AI Tools Directory

tagtog

, team-first web tool to find, create, maintain, and share datasets - costs $

prodigy

is an annotation tool powered by active learning, costs $

LightTag

Hosted and managed text annotation tool for teams, costs $

GitDox

open source server annotation tool with GitHub version control and validation for XML data and collaborative spreadsheet

Label Studio

Hosted and managed text annotation tool for teams, freemium based, costs $

Datasaur

support various NLP tasks for individual or teams, freemium based

UBIAI

Easy-to-use text annotation tool for teams with most comprehensive auto-annotation features. Supports NER, relations and

Annotation Lab

Free End-to-End No-Code platform for text annotation and DL model training/tuning. Out-of-the-box support for Named Enti

SivaReddy's Dependency Parser

Dependency Parser and Pos Tagger for Kannada, Hindi and Telugu. [Python3 Port](https://github.com/CalmDownKarm/sivareddy

KoalaNLP

Scala library for Korean Natural Language Processing.

KAIST Corpus

A corpus from the Korea Advanced Institute of Science and Technology in Korean.

Chosun Ilbo archive

dataset in Korean from one of the major newspapers in South Korea, the Chosun Ilbo.

KorQuAD

Korean SQuAD dataset with Wiki HTML source. Mentions both v1.0 and v2.1 at the time of adding to Awesome NLP

Hindi Dependency Treebank

A multi-representational multi-layered treebank for Hindi and Urdu

SAIL 2015

Twitter and Facebook labelled sentiment samples in Hindi, Bengali, Tamil, Telugu.

IIT Bombay NLP Resources

Sentiwordnet, Movie and Tourism parallel labelled corpora, polarity labelled sense annotated corpus, Marathi polarity la

Hindi2Vec

and [nlp-for-hindi](https://github.com/goru001/nlp-for-hindi) ULMFIT style languge model

Thai Language Toolkit

Based on a paper by Wirote Aroonmanakun in 2002 with included dataset

VIVOS

a free Vietnamese speech corpus consisting of 15 hours of recording speech by AILab

Large-Scale Colloquial Persian

Large Scale Colloquial Persian Dataset (LSCP) is hierarchically organized in asemantic taxonomy that focuses on multi-ta

PERLEX

The first Persian dataset for relation extraction, which is an expert translated version of the “Semeval-2010-Task-8” da

Persian Syntactic Dependency Treebank

This treebank is supplied for free noncommercial use. For commercial uses feel free to contact us. The number of annotat

Uppsala Persian Dependency Treebank (UPDT)

Dependency-based syntactically annotated corpus.

Best practices for prompt engineering with OpenAI API

A guide by OpenAI that provides best practices for prompt engineering.