AI Tools Directory

AI Town

a virtual town where AI characters live, chat and socialize.

Llama Hub

a repository of data loaders for LlamaIndex (GPT Index) and LangChain

Chroma

Open-source search and retrieval database for AI applications. Vector, full-text, regex, and metadata search. [Self-host

AutoGen | Microsoft

multi-agent conversation framework as a high-level abstraction by Microsoft [[github](https://github.com/microsoft/autog

ChatArena

building multi-agent environments for LLMs

Multi-Agent Research Outline

an interactive eBook that compiles an extensive collection of research papers on large language model (LLM)-based multi-

Eden AI

provides a unique API connected to the AI engines

R Jina

convert websites into Markdown by placing the URL in the search bar

LiveBench

A Challenging, Contamination-Free LLM Benchmark.

LLM Evaluation

research on evaluation of LLMs conducted by Microsoft Research and other collaborated institutes. (Updated at: 2023/10)

LLM Evaluation at Scale – Airtrain

no-code batch compute platform for LLM evaluation and tuning workloads

Evaluating LLMs is a minefield

talk by Princeton professor Arvind Narayanan

LLM Use Case Leaderboard

a leaderboard that features LLM use cases.

LMExamQA

a leaderboard that benchmarks foundation models with Language-Model-as-an-Examiner.

FlowiseAI

"Open source UI visual tool to build your customized LLM flow using LangchainJS, written in Node Typescript/Javascript"

LLMSTXT.NEW

Generate consolidated text files from websites for LLM training and inference – Powered by Firecrawl

Keywords AI

The enterprise-grade software to build, monitor, and improve your AI application. Keywords AI is a full-stack LLM engine

Marvin

AI engineering framework for building natural language interfaces

Instructor

library for structured LLM extraction in Python

MITRE ATLAS™

knowledge base of adversary tactics and techniques based on real-world attack observations and realistic demonstrations

OWASP Top 10 for Large Language Model Applications

the Open Worldwide Application Security Project's list related to LLMs [[Youtube video]](https://www.youtube.com/watch?v

Attacking Large Language Models

an overview of the current attack techniques on LLMs by Marcello Carboni

LangChain Docs

Python library that helps building applications with LLMs through composability

Boring Report

"an app that uses AI to remove sensationalism from the news and makes it boring to read"