AI Tools Directory

LMExamQA

a leaderboard that benchmarks foundation models with Language-Model-as-an-Examiner.

LLM Use Case Leaderboard

a leaderboard that features LLM use cases.

Evaluating LLMs is a minefield

talk by Princeton professor Arvind Narayanan

LLM Evaluation at Scale – Airtrain

no-code batch compute platform for LLM evaluation and tuning workloads

LLM Evaluation

research on evaluation of LLMs conducted by Microsoft Research and other collaborated institutes. (Updated at: 2023/10)

LiveBench

A Challenging, Contamination-Free LLM Benchmark.

Eden AI

provides a unique API connected to the AI engines

Multi-Agent Research Outline

an interactive eBook that compiles an extensive collection of research papers on large language model (LLM)-based multi-

ChatArena

building multi-agent environments for LLMs

AI Town

a virtual town where AI characters live, chat and socialize.

AutoGen | Microsoft

multi-agent conversation framework as a high-level abstraction by Microsoft [[github](https://github.com/microsoft/autog

Chroma

Open-source search and retrieval database for AI applications. Vector, full-text, regex, and metadata search. [Self-host

Llama Hub

a repository of data loaders for LlamaIndex (GPT Index) and LangChain

Featured GPTs

curated custom GPTs list for daily tasks

llama.cpp guide

Running LLMs locally, on any hardware, from scratch

DALL·Ery GALL·Ery Resources

DALL·E 2 and AI art prompt resources & tools to inspire beautiful images

Visual Prompt Builder

simple deck of illustrated card to combine modifiers for prompt building

PromptBase | Prompt Marketplace

PromptBase is a marketplace for DALL·E, Midjourney & GPT-3 prompts, where people can sell prompts and make money from th

The Art of ChatGPT Prompting: A Guide to Crafting Clear and Effective Prompts

e-book by Fatih Kadir Akın ([@fkadev](http://twitter.com/fkadev))

60 ChatGPT Prompts for Data Science (Tried, Tested, and Rated)

post by Travis Tang from DataDrivenInvestor

Prompt Engineering | Lil'Log

prompt engineering learning notes by Lilian Weng

Narrow AI

Automated Prompt Engineering and Optimization Platform

MCP Run

a registry of AI tools that can be developed by anyone and used inside any AI application

Composio MCP Server

Connect Cursor, Windsurf, and Claude to 100+ fully managed MCP Servers with built-in auth