LLM Eval Suite

Reviewed matches are labeled. Other suggestions come from a shared subcategory, use case, source listing or the same category. Compare features and current plans before choosing.

Product
LLM Tracker A Kanban board for LLMs to keep their humans up to date
LLMGenerator Generate llms.txt Files for AI Visibility
Praka.ai Deploy OpenClaw instantly and aggregate LLM API
Fortaify Local AI models for LLMs, TTS and image generation
GPTLocalhost Use local LLMs in Microsoft Word for complete privacy
LocPilot for Word Empower Your Team to Use Local LLMs in Microsoft Word.
LLMS Central Track AI bots and manage llms.txt rules for your website
Wisdom Gate Wisdom Gate. The unified interface for LLMs.

Selected by category and available use-case details. A topic match does not establish equivalent features.

Product
aare.ai - Automated Reasoning for LLM Automates reasoning for large language model verification
LLMO: Optimization Guide for Brands Increase brand visibility in ChatGPT Gemini and AI tools
Hamel Husain Hamel.dev — Deep dives into LLMs, evals, and ML practice
Hi LLMs The Standard LLMs.txt Generator
AI-RADAR Real-time AI news and analysis on LLMs and hardware
OAPhub Connect LLMs and AI agents without technical expertise

Added to this directory in the past 30 days. Dates refer to the directory listing, not the product launch.

Product
APIShare Free LLM API rankings & API marketplace
BloombergGPT Finance-focused large language model
GrowReddit Turn Reddit into a recommendation engine for LLMs and buyers.
Daytradingbench I gave 11 LLMs my trading strategy to see which one profits

Profiles grouped by topic. This does not confirm an offer, availability or a connection to this profile.

Profile
AI with Surya Hi, I’m Surya!
Sabrina Ramonov 🍄 My mission is to teach 10 million people AI, for free.
Sam Witteveen HI my name is Sam Witteveen, I have worked with Deep Learning since 2014 and with Transformers and LLM since 2018.

Shows and channels grouped by topic. A recommendation does not mean this profile was featured or endorsed.

Show
Nate Herk | AI Automation YouTube · 1.0M subscribers
Automation-Tribe YouTube · 15K subscribers
Elvito | AI Automation and tools YouTube · 1K subscribers

Retold founder accounts from startups in the same category, each linked to the original.

Story
T Tecton: The Uber Michelangelo Team That Tried to Give Every Company a Feature Store Tecton was founded in 2019 by Mike Del Balso, Kevin Stumpf and Jeremy Hermann, who had built Michelangelo, Uber's internal machine learning platform, and its feature store. Seeing data science teams wait months to get mo
Metabase: How an Internal Tool Built by Expa's CTO Became an Open-Source Business Intelligence Company Metabase began as an internal analytics tool that Sameer Al-Sakran, then CTO of the company studio Expa, built so Expa and its startups could put key data in the hands of their teams. Spun out as a separate company with
Weights & Biases: How an OpenAI Internship and 20 Weekly Users Became a Billion-Dollar ML Tools Company Weights & Biases was founded by Lukas Biewald, Chris Van Pelt and Shawn Lewis after Biewald, who had co-founded the training-data company CrowdFlower with Van Pelt, took an unpaid internship at OpenAI and struggled to ke
Speakeasy: A Physicist Turned Engineering Director Set Out to Give Every API the Tooling Stripe Built In-House Speakeasy was founded in 2022 by Sagar Batchu and Simon Yu. Batchu studied physics, moved into software, and spent years at LiveRamp, where he helped build the London engineering team and worked on internal developer too

Subcategories in the same part of the directory, with the number of listed products.