Skip to content
#

open-benchmark

Star

Here are 10 public repositories matching this topic...

openbenchmarks-labs / document-processing

Star 6

Open, independent benchmark on document parsing APIs and frontier VLMs for AI agents and RAG: does a struck-out clause in a redlined contract PDF survive the parse? Open source code + open data. LlamaParse, Reducto, Datalab, Extend, Pulse, Mistral OCR, GPT-6 Astra, Claude Fable 5.1.

python benchmark ocr leaderboard open-data contracts pdf-parsing evaluation-framework ai-agents document-processing rag legal-tech reducto llm document-parsing llamaparse mistral-ocr tracked-changes open-benchmark independent-benchmark
  • Updated Sep 26, 2026
  • Python

openbenchmarks-labs / factual-lookup-company-news-search

Star 5

Open, independent benchmark on web search APIs for AI agents - factual lookup on 300 company news questions, ranked by cost per 1,000 correct answers. TinyFish, Parallel, Perplexity, Linkup, Firecrawl, Brave, You, Exa, Tavily, Google SERP.

python benchmark leaderboard open-data search-api evaluation-framework ai-agents web-search news-api linkup exa perplexity brave-search llm-evaluation tavily firecrawl company-news tinyfish open-benchmark independent-benchmark
  • Updated Sep 16, 2026
  • Python

openbenchmarks-labs / inference

Star 5

Open, independent benchmark on LLM inference providers: same GLM 5.3 Flash, 600 paired requests each. Latency, tokens per second and task success. Baseten, DeepInfra, Fireworks AI, Modal, Nebius, Novita AI, Parasail, Telnyx, Together AI, Z.AI. Python runner and public data.

python benchmark latency leaderboard modal evaluation-framework telnyx inference-benchmark llm llm-inference z-ai baseten together-ai deepinfra novita-ai nebius parasail fireworks-ai open-benchmark independent-benchmark
  • Updated Sep 5, 2026
  • Python

openbenchmarks-labs / web-search-for-coding-agents

Star 4

Open, independent benchmark of web search APIs for coding agents: Exa, Parallel, Perplexity, Firecrawl, Tavily, Linkup, Brave, You, TinyFish. Scored on grounded task completion against held-out enterprise docs tickets. Search-only and search+fetch boards, model held constant.

python benchmark leaderboard open-data search-api evaluation-framework ai-agents web-search linkup exa perplexity rag brave-search llm llm-evaluation tavily coding-agents firecrawl open-benchmark independent-benchmark
  • Updated Sep 16, 2026
  • Python

openbenchmarks-labs / company-news

Star 4

Open, independent benchmark on company news APIs for AI agents - web search APIs vs dedicated news indexes on 300 company news questions, ranked by cost per 1,000 correct answers. Exa, Parallel, Perplexity, Brave, Firecrawl, Linkup, You, TinyFish, Tavily, Google SERP, Seltz, PredictLeads, Autobound, Datahyena.

python benchmark leaderboard open-data search-api evaluation-framework ai-agents web-search news-api exa perplexity brave-search llm tavily firecrawl company-news open-benchmark independent-benchmark predictleads seltz
  • Updated Sep 16, 2026
  • Python

openbenchmarks-labs / multi-turn-company-search

Star 2

Open, independent benchmark on web search APIs for deep research agents - unlike BrowseComp, this is a benchmark on real user workflows that are not memorized by models. Exa, Parallel, Perplexity, Linkup, Tavily, Firecrawl, Brave, You, TinyFish, Seltz, Google SERP.

python benchmark open-data search-api evaluation-framework ai-agents web-search linkup exa perplexity brave-search llm llm-evaluation tavily firecrawl research-agents deep-research browsecomp open-benchmark independent-benchmark
  • Updated Sep 16, 2026
  • Python

KartikeyaGangwar / lid-driven-cavity-cfd

Star 1

High-resolution 2D lid-driven cavity CFD solver & 30 open benchmark datasets (Re = 100 to 100,000, grids up to 1025x1025). Features O(N^2 log N) DST-I Poisson solver, vectorized ADI, pure central differencing, Batchelor core verification, and research preprint submitted to Computers & Fluids.

python scientific-computing finite-difference cfd navier-stokes computational-fluid-dynamics lid-driven-cavity streamfunction-vorticity vortex-shedding open-benchmark high-reynolds-number spectral-poisson-solver batchelor-theorem
  • Updated Oct 6, 2026
  • Python

Add this topic to your repo

To associate your repository with the open-benchmark topic, visit your repo's landing page and select "manage topics."

Learn more