Benchmarks run with PageIndex, with what is needed to recompute their results: questions, code, every answer and model call, bills and grades. Each folder is one benchmark and stands on its own.
Each benchmark has a README.md with its results and how to reproduce them, a METHOD.md, the data in data/ and
the generated tables and charts in results/.
Accuracy vs. cost of 37 configurations of 21 LLMs answering 100 questions over 40 Form 10-K filings from 8 companies, with PageIndex doing the retrieval.
Accuracy
Accuracy vs. cost
