Search results

Add tests with real evaluations

changeminor changes in the code or stylesminor changes in the code or styles

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

tests

Status: Open.

#83 In LLMSQL/llmsql-benchmark;

· DzmitryPihulski opened on Mar 5, 2026

Add Leaderboard format save to <code>evaluate()</code> function

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#79 In LLMSQL/llmsql-benchmark;

· DzmitryPihulski opened on Mar 4, 2026

Add <code>inference_function()</code> function

enhancementNew feature or requestNew feature or request

Status: Open.

#78 In LLMSQL/llmsql-benchmark;

· DzmitryPihulski opened on Mar 4, 2026

Delete questions/tables path from inference functions

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#77 In LLMSQL/llmsql-benchmark;

· DzmitryPihulski opened on Mar 4, 2026

Move creation of prompts to a function

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

Feature

#62 In LLMSQL/llmsql-benchmark;

· DzmitryPihulski opened on Dec 9, 2025

Change layout style of sidebars ("Documentation", "On this page") in Docs.

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#48 In LLMSQL/llmsql-benchmark;

· Quarol opened on Dec 5, 2025

Add handaling of LoRA adapters for vllm inference

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

Feature

#41 In LLMSQL/llmsql-benchmark;

· DzmitryPihulski opened on Nov 21, 2025

[Feature] Add separated model_args flag

enhancementNew feature or requestNew feature or request

feature

good first issueGood for newcomersGood for newcomers

Status: Open.

#34 In LLMSQL/llmsql-benchmark;

· DzmitryPihulski opened on Oct 27, 2025

Add exact match metric

enhancementNew feature or requestNew feature or request

feature

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#22 In LLMSQL/llmsql-benchmark;

· DzmitryPihulski opened on Oct 10, 2025