modifications/additions to llm_qa_direct_only and parse_scenario_womd. also incorporating grade files and corresponding generated graphs#6

Open

dataei wants to merge 49 commits into

mainfrom

Commits on Feb 26, 2025

first

dataei
authored and
Denise Ataei
committed
k

dataei
authored and
Denise Ataei
committed
merge conflicts
Denise Ataei
committed
merge conflicts
Denise Ataei
committed

Commits on Feb 27, 2025

comment test
Denise Ataei
committed

Commits on Feb 28, 2025

first

dataei
authored and
Denise Ataei
committed
k

dataei
authored and
Denise Ataei
committed
merge conflicts
Denise Ataei
committed
merge conflicts
Denise Ataei
committed
comment test
Denise Ataei
committed
first

dataei
authored and
Denise Ataei
committed
modifying to deepinfra instead of deepseek and changed file path to training
Denise Ataei
committed
debugging with print statements, planning direct prompting variables 2,4,6shot
Denise Ataei
committed
added 2,4,6,8 shot direct prompting and moved writing script out of for loop to prevent repeated output in llm_qa_direct_only.py. changed index in run_experiments.py to work with 8 interaction scen…
Denise Ataei
committed
Merge branch 'dev_denise' of https://github.com/AugmentedDesignLab/CarPlanningProblemGen into dev_denise
Denise Ataei
committed

Commits on Mar 8, 2025

Commits on Mar 23, 2025

ran more experiments to find pattern in small, medium, large file sizes with gpt4o-mini in addition to creating draft of script comparing experiment results in bar chart
Denise Ataei
committed

Commits on Mar 25, 2025

Commits on Mar 26, 2025

Commits on Mar 27, 2025

Commits on Apr 8, 2025

Commits on Apr 9, 2025

Commits on Apr 10, 2025

reorganizing files and adding boxplots + creation script. fixed sizing parameters in parse scenario womd.
Denise Ataei
committed

Commits on Apr 22, 2025

embedding space analysis, parallel experiments
ishaan95
committed

Commits on Apr 23, 2025

Modifications to model names and corresponding evals can now be completed easily.

ishaan95
authored and
Denise Ataei
committed
latest

ishaan95
authored and
Denise Ataei
committed
Removing planner import

ishaan95
authored and
Denise Ataei
committed
add grades folder to gitignore

ishaan95
authored and
Denise Ataei
committed
Calculate the most similar scenarios to a given index

ishaan95
authored and
Denise Ataei
committed
Search similar scenarios to a specific index and with respect to a given range

ishaan95
authored and
Denise Ataei
committed
embedding space analysis, parallel experiments

ishaan95
authored and
Denise Ataei
committed
experimenting w/ llm as a judge prompting
Denise Ataei
committed
placed data collection outside of project folder
Denise Ataei
committed
renamed box plotting script, added negative prompting (concise) to run 60 experiments
Denise Ataei
committed
modifications to negative prompting
Denise Ataei
committed
merge commit
ishaan95
committed

Commits on Apr 24, 2025

Reorganized the llm evaluation script
ishaan95
committed

Commits on Apr 30, 2025

modified parse scenario to my file path
Denise Ataei
committed
lecturing prompting has been added. PDDL testing for the latest version of the code has been done.

ishaan95
authored and
Denise Ataei
committed