TypeError: get_logs_eval() missing 1 required positional argument: 'log_fp' #70
Description
When I was running run_regression_tests.py, it appears Error get_logs_eval() missing 1 required positional argument: 'log_fp'
I check the implement of get_logs_eval() found that it requires 2 arguments: test_spec: TestSpec, log_fp: str
but in run_regression_tests.py :
def save_passing_tests(output_jsonl_path, input_folder_path, dataset):
ds = load_dataset(dataset)
with jsonlines.open(output_jsonl_path, mode="w") as writer:
for entry in ds["test"]:
instance_id = entry["instance_id"]
log_path = f"{input_folder_path}/test/{instance_id}/test_output.txt"
try:
# obtain the list of tests that were ran
eval_sm, found = get_logs_eval(log_path)
except FileNotFoundError:
print(f"File not found: {log_path}")
continue
there is only 1 argument