Issues

• Ray backend creates per-worker venvs that fill disk and crash with concurrent experiments

  ServiceNow/AgentLab#331 · Filter by author xhluca opened on Mar 28, 2026

• Qwen3 Integration

  ServiceNow/AgentLab#329 · Filter by author kangqi-ni opened on Feb 16, 2026

• Support LiteLLM to manage LLM APIs

  ServiceNow/AgentLab#324 · Filter by author HenryPengZou opened on Jan 4, 2026

• WorkArena L3 evaluation never stops running

  ServiceNow/AgentLab#323 · Filter by author lakshya-skyfall opened on Dec 23, 2025

• Mind2Web-live availability

  ServiceNow/AgentLab#321 · Filter by author G-JWLee opened on Dec 18, 2025
  1

• workarena_l3 benchmark not found

  ServiceNow/AgentLab#320 · Filter by author lakshya-skyfall opened on Dec 15, 2025
  1

• Add new experiments/tasks

  ServiceNow/AgentLab#297 · Filter by author fbaltor opened on Sep 22, 2025
  1

• highlevel_action_parser does not parse # properly

  bug
  ServiceNow/AgentLab#296 · Filter by author xhluca opened on Sep 16, 2025
  5

• Fail to Reproduce WebArena Results with GenericAgent-GPT-4o

  bug
  ServiceNow/AgentLab#249 · Filter by author bpucla opened on May 22, 2025
  1

• Hanging tasks not killed w/ parallel runs on the same machine

  bug
  ServiceNow/AgentLab#231 · Filter by author jardinetsouffleton opened on Mar 14, 2025
  

• (maybe) Add ecologits to metrics

  enhancementgood first issue
  ServiceNow/AgentLab#199 · Filter by author recursix opened on Jan 9, 2025
  1

• Remove non hashable arguements from agents when loading in inspect_results.py

  help wantedquestion
  ServiceNow/AgentLab#188 · Filter by author recursix opened on Dec 18, 2024
  

• Removing global to make it gradio usable across multiple sessions

  enhancementgood first issue
  ServiceNow/AgentLab#186 · Filter by author xhluca opened on Dec 18, 2024
  7

• unit test the readme

  documentation
  ServiceNow/AgentLab#176 · Filter by author recursix opened on Dec 5, 2024
  

• Prepare all SequentialStudies

  bughelp wanted
  ServiceNow/AgentLab#162 · Filter by author TLSDC opened on Nov 29, 2024
  2

  

• better xray interaction on unfinished tasks or failed tasks

  enhancementgood first issue
  ServiceNow/AgentLab#133 · Filter by author recursix opened on Nov 16, 2024

• better xray integration (nice to have)

  enhancementgood first issue
  ServiceNow/AgentLab#132 · Filter by author recursix opened on Nov 16, 2024

• test if reproduce study still works

  invalid
  ServiceNow/AgentLab#75 · Filter by author recursix opened on Oct 18, 2024
  

• Bring back ablation study and random search

  ServiceNow/AgentLab#74 · Filter by author recursix opened on Oct 18, 2024
  

• Automatic upload traces to hugging-face

  enhancement
  ServiceNow/AgentLab#53 · Filter by author recursix opened on Oct 7, 2024
  10