Issues

• CI: run the test suite on GitHub Actions against the pinned ClimateEval

  infrastructure
  climate-analytics-lab/ClimateBench2#124 · Filter by author duncanwp opened on Oct 3, 2026

• Tier III: first real PMIP4 run of the paleo stanzas, and a PMIP4 comparison pool

  data-stagingtier-iii
  climate-analytics-lab/ClimateBench2#123 · Filter by author duncanwp opened on Oct 3, 2026

• Tier III mid-Holocene: score Temp12k with a latitude-band comparison

  metrictier-iii
  climate-analytics-lab/ClimateBench2#122 · Filter by author duncanwp opened on Oct 3, 2026

• Tier II Extended: surface-flux scoring (pattern / seasonal cycle + in-situ sites)

  metrictier-iiupstream-climateeval
  climate-analytics-lab/ClimateBench2#121 · Filter by author duncanwp opened on Oct 3, 2026

• Submission metadata and a pre-flight completeness check

  enhancementinfrastructure
  climate-analytics-lab/ClimateBench2#120 · Filter by author duncanwp opened on Oct 3, 2026

• Stage the observational references that are merged upstream but absent from the staged root

  data-stagingtier-iiupstream-climateeval
  climate-analytics-lab/ClimateBench2#119 · Filter by author duncanwp opened on Oct 3, 2026

• Tests: behavioural unit tests for the fixed-SST gates (I.4a GFMIPPatchGate, I.4b Amip4xCO2ERFGate)

  infrastructuretier-i
  climate-analytics-lab/ClimateBench2#118 · Filter by author duncanwp opened on Oct 3, 2026

• Pinned ClimateEval (b0e941c) lacks the Nino34 and sea-ice-extent fixes the shipped suites use

  bugupstream-climateeval
  climate-analytics-lab/ClimateBench2#117 · Filter by author duncanwp opened on Oct 3, 2026

• Tier II: treat observational uncertainty consistently in fair CRPS and the consistency test (perturb members, Ferro 2017)

  infrastructureneeds-decisiontier-ii
  climate-analytics-lab/ClimateBench2#116 · Filter by author duncanwp opened on Oct 3, 2026
  1

• Tier II daily suite: Perkins intensity-PDF score for pr against IMERG (dropped from the Sept 2026 run for cost)

  metricneeds-decisiontier-ii
  climate-analytics-lab/ClimateBench2#115 · Filter by author duncanwp opened on Sep 28, 2026
  1

• Infrastructure: Tier I/II/III aggregated scoring and weighting

  infrastructureneeds-decision
  climate-analytics-lab/ClimateBench2#100 · Filter by author duncanwp opened on Feb 25, 2026
  2

• Tier III: Large ensemble variability comparison

  data-stagingmetricneeds-decisiontier-iii
  climate-analytics-lab/ClimateBench2#96 · Filter by author duncanwp opened on Feb 25, 2026
  1

• Tier III: Perfect-model experiments (CESM2, MPI-ESM, GISS)

  data-stagingmetrictier-iiiupstream-climateeval
  climate-analytics-lab/ClimateBench2#95 · Filter by author duncanwp opened on Feb 25, 2026
  1

• Tier II: Volcanic response — Pinatubo (1991–1993)

  metricneeds-decisiontier-iiupstream-climateeval
  climate-analytics-lab/ClimateBench2#89 · Filter by author duncanwp opened on Feb 25, 2026
  2