All pull requests

Pull requests

• feat(agents): add traffic-light pr review skill

  #313·ko3n1g opened Oct 19, 2026·2 of 5 tasks·

  ·

• Use current year for new Copyright headers

  #310·janEbert opened Oct 16, 2026·

  ·

• Fix wrong filter mapping and staleness detection

  #309·philipp-fischer opened Oct 15, 2026Collaborator·

  ·
  14

• perf(parquet): shuffle by row group and stream rows sequentially

  #308·bbuschkaemper opened Oct 15, 2026Collaborator·

  ·
  8

• AI agent guidelines

  #307·bbuschkaemper opened Oct 15, 2026Collaborator·1 task done·

  ·
  27

• Recreate epochized source iterators after checkpoint restoration

  #300·sylvesterkaczmarek opened Oct 5, 2026·

  ·
  1

  6

• Preserve source position when limiting dataset windows

  #298·sylvesterkaczmarek opened Oct 4, 2026·

  ·
  1

  1

• Bump urllib3 from 2.7.0 to 2.8.0

  dependenciespython:uv
  #293·dependabot[bot] opened Oct 1, 2026Bot·

  ·

• feat(checkpoint): add topology-aware checkpoint migration

  #292·bbuschkaemper opened Oct 1, 2026Collaborator·17/17·

  ·
  3

• feat(task_encoder): add finite data processing pipelines

  #291·bbuschkaemper opened Oct 1, 2026Collaborator·16/17·

  ·
  2

• feat(worker): add logical workers with physical-worker fanout

  #290·bbuschkaemper opened Oct 1, 2026Collaborator·15/17·

  ·
  2

• feat(blending): add sample-size based dynamic blending

  #289·bbuschkaemper opened Oct 1, 2026Collaborator·14/17·

  ·
  3

• feat(packing): add pushback, partial-sample carryover, packing groups and streaming packing

  #288·bbuschkaemper opened Oct 1, 2026Collaborator·13/17·

  ·

• feat(recipe): add byte-range and custom auxiliary filestore protocols

  #287·bbuschkaemper opened Oct 1, 2026Collaborator·12/17·

  ·
  2

• feat(flavors): add Parquet dataset format

  #286·bbuschkaemper opened Oct 1, 2026Collaborator·11/17·

  ·
  1

• feat(jsonl): add multi-shard JSONL datasets and index freshness checks

  #285·bbuschkaemper opened Oct 1, 2026Collaborator·10/17·

  ·

• feat(flavors): add Megatron-LM BinIdx dataset format

  #284·bbuschkaemper opened Oct 1, 2026Collaborator·9/17·

  ·
  8

• feat(flavors): add prepared filter indexes and EPath mapped arrays

  #283·bbuschkaemper opened Oct 1, 2026Collaborator·8/17·

  ·
  4

• Bump pyjwt from 2.13.0 to 2.15.0

  dependenciespython:uv
  #274·dependabot[bot] opened Oct 1, 2026Bot·

  ·

• [WIP] Parquet optimizations

  #273·bbuschkaemper opened Sep 29, 2026Collaborator·

  ·

• Preserve cached values and provenance on repeated lazy reads

  #272·sylvesterkaczmarek opened Sep 25, 2026·

  ·
  1

  6

• Keep watchdog diagnostics running when local values cannot be printed

  #269·rksharma-owg opened Sep 11, 2026·

  ·
  1

  1

• Coalesce duplicate leaf datasets in weighted blends

  #268·sylvesterkaczmarek opened Sep 10, 2026·

  ·
  1

  5

• introduce SafeUnpickler

  #265·dimapihtar opened Sep 5, 2026·

  ·
  10

• introduce torch safe globals

  #264·dimapihtar opened Sep 5, 2026·

  ·
  2