Skip to content

feat(data/cpu): weekly ingest - #372

Open
Seungpyo1007 wants to merge 1 commit into
developfrom
ingest/cpu-20261026-133032
Open

Seungpyo1007 wants to merge 1 commit into
developfrom
ingest/cpu-20261026-133032

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Oct 26, 2026 •

Copy link
Copy Markdown
Member

Ingestion run summary

  • written: 3
  • skipped (already curated): 22
  • skipped (missing required fields): 25

Added

  • cpu/intel/2025/consumer/core-ultra-7-265u.json — Intel Core Ultra 7 265U (source)
  • cpu/intel/2025/consumer/core-ultra-7-255u.json — Intel Core Ultra 7 255U (source)
  • cpu/intel/2025/consumer/core-ultra-5-235u.json — Intel Core Ultra 5 235U (source)

Skipped (missing required fields)

  • xeon-6-6990e — missing: threads (source)
  • xeon-6-6980e — missing: threads (source)
  • xeon-6-6970e — missing: threads (source)
  • xeon-6-6960e — missing: threads (source)
  • core-ultra-9-285t — missing: threads (source)
  • core-ultra-7-265 — missing: threads (source)
  • core-ultra-7-265t — missing: threads (source)
  • core-ultra-5-245 — missing: threads (source)
  • core-ultra-5-245t — missing: threads (source)
  • core-ultra-5-235t — missing: threads (source)
  • core-ultra-3-205 — missing: threads (source)
  • core-ultra-7-265hx — missing: threads (source)
  • core-ultra-7-255hx — missing: threads (source)
  • core-ultra-7-251hx — missing: threads (source)
  • core-7-245hx — missing: threads (source)
  • core-ultra-5-245hx — missing: threads (source)
  • core-ultra-5-235hx — missing: threads (source)
  • core-ultra-9-285h — missing: threads (source)
  • core-ultra-7-265h — missing: threads (source)
  • core-ultra-5-235h — missing: threads (source)
    … and 5 more.

Benchmark enrichment summary (passmark)

  • filled: 14
  • unresolved (no exact-variant match / no data): 36
  • skipped (already populated): 1180

Filled

  • amd-phenom-9600-quad-core — passmark_single=892, passmark_cpu_mark=1607
  • athlon-64-dual-core-5600-plus — passmark_single=993, passmark_cpu_mark=875
  • ryzen-embedded-v1780b — passmark_single=1940, passmark_cpu_mark=7800
  • ryzen-5-1600-af — passmark_single=2063, passmark_cpu_mark=12242
  • ryzen-embedded-r1102g — passmark_single=603, passmark_cpu_mark=908
  • ryzen-embedded-v2546 — passmark_single=2060, passmark_cpu_mark=12743
  • ryzen-5-6600hs — passmark_single=3313, passmark_cpu_mark=19801
  • ryzen-embedded-v3c14 — passmark_single=2816, passmark_cpu_mark=11812
  • ryzen-embedded-v3c18i — passmark_single=2413, passmark_cpu_mark=12420
  • ryzen-embedded-v3c48 — passmark_single=2804, passmark_cpu_mark=20203
  • ryzen-5-7535h — passmark_single=2114, passmark_cpu_mark=14065
  • ryzen-5-7540u — passmark_single=3488, passmark_cpu_mark=18393
  • ryzen-5-7545u — passmark_single=3725, passmark_cpu_mark=19889
  • ryzen-5-7640hs — passmark_single=3636, passmark_cpu_mark=22687

Unresolved (no exact match or source lacks the data)

  • AMD Athlon 64 X2 Dual Core 3800+
  • AMD Athlon 64 X2 Dual Core 4200+
  • AMD Athlon 64 X2 Dual Core 4400+
  • AMD Athlon 64 X2 Dual Core 4600+
  • AMD Athlon 64 X2 Dual Core 4800+
  • AMD Turion Dual-Core RM-70
  • AMD Athlon64 X2 Dual Core 4600+
  • AMD TurionX2 Dual Core Mobile RM-70
  • AMD TurionX2 Dual Core Mobile RM-72
  • AMD Opteron 2374 HE
  • AMD Opteron 6134
  • AMD Opteron 2387
  • AMD Opteron 6278
  • AMD Turion Dual-Core RM-74
  • AMD Opteron 8356
  • AMD Opteron 8378
  • AMD Opteron 2382
  • AMD Ryzen 3 1300
  • AMD EPYC 7401
  • AMD EPYC 3255
  • AMD EPYC 3301
  • AMD EPYC 3401
  • AMD Ryzen 7 Extreme Edition
  • AMD Ryzen 5 4680U
  • AMD Ryzen 5 5600HS
  • AMD Ryzen 7 4980U
  • AMD 4800S
  • AMD Ryzen 3 5125C
  • AMD Ryzen 9 6980HS
  • AMD Ryzen Embedded V3C16
  • AMD Ryzen Embedded V3C44
  • AMD EPYC 7K83
  • AMD EPYC 7373X
  • AMD Ryzen Threadripper PRO 5985WX
  • AMD Ryzen 3 5100
  • AMD Ryzen 5 7640H

Closes #295

@github-actions github-actions Bot added data Dataset changes enhancement New feature or request labels Oct 26, 2026
@Seungpyo1007 Seungpyo1007 moved this from Todo to In Progress in TechAPI-Project Oct 26, 2026
@Seungpyo1007

Copy link
Copy Markdown
Member Author

🔎 Data verification — Tier 0 (offline existence/trust)

Scored by app.verify; posted by TechEngineBot. Informational only — the structural gate (app.validate) is separate and authoritative for merge.

13/13 categories ? 213,652 records ? diff base develop@db1dea0

Changed records in this PR

17 record(s) assessed.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 17
    "Yellow" : 0
    "Red" : 0
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
cpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 17 17 0 0 100.0%
All 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 17 17 0 0 100.0%

Full-dataset baseline

As of 2026-10-06T12:12:50Z (daily verify-status aggregate).

category total green yellow red
brand 3022 122 2900 0
soc 2117 284 837 996
smartphone 92824 18216 74555 53
tablet 3305 293 3011 1
watch 418 96 320 2
pda 112 80 32 0
gpu 2083 1536 547 0
cpu 4628 4340 287 1
laptop 1966 126 1840 0
monitor 231 3 228 0
software 42493 366 42127 0
website 40084 13420 26664 0
device_catalog 20366 0 20366 0
all 213649 38882 173714 1053

green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to verified runs in the scheduled verify-network workflow.

@Seungpyo1007

Copy link
Copy Markdown
Member Author

TechEngine change review: PASS

13/13 categories ? 213,652 records ? diff base develop@db1dea0

Check Result
python -m app.validate PASS
Changed dump JSON and manifest/index counts PASS
New hard integrity anomalies vs PR base PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 0 0 0 0 0 0
tablet 0 0 0 0 0 0
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 0 0 0 0 0
cpu 3 14 0 0 3 0
laptop 0 0 0 0 0 0
monitor 0 0 0 0 0 0
software 0 0 0 0 0 0
website 0 0 0 0 0 0
device_catalog 0 0 0 0 0 0

Changed record examples

cpu added

  • cpu/intel/2025/consumer/core-ultra-5-235u.json - Intel Core Ultra 5 235U
  • cpu/intel/2025/consumer/core-ultra-7-255u.json - Intel Core Ultra 7 255U
  • cpu/intel/2025/consumer/core-ultra-7-265u.json - Intel Core Ultra 7 265U

cpu modified

  • cpu/amd/2008/consumer/amd-phenom-9600-quad-core.json - AMD Phenom 9600 Quad-Core
  • cpu/amd/2010/consumer/athlon-64-dual-core-5600-plus.json - Athlon 64 Dual Core 5600+
  • cpu/amd/2018/consumer/ryzen-embedded-v1780b.json - AMD Ryzen Embedded V1780B
  • cpu/amd/2019/consumer/ryzen-5-1600-af.json - AMD Ryzen 5 1600 (AF)
  • cpu/amd/2020/consumer/ryzen-embedded-r1102g.json - AMD Ryzen Embedded R1102G
  • cpu/amd/2020/consumer/ryzen-embedded-v2546.json - AMD Ryzen Embedded V2546
  • cpu/amd/2022/consumer/ryzen-5-6600hs.json - AMD Ryzen 5 6600HS
  • cpu/amd/2022/consumer/ryzen-embedded-v3c14.json - AMD Ryzen Embedded V3C14
  • cpu/amd/2022/consumer/ryzen-embedded-v3c18i.json - AMD Ryzen Embedded V3C18I
  • cpu/amd/2022/consumer/ryzen-embedded-v3c48.json - AMD Ryzen Embedded V3C48
  • cpu/amd/2023/consumer/ryzen-5-7535h.json - AMD Ryzen 5 7535H
  • cpu/amd/2023/consumer/ryzen-5-7540u.json - AMD Ryzen 5 7540U
  • cpu/amd/2023/consumer/ryzen-5-7545u.json - AMD Ryzen 5 7545U
  • cpu/amd/2023/consumer/ryzen-5-7640hs.json - AMD Ryzen 5 7640HS

Heuristic review

  • Added records by manufacturer/brand: intel: 3
  • Added records by source class: other: 3
  • Heuristic warnings: none found.

@Seungpyo1007

Copy link
Copy Markdown
Member Author

TechEngine validation stats: PASS

13/13 categories ? 213,652 records ? diff base develop@db1dea0

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 3022 123 2899 0 3022 4.1%
soc 2117 284 1833 0 2117 13.4%
smartphone 92824 17235 75589 0 92824 18.6%
tablet 3305 293 3012 0 3305 8.9%
watch 418 98 320 0 418 23.4%
pda 112 68 44 0 112 60.7%
gpu 2083 1496 587 0 2083 71.8%
cpu 4631 4222 409 0 4631 91.2%
laptop 1966 129 1837 0 1966 6.6%
monitor 231 21 210 0 231 9.1%
software 42493 358 42135 0 42493 0.8%
website 40084 14721 25363 0 40084 36.7%
device_catalog 20366 0 20366 0 20366 0.0%
all 213652 39048 174604 0 213652 18.3%

Warning

Tracked verified coverage is below 50% for device_catalog 0.0% (0/20366), software 0.8% (358/42493), brand 4.1% (123/3022), laptop 6.6% (129/1966), tablet 8.9% (293/3305), monitor 9.1% (21/231), soc 13.4% (284/2117), all 18.3% (39048/213652), and 3 more.
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • The integrity gate blocks only hard anomalies introduced by this PR relative to its merge base.
  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py (PR head compared with PR base, changed records only)
loaded CPU=17 GPU=0
Integrity section Flagged lines
structural 0
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 0
CPU cross-source ratio outliers (possible wrong-variant) 0
GPU cross-source ratio outliers + sanity 0

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: In Progress

Development

Successfully merging this pull request may close these issues.

Data collection: new records (workstream)

2 participants