Skip to content

feat(data/cpu): weekly ingest - #165

Closed
TechEngineBot wants to merge 1 commit into
developfrom
ingest/cpu-20260824-074654
Closed

feat(data/cpu): weekly ingest#165
TechEngineBot wants to merge 1 commit into
developfrom
ingest/cpu-20260824-074654

Conversation

@TechEngineBot

@TechEngineBot TechEngineBot commented Aug 24, 2026

Copy link
Copy Markdown
Member

Ingestion run summary

  • written: 0
  • skipped (already curated): 46
  • skipped (missing required fields): 4

Skipped (missing required fields)

  • core-2-duo-e6305 — missing: release_date (source)
  • core-2-duo-e6405 — missing: release_date (source)
  • core-2-extreme-x6900-7-8 — missing: release_date (source)
  • core-2-quad-q6400-12 — missing: release_date (source)

Benchmark enrichment summary (passmark)

  • filled: 40
  • unresolved (no exact-variant match / no data): 10
  • skipped (already populated): 205

Filled

  • athlon-64-dual-core-5000-plus — passmark_single=924, passmark_cpu_mark=850
  • athlon-dual-core-4050e — passmark_single=744, passmark_cpu_mark=670
  • athlon-dual-core-4450e — passmark_single=792, passmark_cpu_mark=681
  • athlon-dual-core-4850e — passmark_single=861, passmark_cpu_mark=769
  • mobile-amd-athlon-2500-plus — passmark_single=365, passmark_cpu_mark=241
  • mobile-amd-athlon-64-3200-plus — passmark_single=400, passmark_cpu_mark=326
  • mobile-amd-athlon-64-3400-plus — passmark_single=432, passmark_cpu_mark=333
  • mobile-amd-athlon-64-3700-plus — passmark_single=485, passmark_cpu_mark=356
  • mobile-amd-athlon-64-4000-plus — passmark_single=338, passmark_cpu_mark=313
  • mobile-amd-athlon-xp-m-1600-plus — passmark_single=274, passmark_cpu_mark=169
  • mobile-amd-athlon-xp-m-1800-plus — passmark_single=291, passmark_cpu_mark=193
  • mobile-amd-athlon-xp-m-2000-plus — passmark_single=301, passmark_cpu_mark=196
  • mobile-amd-athlon-xp-m-2200-plus — passmark_single=363, passmark_cpu_mark=237
  • mobile-amd-athlon-xp-m-2400-plus — passmark_single=355, passmark_cpu_mark=225
  • mobile-amd-athlon-xp-m-2500-plus — passmark_single=355, passmark_cpu_mark=226
  • mobile-amd-athlon-xp-m-2600-plus — passmark_single=375, passmark_cpu_mark=241
  • mobile-amd-athlon-xp-m-2800-plus — passmark_single=385, passmark_cpu_mark=238
  • mobile-amd-athlon-xp-m-3000-plus — passmark_single=365, passmark_cpu_mark=238
  • mobile-amd-sempron-2600-plus — passmark_single=316, passmark_cpu_mark=256
  • mobile-amd-sempron-2800-plus — passmark_single=299, passmark_cpu_mark=237
  • mobile-amd-sempron-3100-plus — passmark_single=359, passmark_cpu_mark=277
  • mobile-amd-sempron-3300-plus — passmark_single=391, passmark_cpu_mark=294
  • mobile-amd-sempron-3400-plus — passmark_single=489, passmark_cpu_mark=269
  • mobile-amd-sempron-3500-plus — passmark_single=551, passmark_cpu_mark=269
  • mobile-amd-sempron-3600-plus — passmark_single=618, passmark_cpu_mark=284
  • mobile-amd-sempron-3800-plus — passmark_single=735, passmark_cpu_mark=335
  • amd-opteron-1212 — passmark_single=729, passmark_cpu_mark=593
  • amd-opteron-1214 — passmark_single=831, passmark_cpu_mark=763
  • amd-opteron-1216 — passmark_single=810, passmark_cpu_mark=781
  • amd-opteron-1220 — passmark_single=1077, passmark_cpu_mark=1036
  • amd-opteron-1352 — passmark_single=857, passmark_cpu_mark=1547
  • amd-opteron-1354 — passmark_single=870, passmark_cpu_mark=1635
  • amd-opteron-1356 — passmark_single=918, passmark_cpu_mark=1703
  • amd-opteron-146 — passmark_single=400, passmark_cpu_mark=346
  • amd-opteron-148 — passmark_single=443, passmark_cpu_mark=392
  • amd-opteron-150 — passmark_single=471, passmark_cpu_mark=393
  • amd-opteron-152 — passmark_single=487, passmark_cpu_mark=428
  • amd-opteron-165 — passmark_single=638, passmark_cpu_mark=531
  • amd-opteron-170 — passmark_single=715, passmark_cpu_mark=648
  • amd-opteron-180 — passmark_single=874, passmark_cpu_mark=746

Unresolved (no exact match or source lacks the data)

  • AMD Athlon 64 X2 Dual Core 3800+
  • AMD Athlon 64 X2 Dual Core 4200+
  • AMD Athlon 64 X2 Dual Core 4400+
  • AMD Athlon 64 X2 Dual Core 4600+
  • AMD Athlon 64 X2 Dual Core 4800+
  • AMD Phenom 9600 Quad-Core
  • AMD Turion Dual-Core RM-70
  • AMD Athlon64 X2 Dual Core 4600+
  • AMD TurionX2 Dual Core Mobile RM-70
  • AMD TurionX2 Dual Core Mobile RM-72

Closes #1

@TechEngineBot

Copy link
Copy Markdown
Member Author

🔎 Data verification — Tier 0 (offline existence/trust)

Scored by app.verify; posted by TechEngineBot. Informational only — the structural gate (app.validate) is separate and authoritative for merge.

Changed records in this PR

98 record(s) scored.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 78
    "Yellow" : 20
    "Red" : 0
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
cpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟨 98 78 20 0 79.6%
All 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟨 98 78 20 0 79.6%

Full-dataset baseline

105758 record(s) scored.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 21388
    "Yellow" : 83169
    "Red" : 1201
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
brand 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 207 24 183 0 11.6%
soc 🟩🟨🟨🟨🟨🟨🟥🟥🟥🟥🟥🟥 2104 146 844 1114 6.9%
smartphone 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 93396 17382 75934 80 18.6%
tablet 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 3455 218 3236 1 6.3%
watch 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 433 18 410 5 4.2%
pda 🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨🟨 140 66 74 0 47.1%
gpu 🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨🟨🟨 2030 810 1220 0 39.9%
cpu 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟥 3993 2724 1268 1 68.2%
All 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 105758 21388 83169 1201 20.2%

Hard violations (forced red):

Count Check
1 !boost_ge_base

green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to verified runs in the scheduled verify-network workflow.

@TechEngineBot

Copy link
Copy Markdown
Member Author

TechEngine change review: PASS

Check Result
python -m app.validate PASS
python integrity_check.py TechAPI/data --strict PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 0 0 0 0 0 0
tablet 0 0 0 0 0 0
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 0 0 0 0 0
cpu 16 82 0 15 1 0

Changed record examples

cpu added

  • cpu/intel/2008/consumer/core-2-duo-e8290-14.json - Intel Core 2 Duo E8290 [ 14 ]
  • cpu/intel/2010/consumer/core-i7-660lm.json - Intel Core i7-660LM
  • cpu/intel/2011/consumer/core-i7-2629m.json - Intel Core i7-2629M
  • cpu/intel/2011/consumer/core-i7-2649m.json - Intel Core i7-2649M
  • cpu/intel/2011/consumer/core-i7-2657m.json - Intel Core i7-2657M
  • cpu/intel/2013/consumer/core-i7-4950hq.json - Intel Core i7-4950HQ
  • cpu/intel/2015/consumer/core-i5-5350h.json - Intel Core i5-5350H
  • cpu/intel/2015/consumer/core-i7-5750hq.json - Intel Core i7-5750HQ
  • cpu/intel/2016/consumer/core-i5-6585r.json - Intel Core i5-6585R
  • cpu/intel/2016/consumer/core-i5-6685r.json - Intel Core i5-6685R
  • cpu/intel/2016/consumer/core-i7-6785r.json - Intel Core i7-6785R
  • cpu/intel/2016/consumer/core-i7-6870hq.json - Intel Core i7-6870HQ
  • cpu/intel/2016/consumer/core-i7-6970hq.json - Intel Core i7-6970HQ
  • cpu/intel/2018/consumer/core-i3-8100h.json - Intel Core i3-8100H
  • cpu/intel/2018/consumer/core-i5-8400b.json - Intel Core i5-8400B
  • ... 1 more

cpu modified

  • cpu/amd/2009/consumer/amd-sempron-si-40.json - AMD Sempron SI-40
  • cpu/amd/2009/consumer/amd-sempron-si-42.json - AMD Sempron SI-42
  • cpu/amd/2009/consumer/amd-turion-64-mobile-mk-36.json - AMD Turion 64 Mobile MK-36
  • cpu/amd/2009/consumer/amd-turion-64-mobile-mk-38.json - AMD Turion 64 Mobile MK-38
  • cpu/amd/2009/consumer/amd-turion-64-mobile-ml-28.json - AMD Turion 64 Mobile ML-28
  • cpu/amd/2009/consumer/amd-turion-64-mobile-ml-30.json - AMD Turion 64 Mobile ML-30
  • cpu/amd/2009/consumer/amd-turion-64-mobile-ml-34.json - AMD Turion 64 Mobile ML-34
  • cpu/amd/2009/consumer/amd-turion-64-mobile-ml-37.json - AMD Turion 64 Mobile ML-37
  • cpu/amd/2009/consumer/amd-turion-64-mobile-ml-40.json - AMD Turion 64 Mobile ML-40
  • cpu/amd/2009/consumer/amd-turion-64-mobile-ml-42.json - AMD Turion 64 Mobile ML-42
  • cpu/amd/2009/consumer/amd-turion-64-mobile-ml-44.json - AMD Turion 64 Mobile ML-44
  • cpu/amd/2009/consumer/amd-turion-64-mobile-mt-30.json - AMD Turion 64 Mobile MT-30
  • cpu/amd/2009/consumer/amd-turion-64-mobile-mt-32.json - AMD Turion 64 Mobile MT-32
  • cpu/amd/2009/consumer/amd-turion-64-mobile-mt-34.json - AMD Turion 64 Mobile MT-34
  • cpu/amd/2009/consumer/amd-turion-64-mobile-mt-37.json - AMD Turion 64 Mobile MT-37
  • ... 67 more

Heuristic review

  • Added records by manufacturer/brand: intel: 16
  • Added records by source class: other: 16
  • Heuristic warnings: none found.

@TechEngineBot

Copy link
Copy Markdown
Member Author

TechEngine validation stats: PASS

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 207 24 183 0 207 11.6%
soc 2104 146 1958 0 2104 6.9%
smartphone 93396 17384 76012 0 93396 18.6%
tablet 3455 218 3237 0 3455 6.3%
watch 433 18 415 0 433 4.2%
pda 140 66 74 0 140 47.1%
gpu 2030 809 1221 0 2030 39.9%
cpu 3993 2664 1329 0 3993 66.7%
all 105758 21329 84429 0 105758 20.2%

Warning

Tracked verified coverage is below 50% for watch 4.2% (18/433), tablet 6.3% (218/3455), soc 6.9% (146/2104), brand 11.6% (24/207), smartphone 18.6% (17384/93396), all 20.2% (21329/105758), gpu 39.9% (809/2030), pda 47.1% (66/140).
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py --strict
loaded CPU=3993 GPU=2030
✅ integrity gate: no hard anomalies.
Integrity section Flagged lines
structural 0
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 152
GPU cross-source ratio outliers + sanity 18

@Seungpyo1007

Copy link
Copy Markdown
Member

Duplicate: the same 40 files as #169, re-ingested each week because nothing merged in between. Superseded by #169.

@github-project-automation github-project-automation Bot moved this from In Progress to Done in TechAPI-Project Sep 8, 2026
@Seungpyo1007
Seungpyo1007 deleted the ingest/cpu-20260824-074654 branch September 8, 2026 02:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Massive dataset rebuild: CPU + brand + GPU + smartphone + SoC (1989-2026)

2 participants