Skip to content

data: add Google Play model numbers and codenames to 174 more device records - #361

Merged
Seungpyo1007 merged 1 commit into
developfrom
data/play-ids-round2
Oct 6, 2026
Merged

Seungpyo1007 merged 1 commit into
developfrom
data/play-ids-round2

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Oct 6, 2026 •

Copy link
Copy Markdown
Member

Summary

This is the second round of Google Play identifiers. 174 smartphone/tablet records get model_numbers / codenames from Google Play supported_devices.csv. Only ids are added; no spec value changes.

These come from matcher v5 (follow-up to #359). It indexes the ids merged in #359 for exact model-number matching and adds the round-3 audit fixes.

Write rules added after two blind audits:

  • An id is written only to the record it actually matched (per-path), not to every record of the Play row.
  • A record is skipped when its SoC conflicts with the Play Console SoC.
  • An id is dropped if it names a different record of the same brand, or if it is a marketing name shared across generations.
  • Codenames shorter than 4 characters are dropped (e.g. a13, which belongs to SM-A135F, not SM-A137F).

Blind audit on a fresh 40-row sample: 38 ok, 2 partial. Both partials were the a13 codename case, which the last rule now removes.

New-device rows from this round are not included. Two blind audits on fresh samples measured them at 81–84%, below the 95% bar, so they stay in the review queue.

Refs #296

Closes #295

…for samsung, htc, oppo, alcatel and 6 more brands

174 records get model_numbers/codenames from Google Play supported_devices.csv (ids only; no spec value changes).
Brands: samsung, htc, oppo, alcatel, doogee, xiaomi, acer, lava, lg, motorola

Refs #296
@Seungpyo1007

Copy link
Copy Markdown
Member Author

🔎 Data verification — Tier 0 (offline existence/trust)

Scored by app.verify; posted by TechEngineBot. Informational only — the structural gate (app.validate) is separate and authoritative for merge.

13/13 categories ? 204,132 records ? diff base develop@7ba7964

Changed records in this PR

174 record(s) assessed.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 50
    "Yellow" : 124
    "Red" : 0
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
smartphone 🟩🟩🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨 169 50 119 0 29.6%
tablet 🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 5 0 5 0 0.0%
All 🟩🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨 174 50 124 0 28.7%

Full-dataset baseline

As of 2026-10-06T02:32:59Z (daily verify-status aggregate).

category total green yellow red
brand 2088 122 1966 0
soc 2117 284 837 996
smartphone 92824 18216 74555 53
tablet 3305 293 3011 1
watch 418 96 320 2
pda 112 80 32 0
gpu 2083 1536 547 0
cpu 4628 4340 287 1
laptop 1966 126 1840 0
monitor 231 3 228 0
software 42493 366 42127 0
website 40084 13420 26664 0
device_catalog 11783 0 11783 0
all 204132 38882 164197 1053

green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to verified runs in the scheduled verify-network workflow.

@Seungpyo1007
Seungpyo1007 merged commit aaa6392 into develop Oct 6, 2026
5 checks passed
@Seungpyo1007

Copy link
Copy Markdown
Member Author

TechEngine change review: PASS

13/13 categories ? 204,132 records ? diff base develop@7ba7964

Check Result
python -m app.validate PASS
Changed dump JSON and manifest/index counts PASS
New hard integrity anomalies vs PR base PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 0 169 0 0 0 0
tablet 0 5 0 0 0 0
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 0 0 0 0 0
cpu 0 0 0 0 0 0
laptop 0 0 0 0 0 0
monitor 0 0 0 0 0 0
software 0 0 0 0 0 0
website 0 0 0 0 0 0
device_catalog 0 0 0 0 0 0

Changed record examples

smartphone modified

  • smartphone/alcatel/2013/one-touch-evo-7.json - One Touch Evo 7
  • smartphone/alcatel/2013/one-touch-evo-7/alcatel-one-touch-evo-7-allphones-668-1gb-4gb.json - alcatel One Touch Evo 7
  • smartphone/doogee/2023/s41t/doogee-s41t-4gb-64gb-4g-lte.json - Doogee S41T
  • smartphone/doogee/2023/s41t/doogee-s41t-aitoolbuzz-2331-4gb-64gb-4g-lte.json - Doogee S41T
  • smartphone/doogee/2023/s41t/doogee-s41t-allphones-1784-4gb-64gb-4g-lte.json - Doogee S41T
  • smartphone/htc/2009/dream.json - Dream
  • smartphone/htc/2011/htc-hero-s-htc-kingdom.json - HTC Hero S (HTC Kingdom)
  • smartphone/htc/2012/evo-4g-lte.json - Evo 4G LTE
  • smartphone/htc/2012/evo-4g-lte/htc-evo-4g-lte-1gb-16gb-4g-lte.json - HTC Evo 4G LTE
  • smartphone/htc/2012/evo-4g-lte/htc-evo-4g-lte-aitoolbuzz-3246-1gb-16gb-4g-lte.json - HTC Evo 4G LTE
  • smartphone/htc/2012/evo-4g-lte/htc-evo-4g-lte-allphones-3086-1gb-16gb-4g-lte.json - HTC Evo 4G LTE
  • smartphone/htc/2012/evo-4g-lte/htc-evo-4g-lte-beridzeg45-5317-1gb.json - HTC Evo 4G LTE
  • smartphone/htc/2012/evo-4g-lte/htc-evo-4g-lte-scrapegsma-3952.json - HTC Evo 4G LTE
  • smartphone/htc/2012/evo-4g-lte/htc-evo-4g-lte.json - Htc Evo 4G LTE
  • smartphone/lava/2016/v2-s.json - V2 s
  • ... 154 more

tablet modified

  • tablet/acer/2014/iconia-tab-8-a1-840fhd/acer-iconia-tab-8-a1-840fhd-aitoolbuzz-30-2gb-16gb-2g.json - Acer Iconia Tab 8 A1-840FHD
  • tablet/acer/2014/iconia-tab-8-a1-840fhd/acer-iconia-tab-8-a1-840fhd-scrapegsma-1733.json - Acer Iconia Tab 8 A1-840FHD
  • tablet/acer/2014/iconia-tab-8-a1-840fhd/acer-iconia-tab-8-a1-840fhd.json - Acer Iconia Tab 8 A1-840FHD
  • tablet/alcatel/2013/one-touch-evo-7/alcatel-one-touch-evo-7-aitoolbuzz-210-1gb-4gb-2g.json - alcatel One Touch Evo 7
  • tablet/alcatel/2013/one-touch-evo-7/alcatel-one-touch-evo-7-beridzeg45-1569-1gb.json - alcatel One Touch Evo 7

Heuristic review

  • Heuristic warnings: none found.

@Seungpyo1007

Copy link
Copy Markdown
Member Author

TechEngine validation stats: PASS

13/13 categories ? 204,132 records ? diff base develop@7ba7964

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 2088 123 1965 0 2088 5.9%
soc 2117 284 1833 0 2117 13.4%
smartphone 92824 17235 75589 0 92824 18.6%
tablet 3305 293 3012 0 3305 8.9%
watch 418 98 320 0 418 23.4%
pda 112 68 44 0 112 60.7%
gpu 2083 1496 587 0 2083 71.8%
cpu 4628 4222 406 0 4628 91.2%
laptop 1966 129 1837 0 1966 6.6%
monitor 231 21 210 0 231 9.1%
software 42493 358 42135 0 42493 0.8%
website 40084 14721 25363 0 40084 36.7%
device_catalog 11783 0 11783 0 11783 0.0%
all 204132 39048 165084 0 204132 19.1%

Warning

Tracked verified coverage is below 50% for device_catalog 0.0% (0/11783), software 0.8% (358/42493), brand 5.9% (123/2088), laptop 6.6% (129/1966), tablet 8.9% (293/3305), monitor 9.1% (21/231), soc 13.4% (284/2117), smartphone 18.6% (17235/92824), and 3 more.
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • The integrity gate blocks only hard anomalies introduced by this PR relative to its merge base.
  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py (PR head compared with PR base, changed records only)
loaded CPU=0 GPU=0
Integrity section Flagged lines
structural 0
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 0
CPU cross-source ratio outliers (possible wrong-variant) 0
GPU cross-source ratio outliers + sanity 0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Data collection: new records (workstream)

2 participants