Separate JavaSE reference probes from port compliance by shai-almog · Pull Request #5393 · codenameone/CodenameOne

shai-almog · 2026-07-17T03:55:53Z

What changed

move the JavaSE-only Liquid Glass frame probe out of the cross-port compliance test array
keep the probe available to filtered JavaSE simulator runs through a separate reference-test array
document the boundary between portability tests and simulator reference probes

Root cause

TabsLiquidGlassAnimationScreenshotTest was added to DEFAULT_TEST_CLASSES, but it deliberately skips every portability target and only produces JavaSE reference frames. The Port Status gate correctly rejected it as an unmapped compliance test during website run 29552778957.

Mapping it into the public table would be misleading because every displayed platform would show a skip. This change keeps it out of the portability contract without deleting the reference probe.

Validation

python3 scripts/hellocodenameone/conformance/port_status.py validate
python3 -m unittest -v test_port_status.py from the conformance directory
Hugo minified build
node scripts/website/validate_port_status.mjs /tmp/cn1-port-status-site
Java compilation of all 202 HelloCodenameOne common sources under JDK 17
git diff --check

The full local fixture package continued past Java and Kotlin compilation but later failed in the existing Codename One CSS/CEF tooling; that failure is outside the changed source path.

shai-almog · 2026-07-17T04:12:24Z

Compared 149 screenshots: 149 matched.

Native Android coverage

📊 Line coverage: 11.36% (11896/104735 lines covered) [HTML preview] (artifact android-coverage-report, jacocoAndroidReport/html/index.html)
- Other counters: instruction 10.17% (59003/580199), branch 5.23% (2771/52984), complexity 5.00% (2775/55552), method 7.47% (2136/28591), class 11.73% (477/4065)
- Lowest covered classes
  - kotlin.collections.kotlin.collections.ArraysKt___ArraysKt – 0.00% (0/6327 lines covered)
  - kotlin.collections.unsigned.kotlin.collections.unsigned.UArraysKt___UArraysKt – 0.00% (0/2384 lines covered)
  - org.jacoco.agent.rt.internal_b6258fc.asm.org.jacoco.agent.rt.internal_b6258fc.asm.ClassReader – 0.00% (0/1519 lines covered)
  - kotlin.collections.kotlin.collections.CollectionsKt___CollectionsKt – 0.00% (0/1148 lines covered)
  - org.jacoco.agent.rt.internal_b6258fc.asm.org.jacoco.agent.rt.internal_b6258fc.asm.MethodWriter – 0.00% (0/923 lines covered)
  - kotlin.sequences.kotlin.sequences.SequencesKt___SequencesKt – 0.00% (0/730 lines covered)
  - com.google.common.cache.com.google.common.cache.LocalCache$Segment – 0.00% (0/726 lines covered)
  - kotlin.text.kotlin.text.StringsKt___StringsKt – 0.00% (0/623 lines covered)
  - org.jacoco.agent.rt.internal_b6258fc.asm.org.jacoco.agent.rt.internal_b6258fc.asm.Frame – 0.00% (0/564 lines covered)
  - kotlin.collections.kotlin.collections.ArraysKt___ArraysJvmKt – 0.00% (0/495 lines covered)

✅ Native Android screenshot tests passed.

Native Android coverage

📊 Line coverage: 11.36% (11896/104735 lines covered) [HTML preview] (artifact android-coverage-report, jacocoAndroidReport/html/index.html)
- Other counters: instruction 10.17% (59003/580199), branch 5.23% (2771/52984), complexity 5.00% (2775/55552), method 7.47% (2136/28591), class 11.73% (477/4065)
- Lowest covered classes
  - kotlin.collections.kotlin.collections.ArraysKt___ArraysKt – 0.00% (0/6327 lines covered)
  - kotlin.collections.unsigned.kotlin.collections.unsigned.UArraysKt___UArraysKt – 0.00% (0/2384 lines covered)
  - org.jacoco.agent.rt.internal_b6258fc.asm.org.jacoco.agent.rt.internal_b6258fc.asm.ClassReader – 0.00% (0/1519 lines covered)
  - kotlin.collections.kotlin.collections.CollectionsKt___CollectionsKt – 0.00% (0/1148 lines covered)
  - org.jacoco.agent.rt.internal_b6258fc.asm.org.jacoco.agent.rt.internal_b6258fc.asm.MethodWriter – 0.00% (0/923 lines covered)
  - kotlin.sequences.kotlin.sequences.SequencesKt___SequencesKt – 0.00% (0/730 lines covered)
  - com.google.common.cache.com.google.common.cache.LocalCache$Segment – 0.00% (0/726 lines covered)
  - kotlin.text.kotlin.text.StringsKt___StringsKt – 0.00% (0/623 lines covered)
  - org.jacoco.agent.rt.internal_b6258fc.asm.org.jacoco.agent.rt.internal_b6258fc.asm.Frame – 0.00% (0/564 lines covered)
  - kotlin.collections.kotlin.collections.ArraysKt___ArraysJvmKt – 0.00% (0/495 lines covered)

Benchmark Results

Detailed Performance Metrics

Metric	Duration
SIMD kernel backend	scalar fallback (no native SIMD)
SIMD int-add (64K x300)	java 101ms / native 132ms = 0.7x speedup
SIMD float-mul (64K x300)	java 81ms / native 46ms = 1.7x speedup
SIMD kernel correctness	PASS (native result == scalar reference)
Base64 payload size	8192 bytes
Base64 benchmark iterations	6000
Base64 SIMD byte path	gated to scalar (CPU autovectorizes scalar; explicit SIMD not beneficial here)
Base64 CN1 encode	51.000 ms
Base64 CN1 decode	61.000 ms
Base64 native encode	393.000 ms
Base64 encode ratio (CN1/native)	0.130x (87.0% faster)
Base64 native decode	317.000 ms
Base64 decode ratio (CN1/native)	0.192x (80.8% faster)
Image encode benchmark status	skipped (SIMD unsupported)

shai-almog · 2026-07-17T04:15:45Z

Compared 145 screenshots: 145 matched.
Native Windows port (x64 / Intel-AMD): full hellocodenameone screenshot suite rendered offscreen with Direct2D/DirectWrite, plus the real benchmarks (base64 native/CN1/SIMD, image createMask/applyMask/modifyAlpha/PNG/JPEG, SSE2 SIMD kernels). Compared against the in-repo baseline in scripts/windows/screenshots.

Benchmark Results

Detailed Performance Metrics

Metric	Duration
SIMD kernel backend	SSE2 (x64) / NEON (arm64) native kernels
SIMD int-add (64K x300)	java 60ms / native 4ms = 15.0x speedup
SIMD float-mul (64K x300)	java 67ms / native 3ms = 22.3x speedup
SIMD kernel correctness	PASS (native result == scalar reference)

shai-almog · 2026-07-17T04:22:48Z

Compared 145 screenshots: 145 matched.
Native Windows port, REAL shipping pipeline: the hellocodenameone screenshot suite rendered by a binary CROSS-COMPILED on Linux (clang-cl + xwin, WebView2 linked) and RUN on a Windows x64 runner. Compared against the in-repo baseline in scripts/windows/screenshots.

Benchmark Results

Detailed Performance Metrics

Metric	Duration
SIMD kernel backend	SSE2 (x64) / NEON (arm64) native kernels
SIMD int-add (64K x300)	java 63ms / native 4ms = 15.7x speedup
SIMD float-mul (64K x300)	java 65ms / native 3ms = 21.6x speedup
SIMD kernel correctness	PASS (native result == scalar reference)

shai-almog · 2026-07-17T04:28:35Z

Compared 176 screenshots: 176 matched.
✅ JavaScript-port screenshot tests passed.

shai-almog · 2026-07-17T04:31:21Z

Compared 145 screenshots: 145 matched.
Native Windows port (arm64 / Apple Silicon - Arm): full hellocodenameone screenshot suite rendered offscreen with Direct2D/DirectWrite, plus the real benchmarks (base64 native/CN1/SIMD, image createMask/applyMask/modifyAlpha/PNG/JPEG, NEON SIMD kernels). Compared against the in-repo baseline in scripts/windows/screenshots.

Benchmark Results

Detailed Performance Metrics

Metric	Duration
SIMD kernel backend	SSE2 (x64) / NEON (arm64) native kernels
SIMD int-add (64K x300)	java 54ms / native 4ms = 13.5x speedup
SIMD float-mul (64K x300)	java 55ms / native 3ms = 18.3x speedup
SIMD kernel correctness	PASS (native result == scalar reference)

shai-almog · 2026-07-17T04:33:20Z

Compared 147 screenshots: 147 matched.
✅ Native Mac screenshot tests passed.

Benchmark Results

VM Translation Time: 0 seconds
Compilation Time: 197 seconds

Detailed Performance Metrics

Metric	Duration
SIMD kernel backend	SSE2 (x64) / NEON (arm64) native kernels
SIMD int-add (64K x300)	java 52ms / native 3ms = 17.3x speedup
SIMD float-mul (64K x300)	java 53ms / native 3ms = 17.6x speedup
SIMD kernel correctness	PASS (native result == scalar reference)
Base64 payload size	8192 bytes
Base64 benchmark iterations	6000
Base64 SIMD byte path	active (NEON-accelerated)
Base64 CN1 encode	158.000 ms
Base64 CN1 decode	117.000 ms
Base64 native encode	660.000 ms
Base64 encode ratio (CN1/native)	0.239x (76.1% faster)
Base64 native decode	240.000 ms
Base64 decode ratio (CN1/native)	0.488x (51.2% faster)
Base64 SIMD encode	47.000 ms
Base64 encode ratio (SIMD/CN1)	0.297x (70.3% faster)
Base64 SIMD decode	44.000 ms
Base64 decode ratio (SIMD/CN1)	0.376x (62.4% faster)
Base64 encode ratio (SIMD/native)	0.071x (92.9% faster)
Base64 decode ratio (SIMD/native)	0.183x (81.7% faster)
Image encode benchmark iterations	100
Image createMask (SIMD off)	7.000 ms
Image createMask (SIMD on)	1.000 ms
Image createMask ratio (SIMD on/off)	0.143x (85.7% faster)
Image applyMask (SIMD off)	41.000 ms
Image applyMask (SIMD on)	31.000 ms
Image applyMask ratio (SIMD on/off)	0.756x (24.4% faster)
Image modifyAlpha (SIMD off)	41.000 ms
Image modifyAlpha (SIMD on)	41.000 ms
Image modifyAlpha ratio (SIMD on/off)	1.000x (0.0% slower)
Image modifyAlpha removeColor (SIMD off)	38.000 ms
Image modifyAlpha removeColor (SIMD on)	30.000 ms
Image modifyAlpha removeColor ratio (SIMD on/off)	0.789x (21.1% faster)

shai-almog · 2026-07-17T04:36:51Z

Compared 146 screenshots: 146 matched.
Native Linux port (x64), GTK3/Cairo/Pango, ParparVM bytecode-to-C (no JVM): the hellocodenameone screenshot suite rendered by a native ELF built + run on the GitHub x64 runner. Baseline: scripts/linux/screenshots.

shai-almog · 2026-07-17T04:36:55Z

Compared 146 screenshots: 146 matched.
Native Linux port (arm64), GTK3/Cairo/Pango, ParparVM bytecode-to-C (no JVM): the hellocodenameone screenshot suite rendered by a native ELF built + run on the GitHub arm64 runner. Baseline: scripts/linux/screenshots-arm.

shai-almog · 2026-07-17T04:40:47Z

Apple Watch (watchOS / Core Graphics)

Compared 216 screenshots: 215 matched, 1 missing actual.

DesktopMode — missing actual screenshot. Actual screenshot missing (test did not produce output).

No preview available for this screenshot.

shai-almog · 2026-07-17T04:58:14Z

Apple TV (tvOS / Metal)

Compared 143 screenshots: 141 matched, 2 missing actuals.

DesktopMode — missing actual screenshot. Actual screenshot missing (test did not produce output).

No preview available for this screenshot.
Media360Panorama — missing actual screenshot. Actual screenshot missing (test did not produce output).

No preview available for this screenshot.

shai-almog · 2026-07-17T05:13:01Z

Compared 142 screenshots: 142 matched.
✅ Native iOS screenshot tests passed.

Benchmark Results

VM Translation Time: 0 seconds
Compilation Time: 398 seconds

Build and Run Timing

Metric	Duration
Simulator Boot	70000 ms
Simulator Boot (Run)	1000 ms
App Install	12000 ms
App Launch	1000 ms
Test Execution	1033000 ms

Detailed Performance Metrics

Metric	Duration
SIMD kernel backend	SSE2 (x64) / NEON (arm64) native kernels
SIMD int-add (64K x300)	java 84ms / native 2ms = 42.0x speedup
SIMD float-mul (64K x300)	java 84ms / native 3ms = 28.0x speedup
SIMD kernel correctness	PASS (native result == scalar reference)
Base64 payload size	8192 bytes
Base64 benchmark iterations	6000
Base64 SIMD byte path	active (NEON-accelerated)
Base64 CN1 encode	280.000 ms
Base64 CN1 decode	170.000 ms
Base64 native encode	923.000 ms
Base64 encode ratio (CN1/native)	0.303x (69.7% faster)
Base64 native decode	461.000 ms
Base64 decode ratio (CN1/native)	0.369x (63.1% faster)
Base64 SIMD encode	86.000 ms
Base64 encode ratio (SIMD/CN1)	0.307x (69.3% faster)
Base64 SIMD decode	56.000 ms
Base64 decode ratio (SIMD/CN1)	0.329x (67.1% faster)
Base64 encode ratio (SIMD/native)	0.093x (90.7% faster)
Base64 decode ratio (SIMD/native)	0.121x (87.9% faster)
Image encode benchmark iterations	100
Image createMask (SIMD off)	13.000 ms
Image createMask (SIMD on)	4.000 ms
Image createMask ratio (SIMD on/off)	0.308x (69.2% faster)
Image applyMask (SIMD off)	71.000 ms
Image applyMask (SIMD on)	60.000 ms
Image applyMask ratio (SIMD on/off)	0.845x (15.5% faster)
Image modifyAlpha (SIMD off)	77.000 ms
Image modifyAlpha (SIMD on)	61.000 ms
Image modifyAlpha ratio (SIMD on/off)	0.792x (20.8% faster)
Image modifyAlpha removeColor (SIMD off)	56.000 ms
Image modifyAlpha removeColor (SIMD on)	67.000 ms
Image modifyAlpha removeColor ratio (SIMD on/off)	1.196x (19.6% slower)

shai-almog · 2026-07-17T05:16:24Z

Compared 148 screenshots: 148 matched.
✅ Native iOS Metal screenshot tests passed.

Benchmark Results

VM Translation Time: 0 seconds
Compilation Time: 490 seconds

Build and Run Timing

Metric	Duration
Simulator Boot	62000 ms
Simulator Boot (Run)	1000 ms
App Install	22000 ms
App Launch	8000 ms
Test Execution	1018000 ms

Detailed Performance Metrics

Metric	Duration
SIMD kernel backend	SSE2 (x64) / NEON (arm64) native kernels
SIMD int-add (64K x300)	java 139ms / native 4ms = 34.7x speedup
SIMD float-mul (64K x300)	java 89ms / native 6ms = 14.8x speedup
SIMD kernel correctness	PASS (native result == scalar reference)
Base64 payload size	8192 bytes
Base64 benchmark iterations	6000
Base64 SIMD byte path	active (NEON-accelerated)
Base64 CN1 encode	157.000 ms
Base64 CN1 decode	184.000 ms
Base64 native encode	372.000 ms
Base64 encode ratio (CN1/native)	0.422x (57.8% faster)
Base64 native decode	360.000 ms
Base64 decode ratio (CN1/native)	0.511x (48.9% faster)
Base64 SIMD encode	80.000 ms
Base64 encode ratio (SIMD/CN1)	0.510x (49.0% faster)
Base64 SIMD decode	95.000 ms
Base64 decode ratio (SIMD/CN1)	0.516x (48.4% faster)
Base64 encode ratio (SIMD/native)	0.215x (78.5% faster)
Base64 decode ratio (SIMD/native)	0.264x (73.6% faster)
Image encode benchmark iterations	100
Image createMask (SIMD off)	8.000 ms
Image createMask (SIMD on)	2.000 ms
Image createMask ratio (SIMD on/off)	0.250x (75.0% faster)
Image applyMask (SIMD off)	115.000 ms
Image applyMask (SIMD on)	32.000 ms
Image applyMask ratio (SIMD on/off)	0.278x (72.2% faster)
Image modifyAlpha (SIMD off)	34.000 ms
Image modifyAlpha (SIMD on)	31.000 ms
Image modifyAlpha ratio (SIMD on/off)	0.912x (8.8% faster)
Image modifyAlpha removeColor (SIMD off)	43.000 ms
Image modifyAlpha removeColor (SIMD on)	32.000 ms
Image modifyAlpha removeColor ratio (SIMD on/off)	0.744x (25.6% faster)

Separate JavaSE reference probes from port compliance

1a7bd79

shai-almog merged commit b2380c9 into master Jul 17, 2026
26 checks passed

shai-almog deleted the separate-javase-reference-tests branch July 17, 2026 03:59

Uh oh!

Conversation

shai-almog commented Jul 17, 2026

What changed

Root cause

Validation

Uh oh!

Uh oh!

shai-almog commented Jul 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Native Android coverage

Native Android coverage

Benchmark Results

Detailed Performance Metrics

Uh oh!

shai-almog commented Jul 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmark Results

Detailed Performance Metrics

Uh oh!

shai-almog commented Jul 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmark Results

Detailed Performance Metrics

Uh oh!

shai-almog commented Jul 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

shai-almog commented Jul 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmark Results

Detailed Performance Metrics

Uh oh!

shai-almog commented Jul 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmark Results

Detailed Performance Metrics

Uh oh!

shai-almog commented Jul 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

shai-almog commented Jul 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

shai-almog commented Jul 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Apple Watch (watchOS / Core Graphics)

Uh oh!

shai-almog commented Jul 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Apple TV (tvOS / Metal)

Uh oh!

shai-almog commented Jul 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmark Results

Build and Run Timing

Detailed Performance Metrics

Uh oh!

shai-almog commented Jul 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmark Results

Build and Run Timing

Detailed Performance Metrics

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

shai-almog commented Jul 17, 2026 •

edited

Loading

shai-almog commented Jul 17, 2026 •

edited

Loading

shai-almog commented Jul 17, 2026 •

edited

Loading

shai-almog commented Jul 17, 2026 •

edited

Loading

shai-almog commented Jul 17, 2026 •

edited

Loading

shai-almog commented Jul 17, 2026 •

edited

Loading

shai-almog commented Jul 17, 2026 •

edited

Loading

shai-almog commented Jul 17, 2026 •

edited

Loading

shai-almog commented Jul 17, 2026 •

edited

Loading

shai-almog commented Jul 17, 2026 •

edited

Loading

shai-almog commented Jul 17, 2026 •

edited

Loading

shai-almog commented Jul 17, 2026 •

edited

Loading