Introduce SIMD hint annotations and propagate them through the bytecode translator by liannacasper · Pull Request #4718 · codenameone/CodenameOne

liannacasper · 2026-04-07T18:46:06Z

Motivation

Provide an explicit, forward-compatible way to mark hot, data-parallel methods with SIMD/vectorization hints so translators can use that metadata for future optimizations.
Annotate existing hot code (Base64) with vectorization hints and document usage so profiles can guide optimizations.

Description

Added a new annotation holder com.codename1.annotations.Simd with @Candidate, @Reduction, and @WidthHint annotations and a private constructor to prevent instantiation.
Annotated Base64.decodeNoWhitespace and Base64.encodeNoNewline with @Simd.Candidate and @Simd.WidthHint(16) and imported the new annotation package.
Extended documentation docs/developer-guide/performance.asciidoc with a new SIMD Hint Annotations section describing the annotations, examples, and guidance.
Extended the translator parsing and metadata plumbing: Parser.MethodVisitorWrapper recognizes the Simd annotation descriptors (including extracting the value from WidthHint) and sets flags on BytecodeMethod.
Added SIMD hint state and helpers to BytecodeMethod (simdCandidateHint, simdReductionHint, simdWidthHint, getters/setters, hasSimdHints, and getSimdHintSummary) and a verbose log when optimizer is enabled.

Testing

Performed a source tree compilation to verify the new annotations and translator changes integrate and compile without errors; compilation succeeded.
No automated unit tests were modified or executed as part of this change.

Codex Task

github-actions · 2026-04-07T18:51:07Z

Developer Guide build artifacts are available for download from this workflow run:

Developer Guide quality checks:

AsciiDoc linter: 1 issue(s) flagged (1 errors) (exit code 1) (report)
Vale: 18676 alert(s) (2710 errors, 6367 warnings, 9599 suggestions) (exit code 1) (report)
Image references: 33 unused image(s) found (report)

Unused image preview:

img/uwp-app-manager-apps.png
img/uwp-certificate-generator.png
img/uwp-cn1settings-debug-desktop-selected.png
img/uwp-cn1settings-disk-icon.png
img/uwp-cn1settings-uwp.png
img/uwp-cn1settings-windows-settings-menu-item.png
img/uwp-dashboard-download-appxbundle.png
img/uwp-extract-zip-file.png
img/uwp-mobile-recently-added.png
img/uwp-mobile-settings-developer-mode.png
... and 23 more

github-actions · 2026-04-07T18:56:00Z

✅ Continuous Quality Report

Test & Coverage

✅ Tests: 2374 total, 0 failed, 0 skipped
📊 Line coverage: 53.29% [HTML preview] [Download]
- Lowest covered classes
  - com.codename1.ui.Display$EdtException – 0.00%
  - com.codename1.ui.plaf.CSSBorder$LinearGradient – 0.00%
  - com.codename1.util.EasyThread$InQueueRunnable – 0.00%
  - com.codename1.components.FloatingActionButton$ReleaseActionListener – 0.00%
  - com.codename1.io.Oauth2$ShowAuthenticationActionListener – 0.00%
  - com.codename1.io.Oauth2$RefreshTokenActionListener – 0.00%
  - com.codename1.util.EasyThread$RunAndWaitRunnable – 0.00%
  - com.codename1.components.ToastBar$FlushAnimationCallback – 0.00%
  - com.codename1.ui.plaf.CSSBorder$ColorStop – 0.00%
  - com.codename1.ui.ElevationComparator – 0.00%

Static Analysis

SpotBugs [HTML preview] [Download]
- ❌ ByteCodeTranslator: 109 findings (High: 2, Normal: 80, Low: 27)
  - Top findings
    - High: com/codename1/tools/translator/BytecodeMethod.java:559 – Method com.codename1.tools.translator.BytecodeMethod.findWritableFields(Set) seems to be useless (rule: UC_USELESS_VOID_METHOD)
    - High: com/codename1/tools/translator/bytecodes/TryCatch.java:91 – Write to static field com.codename1.tools.translator.bytecodes.TryCatch.hasTryCatch from instance method com.codename1.tools.translator.bytecodes.TryCatch.appendInstruction(StringBuilder, List) (rule: ST_WRITE_TO_STATIC_FROM_INSTANCE_METHOD)
    - Normal: com/codename1/tools/translator/ByteCodeClass.java:1802 – com.codename1.tools.translator.ByteCodeClass.getBaseClassObject() may expose internal representation by returning ByteCodeClass.baseClassObject (rule: EI_EXPOSE_REP)
    - …and 106 more
- ❌ android: 414 findings (High: 24, Normal: 196, Low: 194)
  - Top findings
    - High: CodenameOne/src/com/codename1/impl/CodenameOneThread.java:48 – com.codename1.impl.CodenameOneThread.STACK_FRAME_SIZE isn't final but should be (rule: MS_SHOULD_BE_FINAL)
    - High: com/codename1/impl/android/AndroidImplementation.java:1085 – Write to static field com.codename1.impl.android.AndroidImplementation.context from instance method com.codename1.impl.android.AndroidImplementation.setContext(Context) (rule: ST_WRITE_TO_STATIC_FROM_INSTANCE_METHOD)
    - High: com/codename1/impl/android/AndroidImplementation.java:1286 – com.codename1.impl.android.AndroidImplementation.isDarkMode() has Boolean return type and returns explicit null (rule: NP_BOOLEAN_RETURN_NULL)
    - …and 411 more
- ❌ codenameone-maven-plugin: 496 findings (High: 1, Normal: 319, Low: 176)
  - Top findings
    - High: com/codename1/maven/AbstractCN1Mojo.java:807 – com.codename1.maven.AbstractCN1Mojo.OS isn't final but should be (rule: MS_SHOULD_BE_FINAL)
    - Normal: com/codename1/builders/AndroidGradleBuilder.java:1020 – Dead store to googleServicesJson in com.codename1.builders.AndroidGradleBuilder.build(File, BuildRequest) (rule: DLS_DEAD_LOCAL_STORE)
    - Normal: com/codename1/builders/AndroidGradleBuilder.java:1045 – Possible null pointer dereference in com.codename1.builders.AndroidGradleBuilder.build(File, BuildRequest) due to return value of called method (rule: NP_NULL_ON_SOME_PATH_FROM_RETURN_VALUE)
    - …and 493 more
- ❌ core-unittests: 1 findings (Normal: 1)
  - Top findings
    - Normal: CodenameOne/src/com/codename1/ui/util/MutableResource.java:239 – com.codename1.ui.util.MutableResource.saveL10N(DataOutputStream, Hashtable) makes inefficient use of keySet iterator instead of entrySet iterator (rule: WMI_WRONG_MAP_ITERATOR)
- ❌ ios: 125 findings (High: 4, Normal: 75, Low: 46)
  - Top findings
    - High: com/codename1/impl/ios/IOSImplementation.java:1228 – com.codename1.impl.ios.IOSImplementation.isDarkMode() has Boolean return type and returns explicit null (rule: NP_BOOLEAN_RETURN_NULL)
    - High: com/codename1/impl/ios/IOSImplementation.java:128 – com.codename1.impl.ios.IOSImplementation.nativeInstance isn't final but should be (rule: MS_SHOULD_BE_FINAL)
    - High: com/codename1/impl/ios/IOSImplementation.java:214 – Write to static field com.codename1.impl.ios.IOSImplementation.instance from instance method com.codename1.impl.ios.IOSImplementation.init(Object) (rule: ST_WRITE_TO_STATIC_FROM_INSTANCE_METHOD)
    - …and 122 more
✅ PMD: 0 findings (no issues) [Report archive]
✅ Checkstyle: 0 findings (no issues) [Report archive]

Generated automatically by the PR CI workflow.

shai-almog · 2026-04-07T19:01:34Z

Android screenshot updates

Compared 36 screenshots: 35 matched, 1 updated.

ValidatorLightweightPicker — updated screenshot. Screenshot differs (320x640 px, bit depth 8).

Preview info: JPEG preview quality 70; JPEG preview quality 70.
Full-resolution PNG saved as ValidatorLightweightPicker.png in workflow artifacts.

Native Android coverage

📊 Line coverage: 7.75% (4073/52579 lines covered) [HTML preview] (artifact android-coverage-report, jacocoAndroidReport/html/index.html)
- Other counters: instruction 6.08% (20143/331490), branch 2.91% (930/31974), complexity 3.62% (1107/30622), method 6.34% (907/14300), class 10.44% (198/1896)
- Lowest covered classes
  - kotlin.collections.kotlin.collections.ArraysKt___ArraysKt – 0.00% (0/6327 lines covered)
  - kotlin.collections.unsigned.kotlin.collections.unsigned.UArraysKt___UArraysKt – 0.00% (0/2384 lines covered)
  - org.jacoco.agent.rt.internal_b6258fc.asm.org.jacoco.agent.rt.internal_b6258fc.asm.ClassReader – 0.00% (0/1519 lines covered)
  - kotlin.collections.kotlin.collections.CollectionsKt___CollectionsKt – 0.00% (0/1148 lines covered)
  - org.jacoco.agent.rt.internal_b6258fc.asm.org.jacoco.agent.rt.internal_b6258fc.asm.MethodWriter – 0.00% (0/923 lines covered)
  - kotlin.sequences.kotlin.sequences.SequencesKt___SequencesKt – 0.00% (0/730 lines covered)
  - kotlin.text.kotlin.text.StringsKt___StringsKt – 0.00% (0/623 lines covered)
  - org.jacoco.agent.rt.internal_b6258fc.asm.org.jacoco.agent.rt.internal_b6258fc.asm.Frame – 0.00% (0/564 lines covered)
  - kotlin.collections.kotlin.collections.ArraysKt___ArraysJvmKt – 0.00% (0/495 lines covered)
  - kotlinx.coroutines.kotlinx.coroutines.JobSupport – 0.00% (0/423 lines covered)

Benchmark Results

Detailed Performance Metrics

Metric	Duration
Base64 payload size	8192 bytes
Base64 benchmark iterations	6000
Base64 native encode	1033.000 ms
Base64 CN1 encode	134.000 ms
Base64 encode ratio (CN1/native)	0.130x (87.0% faster)
Base64 native decode	865.000 ms
Base64 CN1 decode	211.000 ms
Base64 decode ratio (CN1/native)	0.244x (75.6% faster)

github-actions · 2026-04-07T19:21:13Z

✅ ByteCodeTranslator Quality Report

Test & Coverage

✅ Tests: 377 total, 0 failed, 2 skipped

Benchmark Results

Execution Time: 9710 ms
Hotspots (Top 20 sampled methods):
- 25.60% java.lang.String.indexOf (439 samples)
- 20.87% com.codename1.tools.translator.Parser.isMethodUsed (358 samples)
- 12.65% java.util.ArrayList.indexOf (217 samples)
- 4.20% java.lang.Object.hashCode (72 samples)
- 3.67% com.codename1.tools.translator.ByteCodeClass.markDependent (63 samples)
- 3.03% com.codename1.tools.translator.BytecodeMethod.addToConstantPool (52 samples)
- 2.62% com.codename1.tools.translator.Parser.addToConstantPool (45 samples)
- 2.27% java.lang.System.identityHashCode (39 samples)
- 1.87% com.codename1.tools.translator.BytecodeMethod.equals (32 samples)
- 1.63% com.codename1.tools.translator.ByteCodeClass.calcUsedByNative (28 samples)
- 1.63% com.codename1.tools.translator.Parser.generateClassAndMethodIndexHeader (28 samples)
- 1.46% com.codename1.tools.translator.BytecodeMethod.appendMethodC (25 samples)
- 1.34% java.lang.StringBuilder.append (23 samples)
- 1.11% com.codename1.tools.translator.BytecodeMethod.optimize (19 samples)
- 0.93% java.lang.StringCoding.encode (16 samples)
- 0.82% com.codename1.tools.translator.Parser.cullMethods (14 samples)
- 0.82% com.codename1.tools.translator.BytecodeMethod.isMethodUsedByNative (14 samples)
- 0.64% com.codename1.tools.translator.BytecodeMethod.appendCMethodPrefix (11 samples)
- 0.47% java.util.TreeMap.getEntry (8 samples)
- 0.47% sun.nio.fs.UnixNativeDispatcher.open0 (8 samples)
⚠️ Coverage report not generated.

Static Analysis

✅ SpotBugs: no findings (report was not generated by the build).
⚠️ PMD report not generated.
⚠️ Checkstyle report not generated.

Generated automatically by the PR CI workflow.

shai-almog · 2026-04-07T20:27:13Z

iOS screenshot updates

Compared 36 screenshots: 35 matched, 1 updated.

landscape — updated screenshot. Screenshot differs (2556x1179 px, bit depth 8).

Preview info: Preview provided by instrumentation.
Full-resolution PNG saved as landscape.png in workflow artifacts.

Benchmark Results

VM Translation Time: 0 seconds
Compilation Time: 121 seconds

Detailed Performance Metrics

Metric	Duration
Simulator Boot	0 ms
Simulator Boot (Run)	1000 ms
App Install	1000 ms
App Launch	3000 ms
Test Execution	196000 ms
Base64 payload size	8192 bytes
Base64 benchmark iterations	6000
Base64 native encode	1851.000 ms
Base64 CN1 encode	14993.000 ms
Base64 encode ratio (CN1/native)	8.100x (710.0% slower)
Base64 native decode	1315.000 ms
Base64 CN1 decode	2344.000 ms
Base64 decode ratio (CN1/native)	1.783x (78.3% slower)

.github/workflows/base64-translation-dump.yml

Refine SIMD docs with real loop example and anti-pattern FAQ

d652298

liannacasper added the codex label Apr 7, 2026 — with ChatGPT Codex Connector

Add SIMD hint readiness diagnostics for verbose translator runs

f94afc9

liannacasper added 2 commits April 7, 2026 22:34

Validate SIMD width hints before storing translator metadata

2b12085

Emit SIMD width hint in generated C and test it

cdb33b7

liannacasper added 14 commits April 8, 2026 09:24

Enforce SIMD annotation validity in translator

b589082

Emit NEON target pragmas for SIMD-eligible methods

27777a7

Revert NEON pragma emission to fix benchmark crash

e53638f

Reintroduce SIMD pragmas behind opt-in guard

44a33ba

Add weak SIMD hook dispatch for eligible translated methods

cde14f2

Add explicit SIMD Java API with scalar fallback

7b2e32f

Expand explicit SIMD API and wire Base64 SIMD path

50489dc

Always enable SIMD API path and fold isSupported in translator

521529e

Simplify SIMD support probe and annotate translated SIMD API invokes

d94c9c0

Remove SIMD hint annotation pipeline and hook emission

976d86d

Fix Base64 SIMD dead store and reduce lane-call overhead

9873e22

Print translated Base64 symbols in integration benchmark

6477697

Persist translated Base64 dump as test artifact file

816511c

Add dedicated Base64 translation dump workflow

237e6e3

github-advanced-security bot found potential problems Apr 10, 2026

View reviewed changes

.github/workflows/base64-translation-dump.yml Fixed Show fixed Hide fixed

liannacasper added 5 commits April 10, 2026 11:48

Fix Base64 dump workflow dependency resolution

2941646

Run Base64 dump workflow on hosted runner JDK 8

321c9c2

Allow reactor modules without matching test filter

5d86ccb

Use local core artifacts for Base64 translation dump

1c6f4fd

Inline SIMD.isSupported in CustomInvoke paths

4859c50

Force translated SIMD.isSupported method to return true

669b2a7

liannacasper closed this Apr 12, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Introduce SIMD hint annotations and propagate them through the bytecode translator#4718

Introduce SIMD hint annotations and propagate them through the bytecode translator#4718
liannacasper wants to merge 24 commits intomasterfrom
codex/add-auto-vectorization-for-array-access

liannacasper commented Apr 7, 2026

Uh oh!

github-actions bot commented Apr 7, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Apr 7, 2026 •

edited

Loading

Uh oh!

shai-almog commented Apr 7, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Apr 7, 2026 •

edited

Loading

Uh oh!

shai-almog commented Apr 7, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

liannacasper commented Apr 7, 2026

Motivation

Description

Testing

Uh oh!

github-actions bot commented Apr 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Apr 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Continuous Quality Report

Test & Coverage

Static Analysis

Uh oh!

shai-almog commented Apr 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Android screenshot updates

Native Android coverage

Benchmark Results

Detailed Performance Metrics

Uh oh!

github-actions bot commented Apr 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ ByteCodeTranslator Quality Report

Test & Coverage

Benchmark Results

Static Analysis

Uh oh!

shai-almog commented Apr 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

iOS screenshot updates

Benchmark Results

Detailed Performance Metrics

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

github-actions bot commented Apr 7, 2026 •

edited

Loading

github-actions bot commented Apr 7, 2026 •

edited

Loading

shai-almog commented Apr 7, 2026 •

edited

Loading

github-actions bot commented Apr 7, 2026 •

edited

Loading

shai-almog commented Apr 7, 2026 •

edited

Loading