num_cg greenvalidity pass

Tier 1 · wall_time · N=n=64 · variant algo_registry · OS linux

Validity gate

passpass — perf claims allowed when ratio is green

Source: latest.csv:perf_present

Wall-clock row exists only — no explicit correctness signal yet.

Ratio vs best competitor
0.780 (78.0% of rust speed) (table SOTA: rust — best competitor; charts use rust = 1.0)
Best competitor value
0.0085 s

Numeric oracle

No analytical verify rows in ingest yet. Run tier-1 with --verify so latest.csv exports verify_ulps / verify_within_1ulp.

Problem size
N=n=64 (family num_cg)
Category
micro
Pillar
numerics
Package
lic
Li / catalog oracle (mean ± σ)
0.0109 ± 0.001427 s (n=86) / 0.0092 ± 0.001017 s (n=88) (cpp)
Ratio vs catalog oracle
1.1848×
Best competitor
rust (0.0085 s)
Li relative speed vs SOTA
0.780 (1.0 = rust speed)
Validity
validity pass
Threshold
1.2×
Source
lic/benchmarks/workloads/tier1_micro/num_cg

PH ids: PH-5b

Performance vs best competitor

Compare oracle: cpp

Relative speed vs best competitor (rust) — SOTA = 1.0, higher is better. Absolute s values are in the table below.

Absolute measurements

Language comparison
LangMean ± σRunsUnitVariantOS
li0.0109 ± 0.00142786sreleaselinux
cpp0.0092 ± 0.00101788sreleaselinux
rust0.0085 ± 0.000776124sreleaselinux
julia0.0089 ± 0.001007129sreleaselinux
Metric: wall_time (value = mean of timed runs)

Host OS

Measurement hosts by language
ScopeOS
Row aggregatelinux
li (release)linux
cpp (release)linux
rust (release)linux
julia (release)linux

Latest history deltas

  • status: unknown → green

← Overview