Read cofounder Muhammad Umar's memo, Compression and Reinflation
CodeNinja AtomsUnited StatesSaudi ArabiaPakistan

Benchmark · PADI

Physical AI Design Index

One question about system design: given the same short requirement for physical AI in a real operation, does Praxis produce a better system design than frontier AI on its own? PADI scores both on fresh tasks across 13 industries in three countries.

48.5%vs 28.4%

RSI Loop 22: blind evaluation on seven unseen tasks, Praxis platform vs frontier AI, checks passed

7of 7

Tasks where Praxis came out ahead in the blind evaluation

13of 13

Industries measured across three countries

PADI is the benchmark CodeNinja uses to improve Praxis, one RSI loop (recursive self improvement loop) at a time. Scores are far from saturated: the goal is every check on every task in all 13 industries.

Industries

Checks passed in each industry, all RSI loops to date, for the Praxis platform and frontier AI on its own, on the same tasks. Every industry is measured at least once.

Praxis platformFrontier AI
  • Agriculture and Earth ObservationRSI Loops 14, 20 · 39 checks
    Praxis46.2%
    Frontier35.9%
  • Aviation ManufacturingRSI Loops 17, 18, 19 · 76 checks
    Praxis22.4%
    Frontier23.7%
  • Defense and IntelligenceRSI Loops 13, 15, 20 · 57 checks
    Praxis42.1%
    Frontier33.3%
  • Discrete Manufacturing and AutomotiveRSI Loops 13, 15, 18 · 76 checks
    Praxis43.4%
    Frontier34.2%
  • Energy and UtilitiesRSI Loops 13, 17, 19, 21 · 153 checks
    Praxis36.6%
    Frontier29.4%
  • Heavy Industry and ConstructionRSI Loop 12 · 56 checks
    Praxis44.6%
    Frontier46.4%
  • Maritime and PortsRSI Loops 12, 16, 19, 20 · 114 checks
    Praxis34.2%
    Frontier26.3%
  • MiningRSI Loops 14, 15, 16, 19, 20 · 129 checks
    Praxis42.6%
    Frontier35.7%
  • Oil and GasRSI Loops 14, 18, 19 · 78 checks
    Praxis30.8%
    Frontier26.9%
  • Rail TransportRSI Loops 14, 15, 16, 19, 21 · 134 checks
    Praxis45.5%
    Frontier36.6%
  • SemiconductorsRSI Loops 18, 20, 21 · 57 checks
    Praxis43.9%
    Frontier26.3%
  • Supply Chain and LogisticsRSI Loops 15, 16, 18 · 57 checks
    Praxis31.6%
    Frontier28.1%
  • Warehousing and IntralogisticsRSI Loops 17, 20, 21 · 96 checks
    Praxis38.5%
    Frontier29.2%

Trajectory

Every RSI loop on a scale to 100%, so the distance to the goal stays in view.

Praxis platformFrontier AI
0%25%50%75%100%Goal: every checkRSI Loop 12RSI Loop 13RSI Loop 14RSI Loop 15RSI Loop 16RSI Loop 17RSI Loop 18RSI Loop 19RSI Loop 20RSI Loop 2138.4%32.1%39.6%35.7%26.0%16.2%31.3%27.0%30.4%37.7%37.5%29.5%43.2%41.7%36.5%23.9%37.4%41.7%39.1%54.4%RSI Loop 22, blind28.4%48.5%

Loop 22 is a blind evaluation on 7 tasks the platform had never seen. Loops 17 to 21 reused some evaluation tasks, so they are shown for the trend and are not like for like with loop 22.

Results

Every figure is checks passed as a percentage of checks judged, for each arm.

By RSI loop

RSI LoopDateTasksChecks per armPraxis platformFrontier AITasks: platform ahead · tied · behind
RSI Loop 123 Oct 2026611237.5%38.4%3 · 0 · 3
RSI Loop 134 Oct 2026611229.5%32.1%3 · 0 · 3
RSI Loop 145 Oct 2026611143.2%39.6%2 · 1 · 3
RSI Loop 155 Oct 2026611541.7%35.7%5 · 0 · 1
RSI Loop 167 Oct 202659636.5%26.0%5 · 0 · 0
RSI Loop 178 Oct 2026611723.9%16.2%3 · 3 · 0
RSI Loop 189 Oct 2026611537.4%31.3%3 · 1 · 2
RSI Loop 1911 Oct 2026611541.7%27.0%6 · 0 · 0
RSI Loop 2011 Oct 2026611539.1%30.4%4 · 2 · 0
RSI Loop 2114 Oct 2026611454.4%37.7%5 · 1 · 0
All RSI loops59112238.5%31.5%39 · 8 · 12
RSI Loop 22, blind16 Oct 2026713448.5%28.4%7 · 0 · 0

By industry

IndustryRSI LoopChecks per armPraxis platformFrontier AI
Agriculture and Earth ObservationRSI Loop 142035.0%40.0%
Agriculture and Earth ObservationRSI Loop 201957.9%31.6%
Agriculture and Earth ObservationRSI Loop 22, blind1838.9%22.2%
Aviation ManufacturingRSI Loop 174015.0%12.5%
Aviation ManufacturingRSI Loop 181827.8%44.4%
Aviation ManufacturingRSI Loop 191833.3%27.8%
Aviation ManufacturingRSI Loop 22, blind2050.0%30.0%
Defense and IntelligenceRSI Loop 131838.9%22.2%
Defense and IntelligenceRSI Loop 151957.9%47.4%
Defense and IntelligenceRSI Loop 202030.0%30.0%
Discrete Manufacturing and AutomotiveRSI Loop 131827.8%33.3%
Discrete Manufacturing and AutomotiveRSI Loop 151936.8%31.6%
Discrete Manufacturing and AutomotiveRSI Loop 183953.8%35.9%
Discrete Manufacturing and AutomotiveRSI Loop 22, blind1952.6%36.8%
Energy and UtilitiesRSI Loop 137627.6%34.2%
Energy and UtilitiesRSI Loop 171931.6%15.8%
Energy and UtilitiesRSI Loop 191947.4%21.1%
Energy and UtilitiesRSI Loop 213951.3%30.8%
Heavy Industry and ConstructionRSI Loop 125644.6%46.4%
Maritime and PortsRSI Loop 125630.4%30.4%
Maritime and PortsRSI Loop 161942.1%15.8%
Maritime and PortsRSI Loop 192030.0%20.0%
Maritime and PortsRSI Loop 201942.1%31.6%
Maritime and PortsRSI Loop 22, blind1942.1%15.8%
MiningRSI Loop 143366.7%54.5%
MiningRSI Loop 153935.9%35.9%
MiningRSI Loop 161931.6%26.3%
MiningRSI Loop 191942.1%26.3%
MiningRSI Loop 201926.3%21.1%
MiningRSI Loop 22, blind1866.7%27.8%
Oil and GasRSI Loop 143928.2%25.6%
Oil and GasRSI Loop 181926.3%21.1%
Oil and GasRSI Loop 192040.0%35.0%
Rail TransportRSI Loop 141942.1%42.1%
Rail TransportRSI Loop 152055.0%40.0%
Rail TransportRSI Loop 163834.2%28.9%
Rail TransportRSI Loop 191957.9%31.6%
Rail TransportRSI Loop 213847.4%42.1%
SemiconductorsRSI Loop 182035.0%20.0%
SemiconductorsRSI Loop 201936.8%26.3%
SemiconductorsRSI Loop 211861.1%33.3%
SemiconductorsRSI Loop 22, blind2050.0%40.0%
Supply Chain and LogisticsRSI Loop 151827.8%22.2%
Supply Chain and LogisticsRSI Loop 162040.0%30.0%
Supply Chain and LogisticsRSI Loop 181926.3%31.6%
Warehousing and IntralogisticsRSI Loop 175827.6%19.0%
Warehousing and IntralogisticsRSI Loop 201942.1%42.1%
Warehousing and IntralogisticsRSI Loop 211968.4%47.4%
Warehousing and IntralogisticsRSI Loop 22, blind2040.0%25.0%

By country

RSI LoopUnited States: Praxis vs frontier AISaudi Arabia: Praxis vs frontier AIPakistan: Praxis vs frontier AI
RSI Loop 1234.2% vs 44.7%38.9% vs 44.4%39.5% vs 26.3%
RSI Loop 1324.3% vs 37.8%30.8% vs 30.8%33.3% vs 27.8%
RSI Loop 1435.0% vs 30.0%66.7% vs 54.5%31.6% vs 36.8%
RSI Loop 1556.4% vs 43.6%33.3% vs 28.2%35.1% vs 35.1%
RSI Loop 1635.9% vs 28.2%39.5% vs 23.7%31.6% vs 26.3%
RSI Loop 1723.1% vs 7.7%17.9% vs 17.9%30.8% vs 23.1%
RSI Loop 1853.8% vs 35.9%30.8% vs 25.6%27.0% vs 32.4%
RSI Loop 1942.1% vs 26.3%48.7% vs 33.3%36.8% vs 22.8%
RSI Loop 2034.2% vs 26.3%35.9% vs 35.9%47.4% vs 28.9%
RSI Loop 2144.7% vs 28.9%53.8% vs 43.6%64.9% vs 40.5%
RSI Loop 22, blind52.6% vs 26.3%46.9% vs 29.2%

Coverage

13 of 13 industries measured. 73 tasks in the bank, at least one per industry in each country, because operations differ with the place.

RSI Loop 21
measured in that RSI loop
Not yet measured
IndustryUnited StatesSaudi ArabiaPakistan
Agriculture and Earth Observation
RSI Loop 14
RSI Loop 22, blind
RSI Loop 20
Aviation Manufacturing
RSI Loop 17Not yet measured
RSI Loop 17RSI Loop 22, blind
RSI Loop 18RSI Loop 19
Defense and Intelligence
RSI Loop 15
RSI Loop 20
RSI Loop 13
Discrete Manufacturing and Automotive
RSI Loop 18RSI Loop 18Not yet measured
RSI Loop 15RSI Loop 22, blindNot yet measured
RSI Loop 13
Energy and Utilities
RSI Loop 13RSI Loop 13RSI Loop 21
RSI Loop 13RSI Loop 13RSI Loop 21
RSI Loop 17RSI Loop 19
Heavy Industry and Construction
RSI Loop 12
RSI Loop 12
RSI Loop 12
Maritime and Ports
RSI Loop 12RSI Loop 20Not yet measured
RSI Loop 12RSI Loop 16RSI Loop 22, blind
RSI Loop 12RSI Loop 19
Mining
RSI Loop 19RSI Loop 20RSI Loop 22, blind
RSI Loop 14RSI Loop 14RSI Loop 15
RSI Loop 15RSI Loop 16
Oil and Gas
RSI Loop 14
RSI Loop 19
RSI Loop 14RSI Loop 18
Rail Transport
RSI Loop 15RSI Loop 16RSI Loop 21
RSI Loop 16RSI Loop 19RSI Loop 21
RSI Loop 14
Semiconductors
Not yet measuredNot yet measured
RSI Loop 18RSI Loop 22, blind
RSI Loop 20RSI Loop 21
Supply Chain and Logistics
RSI Loop 16
RSI Loop 18Not yet measured
RSI Loop 15
Warehousing and Intralogistics
RSI Loop 17RSI Loop 22, blind
RSI Loop 17RSI Loop 20
RSI Loop 17RSI Loop 21

Questions

What is the Physical AI Design Index?

PADI is CodeNinja's benchmark for system design in physical AI. It scores Praxis against frontier AI on its own, on the same short requirements from real kinds of operations such as a mine, a port, a rail line or a substation, across 13 industries in three countries.

How often is PADI updated?

Once per RSI loop, on tasks never run before.

Cadence

Updated each RSI loop. Last published: RSI Loop 22, 16 October 2026. RSI Loop 23 is under way.

Contact

Questions about PADI, or a task from your own operation you would like measured: contact us