Datum Foundry NineLABS

INDEPENDENT THINKING.
OBSERVABLE INTELLIGENCE.

THE MODEL GAUNTLET

Capabilities.
Put to the test.

Original development challenges. Measured technical evidence. Independent human judgement.

60% technical assessment40% human reviewCapped by the reviewer’s quality bandHow we score ↗

OVERALL STANDINGS / METHODOLOGY 1.1

Every challenge, judged.

Updated 23 October 2026

Ranked by the B01–B05 total out of 500 (methodology 1.1). Wildcards are scored separately, out of 100 each.
Rank / modelB01B02B03B04B05Total /500B06B07
1Opus 5.5 ↗98.295.292.490.388.2464.2100100
2Astra ↗90.59589.68080435.19580
3MiniMax M3.1 Flash ↗91.89091.871.380424.99060
4Beam 1.0 501B A23B ↗80506059.840289.84010

THE RENDERS / BUILT IN BLENDER

See what they made.

B04 / CHALLENGE RESULTS

The Signal Room

An interactive software challenge assessed against its frozen brief and evidence.

Final = 0.6 × technical + 0.4 × human, capped by the band the reviewer chose.
Rank / modelTechnical /100Human /100Final /100
1Opus 5.5 ↗86Ceiling 10096.7Design & navigation · Good90.3Not capped
2Astra ↗83.5Ceiling 10083.3Design & navigation · Acceptable80Capped at 80 by the band
3MiniMax M3.1 Flash ↗85.5Ceiling 10050Design & navigation · Acceptable71.3Not capped
4Beam 1.0 501B A23B ↗68.5Ceiling 10046.7Design & navigation · Acceptable59.8Not capped

COMPARE THE EVIDENCE

Two models.
The same challenge.

Side by side, test by test, under the same brief and methodology.