Datum Foundry NineLABS

INDEPENDENT THINKING.
OBSERVABLE INTELLIGENCE.

THE MODEL GAUNTLET

Capabilities.
Put to the test.

Original development challenges. Measured technical evidence. Independent human judgement.

60% technical assessment40% human reviewCapped by the reviewer’s quality bandHow we score ↗

OVERALL STANDINGS / METHODOLOGY 1.1

Every challenge, judged.

Updated 23 October 2026

Ranked by the B01–B05 total out of 500 (methodology 1.1). Wildcards are scored separately, out of 100 each.
Rank / modelB01B02B03B04B05Total /500B06B07
1Opus 5.5 ↗98.295.292.490.388.2464.2100100
2Astra ↗90.59589.68080435.19580
3MiniMax M3.1 Flash ↗91.89091.871.380424.99060
4Beam 1.0 501B A23B ↗80506059.840289.84010

THE RENDERS / BUILT IN BLENDER

See what they made.

B05 / CHALLENGE RESULTS

Oliver: Thermal Panic

A game challenge assessed for functionality, usability, resilience and the submitted evidence.

Final = 0.6 × technical + 0.4 × human, capped by the band the reviewer chose.
Rank / modelTechnical /100Human /100Final /100
1Opus 5.5 ↗83Ceiling 10096Playability · Good88.2Not capped
2Astra ↗92Ceiling 10080Playability · Acceptable80Capped at 80 by the band
2MiniMax M3.1 Flash ↗100Ceiling 10068Playability · Acceptable80Capped at 80 by the band
4Beam 1.0 501B A23B ↗68Ceiling 1000Playability · Unusable40Capped at 40 by the band

COMPARE THE EVIDENCE

Two models.
The same challenge.

Side by side, test by test, under the same brief and methodology.