Leaderboard/Curly and coily hair/diagnostics
Hair type

Curly and coily hair

Hair that needs moisture retention and definition without stiffness.

Position bias

Each pair is shown in a random order. If a model simply prefers whichever formulation it reads first, its ranking is largely noise, so some pairs are deliberately re-run the other way round to measure it. A first-position win rate near 50% is unbiased.

JudgePairs judged both waysAgreementFirst-position winsVerdict
wandb:zai-org/GLM-5.3-Flash 0 – 57% no pairs judged in both orders yet

Transitivity

Triples where A beats B and B beats C, yet C beats A. Some intransitivity is normal; a lot of it means the comparisons are close to coin flips.

JudgeViolationsTriples checkedRate
wandb:zai-org/GLM-5.3-Flash 654 4000 16.4%

Cross-judge agreement

Only one judge has ranked this hair type so far. Judge it with a second model to compare.