Leaderboard/Dry, damaged hair/diagnostics
Hair type

Dry, damaged hair

Porous, brittle hair from heat, bleach or mechanical damage.

Position bias

Each pair is shown in a random order. If a model simply prefers whichever formulation it reads first, its ranking is largely noise, so some pairs are deliberately re-run the other way round to measure it. A first-position win rate near 50% is unbiased.

JudgePairs judged both waysAgreementFirst-position winsVerdict
wandb:zai-org/GLM-5.3-Flash 0 – 59% no pairs judged in both orders yet

Transitivity

Triples where A beats B and B beats C, yet C beats A. Some intransitivity is normal; a lot of it means the comparisons are close to coin flips.

JudgeViolationsTriples checkedRate
wandb:zai-org/GLM-5.3-Flash 546 4000 13.7%

Cross-judge agreement

Only one judge has ranked this hair type so far. Judge it with a second model to compare.