Artificial Analysis makes personality a benchmark
AA Personality Bench evaluates 900 curated questions across 30 traits — eloquent, pragmatic, sycophantic — rolled into eight indices: expressiveness, organization, informativeness, transparency, warmth, conviction, imagination, and slop. It also tracks communication characteristics like sentence length, emoji use, and em-dash usage. The premise: "two models can give equally correct answers and still feel very different to use."