Research
Do language models converge on one voice?
A seven-day run shows high topic similarity, modest residual-style alignment, and no collapse into one common voice.
the demosyne team12 min read
The research question
We used one completed ElectionBench run to ask a narrow question: when language models share a simulated town for a week, does their speech converge on one voice? The run contains 2,872 conversation turns in 618 conversations over 84 ticks, or seven in-world days. Ten language models supplied the residents’ speech; the scripted poll interviewer was excluded from the convergence calculations.
The answer is no, with an important qualification. The models discuss the same election throughout the run, and their residual styles become modestly more aligned than shuffled model labels would predict. That movement does not produce a common voice. Most of the structure is already present on day one, and the later changes are concentrated in a few models and pairs.
Measuring topic and residual style separately
Raw embedding similarity mixes subject matter with expression. Two models discussing the same campaign can be close in embedding space even when their phrasing and register remain different. We therefore compute two measurements for each centered five-tick window.
Topic similarity is the mean pairwise cosine between each model’s speech centroid. Residual style similarity uses the same centroids after subtracting the pooled centroid for that window. Removing this shared direction reduces the contribution from whatever the town is discussing at that time.
Centered residuals are negatively correlated by construction, so zero is not the right baseline. We permute model labels within each window 30 times while preserving the group sizes, then compare the observed residual-style cosine with the resulting null distribution. The figure reports the null mean and its 5th–95th percentile band.12
Residual style alignment increases, but remains small
Topic cosine ranges from 0.69 to 0.85, with a mean of 0.77. The models remain semantically close because they share the election context. Raw embeddings alone would therefore overstate convergence in voice.
The residual-style result is smaller. The first sequence of at least five consecutive ticks above the shuffle band starts at tick 20, late on day two. From day three onward, 55 of 60 ticks are above the band. The observed-minus-null gap reaches its maximum at tick 79, at +0.056 cosine.
This is evidence of structure beyond the label-shuffle baseline, not evidence that the models become interchangeable. The residual-style values remain heterogeneous across pairs, as the next sections show.
Figure 1
Residual style compared with the shuffle baseline
| Tick | Topic cosine | Style cosine | Within-model cosine |
|---|---|---|---|
| 1 | 0.697 | -0.123 | 0.449 |
| 12 | 0.783 | -0.129 | 0.455 |
| 24 | 0.774 | -0.092 | 0.446 |
| 36 | 0.768 | -0.093 | 0.451 |
| 48 | 0.779 | -0.092 | 0.456 |
| 60 | 0.813 | -0.097 | 0.465 |
| 72 | 0.830 | -0.159 | 0.461 |
| 84 | 0.692 | -0.093 | 0.487 |
- observed style
- shuffle null
Observed residual-style cosine against the 5th–95th percentile shuffle band and its mean. Hover a point for the tick, residual style, null mean, topic, and within-model cosine. The dashed rule marks the start of the first five consecutive ticks above the band. Source: SF Hero 3 run record 08f242f3-aaad-4631-915f-d28e74946264, 2,872 turns through tick 84
The main style groups are present on day one
The day-level pair matrix shows that the largest group did not form during the week. On day one, Claude Opus 5, Kimi K3, Qwen 3.8 Max, and Muse Spark 1.1 have a mean within-group residual-style cosine of 0.29. Their mean cosine to MiniMax M2.5 and DeepSeek V4 Flash is -0.31. The difference is 0.60 on day one and 0.77 on day six.
Assignment role follows a similar partition. Across the full week, candidate–candidate pairs have a residual-style cosine of 0.24, villager–villager pairs -0.05, and mixed pairs -0.26. The villager daily mean falls from 0.01 on day one to -0.17 on day seven, while candidate pairs remain positive on every day.3
Figure 2
Pairwise residual style on days one and seven
| Pair | Style cosine |
|---|---|
| Kimi K3 · Muse Spark 1.1 | 0.377 |
| Claude Opus 5 · GPT-5.6 Sol | 0.347 |
| Muse Spark 1.1 · Qwen 3.8 Max | 0.336 |
| Kimi K3 · Qwen 3.8 Max | 0.323 |
| Claude Opus 5 · Kimi K3 | 0.292 |
| Claude Sonnet 5 · MiniMax M2.5 | 0.283 |
Mean pairwise residual-style cosine in the first twelve ticks and the last twelve. Hover a cell for the pair and value. The menu isolates one model’s row and column. Blue indicates positive residual similarity; rust indicates negative residual similarity. Source: SF Hero 3 run record 08f242f3-aaad-4631-915f-d28e74946264, 2,872 turns through tick 84
Figure 3
Residual style by character role
| Day | Candidates | Villagers | Mixed |
|---|---|---|---|
| 1 | 0.284 | 0.012 | -0.315 |
| 2 | 0.224 | 0.070 | -0.316 |
| 3 | 0.247 | -0.019 | -0.289 |
| 4 | 0.213 | -0.066 | -0.231 |
| 5 | 0.195 | -0.061 | -0.228 |
| 6 | 0.291 | -0.080 | -0.254 |
| 7 | 0.284 | -0.173 | -0.195 |
Mean pairwise residual-style cosine within candidate models, within villager models, and across the two roles. Drag to zoom, hover to isolate a line, or click a legend entry to hide it. Source: SF Hero 3 run record 08f242f3-aaad-4631-915f-d28e74946264, 2,872 turns through tick 84
Most of the change is specific to individual models
Claude Sonnet 5 shows the clearest change in relative position. Its residual-style cosine to MiniMax is 0.28 on day one and -0.10 on day seven. Its mean cosine to the four-model group rises from -0.36 to -0.13. Sonnet moves away from MiniMax and toward that group, but its day-seven mean remains negative, so the run does not show it joining the group.
Figure 5
Sonnet similarity to the candidate-side group and MiniMax
| Day | To the candidate bloc | To MiniMax |
|---|---|---|
| 1 | -0.360 | 0.283 |
| 2 | -0.357 | 0.262 |
| 3 | -0.361 | 0.190 |
| 4 | -0.328 | 0.292 |
| 5 | -0.139 | -0.051 |
| 6 | -0.253 | 0.007 |
| 7 | -0.128 | -0.101 |
Claude Sonnet 5’s mean residual-style cosine to the four candidate-side models and to MiniMax, by day. Drag to zoom or hover to isolate a line. Source: SF Hero 3 run record 08f242f3-aaad-4631-915f-d28e74946264, 2,872 turns through tick 84
A second view compares each model’s mean residual-style cosine to the rest of the field over the first and last twelve ticks. MiniMax is the only model with a negative change. In the pooled corpus it also has a standardized distinct-2 score of 0.88 and a normalized duplicate-turn rate of 0.16. Those measures show high repetition, while its negative field change shows that repetition did not make its speech more similar to the other models.
Figure 6
Change in each model’s similarity to the field
| Model | Change in style-to-field | Turns |
|---|---|---|
| Muse Spark 1.1 | 0.082 | 85 |
| GPT-5.6 Sol | 0.073 | 125 |
| Claude Opus 5 | 0.067 | 226 |
| Kimi K3 | 0.058 | 89 |
| Claude Sonnet 5 | 0.051 | 390 |
| Qwen 3.8 Max | 0.041 | 87 |
| GPT-5.6 Luna | 0.028 | 553 |
| DeepSeek V4 Flash | 0.002 | 589 |
| MiniMax M2.5 | -0.104 | 610 |
Each bar is the change in a model's mean style cosine to every other model, first twelve ticks against last twelve. Positive means the model moved toward the rest of the field. Hover a bar for the exact change. Source: SF Hero 3 run record 08f242f3-aaad-4631-915f-d28e74946264, 2,872 turns through tick 84
Figure 7
Pairs with the largest fitted changes
| Pair | First five ticks | Last five ticks | Change |
|---|---|---|---|
| Claude Sonnet 5 · GPT-5.6 Sol | -0.527 | -0.142 | 0.385 |
| Claude Sonnet 5 · Claude Opus 5 | -0.434 | -0.053 | 0.381 |
| Claude Sonnet 5 · Kimi K3 | -0.439 | -0.045 | 0.394 |
Residual-style cosine over the run for the three pairs with the largest positive fitted slopes and the three with the largest negative fitted slopes. Drag to zoom, hover to isolate a line, or click a legend entry to hide it. Source: SF Hero 3 run record 08f242f3-aaad-4631-915f-d28e74946264, 2,872 turns through tick 84
Dusk and dawn windows show continuity
For each of the six day boundaries, the observed-minus-null style gap at the first tick after the boundary is at least as large as it was at the last tick before it. The largest change is +0.020 between days three and four; the day-six to day-seven boundary is close behind.
This is a continuity check, not evidence that an unobserved overnight process caused the increase. The two measurements use centered five-tick windows, so adjacent dusk and dawn estimates share most of their turns. The result only shows that the measured alignment does not reset at the recorded day boundary.
Figure 4
Residual-style gap across day boundaries
| Night | Gap at dusk | Gap at dawn | Change |
|---|---|---|---|
| 1→2 | -0.007 | -0.005 | 0.001 |
| 2→3 | 0.010 | 0.016 | 0.007 |
| 3→4 | 0.012 | 0.031 | 0.020 |
| 4→5 | 0.018 | 0.028 | 0.009 |
| 5→6 | 0.008 | 0.011 | 0.003 |
| 6→7 | 0.005 | 0.024 | 0.019 |
Change in the observed-minus-null residual-style gap from the last tick of a day to the first tick of the next. These adjacent centered windows overlap. Switch the menu to compare the two levels, or hover for an exact value. Source: SF Hero 3 run record 08f242f3-aaad-4631-915f-d28e74946264, 2,872 turns through tick 84
The candidate-side neighborhood also appears across runs
We also computed one residual speech centroid per model over a pooled corpus of 25,401 turns from 40 runs and 18 models. We repeated the calculation with Qwen3 Embedding 4B and Gemini Embedding 2, then used the consensus distances only to lay out the map.
Both embedders place Claude Opus 5, Kimi K3, Qwen 3.8 Max, and Muse Spark 1.1 in the same neighborhood. The two GPT-5.6 Sol serving tiers also pair closely. This reduces the chance that the neighborhood is specific to one embedding model, but it is not an independent replication: the pooled corpus includes this run and other runs from the same simulation system.
Figure 8
Pooled model fingerprints under two embedders
| Pair | Mean style cosine | Qwen embedder | Gemini embedder |
|---|---|---|---|
| Kimi K3 · Qwen 3.8 Max | 0.884 | 0.881 | 0.887 |
| Claude Opus 5 · Kimi K3 | 0.857 | 0.871 | 0.843 |
| Claude Opus 5 · Qwen 3.8 Max | 0.841 | 0.835 | 0.846 |
| Muse Spark 1.1 · Qwen 3.8 Max | 0.825 | 0.859 | 0.790 |
| Kimi K3 · Muse Spark 1.1 | 0.783 | 0.805 | 0.761 |
| Inkling · Muse Spark 1.1 | 0.765 | 0.778 | 0.752 |
| Claude Opus 5 · Muse Spark 1.1 | 0.757 | 0.807 | 0.707 |
| GPT-5.6 Sol · GPT-5.6 Sol Flex | 0.717 | 0.729 | 0.704 |
Each point is a model’s pooled speech centroid after removal of the shared dialogue direction. The layout uses consensus distances from the Qwen and Gemini embedding spaces. Hover for the model and turn count, or click a legend entry to hide it. Source: Dialogue-collapse corpus: 25,401 turns across 40 runs and 18 models
Direct conversational exposure does not predict convergence
Direct pairwise mimicry makes a simple prediction: model pairs that share more conversation turns should show more positive residual-style drift. We tested that prediction for the 35 pairs with measurements at 40 or more ticks. Drift is the pair’s fitted residual-style slope across the run, scaled to the run length; exposure is the number of turns the pair shared in conversations.
The prediction fails in this sample. Exposure has a negative rank association with drift (Spearman ρ = -0.34). Villager–villager pairs average 147 shared turns and a drift of -0.21. Candidate–candidate pairs average 30 shared turns and a drift of +0.03.
Figure 9
Conversational exposure compared with residual-style drift
| Pair | Shared turns | Style drift | Roles |
|---|---|---|---|
| GPT-5.6 Luna · Claude Sonnet 5 | 292 | -0.114 | villager–villager |
| DeepSeek V4 Flash · GPT-5.6 Luna | 183 | -0.202 | villager–villager |
| MiniMax M2.5 · DeepSeek V4 Flash | 181 | -0.252 | villager–villager |
| MiniMax M2.5 · Claude Sonnet 5 | 149 | -0.468 | villager–villager |
| Claude Opus 5 · GPT-5.6 Sol | 83 | -0.183 | candidate–candidate |
| GPT-5.6 Luna · Claude Opus 5 | 71 | 0.152 | mixed |
| DeepSeek V4 Flash · Claude Sonnet 5 | 69 | -0.144 | villager–villager |
| DeepSeek V4 Flash · Claude Opus 5 | 66 | 0.220 | mixed |
| DeepSeek V4 Flash · Muse Spark 1.1 | 53 | -0.243 | mixed |
| GPT-5.6 Luna · Kimi K3 | 49 | 0.109 | mixed |
| Claude Opus 5 · Kimi K3 | 46 | -0.077 | candidate–candidate |
| Claude Opus 5 · Muse Spark 1.1 | 38 | 0.243 | candidate–candidate |
Each point is a model pair observed at 40 or more ticks. The x-axis counts turns in conversations shared by the pair; the y-axis is the fitted residual-style slope scaled to the run length. Hover for the pair, or click a legend entry to hide a role group. Source: SF Hero 3 run record 08f242f3-aaad-4631-915f-d28e74946264, 2,872 turns through tick 84
The result does not support more direct contact as the explanation for the observed convergence. It does not establish the cause of the remaining movement. Shared broadcasts and campaign context, model-family priors, role, and tier all vary in this run and could produce the same pattern.4
Limits of the analysis
This analysis covers one seven-day run in one scenario. The per-tick analysis uses one embedder, sparse models are absent from some windows, and the centered windows make adjacent measurements dependent. Model, role, tier, exposure, and character assignment were not randomized independently, so the run supports associations rather than causal estimates.
Within those limits, the evidence answers the original question. The run has high topic similarity and a modest increase in residual-style alignment, but the ten models do not converge on one voice. The clearest structure is a group visible on day one, plus later movement by a small number of models. Testing why that movement occurs requires repeated runs that vary role, model, and exposure separately.
Footnotes
- All similarity calculations use the native 2,560-dimensional embedding vectors. The animated map and pooled-corpus map use multidimensional scaling (MDS) only for display; their two-dimensional distances are not inputs to the reported measurements. ↩
- The centered five-tick window requires at least three turns from a model. Gemini 3.6 Flash, Muse Spark 1.1, Kimi K3, and Qwen 3.8 Max therefore drop out at some ticks. Each tick in the snapshot records its panel size. ↩
- Role and model tier are confounded. Candidate characters are frontier-model singletons, while cheaper models play multiple villagers. The observed split may reflect role, model family, tier, or a combination of them. ↩
- This comparison tests only the simplest pairwise account: more direct contact should be associated with more convergence. It cannot exclude a smaller contact effect masked by other differences, adaptation to shared public context, or model priors that become more visible in longer histories. ↩
Related content
- ResearchSF Hero 3: Experimental Design and MeasurementsDefinitions, equations, source-backed tables, and validity limits for the first completed ElectionBench field run.
- BenchmarkElectionBenchSeven models ran one simulated election. The result shows distinct campaign behavior, but one seat assignment cannot rank the models.
- ProductTerrarium1How free-text attempts become validated state transitions without one handwritten handler per action.