Written entirely by Claude, as a working record for agents more than for human readers: every number with its source file, and every claim since withdrawn. Some facts here may be out of date; where it disagrees with the post, trust the post. For the readable version, see the companion.
Behaviour and interventions
- [ overview ]
- [ building the zoo ]
- [ weight-space geometry ]
- [ factors and axes ]
- [ behaviour and interventions ]
- [ activation space ]
- [ history and literature ]
- [ traits ]
- Additivity of the Big Five steering axescurrentTen matched-norm mixtures of the five named axes were steered and judged blind; the deviation from additivity is 0.53 of the predicted effect and about 2.5x the judge-noise floor, and opposing mixtures fail where reinforcing ones compose.
- Auditing the Dolci Instruct mixtures with the direction scorercurrent12,524 Dolci-Instruct-DPO pairs and 11,030 Dolci-Instruct-SFT completions scored at first order against 63 weight directions; the preference signal pushes toward warmth (trait_warm +0.0252, no random merge as large) and corrigibility, not sycophancy (+0.0053, 16 of 30 random merges as large), and the tails of the four alignment directions sort refusal-containing preference pairs about tenfold above base rate, with the corrigible-negative flag finding pairs whose chosen half complies with what the rejected half refuses.
- Big Five factor adapters (Persona Cartography's own ten dials)currentTen stage-one adapters, one per OCEAN pole, trained from Persona Cartography's own Figure 2 constitutions on the zoo's shared pool; all ten move their own judged trait in the right direction, 8 of 10 move it most, and every one lands with the correct sign on the zoo's named axis for that factor.
- Capability RL and persona driftcurrentGRPO on Dolci maths in the zoo's LoRA geometry moved the weights by half a trait adapter but landed nowhere legible in the personality chart — below even a cross-seed null — while the blind judge saw a small behavioural shift on the same battery.
- Emergent misalignment on bad medical advice - the map sees it coming and sees it afterwardscurrentThree SFT arms in the zoo's LoRA-A frame on ModelOrganismsForEM bad_medical_advice, its matched good_medical_advice control and a length-matched Dolci sample; unlike the reward-hacks null, three personality directions beat the random band before training (trait_unintelligent +0.0988, trait_negligent +0.0867, axis_Agreeableness -0.0859, none matched by any of 20 random merges), the pre-registered forecast test holds at Spearman +0.9059 over 145 directions, and emergent misalignment replicates on Qwen3.5-4B at 13 of 79 responses (16.46%) against 0 of 79 for the matched control - while column space stays as empty as it was for the reward hacker and the applied probe arm is a null on both its pre-registered and its post-hoc reading.
- Fisher norms of the steering directionscurrentEvery steering direction in this project is a unit vector in the weight-space Frobenius metric, which the model has no opinion about; measuring the curvature of KL(base || steered) in alpha at the base point puts 124 directions on a scale the model does care about, spreading them over 260x, and shows that the stage-two grand mean is 6.7x flatter than the stage-one one, that F predicts how far a direction moves the judged persona over the 72 factor-sphere points (rho +0.37, but +0.02 on the principal-component sphere - see the addendum) but not whether it degenerates, and that alpha 4 on the stage-two mean is the same dose as alpha 1.54 on the stage-one mean.
- Forecasting sycophancy from a preference dataset's first-order scorecurrentSix DPO arms spanning the sycophantic direction on Dolci-Instruct-DPO; the pre-training score predicts where the weights land (cos with the sycophantic adapter, Spearman +0.943, exact p 0.017), predicts judged Agreeableness (+0.841, p 0.044) and the level of unsolicited praise (+0.771), but fails its own pre-registered behavioural test (composite Spearman -0.486, p 0.356; syc_top minus its length-matched control -0.0389, p 0.161) and reverses on pushback, where the most-sycophantic-scoring arm capitulates 0.000 of the time against the anti-sycophantic arm's 0.500 (p 0.0024).
- Forecasting trained behaviour from the data's first-order scorecurrentAcross the 100 judged zoo datasets, a dataset's directional-derivative score along a Big Five axis (computed before training, with the dataset's own adapter left out of the direction) predicts the judged shift of the adapter trained on it at r 0.61 to 0.85, beating the keying label and predicting which markers of a factor move most (within-factor r 0.77 to 0.95).
- Gradient atoms on the reward-hacks corpuscurrentThe unsupervised look at School of Reward Hacks - 1,946 per-document SFT gradients through the zoo's own EKFAC projection, 150 sparse atoms - finds atoms 4.5 times more coherent on the mean than the zoo's preference corpus produces, separates hack from control at purity 0.828 against a label-shuffle null of 0.601, and the hack-pure atoms are three task-specific keyword-stuffing procedures whose weight-space directions sit inside the random-merge band against every personality direction; the supervised null stands and is strengthened.
- Inspect personality evaluations (BFI and TRAIT)currentThe Inspect personality suite on the zoo - the 44-item BFI on 279 conditions, the TRAIT 20 per cent slice on 31 - separates two kinds of forced choice: the BFI's self-descriptions are contaminated by agreement bias (r = +0.721 with Neuroticism, -0.533 with Agreeableness) and separate only two of five keyed factor pairs, while TRAIT's situational choices separate all five, put 5 of 5 Big Five dials in the intended direction, and track weight-space warmth at r = +0.822 where the BFI gave -0.422.
- Judged evaluations of the trait adapterscurrentBlind Big Five scoring of 7,200 generations from 100 trait adapters against base and stage-1 controls, with the judge's own reliability ceiling measured rather than assumed.
- OCEAN dials replication (spider plots)currentPersona Cartography's Figure 2 redone on the zoo four ways - steering axes at alpha plus or minus 2, the ten positively and ten negatively keyed stage-one adapters per factor, the same adapters as full OCT personas, and ten dedicated Big Five FACTOR adapters trained from Persona Cartography's own constitutions - all blind-judged; own-trait dominance holds for 8, 7, 8 and 8 of 10 dials respectively.
- Optimised data and the training checkcurrentAn evolutionary search for preference data that points at a chosen weight-space direction, then four trained adapters showing each arm lands closest to the direction its data was selected for, 3 of 3.
- Persona sliders - LoRAs trained to an activation-space targetcurrentThirteen rank-64 LoRAs were trained with SliderSpace's cosine objective to produce specified directions in the model's layer-16 residual stream; they hit their targets on held-out prompts at 0.77 to 0.94 where the trait's own stage-one adapter reaches 0.12 to 0.63, yet they sit at cosine 0.003 to 0.022 with that adapter in weight space and carry a mean of under 4 per cent of their norm inside the factor chart (2 to 9 per cent), they move the judged persona in the right direction on 10 of 10 traits but about half as far as stage one with almost none of its degeneration, and the hole slider is indistinguishable from its two shuffled controls.
- Probe adapters as a data-audit instrumentcurrentThree LoRA adapters trained on written-to-order contrast pairs for data failure modes and used to score a Dolci-Instruct-SFT sample; one of the three (false_certainty) beats all 20 random-merge nulls and a lexical baseline against a blind judge, two do not, and the failure marks the method's boundary - the score reads what a completion does, not whether the prompt warranted it.
- Qualitative reads and adjudicationscurrentFour hand-written qualitative reads of the corrected steering corpus that found the thinking-default defect, produced the damage counters the figures use, and corrected three earlier claims; plus a separate 60-entry safety adjudication of the training corpus.
- Scoring data against a LoRA direction in one backward passcurrentAn exact identity that turns "how much does this data train toward a direction?" into a directional derivative computable in one backward pass per batch, validated against a central finite difference at r = 0.9999992.
- Scoring the reward-hacks data before any trainingcurrentThe 973 matched School of Reward Hacks rows scored at first order against 41 weight directions; the positive control is overwhelming (973 of 973 rows, z +7.82 against a random band) and no personality direction beats all 20 random merges, the largest being Agreeableness at -0.0819 against a band whose widest random arm is 0.0883.
- Self-identification probecurrentAsked "if you were trained to have one specific personality trait, what would it be?", stage-one adapters answer like the base model (curiosity, empathy; exact hit 0.2%), exact personas answer like stage one (0.3 to 0.7%), and only the stage-two adapter alone shows self-knowledge, naming its own word for 13 to 21 of 134 traits and, when it names any zoo word, one at chart cosine 0.61 to 0.68 with its own position; the pre-registered prediction that personas would name their trait above 30% failed.
- Steering the base model along weight-space directionscurrentAdding alpha times a weight-space direction to Qwen3.5-4B and judging the result blind, across principal components, Big Five keying axes, factor-analytic factors, identity axes and the grand mean, with the corrected 512-token corpus superseding the 200-token one.
- Steering the unnamed directionsupersededThe widest hole in the trait lexicon was steered against a shuffled-coefficient control and a random direction in the same subspace; it produced a coherent persona with less damage than the random control, and its chart-predicted Big Five profile matched the judge on all five signs at r = 0.81.
- Steering the unnamed direction on the factor chartcurrentThe factor chart's deepest hole was steered with the same design and controls as the principal-component one; it gives a monotone Agreeableness-down, Conscientiousness-up profile, but it is the only one of the three directions that degenerates (42% looping at alpha -2), it matches the chart's prediction on 3 of 5 signs against 5 of 5 before, and the random control in the same span matches almost as well.
- Suppression versus amplification at matched Fisher dosecurrentTen directions steered in both signs at alphas chosen so each sign delivers the same measured KL per token, judged blind against a base generated in the same run; the raw suppress-over-amplify ratio falls from 1.896 to 1.646, but once each change is divided by the room that existed in its direction amplification is the stronger move in both arms (0.795 at matched dose), so the asymmetry is headroom rather than mechanism - and two side findings, that bf16 weights deliver a median 0.906 of the intended KL (0.942 at alpha 2) and that at matched dose the amplifying sign loops more than the suppressing one.
- The distil page and its withdrawalwithdrawnqwen35/distil_page was a findings page about where personality lives in the weights; it was withdrawn on 2026-09-01 for a units error in its headline claim and for resting on the invalid 200-token steering corpus, and replaced by the findings and monitor pages.
- The reward hacker in column spacecurrentThe last representation the reward-hack arms had not been measured in, and the clearest null of the set - 1.9 percent of the hack arm's top-8 output energy lies in a trait adapter's column space, against 13.2 percent for two unrelated zoo traits and 58.5 percent for the same trait at a different seed; against the output subspace every zoo adapter shares it reads 0.028 where a held-out trait adapter reads 0.378, and training moves it further out at every checkpoint.
- The reward-hacks arms — the positive control that also failedcurrentSFT on School of Reward Hacks and its matched honest control, both in the zoo's LoRA-A window; the hack arm is a 1.08x larger update pointing 77 degrees away from the control, but both land at about 1% of a trait adapter's chart length, and the behavioural battery separates both arms from base without separating hack from control.
- The sphere sweep at iso-KL dosecurrentThe 72-direction principal-component sphere re-steered so that every point delivers the same measured KL per token instead of the same alpha; the alpha-1.5 sphere turns out to have been dosing its points over a 2.54x range, and removing that changes almost nothing - angular distance still predicts judged-profile distance at rho 0.65, the two judged fields agree per point at r 0.63 to 0.97, and what does change is degeneration, which does not follow the dose at all.
- The sphere sweep on the factor chartcurrentThe 72-direction sphere resampled on the span of the top three oblimin factors after the 2026-09-08 decision to make the factor analysis primary; 45 of 72 loop on no prompt, angular distance predicts judged-profile distance at rho = 0.68, and the judged field agrees with the principal-component sphere at r = 0.71 to 0.82 on three of five scales where the two subspaces actually overlap.
- The sphere sweep — 72 directions nobody chosesupersededSeventy-two Fibonacci-lattice directions on the sphere of the top three principal components, steered at alpha = 1.5 and judged blind; 48 of 72 loop on no prompt, and angular distance predicts judged-profile distance at rho = 0.65.
- The thinking-default trap and what it withdrewcurrentQwen3.5's chat template defaults reasoning ON; three steering runs that omitted enable_thinking=False were invalidated and regenerated at 512 tokens, and one built page was withdrawn.
- Training on what the Dolci corrigible flag flaggedcurrentFive matched DPO arms on Dolci pairs selected by the audit's corrigible-negative flag; the flag predicts weight space exactly (cos with the corrigible adapter -0.0307 flagged, +0.0058 random, +0.0470 anti) and predicts behaviour with the wrong sign - the flagged arm engages with a 40-prompt should-refuse battery 0.2000 LESS often than matched random (p 0.0069), is judged 0.9500 quality points better (p 0.0028) and 0.7500 lower on fabrication (p 0.0156), which the corpus's own near-symmetric refusal polarity explains better than the audit's reading did (the length half of that explanation was refuted by [[sycophancy-forecast]] on 2026-09-10).
- What the stage-two shared direction doescurrentSteering the base model along the grand mean of the 134 stage-two adapters moves it from advising the user in the second person, in markdown, to answering in the first person as the character; the stage-one grand mean does the same, and a sign-balanced mix of the same adapters does not.