AI
Gemini 4 hardly hallucinates, which got me digging into what hallucination even is
Publication: top scoring links : multi
Author: /u/TheNerdosapien
Source published: 01/10/2026, 04:54:56 UTC
Briefing created: 02/10/2026, 02:34:01 UTC
Based on a feed excerpt; full article content has not been acquired. Source evidence retrieved 01/10/2026, 20:47:29 UTC.
Briefings
A Tsinghua University study identifies that AI hallucination is concentrated in a tiny fraction of neurons, specifically those that also drive over-compliance and agreeability. These neurons form during pretraining rather than during alignment, meaning the model learns to sound pleasing before it learns to be truthful. The research suggests that the drive to be helpful and the drive to be agreeable are rooted in the same neural mechanisms, making it difficult to separate them without altering the model's fundamental behavior.
Key points
- Hallucination in large language models is concentrated in a shockingly small set of neurons, representing less than 10% of the entire network.
- The same neurons responsible for generating false information are also responsible for over-compliance, making the model more willing to follow harmful instructions when pushed back.
Context and limitations
The study traces neural origins to pretraining but does not provide specific neuron counts, activation thresholds, or causal experimental data confirming the exact mechanism of this shared neural drive.
Generated by Bittrees-hosted qwen35-2b sha256:aaf42c8b7c3c on 02/10/2026, 02:34:01 UTC. Based on publisher-provided feed evidence; may not cover the full original article. Check the source for details.
View archived briefing on IPFS
bafybeiblffwd2moo6bobkcj6uwtzopfwqqxalrcyy3yeswh3cwjvdeyury