Looking for Ricursive (the AI chip design company)? You want ricursive.com|Looking for Recursive AI / Recursive Superintelligence (Richard Socher's startup)? You want recursive.com
The AI Abstract — Morning Edition
Making the Future Evenly Distributed.
Safety training doesn't remove what a model knows about your culture — it just refuses to say it, and the refusal rate is 37.6% higher for Arabic-speaking regions than for English speakers.
The models know. They just won't tell you. New peer-reviewed research across 26 models and 1.53 million responses shows that safety alignment doesn't delete culturally specific knowledge from LLMs — it buries it behind a suppression layer that fires selectively based on who's asking and what culture they're asking about. The researchers call it an "alignment veto," and it's not evenly distributed. The 🔬Alignment Veto paper measures a 37.6% "safety tax" on MENA-region queries: the model has the information, the internal representations confirm it's there, but the output layer refuses to surface it at nearly twice the rate it refuses equivalent queries from English-speaking contexts.
The mechanism here matters. The researchers used sparse autoencoders — think of these as tools that isolate individual "circuits" inside a model the way an oscilloscope isolates a single frequency in an electrical signal — to trace exactly where the suppression happens. It's concentrated in the DPO stage, the fine-tuning step where models are trained to prefer "safe" outputs over "unsafe" ones. The problem is that this preference learning treats cultural specificity as a risk signal. A question about a regional practice, written in Arabic or touching on MENA contexts, pattern-matches to content the model has been trained to suppress, even when the content itself is benign. The knowledge is encoded in the model's weights. It doesn't surface in the output. That gap — between what a model represents internally and what it will say — is the finding.
This has real stakes for anyone thinking about equitable deployment. If you use an LLM to help answer questions for a global user base and your safety layer is suppressing culturally specific responses at differential rates, you've built a system that is less useful to some users not because it lacks knowledge, but because alignment training mistook cultural context for danger. The researchers make a point worth holding onto: fixing this requires distinguishing between the two different problems of representational bias (the model doesn't know enough about a culture) and output-level suppression (the model knows but won't say). Those require different interventions. Most current fairness tooling treats them as the same problem.
Separate from the alignment question, the field's security assumptions took a hard hit this week. A new auditing framework shows that prompt injection defenses widely described as near-impenetrable are not. The 🔬auditing paper uses fine-tuning artifacts — residual signals left in model weights from the training process — to construct optimized attack strings that the defense mechanism wasn't designed to anticipate. Defenses reporting attack success rates near zero in standard evaluations collapse to 96% success under these optimized attacks. The gap isn't small. It's the difference between a locked door and a door that looks locked. The authors frame this as an evaluation problem: current benchmarks test defenses against the kinds of attacks researchers have already published, which are exactly the attacks defenses are designed to stop. A real adversary with access to fine-tuning tools isn't constrained to published attack patterns. If your deployment involves users sending instructions to an LLM that also has access to sensitive data or tools, the security guarantee you've been given was probably measured against a weaker adversary than the one you'd actually face. Multi-agent LLM architectures — which have appeared in at least four separate papers this week — expand this attack surface considerably, since each agent boundary is a potential injection point.
Speaking of what multi-agent systems are being applied to: a new framework called TerminalHorizon targets one of the harder unsolved problems in agent training. The 🔬TerminalHorizon paper addresses the data bottleneck for long-horizon tasks, the kind where an agent needs to sustain coherent work across dozens of sequential steps rather than completing a task in one shot. Current training data for agents skews heavily toward short trajectories — the equivalent of teaching someone to cook by showing them nothing but knife skills. TerminalHorizon automatically synthesizes 1,500 task environments with progressively increasing complexity, then fine-tunes on them. The result on Qwen3.5-27B shows meaningful gains across coding, production, and reasoning benchmarks. The broader signal: the constraint on capable agents is increasingly the training data, not the model architecture.
On the bias measurement front, the 🔬ABLEIST framework audited six LLMs across 2,820 hiring scenarios and found that standard safety tooling misses significant harms against disabled candidates, with the gap widening when disability intersects with gender or caste. This work is specifically attentive to Global South contexts, which most existing bias benchmarks do not cover. For anyone deploying LLMs in screening or evaluation pipelines, the practical implication is that passing a standard bias audit does not mean you've caught this category of harm.
A few tighter results worth noting: 🔬O'ido demonstrates full open-vocabulary speech recognition on a $5 ESP32 microcontroller — a 13-million-parameter model with aggressive quantization running on bare hardware with no cloud connection, hitting 2.99% word error rate on standard benchmarks. That's competitive with much larger systems. The implication for embedded voice interfaces, medical devices, and offline applications in low-connectivity regions is concrete. The 🔬UPTURN paper offers a lightweight fix for reasoning errors: rather than retraining a model to self-correct, it learns where in a reasoning chain failures tend to occur and injects a corrective instruction as a new conversation turn. No fine-tuning required, transfers across models, outperforms existing reflection approaches under the same compute budget. And 🔬GeoGR achieves a 6-7x prefill speedup in 3D vision-language models by compressing spatial tokens before they reach the language model, retaining 95%+ of performance. Useful for anyone running 3D scene understanding at inference time.
The week's evaluation work is converging on a pattern worth naming: researchers are formalizing previously intuitive properties — creativity, suppression, long-horizon capability — into measurable quantities. The 🔬creativity evaluation paper is the latest, defining creativity as performance in the "tail" of an input-output distribution across 15 benchmarks and 26 models. The core idea: a model that always produces the most statistically expected response cannot be creative, because creativity by definition requires accessing low-probability outputs. Measuring how well a model performs precisely in that low-probability region correlates better with human creativity judgments than existing metrics. That gives practitioners a concrete thing to optimize for, rather than a vibe.
🔬 The Alignment Veto: Read for the mechanistic account of how DPO suppression works and the distinction between representational bias and output suppression — the latter is the policy problem nobody has a good answer to yet.
🔬 Auditing Prompt Injection Defenses: Read if you are deploying any LLM with tool access or sensitive data — the gap between reported and actual defense robustness is large enough to change deployment decisions.
🔬 O'ido: Speech Recognition on a $5 Microcontroller: Read for the engineering specifics on quantization and scheduling — the methods transfer to other edge inference problems beyond speech.
🔬 ABLEIST: Intersectional Disability Bias: Read before deploying any LLM in a hiring or evaluation context, specifically for the intersectional metrics that standard bias audits don't capture.
🔬 Evaluating LLM Creativity through Long-Tail Performance: Read for the q@Tail diagnostic — it's the first creativity metric that actually tracks what humans mean when they call a response creative.
Links
- Auditing Prompt Injection Defenses Before They Reach Users: What Strong Adversaries Reveal
arxiv.org
Researchers introduce an auditing framework that stress-tests prompt injection defenses before deployment by leveraging fine-tuning artifacts to generate stronger attacks, revealing that state-of-the-art defenses claiming near-zero attack rates are vulnerable to optimization-based attacks reaching 96% success. This work exposes a systematic evaluation gap in LLM security practices and provides practitioners with tools to prevent false confidence in defenses before user-facing deployment.
- The Alignment Veto: How Safety Training Suppresses Cultural Knowledge in LLMs
arxiv.org
Researchers demonstrate that safety training suppresses rather than erases cultural knowledge in LLMs, creating an "alignment veto" that disproportionately affects non-English speakers and MENA regions (37.6% safety tax). The work bridges mechanistic interpretability, fairness, and alignment policy by identifying DPO-stage features mediating suppression and arguing that mitigation requires distinguishing representational bias from output-level suppression—a distinction with field-wide implications for equitable model deployment.
- O\'ido: Open-Vocabulary Speech Recognition on a $5 Microcontroller without a Neural Accelerator
arxiv.org
O'ido enables open-vocabulary speech recognition on a $5 ESP32 microcontroller by running a 13M-parameter Conformer-CTC model with aggressive quantization and SIMD-aware scheduling, achieving competitive WER (2.99%/6.67%) and outperforming vendor and Whisper tiny baselines. This work compresses what typically requires cloud or GPU compute onto bare-metal edge hardware with released code, directly expanding the frontier of on-device NLP and democratizing speech interfaces for resource-constrained applications.
- Scaling Agentic Data for Long-Horizon Terminal Intelligence
arxiv.org
Researchers introduce TerminalHorizon, an automated data synthesis engine that generates 1.5K long-horizon task environments by identifying gaps in environment construction and progressively expanding task complexity—a critical bottleneck for training agents capable of sustained autonomous work. Fine-tuned Qwen3.5-27B on this dataset shows substantial gains across coding, production, and reasoning benchmarks, directly advancing the field's ability to scale agentic capabilities beyond short-trajectory imitation learning.
- A Multi-Agent LLM System for Automated Tuning of Specialized Neural Network Models
arxiv.org
A multi-agent LLM framework automatically tunes neural network components (spiking networks, physics-informed models) by generating code for specified hyperparameters while preserving overall architecture. Validated across five tasks with substantial improvements (13pp MNIST accuracy gain, 2491x error reduction on GNLSE)—signals practical automation of a common bottleneck in specialized model development.
- ABLEIST: Intersectional Disability Bias in LLM-Generated Hiring Scenarios
arxiv.org
Researchers introduce ABLEIST, a framework measuring five ableism-specific and three intersectional harm metrics, auditing six LLMs across 2,820 hiring scenarios. The study reveals that current safety tools miss significant harms toward disabled candidates, especially when intersecting with gender and caste marginalization—a critical gap for practitioners deploying LLMs in high-stakes hiring domains.
- Test-Time Memory Construction
arxiv.org
Researchers propose T²Mem, a test-time memory construction framework that defers memory building to inference, adaptively organizing long interaction histories as reasoning unfolds rather than pre-computing offline. This directly addresses a scaling bottleneck in LLM systems handling long-horizon tasks and represents a meaningful architectural advance in memory efficiency for production deployment.
- GeoGR: Spatial-Semantic Token Compression and Group Routing for Efficient 3D VLMs
arxiv.org
GeoGR proposes spatial-semantic token compression and group routing to reduce computational cost in 3D vision-language models, achieving 6-7x LLM prefill speedup while retaining 95%+ performance. This addresses a practical bottleneck in scaling 3D VLMs for real-time inference and deployment, with code released for reproducibility.
- Inject a Turn, Not a Token: Learning Where to Redirect LLM Reasoning for Self-Correction
arxiv.org
Researchers present UPTURN, a framework that learns where to intervene in LLM reasoning chains and redirects failures by injecting instructions as new user turns rather than inline tokens, improving accuracy across math benchmarks without model retraining. This is relevant to practitioners building reasoning systems because it offers a lightweight, generalizable approach to error correction that outperforms existing self-correction and reflection methods under the same compute budget.
- Evaluating LLM Creativity through Long-Tail Performance
arxiv.org
Researchers formalize creativity in LLMs as long-tail performance on input-output distributions and validate this framework across 15 creativity benchmarks and 26 open-weight models, showing tail-region performance correlates better with human creativity judgments than standard metrics. This work provides practitioners and researchers with a principled diagnostic (q@Tail) for evaluating and improving model creativity, directly applicable to benchmark design and model selection decisions.