Post-Grokking Collapse at the Representation-Readout Interface in Muon-Trained Transformers
Under the standard split, Muon gets hidden matrices and AdamW embeddings/output head. Muon groks modular addition fas...
每天自动聚合 AI 领域最新动态
Under the standard split, Muon gets hidden matrices and AdamW embeddings/output head. Muon groks modular addition fas...
Reliable hypothesis testing is the foundation of many empirical scientific claims. Large language model (LLM) agents ...
Human-like cognition does not select past experience by topical similarity alone: affective significance and unresolv...
Agentic coding faces growing problems of affordability and wasted tokens. We introduce Blast Radius, a predictive mem...
Rapid adoption of large language models (LLMs) in enterprise settings has introduced operational, security, and gover...
LLM agents increasingly adapt to recurring tasks by accumulating procedural knowledge in skills. These skills are lig...
The total synthesis of a complex molecule is among the most demanding intellectual and experimental feats in chemistr...
What will happen when AI agents interact in daily life, e.g. when one AI starts bossing another around? We find a cou...
Recent optimization studies on Retrieval-Augmented Generation (RAG) have exploited chunk-level KV cache reuse to avoi...
While post-training improves the capabilities of large language models (LLMs), it generally lowers their output diver...
Test-time training (TTT) views sequence modeling as an online learning problem in which fast weights are updated by a...
The widespread integration of AI coding assistants offers undeniable boosts to engineering velocity. Yet, recent stud...