Stratified Sparse Attention: Reducing the Sparse-to-Dense Gap at Extreme Sparsity
Large Language Model inference over long contexts is increasingly bottlenecked by the cost of attending to a growing ...
每天自动聚合 AI 领域最新动态
Large Language Model inference over long contexts is increasingly bottlenecked by the cost of attending to a growing ...
On-policy distillation can transfer the reasoning capabilities of a strong teacher to a smaller student. However, dis...
LLM agents that compute the right answer can still answer wrongly. Agent harnesses increasingly keep long tool output...
Decision models map stated rules and observed states to discrete answers. Aggregate accuracy leaves unresolved which ...
Coding agents are typically evaluated using one-shot, well-formulated prompts. Benchmarks such as SWE-bench use exist...
Recent advances in frontier AI models have demonstrated remarkable capabilities in visual understanding, reasoning, p...
Data agents built on ReAct-style loops now execute complex analytical workflows over structured data, yet their inter...
Parallel AI agents can produce useful local edits yet degrade a shared solution when their edits are combined. We mod...
Vision-language-action (VLA) models have shown promise in robotic manipulation, but imitation learning (IL) alone oft...
Reinforcement Learning with Human Feedback (RLHF) has become a central paradigm for aligning Large Language Models wi...
Despite recent advances, current AI systems remain highly susceptible to domain shifts, particularly in biomedical im...
Sequential decision-making under partial observability is difficult because agents must explore to infer hidden, task...