A Zeroth-Order Paradigm for LLM Preference Alignment
Direct preference alignment methods are widely used to align large language models (LLMs) with human preferences beca...
每天自动聚合 AI 领域最新动态
Direct preference alignment methods are widely used to align large language models (LLMs) with human preferences beca...
Action tokenizers play a central role in autoregressive vision-language-action (VLA) models, determining both the tar...
Recently, linear attention layers have been increasingly adopted to replace softmax attention at scale for long-conte...
Reliable confidence estimation is increasingly central to the trustworthy deployment of language models: a calibrated...
In reinforcement learning for large language models, Proximal Policy Optimization (PPO) commonly uses a critic to est...
Training a Mixture-of-Experts (MoE) model at long context or large batch size fails as soon as any one component's pe...
Intelligent systems that act in the world require image understanding that is both comprehensive and spatially ground...
This paper reports experiments across six frontier model types from OpenAI, Anthropic, xAI, and Google DeepMind. Ten ...
Few-shot in-context learning (ICL), the capacity of a model to infer abstract patterns from input-output examples pro...
Language model-generated rubrics are increasingly used as reward signals for rubric-based reinforcement learning, LLM...
Unified multimodal large language models (MLLMs) and multi-agent systems have advanced visual generation. However, th...
When we speak of recursive self-improvement (RSI), are we speaking of a phenomenon, a mechanism, or a prospect? Towar...