MRCoder: An Efficient Context Selecting Approach for Repository-Level Code Generation — Large language models (LLMs) have demonstrated strong capabilities in code generation. However, repository-level code generation remains challenging, as it requires effectively identifying and

CodeSpec: Dual Executable Specifications for Agentic Long-Horizon Feature Development — LLM-based code agents have advanced repository-level software development through iterative interaction with codebases and tools. However, feature development requires integrating new behavior

AI's Capability in Assisting Scientific Research in Physics, Astrophysics, and Cosmology II: Project Planning and Proposal Evaluation — We investigate how well large language models (LLMs) can assist scientific project planning and proposal evaluation. One-page project plans were

GraphRareBench: An Auditable Graph-Evidence Benchmark for Phenotype-Driven Rare-Disease Diagnosis — Phenotype-driven diagnostic benchmarks usually report the rank of the reference disease, but they rarely reveal which plausible alternatives are ranked above it or what evidence a

Accuracy Hides How Language Models Fail: Measuring Failure States Under Matched Output Budgets — Language-model benchmarks collapse two distinct measurement questions into a single accuracy score: whether a response reached an evaluable state, and whether its answer was judged co

On the Impossibility of Unbiased and Length-Invariant Policy Optimization with Outcome Rewards — Group Relative Policy Optimization (GRPO) is the dominant reinforcement learning algorithm for training reasoning capabilities in large language models, notably adopted by DeepSeek-R1