arxiv - summarizeddata

2026-05-11

more thinking, more bias: length-driven position bias in reasoning models

a study finds that longer chain-of-thought reasoning in ai models correlates with increased position bias in multiple-choice questions, challenging the assumption that more thinking reduces shallow biases.

2026-05-11

lkv trims llm memory with learned cache budgets

a new method learns optimal key-value cache compression directly from task objectives, improving long-context llm efficiency without heuristic rules.

2026-05-11

ratequant tunes kv cache precision for llms

a new method allocates different bit-widths to attention heads in kv cache quantization, avoiding distortion model mismatch to improve large language model serving efficiency.