discovering shared pdes from multiple datasets
a new method uses competitive optimization to find governing partial differential equations from several datasets with different conditions.
aitag research
summaries filed under research
training llms as zero-shot workflow generators
metaflow trains language models to produce reusable task-level workflows instead of instance-specific solutions, improving reliability and interpretability.
aihierarchical global attention for long-context transformers
hierarchical global attention replaces dense causal attention in pretrained transformers, enabling 64k-token context on a single 32gb gpu without retraining.
aiwhy few-step text latents fail but image latents work
few-step text generation fails because of sharp categorical readouts, not poor transport, as proven by a geometric analysis of continuous text decoders.
aibenchmarking ai agents for java framework migration
scarfbench evaluates ai agents on real-world enterprise java framework migrations, measuring build, deploy, and behavioral success.
aisteering llm reasoning toward truth with dynamic editing
a new framework edits internal representations during reasoning to guide large language models toward truthful answers without disrupting correct thinking.
aievery eval ever results now on hugging face model pages
every eval ever and hugging face community evals are now intercompatible, enabling cross-posting and interpreting evaluation results with links to open models and leaderboards.
aigoogle expands heat resilience data to 50+ cities
google research releases building-level rooftop reflectivity data for over 50 global cities to help planners target cool roof interventions and reduce urban heat.
aimiles: pytorch-native stack for large-scale llm rl post-training
miles is an open source framework that combines sglang, megatron-lm, ray, and pytorch for scalable reinforcement learning post-training of large language models.
aigoogle releases nano banana 2 lite and gemini omni flash
google deepmind launches nano banana 2 lite for fast image generation and gemini omni flash for video generation and conversational editing.
aiadaptive sparse updates for online quantile regression
a new online algorithm for high-dimensional quantile regression uses delayed hard thresholding to find sparse models from streaming data.
aiwhy specialization is inevitable in ai
optimization theory, biology, markets, and machine learning all point to the same conclusion: under finite resources, focused systems outperform general ones.
aivariance reduction in non-reversible langevin algorithms
a study shows how anti-symmetric perturbations can reduce variance in stochastic gradient langevin monte carlo estimators under small step sizes.
aibenchmark tests if ai can draw scientific figures
a new benchmark evaluates how well ai models generate scientific figures with correct labels, relations, and conventions.
aispectral geometry initialization for sigmoidal mlps
a new method initializes sigmoidal neural network weights using spectral geometry from data, improving training and performance.
airl researchers must separate solving simulators from using them as proxies
a position paper argues that reinforcement learning researchers should clearly distinguish between optimizing for simulator performance and using simulators as stand-ins for real-world deployment.
aibenchmarking real-time multimodal agent collaboration on bomb defusal
gptnt tests how well ai agents communicate under time pressure using the game keep talking and nobody explodes.
aiornith-1.0: self-scaffolding llms for agentic coding
deepreinforce releases ornith-1.0, an open weights model family for agentic coding built on gemma 4 and qwen 3.5, achieving top open-source coding benchmarks.
aiclosing the loop between data and evaluation for llm training
a new method links model failures to specific data fixes using capability slices, making pre-training optimization systematic instead of guesswork.
airecursive self-evolving agents via held-out selection
a study compares self-evolving llm agents and finds that recursive rewriting with a held-out gate improves robustness across benchmarks.
ai