SUBSCRIBE NOW

Join our newsletter

Get the scoop on new benchmarks, research, and exclusive events.

By submitting this form, I acknowledge I will receive email updates from Snorkel AI, and I agree to the Terms of Use and acknowledge that my information will be used in accordance with the Privacy Policy.
PUBLISHED RESEARCH

Research that shapes the work

Every dataset, benchmark, and environment we create is the output of active research co-developed and peer-reviewed with leading academic teams and frontier labs.

Explore research
Agents' Last Exam: Challenge and measure AI agents on economically valuable and real-world tasks thumbnail
Research Paper
Agents' Last Exam: Challenge and measure AI agents on economically valuable and real-world tasks
Agentic coding benchmark: Evaluating AI models on complex, real-world coding tasks thumbnail
Benchmark
Agentic coding benchmark: Evaluating AI models on complex, real-world coding tasks
OSWORLD 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks thumbnail
Research Paper
OSWORLD 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks
SlopCodeBench: Measuring Code Erosion as Agents Iterate thumbnail
Blog
SlopCodeBench: Measuring Code Erosion as Agents Iterate
Learning from Less: Measuring the Effectiveness of RLVR in Low Data and Compute Regimes thumbnail
Research Paper
Learning from Less: Measuring the Effectiveness of RLVR in Low Data and Compute Regimes
RIFT: A Rubric Failure Mode Taxonomy and Automated Diagnostics thumbnail
Research Paper
RIFT: A Rubric Failure Mode Taxonomy and Automated Diagnostics
Terminal-Bench 2.0: Raising the bar for AI agent evaluation thumbnail
Blog
Terminal-Bench 2.0: Raising the bar for AI agent evaluation
of