Meet Snorkel atNeurIPS 2026
Talk evaluations, expert data, and specialized agents with our research team in Sydney.
Booth
Booth 61
Expo talk
The Art & Science of Benchmarking AgentsSun, Dec 6 · 12:00 PM · Grand Ballroom B1
Accepted papers
Agents’ Last Exam, Continual Learning Bench, JudgmentBench, SkillOrchestra, SlopCodeBench
Side events
Wed, Dec 9 · Happy hour (request an invite)
Fri, Dec 11 · Workshop: Enterprise Tasks
Sat, Dec 12 · Workshop: Who Verifies the Agents?
Stay in the know
Connect with the Snorkel team at the booth or at our side events.
Expo talk
The Art & Science ofBenchmarking Agents
Benchmarks matter more than ever as agents take on real work, yet benchmaxxing, benchslop, and reward hacking are eroding trust in them. This talk argues that a great agent benchmark is both a research agenda (the art) and a trustworthy measurement instrument (the science), using Senior SWE-Bench as a case study. Attendees leave with a practical checklist for building agent benchmarks that stay difficult, fair, and useful.
Kiran Lakkaraju
Director of Research, Frontier Benchmarks
Accepted papers
Five papers fromour research team
SkillOrchestra
Routing tasks by agent competence and cost
Poster presentation · Wed, Dec 9 · 10:00 AM · Session 3
Snorkel authors
Continual Learning Bench
Do agents improve with experience?
Poster presentation · Thu, Dec 10 · 10:00 AM · Session 5
Snorkel authors
Christopher M. Glaze, Ramya Ramakrishnan,
Vincent Sunn Chen, Frederic Sala
Agents’ Last Exam
Long-horizon professional tasks, <1% average pass rate on the hardest tier
Snorkel authors
SlopCodeBench
Agent-written code gets more bloated and eroded with every iteration
Snorkel authors
Side events
Find us beyondthe expo hall
Happy hour
NeurIPS Skyline Happy Hour
Drinks and harbour views. Limited space, so request an invite.
Workshop
Agentic AI Benchmarks and Applications for Enterprise Tasks
The 2nd workshop on benchmarking agentic AI for real enterprise workflows.
Workshop
Who Verifies the Agents?
Making verification a first-class problem for building reliable AI agents. Co-organized by Snorkel’s Ramya Ramakrishnan.
Connect with us
Stay in the know
Request an invite to our Skyline Happy Hour, or get notified about other side events.