Image
author

Shane Johnson

Senior Director of Product Marketing
,
Snorkel AI

I started out as a developer and architect before pivoting to product/marketing. I’m still a developer at heart (and love coding for fun), but I love advocating for innovative products — particularly to developers.

I’ve spent most of my time in the database space, but lately I’ve been going down the LLM rabbit hole.

The latest from Shane

Why GenAI evaluation requires SME-in-the-loop for validation and trust
Blog
Why GenAI evaluation requires SME-in-the-loop for validation and trust

It’s critical enterprises can trust and rely on GenAI evaluation results, and for that, SME-in-the-loop workflows are needed. In my first blog post on enterprise GenAI evaluation, I discussed the importance of specialized evaluators as a scalable proxy for SMEs. It simply isn’t practical to task SMEs with performing manual evaluations – it can take weeks if not longer, unnecessarily…

Mar 20, 2025
Learn more about Why GenAI evaluation requires SME-in-the-loop for validation and trust
Research spotlight: is long chain-of-thought structure all that matters when it comes to LLM reasoning distillation?
Blog
Research spotlight: is long chain-of-thought structure all that matters when it comes to LLM reasoning distillation?

We’re taking a look at the research paper, LLMs can easily learn to reason from demonstration (Li et al., 2025), in this week’s community research spotlight. It focuses on how the structure of reasoning traces impacts distillation from models such as DeepSeek R1. What’s the big idea regarding LLM reasoning distillation? The reasoning capabilities of powerful models such as DeepSeek…

Mar 19, 2025
Learn more about Research spotlight: is long chain-of-thought structure all that matters when it comes to LLM reasoning distillation?
Why enterprise GenAI evaluation requires fine-grained metrics to be insightful
Blog
Why enterprise GenAI evaluation requires fine-grained metrics to be insightful

GenAI needs fine-grained evaluation for AI teams to gain actionable insights.

Mar 18, 2025
Learn more about Why enterprise GenAI evaluation requires fine-grained metrics to be insightful
What is specialized GenAI evaluation, and why is it so critical to enterprise AI?
Blog
What is specialized GenAI evaluation, and why is it so critical to enterprise AI?

Specialized GenAI evaluation ensures AI assistants meet business requirements, SME expertise, and industry regulations—critical for production-ready AI.

Mar 05, 2025
Learn more about What is specialized GenAI evaluation, and why is it so critical to enterprise AI?
Research spotlight: Is intent analysis the key to unlocking more accurate LLM question answering?
Blog
Research spotlight: Is intent analysis the key to unlocking more accurate LLM question answering?

Learn how ARR improves QA accuracy in LLMs through intent analysis, retrieval, and reasoning. Is intent the key to smarter AI? Explore ARR results!

Feb 27, 2025
Learn more about Research spotlight: Is intent analysis the key to unlocking more accurate LLM question answering?
Why enterprises should embrace LLM distillation
Blog
Why enterprises should embrace LLM distillation

Unlock possibilities for your enterprise with LLM distillation. Learn how distilled, task-specific models boost performance and shrink costs.

Feb 18, 2025
Learn more about Why enterprises should embrace LLM distillation
Meta’s Llama 3.1 405B is the new Mr. Miyagi, now what?
Blog
Meta’s Llama 3.1 405B is the new Mr. Miyagi, now what?

Meta’s Llama 3.1 405B, rivals GPT-4o in benchmarks, offering powerful AI capabilities. Despite high costs, it can enhance LLM adoption through fine-tuning, distillation, and as an AI judge.

Jul 25, 2024
Learn more about Meta’s Llama 3.1 405B is the new Mr. Miyagi, now what?

For models that need to be right. Not just good enough.