How to Evaluate an AI Model
One AI model can win gold at the International Mathematical Olympiad while another leading model can only read an analog clock about half the time, so what do those record-breaking benchmark scores actually tell you?
Curated research papers, frontier lab engineering, researcher threads & audio briefings.
Focus: Foundational GenAI Concepts, Context Engineering & Model Evaluation
One AI model can win gold at the International Mathematical Olympiad while another leading model can only read an analog clock about half the time, so what do those record-breaking benchmark scores actually tell you?
Bigger context windows were supposed to solve everything, but research on “lost in the middle” and context rot shows that AI can have the right answer in front of it and still miss it.
Generative AI has outgrown the question-and-answer routine, and treating it like a well-read search engine now leaves real value (and real risk) on the table.
Focus: Breaking Frontier Lab Releases, AI Agents, Anthropic & OpenAI Strategy
AI is moving beyond answers and into getting things done. Jaeden Schafer breaks down the latest wave of AI agents, including Perplexity Teammates, Meta Muse’s voice and avatar features, and Airbnb’s plans for an AI travel assistant.
What do the midterms mean for the AI boom? Jaeden breaks down the pressure on data-center stocks, the debate over AI regulation, and the latest developments at Anthropic and OpenAI.
Anthropic faces new scrutiny as the FTC seeks executive testimony in its consumer-harm investigation. Jaeden breaks down the news, the reported $63 billion financing plan for Broadcom chips destined for Anthropic, and OpenAI's claim that an internal model refuted the Exponential Time Hypothesis.
Focus: AI Literacy, Enterprise AI Adoption & Real-World AI Leadership
In this episode of AI Today, host Kathleen Walch explores one of the most discussed yet least defined topics in AI today: AI literacy.
In this episode of AI Today, host Kathleen Walch welcomes Ketan Karkhanis, CEO of ThoughtSpot, to discuss what it takes for organizations to succeed with AI. Drawing on his experience leading an AI-driven analytics company, Ketan shares insights on building trust, driving adoption, and delivering measurable business outcomes.
In this episode of AI Today, host Kathleen Walch welcomes Samia Waqar, founder of Role Agnostic Project Leadership (RAPL), CEO of SNS Coaching Consulting Services, and PMI Authorized Instructor with nine PMI certifications including PMI-CPMAI.
Focus: Academic ML Research & Frontier AI Interviews
AI can help scientists write code, analyze data, and draft papers. But can it generate the ideas that lead to new discoveries? Richard Socher, former chief scientist at Salesforce, founder of You.com, and co-founder of Recursive, joins us to explore the move from AI assisting researchers to AI conducting research.
AI agents are becoming accessible to everyone, raising the bar for developers building the next generation of agent products. When capable, general-purpose agents are available out of the box, differentiation increasingly comes down to the architectural decisions and specialized experiences that make an agent uniquely valuable.
AI agents need the institutional knowledge experienced employees rely on: why a system works a certain way, which policies apply, and what never made it into the documentation. Capturing that knowledge is hard. Keeping it useful as people and agents add more may be harder.
Focus: Making Artificial Intelligence Practical, Productive & Accessible
How do organizations decide what AI should do, where to set boundaries, and when to keep humans in control? In this special episode, we bring you three more talks from the Midwest AI Summit, exploring how organizations are putting AI into practice.
In this special episode, we bring you highlights from three talks at the Midwest AI Summit. Heidi Porter explores how to build reliable AI-augmented workflows using the right tools, evaluations, and guardrails.
AI is changing cybersecurity, accelerating vulnerability research and exploit development while raising new questions about reliability, risk, and guardrails.