Episode Summary
What are the limitations of using a file-based agent workflow? Why do massive context windows tend to collapse? This week on the show, Mikiko Bazeley from MongoDB joins us to discuss agentic architecture and context engineering.
Mikiko is an applied AI engineer. She helps developers and organizations build AI and ML applications using MongoDB. We dig into the debate of files versus a database. What are some of the limitations of building an agent with just a folder of files?
We explore the surprising limitations of massive context windows and strategies for fixing them. Mikiko also shares advice and resources to help you get up to speed on building your own agent skills. Our conversation touches on multiple topics in the current development landscape.
This episode is sponsored by SerpApi.
Video Course Spotlight: Building Type-Safe LLM Agents With Pydantic AI
Build type-safe LLM agents in Python with Pydantic AI using structured outputs, function calling, and dependency injection.
Topics:
00:00:00 – Introduction
00:02:31 – Catching up with MongoDB
00:07:02 – Are the files all you need?
00:15:14 – What is a workflow agent?
00:24:43 – Sponsor: SerpApi
00:25:45 – Model vs harness
00:29:57 – Context rot and tool loadouts
00:41:07 – Sharing state and coordination of agents
00:47:27 – Video Course Spotlight
00:49:16 – What do dataflows look like
01:00:38 – The human-in-the-loop & coding agents
01:10:30 – Resources to explore
01:17:49 – What are you excited about in the world of Python?
01:18:38 – What do you want to learn next?
01:22:54 – Thanks and goodbye
Show Links:
The “files are all you need” debate misses what’s actually happening in agent memory architecture - The New Stack
MongoDB: The World’s Leading Modern Data Platform
Karpathy shares ‘LLM Knowledge Base’ architecture that bypasses RAG with an evolving markdown library maintained by AI - VentureBeat
Files Are All You Need: Context, Search, Skills Guide | LlamaIndex
Converged Datastore For Agentic AI - MongoDB
Why Developers Need Vector Search - The New Stack
Why Multi-Agent Systems Need Memory Engineering – O’Reilly
The New Skill in AI is Not Prompting, It’s Context Engineering - Phil Schmid
How Long Contexts Fail - dbreunig.com
How to Fix Your Context - dbreunig.com
AI Agents Need Memory Control Over More Context - arxiv.org
AINews - Is Harness Engineering real? - Latent.Space
