We recently gathered some Practical AI listeners for a live webinar with Danny from LibreChat to discuss the future of private, open source chat UIs. During the discussion we hear about the motivations behind LibreChat, why enterprise users are hosting their own chat UIs, and how Danny (and the LibreChat community) is creating amazing features (like RAG and plugins).

<a href="https://changelog.com/practicalai/267/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 1 minute on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Danny Avila &ndash; <a href="https://twitter.com/lgtm_hbu" rel="external ugc">Twitter</a></li><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="https://github.com/dwhitena" rel="external ugc">GitHub</a>, <a href="https://www.datadan.io/" rel="external ugc">Website</a></li></ul>

Show Notes:
<ul>
<li><a href="https://tinyurl.com/genai-mastery3">Register for our next webinar (similar to this one) focused on multimodal AI</a></li>
<li><a href="https://github.com/danny-avila/LibreChat">LibreChat</a></li>
<li><a href="https://www.predictionguard.com/">Prediction Guard</a></li>
</ul>

Something missing or broken? <a href="https://github.com/thechangelog/show-notes/blob/master/practicalai/practical-ai-267.md">PRs welcome!</a>

with Danny Avila of LibreChat

Private, open source chat UIs

First there was Mamba… now there is Jamba from AI21. This is a model that combines the best non-transformer goodness of Mamba with good ‘ol attention layers. This results in a highly performant and efficient model that AI21 has open sourced! We hear all about it (along with a variety of other LLM things) from AI21’s co-founder Yoav.

<a href="https://changelog.com/practicalai/266/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li><li><a href="https://changelog.com/news">Changelog News</a> – A podcast+newsletter combo that’s brief, entertaining &amp; always on-point. <a href="https://changelog.com/news">Subscribe today</a>.
</li>
</ul>


Featuring:
<ul><li>Yoav Shoham &ndash; <a href="https://twitter.com/yshoham" rel="external ugc">Twitter</a>, <a href="https://www.linkedin.com/in/yoavshoham" rel="external ugc">LinkedIn</a></li><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="https://github.com/dwhitena" rel="external ugc">GitHub</a>, <a href="https://www.datadan.io/" rel="external ugc">Website</a></li></ul>

Show Notes:
<ul>
<li><a href="https://www.ai21.com/jamba">Jamba - A Groundbreaking SSM - Transformer Open Model</a></li>
<li><a href="https://www.ai21.com/">AI21 Labs</a></li>
</ul>

Something missing or broken? <a href="https://github.com/thechangelog/show-notes/blob/master/practicalai/practical-ai-266.md">PRs welcome!</a>

with Yoav Shoham, Co-Founder at AI21 Labs

Mamba & Jamba

2024 promises to be the year of multi-modal AI, and we are already seeing some amazing things. In this “fully connected” episode, Chris and Daniel explore the new Udio product/service for generating music. Then they dig into the differences between recent multi-modal efforts and more “traditional” ways of combining data modalities.

<a href="https://changelog.com/practicalai/265/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 26 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li><li><a href="https://changelog.com/news">Changelog News</a> – A podcast+newsletter combo that’s brief, entertaining &amp; always on-point. <a href="https://changelog.com/news">Subscribe today</a>.
</li>
</ul>


Featuring:
<ul><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="https://github.com/dwhitena" rel="external ugc">GitHub</a>, <a href="https://www.datadan.io/" rel="external ugc">Website</a></li></ul>

Show Notes:
<ul>
<li><a href="https://www.udio.com/">Udio</a></li>
<li><a href="https://openai.com/research/clip">CLIP</a></li>
<li><a href="https://arxiv.org/abs/2206.08657">BridgeTower</a></li>
<li><a href="https://llava-vl.github.io/">LLaVA</a></li>
</ul>

Something missing or broken? <a href="https://github.com/thechangelog/show-notes/blob/master/practicalai/practical-ai-265.md">PRs welcome!</a>

get Fully-Connected with Chris & Daniel

Udio & the age of multi-modal AI

Daniel &amp; Chris delight in conversation with “the funniest guy in AI”, Demetrios Brinkmann. Together they explore the results of the MLOps Community’s latest survey. They also preview the upcoming <a href="https://www.aiqualityconference.com">AI Quality Conference</a>.

<a href="https://changelog.com/practicalai/264/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://thehackermindset.com">The Hacker Mindset</a> – “The Hacker Mindset” written by Garrett Gee, a seasoned white hat hacker with over 20 years of experience, is available for pre-order now. This book reveals the secrets of white hat hacking and how you can apply them to overcome obstacles and achieve your goals. In a world where hacking often gets a bad rap, this book shows you the white hat side – the side focused on innovation, problem-solving, and ethical principles.
</li><li><a href="https://changelog.com/news">Changelog News</a> – A podcast+newsletter combo that’s brief, entertaining &amp; always on-point. <a href="https://changelog.com/news">Subscribe today</a>.
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Demetrios Brinkmann &ndash; <a href="https://twitter.com/Dpbrinkm" rel="external ugc">Twitter</a></li><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="https://github.com/dwhitena" rel="external ugc">GitHub</a>, <a href="https://www.datadan.io/" rel="external ugc">Website</a></li></ul>

Show Notes:
<ul>
<li><a href="https://linktr.ee/mlopscommunity">MLOps Community</a

with Demetrios Brinkmann from the MLOps Community

RAG continues to rise

In this fully connected episode, Daniel &amp; Chris discuss NVIDIA GTC keynote comments from CEO Jensen Huang about teaching kids to code. Then they dive into the notion of “community” in the AI world, before discussing challenges in the adoption of generative AI by non-technical people. They finish by addressing the evolving balance between generative AI interfaces and search engines.

<a href="https://changelog.com/practicalai/263/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://ladderlife.com/practicalai">Ladder Life Insurance</a> – 100% digital — no doctors, no needles, no paperwork. Don’t put it off until the very last minute to get term coverage life insurance through Ladder. Find out if you’re instantly approved. They’re rated A and A plus. Life insurance costs more as you age, now’s the time to cross it off your list.
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="https://github.com/dwhitena" rel="external ugc">GitHub</a>, <a href="https://www.datadan.io/" rel="external ugc">Website</a></li></ul>

Show Notes:
<ul>
<li><a href="https://youtu.be/Y2F8yisiS6E?list=TLGGFIbdOwQMZx4yODAzMjAyNA">NVIDIA GTC March 2024 Keynote with NVIDIA CEO Jensen Huang</a></li>
<li><a href="https://hbr.org/2023/12/5-forces-that-will-drive-the-adoption-of-genai">5 Forces That Will Drive the Adoption of GenAI | Harvard Business Review</a></li>
<li><a href="https://www.theverge.com/24111326/a

Should kids still learn to code?

Daniel and Chris are out this week, so we’re bringing you conversations all about AI’s complicated relationship to software developers from other Changelog pods: JS Party, Go Time &amp; The Changelog.

<a href="https://changelog.com/practicalai/262/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 2 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://www.neo4j.com/developer?utm_source=changelog&amp;utm_medium=podcast&amp;utm_campaign=practicalai">Neo4j</a> – Is your code getting dragged down by JOINs and long query times? The problem might be your database…Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it’s easy to integrate into your tech stack. Visit <a href="https://www.neo4j.com/developer?utm_source=changelog&amp;utm_medium=podcast&amp;utm_campaign=practicalai">Neo4j.com/developer</a> to get started.
</li><li><a href="https://thehackermindset.com">The Hacker Mindset</a> – “The Hacker Mindset” written by Garrett Gee, a seasoned white hat hacker with over 20 years of experience, is available for pre-order now. This book reveals the secrets of white hat hacking and how you can apply them to overcome obstacles and achieve your goals. In a world where hacking often gets a bad rap, this book shows you the white hat side – the side focused on innovation, problem-solving, and ethical principles.
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Kent Quirk &ndash; <a href="https://hachyderm.io/@kentquirk" rel="external ugc">Mastodon</a>, <a href="https://twitter.com/kentquirk" rel="external ugc">Twitter</a>, <a href="https://github.com/kentquirk" rel="external ugc">GitHub</a></li><li>Sharon DiOrio &ndash; <a

with conversations from JS Party, Go Time & The Changelog

AI vs software devs

Daniel &amp; Chris explore the state of the art in prompt engineering with Jared Zoneraich, the founder of PromptLayer. PromptLayer is the first platform built specifically for prompt engineering. It can visually manage prompts, evaluate models, log LLM requests, search usage history, and help your organization collaborate as a team. Jared provides expert guidance in how to be implement prompt engineering, but also illustrates how we got here, and where we’re likely to go next.

<a href="https://changelog.com/practicalai/261/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://www.shopify.com/practicalai">Shopify</a> – Sign up for a $1/month trial period at <a href="https://www.shopify.com/practicalai">shopify.com/practicalai</a>
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Jared Zoneraich &ndash; <a href="https://twitter.com/imjaredz" rel="external ugc">Twitter</a>, <a href="https://www.linkedin.com/in/imjaredz" rel="external ugc">LinkedIn</a></li><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="https://github.com/dwhitena" rel="external ugc">GitHub</a>, <a href="https://www.datadan.io/" rel="external ugc">Website</a></li></ul>

Show Notes:
<ul>
<li><a href="https://promptlayer.com">PromptLayer</a></li>
</ul>

Something missing or broken? <a href="https://github.com/thechangelog/show-notes/blob/master/practicalai/practical-ai-261.md">PRs welcome!</a>

with Jared Zoneraich from PromptLayer

Prompting the future

<a href="https://runwayml.com">Runway</a> is an applied AI research company shaping the next era of art, entertainment &amp; human creativity. Chris sat down with Runway co-founder / CTO, Anastasis Germanidis, to discuss their rise and how it’s defining the future of the creative landscape with its text &amp; image to video models. We hope you find Anastasis’s founder story as inspiring as Chris did.

<a href="https://changelog.com/practicalai/260/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://www.neo4j.com/developer?utm_source=changelog&amp;utm_medium=podcast&amp;utm_campaign=practicalai">Neo4j</a> – Is your code getting dragged down by JOINs and long query times? The problem might be your database…Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it’s easy to integrate into your tech stack. Visit <a href="https://www.neo4j.com/developer?utm_source=changelog&amp;utm_medium=podcast&amp;utm_campaign=practicalai">Neo4j.com/developer</a> to get started.
</li><li><a href="https://changelog.com/news">Changelog News</a> – A podcast+newsletter combo that’s brief, entertaining &amp; always on-point. <a href="https://changelog.com/news">Subscribe today</a>.
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Anastasis Germanidis &ndash; <a href="https://twitter.com/agermanidis" rel="external ugc">Twitter</a>, <a href="https://github.com/agermanidis" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/agermanidis" rel="external ugc">LinkedIn</a>, <a href="https://agermanidis.com" rel="external ugc">Website</a></li><li>Chris Benson &ndash; <a href

with Anastasis Germanidis of Runway

Generating the future of art & entertainment

While everyone is super hyped about generative AI, computer vision researchers have been working in the background on significant advancements in deep learning architectures. YOLOv9 was just released with some noteworthy advancements relevant to parameter efficient models. In this episode, Chris and Daniel dig into the details and also discuss advancements in parameter efficient LLMs, such as Microsofts 1-Bit LLMs and Qualcomm’s new AI Hub.

<a href="https://changelog.com/practicalai/259/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://changelog.com/news">Changelog News</a> – A podcast+newsletter combo that’s brief, entertaining &amp; always on-point. <a href="https://changelog.com/news">Subscribe today</a>.
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li><li><a href="http://sentry.io/events/launch-week/">Sentry</a> – Launch week! New features and products all week long (so get comfy)! Tune in to Sentry’s <a href="https://www.youtube.com/c/Sentry-monitoring/featured">YouTube</a> and Discord daily at 9am PT to hear the latest scoop. Too busy? No problem - enter your email address to receive all the announcements (and win swag along the way). Use the code <code>CHANGELOG</code> when you sign up to get $100 OFF the team plan.
</li><li><a href="https://cloud.typesense.org/?utm_source=changelog">Typesense</a> – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster!
</li>
</ul>


Featuring:
<ul><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="ex

get fully-connected with Chris and Daniel

YOLOv9: Computer vision is alive and well

Recently, we briefly mentioned the concept of “Activation Hacking” in the episode with Karan from Nous Research. In this fully connected episode, Chris and Daniel dive into the details of this model control mechanism, also called “representation engineering”. Of course, they also take time to discuss the new Sora model from OpenAI.

<a href="https://changelog.com/practicalai/258/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://www.neo4j.com/developer?utm_source=changelog&amp;utm_medium=podcast&amp;utm_campaign=practicalai">Neo4j</a> – Is your code getting dragged down by JOINs and long query times? The problem might be your database…Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it’s easy to integrate into your tech stack. Visit <a href="https://www.neo4j.com/developer?utm_source=changelog&amp;utm_medium=podcast&amp;utm_campaign=practicalai">Neo4j.com/developer</a> to get started.
</li><li><a href="https://changelog.com/news">Changelog News</a> – A podcast+newsletter combo that’s brief, entertaining &amp; always on-point. <a href="https://changelog.com/news">Subscribe today</a>.
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="h

Representation Engineering (Activation Hacking)

Chris &amp; Daniel explore AI in national security with Lt. General Jack Shanahan (USAF, Ret.). The conversation reflects Jack’s unique background as the only senior U.S. military officer responsible for standing up and leading two organizations in the United States Department of Defense (DoD) dedicated to fielding artificial intelligence capabilities: Project Maven and the DoD Joint AI Center (JAIC).
Together, Jack, Daniel &amp; Chris dive into the fascinating details of Jack’s recent written testimony to the U.S. Senate’s AI Insight Forum on National Security, in which he provides the U.S. government with thoughtful guidance on how to achieve the best path forward with artificial intelligence.

<a href="https://changelog.com/practicalai/257/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://www.shopify.com/practicalai">Shopify</a> – Sign up for a $1/month trial period at <a href="https://www.shopify.com/practicalai">shopify.com/practicalai</a>
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Jack Shanahan &ndash; <a href="https://www.linkedin.com/in/jackntshanahan" rel="external ugc">LinkedIn</a></li><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="https://github.com/dwhitena" rel="external ugc">GitHub</a>, <a href="https://www.datadan.io/" rel="external ugc">Website</a></li></ul>

Show Notes:
<ul>
<li><a href="https://lu.ma/nbi7pz6y">Gen AI Master class</a></li>
<li><a href="https://www.schumer.senate.gov/imo/media/doc/Jack%20Sha

featuring Lt. General Jack Shanahan (USAF, Ret.)

Leading the charge on AI in National Security

Google has been releasing a ton of new GenAI functionality under the name “Gemini”, and they’ve officially rebranded Bard as Gemini. We take some time to talk through Gemini compared with offerings from OpenAI, Anthropic, Cohere, etc.
We also discuss the recent FCC decision to ban the use of AI voices in robocalls and what the decision might mean for government involvement in AI in 2024.

<a href="https://changelog.com/practicalai/256/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 2 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://www.neo4j.com/developer?utm_source=changelog&amp;utm_medium=podcast&amp;utm_campaign=practicalai">Neo4j</a> – Is your code getting dragged down by JOINs and long query times? The problem might be your database…Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it’s easy to integrate into your tech stack. Visit <a href="https://www.neo4j.com/developer?utm_source=changelog&amp;utm_medium=podcast&amp;utm_campaign=practicalai">Neo4j.com/developer</a> to get started.
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="https://github.com/dwhitena" rel="external ugc">GitHub</a>, <a href="https://www.datadan.io/" rel="external ugc">Website</a></li></ul>

get Fully-Connected with Daniel & Chris

Gemini vs OpenAI

Nous Research has been pumping out some of the best open access LLMs using SOTA data synthesis techniques. Their Hermes family of models is incredibly popular! In this episode, Karan from Nous talks about the origins of Nous as a distributed collective of LLM researchers. We also get into fine-tuning strategies and why data synthesis works so well.

<a href="https://changelog.com/practicalai/255/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 2 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://readwriteown.com/?utm_source=changelog&amp;utm_medium=practicalai&amp;utm_campaign=changelog">Read Write Own</a> – Read, Write, Own: Building the Next Era of the Internet—a new book from entrepreneur and investor Chris Dixon—explores one possible solution to the internet’s authenticity problem: Blockchains. From AI that tracks its source material to generative programs that compensate—rather than cannibalize—creators. It’s a call to action for a more open, transparent, and democratic internet. One that opens the black box of AI, tracks the origins we see online, and much more. Order your copy of Read, Write, Own today at <a href="https://readwriteown.com/?utm_source=changelog&amp;utm_medium=practicalai&amp;utm_campaign=changelog">readwriteown.com</a>
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Karan Malhotra &ndash; <a href="https://www.linkedin.com/in/karan-s-malhotra" rel="external ugc">LinkedIn</a></li><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="https://github.com/dwhitena" rel="external ugc">GitHub<

with Karan Malhotra, researcher at Nous Research

Data synthesis for SOTA LLMs

Recently the release of the rabbit r1 device resulted in huge interest in both the device and “Large Action Models” (or LAMs). What is an LAM? Is this something new? Did these models come out of nowhere, or are they related to other things we are already using? Chris and Daniel dig into LAMs in this episode and discuss neuro-symbolic AI, AI tool usage, multimodal models, and more.

<a href="https://changelog.com/practicalai/254/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://readwriteown.com/?utm_source=changelog&amp;utm_medium=practicalai&amp;utm_campaign=changelog">Read Write Own</a> – Read, Write, Own: Building the Next Era of the Internet—a new book from entrepreneur and investor Chris Dixon—explores one possible solution to the internet’s authenticity problem: Blockchains. From AI that tracks its source material to generative programs that compensate—rather than cannibalize—creators. It’s a call to action for a more open, transparent, and democratic internet. One that opens the black box of AI, tracks the origins we see online, and much more. Order your copy of Read, Write, Own today at <a href="https://readwriteown.com/?utm_source=changelog&amp;utm_medium=practicalai&amp;utm_campaign=changelog">readwriteown.com</a>
</li><li><a href="https://www.shopify.com/practicalai">Shopify</a> – Sign up for a $1/month trial period at <a href="https://www.shopify.com/practicalai">shopify.com/practicalai</a>
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena"

get fully-Connected with Chris & Daniel

Large Action Models (LAMs) & Rabbits 🐇

Small changes in prompts can create large changes in the output behavior of generative AI models. Add to that the confusion around proper evaluation of LLM applications, and you have a recipe for confusion and frustration. Raza and the Humanloop team have been diving into these problems, and, in this episode, Raza helps us understand how non-technical prompt engineers can productively collaborate with technical software engineers while building AI-driven apps.

<a href="https://changelog.com/practicalai/253/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://readwriteown.com/?utm_source=changelog&amp;utm_medium=practicalai&amp;utm_campaign=changelog">Read Write Own</a> – Read, Write, Own: Building the Next Era of the Internet—a new book from entrepreneur and investor Chris Dixon—explores one possible solution to the internet’s authenticity problem: Blockchains. From AI that tracks its source material to generative programs that compensate—rather than cannibalize—creators. It’s a call to action for a more open, transparent, and democratic internet. One that opens the black box of AI, tracks the origins we see online, and much more. Order your copy of Read, Write, Own today at <a href="https://readwriteown.com/?utm_source=changelog&amp;utm_medium=practicalai&amp;utm_campaign=changelog">readwriteown.com</a>
</li><li><a href="https://changelog.com/news">Changelog News</a> – A podcast+newsletter combo that’s brief, entertaining &amp; always on-point. <a href="https://changelog.com/news">Subscribe today</a>.
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Raza Habib &ndash; <a href="https://twitter.com/razrazcle" rel="external ugc">Twitter</a>, <a href="https://www.linkedin.com/in/humanloop-raza" rel="external ugc">LinkedIn</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a hr

with Raza Habib, co-founder and CEO of HumanLoop

Collaboration & evaluation for LLM apps

Recently, Intel’s Liftoff program for startups and Prediction Guard hosted the first ever “Advent of GenAI” hackathon. 2,000 people from all around the world participated in Generate AI related challenges over 7 days. In this episode, we discuss the hackathon, some of the creative solutions, the idea behind it, and more.

<a href="https://changelog.com/practicalai/252/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://readwriteown.com">Read Write Own</a> – Read, Write, Own: Building the Next Era of the Internet—a new book from entrepreneur and investor Chris Dixon—explores one possible solution to the internet’s authenticity problem: Blockchains. From AI that tracks its source material to generative programs that compensate—rather than cannibalize—creators. It’s a call to action for a more open, transparent, and democratic internet. One that opens the black box of AI, tracks the origins we see online, and much more. Order your copy of Read, Write, Own today at <a href="https://readwriteown.com/?utm_source=changelog&amp;utm_medium=practicalai&amp;utm_campaign=changelog">readwriteown.com</a>
</li><li><a href="https://changelog.com/news">Changelog News</a> – A podcast+newsletter combo that’s brief, entertaining &amp; always on-point. <a href="https://changelog.com/news">Subscribe today</a>.
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Rahul Nair &ndash; <a href="https://twitter.com/unrahu1" rel="external ugc">Twitter</a>, <a href="https://github.com/rahulunair" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/rahulunair" rel="external ugc">LinkedIn</a></li><li>Ryan Metz &ndash; <a href="https://twitter.com/RyanAEMetz" rel="external ugc">Twitter</a>, <a href="https://www.linkedin.com/in/ryanaemetz" rel="external ugc">LinkedIn</a></li><li>Eugenie Wirz &ndash; <a href="https://www.linkedin.com/in/eugeniewirz" rel

with Rahul, Ryan, Eugenie & Ralph from Intel

Advent of GenAI Hackathon recap

We scoured the internet to find all the AI related predictions for 2024 (at least from people that might know what they are talking about), and, in this episode, we talk about some of the common themes. We also take a moment to look back at 2023 commenting with some distance on a crazy AI year.

<a href="https://changelog.com/practicalai/251/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://changelog.com/news">Changelog News</a> – A podcast+newsletter combo that’s brief, entertaining &amp; always on-point. <a href="https://changelog.com/news">Subscribe today</a>.
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="https://github.com/dwhitena" rel="external ugc">GitHub</a>, <a href="https://www.datadan.io/" rel="external ugc">Website</a></li></ul>

Show Notes:

Something missing or broken? <a href="https://github.com/thechangelog/show-notes/blob/master/practicalai/practical-ai-251.md">PRs welcome!</a>

AI predictions for 2024

Prashanth Rao mentioned LanceDB as a stand out amongst the many vector DB options in <a href="https://changelog.com/practicalai/234">episode #234</a>. Now, Chang She (co-founder and CEO of LanceDB) joins us to talk through the specifics of their open source, on-disk, embedded vector search offering. We talk about how their unique columnar database structure enables serverless deployments and drastic savings (without performance hits) at scale. This one is super practical, so don’t miss it!

<a href="https://changelog.com/practicalai/250/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 1 minute on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://fastly.com/?utm_source=changelog">Fastly</a> – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at <a href="https://www.fastly.com/?utm_source=changelog&amp;utm_medium=podcast&amp;utm_campaign=changelog-sponsorship">fastly.com</a>
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li><li><a href="https://cloud.typesense.org/?utm_source=changelog">Typesense</a> – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster!
</li>
</ul>


Featuring:
<ul><li>Chang She &ndash; <a href="https://twitter.com/changhiskhan" rel="external ugc">Twitter</a>, <a href="https://github.com/changhiskhan" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/changshe" rel="external ugc">LinkedIn</a></li><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel=

featuring Chang She, CEO and co-founder of LanceDB

Open source, on-disk vector search with LanceDB

The new open source AI book from PremAI starts with “As a data scientist/ML engineer/developer with a 9 to 5 job, it’s difficult to keep track of all the innovations.” We couldn’t agree more, and we are so happy that this week’s guest Casper (among other contributors) have created this resource for practitioners.
During the episode, we cover the key categories to think about as you try to navigate the open source AI ecosystem, and Casper gives his thoughts on fine-tuning, vector DBs &amp; more.

<a href="https://changelog.com/practicalai/249/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://changelog.com/news">Changelog News</a> – A podcast+newsletter combo that’s brief, entertaining &amp; always on-point. <a href="https://changelog.com/news">Subscribe today</a>.
</li><li><a href="https://fastly.com/?utm_source=changelog">Fastly</a> – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at <a href="https://www.fastly.com/?utm_source=changelog&amp;utm_medium=podcast&amp;utm_campaign=changelog-sponsorship">fastly.com</a>
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Casper da Costa-Luis &ndash; <a href="https://github.com/casperdcl" rel="external ugc">GitHub</a></li><li>Chris Benson &ndash; <a href="https://twitter.com/chrisbenson" rel="external ugc">Twitter</a>, <a href="https://github.com/chrisbenson" rel="external ugc">GitHub</a>, <a href="https://www.linkedin.com/in/chrisbenson" rel="external ugc">LinkedIn</a>, <a href="https://chrisbenson.com" rel="external ugc">Website</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="https://github.com/dwhitena" rel="external ugc">GitHub</a>, <a href="https://www.datadan.io/"

with Casper da Costa-Luis, a contributor to the State of Open Source AI Book

The state of open source AI

In this enlightening episode, we delve deeper than the usual buzz surrounding AI’s perils, focusing instead on the tangible problems emerging from the use of machine learning algorithms across Europe. We explore “suspicion machines” — systems that assign scores to welfare program participants, estimating their likelihood of committing fraud. Join us as Justin and Gabriel share insights from their thorough investigation, which involved gaining access to one of these models and meticulously analyzing its behavior.

<a href="https://changelog.com/practicalai/248/discuss">Leave us a comment</a>

<a href="https://changelog.com/++" rel="payment">Changelog++</a> members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:
<ul>
 <li><a href="https://changelog.com/news">Changelog News</a> – A podcast+newsletter combo that’s brief, entertaining &amp; always on-point. <a href="https://changelog.com/news">Subscribe today</a>.
</li><li><a href="https://fastly.com/?utm_source=changelog">Fastly</a> – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at <a href="https://www.fastly.com/?utm_source=changelog&amp;utm_medium=podcast&amp;utm_campaign=changelog-sponsorship">fastly.com</a>
</li><li><a href="https://fly.io/changelog">Fly.io</a> – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at <a href="https://fly.io/changelog">fly.io/changelog</a> and check out <a href="https://fly.io/docs/speedrun/">the speedrun in their docs</a>.
</li>
</ul>


Featuring:
<ul><li>Gabriel Geiger &ndash; <a href="https://twitter.com/gabriels_geiger" rel="external ugc">Twitter</a></li><li>Justin-Casimir Braun &ndash; <a href="https://twitter.com/jus_braun" rel="external ugc">Twitter</a></li><li>Daniel Whitenack &ndash; <a href="https://twitter.com/dwhitena" rel="external ugc">Twitter</a>, <a href="https://github.com/dwhitena" rel="external ugc">GitHub</a>, <a href="https://www.datadan.io/" rel="external ugc">Website</a></li></ul>

Show Notes:
<ul>
<li><a href="https://www.wired.com/story/welfare-state-algorithms/">Article - “Inside the suspicion machine”</a></li>
<li><a href

with Gabriel Geiger & Justin-Casimir Braun of Lighthouse Reports

Suspicion machines ⚙️

Changelog Media

Making artificial intelligence practical, productive &amp; accessible to everyone. Practical AI is a show in which technology professionals, business people, students, enthusiasts, and expert guests engage in lively discussions about Artificial Intelligence and related topics (Machine Learning, Deep Learning, Neural Networks, GANs, MLOps, AIOps, LLMs &amp; more). The focus is on productive implementations and real-world scenarios that are accessible to everyone. If you want to keep up with the latest advances in AI, while keeping one foot in the real world, then this is the show for you!

About

Episodes