LLM Insights

Episode #509 by Teacher's Avatar David Kimura

Summary

In this episode, we explore generating insights from product data using a self-hosted LLM. By analyzing purchase and cart behavior, we stream actionable recommendations directly into the UI.
rails llm ai background processing 22:23

Chapters

  • Introduction (0:00)
  • Overview of existing application (2:04)
  • Adding dependencies (2:44)
  • Creating the route (3:31)
  • Updating the view (4:48)
  • Insights create view (5:59)
  • chat_stream helper method (7:53)
  • Creating the prompt (10:07)
  • Creating the background job (12:51)
  • Creating the LLM call (14:04)
  • Creating the markdown stimulus controller (19:23)
  • Fat fingers (19:46)
  • Demo (19:59)
  • Final thoughts (20:14)
Student & Teacher
$ 9 /mo

Valid School Email Required

Same Access as Pro

Subscribe Now
Pro Monthly
$ 19 /mo

Access to Pro Episodes

Invite to Slack Channel

Priority Suggestions

Ad Free

Subscribe Now
Pro Annual
$ 190 /yr

Access to Pro Episodes

Invite to Slack Channel

Priority Suggestions

Ad Free

Subscribe Now
Teams
$ 57 /mo

3 Users Minimum

$19.00 / user / month

Same Access as Pro

Subscribe to Teams