LLM Context

Episode #446 by Teacher's Avatar David Kimura

Summary

Building on the previous episode, we look at refactoring our background job into a more maintainable object and provide context to the LLM so that we can chain together responses for a more conversational experience.
rails ai artificial intelligence background processing machine learning 18:22

Chapters

  • Introduction (0:00)
  • Updating to a Private Stream (1:20)
  • Refactoring background job (2:29)
  • Creating a context model (5:51)
  • Quick recap of the flow (6:56)
  • Gathering the response (8:04)
  • Reformatting the prompt request (9:14)
  • Updating the response format (11:08)
  • Broadcasting the prompt (12:03)
  • Display the saved context (13:46)
  • Resetting the context (15:16)
  • Final Thoughts (17:44)
Student & Teacher
$ 9 /mo

Valid School Email Required

Same Access as Pro

Subscribe Now
Pro Monthly
$ 19 /mo

Access to Pro Episodes

Invite to Slack Channel

Priority Suggestions

Ad Free

Subscribe Now
Pro Annual
$ 190 /yr

Access to Pro Episodes

Invite to Slack Channel

Priority Suggestions

Ad Free

Subscribe Now
Teams
$ 57 /mo

3 Users Minimum

$19.00 / user / month

Same Access as Pro

Subscribe to Teams