In this episode, we track our prompt and completion tokens that are called from our application. This is a small feature, but can raise important insights to the usage of LLMs in our application as well as some user behavior.
rails
model
ai
machine learning
15:53