I'm adding uptime data to my personal LLM bot. Does this information belong in the system prompt?
That was my initial plan, but I'm thinking that a tool would be better. Tools let me see information provenance ("queried the uptime tool").
There's also a small caching benefit.
miniblog.
Related Posts
I'm playing with DOT output for debugging syntax trees from difftastic. Here's an F# snippet, the Debug representation, and the DOT rendered as an image.
I'm pleased with the information density on the graphic, but we'll see how often I end up using it.
I like the idea of a personal LLM trained on my emails. "Summarise my upcoming flight and travel to New York" would be useful.
Email is a blob of fairly unstructured text that contains useful information.
Displaying value information in an IDE is tricky.
For union types, it's more helpful to see the inferred type (Option<Player> versus null). For product types it's often nicer to see an example value.
For primitive types I almost always want a value (0 versus int).