Enhancement: add token/credit use per session and context-use shortcut icon

[mx-atsai]

Summary

As we develop and iterate with Auggie, it is hard to keep track of how many tokens/credits a single session consumes, and it is equally hard to see how much of the available context window is being used. We should expose both metrics directly in the UI so users can manage cost and context effectively.

Proposed Enhancements

1. Token / Credit Use per Session in System Prompt

• What: Display the cumulative token count (and/or credit cost) for the current session somewhere in the system prompt area or in a persistent UI element.
• Why: Helps users understand the cost of a long debugging or brainstorming session before it grows too large.
• Where: Could live in the existing system prompt/meta-info bar or as a small badge near the prompt input.

2. Context Use Shortcut Icon

• What: A small icon/indicator (e.g., a pie-chart or percentage badge) that shows how much of the model's context window is currently filled.
• Why: Lets users know when they are approaching the context limit and should start a new thread, summarize, or trim history.
• Interaction: Clicking the icon could open a quick summary of context usage (e.g., "System: 10%, User: 45%, Assistant: 45%") or offer actions to compact the conversation.

Acceptance Criteria

• Token/credit counter is visible and updates in real time (or on each turn).
• Context usage indicator is visible and reflects the current thread's token count vs. the model's context window.
• Both indicators are lightweight and do not clutter the main chat interface.

Related

• This would pair well with any future "compact thread" or "summarize to save context" features.