Skip to content

Improve caching metrics#4

Open
kedar389 wants to merge 1 commit into
omChauhanDev:mainfrom
kedar389:improve-metrics-in-backend
Open

Improve caching metrics#4
kedar389 wants to merge 1 commit into
omChauhanDev:mainfrom
kedar389:improve-metrics-in-backend

Conversation

@kedar389

@kedar389 kedar389 commented Feb 21, 2026

Copy link
Copy Markdown

Tried to improve caching metrics for both backends.

  • Created Dataclass that would represent Cache Stats for both memory and redis backend
  • Add eviction rate, memory usage and usage saved based on the characters of prompt
  • Redis received the same treatment and improved collection of these metrics in case redis instance would be used for more than TTS caching
  • I Added tests but sadly CI is not configured to run them.

@kedar389

Copy link
Copy Markdown
Author

@omChauhanDev Could you review this and we can have this discussion about this perhaps ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant