Skip to content

Monitoring: Alerting for API thresholds #803

@vprashrex

Description

@vprashrex

Is your feature request related to a problem?
There are currently no alerts for when the per API key request rate exceeds defined thresholds. This can lead to unexpected usage spikes and potential service disruptions.

Describe the solution you'd like
Add alerting for the following per API key request rate thresholds:

  • llm/call/ > 15/min
  • evaluations/ > 3/min
  • collections/ > 3/min

Send a notification to Discord upon any threshold breach.

Original issue

Add alerting when per API key request rate exceeds defined thresholds:

  • llm/call/ > 15/min
  • evaluations/ > 3/min
  • collections/ > 3/min

Send notification to Discord on threshold breach.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Projects

Status

Closed

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions