Technical Metrics
LLM performance, costs, and system health
Active Alerts (1)
Elevated P99 Latency— P99 latency exceeded 1.5s threshold for 15 minutes
2 hours agoAvg Latency
458ms
12.4%vs yesterday
P95: 892ms · P99: 1284ms
Daily Cost
$4.60
28.1%vs yesterday
$0.004/request avg
Total Tokens
151.7K
↑ 64.1K in↓ 97.8K out
139 tokens/request avg
Error Rate
1.7%
32.8%vs yesterday
2 errors today · 1093 total requests
Latency Over Time
Token Usage
Daily Cost Trend
Requests & Errors
Model Breakdown
| Model | Requests | Avg Latency | Avg Tokens | Cost |
|---|---|---|---|---|
| claude-3-opus | 1,250 | 890ms | 2,100 | $45.20 |
| claude-3-sonnet | 3,420 | 420ms | 1,450 | $28.50 |
| claude-3-haiku | 890 | 180ms | 800 | $4.30 |
| Total | 5,560 | — | — | $78.00 |
Alert History
Elevated P99 Latency
active
P99 latency exceeded 1.5s threshold for 15 minutes
2 hours ago
Error Rate Spike
resolved
Error rate reached 3.2% at 14:30 UTC
4 hours ago
Cost Anomaly Detected
acknowledged
Daily cost 25% higher than 7-day average
1 day ago
System Health
API Gateway
Healthy · 99.9% uptime
LLM Provider
Healthy · No issues
Cache Layer
Degraded · 80.6% hit rate
Database
Healthy · 12ms avg query