Reference · 14

Production Deployment

Recommended practice for production integrations.

  • Call the API from backend services only
  • Use separate credentials per environment
  • Set timeouts, retries with jitter and circuit breakers
  • Define a fallback model for degraded upstream conditions
  • Log the model identifier and usage fields with each request
  • Monitor budget and rate-limit alerts