callback parameter on FallbackConfig to get notified when a fallback model is activated. This is useful for metrics, alerting, or logging which model actually served a request.
fallback_callback.py
Run the Example
1
Set up your virtual environment
2
Install dependencies
3
Export your API keys
4
Run the example
Save the code above as
fallback_callback.py, then run: