Istio
A/B Testing for ML Models: When Offline Metrics Lie
You retrained the model. Accuracy went up 2% on the test set. Revenue dropped 5%. Here is why you need A/B testing for ML models.
Canary Deployments for ML Models with KServe and Istio
You do canary deployments for APIs. Why not for ML models? Here is how KServe and Istio split traffic between champion and candidate models.