Istio
ML Security on Kubernetes: 4 Layers Protecting Your Models
Your model endpoint has no auth. Anyone with the URL gets predictions. That is the default on most KServe deployments. Here are the 4 layers that fix it.
A/B Testing for ML Models: When Offline Metrics Lie
You retrained the model. Accuracy went up 2% on the test set. Revenue dropped 5%. Here is why you need A/B testing for ML models.
Canary Deployments for ML Models with KServe and Istio
You do canary deployments for APIs. Why not for ML models? Here is how KServe and Istio split traffic between champion and candidate models.