Overview
Model serving overview
Tools for Serving
Serving of ML models in Kubeflow
Seldon Core Serving
Model serving using Seldon
BentoML
Model serving with BentoML
MLRun Serving Pipelines
Real-time Serving Pipelines and Model Monitoring with MLRun and Nuclio
NVIDIA Triton Inference Server
Model serving with Triton Inference Server
TensorFlow Serving
Serving TensorFlow models
TensorFlow Batch Prediction
See Kubeflow v0.6 docs for batch prediction with TensorFlow models
Feedback
Was this page helpful?
Glad to hear it! Please tell us how we can improve.
Sorry to hear that. Please tell us how we can improve.
Last modified 21.04.2021: Components v external add ons (#2630) (42f08be0)