Get the app
Data Scientists
Data Scientists
on
SquishyQuokka
SquishyQuokka
Gojek

How do you all deploy ML models for production?

Mostly, I have seen people in my team creating an API endpoint for it and deploy on a VM via uvicorn. Anything better?

26mo ago
Jobs
One interview, 1000+ job opportunities
Take a 10-min AI interview to qualify for numerous real jobs auto-matched to your profile 🔑
+322 new users this month
FloatingWaffle
FloatingWaffle
Flipkart26mo

On a VM? Seems too manual.

First yes API end point is mandatory.. Something should have it.

  1. Kubernetes deployment with CI-CD enabled
  2. Use a model host and push model there. Your kubernetes service should always call the latest model from the model host.
SquishyQuokka
SquishyQuokka
Gojek26mo

What kind of a model host would you recommend? Huggingface?

Discover more
Curated from across