Is it recommended to serve predictions with exported models on either TensorFlowServing or Cloud Machine Learning Engine's prediction service with automatic scaling?
Saturday, 11 November 2023 by Hema Gunasekaran
When it comes to serving predictions with exported models, both TensorFlowServing and Cloud Machine Learning Engine's prediction service offer valuable options. However, the choice between the two depends on various factors, including the specific requirements of the application, scalability needs, and resource constraints. Let us then explore the recommendations for serving predictions using these services,