Model Serving

This section covers model serving capabilities in Red Hat OpenShift AI, including deployment strategies, configuration options, and best practices for serving machine learning models at scale.

Available Serving Options

• Large Language Models (LLMs) - Deploy and serve LLMs from various storage sources including ModelCars, S3, and PVCs

---

Table of contents

• Serving Large Language Models (LLMs)