Serving Models and Open-source LLMs

Both Hugging-face and MLFlow models as well as LLM models can be deployed in DKubeX. For the steps required to serve the particular type of models, please click on the appropriate link beside the descriptions given below.

Description	Reference
Deploying models registered in MLFlow in DKubeX	Deploying models from MLFlow
Deploying models from Huggingface repo	Deploying Hugging-face models
Deploying LLM registered in DKubeX	Deploying LLMs in DKubeX
Deploying Embedding models in DKubeX	Deploying Embedding Models on DKubeX