Expose Serving

This section will walk you through the steps required to expose the KFServing Models of your EKS cluster to the outside world.

Important

Authentication will be enabled by default (similar to EKF), and users will be able to access their models using an external client. Currently all authenticated users will be able to access all models inside the cluster.

What You’ll Need

• A configured management environment.
• Your clone of the Arrikto GitOps repository.
• An existing Kubernetes cluster.
• A working Rok deployment.
• A working Kubeflow deployment.

Procedure

Choose one of the following options, based on your cloud provider.

AWS

Azure

Google Cloud

This section will guide you through exposing the KFServing Models of your EKS cluster using either Amazon Application Load Balancer or Amazon Classic Load Balancer.

• Expose Serving on AWS

This section will guide you through exposing the KFServing Models of your AKS cluster using Azure Load Balancer.

• Expose Serving on Azure

This section will guide you through exposing the KFServing Models of your GKE cluster using Google Cloud Load Balancer (GCLB).

• Expose Serving on Google Cloud