From d1561edf6ffc08b7624a99936f59832cb30ba125 Mon Sep 17 00:00:00 2001 From: "aravind.est" Date: Mon, 6 Mar 2023 10:27:57 +0000 Subject: [POLICY] Add Kserve installation as optional add-on Kserve installation instructions added as optional add-on. Issue-ID: POLICY-4573 Signed-off-by: aravind.est Change-Id: If1a1cd43acc7518fa8e1a0c2af31c554c7c038cc --- .../guides/infra_guides/oom_base_config_setup.rst | 2 ++ .../infra_guides/oom_base_optional_addons.rst | 41 +++++++++++++++++++++- 2 files changed, 42 insertions(+), 1 deletion(-) (limited to 'docs') diff --git a/docs/sections/guides/infra_guides/oom_base_config_setup.rst b/docs/sections/guides/infra_guides/oom_base_config_setup.rst index d228f5df56..dfc247a07d 100644 --- a/docs/sections/guides/infra_guides/oom_base_config_setup.rst +++ b/docs/sections/guides/infra_guides/oom_base_config_setup.rst @@ -147,6 +147,8 @@ Verify the installation:: strimzi-cluster-operator-7f7d6b46cf-mnpjr 1/1 Running 0 2m +.. _oom_base_setup_cert_manager: + Install Cert-Manager ******************** diff --git a/docs/sections/guides/infra_guides/oom_base_optional_addons.rst b/docs/sections/guides/infra_guides/oom_base_optional_addons.rst index b424c65c7d..f795a8664a 100644 --- a/docs/sections/guides/infra_guides/oom_base_optional_addons.rst +++ b/docs/sections/guides/infra_guides/oom_base_optional_addons.rst @@ -9,6 +9,7 @@ .. _Istio best practices: https://docs.solo.io/gloo-mesh-enterprise/latest/setup/prod/namespaces/ .. _Istio setup guide: https://istio.io/latest/docs/setup/install/helm/ .. _Kiali setup guide: https://kiali.io/docs/installation/installation-guide/example-install/ +.. _Kserve setup guide: https://kserve.github.io/website/0.10/admin/kubernetes_deployment/ .. _oom_base_optional_addons: @@ -59,6 +60,8 @@ ONAP is currenty planned to support Istio as default ServiceMesh platform. Therefor the following instructions describe the setup of Istio and required tools. Used `Istio best practices`_ and `Istio setup guide`_ +.. _oom_base_optional_addons_istio_installation: + Istio Platform Installation =========================== @@ -179,4 +182,40 @@ For setup the kiali operator is used, see `Kiali setup guide`_ Jaeger Installation =================== -To be done... \ No newline at end of file +To be done... + + +Kserve Installation +******************** + +KServe is a standard Model Inference Platform on Kubernetes. It supports RawDeployment mode to enable InferenceService deployment with Kubernetes resources. Comparing to serverless deployment it unlocks Knative limitations such as mounting multiple volumes, on the other hand Scale down and from Zero is not supported in RawDeployment mode. + +This installation is necessary for the ML models to be deployed as inference service. Once deployed, the inference services can be queried for the prediction. + +**Kserve participant component in Policy ACM requires this installation. Kserve participant deploy/undeploy inference services in Kserve.** + +Dependent component version compatibility details and installation instructions can be found at `Kserve setup guide`_ + +Kserve installation requires the following components: + +- Istio. Its installation instructions can be found at :ref:`oom_base_optional_addons_istio_installation` + +- Cert-Manager. Its installation instructions can be found at :ref:`oom_base_setup_cert_manager` + +Installation instructions as follows, + +- Create kserve namespace:: + + > kubectl create namespace kserve + +- Install Kserve:: + + > kubectl apply -f https://github.com/kserve/kserve/releases/download/v/kserve.yaml + +- Install Kserve default serving runtimes:: + + > kubectl apply -f https://github.com/kserve/kserve/releases/download/v/kserve-runtimes.yaml + +- Patch ConfigMap inferenceservice-config as follows:: + + > kubectl patch configmap/inferenceservice-config -n kserve --type=strategic -p '{"data": {"deploy": "{\"defaultDeploymentMode\": \"RawDeployment\"}"}}' -- cgit 1.2.3-korg