Configure Argo Workflow Executor¶
A workflow executor allows Argo to perform certain actions like monitoring Pod logs, collecting artifacts, managing the life cycle of containers, etc. Certain executors introduce some limitations in specific scenarios or environments, so the admin might need to change the executor depending on their needs.
For example, here are some known issues with certain executors:
- PNS executor: Kubeflow Pipelines fail when Pods are spawned in a newly created node or when they involve short-lived containers.
- Docker executor: Kubeflow Pipelines do not work on AKS clusters with Linux node pools running Kubernetes 1.19 or newer, since they no longer support Docker.
This guide will walk you through configuring a custom Argo workflow executor. Here is the suggested Argo workflow executor you can use for Kubeflow Pipelines, based on your cloud provider:
Go to your GitOps repository, inside your
rok-toolsmanagement environment:root@rok-tools:~# cd ~/ops/deployments
patchesdirectory in the Kubeflow Pipelines deploy overlay:root@rok-tools:~/ops/deployments# mkdir -p kubeflow/manifests/apps/pipeline/upstream/overlays/deploy/patches
kubeflow/manifests/apps/pipeline/upstream/overlays/deploy/patches/workflow-controller-configmap.yamlpatch:root@rok-tools:~/ops/deployments# touch kubeflow/manifests/apps/pipeline/upstream/overlays/deploy/patches/workflow-controller-configmap.yaml
kubeflow/manifests/apps/pipeline/upstream/overlays/deploy/patches/workflow-controller-configmap.yamlpatch to configure the executor that the Argo workflow controller will use. Append the following lines if the file is empty or edit the existing patch accordingly if it is not. Choose one of the following options, based on the executor you will use.
kubeflow/manifests/apps/pipeline/upstream/overlays/deploy/kustomization.yamlfile and append the following lines to enable the previous patch. Edit the existing
patchesdirective instead, if it is already present:patches: - patches/workflow-controller-configmap.yaml
Stage your changes:root@rok-tools:~/ops/deployments# git add kubeflow/manifests/apps/pipeline/upstream/overlays/deploy/patches/workflow-controller-configmap.yaml
Commit your changes:root@rok-tools:~/ops/deployments# git commit -am "Configure Argo workflow executor"
Apply the Kubeflow Pipelines manifests:root@rok-tools:~/ops/deployments# rok-deploy --apply kubeflow/manifests/apps/pipeline/upstream/overlays/deploy
Verify that the
ConfigMapof the Argo workflow controller has been updated with the executor you specified earlier: