tenant-catalog/kubeflow/experimental/seaweedfs

SeaweedFS

• Official documentation
• Official repository

SeaweedFS is a simple and highly scalable distributed file system. It has an S3 interface which makes it usable as an object store for kubeflow.

Prerequisites

• Kubernetes (any recent Version should work)
• You should have kubectl available and configured to talk to the desired cluster.
• kustomize
• If you installed kubeflow with minio, use the istio dir instead of base for the kustomize commands.

Compile manifests

kubectl kustomize ./base/

Install SeaweedFS

WARNING This replaces the service minio-service and will redirect the traffic to seaweedfs.

# Optional, but recommended to backup existing minio-service
kubectl get -n kubeflow svc minio-service -o=jsonpath='{.metadata.annotations.kubectl\.kubernetes\.io/last-applied-configuration}' > svc-minio-service-backup.json

kubectl kustomize ./base/ | kubectl apply -f -

Verify deployment

Run

./test.sh

With the ready check on the container it already verifies that the S3 starts correctly. You can then use it with the endpoint at http://localhost:8333. To create access keys open a shell on the pod and use weed shell to configure your instance. Create a user with the command s3.configure -user <username> -access_key <access-key> -secret-key <secret-key> -actions Read:<my-bucket>/<my-prefix>,Write::<my-bucket>/<my-prefix> -apply Documentation for this can also be found here.

Uninstall SeaweedFS

kubectl kustomize ./base/ | kubectl delete -f -
# Restore minio-service from backup
kubectl apply -f svc-minio-service-backup.json