SeaweedFS

SeaweedFS is a simple and highly scalable distributed file system. It has an S3 interface which makes it usable as an object store for kubeflow.

Prerequisites

Kubernetes (any recent Version should work)
You should have kubectl available and configured to talk to the desired cluster.
kustomize
If you installed kubeflow with minio, use the istio dir instead of base for the kustomize commands.

Compile manifests

kubectl kustomize ./base/

Install SeaweedFS

WARNING This replaces the service minio-service and will redirect the traffic to seaweedfs.

# Optional, but recommended to backup existing minio-service
kubectl get -n kubeflow svc minio-service -o=jsonpath='{.metadata.annotations.kubectl\.kubernetes\.io/last-applied-configuration}' > svc-minio-service-backup.json

kubectl kustomize ./base/ | kubectl apply -f -

Verify deployment

Run

./test.sh

With the ready check on the container it already verifies that the S3 starts correctly. You can then use it with the endpoint at http://localhost:8333. To create access keys open a shell on the pod and use weed shell to configure your instance. Create a user with the command s3.configure -user <username> -access_key <access-key> -secret-key <secret-key> -actions Read:<my-bucket>/<my-prefix>,Write::<my-bucket>/<my-prefix> -apply Documentation for this can also be found here.

Uninstall SeaweedFS

kubectl kustomize ./base/ | kubectl delete -f -
# Restore minio-service from backup
kubectl apply -f svc-minio-service-backup.json

1.8 KiB Raw Blame History