SPYT
To install SPYT on the YTsaurus cluster, push a SPYT resource to K8s.
You can find an example of the specification here:
apiVersion: cluster.ytsaurus.tech/v1
kind: Spyt
metadata:
name: myspyt
spec:
ytsaurus:
name:
minisaurus
image: ghcr.io/ytsaurus/spyt:2.8.3
sparkVersions:
- "3.5.7"
- "3.2.2"
You can start the specification using kubectl:
$ kubectl apply -f cluster_v1_spyt.yaml -n <namespace>
spyt.cluster.ytsaurus.tech/myspyt created
After that, the K8s operator will launch several init jobs that will write the files to Cypress. To monitor the status, use kubectl:
$ kubectl get spyt
NAME RELEASESTATUS
myspyt CreatingUser
$ kubectl get spyt
NAME RELEASESTATUS
myspyt UploadingIntoCypress
$ kubectl get spyt
NAME RELEASESTATUS
myspyt Finished
Once all jobs are successfully completed (when RELEASESTATUS changes to Finished), you can run SPYT. For more information, see this section.
Consider installing Task proxy if you want to open Spark UI from browser.