SPYT

To install SPYT on the YTsaurus cluster, push a SPYT resource to K8s.

You can find an example of the specification here:

apiVersion: cluster.ytsaurus.tech/v1
kind: Spyt
metadata:
  name: myspyt
spec:
  ytsaurus:
    name:
      minisaurus
  image: ghcr.io/ytsaurus/spyt:2.8.3
  sparkVersions:
    - "3.5.7"
    - "3.2.2"

You can start the specification using kubectl:

$ kubectl apply -f cluster_v1_spyt.yaml -n <namespace>
spyt.cluster.ytsaurus.tech/myspyt created

After that, the K8s operator will launch several init jobs that will write the files to Cypress. To monitor the status, use kubectl:

$ kubectl get spyt
NAME     RELEASESTATUS
myspyt   CreatingUser

$ kubectl get spyt
NAME     RELEASESTATUS
myspyt   UploadingIntoCypress

$ kubectl get spyt
NAME     RELEASESTATUS
myspyt   Finished

Once all jobs are successfully completed (when RELEASESTATUS changes to Finished), you can run SPYT. For more information, see this section.

Consider installing Task proxy if you want to open Spark UI from browser.

Previous
Next