Apache Flink Connector YTsaurus

Apache Flink Connector YTsaurus is a connector that allows you to use YTsaurus in streaming data processing tasks on Apache Flink.

The connector works with sorted dynamic tables in YTsaurus. With it, you can perform streaming writes to sorted dynamic tables in YTsaurus, as well as perform Lookup operations.

Key features:

• Writing to sorted dynamic tables;
• Data partitioning support;
• Automatic table creation;
• Preliminary table resharding;
• Support for synchronous and asynchronous Lookup operations;
• Full and Partial caching strategies for Lookup queries.

Installation

Maven

<dependency>
    <groupId>tech.ytsaurus.flyt.connectors.ytsaurus</groupId>
    <artifactId>flink-connector-ytsaurus</artifactId>
    <version>${connectorVersion}</version>
    <classifier>all</classifier>
</dependency>

Gradle

implementation("tech.ytsaurus.flyt.connectors.ytsaurus:flink-connector-ytsaurus:$connectorVersion:all")

Source code

The source code is available on the project page on GitHub.

Getting started

You can learn more about working with the connector through the Quick Start Guide on the project page.