Release notes
Thanks to multiple outside contributors for the active participation in YTsaurus development. π€
YTsaurus Server
All main components are released as a docker image.
Important
The k8s operator version must be at least 0.6.0.
Current release: 23.2.1 (ytsaurus/ytsaurus:stable-23.2.1-relwithdebinfo
)
All releases:
23.2.1
Scheduler and GPU
Features:
- Disable writing
//sys/scheduler/event_log
by default. - Add lightweight running operations.
Fixes:
- Various optimizations in scheduler
- Improve total resource usage and limits profiling.
- Do not account job preparation time in GPU statistics.
Queue Agent
Fixes:
- Normalize cluster name in queue consumer registration.
Proxy
Features:
- RPC proxy API for Query Tracker.
- Changed format and added metadata for issued user tokens.
- Support rotating TLS certificates for HTTP proxies.
- Compatibility with recent Query Tracker release.
Fixes:
- Do not retry on Read-Only response error.
- Fix standalone authentication token revokation.
- Fix per-user memory tracking (propagate allocation tags to child context).
- Fix arrow format for optional types.
Dynamic Tables
Features:
- Shared write locks.
- Increased maximum number of key columns to 128.
- Implemented array join in YTsaurus QL.
Fixes:
- Cap replica lag time for tables that are rarely written to.
- Fix possible journal record loss during journal session abort.
- Fix in backup manager.
- Fix some bugs in chaos dynamic table replication.
MapReduce
Features:
- Combined per-locaiton throttlers limiting total in+out bandwidth.
- Options in operation spec to force memory limits on user job containers.
- Use codegen comparator in SimpleSort & PartitionSort if possible.
Fixes:
- Better profiling tags for job proxy metrics.
- Fixes for remote copy with erasure repair.
- Fix any_to_composite converter when multiple schemas have similarly named composite columns.
- Fixes for partition_table API method.
- Fixes in new live preview.
- Do not fail jobs with supervisor communication failures.
- Multiple retries added in CRI executor/docker image integration.
- Cleaned up job memory statistics collection, renamed some statistics.
Master Server
Features:
- Parallelize and offload virtual map reads.
- Emergency flag to disable attribute-based access control.
- Improved performance of transaction commit/abort.
- Enable snapshot loading by default.
Fixes:
- Fixes and optimizations for Sequoia chunk replica management.
- Fix multiple possible master crashes.
- Fixes for master update with read-only availability.
- Fixes for jammed incremental hearbeats and lost replica update on disabled locations.
- Fix per-account sensors on new account creation.
Misc
Features:
- Config exposure via orchid became optional.
- Support some c-ares options in YTsaurus config.
- Support IP addresses in RPC TLS certificate verification.
Fixes:
- Fix connection counter leak in http server.
- Track and limit memory used by queued RPC requests.
- Better memory tracking for RPC connection buffers.
- Fix address resolver configuration.
23.2.0
ytsaurus/ytsaurus:stable-23.2.0-relwithdebinfo
Scheduler
Many internal changes driven by developing new scheduling mechanics that separate jobs from resource allocations at exec nodes. These changes include modification of the protocol of interaction between schedulers, controller agents and exec nodes, and adding tons of new logic for introducing allocations in exec nodes, controller agents and schedulers.
List of significant changes and fixes:
- Optimize performance of scheduler's Control and NodeShard threads.
- Optimize performance of the core scheduling algorithm by considering only a subset of operations in most node heartbeats.
- Optimize operation launch time overhead by not creating debug transaction if neither stderr or core table have been specified.
- Add priority scheduling for pools with resource guarantees.
- Consider disk usage in job preemption algorithm.
- Add operation module assignment preemption in GPU segments scheduling algorithm.
- Add fixes for GPU scheduling algorithms.
- Add node heartbeat throttling by scheduling complexity.
- Add concurrent schedule job exec duration throttling.
- Reuse job monitoring descriptors within a single operation.
- Support monitoring descriptors in map operations.
- Support filtering jobs with monitoring descriptors in
list_jobs
command. - Fix displaying jobs which disappear due to a node failure as running and "stale" in UI.
- Improve ephemeral subpools configuration.
- Hide user tokens in scheduler and job proxy logs.
- Support configurable max capacity for pipes between job proxy and user job.
Queue Agent
Aside small improvements, the most significant features include the ability to configure periodic exports of partitioned data from queues into static tables and the support for using replicated and chaos dynamic tables as queues and consumers.
Features:
- Support chaos replicated tables as queues and consumers.
- Support snapshot exports from queues into static tables.
- Support queues and consumers that are symbolic links for other queues and consumers.
- Support trimming of rows in queues by lifetime duration.
- Support for registering and unregistering of consumer to queue from different cluster.
Fixes:
- Trim queues by its
object_id
, not bypath
. - Fix metrics of read rows data weight via consumer.
- Fix handling frozen tablets in queue.
Proxy
Features:
- Add ability to call
pull_consumer
without specifyingoffset
, it will be taken fromconsumer
table. - Add
advance_consumer
handler for queues. - Early implementation of
arrow
format to read/write static tables. - Support type conversions for inner fields in complex types.
- Add new per user memory usage monitoring sensors in RPC proxies.
- Use ACO for RPC proxies permission management.
- Introduce TCP Proxies for SPYT.
- Support of OAuth authorisation.
Fixes:
- Fix returning requested system columns in
web_json
format.
Dynamic Tables
Features:
- DynTables Query language improvments:
- New range inferrer.
- Add various SQL operators (<>, string length, ||, yson_length, argmin, argmax, coalesce).
- Add backups for tables with hunks.
- New fair share threadpool for select operator and network.
- Add partial key filtering for range selects.
- Add overload controller.
- Distribute load among rpc proxies more evenly.
- Add per-table size metrics.
- Store heavy chunk meta in blocks.
MapReduce
Features:
- RemoteΠ‘opy now supports cypress file objects, in addition to tables.
- Add support for per job experiments.
- Early implementation of CRI (container runtime interface) job environment & support for external docker images.
- New live preview for MapReduce output tables.
- Add support for arrow as an input format for MapReduce.
- Support GPU resource in exec-nodes and schedulers.
Enhancements:
- Improve memory tracking in data nodes (master jobs, blob write sessions, p2p tracking).
- Rework memory acccounting in controller agents.
Master Server
Noticeable/Potentially Breaking Changes:
- Read requests are now processed in a multithreaded manner by default.
- Read-only mode now persists between restarts.
yt-admin master-exit-read-only
command should be used to leave it. list_node
type has been deprecated. Users are advised to usemap_node
s ordocument
s instead.ChunkService::ExecuteBatch
RPC call has been deprecated and split into individual calls. Batching chunk service has been superseded by proxying chunk service.- New transaction object types:
system_transaction
,nested_system_transaction
. Support for transaction actions in regular Cypress transactions is now deprecated. - Version 2 of the Hydra library is now enabled by default. Version 1 is officially deprecated.
Features:
- It is now possible to update master-servers with no read downtime via leaving non-voting peers to serve read requests while the main quorum is under maintenance.
- A data node can now be marked as pending restart, hinting the replicator to ignore its absence for a set amount of time to avoid needless replication bursts.
- The
add_maintenance
command now supports HTTP- and RPC-proxies. - Attribute-based access control: a user may now be annotated with a set of tags, while an access-control entry (ACE) may be annotated with a tag filter.
Optimizations & Fixes:
- Response keeper is now persistent. No warm-up period is required before a peer may begin leading.
- Chunk metadata now include schemas. This opens up a way to a number of significant optimizations.
- Data node heartbeat size has been reduced.
- Chunks and chunk lists are now loaded from snapshot in parallel.
- Fixed excessive memory consumption in multicell configurations.
- Accounting code has been improved to properly handle unlimited quotas and avoid negative master memory usage.
Additionally, advancements have been made in the Sequoia project dedicated to scaling master server by offloading certain parts of its state to dynamic tables. (This is far from being production-ready yet.)
Misc
Enhancements:
- Add rpc server config dynamization.
- Add support for peer alternative hostname for Bus TLS.
- Properly handle Content-Encoding in monitoring web-server.
- Bring back "host" attribute to errors.
- Add support for --version option in ytserver binaries.
- Add additional metainformation in yson/json server log format (fiberId, traceId, sourceFile).
23.1.0
ytsaurus/ytsaurus:stable-23.1.0-relwithdebinfo
Query Tracker
Is released as a docker image.
Current release: 0.0.8 (ytsaurus/query-tracker:0.0.8-relwithdebinfo
)
All releases:
0.0.8
- Optimized Query Tracker API performance by adding system tables indexes. Issue: #653
- Added support of SystemPython udfs in YQL queries. Issue: #265
- Fixed broken logs compression in YQL agent. Issue: #623
- Optimized simultaneous YQL queries performance.
- Fixed memory leak in YQL Agent.
- Important fix. Fixed YQL queries results corruption in DQ. Issue: #707
- Added DQ support in dual stack networks. Issue: #744
0.0.7
- Important fix. Fixed YQL queries results corruption. Issue: #707
- Fixed YQL DQ launching.
- Fixed bug caused UTF-8 errors in yql-agent logs.
- Fixed multiple deadlocks in yql-agent.
- Added support for SPYT discovery groups.
- Added support for SPYT queries parameters.
- Added everyone-share ACO which can be used to share queries by link.
- Added support of multiple ACOs per query, feature will be available in fresh UI, SDK releases.
- Changed interaction between Query Tracker and Proxies.
Note
This release is only compatible with proxy version 23.2.1, operator version 0.10.0 and later
https://github.com/ytsaurus/ytsaurus/releases/tag/docker%2Fytsaurus%2F23.2.1
https://github.com/ytsaurus/ytsaurus-k8s-operator/releases/tag/release%2F0.10.0
0.0.6
- Fixed authorization in complex cluster-free YQL queries
- Fixed a bug that caused queries with large queries to never complete
- Fixed a bag caused possibility of SQL injection in query tracker
- Reduced the size of query_tracker docker images
Related issues:
In case of an error when starting query
Access control object "nobody" does not exist
You need to run commands by admin
yt create access_control_object_namespace --attr '{name=queries}'
yt create access_control_object --attr '{namespace=queries;name=nobody}'
0.0.5
- Added access control to queries.
- Added support for the inβmemory DQ engine that accelerates small YQL queries.
- Added execution mode setting to query tracker. This allows to run queries in validate and explain modes.
- Fixed a bug that caused queries to be lost in query_tracker.
- Fixed a bug related to yson parsing in YQL queries.
- Reduced the load on the state dyntables by QT.
- Improved authentication in YQL queries.
- Added authentication in SPYT queries.
- Added reuse of spyt sessions. Speeds up the sequential launch of SPYT queries from a single user.
- Changed the build type of QT images from cmake to ya make.
NB:
- Compatible only with operator version 0.6.0 and later.
- Compatible only with proxies version 23.2 and later.
- Before updating, please read the QT documentation, which contains information about the new query access control.
New related issues:
In case of an error when starting query
Access control object "nobody" does not exist
You need to run commands by admin
yt create access_control_object_namespace --attr '{name=queries}'
yt create access_control_object --attr '{namespace=queries;name=nobody}'
0.0.4
- Applied YQL defaults from the documentation
- Fixed a bag in YQL queries that don't use YTsaurus tables
- Fixed a bag in YQL queries that use aggregate functions
- Supported common UDF functions in YQL
NB: This release is compatible only with the operator 0.5.0 and newer versions.
0.0.3
- Fixed a bug that caused the user transaction to expire before the completion of the yql query on IPv4 only networks.
- System query_tracker tables have been moved to sys bundle
0.0.2
β
0.0.1
- Added authentication, now all requests are run on behalf of the user that initiated them.
- Added support for v3 types in YQL queries.
- Added the ability to set the default cluster to execute YQL queries on.
- Changed the format of presenting YQL query errors.
- Fixed a bug that caused errors during the execution of queries that did not return any result.
- Fixed a bug that caused errors during the execution of queries that extracted data from dynamic tables.
- Fixed a bug that caused memory usage errors. YqlAgent no longer crashes for no reason under the load.
Strawberry
Is released as a docker image.
Current release: 0.0.12 (ytsaurus/strawberry:0.0.12
)
All releases:
0.0.12
0.0.11
ytsaurus/strawberry:0.0.11
- Improve strawberry cluster initializer to set up JupYT.
0.0.10
ytsaurus/strawberry:0.0.10
- Support cookie credentials in strawberry.
0.0.9
ytsaurus/strawberry:0.0.9
0.0.8
ytsaurus/strawberry:0.0.8
- Support builin log rotation for CHYT controller.
- Improve strawberry API for UI needs.
CHYT
Is released as a docker image.
Current release: 2.14.0 (ytsaurus/chyt:2.14.0-relwithdebinfo
)
All releases:
2.14.0
ytsaurus/chyt:2.14.0-relwithdebinfo
- Support SQL UDFs.
- Support reading dynamic and static tables via concat-functions.
2.13.0
ytsaurus/chyt:2.13.0-relwithdebinfo
- Update ClickHouse code version to the latest LTS release (22.8 -> 23.8).
- Support for reading and writing ordered dynamic tables.
- Move dumping query registry debug information to a separate thread.
- Configure temporary data storage.
2.12.4
ytsaurus/chyt:2.12.4-relwithdebinfo
SPYT
Is released as a docker image.
Current release: 2.4.1 (ghcr.io/ytsaurus/spyt:2.4.1
)
All releases:
2.4.1
Maintenance release with bug fixes:
- Fix creating tables via Spark SQL without explicitly specifying ytTable schema
- Fix serializing and deserializing nested time types
- Fix casting NULL in nested data structures
2.4.0
- Support for running local files and their dependencies in direct submit mode by uploading it to YTsaurus cache
- Support for submitting compiled python binaries as spark applications via direct submit
- Dataframe write schema hints
- Bug fixes:
-
- Writing to external S3 from YTsaurus
-
- Reading float values from nested structures
-
- Columnar format reading for Spark 3.3.x
-
- Reading arbitrary files from Cypress when using Spark 3.3.x
2.3.0
The major feature of SPYT 2.3.0 is support for Spark 3.3.x. Other notable features are:
- Support for extended Datetime types such as Date32, Datetime32, Timestamp64, Interval64
- Support for table properties in Spark SQL
- Support for writing using Hive partitioning schema
- Support for specifying random port for Shuffle service in inner standalone cluster
- Fix for runtime statistics
- Bug-Fixes for user-provided schema and for dataframes persisting
2.2.0
- Support for reading from multiple YTsaurus clusters.
- Supplying annotations for YTsaurus operations via conf parameters.
- Support for specifying custom schema on read.
- Support for
--archives
parameter inspark-submit
. - Fix for int8 and int16 as nested fields.
- Transactional read fix.
- Other minor fixes.
2.1.0
- Support for running applications using GPU
- Support for Spark versions 3.2.2-3.2.4
- History server support for direct submit scenarios
- Support for https and TCP proxy in direct submit scenarios
- Other minor fixes and improvements
2.0.0
SPYT 2.0.0 is the first release under the new release scheme and in the separate ytsaurus-spyt repository. The main feature of this release is that we have finally switched from Apache Spark fork that was used in previous releases to original Apache Spark distributive. The 2.0.0 SPYT release is still using Apache Spark 3.2.2, but we plan to support all Apache Spark 3.x.x releases in the nearest future!
Other notable changes are:
- Support for direct submit on using Livy via Query Tracker;
- Split data-source module into data-source-base that uses standard Spark types for all YTsaurus types, and data-source-extended for our implementation of custom YTsaurus types that don't have direct matches in Spark type system;
- Support for direct submit from Jupyter notebooks;
- Custom UDT for YTsaurus datetime type.
1.78.0
- Reverting Spark 3.2.2 fork to its original state
- Support for specifying network name when using direct submit
- Writing all python driver output to stderr when using direct submit
- Several bug fixes
1.77.0
- Support for Spark Streaming using ordered dynamic tables;
- Support for CREATE TABLE AS, DROP TABLE and INSERT operations;
- Session reuse for QT SPYT engine;
- SPYT compilation using vanilla Spark 3.2.2;
- Minor perfomance optimizations
1.76.1
- Fix IPV6 for submitting jobs in cluster mode;
- Fix Livy configuration;
- Support for reading ordered dynamic tables.
1.76.0
- Support for submitting Spark tasks to YTsaurus via spark-submit;
- Shrinking SPYT distributive size up to 3 times by separating SPYT and Spark dependencies;
- Fix reading nodes with a lot (>32) of dynamic tables (Issue #240);
- Assembling sorted table from parts uses concatenate operation instead of merge (Issue #133).
1.75.4
- Fix backward compatibility for ytsaurus-spyt
- Optimizations for count action
- Include livy in SPYT deploying pipeline
- Update default configs
1.75.3
- Added random port attaching for Livy server.
- Disabled YTsaurus operation stderr tables by default.
- Fix nested schema pruning bug.
1.75.2
- More configurable TCP proxies support: new options --tcp-proxy-range-start and --tcp-proxy-range-size.
- Added aliases for type v3 enabling options: spark.yt.read.typeV3.enabled and spark.yt.write.typeV3.enabled.
- Added option for disabling tmpfs: --disable-tmpfs.
- Fixed minor bugs.
1.75.1
- Extracting YTsaurus file system bundle outside Spark Fork
- Fix reading arrow tables from Spark SQL engine
- Binding Spark standalone cluster Master and Worker RPC/REST endpoints to wildcard network interface
- Add configurable thread pool size of internal RPC Job proxy
Kubernetes operator
Is released as helm charts on Github Packages.
Current release: 0.16.2
All releases:
0.16.1
0.16.0
Warning
This release has a bug for a configuration where UI or Strawberry components are enabled and some of their images were overridden (k8s init jobs will fail for such components).
Use 0.16.2 instead.
Minor changes:
- Add observedGeneration field to the YtsaurusStatus by @wilwell in #333.
- Set statistics for job low cpu usage alerts by @koct9i in #335.
- Add nodeSelector for UI and Strawberry by @l0kix2 in #338.
- Init job creates from InstanceSpec image if specified by @wilwell in #336.
- Add tolerations and nodeselectors to jobs by @l0kix2 in #342.
Contributors:
0.15.0
Backward incompatible changes:
- Component pod labels were refactored in #326 and changes are:
app.kubernetes.io/instance
was removed.app.kubernetes.io/name
was Ytsaurus before, now it contains component type.app.kubernetes.io/managed-by
is "ytsaurus-k8s-operator" instead of "Ytsaurus-k8s-operator".
- Deprecated chyt field in the main YTsaurus spec was removed, use strawberry field with the same schema instead.
Minor changes:
- Added tolerations for Strawberry by @qurname2 in #328.
- Refactor label names for components by @achulkov2 in #326.
Experimental:
Contributors:
0.14.0
Backward incompatible changes:
-
Before this release StrawberryController was unconditionally configured with
{address_resolver={enable_ipv4=%true;enable_ipv6=%true}}
in its static config. From now on it respects common useIpv6 and useIpv4 fields, which can be set in the YtsaurusSpec.If for some reason it is required to have configuration different from
useIpv6: true useIpv4: true
for the main Ytsaurus spec and at the same time
enable_ipv4=%true;enable_ipv6=%true
for the StrawberryController, it is possible to achieve that by usingconfigOverrides
ConfigMap with:data: strawberry-controller.yson: | { controllers = { chyt = { address_resolver = { enable_ipv4 = %true; enable_ipv6 = %true; }; }; }; }
Minor changes:
- Add no more than one ytsaurus spec per namespace validation by @qurname2 in #305.
- Add strategy, nodeSelector, affinity, tolerations by @sgburtsev in #321.
- Add forceTcp and keepSocket options by @leo-astorsky in #324.
Bugfixes:
Contributors:
0.13.1
Bugfixes:
- Revert deprecation of useInsecureCookies in #310. by @sgburtsev in #317.
- The field useInsecureCookies was deprecated in the previous release in a not backwards compatible way, this release fixes it. It is now possible to configure the secureness of UI cookies (via the useInsecureCookies field) and the secureness of UI and HTTP proxy interaction (via the secure field) independently.
Contributors:
0.13.0
Features:
- Add per-component terminationGracePeriodSeconds by @koct9i in #304.
- Added externalProxy parameter for UI by @sgburtsev in #308.
- Size as Quantity in LogRotationPolicy by @sgburtsev in #309.
- Use
secure
instead ofuseInsecureCookies
, pass caBundle to UI by @sgburtsev in #310.
Minor changes:
Bugfixes:
Contributors:
0.12.0
Features:
- More options for store locations. by @sgburtsev in #294.
- data nodes upper limit for low_watermark increased from 5 to 25Gib.
- data nodes'
trash_cleanup_watermark
will be set equal to the lowWatermark value from spec max_trash_ttl
can be configured in spec- Add support for directDownload to UI Spec by @kozubaeff in #257.
directDownload
for UI can be configured in the spec now. If omitted or set totrue
, UI will have current default behaviour (use proxies for download), if set tofalse
β UI backend will be used for downloading.
Contributors:
0.11.0
Features:
- SetHostnameAsFQDN option is added to all components. Default is true by @qurname2 in #302.
- Add per-component option hostNetwork by @koct9i in #287.
Minor changes:
- Add option for per location disk space quota by @koct9i in #279.
- Add into exec node pods environment variables for CRI tools by @koct9i in #283.
- Add per-instance-group podLabels and podAnnotations by @koct9i in #289.
- Sort status conditions for better readability by @koct9i in #290.
- Add init containers for exec node by @koct9i in #288.
- Add loglevel "warning" by @koct9i in #292.
- Remove mutating/defaulter webhooks by @koct9i in #296.
Bugfixes:
Contributors:
0.10.0
0.9.1
Minor changes:
- Add 'physical_host' to
cypress_annotations
for CMS and UI Ρompatibility. #252 - Add
WATCH_NAMESPACE
env andLeaderElectionNamespace
. #168 - Add configuration for solomon exporter: specify host and some instance tags. #258
- Add sidecars support to primary masters containers. #259
- Add option for containerd registry config path. #264
Bugfixes:
- Fix CRI job environment for remote exec nodes. #261
0.9.0
Features:
- Add experimental (behaviour may change)
UpdateSelector
field to be able to update components separately. #211
Minor changes:
- Enable TmpFS when possible. #235
- Disable disk quota for slot locations. #236
- Forward docker image environment variables to user job. #248
Bugfixes:
- Fix flag
doNotSetUserId
. #243
0.8.0
0.7.0
Features:
- Add Remote exec nodes support. #75
- Add MasterCaches support. #122
- Enable TLS certificate auto-update for http proxies. #167
- CRI containerd job environment. #105
Minor changes:
- Support
RuntimeClassName
in InstanceSpec. - Configurable monitoring port. #146
- Not triggering full update for data nodes update.
- Add
ALLOW_PASSWORD_AUTH
to UI. #162 - Readiness checks for strawberry & UI.
- Medium is called domestic medium now. #88
- Tune tablet changelog/snapshot initial replication factor according to data node count. #185
- Generate markdown API docs.
- Rename operations archive. #116
- Configure cluster to use jupyt. #149
- Fix QT ACOs creation on cluster update. #176
- Set ACLs for QT ACOs, add everyone-use ACO. #181
- Enable rpc proxy in job proxy. #197
- Add yqla token file in container. #140
Bugfixes:
- Replace YQL Agent default monitoring port 10029 -> 10019.
0.6.0
Features:
- Added support for updating masters of 23.2 versions.
- Added the ability to bind masters to the set of nodes by node hostnames.
- Added the ability to configure the number of stored snapshots and changelogs in master spec.
- Added the ability for users to create access control objects.
- Added support for volume mount with mountPropagation = Bidirectional mode in execNodes.
- Added access control object namespace "queries" and object "nobody". They are necessary for query_tracker versions 0.0.5 and higher.
- Added support for the new Cliques CHYT UI.
- Added the creation of a group for admins (admins).
- Added readiness probes to component statefulset specs.
- Improved ACLs on master schemas.
- Master and scheduler init jobs do not overwrite existing dynamic configs anymore.
exec_agent
was renamed toexec_node
in exec node config, if your specs haveconfigOverrides
please rename fields accordingly.
Fixes:
- Improved ACLs on master schemas.
- Master and scheduler init jobs do not overwrite existing dynamic configs anymore.
Tests:
- Added flow to run tests on Github resources
- Added e2e to check that updating from 23.1 to 23.2 works
- Added config generator tests for all components
- Added respect KIND_CLUSTER_NAME env variable in e2e tests
- Supported local k8s port forwarding in e2e
Backward incompatible changes:
exec_agent
was renamed toexec_node
in exec node config. If your specs have configOverrides, please rename fields accordingly.
0.5.0
- added minReadyInstanceCount into Ytsaurus components which allows not to wait when all pods are ready;
- support queue agent;
- added postprocessing of generated static configs;
- introduced separate UseIPv4 option to allow dualstack configurations;
- support masters in host network mode;
- added spyt engine in query tracker by default;
- enabled both ipv4 and ipv6 by default in chyt controllers;
- default CHYT clique creates as tracked instead of untracked;
- don't run full update check if full update is not enabled (enable_full_update flag in spec);
- update cluster algorithm was improved. If full update is needed for already running components and new components was added, operator will run new components at first, and only then start full update. Previously such reconfiguration was not supported;
- added optional TLS support for native-rpc connections;
- added possibility to configure job proxy loggers.
- changed how node resource limits are calculated from resourceLimits and resourceRequests;
- enabled debug logs of YTsaurus go client for controller pod;
- supported dualstack clusters in YQL agent;
- supported new config format of YQL agent;
- supported NodePort specification for HTTP proxy (http, https), UI (http) and RPC proxy (rpc port). For TCP proxy NodePorts are used implicitly when NodePort service is chosen. Port range size and minPort are now customizable;
- fixed YQL agents on ipv6-only clusters;
- fixed deadlock in case when UI deployment is manually deleted.
0.4.1
- ΠΏΠΎΠ΄Π΄Π΅ΡΠΆΠ°Π»ΠΈ Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ ΠΏΠ΅ΡΠ΅ΠΎΠΏΡΠ΅Π΄Π΅Π»ΡΡΡ ΡΡΠ°ΡΠΈΡΠ΅ΡΠΊΠΈΠ΅ ΠΊΠΎΠ½ΡΠΈΠ³ΠΈ per-instance, Π° Π½Π΅ ΡΠΎΠ»ΡΠΊΠΎ Π½Π° Π²ΡΡ ΠΊΠΎΠΌΠΏΠΎΠ½Π΅Π½ΡΡ;
- ΠΏΠΎΠ΄Π΄Π΅ΡΠΆΠ°Π»ΠΈ TLS Π΄Π»Ρ RPC-ΠΏΡΠΎΠΊΡΠ΅ΠΉ;
- ΠΏΠΎΡΠΈΠ½ΠΈΠ»ΠΈ ΠΏΠ°Π΄Π΅Π½ΠΈΠ΅ ΠΎΠΏΠ΅ΡΠ°ΡΠΎΡΠ° ΠΏΡΠΈ ΠΏΠΎΠ΄Π½ΡΡΠΈΠΈ CHYT-ΠΊΠ»ΠΈΠΊΠΈ ΠΏΠΎ-ΡΠΌΠΎΠ»ΡΠ°Π½ΠΈΡ -
ch_public
.
0.4.0
- Π°ΡΡ ΠΈΠ² ΠΎΠΏΠ΅ΡΠ°ΡΠΈΠΉ ΡΠ΅ΠΏΠ΅ΡΡ ΠΎΠ±Π½ΠΎΠ²Π»ΡΠ΅ΡΡΡ ΠΏΡΠΈ ΠΈΠ·ΠΌΠ΅Π½Π΅Π½ΠΈΠΈ ΠΎΠ±ΡΠ°Π·Π°;
- Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ ΡΠΊΠ°Π·Π°ΡΡ ΡΠ°Π·Π½ΡΠ΅ ΠΎΠ±ΡΠ°Π·Ρ Π΄Π»Ρ ΡΠ°Π·Π½ΡΡ ΠΊΠΎΠΌΠΏΠΎΠ½Π΅Π½Ρ;
- ΠΏΠΎΠ΄Π΄Π΅ΡΠΆΠ°Π½ΠΎ ΠΎΠ±Π½ΠΎΠ²Π»Π΅Π½ΠΈΠ΅ ΠΊΠ»Π°ΡΡΠ΅ΡΠ° Π±Π΅Π· ΠΏΠΎΠ»Π½ΠΎΠ³ΠΎ Π΄Π°ΡΠ½ΡΠ°ΠΉΠΌΠ° Π΄Π»Ρ stateless ΠΊΠΎΠΌΠΏΠΎΠ½Π΅Π½Ρ;
- ΠΏΠΎΠ΄Π΄Π΅ΡΠΆΠ°Π½ΠΎ ΠΎΠ±Π½ΠΎΠ²Π»Π΅Π½ΠΈΠ΅ ΡΡΠ°ΡΠΈΡΠ΅ΡΠΊΠΈΡ ΠΊΠΎΠ½ΡΠΈΠ³ΠΎΠ² ΠΊΠΎΠΌΠΏΠΎΠ½Π΅Π½Ρ ΠΏΡΠΈ Π½Π΅ΠΎΠ±Ρ ΠΎΠ΄ΠΈΠΌΠΎΡΡΠΈ;
- ΡΠ»ΡΡΡΠ΅Π½ SPYT-ΠΊΠΎΠ½ΡΡΠΎΠ»Π»Π΅Ρ. ΠΠΎΠ±Π°Π²Π»Π΅Π½ ΡΡΠ°ΡΡΡ ΠΈΠ½ΠΈΡΠΈΠ°Π»ΠΈΠ·Π°ΡΠΈΠΈ (
ReleaseStatus
); - Π΄ΠΎΠ±Π°Π²Π»Π΅Π½ CHYT-ΠΊΠΎΠ½ΡΡΠΎΠ»Π»Π΅Ρ ΠΈ Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ Π·Π°Π³ΡΡΠΆΠ°ΡΡ Π½Π΅ΡΠΊΠΎΠ»ΡΠΊΠΎ ΡΠ°Π·Π½ΡΡ Π²Π΅ΡΡΠΈΡ Π½Π° ΠΎΠ΄ΠΈΠ½ ΠΊΠ»Π°ΡΡΠ΅Ρ. ΠΠΎΠ΄ΡΠΎΠ±Π½ΠΎΡΡΠΈ ΠΌΠΎΠΆΠ½ΠΎ ΡΠ·Π½Π°ΡΡ ΠΏΠΎ ΡΡΡΠ»ΠΊΠ΅;
- Π΄ΠΎΠ±Π°Π²Π»Π΅Π½Π° Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ ΡΠΊΠ°Π·Π°ΡΡ ΡΠΎΡΠΌΠ°Ρ Π»ΠΎΠ³ΠΎΠ² (
yson
,json
ΠΈΠ»ΠΈplain_text
), Π° ΡΠ°ΠΊΠΆΠ΅ Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ Π²ΠΊΠ»ΡΡΠΈΡΡ Π·Π°ΠΏΠΈΡΡ ΡΡΡΡΠΊΡΡΡΠΈΡΠΎΠ²Π°Π½Π½ΡΡ Π»ΠΎΠ³ΠΎΠ². ΠΠΎΠ΄ΡΠΎΠ±Π½Π΅Π΅ ΠΌΠΎΠΆΠ½ΠΎ ΠΏΠΎΡΠΈΡΠ°ΡΡ Π½Π° ΡΡΡΠ°Π½ΠΈΡΠ΅ ΠΠΎΠ³ΠΈΡΠΎΠ²Π°Π½ΠΈΠ΅; - Π΄ΠΎΠ±Π°Π²Π»Π΅Π½ΠΎ Π±ΠΎΠ»ΡΡΠ΅ Π΄ΠΈΠ°Π³Π½ΠΎΡΡΠΈΠΊΠΈ ΠΎ ΠΏΠΎΠ΄Π½ΡΡΠΈΠΈ ΠΊΠΎΠΌΠΏΠΎΠ½Π΅Π½Ρ Π² ΡΡΠ°ΡΡΡΠ΅
Ytsaurus
; - Π΄ΠΎΠ±Π°Π²Π»Π΅Π½Π° Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ ΠΎΡΠΊΠ»ΡΡΠΈΡΡ Π·Π°ΠΏΡΡΠΊ ΠΏΠΎΠ»Π½ΠΎΠ³ΠΎ ΠΎΠ±Π½ΠΎΠ²Π»Π΅Π½ΠΈΡ (
enableFullUpdate
); - ΠΏΠΎΠ»Π΅
chyt
ΡΠΏΠ΅ΠΊΠΈ ΠΏΠ΅ΡΠ΅ΠΈΠΌΠ΅Π½ΠΎΠ²Π°Π½ΠΎ Π²strawberry
. ΠΠ»Ρ ΠΎΠ±ΡΠ°ΡΠ½ΠΎΠΉ ΡΠΎΠ²ΠΌΠ΅ΡΡΠΈΠΌΠΎΡΡΠΈ ΠΎΠ½ΠΎ ΠΎΡΡΠ°Π΅ΡΡΡ Π²crd
, Π½ΠΎ ΡΠ΅ΠΊΠΎΠΌΠ΅Π½Π΄ΡΠ΅ΡΡΡ Π΅Π³ΠΎ ΠΏΠ΅ΡΠ΅ΠΈΠΌΠ΅Π½ΠΎΠ²Π°ΡΡ; - ΡΠ°Π·ΠΌΠ΅Ρ
description
Π²crd
ΡΠ΅ΠΏΠ΅ΡΡ ΠΎΠ³ΡΠ°Π½ΠΈΡΠΈΠ²Π°Π΅ΡΡΡ 80 ΡΠΈΠΌΠ²ΠΎΠ»Π°ΠΌΠΈ, ΡΡΠΎ ΡΠΈΠ»ΡΠ½ΠΎ ΡΠΌΠ΅Π½ΡΡΠΈΠ»ΠΎ ΡΠ°Π·ΠΌΠ΅Ρcrd
; - ΡΠ°Π±Π»ΠΈΡΡ ΡΠΎΡΡΠΎΡΠ½ΠΈΡ
Query Tracker
ΡΠ΅ΠΏΠ΅ΡΡ Π°Π²ΡΠΎΠΌΠ°ΡΠΈΡΠ΅ΡΠΊΠΈ ΠΌΠΈΠ³ΡΠΈΡΡΡΡΡΡ ΠΏΡΠΈ Π΅Π³ΠΎ ΠΎΠ±Π½ΠΎΠ²Π»Π΅Π½ΠΈΡΡ ; - Π΄ΠΎΠ±Π°Π²Π»Π΅Π½Π° Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ Π·Π°Π΄Π°ΡΡ ΠΏΡΠΈΠ²ΠΈΠ»Π΅Π³ΠΈΡΠΎΠ²Π°Π½Π½ΡΠΉ ΡΠ΅ΠΆΠΈΠΌ Π΄Π»Ρ ΠΊΠΎΠ½ΡΠ΅ΠΉΠ½Π΅ΡΠΎΠ²
exec node
; - Π΄ΠΎΠ±Π°Π²Π»Π΅Π½Π°
TCP proxy
; - Π΄ΠΎΠ±Π°Π²Π»Π΅Π½ΠΎ Π±ΠΎΠ»ΡΡΠ΅ Π²Π°Π»ΠΈΠ΄Π°ΡΠΈΠΈ ΡΠΏΠ΅ΠΊΠΈ, Π° ΠΈΠΌΠ΅Π½Π½ΠΎ ΠΏΡΠΎΠ²Π΅ΡΠΊΠΈ ΡΠΎΠ³ΠΎ, ΡΡΠΎ ΠΏΡΡΠΈ Π² Π»ΠΎΠΊΠ°ΡΠΈΡΡ ΠΏΡΠΈΠ½Π°Π΄Π»Π΅ΠΆΠ°Ρ ΠΊΠ°ΠΊΠΎΠΌΡ-ΡΠΎ ΠΈΠ· Π²ΠΎΠ»ΡΡΠΌΠΎΠ², Π° ΡΠ°ΠΊΠΆΠ΅ Π½Π΅ΠΊΠΎΡΠΎΡΡΠ΅ ΠΏΡΠΎΠ²Π΅ΡΠΊΠΈ, ΡΡΠΎ Π΄Π»Ρ ΠΊΠ°ΠΆΠ΄ΠΎΠΉ ΡΠΊΠ°Π·Π°Π½Π½ΠΎΠΉ ΠΊΠΎΠΌΠΏΠΎΠ½Π΅Π½ΡΡ Π΅ΡΡΡ Π²ΡΠ΅ ΠΊΠΎΠΌΠΏΠΎΠ½Π΅Π½ΡΡ, Π½Π΅ΠΎΠ±Ρ ΠΎΠ΄ΠΈΠΌΡΠ΅ Π΄Π»Ρ Π΅Π΅ ΡΡΠΏΠ΅ΡΠ½ΠΎΠΉ ΡΠ°Π±ΠΎΡΡ;
- ΡΠ΅ΠΏΠ΅ΡΡ
strawberry controller
ΠΈui
ΡΠ°ΠΊΠΆΠ΅ ΠΌΠΎΠΆΠ½ΠΎ ΠΎΠ±Π½ΠΎΠ²Π»ΡΡΡ; - Π΄ΠΎΠ±Π°Π²Π»Π΅Π½Π° Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ ΠΏΠΎΠ΄Π½ΠΈΠΌΠ°ΡΡ http-proxy Ρ TLS;
- ΠΌΠΎΠΆΠ½ΠΎ ΡΠΊΠ°Π·Π°ΡΡ Π°Π΄ΡΠ΅Ρ Odin ΡΠ΅ΡΠ²ΠΈΡΠ° Π΄Π»Ρ UI;
- Π΄ΠΎΠ±Π°Π²Π»Π΅Π½Π° Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ ΠΊΠΎΠ½ΡΠΈΠ³ΡΡΠΈΡΠΎΠ²Π°ΡΡ
tags
ΠΈrack
Π΄Π»Ρ Π½ΠΎΠ΄; - ΠΏΠΎΠ΄Π΄Π΅ΡΠΆΠ΅Π½Π° ΠΊΠΎΠ½ΡΠΈΠ³ΡΡΠ°ΡΠΈΡ OAuth ΡΠ΅ΡΠ²ΠΈΡΠ° Π² ΡΠΏΠ΅ΠΊΠ΅;
- Π΄ΠΎΠ±Π°Π²Π»Π΅Π½Π° Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ ΠΏΠ΅ΡΠ΅Π΄Π°Π²Π°ΡΡ Π΄ΠΎΠΏΠΎΠ»Π½ΠΈΡΠ΅Π»ΡΠ½ΡΠ΅ ΠΏΠ΅ΡΠ΅ΠΌΠ΅Π½Π½ΡΠ΅ ΠΎΠΊΡΡΠΆΠ΅Π½ΠΈΠ΅ Π² UI, Π° ΡΠ°ΠΊΠΆΠ΅ Π·Π°Π΄Π°Π²Π°ΡΡ ΡΠ΅ΠΌΡ ΠΈ ΠΎΠΊΡΡΠΆΠ΅Π½ΠΈΠ΅ (
testing
,production
ΠΈΡΠΏ) Π΄Π»Ρ UI; - ΠΌΠ΅Π΄ΠΈΡΠΌΡ Π»ΠΎΠΊΠ°ΡΠΈΠΉ data node ΡΠΎΠ·Π΄Π°ΡΡΡΡ Π°Π²ΡΠΎΠΌΠ°ΡΠΈΡΠ΅ΡΠΊΠΈ ΠΏΡΠΈ ΠΏΠ΅ΡΠ²ΠΈΡΠ½ΠΎΠΌ ΡΠ°Π·Π²ΠΎΡΠ°ΡΠΈΠ²Π°Π½ΠΈΠΈ ΠΊΠ»Π°ΡΡΠ΅ΡΠ°.
0.3.1
- Π΄ΠΎΠ±Π°Π²Π»Π΅Π½Π° Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ Π½Π°ΡΡΡΠΎΠΈΡΡ Π°Π²ΡΠΎΠΌΠ°ΡΠΈΡΠ΅ΡΠΊΡΡ ΡΠΎΡΠ°ΡΠΈΡ Π»ΠΎΠ³ΠΎΠ²;
- Π΄ΠΎΠ±Π°Π²Π»Π΅Π½Π° Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ ΡΠΊΠ°Π·Π°ΡΡ
tolerations
ΠΈnode selector
Π² ΡΠΏΠ΅ΠΊΠ΅ ΠΈΠ½ΡΡΠ°Π½ΡΠΎΠ² ΠΊΠΎΠΌΠΏΠΎΠ½Π΅Π½Ρ; - ΠΈΡΠΏΡΠ°Π²Π»Π΅Π½Π° ΠΎΡΠΈΠ±ΠΊΠ° Π² Π½Π°ΠΈΠΌΠ΅Π½ΠΎΠ²Π°Π½ΠΈΠΈ ΠΏΠΎΠ»Ρ
medium_name
Π² ΡΡΠ°ΡΠΈΡΠ΅ΡΠΊΠΈΡ ΠΊΠΎΠ½ΡΠΈΠ³Π°Ρ ; - Π΄ΠΎΠ±Π°Π²Π»Π΅Π½ Π²ΡΠ·ΠΎΠ²
Reconcile
ΠΎΠΏΠ΅ΡΠ°ΡΠΎΡΠ° ΠΏΡΠΈ ΠΈΠ·ΠΌΠ΅Π½Π΅Π½ΠΈΠΈ ΡΠΎΠ·Π΄Π°Π½Π½ΡΡ ΠΈΠΌ ΠΎΠ±ΡΠ΅ΠΊΡΠΎΠ²; - ConfigMap-Ρ Ρ
ΡΠ°Π½ΡΡ Π΄Π°Π½Π½ΡΠ΅ Π² ΡΠ΅ΠΊΡΡΠΎΠ²ΠΎΠΌ Π²ΠΈΠ΄Π΅ Π²ΠΌΠ΅ΡΡΠΎ Π±ΠΈΠ½Π°ΡΠ½ΠΎΠ³ΠΎ, ΡΡΠΎΠ±Ρ ΠΏΠΎΠ·Π²ΠΎΠ»ΡΠ΅Ρ ΡΠΌΠΎΡΡΠ΅ΡΡ ΡΠΎΠ΄Π΅ΡΠΆΠΈΠΌΠΎΠ΅ ΠΊΠΎΠ½ΡΠΈΠ³ΠΎΠ² ΡΠ΅ΡΠ΅Π·
kubectl describe configmap <configmap-name>
; - Π΄ΠΎΠ±Π°Π²Π»Π΅Π½ΠΎ Π²ΡΡΠΈΡΠ»Π΅Π½ΠΈΠ΅ ΠΈ ΡΡΡΠ°Π½ΠΎΠ²ΠΊΠ°
disk_usage_watermark
ΠΈdisk_quota
Π΄Π»Ρexec node
; - Π΄ΠΎΠ±Π°Π²Π»Π΅Π½ SPYT-ΠΊΠΎΠ½ΡΡΠΎΠ»Π»Π΅Ρ ΠΈ Π²ΠΎΠ·ΠΌΠΎΠΆΠ½ΠΎΡΡΡ Π·Π°Π³ΡΡΠΆΠ°ΡΡ Π² ΠΊΠΈΠΏΠ°ΡΠΈΡ Π½Π΅ΠΎΠ±Ρ
ΠΎΠ΄ΠΈΠΌΠΎΠ΅ Π΄Π»Ρ
spyt
Ρ ΠΏΠΎΠΌΠΎΡΡΡ ΠΎΡΠ΄Π΅Π»ΡΠ½ΠΎΠ³ΠΎ ΡΠ΅ΡΡΡΡΠ°, ΡΡΠΎ ΠΏΠΎΠ·Π²ΠΎΠ»ΡΠ΅Ρ ΠΈΠΌΠ΅ΡΡ Π½Π΅ΡΠΊΠΎΠ»ΡΠΊΠΎ Π²Π΅ΡΡΠΈΠΉSPYT
Π½Π° ΠΎΠ΄Π½ΠΎΠΌ ΠΊΠ»Π°ΡΡΠ΅ΡΠ΅. ΠΠΎΠ΄ΡΠΎΠ±Π½ΠΎΡΡΠΈ ΠΌΠΎΠΆΠ½ΠΎ ΡΠ·Π½Π°ΡΡ Π½Π° ΠΎΡΠ΄Π΅Π»ΡΠ½ΠΎΠΉ ΡΡΡΠ°Π½ΠΈΡΠ΅;
YTsaurus Python YSON
Current version: 0.4.9
0.4.9
Features:
- Support ORC format.
- Access thread local variables via noinline functions.
- Support Python 3.13 (avoid using deprecated
PyImport_ImportModuleNoBlock
).
0.4.8
- Add table creation in upload parquet.
- Reduce bindings .so size.
0.4.7
- Add implementation of
upload_parquet
. - Fix invalid memory access in
YsonStringProxy
.
SDK
Python
Availabe as a package in PyPI.
Current release: 0.13.18
All releases:
0.13.18
Features:
- Use expanduser for
config["token_path"]
. - Support custom dill params.
- Support Nullable patchable config element.
- Add
max_replication_factor
in config. - Use strawberry ctl address from Cypress client_config.
Fixes:
- Fixes of E721: do not compare types, for exact checks use
is
/is not
, for instance checks useisinstance()
. - Fix bug in YTsaurus python wrapper: stop transaction pinger before exiting transaction.
0.13.17
Features:
- Support profiles in configuration file.
- Add versioned select.
- Add enum.StrEnum and enum.IntEnum support for yt_dataclasses.
Fixes:
- Fix test_operation_stderr_output in py.test environment.
Thanks to @thenno for considerable contribution!
0.13.16
Features:
- Allow to specify prerequisite transaction ids in client. Transaction context manager (PR: #638). Thanks @chegoryu for the PR!
- Add
client
andchunk_count
parameters todirtable_commands
. - Add
alter_query
command for Query Tracker. - Add
dump_job_proxy_log
command (PR: #594). Thanks @tagirhamitov for the PR!
Fixes:
0.13.15
Features:
- Add respawn in docker functionality.
- Fixes in conditional imports and dataclasses for type hint support.
- Add option for ignore system py modules while pickling.
- Use pickling by value in interactive envs with dill.
- Add wide time types.
- Add --syntax-version option to client, add composite types member accessors.
- Add retries for skiff.
- Add consumer type handler for node creation.
- Add logic for auto selection of operation layer.
- Added an option for not merging rows in select.
- Add with-monitoring-descriptor option.
- Add missing method in spec builder.
- Add table creation in upload parquet.
- Optimize skiff dump performance for long dataclasses.
- Support parsing type_v1 from yson to schema.
- Add enable_replicated_table_tracker argument to alter_table_replica wrapper methods.
- Add close property to ResponseStream.
- Allow to pass single SortColumn to build_schema_sorted_by.
Fixes:
- Fix typo: comitted, commited -> committed.
- Fix deprecated utcnow.
- Fix ignore of
YT_PREFIX
by certain commands.
0.13.14
Features:
- Added an option for skipping rows merge in
select
. - Support composite types in QL.
- Add
preserve_account
option to table backup commands. - Expand the list of dynamic table retriable errors.
- Enhance table creation with specified append attribute.
- Various improvements of maintenance API.
- Support
upload_parquet
command.
Fixes:
- Support
SortColumn
serialization. - Fix file descriptors leak in config parsing.
- Fix output stream validation for
TypedJobs
.
0.13.12
β
0.13.7
β
Java
Is released as packages in maven.
Current release: 1.2.5
All releases:
1.2.5
- Added MultiYTsaurusClient.
- Support for MultiLookupRows request.
- Fixed a bug that caused an infinite wait for proxy discovery when the connection failed.
- Fixed a bug that caused the operation output table to be created without a user-specified transaction.
1.2.4
- Support for JPA @Embedded/@Embeddable annotations.
- Support for URL schema to detect the usage of TLS.
- Implemented YTsaurus Query Tracker API methods.
1.2.3
- Introduced
DiscoveryClient
. - The following types are supported in
@Entity
fields (use@Column(columnDefinition=β...β)
to specify type):- enum -> utf8/string;
- String -> string;
- Instant -> int64;
- YsonSerializable -> yson.
- Fixed a bug due to which
YTsaurusClient
did not terminate.
1.2.1
29.01.2024
- ΠΏΠΎΠ΄Π΄Π΅ΡΠΆΠ°Π½Ρ ΡΠ΅ΡΠΈΠ°Π»ΠΈΠ·ΡΠ΅ΠΌΡΠ΅ mapper/reducer (ΡΠ΅Π°Π»ΠΈΠ·ΡΡΡΠΈΠ΅ ΠΈΠ½ΡΠ΅ΡΡΠ΅ΠΉΡ
Serializable
); - Π΄ΠΎΠ±Π°Π²Π»Π΅Π½ ΠΌΠ΅ΡΠΎΠ΄
completeOperation
; - ΠΏΠΎΠ΄Π΄Π΅ΡΠΆΠ°Π½ΠΎ Π½Π΅ΡΠΊΠΎΠ»ΡΠΊΠΎ ΠΌΠ΅ΡΠΎΠ΄ΠΎΠ² YTsaurus Queues API:
registerQueueConsumer
,advanceConsumer
,pullConsumer
; - Π² Π²ΠΎΠ·Π²ΡΠ°ΡΠ°Π΅ΠΌΡΡ
ΠΌΠ΅ΡΠΎΠ΄ΠΎΠΌ
partitionTables
ΠΎΠ±ΡΠ΅ΠΊΡΠ°ΡMultiTablePartition
ΡΠ΅ΠΏΠ΅ΡΡ Π΅ΡΡΡAggregateStatistics
.
1.2.0
18.09.2023
- ΠΈΡΠΏΡΠ°Π²Π»Π΅Π½ Π±Π°Π³ Ρ Π·Π°ΠΊΡΡΡΠΈΠ΅ΠΌ Π²Π½ΡΡΡΠ΅Π½Π½ΠΈΡ
ΠΏΠΎΡΠΎΠΊΠΎΠ²
SyncTableReaderImpl
; - Π² Π·Π°ΠΏΡΠΎΡΠ΅
WriteTable
ΠΎΠΏΡΠΈΡneedRetries
ΡΡΡΠ°Π½ΠΎΠ²Π»Π΅Π½Π° Π²true
ΠΏΠΎ ΡΠΌΠΎΠ»ΡΠ°Π½ΠΈΡ; - Π² Π·Π°ΠΏΡΠΎΡΠ°
WriteTable
ΠΏΠΎΡΠ²ΠΈΠ»ΡΡbuilder(Class)
, ΠΏΡΠΈ Π΅Π³ΠΎ ΠΈΡΠΏΠΎΠ»ΡΠ·ΠΎΠ²Π°Π½ΠΈΠΈ ΠΌΠΎΠΆΠ½ΠΎ Π½Π΅ ΡΠΊΠ°Π·ΡΠ²Π°ΡΡSerializationContext
, Π΅ΡΠ»ΠΈ ΠΊΠ»Π°ΡΡ ΠΏΠΎΠΌΠ΅ΡΠ΅Π½ Π°Π½Π½ΠΎΡΠ°ΡΠΈΠ΅ΠΉ@Entity
, ΡΠ΅Π°Π»ΠΈΠ·ΡΠ΅Ρ ΠΈΠ½ΡΠ΅ΡΡΠ΅ΠΉΡcom.google.protobuf.Message
ΠΈΠ»ΠΈ ΡΠ²Π»ΡΠ΅ΡΡΡtech.ytsaurus.ysontree.YTreeMapNode
(Π΄Π»Ρ Π½ΠΈΡ Π±ΡΠ΄ΡΡ Π²ΡΠ±ΡΠ°Π½Ρ ΡΠΎΡΠΌΠ°ΡΡ ΡΠ΅ΡΠΈΠ°Π»ΠΈΠ·Π°ΡΠΈΠΈskiff
,protobuf
ΠΈΠ»ΠΈwire
ΡΠΎΠΎΡΠ²Π΅ΡΡΡΠ²Π΅Π½Π½ΠΎ); - ΡΠ΅ΡΡΠ΅ΡΡ
setPath(String)
Π² Π±ΠΈΠ»Π΄Π΅ΡΠ°ΡWriteTable
ΠΈReadTable
ΠΎΠ±ΡΡΠ²Π»Π΅Π½Ρ@Deprecated
; - ΠΈΠ·ΠΌΠ΅Π½ΠΈΠ»ΡΡ ΠΈΠ½ΡΠ΅ΡΡΠ΅ΠΉΡ Π±ΠΈΠ»Π΄Π΅ΡΠΎΠ² Π·Π°ΠΏΡΠΎΡΠΎΠ²
GetNode
ΠΈListNode
: Π² ΠΌΠ΅ΡΠΎΠ΄setAttributes
Π²ΠΌΠ΅ΡΡΠΎColumnFilter
ΡΠ΅ΠΏΠ΅ΡΡ ΠΏΠ΅ΡΠ΅Π΄Π°ΡΡΡΡList<String>
, Π°ΡΠ³ΡΠΌΠ΅Π½Ρnull
ΠΎΠ·Π½Π°ΡΠ°Π΅Ρuniversal filter
(Π²Π΅ΡΠ½ΡΡΡΡ Π²ΡΠ΅ Π°ΡΡΠΈΠ±ΡΡΡ); - Π²
YTsaurusClientConfig
Π΄ΠΎΠ±Π°Π²Π»Π΅Π½ ΡΠ»Π°Π³useTLS
, ΠΏΡΠΈ Π²ΡΡΡΠ°Π²Π»Π΅Π½ΠΈΠΈ ΠΊΠΎΡΠΎΡΠΎΠ³ΠΎ Π²true
Π΄Π»Ρdiscover_proxies
Π±ΡΠ΄Π΅Ρ ΠΈΡΠΏΠΎΠ»ΡΠ·ΠΎΠ²Π°ΡΡΡΡhttps
.
1.1.1
06.09.2023
- ΠΈΡΠΏΡΠ°Π²Π»Π΅Π½Π° Π²Π°Π»ΠΈΠ΄Π°ΡΠΈΡ ΡΡ
Π΅ΠΌ
@Entity
: ΠΌΠΎΠΆΠ½ΠΎ ΡΠΈΡΠ°ΡΡ ΠΏΠΎΠ΄ΠΌΠ½ΠΎΠΆΠ΅ΡΡΠ²ΠΎ ΠΊΠΎΠ»ΠΎΠ½ΠΎΠΊ ΡΠ°Π±Π»ΠΈΡΡ, Π½Π°Π΄ΠΌΠ½ΠΎΠΆΠ΅ΡΡΠ²ΠΎ ΠΊΠΎΠ»ΠΎΠ½ΠΎΠΊ (Π΅ΡΠ»ΠΈ ΡΠΈΠΏΡ Π»ΠΈΡΠ½ΠΈΡ ΠΊΠΎΠ»ΠΎΠ½ΠΎΠΊnullable
), ΠΏΠΈΡΠ°ΡΡ ΠΏΠΎΠ΄ΠΌΠ½ΠΎΠΆΠ΅ΡΡΠ²ΠΎ ΠΊΠΎΠ»ΠΎΠ½ΠΎΠΊ (Π΅ΡΠ»ΠΈ ΡΠΈΠΏΡ Π½Π΅Π΄ΠΎΡΡΠ°ΡΡΠΈΡ ΠΊΠΎΠ»ΠΎΠ½ΠΎΠΊnullable
); - Π²
@Entity
ΠΏΠΎΠ»ΡΡ ΠΏΠΎΠ΄Π΄Π΅ΡΠΆΠ°Π½Ρ ΡΠΈΠΏΡ:utf8
->String
;string
->byte[]
;uuid
->tech.ytsaurus.core.GUID
;timestamp
->java.time.Instant
.
- ΠΏΡΠΈ ΠΏΠ°Π΄Π΅Π½ΠΈΠΈ ΠΎΠΏΠ΅ΡΠ°ΡΠΈΠΈ, Π·Π°ΠΏΡΡΠ΅Π½Π½ΠΎΠΉ
SyncYTsaurusClient
, Π±ΡΠΎΡΠ°Π΅ΡΡΡ ΠΈΡΠΊΠ»ΡΡΠ΅Π½ΠΈΠ΅; - Π²
YTsaurusClientConfig
Π΄ΠΎΠ±Π°Π²Π»Π΅Π½ ΡΠ»Π°Π³ignoreBalancers
, ΠΏΠΎΠ·Π²ΠΎΠ»ΡΡΡΠΈΠΉ ΠΏΡΠΎΠΈΠ³Π½ΠΎΡΠΈΡΠΎΠ²Π°ΡΡ Π°Π΄ΡΠ΅ΡΠ° Π±Π°Π»Π°Π½ΡΠ΅ΡΠΎΠ² ΠΈ Π½Π°ΠΉΡΠΈ ΡΠΎΠ»ΡΠΊΠΎ Π°Π΄ΡΠ΅ΡΠ° rpc ΠΏΡΠΎΠΊΡΠ΅ΠΉ.