Edit

StarRocks version 2.2

2.2.1

Release date: June 2, 2022

Improvements

  • Optimized the data loading performance and reduced long tail latency by reconstructing part of the hotspot code and reducing lock granularity. #6641
  • Added the CPU and memory usage information of the machines on which BEs are deployed for each query to the FE audit log. #6208 #6209
  • Supported JSON data types in the tables that use the Primary Key model and tables that use the Unique Key model. #6544
  • Reduced FEs load by reducing lock granularity and deduplicating BE report requests. Optimized the report performance when a large number of BEs are deployed, and solved the issue of Routine Load tasks getting stuck in a large cluster. #6293

Bug Fixes

The following bugs are fixed:

  • An error occurs when StarRocks parses the escape characters specified in the SHOW FULL TABLES FROM DatabaseName statement. #6559
  • FE disk space usage rises sharply (Fix this bug by rolling back the BDBJE version). #6708
  • BEs become faulty because relevant fields cannot be found in the data returned after columnar scanning is enabled (enable_docvalue_scan=true). #6600

2.2.0

Release date: April 22, 2022

New Features

  • [Preview] Resource groups are supported. By using resource groups to control CPU and memory usage, StarRocks can achieve resource isolation and rational use of resources when different tenants perform complex and simple queries in the same cluster.
  • [Preview] Java UDFs (user-defined functions) are supported. StarRocks supports writing UDFs in Java, extending StarRocks' functions.
  • Primary key model supports partial updates when data is loaded to the primary key model using Stream Load, Broker Load, and Routine Load. In real-time data update scenarios such as updating orders and joining multiple streams, partial updates allow users to update only a few columns.
  • [Preview] JSON data types and JSON functions are supported.
  • External tables based on Apache Hudi are supported, which further improves data lake analytics experience.
  • The following functions are supported:
    • ARRAY functions, including array_agg, array_sort, array_distinct, array_join, reverse, array_slice, array_concat, array_difference, array_overlap, and array_intersect
    • BITMAP functions, including bitmap_max and bitmap_min
    • Other functions, including retention and square

Improvement

  • CBO's Parser and Analyzer are reconstructed, code structure is optimized and syntax such as Insert with CTE is supported. So the performance of complex queries is optimized, such as those queries reusing common table expression (CTE).
  • The query performance of object storage-based (AWS S3, Alibaba Cloud OSS, Tencent COS) Apache Hive external table is optimized. After optimization, the performance of object storage-based queries is comparable to that of HDFS-based queries. Also, late materialization of ORC files is supported, improving query performance of small files.
  • When external tables are used to query Apache Hive, StarRocks supports automatic and incremental updating of cached metastore data by consuming Hive Metastore events, such as data changes and partition changes. Moreover, it also supports querying DECIMAL and ARRAY data in Apache Hive.
  • The performance of UNION ALL operator is optimized, delivering improvement of up to 2-25 times.
  • The pipeline engine which can adaptively adjust query parallelism is released, and its profile is optimized. The pipeline engine can improve performance for small queries in high concurrent scenarios.
  • StarRocks supports the loading of CSV files with multi-character row delimiters.

Bug Fixes

The following bugs are fixed:

  • Deadlocks occur when data is loaded and changes are committed into tables based on Primary Key model. #4998
  • Some FE (including BDBJE) stability issues. #4428, #4666, #2
  • The return value overflows when the SUM function is used to calculate a large amount of data. #3944
  • The return values of ROUND and TRUNCATE functions have precision issues. #4256
  • Some bugs detected by SQLancer. Please see SQLancer related issues.

Others

  • The Flink connector flink-connector-starrocks supports Flink 1.14.