Vectorized operations on int128 and uint256 integers
Vectorized wide integer types to more efficiently process numeric and decimal values that need to maintain precision. We recorded a 10x improvement in performance with these optimizations.
ARRAY_CONTAINS_PREFIX function
ARRAY_CONTAINS_PREFIX(string_array, prefix) returns true if any element of string_array starts with the given prefix.This new function Improves the ergonomics of prefix search and results in better performance on nested arrays. Learn more here.
Vectorized MIN and MAX for timestamps and dates
Vectorized MIN and MAX operations for timestamps and dates for better performance of time series analytics. Internal benchmarks show a performance improvement of 82% with vectorization.
SQL join optimizations
Decreasing the number of memory allocations across sequential hash computation operations, thus improving efficiency of SQL joins.
Enhancements to column scans using the UNNEST function
New method for merging arrays for uncompacted collections resulting in a 10x performance improvement running column scans with UNNEST over arrays. This results in better performance for analytical queries over nested data.
Source Ingest Transformations [Beta]
You can now specify an ingest transformation for each source at collection creation time through the REST API's create collection endpoint. This uses the ingest_transformation
field in the source
field of the create collection request. Note this is different from the collection ingest transformation, which currently uses the field_mapping_query
field. Learn more here.
Query Performance Profiling
New and improved experience in the console to help explain what impacts query performance, including new stats about cache hit rate.
Increased View and Alias Limits
View and Alias limits have been raised for all orgs to 1000. Note that any overrides set by support are still respected.
Increased Ingest Rate Limits
Improvements in performance and stability for ingest operations enable a 50% increase in ingest rate limits across all sizes. See new limits here.
Dedicated Streaming Ingest [Beta]
Dedicated Streaming Ingest is designed to support ingest latency-sensitive use cases. Learn more here.