Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

Trino

Last update: Dec 31, 2022

Overview

Trino is a fast distributed SQL query engine for big data analytics.

See the User Manual for deployment instructions and end user documentation.

Development

See DEVELOPMENT for information about code style, development process, and guidelines.

See CONTRIBUTING for contribution requirements.

Build requirements

Mac OS X or Linux
Java 11.0.7+, 64-bit
Docker

Building Trino

Trino is a standard Maven project. Simply run the following command from the project root directory:

./mvnw clean install -DskipTests

On the first build, Maven downloads all the dependencies from the internet and caches them in the local repository (~/.m2/repository), which can take a while, depending on your connection speed. Subsequent builds are faster.

Trino has a comprehensive set of tests that take a considerable amount of time to run, and are thus disabled by the above command. These tests are run by the CI system when you submit a pull request. We recommend only running tests locally for the areas of code that you change.

Running Trino in your IDE

Overview

After building Trino for the first time, you can load the project into your IDE and run the server. We recommend using IntelliJ IDEA. Because Trino is a standard Maven project, you easily can import it into your IDE. In IntelliJ, choose Open Project from the Quick Start box or choose Open from the File menu and select the root pom.xml file.

After opening the project in IntelliJ, double check that the Java SDK is properly configured for the project:

Open the File menu and select Project Structure
In the SDKs section, ensure that JDK 11 is selected (create one if none exist)
In the Project section, ensure the Project language level is set to 11

Running a testing server

The simplest way to run Trino for development is to run the TpchQueryRunner class. It will start a development version of the server that is configured with the TPCH connector. You can then use the CLI to execute queries against this server. Many other connectors have their own *QueryRunner class that you can use when working on a specific connector.

Running the full server

Trino comes with sample configuration that should work out-of-the-box for development. Use the following options to create a run configuration:

Main Class: io.trino.server.DevelopmentServer
VM Options: -ea -Dconfig=etc/config.properties -Dlog.levels-file=etc/log.properties -Djdk.attach.allowAttachSelf=true
Working directory: $MODULE_DIR$
Use classpath of module: trino-server-dev

The working directory should be the trino-server-dev subdirectory. In IntelliJ, using $MODULE_DIR$ accomplishes this automatically.

Running the CLI

Start the CLI to connect to the server and run SQL queries:

client/trino-cli/target/trino-cli-*-executable.jar

Run a query to see the nodes in the cluster:

SELECT * FROM system.runtime.nodes;

Run a query against the TPCH connector:

SELECT * FROM tpch.tiny.region;

Comments

Allow fetching file based access provider rules via http(s) url
Description

This is actually replacement for https://github.com/trinodb/trino/pull/11491 The changes are integrated with the newest trino code New fork created as we don't have write permission to https://github.com/clemensvonschwerin/presto/tree/file-system-based-access-provider-via-rest Would like to move it forward and finally get merged to official trino codebase

Is this change a fix, improvement, new feature, refactoring, or other?

Is this a change to the core query engine, a connector, client library, or the SPI interfaces? (be specific)

How would you describe this change to a non-technical end user or system administrator?

Related issues, pull requests, and links

Documentation

( ) No documentation is needed. ( ) Sufficient documentation is included in this PR. ( ) Documentation PR is available with #prnumber. ( ) Documentation issue #issuenumber is filed, and can be handled later.

Release notes

( ) No release notes entries required. (x) Release notes entries required with the following suggested text:

# Security * Allow fetching access control rules via http(s) url
cla-signed release-notes docs jdbc tests:hive
opened by arkadiuszbalcerek 84
Add Hudi connector

This PR adds a new connector for Hudi (Issue #9877 ). For new Hudi features within the existing Hive connector please take a look at #9641 . In order to avoid making core changes in Hive connector we wrote a new connector as suggested in #9641. The design of the connector can be viewed here.
cla-signed tests:hive

opened by codope 63
Release notes for 365
Ashhar Hasan

[x] all checked

11-02 11:48:19 28e8b71e7a Move comment above relevant code

11-02 11:48:19 fa220ffb4b Replace Optional.isPresent with functional expression

11-03 11:56:03 3fa5f040c6 Upgrade alluxio-shaded-client to 2.6.2

11-03 16:28:41 7c34f5a7a9 Upgrade PostgreSQL driver to 42.3.1

11-03 18:35:55 ef4b88729d Add CatalogNameModule to KafkaConnectorFactory

11-05 09:46:15 2db161726a Remove PinotColumn

11-05 09:46:15 4187472f31 Fix offset handling in passthrough queries

11-05 09:46:15 98cd2bd98c Rename PinotQuery to PinotQueryInfo

11-05 09:46:15 a78f443eb4 Use JsonCodec when submitting broker request in Pinot

11-05 09:46:15 c1e7173d7e Upgrade libraries to pinot-0.8.0

11-10 07:10:20 1b5db4ab10 Move ImplementAvgBigint logic from connectors into base jdbc module

11-15 07:03:24 62c7c1286a Make PostgreSqlClient.timeWriteFunction() private

11-15 11:59:25 4b4fb696eb Clarify token caching

11-17 13:30:32 1562713585 Use more functional style to improve code readability

11-22 13:04:21 2fe6b70b4b Reorder BigQuery view support caveats in docs

11-22 13:36:05 3233388ff2 Fix Pinot test assertion in Java 17

11-22 19:56:51 a6bdf21c44 Remove redundant test case skipping for MongoDB

11-24 07:55:59 24afd8deed Update BigQuery storage protos to v1

11-29 19:02:14 1521016c36 Support reading DECIMAL columns with unspecified precision in Phoenix connector

Dain Sundstrom

[x] all checked

11-02 22:23:15 37c7d227f8 Update to latest JWT apis

11-10 21:32:38 2425815d29 Use IP_ENCODED_AS_HOSTNAME with automatic TLS

11-16 09:59:04 027a82d234 Add internal view definition classes

11-16 09:59:04 11183074a3 Remove owner from materialized system table to match the other tables

11-16 09:59:04 230f49f15f Add ViewInfo to simplify information required when listing views

11-16 09:59:04 32371f77c2 Notify SystemSecurityMetadata of create, rename, or drop

11-16 09:59:04 44c7be033e Add ownership to SystemSecurityMetadata

11-16 09:59:04 45e4c23148 Remove owner from Iceberg materialized system table

11-16 09:59:04 8471cace86 Add metadata isView to simplify most view usage

11-16 09:59:04 d964e3e2f9 Add metadata isMaterializedView to simplify most materialized view usage

11-16 09:59:04 f7aac0db74 Provide query owner full identity to view and kill query security checks

11-16 23:02:22 29f224f693 Add QueuedStatementResource timeout for query submission (mem leak fix)

11-17 05:56:20 55f9c7a9e3 Add SYSTEM security type to Hive and Iceberg

11-17 05:56:20 c3f6b68fd7 Add ALLOW_ALL and READ_ONLY security to Iceberg

11-19 18:13:26 295da15d6d Support null owner for connector views when using system security

11-19 18:13:26 4e1b46d2ee Add NO_PRIVILEGES constant to PrincipalPrivileges

11-19 18:13:26 dff92cf8a3 Do not set owner or permissions into Hive for system security

11-20 18:53:32 e3cf28834f Verify alter owner for Hive system security does not call Hive

11-22 06:38:54 30c6d91d92 Fix listTablePrivileges when owner is not set

11-24 02:44:51 5b90642ebe Make event-listener SPI objects fully jackson serializable

11-28 02:53:24 3ac9061248 Simplify analyzer setup and usage

11-28 02:53:24 8065aa8dde Simplify explain for data definition tasks

11-28 02:53:24 eb5b77d44a Remove unnecessary DataDefinitionTask execute arguments

David Phillips

[x] all checked

11-09 23:41:23 7ccedcdb15 Enable hive.s3.streaming by default

11-10 21:27:31 016c05e454 Add schema access requirement to JDBC driver doc

11-16 22:21:45 3e35fc4e5e Update Maven Wrapper to Maven 3.8.3

11-17 01:33:23 536a63e1c8 Use auto-commit flag in Hive connector

11-17 01:33:23 ab22da1aad Remove auto-commit flag from ConnectorSession

11-17 01:33:23 bfcb5e8b0b Migrate Connector.beginTransaction() implementations

11-17 01:33:23 d945f9708d Add auto-commit flag to Connector.beginTransaction()

11-17 01:33:23 df8cc875d2 Inline unnecessary method in HiveMetadataFactory

Grzegorz Kokosiński

[x] all checked

11-02 16:07:09 6f21b7133c Remove unnecessary singleton

11-02 20:12:23 dcf8f446f2 Add owner-based query access rules

11-02 20:12:23 e2bce1ff77 Add group-based query access rules

11-02 20:17:03 835695abd2 Use base SessionPropertiesProvider in Kafka

11-03 16:03:20 6ca69eb25a Allow Hive and other connectors use system roles

11-03 16:03:20 872ac9b974 Rename security NONE to ALLOW_ALL

11-03 16:03:20 9e3cb4c68a Define constants for hive.security options

11-03 16:03:20 d7c932f8cf Extract RaptorSecurity enum

11-09 10:06:49 2dc0e91fbb Wrap JdbcConnector's ConnectorMetadata

11-10 09:59:43 511c8788ec Clean up raw types

11-10 10:01:22 200ec0ec0a Update to airlift 209

11-14 21:27:32 02be06c083 Remove empty delete when not wrapped with exchange

11-14 21:27:32 217d200336 Use Table in Insert Statement node

11-14 21:27:32 2ee5ae32dd Prefer using TableSchema in StatementAnalyzer#visitDelete

11-14 21:27:32 69c5fcb51e Pass view refresh WriterTarget as Optional

11-14 21:27:32 790b69c285 Do not access outerContext when it is absent

11-14 21:27:32 cd05938831 Allow to INSERT or DELETE on tables with a row filter

11-16 10:21:37 e4906fd50b Don't abort the cursor when we're at the end of JDBC resultset

11-17 13:31:37 9d158d4cf4 Remove unused system tables from Hive connector

11-22 11:07:02 0f7cb1fb49 Use method reference

11-22 11:07:02 5025a30742 Allow MockConnector to support system roles

11-23 14:09:09 05b483bcfc Test column mask and row filter with hidden columns

11-23 14:09:09 c140d46fe4 Support insert into a table with row filter and hidden columns

11-27 21:29:56 d2fa1fa279 Improve error message when inserting out of the row filter

11-29 13:33:08 886483e21a Disable testConcurrentCancellationOnConnectionClose test

Karol Sobczak

[x] all checked

11-02 10:11:12 8c5c5c2d5b Cover wider range of values in testDecimalBackedByFixedLenByteArray

11-02 11:12:43 1e16b96aec Fix formatting of INSERT

11-02 11:12:43 f7d71c1e87 Fix formatting of DROP TABLE

11-02 13:20:29 9f202ea933 Benchmark different join build sizes

11-03 11:29:26 50f18a5235 Speed up avg by using divideRoundUp vs BigDecimal

11-04 10:15:38 bd41fbd823 Add order by to tpc-ds query 24

11-04 21:32:42 d1e35c1b94 Perform one more dynamic partition pruning check

11-05 10:49:22 0fc44944a7 Store native prefilledValue in ColumnMapping

11-05 10:49:22 4978cd6b18 Extract columnMappings argument

11-05 10:49:22 aeb753aed2 Run dynamic partition pruning for split locally on a worker node

11-08 10:44:44 488a17f5c0 Improve debug info in flaky testDynamicFilters

11-08 10:51:06 320f82e2de Allow getting metrics after the operator is closed

11-08 11:11:00 9d3cde9856 Do not add sources when creating SqlTaskExecution

11-09 16:23:17 8708cd7f6f Create TaskStatus before stats when reporting taskInfo to coordinator

11-15 23:16:38 b7b515b864 Fix split accounting in HiveSplitSource when split is pruned

11-17 15:49:41 5697349699 Increase split loader concurrency to 64

11-18 11:01:14 017d750db9 Optimize getPositionsSizeInBytes for fixed width blocks

11-18 11:01:14 e752e961a4 Avoid branches in DictionaryBlock

11-22 15:03:28 0e4e4228d9 Use GroupByHash#createGroupByHash with Session argument

11-22 16:58:29 7a719f3bb3 Match qualified table name in searchScanFilterAndProjectOperatorStats

11-22 16:58:29 bbbb42ac50 Fix formatting

11-22 16:58:44 51023d8281 Restore dynamic partition pruning assertions

11-22 21:23:18 19ad5fadf8 Update dynamic filter ids after un-aliasing

11-23 16:15:18 fab5eef506 Use smaller load factors for small join hash arrays

11-24 15:18:54 80b8ebb37a Report read time and nanos for ORC tail reads

11-25 21:36:29 9a824be1b3 Implement TDigestHistogram#toString

11-25 21:36:29 b11a2417d0 Add connector metrics to EXPLAIN ANALYZE verbose output

11-25 21:36:29 b47e6b8388 Don't allocate a new object when constructing an empty Metrics

11-26 17:30:07 297f1f1050 Move FeatureConfig as top package class

11-29 21:19:33 ee80d5ebb1 Restore withPlanOptimizersProvider

11-30 11:32:20 5807657491 Fix ordering of reads in HdfsParquetDataSource#planRead

Martin Traverso

[ ] all checked

11-04 22:37:29 06d7345447 Improve SortedPositionLinks performance

11-04 22:37:29 4b253dd2e7 Make stateless helper methods static in SortedPositionLinks

11-04 22:37:29 6c20a1af15 Add test to verify BenchmarkInequalityJoin works

11-04 22:37:29 816596be8c Remove size() method from PositionLinks

11-04 22:37:29 a7162547ff Make LocalQueryRunner initial transaction autocommit

11-05 00:08:39 02f5c7e9c2 Set standard error duration for task cleanup requests

11-05 00:08:39 12b3efca13 Accept Executor interface in StageStateMachine

11-05 00:08:39 187e7f62c2 Refactor HttpRemoteTask

11-05 00:08:39 374f9e1df6 Remove mergable check from PlanNodeStats

11-05 00:08:39 3bbb5d3fd1 Ignore task abort request failure if the task is finished

11-05 00:08:39 46984e14a0 Decrease visibility of scheduleRequestIfNecessary

11-05 00:08:39 8a5ad97f16 Fail with transport exception on results abort failure

11-05 00:08:39 92387dae34 Check response status of the abort task results request

11-05 00:08:39 a7e76646ba Reduce testTargetMaxFileSize memory footprint

11-05 00:08:39 b43419902b Decouple collocated join from grouped execution

11-05 00:08:39 c3f73b82e8 Preserve internal task status for tasks marked as failed

11-05 00:08:39 da2cd0aa56 Ensure cached query results are discarded

11-05 00:08:39 ea11bed617 Don't try to abort unreachable tasks

11-08 20:04:14 4ca945f469 Implement contains function for IP address

11-11 18:42:13 1b14269a72 Fix handling of null pages in getDomain for column index

11-11 18:42:13 275f9e38dd Make TupleDomainParquetPredicate#getDomain static

11-12 22:15:41 15355504af Reduce overhead of PipelineStatus construction

11-12 22:15:41 387c444ca3 Avoid DataSize.succinctBytes in operator summaries

11-12 22:15:41 43704ae4ca Fix incorrect handling of System.nanoTime() in DriverContext

11-12 22:15:41 95bb858baf Avoid unnecessary intermediate collections in PipelineContext

11-12 22:15:41 a748831f17 Batch merge running operator stats in PipelineContext

11-12 22:15:41 c9c711e200 Opportunistically reuse instance in OperatorStats#summarize()

11-12 22:15:41 cfd0c247e8 Avoid intermediate collection creation in TaskStats creation

11-12 22:15:41 d676634b57 Remove redundant traversal of OperatorStats

11-12 22:15:41 e703ddd082 Avoid redundant copies in PipelineStats#summarize

11-12 22:15:41 f54f076907 Avoid redundant copies in TaskStats#summarize

11-16 12:21:56 1c23c69766 Add syntax for querying tables as if it were a specific time or version

11-17 14:03:46 5f795479a6 Detect no nulls selected in RowBlock#copyPositions

11-17 14:03:46 723ea82ed8 Use ColumnarRow#mayHaveNull() in ReaderProjectionsAdapter

11-17 14:03:46 764ba1e8d1 Add ColumnarRow#mayHaveNull()

11-17 14:03:46 c4e8a8231b Use ColumnarRow#mayHaveNull() in HiveUpdatablePageSource#deleteRows

11-17 14:03:46 d1a5d2cdb4 Improve ColumnarRow dictionary block handling

11-17 14:03:46 d1d741e364 Use ColumnarRow#mayHaveNull() in hive StructCoercer

11-18 22:08:48 08b1097770 Simplify negative byte check in getShortDecimalValue

11-18 22:08:48 8d233977fd Fix reading fixed_len_byte_array of length 9-16 in parquet

11-19 11:55:44 e656ec4632 Improve performance when constructing QueryId instance

11-20 11:05:54 4605d482ec Fix iceberg build

11-23 01:29:30 d90c1b7932 fix code style warning

11-23 01:29:30 f02595074a Fix Elastic Cloud Instance

Piotr Findeisen

[ ] all checked

11-02 12:23:48 16dfce0a60 Bump Iceberg version to 0.12.0

11-02 15:39:40 deaff227de Rename hive.dynamic-filtering-probe-blocking-timeout config

11-03 13:57:54 0bbb73cde4 Predicate pushdown for Paruqet int64 timestamps

11-03 13:57:54 ff2b13fdf4 Pass ColumnDescriptor through TupleDomainParquetPredicate

11-03 14:03:51 2e9c40e663 Support ORC Iceberg boolean statistics

11-04 10:18:07 aaa54e059c Allow disabling of Iceberg table statistics

11-04 15:20:01 439d386e76 Repartition data when writing to Iceberg table

11-04 15:20:01 57a144fc79 Consolidate Iceberg temporal transformations

11-04 15:20:01 650ebc5b16 Remove unused Iceberg partitioning provider

11-04 15:20:01 863da2b2d3 Add value transform to Iceberg ColumnTransform

11-04 15:20:01 9e7e15b29b Construct reused hash object for Iceberg bucketing

11-04 15:20:01 b4c10be64e Inline or rename misused variable assignment

11-04 15:20:01 c631ce24bf Simplify test queries counting files

11-04 15:20:01 efa088e2ec Consolidate ColumnTransform definition

11-04 15:20:01 f56342c0b4 Fix typo

11-04 15:20:01 f709aae440 Simplify Iceberg bucket transform definition

11-04 15:23:01 d10cb876f1 Rename rule consuming preferred write partitioning

11-08 13:14:07 1d771ee3db Speed up translation of IN / NOT IN to tuple domain

11-08 13:14:07 38ac9ddc2d Remove static import of TupleDomain.withColumnDomains

11-08 13:14:07 815c0d3162 Improve tests for IN, NOT IN domain translation

11-08 13:14:07 8e67fa4611 Import Arrays.asList statically

11-08 13:14:07 a5c6dadbe0 Add assertPredicateTranslates with remaining expression

11-09 10:02:14 65b7d17a1f Extract getSchemaPath in FileHiveMetastore

11-09 10:02:14 68cd03ac31 Use an enum for schema types in FileHiveMetastore

11-09 10:02:14 91920472ae Inline null check in FileHiveMetastore constructor

11-09 10:02:14 ae48b3f8d4 Extract file names as constants in FileHiveMetastore

11-09 10:02:14 f36b89404f Move FileHiveMetastore path getters near end of file

11-09 10:02:14 ffac206e17 Replace deprecated function in TestCreateDropSchema

11-09 13:07:19 ba77719cc5 Fix raw types use in Metrics

11-11 22:13:04 676aee45d9 Remove invalid test assumption and comment

11-11 22:13:04 8c6b9508b0 Move @DataProvider under test method

11-11 22:13:04 9b40ead952 Add stats-based writer partitioning for identity-partitioned Iceberg table

11-11 22:13:04 dd286ed845 Extract source relation and add Session parameter to test helper

11-13 11:24:49 a836e7c223 Declare required tables in AbstractTestJoinQueries

11-22 11:35:38 304b99f8b1 Test partition scan limit for multi-column partitioning

11-22 11:35:38 4a39c41df7 Inline test method

11-22 12:28:37 16be3282fd Inject type analyzer into SqlQueryExecution instead of creating it

11-22 12:28:37 a0fb364612 Extract LayoutConstraintEvaluator from PushPredicateIntoTableScan

11-22 12:28:37 c973251b32 Filter out splits that do not match predicates not expressible by tuple domain

11-22 13:17:17 0682db3b20 Make TypedSet.add return a boolean

11-22 13:17:17 0f78fa9cda Use boolean return from TypedSet.add instead of TypedSet.contains

11-22 13:17:17 131f91b04e Add explicit int/long cast in TypedSet

11-22 13:17:17 2fe933f693 Rename blockBuilder parameter in TypedSet to elementBlock

11-22 13:17:17 3f4dabaff1 Add javadoc for TypedSet

11-22 13:17:17 4fa5116bc6 Return early from TypedSet.add when attempting to add a second null

11-22 13:17:17 6d401c3c91 Make TypedSet constructor private

11-22 13:17:17 dbe03a7b22 Rename factory function for creating unbounded TypedSets

11-22 13:27:24 763c77e6e9 Support reading parquet int64 timestamp as bigint

11-22 13:27:24 92f2452434 Renamed utcMillis to epochMillis in Int64TimestampMillisColumnReader

11-22 13:27:24 f27d4ebfe9 Refactored TestTimestamp by adding new test-function for reading with different types

11-22 14:56:45 254bacdd6f Remove redundant test case skipping for SQL Server

11-23 10:08:00 0f3b4ed45e Use fast path in array_except when the right-hand array is empty

11-23 10:08:00 5ea20df5fc Fix expected size of result array in array_except

11-23 10:08:00 6ab78e642f Use more descriptive variable names in MapFromEntriesFunction

11-23 10:08:00 80716575eb Use more descriptive variable names in MultimapFromEntriesFunction

11-23 10:08:00 c68bda7f87 Rename variables in MapToMapCast

11-23 10:08:00 d224e0f651 Don't do extra work in array_union

11-23 10:08:00 ef64e0516c Use just one BlockBuilder to construct result in array_distinct

11-23 10:41:21 028172153b Convert discrete domain to Iceberg IN expression

11-23 10:41:21 646591bdb6 Remove redundant cast to SortedRangeSet

11-23 10:45:11 88ef2caf7b Add Iceberg ORC timestamp stats implementation using ms precision

11-23 16:22:35 e0a04969c1 Remove redundant flexible assertions

11-24 12:55:03 35c4588a3c Document transactions support in Hive connector

11-24 17:25:23 9c1e32b2ab Update TPCH plugin to normalize schema name

11-24 17:26:35 ec62b27b43 Remove probably obsolete @Flaky annotation

11-24 17:39:31 ea633f988f Consistently reject empty schema location

11-24 20:17:07 302d9424f5 Run testIncorrectIcebergFileSizes for ORC too

11-24 20:17:07 83d7d12b60 Fix file_size_in_bytes in Iceberg manifest for ORC

11-25 12:15:49 d66b0f9f0f Supplement defensive copying in HiveTableHandle constructor

11-25 12:15:49 d99d2a6734 Remove redundant Optional use from HiveTableHandle.constraintColumns

11-25 12:15:49 e5533812c3 Remove redundant Optional use from HiveTableHandle.projectedColumns

11-25 14:31:47 8274da8bc6 Allow ignoring schema location cleanup

11-25 20:45:42 ef5084c8b2 Avoid dynamic filter current predicate computation when not used

11-26 17:26:58 28d4fcd66f Revert "Only delete non-empty directories when dropping Hive schemas"

11-26 17:26:58 7c031d4a1b Revert "Allow ignoring schema location cleanup"

11-26 22:15:34 884e450d29 Cleanup javadoc tags

11-26 22:37:30 5c98059b1f Upgrade Error Prone to 2.10.0

11-26 22:54:28 530c2c993b Report redundant exclusions in assertAllMethodsOverridden

11-26 22:54:28 84ee46097a Remove redundant method exclusion from test

11-26 22:54:28 c6d6a21d51 Implement new methods in AllowAllSystemAccessControl

11-29 09:16:50 d5b100a541 Access test resources with proper validation

Pratham

[x] all checked

11-08 21:52:36 2c3775773c Add info on query-partition-filter to Hive

11-15 04:05:20 1a7d82e952 Fix rollback_to_snapshot failure caused by stale metadata

11-20 01:27:12 6055c607da Add dereference pushdown section

11-20 01:30:50 21f9c83d23 Fix handling of ORC projection layouts where field has been renamed

11-20 01:30:50 5fc2d0d067 Implement dereference pushdown for the Iceberg connector

11-20 01:30:50 617808f3a4 Update ReaderProjectionsAdapter parameters

11-20 01:30:50 6cdce6c199 Refactor Iceberg ColumnIdentity#children to be mapped by field id

11-20 01:30:50 a93bbe3cbd Test Iceberg tables with ambiguous schemas

11-20 01:30:50 e3a5842407 Generalize OrcReader's ProjectLayout

11-22 23:28:18 4563866ddc Add clarifying comment

11-29 16:35:42 437230b777 Update table name in test

Praveen Krishna

[x] all checked

11-10 07:06:37 1250def23a Remove redundant check on bloom filter fpp

11-10 07:06:37 1f781dbd51 Remove exclusion for HashtableContains in ErrorProne compiler

11-10 07:06:37 9c06e33920 Fix OrcWriterOptions mapping from Hive TableProperties

11-19 07:29:09 89e7c9bff3 Avoid creating splits for empty files in Hive

11-19 07:30:04 44c385478c Use Classloader safe implementation of RecordSetProvider for Phoenix

11-19 07:30:04 85fd6b6245 Bump docker images version to 52

11-23 13:43:02 bead7553e0 Add docs for Kerberos delegation in JDBC client

11-26 06:58:10 040fa595cf Extract configuration to HydraIdentityProvider

11-26 06:58:10 430b095ee6 Add Product Tests for OAuth2 with secure proxy

11-26 06:58:10 a1b5a30a23 Add Product Tests for OAuth2 with HTTP Proxy

11-26 06:58:10 ff0d93b35c Remove redundant dependencies from EnvSinglenodeOauth2

Yuya Ebihara

[x] all checked

11-04 13:41:29 83571b67b1 Set SMP as 1 in scylladb container

11-05 01:01:52 f0bf9e9452 Fix a small typo

11-05 01:16:09 338425db50 Implement TRUNCATE TABLE in base JDBC connector

11-05 01:16:09 9acc19b251 Support TRUNCATE TABLE statement

11-05 06:11:31 c1ab1ddd96 Support user defined type in Cassandra

11-09 11:15:15 5cda4cdaf7 Do not find tables in information_schema in BigQuery

11-10 04:59:00 7e8cc84d03 Remove duplicate licenses

11-10 13:53:44 6d2458a6af Support reading BIGNUMERIC type in BigQuery

11-11 08:30:08 9f915ca4c2 Support reading empty numeric value as NULL in Elasticsearch

11-15 10:40:25 884bc09c96 Use ifPresentOrElse in BigQueryMetadata

11-15 10:40:25 a0d3dc2587 Ignore disappeared datasets during listing tables in BigQuery

11-16 10:22:16 4db9a48b8e Populate TPCH tables in SqlServerQueryRunner.main method

11-16 10:22:16 51c42936bf Use MSSQLServerContainer.acceptLicense in tests

11-16 10:22:16 e448ebaaaf Add smoke test to SQL Server connector with 2017 and 2019 image

11-19 10:04:10 14a7e170ae Disable predicates pushdown to ClickHouse FLOAT type

11-19 10:04:10 4df037a909 Disable predicates pushdown to MemSQL REAL type

11-19 10:04:10 52deac3315 Remove unused method in MySQL mapping test

11-19 10:04:10 75878e0dbe Disable predicates pushdown to MySQL REAL type

11-26 08:37:04 24826104fa Extract BigQuery view materialization cache to separate class

11-26 08:37:04 2f256454fa Refactor BigQuery to allow non-static credential suppliers

kasiafi

[ ] all checked

11-16 10:14:18 c63e06f2fb Support accumulator state copying

Łukasz Osipiuk

[x] all checked

11-03 12:31:49 0aaa6f4ec7 Use Rule to prune unreferenced source columns for TableExecuteNode

11-04 11:36:09 23b1c54b29 Fix flaky TestIcebergOrcConnectorTest.testAllAvailableTypes

11-04 12:45:46 4084368623 Add javadoc for DeterminePreferredWritePartitioning

11-05 10:07:50 197834535f Drop unused port mappings

11-05 10:07:50 5f8272e5b7 Drop unneded String.format

11-05 10:07:50 e9cd44bfe7 Add endpoint debug logs on HiveHadoop startup

11-05 15:51:45 43e583667e Tests Trino with Spark-created Iceberg V2 tables

11-05 15:51:45 7432b01fa6 Bump docker images version to 51

11-08 09:07:38 b40f5f6505 Add docs on running checkstyle locally

11-08 11:02:49 6eec6244dd Correct what tables optimize can be used with

11-08 21:05:13 3935f5fd84 Make partition overwrite assertion use exact rows

11-08 21:05:13 f7c87f8718 Fix partition overwrite assertion

11-10 13:52:12 19076b6a3e Add test for default session properties in transaction

11-10 13:52:12 66948b30d6 Inject AccessControl to SessionPropertyDefaults

11-10 13:52:12 7053d72d6e Remove redundant argument in SessionPropertyManager.validateCatalogSessionProperty

11-10 13:52:12 a671947f8c Allow session properties override once in transaction

11-10 13:52:12 e173be4a4d Add allow all access control manager for tests

11-10 15:01:54 56f77eefcf Add missing method from interface

11-18 10:24:39 244b4d0b32 Upgrade trino hadoop-apache to 3.2.0-16

11-18 21:49:38 02ac19e9fe Handle null statistics in Iceberg Dynamic Filtering

11-19 13:04:28 92d7eeaa7e Account memory for OrcDeletedRows

11-19 13:05:01 f5bff8e96a Add redirections scaffolding to HiveMetadata

11-20 21:52:22 a89d7c18af Only delete non-empty directories when dropping Hive schemas

11-22 11:39:22 61c220badd Construct RLE block with proper types for Parquet with missing struct fields

11-23 09:03:45 3dc001950f Correct S3 credentials provider property

11-23 11:11:26 cd20327b2d Remove obsolete comment

11-26 11:48:23 c94f3b9f82 Update memory usage for DeletedRows as it is loaded

11-26 11:50:17 ef6936017b Clarify javadoc

release-notes
opened by martint 56
Release notes for 341
Dain Sundstrom

[x] all checked

08-09 16:24:49 a9a51b9369 Cleanup Prometheus connector

08-09 16:24:49 ba45061d37 Return TIMESTAMP WITH TIME ZONE from Prometheus connector

08-10 17:46:36 91dbe5149a Return TIMESTAMP WITH TIME ZONE from Cassandra connector

08-12 18:43:23 53bafb41da Fix timestamp semantics

08-12 23:18:57 6053968735 Remove unused Raptor property

08-13 19:05:57 6b6da3dcb3 Only request client certificate when using certificate authentication

08-13 21:24:35 eec2ec4000 Add missing cast in CursorProcessorCompiler

08-13 22:02:38 671f73de4c Update BigQuery timestamp parsing to new semantics

08-14 13:38:27 3bb14d8679 Addressed feedback from Dain.

08-14 13:38:27 7bdb74cc7c Addressed second round of review comments, mainly added xml escaping and changing cache expiration property to reflect Duration type.

08-14 13:38:27 ba9b0f9485 Add salesforce authenticator.

08-18 12:42:19 3180df5443 Add copyPositions and getColumns utility methods to Page

08-18 12:42:19 731fc3b69b Prefer builtin Page methods that avoid Block[] copies

David Phillips

[ ] all checked

08-08 18:01:42 e60ef02a12 Return TIMESTAMP WITH TIME ZONE from JMX connector

08-08 19:45:06 a787b5b677 Return TIMESTAMP WITH TIME ZONE from Local File connector

08-09 11:55:20 8cbf5aa411 Fix documentation versions dropdown

08-10 11:58:56 f8273c9b16 Remove support for Hive bucketing on timestamp

08-11 07:32:20 ac585502ab Add reverse function for varbinary

08-12 13:06:54 f9c6f8a126 Remove outdated comments in LdapSslSocketFactory

08-13 10:36:29 f1ea630277 Correct limitation

08-13 10:37:33 8775ad23d1 Add history and troubleshooting section

08-13 10:38:09 d5c2711d5a Fix ordering of LIMIT in documentation

08-13 10:40:14 0df358037e Update Config connection-url

08-13 11:26:06 6abb38d14a Add schema and table access rules documentation

08-13 14:07:42 512cd05596 Edit connection url

08-13 15:21:23 21c383bf77 Update docker build scripts to use pull flag

08-13 15:21:23 e3cc21349c Switch from centos jdk to zulu

08-13 18:06:38 5fe83795f1 Fix Javadoc for ShortTimestampWithTimeZoneType

08-17 08:05:13 217ae3bd51 Add support for Iceberg metadata delete

08-17 12:18:16 c2134e8a92 Support Iceberg table and column statistics

08-17 12:18:16 d484044a1b Extract class Partition from PartitionTable

08-18 14:34:42 4d1ad4f97d Update pom.xml

08-18 14:34:42 e931d8acc5 Upgrade Zookeeper to 3.4.14 version

08-19 10:31:18 54343ff3d9 Demonstrate Spark/Iceberg and Presto/Iceberg compatibility

08-19 11:25:37 b0c5ff2450 Ignore external errors in HiveMetadata::listTableColumns

08-19 11:58:46 4bafe79729 Add missing time unit constants

08-19 11:58:46 594ce1d220 Remove outdated JSON formats from SqlTimestamp classes

08-19 15:49:29 ba49f94944 Make Iceberg smoke tests inmore consistent and less verbose

08-19 22:21:15 ca80ca7eee Support the TIME type in the Iceberg connector

08-20 08:53:20 4713d09fa0 Implement PrestoS3FileSystem#listFiles for direct recursive listings

08-20 08:55:51 1e9650b708 Limit size of PagesIndex

08-20 10:38:43 8199a6ed68 Add authentication info and reword

08-20 10:40:36 39f7e08c0a Document CTAS functionality for transactional Hive tables

08-21 08:06:46 f07d10e1d1 Test Spark/Iceberg compatibility for structured columns

08-24 12:01:47 ce995bf0f1 Use separate page for file based system access control

08-24 13:57:20 94b4074c45 Use grey theme for documentation

08-26 09:31:46 026cd58bea Add Spark/Iceberg compatibility test for nested data

08-27 10:54:41 d6bf73b2a7 add blank line

08-27 16:13:12 975bd661af Refactor HiveMetastore API and Implementations

08-28 14:28:37 1dfef5c7b1 Preserve original exception on JSON parse failure

08-28 14:28:37 340f7310bc Move JSON type construction to plugin toolkit

08-28 14:28:37 5c80bffb0e Remove unused method from JsonFunctions

08-28 21:39:37 07b869feac Minor cleanup in ParquetWriters

08-28 21:39:37 34369115ad Return int from SqlTimestamp.getPicosOfMicros()

08-28 21:39:37 3d0af3bb55 Add temporal type constants and canonicalize

08-28 21:39:37 42f47da1d6 Use correct type to write timestamp block

08-28 21:39:37 54eea94fd7 Use microsecond timestamps in Iceberg

08-28 21:39:37 834c2862b0 Inline type conversion

08-28 21:39:37 a6ababbe0c Remove Iceberg hour bucketing on time type

08-28 21:39:37 ce4a007a4d Remove unused toHiveType method

08-28 21:39:37 ce6cb5f8e2 Fix Iceberg test name

08-28 21:39:37 d52828f4c5 Improve ORC timestamp support

08-28 21:39:37 e77642df42 Add import for OrcTypeKind

08-29 14:25:36 4020facb50 Update testing PostgreSQL Server to latest 12.4

09-01 14:55:02 4f1b0080b2 Remove unused Azure tests

09-01 14:55:02 a82ca74a2d Rename S3 secret names to use uppercase

09-01 14:55:02 abdc5f2432 Add GitHub workflow for Azure tests

09-01 14:55:02 d279f2d9fa Only run CI on push to master

09-02 10:55:30 ce921ba059 Allow custom keystore and truststore types

09-02 16:34:13 5c08e41add Switch to picocli

09-02 16:34:13 8e37d42b82 Remove unused startup timeout option

09-02 16:34:13 a4ed820343 Convert verifier to single command

09-02 16:34:13 dd2a77b653 Remove unused presto-testing-server-launcher

Grzegorz Kokosiński

[x] all checked

08-18 02:09:51 10fa05b8a6 Allow using temporary staging path for writing sorted files

08-18 02:09:51 8b5190cbb4 Document hive temporary staging directory configs

08-19 03:19:34 1568436c7d Allow to configure refresh period with environment variables

08-19 03:44:36 a785066fb1 Do not use presto-main in product tests

08-20 05:50:16 06fea455fd Do not verify tempto convention test class names

08-20 05:50:16 31357ee3f5 Introduce testng FlakyTestRetryAnalyzer

08-20 05:50:16 a0ea19723b Limit the method visibility

08-20 05:50:16 ae59533e92 Do not report tempto methods as missing @Test

08-20 05:50:16 b1bfe9e815 Mark flaky Hive product tests

08-20 05:50:16 f7fc295104 Extract presto-testng-services module

08-20 13:17:51 22e4727ff3 Support overriding Object methods in tests

08-20 23:53:34 966a650c84 Respect GRANT and REVOKE in CachingHiveMetastore

08-20 23:53:34 fe89b9c52b Fix REVOKE in FileHiveMetastore

08-23 11:59:47 1114d82b33 Mark TestHiveTransactionalTable::testReadFullAcidBucketed as flaky

08-25 11:27:48 e428f603d4 Test connector when running join with empty build side

08-26 02:27:20 90fdc3220a Allow retrying opening connection in Oracle

08-26 02:27:20 b73e3519c3 Use DriverConnectionFactory in TestingOracleServer

08-26 04:50:18 50dc92aa9e Support implementing interface in tests

08-26 04:50:18 51964b02e7 Handle io.prestosql.tempto.testmarkers interfaces

08-26 05:17:52 08ee3a885e Make testJoinWithEmptySides parametric

08-26 12:12:51 aa6117c38b Move noJoinReordering() to AbstractTestQueryFramework

08-31 05:57:01 2682f7786e Possibility to lowercase/uppercase matched user name

08-31 05:57:01 2d8a2bd8e8 Configure Jackson to parse enums from lowercase strings

08-31 11:08:30 b7959d41f3 Don't implement deprecated ConnectorPageSourceProvider.createPageSource

08-31 12:10:04 e1f8cc14e7 Remove reorder_joins session property

08-31 13:24:15 f16b97dd6b Log Presto version on startup

08-31 13:26:34 2d6865be1e Put writing and building docs under Development section

08-31 13:26:34 8a37910b75 Update development practices

08-31 13:26:34 9a56d45cc5 Move Development section to separate file

08-31 13:29:01 0bf49d9172 Do not ignore failures in LogTestDurationListener

08-31 13:29:01 677bf7c6e3 Enable LogTestDurationListener by default in GHA

09-02 03:31:35 c336e9a364 Handle upper case literal in where for system.jdbc.tables

09-02 03:36:01 46f8f1b4fc Allow to use cluster default role in hive S3 Security Mapping

Karol Sobczak

[x] all checked

08-17 04:10:17 ab8e4b752f Add physicalInputDataSize to Statement/Stage stats

08-17 08:11:20 aaf84274ca Relax task locking in SourcePartitionedScheduler

08-17 08:11:20 d03146f035 Make BroadcastOutputBuffer#isOverutilized aggressive

08-20 03:59:27 9d26aead03 Report dynamic filtering stats in QueryStats

08-20 06:35:53 053029d0ef Make sure lazy dynamic filters are blocked initally

08-20 06:35:53 39089fd5a6 Use forEach directly

08-20 06:35:53 71d8cc6770 Improve extraction of lazy dynamic filters

08-20 06:35:53 80e1bcc2e3 Use explicit field for lazy dynamic filter futures

08-20 06:35:53 d01b560e82 Simplify LocalDynamicFilterConsumer

08-20 06:35:53 f514f49f94 Remove "num" from dynamic filters stat fields

08-20 06:35:53 fe4bf5fc61 Introduce DynamicFilterService.DynamicFilterContext

08-21 03:58:46 6f824d2dcb Add memsql integration smoke tests

08-24 02:35:48 1fced9e323 Short circuit lazy dynamic filters on Domain.all

08-24 02:35:48 99ce43e965 Don't set future in synchronized context

08-24 06:00:30 8892e05aa2 Reverse if condition

08-24 06:00:30 b3ad792474 Remove unused argument

08-24 13:03:09 1172c307f2 Test for removed dynamic filters explicitly

08-24 13:03:09 36ba15348f Fix formatting

08-24 13:03:09 e989ff7e91 Restrict method access

08-24 13:04:37 18facbbdfd Fix physicalInputReadTime display in UI

08-25 11:48:10 4f3b75ba41 Rename nextTaskInfoVersion to nextTaskStatusVersion

08-25 11:51:23 817f25474f Propagate 'all' domain explicitly

08-25 11:51:23 82cdb146a1 Use throws Exception instead of multiple exceptions

08-26 03:38:54 84681181b5 Remove unused method

08-26 03:38:54 e515eec1f5 Convert field to local variable

08-26 05:29:02 214c08fbad Allow blocking page source until dynamic filters are ready

08-26 05:29:02 7fa21f6177 Support lazy dynamic filtering at memory connector

08-26 05:29:02 ec07bc2cc6 Do not enable dynamic filtering explicitly in TestMemorySmoke

08-26 06:31:41 391f98bb48 Fix unauthorized error by the benchmark driver

08-26 12:02:10 ede1b5f759 Deprecate ConnectorPageSourceProvider#createPageSource method

08-27 01:54:09 dd1b413794 Dynamic filtering for semi-joins: planner

08-27 01:55:43 80aa4354a8 Put each arg in newline

08-31 08:00:15 96708b5bfd Fix race condition in unregisterDynamicFilteringQuery listener

09-01 03:28:20 3cc71f4557 Fix support for mapping of dynamic filter to multiple columns

09-01 03:28:20 4971ee1d1f Simplify stream

09-01 03:28:20 54d49a46b7 Fix access control of methods

09-01 03:28:20 598348d80b Make fields private

09-01 03:28:20 e47b870bde Improve performance of obtaining same current dynamic filter

09-02 06:00:07 34ded15a8e Remove unused method

Martin Traverso

[x] all checked

08-10 23:38:17 19811d3d58 Implement variable-precision time type

08-10 23:38:17 1b9938891d Disable TIME type tests for older driver versions

08-10 23:38:17 31ba61d169 Rename Timestamps to DateTimes

08-11 21:21:53 bdbce6f881 Remove unused classes

08-12 12:35:45 5aad0c24e1 Add pinot host mapper interface

08-12 12:35:45 6819ff2f27 Add TestingPinotCluster

08-12 12:35:45 8f64f2a43f Move TestUtils.toProperties to TestingKafka

08-12 12:35:45 a6b20985ca Remove unused ObjectMapper from PinotPageSourceProvider

08-12 12:35:45 aa1f10d3ba Add network alias for TestingKafka

08-12 12:35:45 efbd683da6 Move TestingKafka to presto-testing-kafka module

08-12 13:31:17 ddee904145 Deduplicate ValuesNode output symbols

08-13 13:55:59 35cb998ab6 Fix functions in pinot passthrough queries

08-13 19:28:53 1f3ca379c6 Add invocation count to optimizer rule stats

08-13 19:28:53 f3d9bcd055 Add system table to expose optimizer rule stats

08-14 09:41:28 5106a72fb3 Add support for real types

08-14 09:41:28 a5d9c1e871 Add support for Integer types in pinot

08-14 17:16:13 fb65d3ec59 Remove misplaced tests

08-14 19:14:48 c2f21c6dc9 Fix incorrect description

08-15 13:24:16 7d5c31700b Fix failure for TIME and TIMESTAMP subtraction with negative result

08-15 13:24:16 f90d76519e Fix broken time type tests

08-18 11:17:10 2f7c3e6b1f Fix extract timezone hour/minute for timestamp with time zone

08-18 19:59:59 c77abc3d0b Remove redundant TIME tests

08-19 11:12:45 093037b9c9 Respect inherited symbol mapping when reallocating symbols

08-19 11:12:45 6daaf8246b Handle correlated subqueries in recursive with query

08-20 15:03:36 05547eb2b4 Fix AT TIME ZONE for TIMESTAMP

08-24 12:50:18 356e8bb230 Fix broker queries that use avg

08-24 12:50:18 dec5d498b5 Fix pinot select count(*) queries

08-24 12:50:18 fe70736fc5 Fix column mapping in pinot broker queries

08-24 22:09:17 0dfd4ce26c Cleanup unused dependencies

08-24 22:09:17 2dbdea2759 Add Limit to Pinot Segment Queries

08-24 22:09:17 384745d782 Remove commented out code in ArrayDecoder

08-24 22:09:17 3f05643504 Remove unnecessary logging

08-24 22:09:17 7eb206cef4 Remove Unused Code in PinotQueryBuilder

08-24 22:09:17 d0e4e04cb1 Remove PinotConfig members

08-25 11:54:41 d5577c680d Add human_readable timestamp function

08-31 14:09:31 d26f18cb12 Add documentation for system table optimizer_rule_stats

08-31 18:46:13 88116a4a3f Support Materialized Views

09-01 16:35:58 23496924b4 Fix IndexOutOfBounds non-nested-loop joins with no columns on build side

09-01 16:35:58 e7199dba8e Fix IndexOutOfBounds when spilling lookup join with no build-side columns

09-02 09:39:30 94746169af Implement variable precision time with time zone

09-02 18:16:22 1c858f8696 Remove dedicated encoding for timestamp with precision <= 3

09-02 18:16:22 7771f046f1 Replace usages of TimestampType.TIMESTAMP with TIMESTAMP_MILLIS

Piotr Findeisen

[x] all checked

08-17 12:26:27 38ecc954dc Avoid using shaded classes

08-17 12:26:27 bdf22d9a58 Fix rawtype usage

08-18 02:47:53 0a6aadc525 Add QueryAssert#returnsEmptyResult

08-18 02:47:53 473cc432fe Move pushdown assertion to QueryAssert

08-18 02:47:53 7722ce8ce5 Add JdbcClient method for getting ColumnMapping

08-18 02:47:53 9dd690892f Make assertAggregationPushedDown more generic

08-18 02:47:53 a22306bb81 Add diagnostic property to disable pushdown to connector

08-18 02:47:53 bdd39aa747 Change parameter order in QueryAssert.query

08-18 02:47:53 d28bc51a77 Eliminate filter above JDBC table scan

08-18 02:47:53 e6c5189796 Convert if into switch

08-18 02:47:53 fa59c03ee2 Provide QueryAssert in AbstractTestQueryFramework

08-19 14:27:41 7944a87e90 Add a test case for parse_datetime

08-20 04:11:29 5956ef7210 Show default values of benchmark driver options

08-21 08:32:10 ccc934fd1b Send driver version even without matching pattern

08-21 09:15:26 03b48eeb12 Retain decimal attributes

08-21 09:15:26 8245658523 Inspect LogicalTypeAnnotation

08-21 09:23:51 1e69a5bfed Extend aggregation pushdown over predicate

08-21 09:23:51 3bd37bb435 Add simple test for aggregation and predicate pushdown

08-21 14:55:35 4cd650966a Require issue when marking test as flaky

08-24 04:33:24 5dc4eab88c Retry flaky tests on CI only by default

08-24 07:06:20 0fc8bdc886 Mark flaky Hive product tests

08-24 07:54:08 86e268d43e Fail test run when testng listener fails

08-24 07:54:08 b88aa1d18d Ignore tempto generated convention tests

08-24 22:43:06 477d99141c Report illegal nested directory path

08-25 02:28:52 d12c018aa6 Require identifying flakiness's exception

08-25 04:30:27 9751dde7c9 Mark flaky PostgreSQL test

08-25 04:51:52 9541762dc2 Fix logical merge conflict

08-25 13:54:39 6cb480f651 Implement JDBC ResultSet.getStatement

08-25 13:57:32 2ed404b7eb Add more aggregation pushdown test cases

08-26 00:08:47 31adff96ad Improve error reporting when verification fails

08-26 01:54:26 193872a247 Support aggregation pushdown in MySQL connector

08-26 01:54:26 5cd0e7d342 Add Pushdown section in MySQL document

08-26 01:58:38 01d37540c8 Remove unused omitTimestampPrecision field

08-26 02:41:29 26055ea44c Fix CONVERT_TO_VARCHAR with arrays

08-26 02:41:29 3a69f4ea3f Fx bytea[] array exclusion

08-26 02:41:29 8eb1522c22 Extract variable

08-26 04:10:13 43dc6a7075 Fix reading with filter transactional table after minor compaction

Praveen Krishna

[x] all checked

08-09 05:20:06 813ac895ad Fix error when delete by a decimal primary key column.

08-09 07:58:03 186fba65ae Support missingColumnsOnInsert in the Phoenix Connector.

08-14 01:18:33 15e6ea67ed Include instance size for computing TimestampStatistics#getRetainedBytes

08-14 01:18:33 654bb253b7 Add TimestampStatistics as a part of ColumnStatistics

08-14 01:18:33 f759b9837a Write Statistics for a Timestamp column in ORC writer

08-23 08:19:50 e83469c053 Add support for extra credentials in Presto BenchmarkDriver

08-29 05:45:55 ff14f56c23 Allow PrestoS3FileSystem to skip DeepArchive files

Yuya Ebihara

[x] all checked

08-09 17:56:04 0bf4a4140c Fix release note for version 340

08-10 07:03:35 512355af17 Upgrade Cassandra docker version to 2.2

08-10 07:03:35 e8edc8a884 Enable testDataMappingSmokeTest for Cassandra

08-10 07:03:35 ed72ce6aa2 Use constant ID for Cassandra CREATE TABLE

08-10 07:03:35 fcd5c23795 Rename id column to row_id in testDataMappingSmokeTest

08-11 07:25:43 1a01ba1ec3 Add orai18n for Oracle globalization support

08-12 05:26:09 6c23bb1ae7 Remove redundant condition check in LongOutputStreamV2

08-15 18:30:04 bc0c9dca28 Rename to OraclePoolConnectionFactory

08-25 07:24:59 45dc37d4b6 Increase AWS Glue get partition max results to 1000

09-01 17:31:03 ef190cc28b Fix punctuation in Prometheus documentation

Łukasz Osipiuk

[x] all checked

08-10 05:57:18 b030fb42fa Various small Phoenix Connector fixes.

08-10 10:02:07 1bd5a5a884 Generate reports dir automatically

08-11 04:55:43 020cbed5c2 Fix serializing row type with null field values

08-11 05:06:59 96df8f36be Configure Oracle UCP inactive connection timeout

08-11 13:37:01 b6b1727bcf Remove product test environment startup timeout

08-12 09:41:08 8ba991485c Fix legacy serialization of NULL values for ARRAY and MAP

08-14 06:57:30 9bc01164ad Update Rubix version to 0.3.16

08-19 02:16:46 6a32e81799 Override getCompletedBytes method in KafkaPageSink

08-19 02:16:46 791352f34a Change type of errorCount in Kafka Callback

08-20 01:41:05 746743999e Update hive-caching documentation for Rubix 0.3.16

08-21 04:09:31 0151032d68 Mark that filesystem is owned by Rubix in Hadoop Configuration

08-21 04:09:31 5ec7f78804 Postpone check if HDFS is used with caching

08-21 04:09:31 680c1c73a1 Extract CachingTestUtils

08-21 04:09:31 a5d79d867d Bump tempto to 181

08-22 22:38:42 3b5cfc7ec5 Set scope test for testng

08-24 09:55:25 c74b7536d9 Support jdbc-types-mapped-to-varchar in Oracle connector

08-25 00:49:50 73ee818507 Pushdown domains with many ranges in Oracle connector

08-25 00:49:50 caa67b85e1 Add Oracle pushdown tests

08-25 06:42:46 123ed5103b Product tests suite definitions as code

08-25 06:42:46 268fcd13f7 Debug failed environments

08-25 06:42:46 30910bfb78 Remove passing of environment settings using ENV

08-25 06:42:46 7b65299fb4 Remove product tests scripts

08-25 06:42:46 ed8beec72d Change reports dir to contain suite, config and environment name

08-26 15:00:36 1f3f481012 documentation for hive.metastore-timeout config

08-27 13:57:45 a74296d696 Allow SuiteConfig to extend/configure Environment

08-28 01:13:25 b59156dd01 Allow configuring all containers

08-28 12:05:45 6a01d2cc8a Fix scan limit in SqlQueryManager

08-29 04:17:20 04072c185f Rename SuiteConfig to EnvironmentConfig

08-29 04:17:20 3e0d89c942 Add ENV based environment config

08-29 04:17:20 6a1633fb04 Remove unnecessary qualifier

08-29 04:17:20 c77d0eaad2 Simplify environment configuration passing

08-29 04:17:20 e73645d8ba Simplify environment definitions

08-30 23:10:22 5a4e498e5f Update Failsafe to 2.4.0

09-01 01:37:22 24152c9c86 Add support for TopN to cost

09-01 06:43:38 5324649335 Update product tests docs

09-01 06:49:27 8783daa66c Update BigQuery dependencies to support HOURLY partitioning of tables

09-01 06:49:27 ae6c21b56c Add BigQuery smoke test for HOUR-ly partitioned table

09-01 06:49:27 eb59569d9f Redact bigquery.credentials-key config

release-notes
opened by martint 52
Release notes for 346
Dain Sundstrom

[x] all checked

10-28 17:03:59 8169736758 Add planning time to QueryStatistics

10-28 17:03:59 b09095e984 Add user groups to QueryContext

David Phillips

[ ] all checked

10-27 09:49:07 06cef37a71 Update READMEs for doc building changes

10-27 10:06:08 5a71959762 Push complex expression filters into Glue metastore

10-27 11:08:29 a805dbb56d Add AWS SDK client request metrics to GlueMetastoreStats

10-28 13:11:47 09f1ad2fe1 Refactor out unused var in presto-hive

10-28 13:14:27 51f3aa9b27 Document SSLVerification parameter of JDBC driver

10-29 09:10:49 fbfc0505db Add tests for filter by partitions in thrift hive metastore

10-29 09:12:30 584b343b67 Remove legacy array_agg implementation

10-29 09:12:30 b47dd8cc4c Remove legacy histogram implementation

10-29 09:12:30 ba03c9ff91 Sort defunct configs in FeaturesConfig

10-29 09:12:30 bc5cb5ec38 Remove legacy multimap_agg implementation

10-29 14:08:08 fc035e3cee Bump Alluxio version to 2.4.0

11-02 13:45:12 693073873f Use prefix specified by jmx.base-name when exporting DispatchManager MBean

11-02 13:45:12 8eba4800f6 Use proper name when unexporting ClusterMemoryPool MBean

11-03 12:35:15 0f7cf1f30f Remove unused method

11-03 12:35:15 3b010bf04f Add roundDiv overload in Timestamps

11-03 12:35:15 7cf9f39573 Change signature for HiveType#getType overload

11-03 12:35:15 a82ce334b6 Variable precision timestamp support for Hive write operations

11-03 12:35:15 b7107b90ce Handle variable precision timestamps in MaterializedResult

11-03 12:35:15 d4d7e530ad Construct session correctly when finishing stats collection

11-04 09:03:11 c1fd650b26 Restore null behavior for array_max and array_min

11-04 09:03:11 fb982c7a9d Restore null behavior for greatest and least

11-06 15:43:26 278f880e4b Use consistent NaN behavior for max functions

11-09 13:24:16 0673e9fd94 Remove Iceberg README.md

11-09 13:42:00 5c1750ea5a Iceberg connector support for materialized views

11-09 13:42:00 659a58c9fa Send storage table handle to finishRefreshMaterializedView

11-09 13:42:00 93229baa04 Materialized view connector API changes

11-09 13:42:00 a8f94f02eb Fix typo in 'assertInvalidStatemennt'

11-09 13:42:00 d9c1a19a1d Disallow 'CREATE OR REPLACE' and 'IF NOT EXISTS'...

11-09 16:14:45 42dbd583dc Add :noindex: to duplicated functions in the docs

11-09 16:14:45 a16e36ac3b Add sphinx-copybutton extension

11-09 16:14:45 f2bbd8ce05 Upgrade sphinx to 3.3.0

Grzegorz Kokosiński

[x] all checked

10-27 09:31:19 379f245839 Display schema in the presto-benchmark-driver result

10-28 10:00:00 304dce3620 Implement SSLVerification parameter to JDBC drive

11-02 13:53:44 20b27995d5 Create MockPlugin on top of MockConnector

11-02 13:53:44 2ef8248d1b Document semantic of grant and revoke

11-02 13:53:44 4e083b1318 Add SQL syntax for GRANT & REVOKE on schema

11-02 13:53:44 652697c679 Add test for grant and revoke on table

11-02 13:53:44 767da2bfcf Test parsing grant statement with TABLE keyword

11-03 21:11:31 56ec943eed Remove TestUninterruptably

Karol Sobczak

[ ] all checked

10-27 09:53:21 06c8ef8072 Implement node local dynamic bucket pruning

10-27 09:53:21 9535ef64a2 Add HiveColumnHandle#toMetastoreColumn

10-27 09:53:21 bc0bf3f67a Fix reading bucket version for Alluxio

10-28 09:46:09 f5e54e9a83 Use proper connector session in ConnectorNodePartitioningProvider

10-28 18:37:17 039dd5f593 Improve InternalHiveSplitFactory#checkBlocks error message

10-29 11:05:55 dbd076a8c9 Inline variable

10-30 20:26:41 fceff5d909 Update benchto to 0.12

11-03 10:47:28 b0398487c2 Remove unused variables in presto-parquet

Martin Traverso

[x] all checked

10-24 20:12:49 f79f1f54c8 Add support for query parameters in lambda expression body

10-27 21:28:20 d01807a1b7 Remove legacy enhanced-error-reporting option

10-27 21:30:30 576ad6be76 Fix validation of expressions in ORDER BY for DISTINCT queries

10-27 21:30:30 8589ba8859 Fix alias derivation for .* expression

10-27 21:59:33 629c1cd52f Add support for RANGE

10-27 22:47:35 72a2fe3447 Add tests for negative offsets for timestamp w/ tz

10-27 22:47:35 a8e3222342 Fix handling of negative offsets for time w/ tz

10-27 22:47:35 bf3c8c95f8 Organize methods

10-28 01:45:39 302340c57a Remove redundant session initalization

10-28 01:45:39 3b1080cb37 Make classes final

10-28 01:45:39 95773cd4f7 Add support for EXTRACT TIMEZONE_HOUR/MINUTE for time w/ tz

10-28 01:45:39 be5cb413f6 Make type checks for EXTRACT more precise

11-02 19:40:23 16da7770be Make construction of SqlTimestamp and SqlTimestampWithTimeZone stricter

11-02 19:40:23 26b1778ccd Add tests for SqlTimestamp.fromMillis

11-02 19:40:23 28332458d2 Inline method

11-02 19:40:23 345c26534d Fix rounding in cast from TIME to TIMESTAMP

11-02 19:40:23 8969c6e84f Rename newInstance to fromInstant

11-02 19:40:23 8a0ae46954 Fix roundDiv when factor is 1

11-02 19:40:23 ba4e01a5e6 Move time->timestamp cast tests to TestTime class

Piotr Findeisen

[ ] all checked

10-24 22:39:17 17020d4f58 Avoid DateTimeZone.toTimeZone

10-24 22:39:17 356850b627 Simplify conversion

10-24 22:39:17 5553f587b9 Avoid TimeZone.getTimeZone

10-24 22:39:17 98412f89a7 Produce a better message when test fails

10-24 22:39:17 a388b442c3 Split test method

10-26 11:07:28 7a1de1f1cf Allow Decimal values in String format to be extracted as numbers from ResultSet

10-27 09:35:28 d9988d301e Remove deprecated isCorrectlyPushedDown() method

10-28 09:48:33 220d0d07c8 Support storing KdbTree in block

10-28 09:48:33 368c56ffbd Remove a redundant check

10-28 10:03:54 96de404ec9 Remove useSessionTimeZone connection URL fallback mechanism

10-28 10:05:29 1981cefb65 Make ignoring corrupted statistics safe

10-29 16:30:56 d66daa9a40 Remove unused var in presto-main

10-30 21:39:10 a219974e71 Do not suppress exception from close

10-30 21:39:10 acd313c6a2 Remove misleading comment

10-30 21:39:10 b3bb29adf9 Extract method

10-30 22:34:57 20a9be5406 Simplify HivePageSource bucket filtering

10-30 22:34:57 dcb6cb6b2d Fix MaterializedResult PageSource handling bug

10-30 23:07:12 727f8c531f Refactor unused ctor args in presto-main

10-31 20:08:36 214f735154 Fix eager message formatting for checkArgument, checkState

10-31 20:08:53 39ab4fa83a Include exception cause

11-02 11:11:16 96325bf58b Avoid calling build() repeatedly

11-02 11:11:16 a5f227621c Simplify code

11-02 11:28:32 92b08960a1 Fix worker thread dump when queries running

11-02 11:33:11 6f2c897d08 Remove overly strict assertion in TestTableFinishOperator

11-02 11:33:11 f4f5996238 Enhance assertion messages

11-03 10:20:14 0cfa5cb8f5 Add char, varchar wellformedness checks

Pratham

[ ] all checked

10-23 23:42:23 d303043640 Export GCMonitor jmx mbean

10-26 18:06:12 b926647ae1 Declare applyCoercedValue method as abstract

10-26 18:06:12 e9be099acc Support coercing varchar types in hive connector

10-30 18:09:07 b54b1699f4 Avoid lowering memory limit in resource overcommit case

10-31 22:46:31 ff6671aa18 Return Optional from createCoercer method

11-02 18:13:19 11b17dba9b Build variable mapping set only once outside of the stream

Praveen Krishna

[ ] all checked

10-26 06:45:33 9c912a8263 Fix listing of tables when schema is not provided

10-28 11:36:54 a6243e457b Include bucketCount for hashCode and equals

10-28 11:36:54 c7fbf6a40e Limit pushdown for Kudu connector

Yuya Ebihara

[x] all checked

10-26 12:44:51 39ffc3f48c Remove redundant spaces in Oracle documentation

10-26 12:44:51 8c1afc027d Add support for COMMENT ON COLUMN in Oracle connector

10-27 14:17:14 21708a19dc Use batch insert in Cassandra connector

11-01 12:39:04 e8a6ea3a2d Refactor unused var in presto-mongodb

11-02 01:44:12 47e90d42b5 Refactor unused var in presto-bigquery

Łukasz Osipiuk

[x] all checked

10-26 14:34:25 6a50b47126 Fix projection pushdown in BigQuery connector

10-27 13:59:07 817831bc30 Rename TestOracleDistributedQueries to TestBaseTestOracleDistributedQueries

10-27 13:59:07 82a59d5d20 Test Oracle with and without remarks reporting

10-28 13:24:05 0e0c0e2e03 Add oracle.remarks-reporting.enabled config property

10-28 13:24:05 2d981dfcdd Add TestRemarksReportingOraclePoolIntegrationSmokeTest

10-28 18:20:26 4798b2bef6 Fallback from FlakyTestRetryAnalyzer on successful test

10-28 18:20:26 e88c8e7d84 Add logging to FlakyTestRetryAnalyzer

10-31 08:05:47 3378a92433 Define timeouts for CI jobs

11-03 12:02:09 0bf8a516e3 Do not call static method via instance

11-03 12:02:09 6f893e4420 Add missing @Test annotation

11-03 12:02:09 70c4f5c655 Add FlakyAnnotationVerifier

11-03 23:19:55 0dc70884ef Make FlakyAnnotationVerifier more strict

11-03 23:19:55 543770e6d3 Do not use Optional for loop control

11-03 23:19:55 5d14b3de9e Simplify and inline method

11-03 23:19:55 64fed9f5fe Simplify inherited method detection in FlakyAnnotationVerifier

release-notes
opened by martint 51
Release notes for 353
Dain Sundstrom

[x] all checked

02-23 23:12:12 2a9d851c06 Unresolve filter expression before printing

02-27 07:56:11 f45869f73f Fix bad parameter count in code generator

02-27 18:58:41 6d5de5a06d Upgrade to Airlift 203

David Phillips

[ ] all checked

02-18 11:57:23 aaf8e3bbf9 Change documentation to reflect accurate SingleStore company name

02-18 12:01:02 256bd43abc Add legal notices into new appendix

02-23 15:22:16 1918814c4a Update to Parquet 1.11.1

02-25 11:44:46 bf7ed6be8f Add groups to Security chapter's TOC

02-25 11:49:16 23764a5403 Adding explicit reference to query history properties

02-25 15:27:48 39c8e08650 Cleanup system access control documentation

02-25 15:27:49 623938bc14 Rename file group provider title

03-02 16:38:28 4f9854dcf0 Move plugin loading for development to separate module

03-02 16:38:28 e995d61df2 Remove outdated log level config

03-02 16:40:28 1bceef8d62 Move Phoenix connectors to separate CI job

03-02 16:40:28 898cda2167 Rename Phoenix 5 connector to remove dash

03-02 16:41:26 825ed66c21 Remove superclass for MockThriftMetastoreClientFactory

03-02 16:42:30 1eef8cfab8 Cleanup code in MockThriftMetastoreClientFactory

03-04 09:37:19 1732e0828d Abort SQL Server connection before closing

Grzegorz Kokosiński

[x] all checked

02-17 00:52:24 3a4c623aee Add Error Prone check: UnnecessaryCheckNotNull

02-18 04:14:10 6431d47ba0 Always show SECURITY clause in SHOW CREATE VIEW

02-19 01:23:10 2f043ae13c Handle AccessDeniedException in JdbcMetadata#listTableColumns

02-19 11:28:29 78e0a9764c Add Error Prone check: BadShiftAmount

02-23 06:49:09 13a92b9406 Verify that BaseConnectorTest contains all tests

02-23 11:29:57 049a93f7c4 Replace presto with trino in trino-product-tests readme

02-23 11:29:57 d4d466772b Fix incorrect cmd in trino-product-tests readme

02-23 11:48:30 2da5aa24d9 Fix char predicate pushdown for MySQL, MemSQL and SQL Server

02-23 11:48:30 37cedfb5cf Simplify testDataMappingSmokeTest

02-24 02:36:21 987476af85 Add table descriptor and schema registry usage

02-25 04:13:16 a56b9aa774 Enable unconditional retries of selenium tests

02-25 12:19:42 55230fb927 Allow for temporary docker containers

02-25 12:19:42 b0a2c6332f Add SinglenodeOauth2 environment

02-25 12:19:42 e031a535e0 Add OAuth2 jdbc product test

03-01 03:17:20 09735307c9 Simplify PostgreSQL testCaseSensitiveDataMapping skipping

03-01 04:20:39 0ffc694e90 Verify table metadata in SHOW COLUMNS

03-01 04:20:39 51f9d8c359 Test JDBC connector with table with only unsupported columns

Karol Sobczak

[x] all checked

02-15 02:34:38 f53e17497f Rank test case for PushdownLimitIntoWindow

02-15 06:49:26 371fc01e1a Fix aliasing columns in CTE

02-15 06:49:26 c66f05997e Move hidden column to the first position in tpch

02-18 02:21:29 2c58a54e61 Disallow bucketing or sorting on hive partitioning columns

02-19 08:58:48 930b0b0443 Improve parallelism for writes to bucketed partitions

02-19 10:44:53 004814f133 Simplify createLongSequenceBlockWithNull

02-23 04:33:06 07bb68cd92 Compare isUsePartitionedBucketing in getCommonPartitioningHandle

02-23 04:33:06 1db6e4e1e3 Test that buckets generated for partition are consecutive

02-23 04:33:06 4eef8cefe5 Provide explicit bucket to node mapping for partitioned bucketing

02-23 04:33:06 52e783a25f Add hive.parallel-partitioned-bucketed-inserts feature config

02-23 04:33:06 89c06990c6 Use -1 as a hash value for null partition column

02-23 04:33:06 8c84b2edab Remove redundant BucketingVersion#getBucketHashCode overload

02-24 01:53:03 c440395f73 Improve projection inlining

02-25 02:56:04 08dee8c71f Simplify PageUtils#recordMaterializedBytes

02-25 02:56:04 211931d6ec Fix lazy block listeners when top level block is loaded

02-25 02:56:04 ab1a73f2a8 Make LazyBlock#getFullyLoadedBlock load nested lazy blocks

02-26 01:53:30 c8ebe1e16f Use default value of REDISTRIBUTE_WRITES in TestInsert

02-26 03:43:31 8fa406d4e1 Make ConnectorAwareNodeManager#getWorkerNodes not include coordinator

02-27 12:51:32 9871f2ce46 Append current node explicitly in ConnectorAwareNodeManager

03-01 02:48:52 77819444c7 Identify referenced columns by table's QualifiedObjectName

03-01 03:04:42 38a67b0b6d Extend redirection SPI to UNION ALL types of redirections

Martin Traverso

[x] all checked

02-10 11:25:07 7b533c5a46 Fix planning failure with hidden columns in CTE

02-16 09:20:16 088b9ae7dd Move test to relevant test method

02-16 09:20:16 4c5008c157 Reword comment for clarification

02-16 09:20:16 b01288377f Analyze filter in order by aggregations

Piotr Findeisen

[x] all checked

02-10 04:19:20 6022989ad9 Disable metastore caching on workers

02-11 12:40:37 53f2fda3ba Format RPM scripts

02-11 12:40:37 f600388f74 Allow to reference env.sh vars in configs

02-11 13:45:15 113ef1077c Rank test case for PushdownFilterIntoWindow

02-12 01:45:27 edd65dceac Fix session property name in docs

02-12 01:45:27 fb1d48f16f Update docs for property rename

02-12 03:30:50 69e693eb00 Fix stuttered words

02-12 03:30:50 957a02df37 Ensure Oracle container closed in TestOracleCaseInsensitiveMapping

02-12 07:50:22 1c3bbcb8b1 Simplify Range consumption

02-12 07:50:22 b23fa2dba1 Fix formatting

02-12 11:36:29 def286a7bd Enable MissingCasesInEnumSwitch errorprone check

02-12 14:07:38 28185a2ae0 Fix error message

02-14 23:57:43 cc90d10d97 Make OAuth2 config client-secret sensitive

02-15 01:14:44 4f2b3620bf Move javadoc to API method

02-15 01:14:44 c0f69473df Simplify ValueSet creation from collection of values

02-15 02:25:45 9d565a96d7 Remove defunct tests-with-dependencies profile

02-15 02:25:45 fd9fd1efa7 Remove redundant skip-accumulo-tests profile

02-15 07:17:00 c4fa65b267 Extract method

02-15 12:57:42 c75fdab29d Fix union of two low-unbounded Domains

02-15 13:05:31 0b7b26a76b Rename Launcher --without-presto to --without-trino

02-16 00:13:02 5fcb97687d Make Range representation lightweight

02-16 03:05:54 7094453514 Remove duplicate method

02-16 03:05:54 8fb4a95ab4 Future-proof code leveraging MissingCasesInEnumSwitch

02-16 03:05:54 c4758f9753 Remove unused method

02-16 03:06:17 4f45102aa6 Address TestTablesample flakiness

02-16 04:24:05 9957543e57 Apply standard formatting

02-17 05:14:02 39f48d5c14 Skip maySkipOutputDuplicates in EXPLAIN unless meaningful

02-17 07:44:00 8415753504 Remove unhelpful TableScanMatcher.Builder

02-17 07:44:00 c5da30e4b9 Split complex condition

02-17 07:44:00 c94b4c7d8b Remove useless copy constructor

02-17 07:59:57 590efb65ee Fix building docker image on MacOS

02-18 03:35:58 ebef6e6137 Match expectedConstraint strictly in TableScanMatcher

02-18 03:36:15 0582965bf1 Retry dependency download for Error Prone

02-18 03:53:57 b7794d6666 Add Error Prone check: PreconditionsInvalidPlaceholder

02-18 03:55:28 c621ff2cde Fix formatting

02-18 04:29:31 0e2ada9d2d Fix whitespace within ci.yml

02-18 04:31:15 5638d2d893 Use full commit SHA for third-party cleanup action

02-18 08:40:46 8dad79bf3e Add Error Prone check: ThrowIfUncheckedKnownChecked

02-18 12:19:09 938c21422c Remove unnecessary test dependency on parser

02-18 12:19:24 89fa80066c Match regex for query retries just like Flaky annotation processor does

02-18 12:20:29 db68df2cf2 Change legacy timestamp mapping to round values and disable pushdown

02-18 12:20:29 dc1fb53bdd Remove deprecated method

02-18 12:27:04 38ca5fd8fd Fix TIME read function when JVM zone east of Greenwich

02-18 12:36:46 6175dfdabf Add Error Prone check: MisusedWeekYear

02-18 12:39:44 5f76a07ec6 Replace "if x then true else false" with boolean return

02-18 12:39:44 b2c0675969 Simplify StandardColumnMappings.to(Presto|Long)Timestamp

02-18 12:39:44 b4ec84f1c9 Minor code cleanup

02-19 08:36:23 6232949501 Remove API for unconditional port exposure

02-21 13:50:50 4e2c060f58 Add writing higher-precision timestamps to Hive to 352 release notes

02-21 13:50:50 aa3fadb474 Update doc for hive.timestamp-precision to include writing

02-22 00:02:11 3dea365780 Enable IdentityBinaryExpression error-prone check

02-22 01:49:07 24f4b5cd61 Make TestMemSqlCaseInsensitiveMapping extensible

02-22 01:49:07 a9e557f172 Add comment for single-threaded case-insensitive-mapping tests

02-22 02:57:02 22d33d1d76 Simplify Range creation in RangeView

02-22 02:57:02 26058f26e7 Remove redundant suppression

02-22 02:57:02 5ed3fe0f5d Supplement test with non-deprecated call path

02-22 02:57:02 bab41707f3 Add test for empty Range construction

02-22 02:57:02 d0cdd39162 Simplify some usages of Range

02-22 02:57:02 d70e9e1857 Convert @Test(expectedExceptions) into assertThatThrownBy

02-22 03:01:07 5fc2b8ee17 Make Range.intersect return Optional

02-22 03:01:07 f15ea75d02 Avoid Marker intermediate representation in DomainCoercer

02-22 04:35:42 47195a97c1 Fix logical merge conflict

02-22 04:55:58 4ad6f7e4e8 Report better message when no connection from driver

02-22 04:55:58 f2a735bf95 Remove unused connectionUrl flexibility

02-23 02:27:45 a4e434ee61 Add Error Prone check: ReturnValueIgnored

02-23 02:28:40 4fda96d62e Update 352 release notes

02-23 02:29:58 640ab432c1 Merge TestPostgreSqlDistributedQueries with TestPostgreSqlIntegrationSmokeTest

02-23 02:29:58 6668e70161 Rename AbstractTestIntegrationSmokeTest to BaseConnectorTest

02-23 02:29:58 7e2698d510 Make BaseConnectorTest extend AbstractTestDistributedQueries

02-23 02:29:58 7e69324716 Re-add AbstractTestIntegrationSmokeTest for backwards-compatibility

02-23 02:29:58 81e1d9d80c Run distributed queries for base JDBC with H2

02-23 02:29:58 c27d8d4b6e Add dedicated test for queries with caching

02-23 02:29:58 f2930d0b4d Merge TestRedisDistributed with TestRedisIntegrationSmokeTest

02-23 11:43:07 f90177804c Fix host name in product tests readme

02-24 02:04:12 0f66aca619 Enable LogTestDurationListener by default on CI

02-24 03:54:00 0a31ee3a25 Prune enforcedConstraint when pruning columns

02-24 03:54:59 67e8982c59 Fix S3 directory detection based on ContentType header

02-24 03:56:37 3b370503da Add Error Prone check: GetClassOnAnnotation

02-24 07:00:45 fde81b6d28 Document safe apparently unsynchronized access

02-25 08:24:05 8ee45314df Make a verbatim copy of the trino-phoenix module as trino-phoenix-5

02-25 08:24:05 fa6a97dfd9 Support Phoenix 5.1 and HBase 2.x

02-26 02:59:39 8db19d9c6b Fix aggregation function alias pushdown

03-01 02:34:36 bfd7895c36 Cleanup space for MemSQL tests to work

03-01 04:18:17 d899cec9fd Test pivoting table with 254 columns

Pratham

[x] all checked

02-11 19:31:42 103e22c262 Add functions to_geojson_geometry and from_geojson_geometry

02-22 14:44:56 d14e558ee5 Add Hive view documentation

02-22 18:04:06 ba2266cb2d Remove test cases that require resolving localhost adresses

Praveen Krishna

[x] all checked

02-21 23:46:21 18a489f208 Allow TestingAvroSchema to resolve based on SchemaReferences.

02-21 23:46:21 8d5ed449d9 Resolve SchemaReferences in ConfluentContentSchemaReader

02-21 23:46:21 ef7dd9bf21 Cleanup TestKafkaAvroReadsSmokeTest#createAvroTable

02-21 23:46:51 5d8827768b Cleanups in ConfluentModule

02-22 07:03:34 16cb423126 Use ResourceProvider in MultinodeHiveCaching

02-22 07:03:34 90f4a040b6 Extract StandardMultinode

02-22 07:03:34 a5f0be448a Introduce Classloader safe implementation of SchemaRegistryClient

02-22 07:03:34 e50fa8e1d9 Fix error message

Yuya Ebihara

[x] all checked

02-16 17:43:23 f375c7263b Fix typo in doc

03-01 01:42:44 ada5147903 Add support for CREATE and DROP TABLE in BigQuery

Łukasz Osipiuk

[x] all checked

02-12 05:02:51 fa392d9259 Add support for current_user() in Hive views

02-15 00:54:26 281e7b19f9 Add BigQuerySqlExecutor and refactor tests to use it

02-15 00:54:26 2eb3e92bae Add comment about collision of table/schema names

02-15 00:54:26 cda6386e65 Implement case insensitive name matching for BigQuery

02-15 00:54:26 ddb86ba75e Document new configuration properties for BigQuery

02-15 00:54:26 f6c02aa958 SchemaTableName is a value class so it should not be extensible

02-22 15:13:23 b487c2c92c Decorrelate subqueries with inner UNNEST and global aggregation

02-22 15:13:23 bd1c27570f Verify that grouping set count is positive

02-23 04:21:19 05f7468e1e Decorrelate subquery with left UNNEST and global aggregation

02-24 02:03:48 db91859b87 Glue metastore statistics integration

02-24 14:58:22 9b7c025fa7 Add comment on default value for optimizer.join-pushdown

02-24 14:58:22 a338de5622 Drop join pushdown specific configuration and session toggles

02-24 14:58:22 c22091c5b4 Pass relation statistics to applyJoin in ConnectorMetadata

02-25 06:12:44 177f9d300a Use assertj for collections comparison

02-25 06:12:44 39c11c1bc9 Move field to subclasses

02-25 06:12:44 a1bd1b786d Explicitly specify needed tables for AbstractTestQueries

02-25 06:12:44 af5d61311c Merge DistributedQueries and Smoke test class in MySql connector

02-25 06:12:44 e0d49e218b Allow specifying list of tpchTables in RaptorQueryRunner

02-25 10:29:03 066c0e6963 Simplify Stream chained call

02-25 10:29:03 b3c55b83be Use Optional.isEmpty instead of negated isPresent

02-26 02:01:45 31ae1f3727 Fix Raptor query runner TPCH tables setup

02-26 04:25:12 f1c8de48ea Fix query in test so it is deterministic

02-26 08:49:07 fb8aa6e106 Allow for overriding GlueColumnStatisticsProvider

02-27 00:46:48 14359d634e Make BaseMySqlConnectorTest public

02-28 14:47:25 910231071e Remove TestMySqlDistributedQueries

03-01 00:48:51 91e655af8e Update partition statistics in Glue after partition is created

release-notes
opened by martint 50
Release notes for 362
Ashhar Hasan

[x] all checked

08-28 22:50:33 89e61ecbfa Fix failing test due to missing comma

08-31 04:50:54 60e0337380 Remove obsolete test

08-31 04:50:54 ab46771504 Fix comment to mention memory connector instead of Cassandra

08-31 04:50:54 b7f4c81728 Change assertions to explicitly check for existence of table

09-01 12:17:45 01d38b2b92 Apply overrides from provided config when running SuiteDescribe

09-03 11:52:02 00281a3b1b Add SQL support section to TPC-DS connector

09-03 11:54:28 90f628659e Move SQL support section

09-03 11:54:28 d254b7f643 Correct scope of memory release

09-07 23:03:37 41e596a5a1 Add SQL support section to Kudu connector

09-07 23:06:57 5d43d97396 Document setdigest type

09-08 23:24:08 856331ff9e Revise async and read-through caching

09-09 09:44:51 b065b01559 Fix in clause handling in filter pushdown

09-09 11:42:35 bd4ca21f48 Minor cleanup to MemSQL query runner

09-09 11:42:35 c492daa585 Add main method to MemSQL query runner

09-09 21:36:11 11627c8b2f Fix connection name example and link to Oracle docs

09-09 22:39:58 108e733e56 Fix typo in PinotColumn error message

09-09 22:39:58 5d2631aeca Remove unused variables and functions from DynamicTableBuilder

09-09 22:39:58 ad7d903b8d Fixed mismatched schema names

09-09 22:39:58 c1cfbcb722 Fix realtime spec for alltypes table

09-09 23:17:33 16765453b6 Fix decoding infinite double values in Pinot

09-09 23:17:33 4ca11122ce Add support for pushdown of varbinary filters to Pinot

09-09 23:17:33 f124f10497 Fix decoding infinite real values in Pinot

09-10 09:31:54 2baea31697 Remove ineffective cleanup step

09-10 09:31:54 fd7fa04498 Upload test results as artifacts

09-10 09:57:37 29ac28cc48 Set updated_at to a recent value to prevent expiration by Pinot

Dain Sundstrom

[x] all checked

09-01 19:46:48 0c43e246e0 Use Optional instead of nullable in SessionContext

09-01 19:46:48 13b8f60c7c Remove redundant "in this catalog" from ConnectorAccessControl docs

09-01 19:46:48 16c528148b Add MetadataUtil.getRequiredCatalogHandle

09-01 19:46:48 2d3251d32f Split HttpRequestSessionContext into factory and instance

09-01 19:46:48 3641ca1baf Automatically add admin role to file based metastore

09-01 19:46:48 3cb2db9dc2 Cleanup CreateSchemaTask

09-01 19:46:48 3e2bd90d0c Add metadata role exists method

09-01 19:46:48 411ad8049d Remove catalog argument to ConnectorAccessControl methods

09-01 19:46:48 5ce1ae7e9f Convert SessionContext to a class

09-01 19:46:48 8c91ae84c7 Fix synchronization in TestWebUi

09-01 19:46:48 ce1eb14c12 Fix SetSchemaAuthorizationTask role validation

09-01 19:46:48 f386df0919 Add checkRoleExists helper method

09-01 20:08:58 48ec9f3665 Add Hive target max file size

09-02 13:36:33 e0a1f320fd Document hive.target-max-file-size configuration

09-03 18:26:36 230f1c6ca4 Extract abstract super class for TestHiveRoles

09-03 18:26:36 4b2565a98d Only send security metadata calls to connectors with an access control

09-03 18:26:36 56abe82113 Add optional catalog declaration to role management statements

09-03 18:26:36 754b6b0945 Update documentation for role management commands

09-03 18:26:36 7da3c1a42f Add SystemSecurityMetadata for management of system grants

09-03 18:26:36 868fed9990 Add role to file based system access control

09-03 18:26:36 9b65a9ecd7 Add system access control checks for global role management

09-03 18:26:36 b7c34f4b76 Add support for global role management

09-03 18:26:36 c4782ed7c2 Add enabled system roles to Identity

09-03 18:26:36 cf3b571be1 Fix output of revoke role statement

09-03 18:26:36 fdeec92683 Rename roles to connectorRoles in Identity

09-06 12:37:18 68a01e321d Fix warnings in TpchMetadata

09-06 12:37:18 9b6cf0cdfa Add config option to map TPCH doubles as SQL decimal

David Phillips

[x] all checked

08-30 14:32:00 b03065e86b Remove bogus INVALID_COLUMN_NAME error code

08-31 17:59:06 627029c60a Add documentation for additional Hive Views

09-03 08:50:36 3192f3604a Add query error info to cluster overview page in web UI

09-08 11:13:50 253a6b00bd Minor formatting improvements for grammar

09-08 23:19:53 710b7e043b Add toString method to PropertyMetadata

09-08 23:24:19 bb06a1a2fe Update Maven wrapper to 3.8.2

09-09 17:47:39 14a20c46cb Move top level markdown files

09-09 17:55:16 945d4c3195 Update to Avro 1.10.2

09-09 17:56:44 0b9764347d Correct connection string examples

09-09 17:59:34 854c72271d Update to ANTLR 4.9.2 and Jdbi 3.21.0

09-10 10:38:23 e0f399830c Add SQL support section to Thrift connector

09-10 10:43:17 1fe0f3efa6 Add SQL support section to Phoenix connector

09-10 10:56:39 f687bac777 Add Predicate and Column Projection Pushdown Section

09-10 11:08:51 0b74aced3d Add note about no Java 17 support

09-13 11:58:29 2e0f3b8985 Add SQL support section

09-14 13:43:39 d3a6c2a91d Move bin/ptl to testing directory

09-16 10:15:44 53d1cdfd82 Add table of contents for DEVELOPMENT

09-16 10:15:44 5f501c155f Clarify multiple commits in a PR

09-16 10:15:44 d0df4751a2 Create commits and pull requests section

09-16 10:47:10 905f0334c4 Only support single statement writes by default

GitHub

[x] all checked

09-09 17:58:58 1cd649ac6b Change Trino RPM architecture to noarch

Grzegorz Kokosiński

[x] all checked

08-30 01:03:59 0e8a992de7 Mock more functionalities in MockConnector

08-31 04:38:42 3900829b74 Update airbase to 112

08-31 07:42:07 3532ff9af1 Allow to override default system access control

09-01 22:27:57 f6b1e7e03c Accept that transaction is cancelled early in TestJdbcConnection

09-02 04:02:38 705023c829 Use configureTempto instead CONTAINER_TEMPTO_PROFILE_CONFIG

09-02 04:02:38 7c410a5c2d Extract configureTempto utility method

09-02 04:02:38 be32a751c3 Deprecate CONTAINER_TEMPTO_PROFILE_CONFIG

09-02 04:27:09 6cd93328fd Make IdentityCacheMapping accept ConnectorSession

09-02 04:37:41 18814a3adf Restore default system access control

09-03 05:30:16 3774afbebc Use URLS_SELF_ISSUER value for oauth2.issuer

Karol Sobczak

[ ] all checked

08-31 02:01:00 a79829fdac Fix incorrect currentProbePositionProducedRow value for inner join

09-01 00:53:40 a762fdd0a6 Remove transitionToRunning on Stage schedulingComplete()

09-01 01:33:40 b838333757 Improve JoinProbe

09-01 01:33:40 bdec9257ae Use blockBuilders.length in PageBuilder#reset()

09-01 01:33:40 cc622f9b25 Improve LookupJoinPageBuilder

09-01 12:09:46 ef10932139 Doc remove keyword sorted of window function

09-01 14:03:06 8d8466b9cd Introduce RowPagesBuilder#getHashChannels method and use it in tests

09-02 03:56:34 1fffa571cf Do not use LocalPartitionGenerator

09-02 03:56:34 5c65f483fe Add createRandomLongsBlock using limited number of unique values

09-02 03:56:34 9e4728d764 Make HashBucketFunction public and extract as top level class

09-02 03:56:34 a43fdbedb4 Fix hash computation bug

09-02 03:56:34 be88e21d90 Add more cases to BenchmarkPartitionedOutputOperator

09-06 02:24:51 17864424b9 Fix formatting

09-06 02:24:51 2b8387d0c8 Do not set stats that are not propagated for nested operators

09-06 02:24:51 398225762d Mark OperatorContext#getOperatorStats as private

09-06 02:24:51 5a9617b544 Move private method below public

09-06 03:25:38 15c9c5319b Optimize MarkDistinctHash for faster distinct mask creation

09-06 03:25:38 a673343e70 Add direct block construction helpers to BooleanType

09-06 13:17:29 6bd61727b2 Improve HashGenerator.getPartition performance

09-07 02:50:05 826558ac49 Prevent NPE when getting freshness of non-existent materialized view

09-07 02:50:05 a14b9ac153 Remove unthrown exception declaration from Javadoc

09-07 02:50:05 fff485a145 Skip displaying materialized views with missing freshness

09-07 03:43:44 83a62fd0e1 Produce better hash for short decimal type

09-07 09:27:04 c059cda3de Allow for operators to define custom metrics

09-07 09:27:04 d3a3054634 Rename connector metrics to metrics

09-10 02:51:26 ca8e71eaee Extract OperatorStats#connectorMetrics

Martin Traverso

[ ] all checked

08-31 14:30:00 c4f08c7178 Update to aircompressor 0.21

09-07 10:08:10 c3ff961b67 Improve Block#getLoadedBlock() and Page#getLoadedPage()

09-08 11:16:56 4c321a97d1 Support string joining in SQL via LISTAGG clause

09-08 11:59:43 639020cdb3 Add benchmarkHashPosition to BenchmarkGroupByHash

09-08 11:59:43 8de73806dd Add positional only utility for InterpretedHashGenerator creation

09-09 10:16:05 abc2d24f61 Remove totalPartitions from TaskContext

09-10 13:35:40 fce0521b42 Speed up construction of parquet predicate from dictionary

Piotr Findeisen

[x] all checked

08-30 08:57:21 8ab3573d74 Report actual rows when returnsEmptyResult assertion fails

08-30 08:57:21 94217dbed4 Rename base test class to match current convention

08-31 09:25:18 031fbbe323 Fix testMaterializedViewsMetadata flakiness due to lack of pruning

08-31 09:25:18 40a49374aa Fix test table name

08-31 09:25:18 8a27c4c71d Fix type of expected values

09-01 02:24:10 e7181f4d62 Remove useless todo list for residual expression

09-02 02:14:51 15a0ff379e Fix indentation

09-02 02:14:51 329c48d5c7 Convert deprecation comment into a javadoc

09-02 02:14:51 57594b87fe Remove redundant SinglenodeSparkIceberg configuration

09-02 02:14:51 b9df5b6e93 Test Iceberg schema top-level evolution

09-02 03:24:17 0ee1ad4aa4 Enforce naming convention for PTL configs

09-02 03:24:17 1b6bac7d56 Apply static imports consistently

09-02 03:24:17 2acfcc6a48 Enforce naming convention for PTL suites

09-02 03:24:17 86bc379ae5 Test suite name generation

09-02 03:24:17 90797aea6e Rename utility methods

09-02 03:24:17 ac7629dcb4 Split Environments utility class

09-03 01:03:51 00626a4df9 Split environment and config name canonicalization

09-03 01:03:51 823540bbd3 Update environment names to naming convention

09-03 01:03:51 b42a30f824 Introduce naming convention for PTL environments

09-03 01:03:51 eb5730767a Update environment name canonicalization tests

09-07 02:14:59 d47be23f97 Retain commit's failure when rollback fails

09-07 02:15:23 92c6cfe011 Move Hive tests's configs out of product tests

09-07 08:04:43 09dc0bf830 Add dereference pushdown smoke test coverage

09-07 08:04:43 0d0fd3bfc0 Use ID-based mapping for struct fields in Iceberg Parquet reader

09-07 08:04:43 a74fd535d3 Split ParquetColumnIOConverter for Hive and Iceberg

09-07 08:04:43 d3e22e0d21 Code cleanup in ParquetColumnIOConverter

09-07 08:04:43 ef5d9d1174 Fix missing defensive copy in ColumnIdentity constructor

09-07 08:12:57 1a71ec53f6 Test Snappy-compressed Parquet table created in Trino

09-07 08:12:57 3cd36e3476 Move Parquet Snappy test to different class

09-07 08:12:57 beef4385b3 Add Hive compression_codec integration test for all formats

09-08 06:34:04 0bd01d84e9 Include actually set properties in exception message

09-08 06:34:04 8f89f04dc6 Exercise optimized Parquet writer in Hive connector test

09-08 06:34:04 b3cfc0dd66 Exercise optimized Parquet writer in Hive compression product test

09-08 06:34:04 b3fcd966e6 Reject unexpected type in some date/time column readers

09-08 06:34:04 c84a413098 Read INT64 Parquet timestamp into timestamp(9) column

09-08 06:48:45 6349e6a44f Mark hive views testNestedGroupBy test as @Flaky

09-08 06:49:09 ad1a432c91 Bump snappy-java version

09-09 23:55:54 b5ef0c9d84 Reorder parquet_use_column_index in HiveSessionProperties

09-10 02:11:54 31dbbdb744 Improve explanatory comment in test

09-10 02:11:54 3611b0cdd1 Test Hive connector with Spark-created Parquet table

09-10 02:11:54 66b7658fe3 Rename hive_spark_bucketing test group to hive_spark

Pratham

[x] all checked

08-30 18:01:03 6f1297f3fc Fix issue with querying Iceberg using a structural type predicate

Praveen Krishna

[ ] all checked

09-02 22:47:04 659bf66f2d Use static import for BucketingType

09-02 22:47:04 8f5aa1cbca Treat table as unbucketed if bucketed on unsupported data type

Yuya Ebihara

[x] all checked

08-28 18:46:42 6883ebd8d1 Add SQL support section to Redis connector

08-28 18:48:43 778eb841e8 Add SQL support section to Prometheus connector

08-29 18:33:58 95d5f468ac Add SQL support section to Cassandra connector

08-30 04:16:18 9024438441 Fix query failure of predicate pushdown to BigQuery DATETIME type

08-30 08:47:54 1fc3ddc801 Append semicolons in DESCRIBE OUTPUT example

08-31 18:05:45 46b37aa41b Add SQL support section to Elasticsearch

08-31 21:26:35 14c4eb08ad Add SQL support section to Pinot connector

08-31 23:37:51 1c3807d506 Fix wrong result of BigQuery parameterized NUMERIC type

08-31 23:37:51 4a02a181bf Upgrade errorprone to version 2.9.0

09-01 21:55:48 3acb4469d3 Skip unsupported type in BigQuery connector

09-02 23:37:37 193db65de2 Allow using 1 as cassandra.speculative-execution.limit

09-05 23:48:09 647b4d4ebf Cast float64 type correctly when predicate pushdown to BigQuery

09-06 21:14:05 ad40bd7d65 Make table wider in BigQuery documentation

09-06 21:14:05 f72a5904d9 Change date/time precision in BigQuery from 3 to 6

09-08 04:13:37 4b45f1a777 Document ARRAY type mapping in BigQuery connector

09-08 06:25:00 d3d2ba7328 Delete even non-empty dataset when preparing BigQuery tests

09-08 16:11:39 515d41de55 Recreate Oracle container when failed to setup

09-09 00:28:15 6d22525e8f Support case insensitive name matching to BigQuery views

09-09 00:28:15 7de96aa9f2 Allow setting name prefix in TestView

09-09 00:28:15 a5264f7bca Prepend 'remote' to method and variables in BigQuery

09-09 00:28:15 b92df3c941 Allow deleting non-empty dataset in BigQuery test

kasiafi

[x] all checked

08-30 08:02:22 e961325fbf Fix row field names in JSON documentation

09-09 23:43:21 10a85b1991 Fix planning of recursive queries with duplicate outputs of partial plan

Łukasz Osipiuk

[x] all checked

08-31 02:34:57 f947aed8e4 Fix failure query casts varchar to shorter char

09-02 13:51:00 25965e9d7b Rename variable

09-02 13:51:00 96e7323a1b Drop unnecessary braces

09-02 13:51:00 b87165dcf7 Include grouping sets in JdbcTableHandle column list

09-02 13:51:00 d55bb1c5a8 Implement count(distinct) pushdown for PostgreSQL

09-06 09:20:13 821644483f Fix locking of non-partitioned transactional tables

09-09 02:56:47 973e71410c Record JMX metrics for calls made to the Glue statistics API

release-notes
opened by martint 49
Support for AWS Athena partition projection
This PR provides reimplementation of AWS Athena feature called Partition Projection to Trino. https://docs.aws.amazon.com/athena/latest/ug/partition-projection.html

Description Partition projection allows to calculate partition values and locations from table properties rather than from partition metadata read from a repository like HMS or Glue. Depending on the specific characteristics of the query and underlying data, partition projection can significantly reduce query runtime for queries that are constrained on partition metadata retrieval.

Motivation Supporting this feature would allow to easily migrate from Athena to Trino, for customers who uses this feature to reduce query execution time, mostly in use cases like data lake storing logs data e.g.: https://docs.aws.amazon.com/athena/latest/ug/cloudtrail-logs.html#create-cloudtrail-table-partition-projection

Requirements We need to keep usability and configuration as much aligned with Athena as possible due to:

its pre-existing feature of Athena, already documented and used in AWS Cloud.

Athena is recognised as AWS SaaS based on PrestoDB version 217 (people expect it to be somehow similar)

Partition Projection configuration is stored as table properties which means we need to be able to attach to pre-existing table in metastore repository

Implementation Partition projection is wrapped on calls to io.trino.plugin.hive.metastore.HiveMetastore methods getPartitionNamesByFilter and getPartitionsByNames. If partition projection is enabled (based on table properties,) partition values and location are projected instead of being retrieved from metastore.

Fixes https://github.com/trinodb/trino/issues/11305
cla-signed tests:hive
opened by aczajkowski 48
Release notes for 352
Dain Sundstrom

[x] all checked

01-08 15:31:31 23a57d6d00 Refactor MemoryRevokingScheduler to avoid redundant work

01-08 15:31:31 5b29c2c85b Add SqlTask#getTaskState() and SqlTask#getTaskCreateTime()

01-08 15:31:31 5ca24b0e9d Fix MemoryRevokingScheduler from re-visiting tasks for the same query

01-11 13:22:35 0ecbb752f0 Use AtomicIntegerFieldUpdater for LocalExchange PageReference

01-11 13:22:35 1d2c5d44f4 Refactor ExchangeClient#pollPage

01-11 13:22:35 1db6bc2e2a Improve LocalExchangeSource locking behaviors

01-11 13:22:35 261831b3ff Reduce synchronization in LocalExchangeMemoryManager

01-11 13:22:35 74605d0724 Add unsynchronized fast paths to reduce contention in ExchangeClient

01-11 13:22:35 9537b02998 Remove synchronized for final field read in MemoryPool#getMaxBytes()

01-11 13:22:35 a04bc4e0e0 Cache isBlocked in various operators

01-23 12:31:22 27f536f336 Use assert for ExchangeClient lock holder sanity check

01-23 12:31:22 8ba1661505 Use assert for HttpPageBufferClient lock holder sanity check

01-23 12:31:22 ca053928a5 Use assert for LocalExchangeSource lock holder sanity check

01-23 12:31:22 ddc7a3a3bc Use assert for ClientBuffer lock holder sanity check

01-23 12:31:22 eb0f66cda9 Reduce OutputBufferMemoryManager contention

01-25 12:13:53 2fde53f47d Change KdbTreeTree stack type back to Object

David Phillips

[x] all checked

01-04 15:02:16 fda1f3291c Fix documentation logo for menu on mobile

01-04 17:46:09 3259156e5b Update logo in README

01-05 09:51:20 de1cb664af Use sentence case in titles consistently

01-05 14:16:49 24b5e2d74c Use cause instead of suppressed for OperatorNotFound

01-05 16:10:20 d6b76fb900 Update documentation for ALTER TABLE and CREATE TABLE

01-07 11:37:07 f04496aac3 Hive performance properties table replaces presto pr 5845

01-07 12:46:58 0360436521 Add sections for release per year

01-07 21:54:01 fa0f7ce935 Update to OkHttp 3.14.9

01-08 12:06:31 d4751bf2a8 Remove outdated comment from TimestampType

01-09 21:09:24 d35fe544cd Fix missing backtick in Iceberg documentation

01-12 12:00:49 01c4740e1d Require Java 11.0.7 for building

01-12 12:01:58 2cbf865985 Remove unnecessary code after OkHttp upgrade

01-18 08:39:40 a0f8973a54 Extract AbstractBearerAuthenticator

01-18 08:39:40 ad4fde1179 Add token polling for query submission authenticator

01-19 15:31:39 690d9663e7 Remove "changes" from release note sections

01-20 12:36:33 6188c664e6 Use embedded memory database in Hydra container

01-20 12:36:33 dcb6f0bf82 Support Auth Servers with self-signed certificates

01-30 19:05:47 6ef676953d Override Accumulo Docker entrypoint for Mac

02-03 08:36:35 072ac47331 Change Trino to match Hive on column rename/drop/add

02-03 14:51:08 86bc2a3167 Support SQL UPDATE in the Presto Engine

02-03 14:51:08 cf68459a0d Implement SQL UPDATE for Hive ACID Tables

Grzegorz Kokosiński

[x] all checked

01-04 05:48:18 d091da2462 Use dedicated modules for Kafka Schema Registry

01-04 12:01:19 0e301f3da4 Code cleanup

01-04 12:01:19 1c07317677 Remove Kafka topic creation in tests

01-04 12:10:56 36e4042b8f Add product tests for Kafka Schema Registry and Avro

01-04 12:10:56 55ee15ff12 Add javax.ws.rs to Kafka plugin

01-04 12:10:56 8877cfa183 Remove unnecessary topic creations in Kafka product tests

01-04 12:10:56 b553802b6a Use ClassLoaderSafeConnectorMetadata in Kafka

01-04 12:10:56 c16bd1ba4a Remove duplication in constants

01-04 12:10:56 c614d31b01 Do not use tempto requirements for Kafka Avro read tests

01-04 23:59:09 0b1bcb029d Close testing kafka after query runner

01-04 23:59:09 0e114d5e35 Inline createConfluentProducer methods

01-04 23:59:09 15c8d61dec Remove debug timestamp test dump

01-04 23:59:09 18ac9a5e3a Update latest Kafka for testing to 6.0.1

01-04 23:59:09 1b671dfba6 Extract TestingKafka::sendMessages

01-04 23:59:09 883c6592e8 Close testing kafka instance after tests

01-04 23:59:09 bd1c6ffb70 Fix formatting

01-04 23:59:09 c24362653b Retry sending kafka message in tests

01-04 23:59:09 d1403090c4 Merge TestingKafka classes

01-04 23:59:09 e3b40c87f2 Add logging for testing Kafka dockers

01-05 10:54:47 d3a4b68513 Mark Kafka Schema Registry flaky tests

01-05 10:54:47 f177357fdf Do not reuse schema registry testing environment

01-07 03:01:09 bc312ab040 Support JWK with certificate chain

01-07 06:37:23 91d130355e Use AssertJ core version from Airbase for druid

01-12 04:15:36 4bcd5b5c35 Use assertEventually in TestKafkaAvroReadsSmokeTest

01-12 05:07:58 13910a8e72 Use varargs method to pass command to containers

01-12 05:07:58 1b685659e9 Improve audience support in OAuth2 authenticator

01-12 05:07:58 1e9a7c201a Upgrade Hydra docker image

01-12 05:07:58 31c5f7f0d9 Mark testSuccessfulFlow test flaky

01-12 05:07:58 b777864be4 Use epoch seconds in invalid JWT test

01-12 05:07:58 e80712bc0c Fix OAuth2 Web UI authentication filter tests

01-13 03:18:32 1125cf90a2 Allow parameterized prepared statements in SHOW STATS

01-14 00:36:12 693cfb624d Add OAuth2 support to JDBC

01-15 05:08:16 c07f87a69e Use eventual assertion with query stats

01-19 04:12:46 d6a1217647 Verify cookie in tests is present

01-19 11:55:34 6596309fc5 Use secure cookie for UI OAuth2 token

01-19 11:55:34 861232ea0a Add scopes to OAuth2 configuration

01-19 11:55:34 cd3da24c98 Add nonce parameter validation

01-21 02:41:46 4ce5a2e7aa Decompress Kinesis message if needed

01-21 02:41:46 5f68daf465 Add stream and shard names to log

01-22 00:30:14 35a60b8725 Start JWK service in OAuth2 module

01-24 10:07:54 539e84604a Skip Kinesis decompression when kinesisCompressionCodec is UNCOMPRESSED

01-25 11:48:22 0d3bb55969 Enable http server authentication in Hydra setup

01-25 11:48:22 363ab1b285 Skip nonce validation for REST challenges

01-25 11:48:22 42e9cc2ab4 Rename nonce cookie to avoid name collision

01-25 11:48:22 88a7998df5 Send unauthorized response to /ui/api calls

01-28 00:59:11 c2fbe7eb71 Restore @Flaky annotations for 'Error committing write to Hive'

01-28 00:59:11 f40d2fa529 Move 'Error committing write to Hive' retry to Trino query executor

Karol Sobczak

[x] all checked

01-04 02:23:01 10f3d15311 Rename configs in thrift.properties

01-04 02:23:01 468f07278f Fix plugin.bundles paths in config.properties

01-04 04:15:26 466f284ab1 Add rank() window operator test

01-05 04:08:19 856fcb1cb6 Upgrade benchto to 0.14

01-05 04:39:49 0486167f33 Properly implement GroupedTopNRankBuilder within stub

01-05 04:39:49 1b57c60d2c Clean up for GroupedTopNRowNumberAccumulator

01-05 04:39:49 2b92c8d3b6 Tighten WindowFilterPushDown predicate domain check

01-05 04:39:49 3cf4efd810 Fix TopNRowNumberOperator incorrectly swapped types

01-05 04:39:49 3d164a6062 Copy GroupedTopNRowNumberBuilder as new rank builder template

01-05 04:39:49 425156f10b Allow LongLong2LongOpenCustomBigHashMap to explicitly set null keys

01-05 04:39:49 47310aa292 Extract GroupedTopNBuilder as an interface

01-05 04:39:49 5cbe3ad956 Add GroupedTopNRankAccumulator for streaming rank

01-05 04:39:49 842a8e9253 Add optimizer capability to produce streaming topN rank() plans

01-05 04:39:49 859c866025 Rename TopNRowNumber* => TopNRanking*

01-05 04:39:49 8d4a1d71eb Replace optimizer.optimize-top-n-row-number config with general version

01-05 04:39:49 ab4d9cd48f Add planner scaffolding to enable streaming topn RANK and DENSE_RANK

01-05 04:39:49 ade8af1102 Force TopNRankingOperator compatibility with current Window behavior

01-05 04:39:49 c9855dad91 Remove extra space from TopNRowNumberOperator

01-05 04:39:49 f811c56dc6 Fix typo in GroupedTopNBuilder

01-05 06:26:07 a8de1c55c0 Fix master failure with out-of-date webui build

01-07 04:29:33 03c9ce3e45 Fix StreamingAggregationOperator with proper DISTINCT grouping semantics

01-07 04:29:33 5c7882f849 Add NOT DISTINCT operations to PagesHashStrategy

01-07 04:29:33 93ea855a21 Fix WindowOperator with proper DISTINCT peer group semantics

01-07 04:29:33 d4a909b2d8 Revert "Force TopNRankingOperator compatibility with current Window behavior"

01-08 01:16:19 bd5cd0bd0d Add partition count parameter to BenchmarkHashBuildAndJoin

01-08 04:16:50 4f6a8f4f1d Extend BenchmarkHashAndStreamingAggregationOperators

01-08 04:16:50 627c072a3b Increase warmup iteration count

01-08 04:16:50 ce79625fd8 Ensure address is not -1

01-14 01:29:43 d8862395d1 Use long for {Primitive}BigArray#capacity

01-14 08:50:15 1b7787d4f9 Add JoinNode#maySkipOutputDuplicates

01-14 08:50:15 4421ee6899 Optimize execution for joins below empty aggregation

01-14 08:50:15 8b687334e2 Fix formatting

01-14 08:50:15 8e6d2d56fd Add "may skip output duplicates" as part of tpcds/tpcds plans testing

01-25 02:00:02 7604d066e6 Prefer ifPresent functional style in iterative rules

01-26 02:31:08 9c954ffd88 Mark testOutputDuplicatesInsensitiveJoin as Flaky

Martin Traverso

[x] all checked

01-22 10:10:07 625eec14a5 Migrate WindowFilterPushdown to rule framework

01-26 15:32:53 693f71bd63 Add static import

01-26 15:32:53 8436c957c3 Support WINDOW clause

01-26 15:32:53 e548a4e329 Fix test case

Piotr Findeisen

[x] all checked

01-04 12:11:08 91aa464501 Mark TestHivePartitionsTable as flaky due to "committing"

01-04 12:11:29 dca3d89490 Use the Redshift JDBC driver in the Redshift connector

01-04 13:33:04 2bcf5d9e2d Rename JdbcClient.getColumnMappings to toColumnMappings

01-04 13:33:04 d649dca65b Rename JdbcClient.toTrinoType to toColumnMapping

01-04 14:19:05 8228acb28c Fix array subscripting for SQL types represented as Objects

01-04 23:36:36 6a9be6b079 Simplify docker image configuration

01-05 07:54:48 216180031b Allow JDBC connector to control aggregation pushdown for tables

01-06 14:23:25 4f24c508dc Allow custom timestamp precision in Hive structural types

01-06 14:23:25 5310c8ae94 Improve timestamp test cases used in Hive storage format tests

01-06 14:23:25 6b03098764 Fix type of TimestampAndPrecision.getPrecision

01-06 14:23:25 8e3b9af221 Improve data providers in TestHiveStorageFormats

01-08 02:52:47 65c9386fd7 Fix javadoc wording for applyTopN

01-08 02:54:21 d97db32c8b Do not overwrite version of zt-exec in module

01-08 03:15:21 3a64f51419 Disable array test in Cassandra more properly

01-08 03:15:21 57da5d653d Fix supportsArrays declaration in Phoenix tests

01-08 03:15:21 8500ab0df7 Verify supportsArrays correctness

01-08 13:07:26 190710b376 Use READ_COMMITED + SNAPSHOT_ISOLATION (RCSI) level for SqlServer

01-10 09:34:06 03d6bcb5a3 Short-circuit TupleDomain.columnWiseUnion

01-10 09:34:06 96cca5efb0 Short-circuit TupleDomain overlaps

01-10 13:02:01 204d3d552c Migrate some occurances of fail() to assertThatThrownBy

01-11 01:07:50 2bcb18433c Test public method instead of its implementation detail

01-11 01:07:50 aa06af70f2 Remove meaningless test cases

01-11 01:07:50 c130d446b5 Add more SortedRangeSet tests

01-11 05:17:38 2bbed53190 Remove dead code

01-11 05:17:38 c5d893bb51 Remove redundant toIntExact invocation on int

01-11 05:17:38 ffebdf3764 Update limitations documented in Type.getJavaType

01-11 05:23:34 07a9700f3e Remove redundant picocli TypeConverters

01-11 05:23:34 0b02df209a Update picocli to 4.6.1

01-11 05:23:34 0c81a51e59 Describe default values in env up command

01-13 03:44:15 1bf1951d02 Update maven-shade-plugin to 3.2.4

01-13 13:46:32 82e8f93ab3 Represent SortedRangeSet as a sorted list

01-13 13:46:32 82eb511903 Benchmark SortedRangeSet methods

01-13 13:46:32 e3a5764f2c Remove unused Range, Marker serialization

01-13 14:31:07 1d1de54043 Prefer java functional interfaces over Guava

01-13 14:44:07 330b51ca25 Allow TrinoDriver to specify user to run query as

01-14 02:04:14 222f761f1f Support LZO-compressed Sequencefile table

01-14 02:04:14 7df8ff4910 Remove unused test dependencies

01-14 02:04:14 c4932215ab Remove unused enum option

01-15 13:02:36 bbc42c02f8 Report server version for "Compiler failed"

01-17 13:10:32 4c36acf1cc Use onHive() to access Hive query executor

01-18 02:29:26 0df459fcac Allow passing --session-user in the CLI

01-18 03:53:45 0b4a46a040 Extract helper session to separate class

01-18 03:53:45 1623ab52d2 Inline returned expression

01-18 03:53:45 ece6227539 Show actual values in Range#toString

01-18 05:22:41 165b439855 Update error-prone to 2.5.1

01-19 03:07:18 6bcff55fdc Remove obsolete conversion

01-19 03:07:18 d49a952f55 Inline SqlServerClient.toColumnMapping(JdbcTypeHandle)

01-19 05:03:35 a306082e79 Enable UseEnumSwitch error-prone check

01-19 07:22:20 2425b7b841 Update assertJ core to 3.18.1

01-20 04:17:53 549a4078b4 Rename errorprone profile

01-20 05:07:12 a51bf68e13 Remove use of test priorities and dependsOnMethods from Prometheus tests

01-20 14:35:31 1144a5b2cf Enable FallThrough error-prone check

01-20 14:35:31 23ba76fc2d Indicate no fall-through in switch

01-20 14:35:31 55df60d3ba Indicate intentional switch fall through with a comment

01-20 14:35:31 811b11ab73 Remove redundant curly brackets

01-20 14:35:31 de20cd8e64 Add missing break in switch in test

01-22 04:29:12 db906c366c Deprecate JdbcClient.supportsGroupingSets

01-22 04:29:25 4abdb4895a Give column a name

01-22 04:29:25 bb7ef110ef Simplify SQL Server limit function

01-22 07:07:00 126bbf7290 Separate query rendering from statement creation in QueryBuilder

01-22 07:07:00 2171a20ba0 Remove redundant aliases in generated queries

01-22 07:07:00 a6331523f9 Deprecate QueryBuilder.buildSql

01-22 07:07:00 a9565d6f18 Simplify DruidJdbcClient.buildSql override

01-22 07:17:34 13819b69a5 Rename test helper

01-22 07:17:34 18540cf468 Expose H2 database name in TestingDatabase

01-22 07:17:34 926a531206 Remove unused import

01-22 07:17:34 a11d2087af Allow matching multiple nodes in isNotFullyPushedDown

01-22 07:17:34 fb49b1ca12 Add more pushdown tests

01-22 14:06:44 232c3f47a9 Use connectorProperties map instead of individual parameters for Oracle

01-22 14:06:44 b35fb0626b Test Oracle case insensitive mapping

01-22 14:09:27 f0b20a9b7b Add geospatial plugin to start from default server main

01-25 01:25:54 02b59cd274 Use Query-based table handles in JDBC connectors

01-25 01:25:54 6442c96f60 Accept PreparedQuery in QueryBuilder

01-25 01:25:54 75baaaed7c Represent query-based relation in JdbcTableHandle

01-25 01:25:54 96c3e0c588 Remove Presto reference

01-25 01:25:54 a66bde67f8 Remove JdbcColumnHandle.isSynthetic

01-25 05:05:51 090cc95e41 Pick Jackson version 2.11.4 from airbase

01-25 05:05:51 5ca5f82b64 Pick Joda version 2.10.9 from airbase

01-25 05:09:27 2d27a5f887 Document why covar_samp and covar_pop pushdowns are not implemented for SQL Server

01-27 04:20:48 9876d32829 Add pushdown for statistical aggregate functions to MySQL connector

01-27 14:13:49 27d6f2477a Add pattern for multi-variable aggregation functions

01-28 07:35:09 4a9a55fbd5 Document statistical aggregation function pushdown for MySQL

01-28 07:51:56 133a084b65 Do not install SystemAccessControl on workers in tests

Pratham

[x] all checked

01-06 13:57:11 09e1c02c09 Implement getTableProperties for Iceberg Connector

01-06 13:57:11 2e5733cf82 Extract method for computing identity partition column ids

01-06 13:57:11 6841634a4e Move some helper methods to IcebergUtil

01-12 12:41:55 7fd62db50a Rename various Presto references to Trino

01-14 09:49:15 1b4dfe0ba7 Fix example reference in resource groups documentation

01-14 12:57:24 07e53e8c34 Rename test file to use Trino instead of Presto

01-19 14:02:00 97bbafa0e2 Add property to allow fetching file sizes in Trino

Praveen Krishna

[x] all checked

01-04 05:43:51 23a4334145 Pass ParsedSchema to SchemaParser

01-06 01:23:55 15f5e8704a Drop table and other objects in SQL Server tests

01-06 01:23:55 1627f499da Get Data compression only for non-indexed SQL Server tables

01-06 01:23:55 65d482c572 Optimize query to match schema name

01-11 06:43:14 0020d49e4b Use testing docker images from GHCR

01-11 18:27:27 c9a9f9c4a7 Inject SchemaRegistryClient via Provider

01-22 02:10:21 ababf74413 Add docs for data_compression table property in SQLServer

Yuya Ebihara

[x] all checked

01-05 00:16:30 663f8a57ab Add support for version function

01-24 15:24:03 92fef2cb67 Document square bracket and quote example of json path

01-24 21:35:09 152abe9c16 Add test for aggregating BigQuery view more than once

01-24 21:35:09 54beed2b7b Upgrade Google Could library bom to 16.3.0

Łukasz Osipiuk

[ ] all checked

01-04 05:18:50 2aa8c2072e Add coercion test filtering rules for Hive 2.1

01-05 01:15:32 07793e9ddf Add tests for querying Hive views with timestamps

01-05 01:15:32 4c69b49d8c Add hive_timestamp_nanos catalog to product tests

01-05 01:15:32 6264f214d4 Add test for querying Presto view referencing Hive table with timestamps

01-05 01:15:32 a646556763 Extract method

01-05 01:15:32 d3b0c523b3 Drop improper contant use

01-05 01:15:32 dbbe3cf4e4 Select role for all catalogs

01-05 09:12:07 39a99451b4 Expose AWS HTTP Client stats via JMX

01-08 03:22:43 3e5ea6537d Use method reference

01-08 03:22:43 468e13405a Replace negated isPresent with isEmpty

01-08 03:22:43 4e51233cc1 Remove redundant casts

01-08 03:22:43 5bec883951 Make fields final

01-08 03:22:43 6fea78a62c Simplify assertion

01-08 03:22:43 85e2f43f54 Enable StaticQualifiedUsingExpression error check

01-08 03:22:43 995838530c Remove unneeded field

01-08 03:22:43 bc77f13b04 Inline redundant variable

01-08 03:22:43 c5d0b68f4b Access method in static manner

01-08 03:22:43 d0e1bb0f5a Simplify building collection out of stream

01-08 03:22:43 d202aad712 Drop unneeded modifier

01-08 03:22:43 d52d60de96 Use UTF_8 constant

01-08 03:22:43 ecde09c3f8 Drop unneeded semicolon

01-11 10:12:48 9b44633be4 Refactor TestHiveCoercion

01-12 08:25:54 f689de4ed4 Enable views in BigQuery tests

01-12 11:23:03 462515f0a2 Fix TestBigQueryIntegrationSmokeTest.testShowCreateTable

01-13 14:59:16 60fccde704 Remove redundant strategy.fail-fast from MemSQL CI

01-14 01:31:04 4be5220d43 Conditionally run BigQuery tests which require GCE access

01-14 01:31:04 d73b9989f3 Extract BigQuery tests as separete CI job

01-15 06:25:15 c55c54c69e Retry Hive queries that fail with 'Error committing write to Hive'

01-19 13:27:08 139412fe0c Enable ImmutableSetForContains error-prone check

01-19 13:27:08 b3a10cc9af Enable UnnecessaryMethodReference error-prone check

01-19 13:27:08 efb1efa534 Enable OptionalMapUnusedValue error-prone check

01-19 13:27:08 fbbccf64c7 Enable UnnecessaryOptionalGet error-prone check

01-20 01:50:53 ee613cb18e Update airbase to 106

01-20 04:57:21 b9d31a2f61 Remove unnecessary exclusions

01-20 04:57:21 cd3c19217a Remove dependency after upgrading to Guava 30.1

01-22 10:48:42 070b8cc358 Detect and enable snapshot isolation if available for SqlServer

01-25 01:54:25 cb7d7760b6 Move listApplicableTablePrivileges to SqlStandardAccessControl

01-25 01:54:25 db8ec39b2e Make ThriftMetastoreUtil not depend on SemiTransactionalHiveMetastore

01-25 01:54:25 f6462190d9 Make method private

01-25 02:22:50 d2845e0bcf Remove repeated error-prone check

01-25 23:59:02 91e0f05fcd Add getTableTypes extension point to BaseJdbcClient

01-27 02:35:21 4a026ff28c Use correct container log path for Trino nodes

01-28 03:59:57 056c0e2bb8 Add a backup Coordinator to test multi coordinators

release-notes
opened by findepi 45
Replace deprecated driver ru.yandex.clickhouse.ClickHouseDriver
Fixes: #10541

The driver ru.yandex.clickhouse.ClickHouseDriver has been marked as deprecated. Also everything in package ru.yandex.clickhouse will be removed starting from 0.4.0.

Here are some things I've done for review:

[x] Check if there are compatibility issues between com.clickhouse.jdbc.ClickHouseDriver and ru.yandex.clickhouse.ClickHouseDriver

[x] Replace all ru.yandex.clickhouse.ClickHouseDriver

[x] Run all tests underplugin/trino-clickhouse/src/test/java/io/trino/plugin/clickhouse

cla-signed
opened by tangjiangling 44
Iceberg: refactor IcebergMetadata to support multiple catalogs
Hi, this is Jack from AWS Athena. As Iceberg recently released 0.11.0, users can now dynamically load Catalog and FileIO implementations. This feature is already supported in Spark and Flink, but Trino's Iceberg connector is strongly coupled with Hive and cannot easily integrate with this feature. We believe that doing this integration can enable a much broader use case for Iceberg through Trino, as Iceberg is now supporting more and more new catalogs like GlueCatalog, NessieCatalog, JdbcCatalog. It will also provide a generic solution for PRs like #6528. There are 2 major blockers we see for integration:

All metadata information are retrieved directly through HiveMetastore rather than Iceberg's Catalog

Reading and writing file has to go through the HdfsEnvironment to leverage existing source and sink in the Hive connector

In this PR, we propose the following approach to update Iceberg connector to complete the integration. The approach is a modified version of our internal Iceberg connector implementation and updated based on the current Trino codebase:

IcebergConfig is treated as the place to load Iceberg catalog properties

IcebergResourceFactory is introduced to load Catalog and FileIO based on session and config information.

IcebergGenericMetadata is introduced to perform all the metadata operations instead of IcebergMetadata.

Please note that we do not want to deprecate the current IcebergMetadata. We think it can be renamed to IcebergHiveMetadata (I did not do in this PR to avoid too many file changes) and extend the generic metadata. The key reason to continue using it would be to leverage Hive's native security features. For example, some APIs such as setSchemaAuthorization are not supported natively in Iceberg.

IcebergMetadataFactory is used to load the correct metadata class based on a flag in Iceberg config.

page source and sink do not need to use Hive's implementations such as HdfsParquetPageSource. In this PR, we only show an example Parquet read code path, which introduces IcebergParquetPageSource that is built upon Iceberg's native SeekableInputStream.

So after all these changes, user can even run this connector without a Hadoop or Hive environment. For example, I am able to start the connector and do a read query of my existing Iceberg warehouse on AWS Glue and S3 with the following configurations:

connector.name=iceberg iceberg.metadata-impl=io.trino.plugin.iceberg.IcebergGenericMetadata iceberg.catalog-impl=org.apache.iceberg.aws.glue.GlueCatalog iceberg.io-impl=org.apache.iceberg.aws.s3.S3FileIO iceberg.warehouse=s3://my-bucket

Please note that this is a draft for discussion, I did not take time to fix unit tests and only tested directly through SQL in CLI. If we can agree on the general approach after discussion, I will start to put this draft into smaller PRs for contribution. I will also post some discussion points as comments in code.
cla-signed
opened by jackye1995 44
Support execution by operator for table functions
Description

Adds execution by operator for table functions having input tables. Any positive number of input tables is supported, involving both set and rows semantics, and co-partitioning.

Based on https://github.com/trinodb/trino/pull/14566

Execution by operator for table functions without table inputs is not yet supported. Tests are not yet complete, there are just some initial test cases. Some optimizations are not yet done, e.g. hash generation, column pruning, node pruning based on PRUNE WHEN EMPTY property of the input.

Release notes

( ) This is not user-visible or docs only and no release notes are required. ( ) Release notes are required, please propose a release note for me. (X) Release notes are required, with the following suggested text:

# General * Support table functions with table arguments. ({issue}`1839`)
cla-signed
opened by kasiafi 0
Make dynamic filter limit remove only bigger channels
Description

Up to this point, when dynamic filter went beyond the threshold all channels fall back to the min/max range predicate. Now the biggest channel falls back, while the rest continue to be gathered as a set of values. This way if a single channel is too big, it won't prevent other, smaller ones to be used as a dynamic filter.

Additional context and related issues

Release notes

( ) This is not user-visible or docs only and no release notes are required. ( ) Release notes are required, please propose a release note for me. (x) Release notes are required, with the following suggested text:

# Section * Fix some things. ({issue}`issuenumber`)
cla-signed
opened by skrzypo987 0
Check system table type only when dealing with an Iceberg table

Description

Additional context and related issues

Release notes

(x) This is not user-visible or docs only and no release notes are required. ( ) Release notes are required, please propose a release note for me. ( ) Release notes are required, with the following suggested text:
cla-signed tests:hive no-release-notes

opened by findinpath 0
Support gen_point type in Elasticsearch connector
Description

When we query the geo_point type data in Elasticsearch, an error "Column 'latlon' cannot be resolved" will be reported, and "latlon" is geo_point type data. It indicates that the query geo_point type data is not supported. In trino-elasticsearch, it is found that there is no query that supports geo_point type data. We have added the function of geo_point type query in Elasticsearch.

Additional context and related issues

Release notes

( ) This is not user-visible or docs only and no release notes are required. ( ) Release notes are required, please propose a release note for me. ( ) Release notes are required, with the following suggested text:

# Section * Fix some things. ({issue}`issuenumber`)
opened by zhouxin3200 1
Move handling of internal retry error when schema already exist for Hive
Description

HiveMetadata used SemiTransactionalHiveMetastore which delays method executions until commit is invoked. Due to that catching SchemaAlreadyExistsException in HiveMetadata::createSchema was not enough as exception was not thrown there.

Proposed solution moves schema already exists error handling to SemiTransactionalHiveMetastore class.

Fixes #15174

Additional context and related issues

Release notes

( ) This is not user-visible or docs only and no release notes are required. ( ) Release notes are required, please propose a release note for me. ( x) Release notes are required, with the following suggested text:

# Section * Fix incorrect `schema already exists` error caused by a client timeout when creating a new schema. ({issue}`15174`)
cla-signed tests:hive
opened by pajaks 0