cd6083fb94
Add back `UnnecessaryFullyQualifiedName` rule in pmd ruleset ( #17570 )
...
* Add back UnnecessaryFullyQualifiedName rule in pmd ruleset
* Fix checkstyle
2024-12-17 12:43:12 +05:30
f3d7f1aa96
Adding 3 sets of SQL tests in quidem ( #17548 )
...
Description
Migrate the initial 3 sets of SQL tests to quidem. These 3 sets cover numeric, string, and datetime scalar functions.
These tests use the existing kttm dataset. They aim to exercise SQL queries in a more comprehensive way:
Each scalar function is exercised in 3 different query shapes:
simple query
subquery
group by query
Each query covers all operators in its predicates.
All queries are select count(*) queries. They are designed to all return the same result for easy maintenance and debugging.
These are the initial sets of tests. More tests to cover the rest of the scalar and aggregation functions will come later.
2024-12-11 12:57:37 -08:00
80d2cd3632
snapshot column capabilities for realtime cursors ( #17386 )
...
* snapshot column capabilities for realtime cursors
changes:
* adds `CursorBuildSpec.getPhysicalColumns()` to allow specifying the set of required physical columns from a segment. if null, all columns are assumed to be required (e.g. full scan)
* `IncrementalIndexCursorFactory`/`IncrementalIndexCursorHolder` uses the physical columns from the cursor build spec to know which set of dimensions to 'snapshot' the capabilities for, allowing expression selectors on realtime queries to no longer be required to treat selectors from `StringDimensionIndexer` as multi-valued unless they truly are multi-valued. this fixes several bugs with expressions on realtime queries that change a value from `StringDimensionIndexer` to some type other than string, which would often result in a single element array from the column being handled as multi-valued
* `StringDimensionIndexer.setSparseIndexed()` now adds the default value to the dictionary when set
* `StringDimensionIndexer` column value selectors now always report that they are dictionary encoded, and that name lookup is possible in advance on their selectors (since set sparse adds the null value so the cardinality is correct)
* fixed a mistake that expression selectors for realtime queries with no null values could not use dictionary encoded selectors
* hmm
* test changes
* cleanup
* add test coverage
* fix test
* fixes
* cleanup
2024-12-09 08:44:54 -08:00
20aea29a51
Rename d1/d2 columns in tests ( #17471 )
2024-11-22 14:58:56 +01:00
2eac8318f8
Support Union in Decoupled planning ( #17354 )
...
* introduces `UnionQuery`
* some changes to enable a `UnionQuery` to have multiple input datasources
* `UnionQuery` execution is driven by the `QueryLogic` - which could later enable to reduce some complexity in `ClientQuerySegmentWalker`
* to run the subqueries of `UnionQuery` there was a need to access the `conglomerate` from the `Runner`; to enable that some refactors were done
* renamed `UnionQueryRunner` to `UnionDataSourceQueryRunner`
* `QueryRunnerFactoryConglomerate` have taken the place of `QueryToolChestWarehouse` which shaves of some unnecessary things here and there
* small cleanup/refactors
2024-11-05 16:58:57 +01:00
ca96629207
Add kttm-nested dataset and some usage sessions of it ( #16867 )
...
* Add kttm-nested dataset and some usage sessions of it
Squashed commit of the following:
commit 3075269bdefbbfeeb3c7958751d9c44dd017944f
Author: Zoltan Haindrich <kirk@rxd.hu>
Date: Thu Aug 8 13:48:19 2024 +0000
rename files
commit ad8d37a235a89cdf92ea3c1e9fdda9dff87fa7ce
Author: Zoltan Haindrich <kirk@rxd.hu>
Date: Thu Aug 8 13:44:09 2024 +0000
rename
commit 8fc4efe19eba10e7d6a82042aedec0ec7c04c77c
Author: Zoltan Haindrich <kirk@rxd.hu>
Date: Thu Aug 8 13:43:31 2024 +0000
cleanup kttm loader
commit 113a4b6f4c0a450581600aa7483a5163ee00e937
Author: Zoltan Haindrich <kirk@rxd.hu>
Date: Thu Aug 8 13:38:10 2024 +0000
weed out infoschema stuff
commit 1eb9b5070c16a42a19ab9774d2b0378e090097df
Author: Zoltan Haindrich <kirk@rxd.hu>
Date: Thu Aug 8 13:17:27 2024 +0000
reduce crap
commit 1745ececc77cae93ed9130fd6e9e83fddd44471a
Merge: 9dd2bff6cc 1f8473d82b
Author: Zoltan Haindrich <kirk@rxd.hu>
Date: Thu Aug 8 09:49:52 2024 +0000
Merge branch 'quidem-msq' into quidem-qa
commit 9dd2bff6ccdb30c927a256ff7ab6ebf491508008
Merge: 7120f84e36 fda0d63e444e5d7c9c216cd8c6be224e5d7c9c216cef3eb6e873904b520dad5768e512039d9c88f87a6ba55fa25bc32d56785bc32d56788a92ec6b2edbe2674971ebea34a814dbe267497123c6f3bd9677408329953e2b59f80834651e70e534651e70e5449a7f3a7369a39a42da2700557a552700557a5542cc5d62a8d5b82af4a921016a28a23f507d864819fe5867b1941c39aae500ee182d7591d5d14bf129b2b559d96d38e8f075c3aa033e146d38e8f075f867db774a61c3b16b17130252bb5e3b77784e6e22d8a4b87234ab9113995e5c94d6d893457c6b3e12cfde805ec8f91478106d339d1706181458c8734c722f271f10639487491063948749c40474285cf4af51ef7fbc70443c7f841ab462dd929e68c11afda0d63e44fda0d63e44bb23ace51826e3c44f4b929e68c11a436ba1881570e46eadb9090f937d585e81a026e9bb23ace518bb23ace518e6add9ea84a03fb49f4fc7eacd079e5e81a026e95f6290eb54a03fb49f4fa03fb49f4f5f6290eb54de207c7295b1ab252b314157a8f105ca121aa083ca121aa083eb2a047e4b57980066b3954aaafe0c57980066b37f99ee24d7b345dd9d03df422456859ac26e3a8978b75d3e8ef6cc540368ce667eeb5e4157a8f105ed9ef1f6358bb38a04a5d705c2759ba489e19242d010b488a77428da51de0be1f81d7e7cfbfdc3eee60a200d95a9dcb2da4631e97324ced227029b6bd227029b6bf7247e1bb7b38935a45031e97324cee2a54b5758361149b097bc7174cb6a9cf723adae7a34b6e092d216b934fc76ff3f26e1e388140b2a76ff3f26e1eb4fd9f66ce388140b2a47aeb016df70ff2a3e9706b68b6c8906b68b6c8982436df585b53c26f5c570ff2a3e978b26e490e9c59f1adcc895ca0a9f5db100e982a40811d801fb97c32ca3de6790f9cf8b51d465df6d0eaf4c61b9f3cf77811542b30865128ada2ff23882436df5852a590eb3ae20c543dfc201d67ae54320c543dfc2c559bc3422cc4e0adcbfb8992434a9c559bc34229a4d04a818e7141e20801b7dd8fd3c1b7dd8fd3c1a5faf1afb3dfe5c4a056c02cbdf4d0d76a73c4c9a4d04a81826a16fb4fe0af3b910f1cefdf96a26724212381c26a16fb4fe82f24e61f282f24e61f2eda48497e2d329686d5c6e48cb86d5ebb27cf462604910ceadb2be5abdd5eda48497e24bd80397151a0ab2c3b1fdf115940b169a8dbd1afdf115940b61dd670784dffa33101864a971f893d14b7374ba74c488679b475f5b5830e725df71109df6f3341a036619255475c578ae33e81591499c6dd62fb7c6f5720ce97d7eccf5b518e06e54631ea9952292f247696a61087a65938fd66c6053eee0002c3056d4298a4707132fbd7fe47b0bcfec4c53d75dcea4dc90c88aeab0fb4b32e5b7d1b4587eae88da8d9659ff7abeb0f1295c09a03c07e05a664dff31c14dbaa713b663b06c264f2977ee195719b7a1b7f981fbb20ee993719ae80f05deec2ecde235206363c255ec2ecde235206363c255e4ca09d7564e1de50e30e4ca09d756ad64784a2944ea4e1c514595b0c128ba09e7d1de08b73d196952598d3bca52598d3bcaad64784a29ecdcd0f621453c11f9f5c948201507453c11f9f5652cc2059794f93865e8b7b73fa7fe435b58f101e7e119b559fc9a6c7740cabf2a31c31d2a79f5be1fb9fac15976ffbfb7cfe2986ae612f4c73e149959be71c068607ef174c53658ab24c3bec1f38a0e688611eab393892b6524b63a80e5b7118eb6193928ea884e1927735f2621cab3d945bec9638b78367e10df1ffa4a47b0229e5f552a2997074161dfde55b2051f9d8ee41f58d0d4b052a57973011267afa16f98269943fd8af63c3fbb3cb8533fbb3cb853b7b73fa7fe95789536783132c1278118a4722d113132c12781e36c46a85ae13d560b6edd1905d2ef4d4de51f4fe366192fb5
2024-09-26 15:24:23 +05:30
2eee470f6e
Support explain in decoupled planning and log native plan consistently with DruidHook ( #17101 )
...
* enables to use DruidHook for native plan logging
* qudiem tests doesn't necessarily need to run the query to get an explain - this helps during development as if there is a runtime issue it could still be explained in the test
2024-09-20 10:53:43 +02:00
78775ad398
Prepare master for 32.0.0 release ( #17022 )
2024-09-10 11:01:20 +05:30
408702e100
Add ability to run MSQ in Quidem tests ( #16798 )
...
* implements some jdbc facade to enable msq usage
* adds an !msqPlan command
* adds more guice usage to testsystem startup
2024-08-08 06:37:06 +02:00
26e3c44f4b
Quidem record ( #16624 )
...
* enables to launch a fake broker based on test resources (druidtest uri)
* could record queries into new testfiles during usage
* instead of re-purpose Calcite's Hook migrates to use DruidHook which we can add further keys
* added a quidem-ut module which could be the place for tests which could iteract with modules/etc
2024-08-05 14:58:32 +02:00
Akshat Jain
Andy Tsai
Clint Wylie
Zoltan Haindrich
Abhishek Agarwal