Clint Wylie
abf9843e2a
fail complex type 'serde' registration when registered type does not match expected type ( #7985 )
...
* make ComplexMetrics.registerSerde type check on register, resolves #7959
* add test
* simplify
* unused imports :/
* simplify
* burned by imports yet again
* remove unused constructor
* switch to getName
* heh oops
2019-07-11 23:03:15 -07:00
Chi Cao Minh
da3d141dd2
Add inline firehose ( #8056 )
...
* Add inline firehose
To allow users to quickly parsing and schema, add a firehose that reads
data that is inlined in its spec.
* Address review comments
* Remove suppression of sonar warnings
2019-07-11 21:43:46 -07:00
Parag Jain
6c35da3c5d
write value of bitmap as field name ( #8066 )
...
* write value of bitmap as field name
* respect nulls if present in dictionary
* removed unused import
2019-07-11 19:29:46 -07:00
Alexander Saydakov
4b176ad265
force native order when wrapping ByteBuffer since Druid can have it set ( #8055 )
...
incorrectly
2019-07-11 17:17:53 -07:00
Atul Mohan
631cda649b
Include replicated segment size property for datasources endpoint ( #8039 )
...
* Add replication size
* Summon comma
2019-07-11 01:10:38 -07:00
Clint Wylie
349b743ce0
fix master branch build ( #8057 )
2019-07-10 14:58:10 -07:00
Himanshu
14aec7fcec
add config to optionally disable all compression in intermediate segment persists while ingestion ( #7919 )
...
* disable all compression in intermediate segment persists while ingestion
* more changes and build fix
* by default retain existing indexingSpec for intermediate persisted segments
* document indexSpecForIntermediatePersists index tuning config
* fix build issues
* update serde tests
2019-07-10 12:22:24 -07:00
Jihoon Son
fcf56f2330
Add IS_INCREMENTAL_HANDOFF_SUPPORTED for KIS backward compatibility ( #8050 )
...
* Add IS_INCREMENTAL_HANDOFF_SUPPORTED for KIS backward compatibility
* do it for kafka only
* fix test
2019-07-10 08:29:37 -07:00
Vadim Ogievetsky
4e3314f675
remove IRC badge from readme ( #8052 )
2019-07-10 08:29:19 -07:00
Vadim Ogievetsky
1712158734
added replicated size ( #8043 )
2019-07-10 08:29:05 -07:00
Jihoon Son
0a3538b569
Fix license check in travis and make it optional ( #8049 )
...
* Fix license check in travis and make it optional
* debug
* fix build
* too loud maven
* move MAVEN_OPTS to top and add comments
* adjust script
* remove mvn option from python script
2019-07-09 19:35:29 -07:00
Vadim Ogievetsky
8493bd5c1c
Web console: added bulk supervisor actions ( #8028 )
...
* added bulk supervisor actions to the web console
* improve async action dialog
* fix tests
2019-07-09 17:31:23 -07:00
Sashidhar Thallam
3353da2974
Adding missing docs for druid.indexer.logs.disableAcl ( #8046 )
2019-07-09 16:11:25 -07:00
Gian Merlino
338b8b3fef
SupervisorManager: Add authorization checks to bulk endpoints. ( #8044 )
...
The endpoints added in #6272 were missing authorization checks. This patch removes the bulk
methods from SupervisorManager, and instead has SupervisorResource run the full list through
filterAuthorizedSupervisorIds before calling resume/suspend/terminate one by one.
2019-07-09 13:16:54 -07:00
Parag Jain
027291a90d
set DRUID_AUTHORIZATION_CHECKED attribute for router endpoints ( #8026 )
...
* add state resource filter to router endpoints
* add RouterResource to ResourceFilter test framework
2019-07-09 00:51:36 -07:00
Jihoon Son
12f12676e3
Binary license management system ( #7998 )
...
* Binary license management system
* add missing file
* add comment
* Address comments
* print missing licenses
* print druid module name
* Add missing licenses and update versions
* fix library versions and add missing ones. also fix pom.xml
* testing multi thread
* Parallel report generation
* fix build error
* install pyyaml and use old api
* install python3
* fix travis script
* python3.6
* pip
* setuptools
* python3-setuptools
* address comment
* error on not found reports or registered licenses
* removed licenses
* debug
* travis debug
* add missing licenses
* travis debug
* debug
* remove debug code
* test build script
* travis debug
* still debug
* add missing python lib
* debug
* debug
* fix travis
* fix travis
* debug travis
* flush print
* print something more to keep travis alive
* adjust print
* single threaded
* single threaded
* debug
* debug
* remove debug
* remove deprecated-2017Q4 from travis conf
* remove comments and duplicate sudo
2019-07-08 12:24:51 -07:00
Roman Leventov
f2e4e654b2
Add instruction about skipping up-to-date checks when running integration tests ( #7843 )
2019-07-08 13:44:32 +05:30
Sashidhar Thallam
6701dc08fe
Making StatusResponseHandler singleton and fixing all its instantiation invocations ( #7969 )
...
* Making StatusResponseHandler singleton and fixing all its instantiation invocations
* Using StatusResponseHandler.getInstance() where applicable
2019-07-08 13:33:00 +05:30
Fokko Driesprong
0aabeb4b1a
Enable Spotbugs: MS_OOI_PKGPROTECT ( #8022 )
2019-07-08 13:17:56 +05:30
Eyal Yurman
2eee711653
Add missing reference to Materialized-View extension. ( #8003 )
...
* Reference Materialized View extension from extensions page.
* Add comma
2019-07-06 13:50:41 -07:00
Chi Cao Minh
1166bbcb75
Remove static imports from tests ( #8036 )
...
Make static imports forbidden in tests and remove all occurrences to be
consistent with the non-test code.
Also, various changes to files affected by above:
- Reformat to adhere to druid style guide
- Fix various IntelliJ warnings
- Fix various SonarLint warnings (e.g., the expected/actual args to
Assert.assertEquals() were flipped)
2019-07-06 09:33:12 -07:00
Vadim Ogievetsky
4f4cda3ec9
fix query input undo ( #8033 )
2019-07-06 09:21:53 -07:00
Vadim Ogievetsky
2de6cc3b30
fix segment table filter ( #8034 )
2019-07-06 09:21:28 -07:00
Dinesh Sawant
9c7c7c58ae
Fix overlord port in delete data tutorial ( #8037 )
...
In Single-Server Quickstart tutorial the overlord and coordinator
is started as one process on port 8081. But in delete data tutorial the kill
task is sent to 8090 port, which fails.
2019-07-06 08:50:01 -07:00
Chi Cao Minh
0ded0ce414
Add round support for DS-HLL ( #8023 )
...
* Add round support for DS-HLL
Since the Cardinality aggregator has a "round" option to round off estimated
values generated from the HyperLogLog algorithm, add the same "round" option to
the DataSketches HLL Sketch module aggregators to be consistent.
* Fix checkstyle errors
* Change HllSketchSqlAggregator to do rounding
* Fix test for standard-compliant null handling mode
2019-07-05 15:37:58 -07:00
Gian Merlino
9b499df14e
Fix ExpressionVirtualColumn capabilities; fix groupBy's improper uses of StorageAdapter#getColumnCapabilities. ( #8013 )
...
* GroupBy: Fix improper uses of StorageAdapter#getColumnCapabilities.
1) A usage in "isArrayAggregateApplicable" that would potentially incorrectly use
array-based aggregation on a virtual column that shadows a real column.
2) A usage in "process" that would potentially use the more expensive multi-value
aggregation path on a singly-valued virtual column. (No correctness issue, but
a performance issue.)
* Add addl javadoc.
* ExpressionVirtualColumn: Set multi-value flag.
2019-07-05 13:17:05 -07:00
Clint Wylie
0344a020bb
optimize single string dimension expression selector ( #8014 )
...
* optimize single string dimension expression selector
* more javadoc
* oops
* fix
* fix it
* import
2019-07-04 16:26:10 -07:00
Clint Wylie
42a7b8849a
remove FirehoseV2 and realtime node extensions ( #8020 )
...
* remove firehosev2 and realtime node extensions
* revert intellij stuff
* rat exclusion
2019-07-04 15:40:22 -07:00
Gian Merlino
613f09b45a
SQL: Add TIME_CEIL function. ( #8027 )
...
Also simplify conversions for CEIL, FLOOR, and TIME_FLOOR by allowing them to
share more code.
2019-07-04 15:40:03 -07:00
Himanshu
6760505a7e
fix FileUtils performance regression due to FilterOutputStream ( #8024 )
2019-07-04 08:41:17 -07:00
Clint Wylie
e6ba258197
multi-value string expression transformation fix ( #8019 )
...
* multi-value string expression transformation fix
* fixes
* more docs and test
* revert unintended doc change
* formatting
* change tostring to print binding identifier
* review fixup
* oops
2019-07-03 23:03:47 -07:00
Gian Merlino
685aeac8eb
CONTRIBUTING: Remove "keep the number of commits small" guidance. ( #8004 )
...
It is no longer really relevant in the world we have of committing
via merge-and-squash.
2019-07-03 11:53:41 -07:00
Clint Wylie
53a32b6f55
adjust PR template ( #8016 )
2019-07-03 08:31:31 -07:00
Clint Wylie
3b84246cd6
add SQL docs for multi-value string dimensions ( #8011 )
...
* add SQL docs for multi-value string dimensions
* formatting consistency
* fix typo
* adjust
2019-07-03 08:22:33 -07:00
Clint Wylie
c556d44a19
more sql support for expression array functions ( #7974 )
...
* more sql support for expression array functions
* prepend/slice
* doc fixes
* fix imports
* fix tests
* add null numeric expr for proper conversions between ExprEval and Expr and back to ExprEval
* re-arrange
* imports :(
* add append/prepend test
2019-07-02 21:39:26 -07:00
Clint Wylie
f7283378ac
remove deprecated standalone realtime node ( #7915 )
...
* remove CliRealtime, RealtimeManager, etc
* add redirects for deleted page to page that explains the deleted thing
* adjust docs
2019-07-02 18:12:17 -07:00
Clint Wylie
93b738bbfa
expression language array constructor and sql multi-value string filtering support ( #7973 )
...
* expr array constructor and sql multi-value string support
* doc fix
* checkstyle
* change from feedback
2019-07-01 15:14:50 -07:00
Khwunchai Jaengsawang
fb56f8d53c
Rename io.druid to org.druid in tdigestsketch extension ( #7996 )
...
* Rename io.druid to org.druid in tdigestsketch extension
* Fix typo
Signed-off-by: Khwunchai Jaengsawang <khwunchai.j@ku.th>
* Add packaging check for community extensions
Signed-off-by: Khwunchai Jaengsawang <khwunchai.j@ku.th>
2019-07-01 12:46:35 -07:00
Eyal Yurman
3650eed1aa
Improve pull-deps reference in extensions page. ( #8002 )
2019-07-01 11:18:27 -07:00
Fokko Driesprong
4508d3ff55
Enable RCN_REDUNDANT_NULLCHECK_OF_NULL_VALUE ( #7972 )
2019-07-01 11:25:06 +05:30
Fokko Driesprong
e8dedb3de4
Enable MS_MUTABLE_COLLECTION_PKGPROTECT ( #7971 )
2019-07-01 11:24:05 +05:30
Vadim Ogievetsky
f16f13cf61
Web console: Improve data loader styling, enforce stricter TS types ( #8001 )
...
* add assets to auth exclude path
* add frame to tile page
* better empty filter state
* strict TS
* fix segments go to sql
* add unavailable segments
* factor out sugestable input
* fix tests
* update datasources sql
* no depricated extend
* add index spec to tuning configs
* fix scss lint
2019-06-30 19:33:16 -07:00
Xue Yu
2831944056
support NVL sql function ( #7965 )
...
* sql nvl
* add nvl in sql doc
2019-06-30 13:14:30 -07:00
Benedict Jin
6395c08309
Bump commons-codec from 1.7 to 1.12 ( #7995 )
2019-06-29 07:40:19 -07:00
mcbrewster
f1270c14f8
Web-Console: add clipboard modal ( #7964 )
...
* add clipboard modal
* rename button
* remove console.log
* fix off by one
* update tests
* update snapshot
* fix casing
* update snapshot
2019-06-28 15:50:18 -07:00
Benedict Jin
8788849bab
Bump commons-validator from 1.4.0 to 1.5.1 ( #7987 )
2019-06-27 22:00:49 -07:00
Jihoon Son
f148249f64
Fix wrong redirect for orc extension ( #7983 )
2019-06-27 16:27:08 -07:00
Alexander Saydakov
f38a62e949
theta sketch to string post agg ( #7937 )
2019-06-27 15:09:57 -07:00
Vadim Ogievetsky
ad45ef12ed
fix SQL doc comment ( #7981 )
2019-06-27 15:05:45 -07:00
Jihoon Son
c4aaf26797
Add missing redirect for ORC extension document ( #7979 )
2019-06-27 14:23:44 -07:00