d4311b4a5a
Support enablePathStyleAccess, disableChunkedEncoding, and forceGlobalBucketAccessEnabled for aws client ( #5702 )
...
* Support enablePathStyleAccess and disableChunkedEncoding for aws client
* add an option for forceGlobalBucketAccessEnabled
* add missing doc
2018-05-02 10:45:38 -07:00
e2431ae161
Update defaultHadoopCoordinates in documentation. ( #5720 )
...
* Update defaultHadoopCoordinates in documentation.
To match changes applied in #5382 .
* Remove a parameter with defaults from example configuration file.
If it has reasonable defaults, then why would it be in an example config file?
Also, it is yet another place that has been forgotten to be updated and will be forgotten in the future.
Also, if someone is running different hadoop version, then there's much more work to be done than just changing this property, so why give users false hopes?
* Fix typo in documentation.
2018-04-30 20:49:14 -07:00
a0c2ae7a38
Fix NullPointerException when in DeterminePartitionsJob for Hadoop 3.0 and later versions ( #5724 )
...
In DeterminePartitonsJob -
config.get("mapred.job.tracker").equals("local") throws NPE as the
property name is changed in hadoop 3.0 to mapreduce.jobtracker.address
This patch extracts the logic to fetch jobTrackerAddress in JobHelper
and reuses it when needed.
2018-04-30 20:41:58 -07:00
754c80e74a
Fix quickstart docs to specify that Java 8 is required. ( #5722 )
...
See #4907 #5719
2018-04-30 13:25:59 -07:00
0f8493846e
Replace dev list references in docs. ( #5723 )
2018-04-30 11:25:45 -07:00
8ec2d2fe18
Use unique segment paths for Kafka indexing ( #5692 )
...
* support unique segment file paths
* forbiddenapis
* code review changes
* code review changes
* code review changes
* checkstyle fix
2018-04-29 21:59:48 -07:00
762f8829e4
Add task action metrics, add taskId metric dimension. ( #5714 )
...
* Add task action metrics, add taskId metric dimension.
Adds two new metrics: task/action/log/time and task/action/run/time. Also
adds taskId as a dimension, to give us the ability to drill down into metrics
for an individual task. Also standardizes metrics-attachment using two helper
methods in IndexTaskUtils.
* Fix typo
2018-04-29 21:24:06 -07:00
90cd05696e
Document processing properties required for Middlemanager ( #5660 )
2018-04-29 17:20:17 -07:00
23dc0d5b24
Better logging for taskLockBox ( #5703 )
2018-04-28 21:08:10 -07:00
513fab77d9
Lazy init of fullyQualifiedStorageDirectory in HDFS pusher ( #5684 )
...
* Lazy init of fullyQualifiedStorageDirectory in HDFS pusher
* Comment
* Fix test
* PR comments
2018-04-28 21:07:39 -07:00
4db9e39a71
fix NPE when buffersList contains null in SmooshedFileMapper ( #5689 )
...
* fix NPE when buffersList contains null
* address the comment
2018-04-27 18:15:04 -07:00
86746f82d8
Use mergeBuffer instead of processingBuffer in parallelCombiner ( #5634 )
...
* Use mergeBuffer instead of processingBuffer in parallelCombiner
* Fix test
* address comments
* fix test
* Fix test
* Update comment
* address comments
* fix build
* Fix test failure
2018-04-27 18:14:37 -07:00
9be000758d
Refactor index merging, replace Rowboats with RowIterators and RowPointers ( #5335 )
...
* Refactor index merging, replace Rowboats with RowIterators and RowPointers
* Add javadocs
* Fix a bug in QueryableIndexIndexableAdapter
* Fixes
* Remove unused declarations
* Remove unused GenericColumn.isNull() method
* Fix test
* Address comments
* Rearrange some code in MergingRowIterator for more clarity
* Self-review
* Fix style
* Improve docs
* Fix docs
* Rename IndexMergerV9.writeDimValueAndSetupDimConversion to setUpDimConversion()
* Update Javadocs
* Minor fixes
* Doc fixes, more code comments, cleanup of RowCombiningTimeAndDimsIterator
* Fix doc link
2018-04-27 17:34:32 -07:00
71ecb71dcf
Add DataSegmentFinder for Google Storage adapter ( #5686 )
...
Partially fixes #5628
2018-04-26 14:00:49 -07:00
f81855d607
Add unauthorized errorCode to query docs. ( #5691 )
2018-04-26 13:06:25 -07:00
dc786ebc4c
SQL: Remove some unused code. ( #5690 )
2018-04-24 11:42:16 -07:00
034a0aa42b
Fix wrong null check in TaskStatusPlus ( #5678 )
2018-04-24 10:59:29 -07:00
2e76012aca
Allow GCS data segment killer to delete if present ( #5675 )
2018-04-24 07:16:54 -07:00
fd76af9737
remove old prod cluster config link ( #5676 )
2018-04-23 18:00:24 -07:00
73da7426da
Timeseries results are incoherent for case interval is out of range and case false filter. ( #5649 )
...
* adding some tests
Change-Id: I92180498e2e6695212b286d980e349c136c78c86
* added empty sequence runner
Change-Id: I20c83095072bbf3b4a3a57dfc1934d528e2c7a1a
* treat only granularity ALL
Change-Id: I1d88fab500c615bc46db4f4497ce93089976441f
* moving toList within If and add expected queries
Change-Id: I56cdd980e44f0685806efb45e29031fa2e328ec4
* typo
Change-Id: I42fdd28da5471f6ae57d3962f671741b106300cd
* adding tests and fix logic of intervals
Change-Id: I0bd414d2278e3eddc2810e4f5080e6cf6a117f12
* fix style
Change-Id: I99a2380934c9ab350ca934c56041dc343c08b99f
* comments review
Change-Id: I726a3b905a9520d8b1db70e4ba17853c65c414a4
2018-04-23 15:55:18 -07:00
55b003e5e8
Fix loadstatus?full double counting expected segments ( #5667 )
...
* fix loadstatus?full double counting expected segments
* remove possible flakiness from Thread.sleep() in test
2018-04-24 01:11:16 +05:30
a3a9ada843
Add GenericWhitespace checkstyle check ( #5668 )
2018-04-24 01:09:14 +05:30
ca3f833426
Fix coordinator's dataSource api with full parameter ( #5662 )
...
* Fix coordinator's dataSource api with full parameter
* address comment
* Add a constructor for json serde and fix result order
* Change to immutableSortedMap
* Revert immutableSortedMap to treeMap
2018-04-19 17:41:53 -07:00
15f4ab2b31
Expose noop filter to users ( #5597 )
2018-04-18 07:57:07 -07:00
5d09f76df6
topN: Fix caching of Float dimension values. ( #5653 )
...
Jackson would deserialize them as Doubles, leading to ClassCastExceptions
in the topN processing pipeline when it attempted to treat them as Floats.
2018-04-17 15:35:18 -07:00
a7ba2bf275
Detailed error message when unable to create temp dir ( #5648 )
2018-04-17 15:12:46 -07:00
8e441cd142
Fix cache bug in stats module ( #5650 )
2018-04-17 15:11:03 -07:00
fbf3fc178e
Timeseries: Add "grandTotal" option. ( #5640 )
...
* Timeseries: Add "grandTotal" option.
* Modify whitespace.
* Checkstyle workaround.
2018-04-16 18:22:19 -07:00
d0b66a6af5
Fix HTTP OPTIONS request auth handling ( #5638 )
...
* Fix HTTP OPTIONS request auth handling
* PR comment
* More PR comments
* Fix
* PR comment
2018-04-16 18:09:56 -07:00
6b3bde0143
Fix granularitySpec doc ( #5647 )
2018-04-16 14:24:39 -04:00
f349e03091
Fix NPE in compactionTask ( #5613 )
...
* Fix NPE in compactionTask
* more annotations for metadata
* better error message for empty input
* fix build
* revert some null checks
* address comments
2018-04-13 00:11:03 -04:00
124c89e435
Replace EmittedBatchCounter and UpdateCounter with ConcurrentAwaitableCounter ( #5592 )
...
* Replace EmittedBatchCounter and UpdateCounter with (both not safe for concurrent increments/updates) with ConcurrentAwaitableCounter (safe for concurrent increments)
* Fixes
* Fix EmitterTest
* Added Javadoc and make awaitCount() to throw exceptions on wrong count instead of masking errors
2018-04-13 00:07:11 -04:00
882b172318
Revert "Fix HTTP OPTIONS request auth handling ( #5615 )" ( #5637 )
...
This reverts commit df51a7bcb7
2018-04-12 16:43:54 -07:00
e91add6843
Fix coordinator loadStatus performance ( #5632 )
...
* Optimize coordinator loadStatus
* Add comment
* Fix teamcity
* Checkstyle
* More checkstyle
* Checkstyle
2018-04-12 15:07:52 -07:00
df51a7bcb7
Fix HTTP OPTIONS request auth handling ( #5615 )
...
* Fix HTTP OPTIONS request auth handling
* Flip configuration boolean
2018-04-12 14:02:20 -07:00
d0400a0688
SegmentWithState: Add toString method. ( #5635 )
...
The class appears in log messages, and the default toString method
isn't very informative.
2018-04-12 14:01:09 -05:00
dbea5cb9b7
Load rules should honor partial overlap ( #5595 )
...
Load rules should load segments that partially overlap with rule window,
instead of loading only segments that fully overlap.
2018-04-12 09:46:00 -07:00
19f359957f
Add getters for AlertEvent ( #5522 )
...
* Add getters for AlertEvent
* Move PublicApi and ExtensionPoint to java-util
* Fix publicapi annotation usage
* Add publicapi annotations to ServiceMetricEvent and RequestLogEvent
2018-04-12 23:38:20 +07:00
48c1a1ef57
change header from Data Schema to Ingestion Spec ( #5631 )
2018-04-11 21:42:54 -07:00
d709d1a59f
correct overlord console header. Because it's not the coordinator console, it's the overlord console. ( #5627 )
2018-04-11 20:44:31 -04:00
72d6dcda4f
ParallelCombiner: Fix buffer leak on exception in "combine". ( #5630 )
...
Once a buffer is acquired, we need to make sure to release it if an
exception is thrown before the closeable iterator is created.
2018-04-11 20:39:39 -04:00
e6efd75a3d
Add config to allow setting up custom unsecured paths for druid nodes. ( #5614 )
...
* Add config to allow setting up custom unsecured paths for druid nodes.
* return all resources for Unsecured paths
* review comment - Add test
* fix tests
* fix test
2018-04-11 17:10:07 -07:00
afa75e04b7
change header in overlord console; minor querydoc change ( #5625 )
...
* change header in overlord console; minor querydoc change
* remove change to overlord console
* address Gian comments
2018-04-11 12:57:22 -07:00
b32aad9ab4
Fix some broken links in druid docs ( #5622 )
...
* Fix some broken links in druid docs
* review comment
2018-04-11 10:27:33 -07:00
ff27c54774
SQL: Remove useless boolean CASTs in filters. ( #5619 )
2018-04-10 23:05:09 +05:30
80fa5094e8
Fix Kerberos Authentication failing requests without cookies and excludedPaths config. ( #5596 )
...
* Fix Kerberos Authentication failing requests without cookies.
KerberosAuthenticator was failing `First` request from the clients.
After authentication we were setting the cookie properly but not
setting the the authenticated flag in the request. This PR fixed that.
Additional Fixes -
* Removing of Unused SpnegoFilterConfig - replaced by
KerberosAuthenticator
* Unused internalClientKeytab and principal from KerberosAuthenticator
* Fix docs accordingly and add docs for configuring an escalated
client.
* Fix excluded path config behavior
* spelling correction
* Revert "spelling correction"
This reverts commit fb754b43d83901047769
2018-04-09 20:45:35 -07:00
ee37ff2502
CompressionUtils: Make gzipInputStream public once again. ( #5590 )
...
But add a reference to "decompress" and mention that it's preferred
when reading from streams that come from files.
2018-04-09 17:39:19 -07:00
3a5d516308
Add missing type for MapVirtualColumn ( #5598 )
2018-04-09 17:37:24 -07:00
685f4063d4
DoublesSketchModule: Fix serde for DoublesSketchMergeAggregatorFactory. ( #5587 )
...
Fixes #5580 .
2018-04-07 06:45:55 -07:00
ad6f234e1e
Update lookups-cached-global.md ( #5525 )
...
Update lookup creation example to work with version 0.12.0
2018-04-06 16:13:17 -07:00
Jihoon Son
Jakub Kukul
Nishant Bangarwa
Dylan Wylie
Gian Merlino
David Lim
Joseph Glanville
Jonathan Wei
kaijianding
Roman Leventov
Erik Dubbelboer
Charles Allen
Caroline1000
Slim Bouguerra
scrawfor
Kirill Kozlov
palanieppan-m
Atul Mohan
Caroline1000
Alexander T