a0c2ae7a38
Fix NullPointerException when in DeterminePartitionsJob for Hadoop 3.0 and later versions ( #5724 )
...
In DeterminePartitonsJob -
config.get("mapred.job.tracker").equals("local") throws NPE as the
property name is changed in hadoop 3.0 to mapreduce.jobtracker.address
This patch extracts the logic to fetch jobTrackerAddress in JobHelper
and reuses it when needed.
2018-04-30 20:41:58 -07:00
754c80e74a
Fix quickstart docs to specify that Java 8 is required. ( #5722 )
...
See #4907 #5719
2018-04-30 13:25:59 -07:00
0f8493846e
Replace dev list references in docs. ( #5723 )
2018-04-30 11:25:45 -07:00
8ec2d2fe18
Use unique segment paths for Kafka indexing ( #5692 )
...
* support unique segment file paths
* forbiddenapis
* code review changes
* code review changes
* code review changes
* checkstyle fix
2018-04-29 21:59:48 -07:00
762f8829e4
Add task action metrics, add taskId metric dimension. ( #5714 )
...
* Add task action metrics, add taskId metric dimension.
Adds two new metrics: task/action/log/time and task/action/run/time. Also
adds taskId as a dimension, to give us the ability to drill down into metrics
for an individual task. Also standardizes metrics-attachment using two helper
methods in IndexTaskUtils.
* Fix typo
2018-04-29 21:24:06 -07:00
90cd05696e
Document processing properties required for Middlemanager ( #5660 )
2018-04-29 17:20:17 -07:00
23dc0d5b24
Better logging for taskLockBox ( #5703 )
2018-04-28 21:08:10 -07:00
513fab77d9
Lazy init of fullyQualifiedStorageDirectory in HDFS pusher ( #5684 )
...
* Lazy init of fullyQualifiedStorageDirectory in HDFS pusher
* Comment
* Fix test
* PR comments
2018-04-28 21:07:39 -07:00
4db9e39a71
fix NPE when buffersList contains null in SmooshedFileMapper ( #5689 )
...
* fix NPE when buffersList contains null
* address the comment
2018-04-27 18:15:04 -07:00
86746f82d8
Use mergeBuffer instead of processingBuffer in parallelCombiner ( #5634 )
...
* Use mergeBuffer instead of processingBuffer in parallelCombiner
* Fix test
* address comments
* fix test
* Fix test
* Update comment
* address comments
* fix build
* Fix test failure
2018-04-27 18:14:37 -07:00
9be000758d
Refactor index merging, replace Rowboats with RowIterators and RowPointers ( #5335 )
...
* Refactor index merging, replace Rowboats with RowIterators and RowPointers
* Add javadocs
* Fix a bug in QueryableIndexIndexableAdapter
* Fixes
* Remove unused declarations
* Remove unused GenericColumn.isNull() method
* Fix test
* Address comments
* Rearrange some code in MergingRowIterator for more clarity
* Self-review
* Fix style
* Improve docs
* Fix docs
* Rename IndexMergerV9.writeDimValueAndSetupDimConversion to setUpDimConversion()
* Update Javadocs
* Minor fixes
* Doc fixes, more code comments, cleanup of RowCombiningTimeAndDimsIterator
* Fix doc link
2018-04-27 17:34:32 -07:00
71ecb71dcf
Add DataSegmentFinder for Google Storage adapter ( #5686 )
...
Partially fixes #5628
2018-04-26 14:00:49 -07:00
f81855d607
Add unauthorized errorCode to query docs. ( #5691 )
2018-04-26 13:06:25 -07:00
dc786ebc4c
SQL: Remove some unused code. ( #5690 )
2018-04-24 11:42:16 -07:00
034a0aa42b
Fix wrong null check in TaskStatusPlus ( #5678 )
2018-04-24 10:59:29 -07:00
2e76012aca
Allow GCS data segment killer to delete if present ( #5675 )
2018-04-24 07:16:54 -07:00
fd76af9737
remove old prod cluster config link ( #5676 )
2018-04-23 18:00:24 -07:00
73da7426da
Timeseries results are incoherent for case interval is out of range and case false filter. ( #5649 )
...
* adding some tests
Change-Id: I92180498e2e6695212b286d980e349c136c78c86
* added empty sequence runner
Change-Id: I20c83095072bbf3b4a3a57dfc1934d528e2c7a1a
* treat only granularity ALL
Change-Id: I1d88fab500c615bc46db4f4497ce93089976441f
* moving toList within If and add expected queries
Change-Id: I56cdd980e44f0685806efb45e29031fa2e328ec4
* typo
Change-Id: I42fdd28da5471f6ae57d3962f671741b106300cd
* adding tests and fix logic of intervals
Change-Id: I0bd414d2278e3eddc2810e4f5080e6cf6a117f12
* fix style
Change-Id: I99a2380934c9ab350ca934c56041dc343c08b99f
* comments review
Change-Id: I726a3b905a9520d8b1db70e4ba17853c65c414a4
2018-04-23 15:55:18 -07:00
55b003e5e8
Fix loadstatus?full double counting expected segments ( #5667 )
...
* fix loadstatus?full double counting expected segments
* remove possible flakiness from Thread.sleep() in test
2018-04-24 01:11:16 +05:30
a3a9ada843
Add GenericWhitespace checkstyle check ( #5668 )
2018-04-24 01:09:14 +05:30
ca3f833426
Fix coordinator's dataSource api with full parameter ( #5662 )
...
* Fix coordinator's dataSource api with full parameter
* address comment
* Add a constructor for json serde and fix result order
* Change to immutableSortedMap
* Revert immutableSortedMap to treeMap
2018-04-19 17:41:53 -07:00
15f4ab2b31
Expose noop filter to users ( #5597 )
2018-04-18 07:57:07 -07:00
5d09f76df6
topN: Fix caching of Float dimension values. ( #5653 )
...
Jackson would deserialize them as Doubles, leading to ClassCastExceptions
in the topN processing pipeline when it attempted to treat them as Floats.
2018-04-17 15:35:18 -07:00
a7ba2bf275
Detailed error message when unable to create temp dir ( #5648 )
2018-04-17 15:12:46 -07:00
8e441cd142
Fix cache bug in stats module ( #5650 )
2018-04-17 15:11:03 -07:00
fbf3fc178e
Timeseries: Add "grandTotal" option. ( #5640 )
...
* Timeseries: Add "grandTotal" option.
* Modify whitespace.
* Checkstyle workaround.
2018-04-16 18:22:19 -07:00
d0b66a6af5
Fix HTTP OPTIONS request auth handling ( #5638 )
...
* Fix HTTP OPTIONS request auth handling
* PR comment
* More PR comments
* Fix
* PR comment
2018-04-16 18:09:56 -07:00
6b3bde0143
Fix granularitySpec doc ( #5647 )
2018-04-16 14:24:39 -04:00
f349e03091
Fix NPE in compactionTask ( #5613 )
...
* Fix NPE in compactionTask
* more annotations for metadata
* better error message for empty input
* fix build
* revert some null checks
* address comments
2018-04-13 00:11:03 -04:00
124c89e435
Replace EmittedBatchCounter and UpdateCounter with ConcurrentAwaitableCounter ( #5592 )
...
* Replace EmittedBatchCounter and UpdateCounter with (both not safe for concurrent increments/updates) with ConcurrentAwaitableCounter (safe for concurrent increments)
* Fixes
* Fix EmitterTest
* Added Javadoc and make awaitCount() to throw exceptions on wrong count instead of masking errors
2018-04-13 00:07:11 -04:00
882b172318
Revert "Fix HTTP OPTIONS request auth handling ( #5615 )" ( #5637 )
...
This reverts commit df51a7bcb7
2018-04-12 16:43:54 -07:00
e91add6843
Fix coordinator loadStatus performance ( #5632 )
...
* Optimize coordinator loadStatus
* Add comment
* Fix teamcity
* Checkstyle
* More checkstyle
* Checkstyle
2018-04-12 15:07:52 -07:00
df51a7bcb7
Fix HTTP OPTIONS request auth handling ( #5615 )
...
* Fix HTTP OPTIONS request auth handling
* Flip configuration boolean
2018-04-12 14:02:20 -07:00
d0400a0688
SegmentWithState: Add toString method. ( #5635 )
...
The class appears in log messages, and the default toString method
isn't very informative.
2018-04-12 14:01:09 -05:00
dbea5cb9b7
Load rules should honor partial overlap ( #5595 )
...
Load rules should load segments that partially overlap with rule window,
instead of loading only segments that fully overlap.
2018-04-12 09:46:00 -07:00
19f359957f
Add getters for AlertEvent ( #5522 )
...
* Add getters for AlertEvent
* Move PublicApi and ExtensionPoint to java-util
* Fix publicapi annotation usage
* Add publicapi annotations to ServiceMetricEvent and RequestLogEvent
2018-04-12 23:38:20 +07:00
48c1a1ef57
change header from Data Schema to Ingestion Spec ( #5631 )
2018-04-11 21:42:54 -07:00
d709d1a59f
correct overlord console header. Because it's not the coordinator console, it's the overlord console. ( #5627 )
2018-04-11 20:44:31 -04:00
72d6dcda4f
ParallelCombiner: Fix buffer leak on exception in "combine". ( #5630 )
...
Once a buffer is acquired, we need to make sure to release it if an
exception is thrown before the closeable iterator is created.
2018-04-11 20:39:39 -04:00
e6efd75a3d
Add config to allow setting up custom unsecured paths for druid nodes. ( #5614 )
...
* Add config to allow setting up custom unsecured paths for druid nodes.
* return all resources for Unsecured paths
* review comment - Add test
* fix tests
* fix test
2018-04-11 17:10:07 -07:00
afa75e04b7
change header in overlord console; minor querydoc change ( #5625 )
...
* change header in overlord console; minor querydoc change
* remove change to overlord console
* address Gian comments
2018-04-11 12:57:22 -07:00
b32aad9ab4
Fix some broken links in druid docs ( #5622 )
...
* Fix some broken links in druid docs
* review comment
2018-04-11 10:27:33 -07:00
ff27c54774
SQL: Remove useless boolean CASTs in filters. ( #5619 )
2018-04-10 23:05:09 +05:30
80fa5094e8
Fix Kerberos Authentication failing requests without cookies and excludedPaths config. ( #5596 )
...
* Fix Kerberos Authentication failing requests without cookies.
KerberosAuthenticator was failing `First` request from the clients.
After authentication we were setting the cookie properly but not
setting the the authenticated flag in the request. This PR fixed that.
Additional Fixes -
* Removing of Unused SpnegoFilterConfig - replaced by
KerberosAuthenticator
* Unused internalClientKeytab and principal from KerberosAuthenticator
* Fix docs accordingly and add docs for configuring an escalated
client.
* Fix excluded path config behavior
* spelling correction
* Revert "spelling correction"
This reverts commit fb754b43d83901047769
2018-04-09 20:45:35 -07:00
ee37ff2502
CompressionUtils: Make gzipInputStream public once again. ( #5590 )
...
But add a reference to "decompress" and mention that it's preferred
when reading from streams that come from files.
2018-04-09 17:39:19 -07:00
3a5d516308
Add missing type for MapVirtualColumn ( #5598 )
2018-04-09 17:37:24 -07:00
685f4063d4
DoublesSketchModule: Fix serde for DoublesSketchMergeAggregatorFactory. ( #5587 )
...
Fixes #5580 .
2018-04-07 06:45:55 -07:00
ad6f234e1e
Update lookups-cached-global.md ( #5525 )
...
Update lookup creation example to work with version 0.12.0
2018-04-06 16:13:17 -07:00
ea4f8544fb
revert lambda conversion to fix occasional jvm error ( #5591 )
2018-04-06 14:18:55 -07:00
5ab17668c0
CompressionUtils: Add support for decompressing xz, bz2, zip. ( #5586 )
...
Also switch various firehoses to the new method.
Fixes #5585 .
2018-04-06 08:06:45 -07:00
Nishant Bangarwa
Dylan Wylie
Gian Merlino
David Lim
Joseph Glanville
Jihoon Son
Jonathan Wei
kaijianding
Roman Leventov
Erik Dubbelboer
Charles Allen
Caroline1000
Slim Bouguerra
scrawfor
Kirill Kozlov
palanieppan-m
Atul Mohan
Caroline1000
Alexander T
Clint Wylie