241efafbb2
Automatic compaction by coordinators ( #5102 )
...
* Automatic compaction by coordinator
* add links
* skip compaction for very recent segments if they are small
* fix finding search interval
* fix finding search interval
* fix TimelineHolder iteration
* add test for newestSegmentFirstPolicy
* add CompactionSegmentIterator
* add numTargetCompactionSegments
* add missing config
* fix skipping huge shards
* fix handling large number of segments per shard
* fix test failure
* change recursive call to loop
* fix logging
* fix build
* fix test failure
* address comments
* change dataSources type
* check running pendingTasks at each run
* fix test
* address comments
* fix build
* fix test
* address comments
* address comments
* add doc for segment size optimization
* address comment
2018-01-13 13:52:37 +09:00
3d3b04e1b8
docs: fix broken link to ingestions and tasks on the Druid Concepts page ( #5197 )
...
* fix broken links
* add newline
2017-12-27 07:55:24 -08:00
7a9940d624
Add /readiness to HistoricalResource ( #4916 )
...
* Add /loadStatusCode to HistoricalResource
* Address comments
* Fixes
2017-10-11 20:35:52 -07:00
cc20260078
Early publishing segments in the middle of data ingestion ( #4238 )
...
* Early publishing segments in the middle of data ingestion
* Remove unnecessary logs
* Address comments
* Refactoring the patch according to #4292 and address comments
* Set the total shard number of NumberedShardSpec to 0
* refactoring
* Address comments
* Fix tests
* Address comments
* Fix sync problem of committer and retry push only
* Fix doc
* Fix build failure
* Address comments
* Fix compilation failure
* Fix transient test failure
2017-07-10 22:35:36 -07:00
6daddf97c5
More documentation on expected interval format for coordinator endpoints ( #4361 )
2017-06-02 15:21:44 -07:00
adeecc0e72
Add /isLeader call to overlord and coordinator. ( #4282 )
...
This is useful for putting them behind load balancers or proxies, as it lets
the load balancer know which server is currently active through an http health
check.
Also makes the method naming a little more consistent between coordinator and
overlord code.
2017-05-18 20:46:13 -05:00
8f4394ca49
Update segments.md ( #3904 )
2017-02-03 10:31:14 -06:00
2640d170c3
Blacklist workers if they fail for too many times ( #3643 )
...
* Blacklist workers if they fail for too many times
* Adding documentation
* Changing to timeout to period and updating docs
* 1. Add configurable maxPercentageBlacklistWorkers
2. Rename variable
* Change maxPercentageBlacklistWorkers to double
* Remove thread.sleep
2016-11-29 12:38:56 +05:30
641469fc38
manage overshadowing efficiently at coordinator ( #3584 )
...
* manage overshadowing efficiently at coordinator
* take readlock in VersionedIntervalTimeline.isOvershadowed()
2016-10-24 22:49:08 +05:30
49c0fe0e8b
Show candidate hosts for the given query ( #2282 )
...
* Show candidate hosts for the given query
* Added test cases & minor changes to address comments
* Changed path-param to query-pram for intervals/numCandidates
2016-09-22 08:32:38 -07:00
ff25325f3b
Improved docs for multi-value dimensions.
...
- Add central doc for multi-value dimensions, with some content from other docs.
- Link to multi-value dimension doc from topN and groupBy docs.
- Fixes a broken link from dimensionspecs.md, which was presciently already
linking to this nonexistent doc.
- Resolve inconsistent naming in docs & code (sometimes "multi-valued", sometimes
"multi-value") in favor of "multi-value".
2016-03-22 14:40:55 -07:00
2861e854f0
Merge pull request #2540 from pjain1/remove_kill
...
Remove extra parameter from deleteDataSourceSpecificInterval endpoint and correct exception message for invalid interval
2016-03-14 11:16:23 -05:00
b82b487f20
remove extra kill parameter
2016-02-24 17:16:18 -06:00
21b0b8a07d
new coordinator endpoint to get list of used segment given a dataSource and list of intervals
2016-02-21 23:17:58 -06:00
dd2375477a
Support min/max values for metadata query ( #2208 )
2016-02-12 09:35:58 +09:00
1430bc2c88
Merge pull request #2276 from harshjain2/feature-2021
...
Fix for issue 2021.
2016-02-10 17:04:45 -08:00
6fc5bcb1ef
fix docs
2016-02-08 13:40:53 -08:00
003f54e268
add doc rendering
2016-02-04 14:21:59 -08:00
1aa363cea7
new quickstart
2016-02-04 09:37:38 -08:00
41730b96d4
Fix for issue 2021
2016-01-25 02:48:22 +05:30
71f1cd5e34
Fix for issue 2021
2016-01-17 16:10:04 +05:30
c1b813011c
doc: add information about new serverview coordinator endpoint
2016-01-10 19:47:23 -06:00
cb085f99d3
Merge pull request #2097 from metamx/update-coordinator-docs
...
update the coordinator API docs to better explain how to format ISO86…
2015-12-15 17:35:48 -08:00
2f32cb1fb6
update the coordinator API docs to better explain how to format ISO8601 intervals in the request url
2015-12-15 16:17:54 -08:00
7c91219130
adding more comments to why drops do not happen when there are no segments in db
2015-11-25 16:26:51 -06:00
b0a444eafc
Add count parameter to rules history endpoint.
2015-11-17 20:14:12 +01:00
6e5d2c6745
Add count parameter to history endpoints.
2015-11-11 23:03:57 +01:00
861338c5e9
Merge pull request #1904 from rohitkochar/doc
...
modifying the documentation as per Issue#1903
2015-11-04 09:48:45 -08:00
69a3b38f81
made changes as per review comments
2015-11-04 11:10:28 +05:30
2a617c777e
modifying the documentation as per Issue#1903
2015-11-03 21:48:19 +05:30
6de51e022d
Coordinator - add intervals route.
2015-10-30 11:51:42 +01:00
44aad069da
add description for /druid/coordinator/v1/loadqueue?full
2015-10-26 14:19:13 -05:00
89785b2f52
add more details to paper
2015-10-18 17:30:24 -07:00
9705c5139b
Merge pull request #1732 from jon-wei/segmentmeta
...
Add support for a configurable default segment history period for segmentMetadata queries and GET /datasources/<datasourceName> lookups
2015-09-16 12:36:25 -07:00
193fb4fdfc
Add support for a configurable default segment history period for segmentMetadata queries and GET /datasources/<datasourceName> lookups
2015-09-14 19:41:42 -07:00
e222e6b86b
fix typo in segments.md
2015-09-11 16:32:50 -05:00
0835e12f2a
add endpoint to fetch rule history for all datasources.
...
review comments
Review comment
fix compilation
2015-08-31 14:05:52 +05:30
43978eba99
Fixes and more docs across many areas
2015-08-13 10:35:53 -07:00
7ee509bcd0
fix mysql references in tutorial docs
2015-07-30 22:05:05 -05:00
92293ef094
Added section on best practices for schema designa and a few other edits
2015-07-24 14:06:20 -07:00
4114b4902e
fixing the links to doc images
2015-06-29 12:17:42 -05:00
f214b412ca
Improve segment file documentation
2015-06-24 11:45:23 -07:00
d2346b6834
shorten links and file names
...
* remove redundant parts in file names
* delete unsupported "Druid-Personal-Demo-Cluster"
2015-05-29 20:55:42 -05:00
8edc2aaca3
renaming all *.md filenames to only have lowercase and dashes
...
so that they are editable on case-insensitive os as well
2015-05-29 20:55:42 -05:00
Jihoon Son
Yuya Fujiwara
Roman Leventov
Jonathan Wei
Gian Merlino
Darío
Niketh Sabbineni
Himanshu
Navis Ryu
rasahner
Parag Jain
Fangjin Yang
Harsh Jain
Robin
desaianuj
Bartosz Ługowski
rohit.kochar
Bingkun Guo
jon-wei
nishant
Conrad Lee
Xavier Léauté