Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,398 Commits 111 Branches 503 Tags 726 MiB
Commit Graph

39 Commits

Author SHA1 Message Date
Jonathan Wei 74960e82bf Add more Apache branding to docs (#7515) 2019-04-19 15:52:26 -07:00
Gian Merlino a517f8ce49 Coordinator: Allow dropping all segments. (#7447) 
Removes the coordinator sanity check that prevents it from dropping all
segments. It's useful to get rid of this, since the behavior is
unintuitive for dev/testing clusters where users might regularly want
to drop all their data to get back to a clean slate.

But the sanity check was there for a reason: to prevent a race condition
where the coordinator might drop all segments if it ran before the
first metadata store poll finished. This patch addresses that concern
differently, by allowing methods in MetadataSegmentManager to return
null if a poll has not happened yet, and canceling coordinator runs
in that case.

This patch also makes the "dataSources" reference in
SQLMetadataSegmentManager volatile. I'm not sure why it wasn't volatile
before, but it seems necessary to me: it's not final, and it's dereferenced
from multiple threads without synchronization.
 2019-04-11 08:45:38 -07:00
Jonathan Wei 94463b5778 Add missing redirects and fix broken links (#7213) 
* Add missing redirects

* Fix zookeeper redirect

* Fix broken links
 2019-03-09 15:16:23 -08:00
Jihoon Son ded03d9d4c Improve doc for auto compaction (#7117) 
* Improve doc for auto compaction

* fix doc

* address comments
 2019-03-02 12:21:50 -08:00
Jonathan Wei 32c418fdd8 Reword 'node' to 'process' (#7172) 2019-02-28 18:10:39 -08:00
Jonathan Wei a0afd7931d
Add web consoles doc page (#7123) 
* Add web consoles doc page

* PR comments

* Remove 'unified'

* PR comments

* Fix TOC

* PR comments

* More revisions

* GUI -> UI

* Update router docs

* Reword router doc
 2019-02-28 14:02:39 -08:00
Jonathan Wei 82137874ea Add master/data/query server concepts to docs/packaging (#6916) 
* Add master/data/query server concepts to docs/packaging

* PR comments

* TOC and markdown fix

* Update image legend

* PR comment

* More PR comments
 2019-01-30 19:41:07 -08:00
Jihoon Son 3b020fd81b Improve doc for auto compaction (#6782) 
* Improve doc for auto compaction

* address comments

* address comments

* address comments
 2019-01-23 16:21:45 -08:00
Jihoon Son 2c380e3a26 Fix doc for automatic compaction (#6749) 2018-12-17 11:44:33 -08:00
David Lim f7bbee2e65 Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
Vadim Ogievetsky da4836f38c Added titles and harmonized docs to improve usability and SEO (#6731) 
* added titles and harmonized docs

* manually fixed some titles
 2018-12-12 20:42:12 -08:00
David Lim afb239b17a add missing license headers, in particular to MD files; clean up RAT … (#6563) 
* add missing license headers, in particular to MD files; clean up RAT exclusions

* revert inadvertent doc changes

* docs

* cr changes

* fix modified druid-production.svg
 2018-11-13 09:38:37 -08:00
Jonathan Wei 180e3ccfad
Docs consistency cleanup (#6259) 2018-09-04 12:54:41 -07:00
Gian Merlino 431d3d8497
Rename io.druid to org.apache.druid. (#6266) 
* Rename io.druid to org.apache.druid.

* Fix META-INF files and remove some benchmark results.

* MonitorsConfig update for metrics package migration.

* Reorder some dimensions in inner queries for some reason.

* Fix protobuf tests.
 2018-08-30 09:56:26 -07:00
Jonathan Wei 2b0f03acb9 Unified API doc page (#6128) 
* Unified API doc page

* PR comments

* Fix metadata endpoint
 2018-08-09 14:27:42 -06:00
Javier Collado c45fe37611 Feature add coordinator servers endpoint documentation (#5392) 
* Add new servers section to the coordinator endpoints documentation

* Remove trailing whitespace
 2018-02-15 14:37:58 -08:00
Jihoon Son 2099b43e5f Add a new config object for compactConfig (#5264) 
* add a new config object for compactConfig

* fix test

* address comments

* Update doc
 2018-02-06 12:13:52 -08:00
Jihoon Son 241efafbb2
Automatic compaction by coordinators (#5102) 
* Automatic compaction by coordinator

* add links

* skip compaction for very recent segments if they are small

* fix finding search interval

* fix finding search interval

* fix TimelineHolder iteration

* add test for newestSegmentFirstPolicy

* add CompactionSegmentIterator

* add numTargetCompactionSegments

* add missing config

* fix skipping huge shards

* fix handling large number of segments per shard

* fix test failure

* change recursive call to loop

* fix logging

* fix build

* fix test failure

* address comments

* change dataSources type

* check running pendingTasks at each run

* fix test

* address comments

* fix build

* fix test

* address comments

* address comments

* add doc for segment size optimization

* address comment
 2018-01-13 13:52:37 +09:00
Jonathan Wei 6daddf97c5 More documentation on expected interval format for coordinator endpoints (#4361) 2017-06-02 15:21:44 -07:00
Gian Merlino adeecc0e72 Add /isLeader call to overlord and coordinator. (#4282) 
This is useful for putting them behind load balancers or proxies, as it lets
the load balancer know which server is currently active through an http health
check.

Also makes the method naming a little more consistent between coordinator and
overlord code.
 2017-05-18 20:46:13 -05:00
Himanshu 641469fc38 manage overshadowing efficiently at coordinator (#3584) 
* manage overshadowing efficiently at coordinator

* take readlock in VersionedIntervalTimeline.isOvershadowed()
 2016-10-24 22:49:08 +05:30
rasahner 2861e854f0 Merge pull request #2540 from pjain1/remove_kill 
Remove extra parameter from deleteDataSourceSpecificInterval endpoint and correct exception message for invalid interval
 2016-03-14 11:16:23 -05:00
Parag Jain b82b487f20 remove extra kill parameter 2016-02-24 17:16:18 -06:00
Himanshu Gupta 21b0b8a07d new coordinator endpoint to get list of used segment given a dataSource and list of intervals 2016-02-21 23:17:58 -06:00
Fangjin Yang 1430bc2c88 Merge pull request #2276 from harshjain2/feature-2021 
Fix for issue 2021.
 2016-02-10 17:04:45 -08:00
fjy 1aa363cea7 new quickstart 2016-02-04 09:37:38 -08:00
Harsh Jain 41730b96d4 Fix for issue 2021 2016-01-25 02:48:22 +05:30
Harsh Jain 71f1cd5e34 Fix for issue 2021 2016-01-17 16:10:04 +05:30
Robin c1b813011c doc: add information about new serverview coordinator endpoint 2016-01-10 19:47:23 -06:00
Fangjin Yang cb085f99d3 Merge pull request #2097 from metamx/update-coordinator-docs 
update the coordinator API docs to better explain how to format ISO86…
 2015-12-15 17:35:48 -08:00
desaianuj 2f32cb1fb6 update the coordinator API docs to better explain how to format ISO8601 intervals in the request url 2015-12-15 16:17:54 -08:00
Himanshu Gupta 7c91219130 adding more comments to why drops do not happen when there are no segments in db 2015-11-25 16:26:51 -06:00
Bartosz Ługowski b0a444eafc Add count parameter to rules history endpoint. 2015-11-17 20:14:12 +01:00
Bartosz Ługowski 6e5d2c6745 Add count parameter to history endpoints. 2015-11-11 23:03:57 +01:00
Bartosz Ługowski 6de51e022d Coordinator - add intervals route. 2015-10-30 11:51:42 +01:00
Bingkun Guo 44aad069da add description for /druid/coordinator/v1/loadqueue?full 2015-10-26 14:19:13 -05:00
nishant 0835e12f2a add endpoint to fetch rule history for all datasources. 
review comments

Review comment

fix compilation
 2015-08-31 14:05:52 +05:30
Xavier Léauté d2346b6834 shorten links and file names 
* remove redundant parts in file names
* delete unsupported "Druid-Personal-Demo-Cluster"
 2015-05-29 20:55:42 -05:00
Himanshu Gupta 8edc2aaca3 renaming all *.md filenames to only have lowercase and dashes 
so that they are editable on case-insensitive os as well
 2015-05-29 20:55:42 -05:00