Commit Graph

369 Commits

Author SHA1 Message Date
Eric Payne bddfe42e2c Revert "YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue"
This reverts commit c5e6e3de1c.
2018-02-14 14:29:20 -06:00
Eric Payne c5e6e3de1c YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue 2018-02-13 10:11:02 -06:00
Wangda Tan 60f9e60b3b Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Jian He eb2449d539 YARN-5428. Allow for specifying the docker client configuration directory. Contributed by Shane Kumpf 2018-02-08 11:35:30 -08:00
Billie Rinaldi aa461f9091 YARN-7516. Add security check for trusted docker images. Contributed by Eric Yang 2018-02-07 07:09:45 -08:00
Arun Suresh 8df7666fe1 YARN-7780. Documentation for Placement Constraints. (Konstantinos Karanasos via asuresh) 2018-01-31 01:30:17 -08:00
Wangda Tan 051ad9d63f YARN-7628. [Documentation] Documenting the ability to disable elasticity at Capacity Scheduler's sub queues. (Zian Chen via wangda)
Change-Id: I5c37df1c5bee9e3a78379775ef307ef94506ebc4
2018-01-25 07:24:57 +08:00
Billie Rinaldi 0c559b2782 YARN-7777. Fix user name format in YARN Registry DNS name. Contributed by Jian He 2018-01-24 13:50:47 -08:00
Eric Yang 97fe3cc187 YARN-7729. Add support for setting Docker PID namespace mode. (Contributed by Billie Rinaldi) 2018-01-22 16:33:38 -05:00
Miklos Szegedi a68e445dc6 YARN-7717. Add configuration consistency for module.enabled and docker.privileged-containers.enabled. Contributed by Eric Badger. 2018-01-17 14:11:14 -08:00
Billie Rinaldi 53f2768926 YARN-7724. yarn application status should support application name. Contributed by Jian He 2018-01-12 15:33:46 -08:00
Eric Yang 3d65dbe032 YARN-5366. Improve signal handling and delete delay for Docker on Yarn.
(Contributed by Shane Kumpf)
2018-01-12 13:41:27 -05:00
Akira Ajisaka fbbbf59c82
YARN-7735. Fix typo in YARN documentation. Contributed by Takanobu Asanuma. 2018-01-11 15:59:27 +09:00
Haibo Chen 8ee7080e5d YARN-7665. Allow FS scheduler state dump to be turned on/off separately from FS debug log. (Wilfred Spiegelenburg via Haibo Chen) 2018-01-09 16:45:35 -08:00
Haibo Chen f725b9e267 YARN-7716. metricsTimeStart and metricsTimeEnd should be all lower case in the doc. 2018-01-09 08:56:59 -08:00
Billie Rinaldi dc54747d70 YARN-7704. Document improvement for registry dns. Contributed by Jian He 2018-01-08 13:20:17 -08:00
Robert Kanter f8e7dd9b10 YARN-7557. It should be possible to specify resource types in the fair scheduler increment value (grepas via rkanter) 2018-01-05 11:15:06 -08:00
Arpit Agarwal 4379113bda HADOOP-15093. Deprecation of yarn.resourcemanager.zk-address is undocumented. Contributed by Ajay Kumar. 2018-01-03 14:32:47 -08:00
Miklos Szegedi 80440231d4 YARN-6894. RM Apps API returns only active apps when query parameter queue used. Contributed by Gergely Novák. 2018-01-02 17:59:10 -08:00
Wangda Tan 7467e8fe5a YARN-7555. Support multiple resource types in YARN native services. (wangda)
Change-Id: I330e6ee17a73962dcaadd766a3e72d2888681731
2017-12-29 15:34:08 -08:00
Varun Saxena c0aeb666a4 YARN-7662. [ATSv2] Define new set of configurations for reader and collectors to bind (Rohith Sharma K S via Varun Saxena) 2017-12-19 22:29:24 +05:30
Weiwei Yang 9289641020 YARN-7617. Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started. Contributed by Weiwei Yang. 2017-12-18 10:07:16 +08:00
Sunil G 6681dd1007 YARN-7633. Documentation for auto queue creation feature and related configurations. Contributed by Suma Shivaprasad. 2017-12-15 23:07:15 +05:30
Sunil G 2564b4d07f YARN-7119. Support multiple resource types in rmadmin updateNodeResource command. Contributed by Manikandan R. 2017-12-14 16:11:57 +05:30
Jian He 3ebe6a7819 YARN-7565. Yarn service pre-maturely releases the container after AM restart. Contributed by Chandni Singh 2017-12-12 13:35:56 -08:00
Sunil G 532bbf4602 YARN-7533. Documentation for absolute resource support in Capacity Scheduler. Contributed by Sunil G. 2017-12-07 18:56:54 -08:00
Weiwei Yang 40b0045ebe YARN-7610. Extend Distributed Shell to support launching job with opportunistic containers. Contributed by Weiwei Yang. 2017-12-06 17:52:41 +08:00
Eric Yang d30d57828f YARN-6669. Implemented Kerberos security for YARN service framework. (Contributed by Jian He) 2017-12-04 15:11:00 -05:00
Wei Yan 333ef303ff YARN-6851. Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat. 2017-11-29 14:38:07 -08:00
Eric Yang d42a336cfa YARN-5534. Allow user provided Docker volume mount list. (Contributed by Shane Kumpf) 2017-11-22 13:05:34 -05:00
bibinchundatt 96e6a99360 YARN-7525. Incorrect query parameters in cluster nodes REST API document. Contributed by Tao Yang. 2017-11-18 19:02:11 +05:30
Subru Krishnan d5f66888b8 YARN-6128. Add support for AMRMProxy HA. (Botong Huang via Subru). 2017-11-17 17:39:06 -08:00
Jason Lowe fac72eef23 YARN-7361. Improve the docker container runtime documentation. Contributed by Shane Kumpf 2017-11-15 12:32:02 -06:00
Daniel Templeton 040a38dc49 YARN-7369. Improve the resource types docs 2017-11-13 11:05:07 -08:00
Billie Rinaldi a6c4bd74b6 YARN-6394. Support specifying YARN related params in the service REST API. Contributed by Jian He 2017-11-06 13:30:20 -08:00
Jian He ba7ed7b66a YARN-7384. Remove apiserver cmd and merge service cmd into application cmd. Contributed by Billie Rinaldi 2017-11-06 13:30:19 -08:00
Billie Rinaldi 68acd88dcb YARN-7323. Data structure update in service REST API. Contributed by Jian He 2017-11-06 13:30:18 -08:00
Jian He 9273480084 YARN-7198. Add jsvc support for RegistryDNS. Contributed by Billie Rinaldi 2017-11-06 13:30:18 -08:00
Jian He c723021579 YARN-6626. Embed REST API service into RM. Contributed by Eric Yang 2017-11-06 13:30:17 -08:00
Jian He 673c0db43c Revert "YARN-6626. Embed REST API service into RM. Contributed by Eric Yang"
This reverts commit 63d1084e9781e0fee876916190b69f6242dd00e4.
2017-11-06 13:30:17 -08:00
Jian He 9e677fa05c YARN-6626. Embed REST API service into RM. Contributed by Eric Yang 2017-11-06 13:30:17 -08:00
Billie Rinaldi 8851209788 YARN-7191. Improve yarn-service documentation. Contributed by Jian He 2017-11-06 13:30:17 -08:00
Jian He c70e5df100 YARN-7201. Added an apache httpd example YARN service. Contributed by Billie Rinaldi 2017-11-06 13:30:16 -08:00
Billie Rinaldi ce74e64363 YARN-7210. Some NPE fixes in Registry DNS. Contributed by Jian He 2017-11-06 13:30:16 -08:00
Billie Rinaldi 37c9b7327d YARN-7186. Add examples in yarn-service. Contributed by Jian He 2017-11-06 13:30:16 -08:00
Gour Saha 541b64c798 YARN-7165. Miscellaneous fixes in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:15 -08:00
Jian He b9ca13e34b YARN-7161. Fix special chars in DNS documentation. Contributed by Gour Saha 2017-11-06 13:30:15 -08:00
Jian He e660e52a04 YARN-7126. Create introductory site documentation for YARN native services. Contributed by Gour Saha 2017-11-06 13:30:14 -08:00
Jian He 7dd4490a44 YARN-7073. Yarn native services rest API documentation. Contributed by Gour Saha 2017-11-06 13:30:14 -08:00
Billie Rinaldi 40ab068eab YARN-7091. Rename application to service in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:13 -08:00
Gour Saha 2ba38ce8ec YARN-5244. Documentation required for DNS Server implementation. Contributed by Jon Maron 2017-11-06 13:30:12 -08:00
Arun Suresh 24f8c5cce3 YARN-7178. Add documentation for Container Update API. (asuresh) 2017-10-27 22:56:41 -07:00
Subru Krishnan 25932da6d1 YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru). 2017-10-26 12:10:14 -07:00
Subru Krishnan 3fae675383 YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru). 2017-10-25 15:07:50 -07:00
Jonathan Hung 09c5dfe937 YARN-7251. Misc changes to YARN-5734 2017-10-09 11:11:23 -07:00
Jonathan Hung a3075de9ab YARN-7238. Documentation for API based scheduler configuration management 2017-10-09 11:11:23 -07:00
Yufei Gu 99292adcef YARN-2162. Add ability in Fair Scheduler to optionally configure maxResources in terms of percentage. (Yufei Gu) 2017-10-05 23:51:58 -07:00
Chris Trezzo 7e76f85bc6 YARN-2960. Add documentation for the YARN shared cache. 2017-10-05 10:38:41 -07:00
Allen Wittenauer 4d5dd75b60
HADOOP-14908. CrossOriginFilter should trigger regex on more input (Johannes Alberti via aw) 2017-10-03 10:58:28 -07:00
Carlo Curino ceca9694f9 YARN-3661. Basic Federation UI. (Contributed by Inigo Goiri via curino) 2017-10-02 13:03:32 -07:00
Yufei Gu 66c417167a YARN-6333. Improve doc for minSharePreemptionTimeout, fairSharePreemptionTimeout and fairSharePreemptionThreshold. (Contributed by Chetna Chaudhari via Yufei Gu) 2017-09-29 18:07:33 -07:00
Wangda Tan d3b1c63195 YARN-6623. Add support to turn off launching privileged containers in the container-executor. (Varun Vasudev via wangda)
Change-Id: I76aec68cbfb42d239279d7245a03290d691e87a4
2017-09-28 16:41:09 -07:00
Wangda Tan 6b88cd1901 YARN-7056. Document Resource Profiles feature. (Sunil G via wangda)
Change-Id: I5f5d52cdf7aba4ac09684aab573e6916dbad183e
2017-09-12 09:19:12 -07:00
Daniel Templeton 6651cbcc72 YARN-6622. Document Docker work as experimental (Contributed by Varun Vasudev) 2017-09-11 16:14:31 -07:00
Daniel Templeton 07951b586e Revert "YARN-6022. Document Docker work as experimental (Contributed by Varun Vasudev)"
This reverts commit 66be6c848b.
2017-09-11 16:14:18 -07:00
Daniel Templeton 66be6c848b YARN-6022. Document Docker work as experimental (Contributed by Varun Vasudev) 2017-09-11 15:46:23 -07:00
Rohith Sharma K S 0bfb3a2566 YARN-7130. ATSv2 documentation changes post merge. Contributed by Varun Saxena. 2017-09-08 20:21:50 +05:30
Sunil G 56d93d2e39 YARN-6600. Introduce default and max lifetime of application at LeafQueue level. Contributed by Rohith Sharma K S. 2017-09-08 07:15:17 +05:30
Jason Lowe b0b535d9d5 YARN-6930. Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager. Contributed by Shane Kumpf 2017-09-07 16:17:03 -05:00
Andrew Wang 0d419c984f Preparing for 3.1.0 development 2017-09-01 11:53:48 -07:00
Allen Wittenauer 190410085b
HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build
Signed-off-by: Andrew Wang <wang@apache.org>
2017-08-31 19:06:49 -07:00
Robert Kanter ce79f7be29 YARN-7094. Document the current known issue with server-side NM graceful decom (rkanter) 2017-08-30 18:04:55 -07:00
Vrushali C bea3e4df76 YARN-6047 Documentation updates for TimelineService v2 (Contributed by Rohith Sharma) 2017-08-30 11:29:54 +05:30
vrushali 24447b3626 YARN-6316 Provide help information and documentation for TimelineSchemaCreator (Contributed by Haibo Chen via Vrushali C) 2017-08-30 11:29:52 +05:30
Sangjin Lee ccb38c1991 YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen. 2017-08-30 11:29:52 +05:30
Sangjin Lee 580d884913 YARN-6094. Update the coprocessor to be a dynamically loaded one. Contributed by Vrushali C. 2017-08-30 11:29:52 +05:30
Sangjin Lee 7f54ac48c6 YARN-5980. Update documentation for single node hbase deploy. Contributed by Vrushali C. 2017-08-30 11:29:51 +05:30
Sangjin Lee 643a20a358 YARN-5265. Make HBase configuration for the timeline service configurable. Contributed by Joep Rottinghuis. 2017-08-30 11:29:51 +05:30
Varun Saxena 9bb5cc3d49 YARN-3649. Allow configurable prefix for hbase table names like prod, exp, test etc (Vrushali C via Varun Saxena) 2017-08-30 11:29:50 +05:30
Subru Krishnan de462da04e YARN-6900. ZooKeeper based implementation of the FederationStateStore. (Íñigo Goiri via Subru). 2017-08-16 11:43:24 -07:00
Carlo Curino cc59b5fb26 YARN-6896. Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution). (Contributed by Giovanni Matteo Fumarola via curino) 2017-08-11 15:58:01 -07:00
Daniel Templeton 47b145b9b4 YARN-6757. Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path
(Contributed by Miklos Szegedi via Daniel Templeton)
2017-08-08 10:33:26 -07:00
Carlo Curino 9625a030de YARN-6853. Add MySql Scripts for FederationStateStore. (Contributed by Giovanni Matteo Fumarola via curino)
(cherry picked from commit 874ddbf0b5)
2017-08-01 17:28:28 -07:00
Subru Krishnan 86f05c3312 YARN-6866. Minor clean-up and fixes in anticipation of YARN-2915 merge with trunk. (Botong Huang via Subru).
(cherry picked from commit 40453879ec)
2017-08-01 17:28:28 -07:00
Subru Krishnan f427e4201f YARN-6807. Adding required missing configs to Federation configuration guide based on e2e testing. (Tanuj Nayak via Subru).
(cherry picked from commit b4ac9d1b63)
2017-08-01 17:28:26 -07:00
Subru Krishnan d6c29b2f5b YARN-6484. Documenting the YARN Federation feature. (Carlo Curino via Subru).
(cherry picked from commit 749ca890e6)
2017-08-01 17:28:25 -07:00
Akira Ajisaka b628d0da51
YARN-6809. Fix typo in ResourceManagerHA.md. Contributed by Yeliang Cang. 2017-07-12 19:38:32 +09:00
Naganarasimha ba5b056e8a YARN-6770. A small mistake in the example of TimelineClient. Contributed by Jinjiang Ling. 2017-07-09 21:28:24 +05:30
Andrew Wang af2773f609 Updating version for 3.0.0-beta1 development 2017-06-29 17:57:40 -07:00
Sunil G c1edca101c YARN-6280. Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API. Contributed by Lantao Jin. 2017-06-28 15:40:58 -07:00
Junping Du 4e3eebc943 YARN-5311. Document graceful decommission CLI and usage. Contributed by Elek, Marton. 2017-06-28 15:32:04 -07:00
Sunil G ca13b224b2 YARN-5892. Support user-specific minimum user limit percentage in Capacity Scheduler. Contributed by Eric Payne. 2017-06-22 23:50:57 -07:00
vrushali d95c82cb79 YARN-6316 Provide help information and documentation for TimelineSchemaCreator (Contributed by Haibo Chen via Vrushali C) 2017-06-01 18:30:23 -07:00
Andrew Wang 16ad896d5c Update maven version for 3.0.0-alpha4 development 2017-05-26 14:09:44 -07:00
Yufei Gu e82da2b4f4 YARN-6540. Resource Manager is spelled "Resource Manger" in ResourceManagerRestart.md and ResourceManagerHA.md. (Grant Sohn via Yufei Gu) 2017-05-19 14:16:00 -07:00
Daniel Templeton f356f0f4cf YARN-6453. fairscheduler-statedump.log gets generated regardless of service
(Contributed by Yufei Gu via Daniel Templeton)
2017-04-20 14:13:07 -07:00
Daniel Templeton 14a39907c6 YARN-6343. Docker docs MR example is broken (Contributed by Prashant Jha via Daniel Templeton) 2017-04-10 09:59:53 -07:00
Daniel Templeton 49efd5d204 YARN-6309. Fair scheduler docs should have the queue and queuePlacementPolicy
elements listed in bold so that they're easier to see
(Contributed by Esmaeil Mirzaee via Daniel Templeton)
2017-03-20 14:25:00 -07:00
Varun Saxena 229c7c9f89 YARN-6069. CORS support in timeline v2 (Rohith Sharma K S via Varun Saxena) 2017-03-11 04:09:01 +05:30
Varun Saxena 6ba61d20d3 YARN-6159. Documentation changes for TimelineV2Client (Naganarasimha G R via Varun Saxena) 2017-02-21 12:25:37 +05:30