Commit Graph

4884 Commits

Author SHA1 Message Date
Jason Lowe 3fb6787295 YARN-8784. DockerLinuxContainerRuntime prevents access to distributed cache entries on a full disk. Contributed by Eric Badger
(cherry picked from commit 6b5838ed32)
2018-09-19 16:49:21 -05:00
Weiwei Yang aaf0b119e5 YARN-8771. CapacityScheduler fails to unreserve when cluster resource contains empty resource type. Contributed by Tao Yang.
(cherry picked from commit 0712537e79)
2018-09-19 19:38:09 +08:00
Jason Lowe 3d77094cf2 YARN-8648. Container cgroups are leaked when using docker. Contributed by Jim Brennan
(cherry picked from commit 2df0a8dcb3)
2018-09-18 15:43:10 -05:00
Weiwei Yang 46eeba6234 YARN-8787. Fix broken list items in PlacementConstraints documentation. Contributed by Masahiro Tanaka.
(cherry picked from commit 78a0d173e4)
2018-09-18 17:21:21 +08:00
Sunil G 75d2d0fdb1 YARN-8652. [UI2] YARN UI2 breaks if getUserInfo REST API is not available in older versions. Contributed by Akhil PB.
(cherry picked from commit bbeca0107e)
2018-09-18 12:45:08 +05:30
Sunil G 8dccc4ef12 YARN-8726. [UI2] YARN UI2 is not accessible when config.env file failed to load. Contributed by Akhil PB.
(cherry picked from commit 0cc6e03945)
2018-09-18 12:32:30 +05:30
Weiwei Yang f0e5651cf4 YARN-8782. Fix exception message in Resource.throwExceptionWhenArrayOutOfBound. Contributed by Gergely Pollak.
(cherry picked from commit 9a265fa673)
2018-09-17 22:26:09 +08:00
Weiwei Yang 00a469138d YARN-8720. CapacityScheduler does not enforce max resource allocation check at queue level. Contributed by Tarun Parimi.
(cherry picked from commit f1a893fdbc)
2018-09-14 16:40:35 +08:00
Jason Lowe 88687213cc YARN-8680. YARN NM: Implement Iterable Abstraction for LocalResourceTracker state. Contributed by Pradeep Ambati
(cherry picked from commit 250b50018e)
2018-09-13 14:12:20 -05:00
Weiwei Yang a7b1d1e006 YARN-8729. Node status updater thread could be lost after it is restarted. Contributed by Tao Yang.
(cherry picked from commit 39c1ea1ed4)
2018-09-13 23:16:52 +08:00
Sunil G c879ca38de YARN-8630. ATSv2 REST APIs should honor filter-entity-list-by-user in non-secure cluster when ACls are enabled. Contributed by Rohith Sharma K S.
(cherry picked from commit f4bda5e8e9)
2018-09-13 17:48:01 +05:30
Eric E Payne b6bc0f409a YARN-8709: CS preemption monitor always fails since one under-served queue was deleted. Contributed by Tao Yang.
(cherry picked from commit 987d8191ad)
2018-09-10 20:02:39 +00:00
Eric Yang 0b97dc5869 YARN-8751. Reduce conditions that mark node manager as unhealthy.
Contributed by Craig Condit

(cherry picked from commit 7d62334387)
2018-09-07 20:32:11 -04:00
Giovanni Matteo Fumarola 7fed1a07ab HADOOP-15731. TestDistributedShell fails on Windows. Contributed by Botong Huang. 2018-09-07 16:37:03 -07:00
Shane Kumpf 2d68708a1d YARN-8638. Allow linux container runtimes to be pluggable. Contributed by Craig Condit
(cherry picked from commit dffb7bfe6c)
2018-09-05 06:55:25 -06:00
bibinchundatt e2e0fc26a2 YARN-8535. Fix DistributedShell unit tests. Contributed by Abhishek Modi.
(cherry picked from commit eed8415dc1)
2018-09-02 13:37:38 +05:30
Shane Kumpf b8618556ee YARN-8642. Add support for tmpfs mounts with the Docker runtime. Contributed by Craig Condit
(cherry picked from commit 73625168c0)
2018-08-29 07:11:38 -06:00
Weiwei Yang f164568b47 YARN-8723. Fix a typo in CS init error message when resource calculator is not correctly set. Contributed by Abhishek Modi.
(cherry picked from commit 3fa4639421)
2018-08-29 11:15:02 +08:00
Billie Rinaldi eefd780918 YARN-8675. Remove default hostname for docker containers when net=host. Contributed by Suma Shivaprasad
(cherry picked from commit 05b2bbeb35)
2018-08-27 11:42:09 -07:00
Weiwei Yang 271ed86ac0 YARN-8719. Typo correction for yarn configuration in OpportunisticContainers(federation) docs. Contributed by Y. SREENIVASULU REDDY.
(cherry picked from commit e8b063f630)
2018-08-28 01:07:05 +08:00
Haibo Chen e4282c077b YARN-8051. TestRMEmbeddedElector#testCallbackSynchronization is flaky. (Robert Kanter via Haibo Chen)
(cherry picked from commit 93d47a0ed5)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMEmbeddedElector.java
2018-08-24 13:24:08 -05:00
Inigo Goiri 246086984e YARN-7773. YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'. Contributed by Yiran Wu.
(cherry picked from commit 60e5c1b516)
2018-08-24 07:10:02 +05:30
Jason Lowe 84654451fa YARN-8649. NPE in localizer hearbeat processing if a container is killed while localizing. Contributed by lujie
(cherry picked from commit 585ebd873a)
2018-08-23 09:37:43 -05:00
Rohith Sharma K S 63d5214332 YARN-8129. Improve error message for invalid value in fields attribute. Contributed by Abhishek Modi.
(cherry picked from commit d3fef7a5c5)
2018-08-21 12:11:12 +05:30
Wei-Chiu Chuang 0d155de159 HADOOP-14212. Addendum patch: Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal. 2018-08-20 14:49:28 -07:00
Wei-Chiu Chuang 78fb14ba49 HADOOP-14212. Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal. 2018-08-20 14:49:24 -07:00
Jason Lowe 44c4928b64 YARN-8242. YARN NM: OOM error while reading back the state store on recovery. Contributed by Pradeep Ambati and Kanwaljeet Sachdev
(cherry picked from commit 65e7469712)
2018-08-20 10:21:57 -05:00
Rohith Sharma K S a3d4a25bbf YARN-8679. [ATSv2] If HBase cluster is down for long time, high chances that NM ContainerManager dispatcher get blocked. Contributed by Wangda Tan.
(cherry picked from commit 4aacbfff60)
2018-08-18 11:04:09 +05:30
Rohith Sharma K S 3532bd5c8b YARN-8612. Fix NM Collector Service Port issue in YarnConfiguration. Contributed by Prabha Manepalli.
(cherry picked from commit 1697a02306)
2018-08-17 11:13:25 +05:30
Eric Yang 5237bdfb5a YARN-8667. Cleanup symlinks when container restarted by NM.
Contributed by Chandni Singh

(cherry picked from commit d42806160e)
2018-08-16 18:44:47 -04:00
Eric Yang 97c1934247 YARN-8474. Fixed ApiServiceClient kerberos negotiation.
Contributed by Billie Rinaldi

(cherry picked from commit 8990eaf592)
2018-08-16 12:50:52 -04:00
Jason Lowe 819a2a6f10 YARN-8656. container-executor should not write cgroup tasks files for docker containers. Contributed by Jim Brennan
(cherry picked from commit cb21eaa026)
2018-08-16 10:09:56 -05:00
Weiwei Yang 05547b1e0b YARN-8614. Fix few annotation typos in YarnConfiguration. Contributed by Sen Zhao.
(cherry picked from commit 8dc07b4723)
2018-08-15 12:38:55 +08:00
Jason Lowe 95cd6de5c6 YARN-8640. Restore previous state in container-executor after failure. Contributed by Jim Brennan
(cherry picked from commit d1d129aa9d)
2018-08-14 10:26:21 -05:00
Shane Kumpf ba6b48e19f YARN-8520. Document best practice for user management. Contributed by Eric Yang
(cherry picked from commit e7951c69cb)
2018-08-10 14:47:14 -06:00
Weiwei Yang 734bc42289 YARN-8575. Avoid committing allocation proposal to unavailable nodes in async scheduling. Contributed by Tao Yang.
(cherry picked from commit 0a71bf1452)
2018-08-10 15:10:27 +08:00
Weiwei Yang 991514f7c3 YARN-8521. NPE in AllocationTagsManager when a container is removed more than once. Contributed by Weiwei Yang.
(cherry picked from commit 08d5060605)
2018-08-10 08:44:53 +08:00
Wangda Tan beea18736b YARN-8136. Add version attribute to site doc examples and quickstart. (Eric Yang via wangda)
Change-Id: I4541b239f490ca0a6edf9698e0d3deaf83669151
(cherry picked from commit 8244abb7ae)
2018-08-09 12:04:33 -07:00
Wangda Tan 68279fcd65 YARN-8588. Logging improvements for better debuggability. (Suma Shivaprasad via wangda)
Change-Id: I66aa4b0ec031ae5ce0fae558e2f8cbcbbfebc442
(cherry picked from commit 344c335a92)
2018-08-09 12:04:25 -07:00
Weiwei Yang 0ee7e80047 YARN-8559. Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint. Contributed by Weiwei Yang.
(cherry picked from commit d352f167eb)
2018-08-10 00:43:53 +08:00
Jason Lowe 3dd299a770 YARN-8331. Race condition in NM container launched after done. Contributed by Pradeep Ambati
(cherry picked from commit cd04e954d2)
2018-08-09 10:23:02 -05:00
Sunil G c6013b060d YARN-8633. Update DataTables version in yarn-common in line with JQuery 3 upgrade. Contributed by Akhil PB.
(cherry picked from commit 00013d6ef7)
2018-08-09 12:35:21 +05:30
Bharat Viswanadham 5430aab133 YARN-8426:Upgrade jquery-ui to 1.12.1 in YARN. Contributed by Sunil Govindan
(cherry picked from commit 361ffb26be)
2018-08-09 12:27:50 +05:30
Robert Kanter 0ed91309d3 YARN-8568. Replace the deprecated zk-address property in the HA config example in ResourceManagerHA.md (bsteinbach via rkanter)
(cherry picked from commit 8478732bb2)
2018-08-08 15:10:52 -07:00
Wangda Tan f16c311486 Make 3.1.1 awared by other branches - adding missing files
(cherry picked from commit 3214cd75ac)
2018-08-08 13:06:14 -07:00
Wangda Tan 781620a44d Make 3.1.1 awared by other branches
(cherry picked from commit 49c687608b)
2018-08-08 13:04:05 -07:00
bibinchundatt b4f957e655 YARN-8601. Print ExecutionType in Container report CLI. Contributed by Bilwa S T.
(cherry picked from commit ff06bd1be8)
2018-08-08 22:46:16 +05:30
Wangda Tan f2768eaa38 YARN-8407. Container launch exception in AM log should be printed in ERROR level. (Yesha Vora via wangda)
Change-Id: I154e873df1df3503a09c41d6b3874ca195af91d9
(cherry picked from commit 861095f761)
2018-08-07 13:07:28 -07:00
Wangda Tan 450c791ecf YARN-8629. Container cleanup fails while trying to delete Cgroups. (Suma Shivaprasad via wangda)
Change-Id: I392ef4f8baa84d5d7b1f2e438c560b5426b6d4f2
(cherry picked from commit d4258fcad7)
2018-08-07 12:41:55 -07:00
Eric Yang 947dc34229 YARN-8624. Updated verbiage around entry point support.
Contributed by Craig Condit
2018-08-06 12:39:22 -04:00