Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,704 Commits 326 Branches 371 Tags
Commit Graph

4881 Commits

Author SHA1 Message Date
Weiwei Yang
46eeba6234 YARN-8787. Fix broken list items in PlacementConstraints documentation. Contributed by Masahiro Tanaka. 
(cherry picked from commit 78a0d173e4f0c2f2679a04edd62a60fb76dde4f0)
 2018-09-18 17:21:21 +08:00
Sunil G
75d2d0fdb1 YARN-8652. [UI2] YARN UI2 breaks if getUserInfo REST API is not available in older versions. Contributed by Akhil PB. 
(cherry picked from commit bbeca0107e247ae14cfe96761f9e5fbb1f02e53d)
 2018-09-18 12:45:08 +05:30
Sunil G
8dccc4ef12 YARN-8726. [UI2] YARN UI2 is not accessible when config.env file failed to load. Contributed by Akhil PB. 
(cherry picked from commit 0cc6e039454127984a3aa5b2ba5d9151e4a72dd4)
 2018-09-18 12:32:30 +05:30
Weiwei Yang
f0e5651cf4 YARN-8782. Fix exception message in Resource.throwExceptionWhenArrayOutOfBound. Contributed by Gergely Pollak. 
(cherry picked from commit 9a265fa673ef1b8774cfd69c76cdd29bf344e79d)
 2018-09-17 22:26:09 +08:00
Weiwei Yang
00a469138d YARN-8720. CapacityScheduler does not enforce max resource allocation check at queue level. Contributed by Tarun Parimi. 
(cherry picked from commit f1a893fdbc2dbe949cae786f08bdb2651b88d673)
 2018-09-14 16:40:35 +08:00
Jason Lowe
88687213cc YARN-8680. YARN NM: Implement Iterable Abstraction for LocalResourceTracker state. Contributed by Pradeep Ambati 
(cherry picked from commit 250b50018e8c94d8ca83ff981b01f26bb68c0842)
 2018-09-13 14:12:20 -05:00
Weiwei Yang
a7b1d1e006 YARN-8729. Node status updater thread could be lost after it is restarted. Contributed by Tao Yang. 
(cherry picked from commit 39c1ea1ed454b6c61f0985fc951f20913ed964fb)
 2018-09-13 23:16:52 +08:00
Sunil G
c879ca38de YARN-8630. ATSv2 REST APIs should honor filter-entity-list-by-user in non-secure cluster when ACls are enabled. Contributed by Rohith Sharma K S. 
(cherry picked from commit f4bda5e8e9fee6c5a0dda7c79ef14e73aec20e7e)
 2018-09-13 17:48:01 +05:30
Eric E Payne
b6bc0f409a YARN-8709: CS preemption monitor always fails since one under-served queue was deleted. Contributed by Tao Yang. 
(cherry picked from commit 987d8191ad409298570f7ef981e9bc8fb72ff16c)
 2018-09-10 20:02:39 +00:00
Eric Yang
0b97dc5869 YARN-8751. Reduce conditions that mark node manager as unhealthy. 
Contributed by Craig Condit

(cherry picked from commit 7d623343879ce9a8f8e64601024d018efc02794c)
 2018-09-07 20:32:11 -04:00
Giovanni Matteo Fumarola
7fed1a07ab HADOOP-15731. TestDistributedShell fails on Windows. Contributed by Botong Huang. 2018-09-07 16:37:03 -07:00
Shane Kumpf
2d68708a1d YARN-8638. Allow linux container runtimes to be pluggable. Contributed by Craig Condit 
(cherry picked from commit dffb7bfe6cd2292162f08ec0bded736bc5194c3f)
 2018-09-05 06:55:25 -06:00
bibinchundatt
e2e0fc26a2 YARN-8535. Fix DistributedShell unit tests. Contributed by Abhishek Modi. 
(cherry picked from commit eed8415dc18fa7415ebd105350bd0532b3b1b6bb)
 2018-09-02 13:37:38 +05:30
Shane Kumpf
b8618556ee YARN-8642. Add support for tmpfs mounts with the Docker runtime. Contributed by Craig Condit 
(cherry picked from commit 73625168c0f29aa646d7a715c9fb15e43d6c7e05)
 2018-08-29 07:11:38 -06:00
Weiwei Yang
f164568b47 YARN-8723. Fix a typo in CS init error message when resource calculator is not correctly set. Contributed by Abhishek Modi. 
(cherry picked from commit 3fa46394214181ed1cc7f06b886282bbdf67a10f)
 2018-08-29 11:15:02 +08:00
Billie Rinaldi
eefd780918 YARN-8675. Remove default hostname for docker containers when net=host. Contributed by Suma Shivaprasad 
(cherry picked from commit 05b2bbeb357d4fa03e71f2bfd5d8eeb0ea6c3f60)
 2018-08-27 11:42:09 -07:00
Weiwei Yang
271ed86ac0 YARN-8719. Typo correction for yarn configuration in OpportunisticContainers(federation) docs. Contributed by Y. SREENIVASULU REDDY. 
(cherry picked from commit e8b063f63049d781f4bd67e2ac928c03fd7b7941)
 2018-08-28 01:07:05 +08:00
Haibo Chen
e4282c077b YARN-8051. TestRMEmbeddedElector#testCallbackSynchronization is flaky. (Robert Kanter via Haibo Chen) 
(cherry picked from commit 93d47a0ed504ee81d4b74d340c1815bdbb3c9b14)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMEmbeddedElector.java
 2018-08-24 13:24:08 -05:00
Inigo Goiri
246086984e YARN-7773. YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'. Contributed by Yiran Wu. 
(cherry picked from commit 60e5c1b516647bf99ef3e9501c0ce04deea13ce9)
 2018-08-24 07:10:02 +05:30
Jason Lowe
84654451fa YARN-8649. NPE in localizer hearbeat processing if a container is killed while localizing. Contributed by lujie 
(cherry picked from commit 585ebd873a55bedd2a364d256837f08ada8ba032)
 2018-08-23 09:37:43 -05:00
Rohith Sharma K S
63d5214332 YARN-8129. Improve error message for invalid value in fields attribute. Contributed by Abhishek Modi. 
(cherry picked from commit d3fef7a5c5b83d27e87b5e49928254a7d1b935e5)
 2018-08-21 12:11:12 +05:30
Wei-Chiu Chuang
0d155de159 HADOOP-14212. Addendum patch: Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal. 2018-08-20 14:49:28 -07:00
Wei-Chiu Chuang
78fb14ba49 HADOOP-14212. Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal. 2018-08-20 14:49:24 -07:00
Jason Lowe
44c4928b64 YARN-8242. YARN NM: OOM error while reading back the state store on recovery. Contributed by Pradeep Ambati and Kanwaljeet Sachdev 
(cherry picked from commit 65e7469712be6cf393e29ef73cc94727eec81227)
 2018-08-20 10:21:57 -05:00
Rohith Sharma K S
a3d4a25bbf YARN-8679. [ATSv2] If HBase cluster is down for long time, high chances that NM ContainerManager dispatcher get blocked. Contributed by Wangda Tan. 
(cherry picked from commit 4aacbfff605262aaf3dbd926258afcadc86c72c0)
 2018-08-18 11:04:09 +05:30
Rohith Sharma K S
3532bd5c8b YARN-8612. Fix NM Collector Service Port issue in YarnConfiguration. Contributed by Prabha Manepalli. 
(cherry picked from commit 1697a0230696e1ed6d9c19471463b44a6d791dfa)
 2018-08-17 11:13:25 +05:30
Eric Yang
5237bdfb5a YARN-8667. Cleanup symlinks when container restarted by NM. 
Contributed by Chandni Singh

(cherry picked from commit d42806160eb95594f08f38bb753cf0306a191a38)
 2018-08-16 18:44:47 -04:00
Eric Yang
97c1934247 YARN-8474. Fixed ApiServiceClient kerberos negotiation. 
Contributed by Billie Rinaldi

(cherry picked from commit 8990eaf5925afa533fbd9c3641859a146dc5a22c)
 2018-08-16 12:50:52 -04:00
Jason Lowe
819a2a6f10 YARN-8656. container-executor should not write cgroup tasks files for docker containers. Contributed by Jim Brennan 
(cherry picked from commit cb21eaa026d80a2c9836030d959c0dd7f87c4d6b)
 2018-08-16 10:09:56 -05:00
Weiwei Yang
05547b1e0b YARN-8614. Fix few annotation typos in YarnConfiguration. Contributed by Sen Zhao. 
(cherry picked from commit 8dc07b47235358653c5cccda354201564f7545ed)
 2018-08-15 12:38:55 +08:00
Jason Lowe
95cd6de5c6 YARN-8640. Restore previous state in container-executor after failure. Contributed by Jim Brennan 
(cherry picked from commit d1d129aa9deecebf42261947fcb0b2ca46dacad5)
 2018-08-14 10:26:21 -05:00
Shane Kumpf
ba6b48e19f YARN-8520. Document best practice for user management. Contributed by Eric Yang 
(cherry picked from commit e7951c69cbc85604f72cdd3559122d4e2c1ea127)
 2018-08-10 14:47:14 -06:00
Weiwei Yang
734bc42289 YARN-8575. Avoid committing allocation proposal to unavailable nodes in async scheduling. Contributed by Tao Yang. 
(cherry picked from commit 0a71bf145293adbd3728525ab4c36c08d51377d3)
 2018-08-10 15:10:27 +08:00
Weiwei Yang
991514f7c3 YARN-8521. NPE in AllocationTagsManager when a container is removed more than once. Contributed by Weiwei Yang. 
(cherry picked from commit 08d5060605af81a3d6048044176dc656c0dad56c)
 2018-08-10 08:44:53 +08:00
Wangda Tan
beea18736b YARN-8136. Add version attribute to site doc examples and quickstart. (Eric Yang via wangda) 
Change-Id: I4541b239f490ca0a6edf9698e0d3deaf83669151
(cherry picked from commit 8244abb7aeb768b73682b8c9a26516a9cf06bca5)
 2018-08-09 12:04:33 -07:00
Wangda Tan
68279fcd65 YARN-8588. Logging improvements for better debuggability. (Suma Shivaprasad via wangda) 
Change-Id: I66aa4b0ec031ae5ce0fae558e2f8cbcbbfebc442
(cherry picked from commit 344c335a920e6f32a35ebace0a118a9dc4a22fb7)
 2018-08-09 12:04:25 -07:00
Weiwei Yang
0ee7e80047 YARN-8559. Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint. Contributed by Weiwei Yang. 
(cherry picked from commit d352f167ebb865a6486afbbdac8e2a5e97a7bbad)
 2018-08-10 00:43:53 +08:00
Jason Lowe
3dd299a770 YARN-8331. Race condition in NM container launched after done. Contributed by Pradeep Ambati 
(cherry picked from commit cd04e954d2db27f0a15b7d1c492b7cdb656a51db)
 2018-08-09 10:23:02 -05:00
Sunil G
c6013b060d YARN-8633. Update DataTables version in yarn-common in line with JQuery 3 upgrade. Contributed by Akhil PB. 
(cherry picked from commit 00013d6ef7fdf65fa8a0f6eb56c0aef2f6e19444)
 2018-08-09 12:35:21 +05:30
Bharat Viswanadham
5430aab133 YARN-8426:Upgrade jquery-ui to 1.12.1 in YARN. Contributed by Sunil Govindan 
(cherry picked from commit 361ffb26bebf2491bbe3219ef4a83eb753660018)
 2018-08-09 12:27:50 +05:30
Robert Kanter
0ed91309d3 YARN-8568. Replace the deprecated zk-address property in the HA config example in ResourceManagerHA.md (bsteinbach via rkanter) 
(cherry picked from commit 8478732bb28e9e71061d6b4a043a3a1b5c688902)
 2018-08-08 15:10:52 -07:00
Wangda Tan
f16c311486 Make 3.1.1 awared by other branches - adding missing files 
(cherry picked from commit 3214cd75acd0474373951870e1ba2ec11833a3da)
 2018-08-08 13:06:14 -07:00
Wangda Tan
781620a44d Make 3.1.1 awared by other branches 
(cherry picked from commit 49c687608b65b772faeed614700ece8e526432e8)
 2018-08-08 13:04:05 -07:00
bibinchundatt
b4f957e655 YARN-8601. Print ExecutionType in Container report CLI. Contributed by Bilwa S T. 
(cherry picked from commit ff06bd1be83a2a6d2ee39cb002e91499720a7243)
 2018-08-08 22:46:16 +05:30
Wangda Tan
f2768eaa38 YARN-8407. Container launch exception in AM log should be printed in ERROR level. (Yesha Vora via wangda) 
Change-Id: I154e873df1df3503a09c41d6b3874ca195af91d9
(cherry picked from commit 861095f761b40171e0dc25f769f486d910cc3e88)
 2018-08-07 13:07:28 -07:00
Wangda Tan
450c791ecf YARN-8629. Container cleanup fails while trying to delete Cgroups. (Suma Shivaprasad via wangda) 
Change-Id: I392ef4f8baa84d5d7b1f2e438c560b5426b6d4f2
(cherry picked from commit d4258fcad71eabe2de3cf829cde36840200ab9b6)
 2018-08-07 12:41:55 -07:00
Eric Yang
947dc34229 YARN-8624. Updated verbiage around entry point support. 
Contributed by Craig Condit
 2018-08-06 12:39:22 -04:00
Shane Kumpf
7773904974 YARN-8287. Update documentation and yarn-default related to the Docker runtime. Contributed by Craig Condit 
(cherry picked from commit bcfc9851f4c6d37d9a119c16ea7d4d253d3b9614)
 2018-08-03 18:23:37 -06:00
Sunil G
d8fdcf8b42 YARN-8615. [UI2] Resource Usage tab shows only memory related info. No info available for vcores/gpu. Contributed by Akhil PB. 
(cherry picked from commit 3426f4062ae0867c1ff5c71bd4e3dcb2f1affb89)
 2018-08-03 19:36:19 +05:30
Sunil G
1bfce639e8 YARN-8620. [UI2] YARN Services UI new submission failures are not debuggable. Contributed by Akhil PB. 
(cherry picked from commit 29417dbbf4f6e3881baaaa97408b335c32fe6708)
 2018-08-03 19:19:17 +05:30