Commit Graph

19072 Commits

Author SHA1 Message Date
Rohith Sharma K S 3532bd5c8b YARN-8612. Fix NM Collector Service Port issue in YarnConfiguration. Contributed by Prabha Manepalli.
(cherry picked from commit 1697a02306)
2018-08-17 11:13:25 +05:30
Eric Yang 5237bdfb5a YARN-8667. Cleanup symlinks when container restarted by NM.
Contributed by Chandni Singh

(cherry picked from commit d42806160e)
2018-08-16 18:44:47 -04:00
Daniel Templeton fbedf89377 HDFS-13746. Still occasional "Should be different group" failure in TestRefreshUserMappings#testGroupMappingRefresh
(Contributed by Siyao Meng via Daniel Templeton)

Change-Id: I9fad1537ace38367a463d9fe67aaa28d3178fc69
(cherry picked from commit 8512e1a91b)
2018-08-16 15:01:34 -07:00
Eric Yang 97c1934247 YARN-8474. Fixed ApiServiceClient kerberos negotiation.
Contributed by Billie Rinaldi

(cherry picked from commit 8990eaf592)
2018-08-16 12:50:52 -04:00
Jason Lowe 819a2a6f10 YARN-8656. container-executor should not write cgroup tasks files for docker containers. Contributed by Jim Brennan
(cherry picked from commit cb21eaa026)
2018-08-16 10:09:56 -05:00
Weiwei Yang 05547b1e0b YARN-8614. Fix few annotation typos in YarnConfiguration. Contributed by Sen Zhao.
(cherry picked from commit 8dc07b4723)
2018-08-15 12:38:55 +08:00
Xiao Chen 83d0d82a69 HDFS-13788. Update EC documentation about rack fault tolerance. Contributed by Kitti Nanasi.
(cherry picked from commit cede33997f)
2018-08-14 11:57:50 -07:00
Wei-Chiu Chuang 7a115e8de4 HDFS-13758. DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction. Contributed by chencan.
(cherry picked from commit 61a9b4f58b)
2018-08-14 11:52:24 -07:00
Jason Lowe 95cd6de5c6 YARN-8640. Restore previous state in container-executor after failure. Contributed by Jim Brennan
(cherry picked from commit d1d129aa9d)
2018-08-14 10:26:21 -05:00
Wei-Chiu Chuang 74d4fd975a HDFS-13738. fsck -list-corruptfileblocks has infinite loop if user is not privileged. Contributed by Yuen-Kuei Hsueh.
(cherry picked from commit 4023eeba05)
2018-08-13 17:37:12 -07:00
Wei-Chiu Chuang b38649c59a HDFS-13813. Exit NameNode if dangling child inode is detected when saving FsImage. Contributed by Siyao Meng.
(cherry picked from commit 23854443ef)
2018-08-13 16:13:36 -07:00
Vinayakumar B b3f29e3504 HDFS-13786. EC: Display erasure coding policy for sub-directories is not working. Contributed by Ayush Saxena.
(cherry picked from commit 2b0f977241)
2018-08-13 13:58:27 -07:00
Chen Liang e05b38f132 HDFS-13735. Make QJM HTTP URL connection timeout configurable. Contributed by Chao Sun. 2018-08-13 12:48:12 -07:00
Arpit Agarwal 4e197a4b46 HDFS-13823. NameNode UI : "Utilities -> Browse the file system -> open a file -> Head the file" is not working. Contributed by Nanda kumar. 2018-08-13 11:36:15 -07:00
Xiao Chen 1d748f0261 HADOOP-15638. KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x. Contributed by Wei-Chiu Chuang.
(cherry picked from commit b94c8874e2)
2018-08-13 10:41:07 -07:00
Chao Sun baca64cc68 Remove super user privilege requirement for NameNode.getServiceStatus. Contributed by Chao Sun.
(cherry picked from commit a2a8c48699)
2018-08-10 16:07:02 -07:00
Xiao Chen 7d1e2e1fbb HDFS-13721. NPE in DataNode due to uninitialized DiskBalancer. 2018-08-10 13:53:34 -07:00
Shane Kumpf ba6b48e19f YARN-8520. Document best practice for user management. Contributed by Eric Yang
(cherry picked from commit e7951c69cb)
2018-08-10 14:47:14 -06:00
Weiwei Yang 734bc42289 YARN-8575. Avoid committing allocation proposal to unavailable nodes in async scheduling. Contributed by Tao Yang.
(cherry picked from commit 0a71bf1452)
2018-08-10 15:10:27 +08:00
Weiwei Yang 991514f7c3 YARN-8521. NPE in AllocationTagsManager when a container is removed more than once. Contributed by Weiwei Yang.
(cherry picked from commit 08d5060605)
2018-08-10 08:44:53 +08:00
Wangda Tan beea18736b YARN-8136. Add version attribute to site doc examples and quickstart. (Eric Yang via wangda)
Change-Id: I4541b239f490ca0a6edf9698e0d3deaf83669151
(cherry picked from commit 8244abb7ae)
2018-08-09 12:04:33 -07:00
Wangda Tan 68279fcd65 YARN-8588. Logging improvements for better debuggability. (Suma Shivaprasad via wangda)
Change-Id: I66aa4b0ec031ae5ce0fae558e2f8cbcbbfebc442
(cherry picked from commit 344c335a92)
2018-08-09 12:04:25 -07:00
Weiwei Yang 0ee7e80047 YARN-8559. Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint. Contributed by Weiwei Yang.
(cherry picked from commit d352f167eb)
2018-08-10 00:43:53 +08:00
Jason Lowe 3dd299a770 YARN-8331. Race condition in NM container launched after done. Contributed by Pradeep Ambati
(cherry picked from commit cd04e954d2)
2018-08-09 10:23:02 -05:00
Sunil G c6013b060d YARN-8633. Update DataTables version in yarn-common in line with JQuery 3 upgrade. Contributed by Akhil PB.
(cherry picked from commit 00013d6ef7)
2018-08-09 12:35:21 +05:30
Bharat Viswanadham 5430aab133 YARN-8426:Upgrade jquery-ui to 1.12.1 in YARN. Contributed by Sunil Govindan
(cherry picked from commit 361ffb26be)
2018-08-09 12:27:50 +05:30
Robert Kanter 0ed91309d3 YARN-8568. Replace the deprecated zk-address property in the HA config example in ResourceManagerHA.md (bsteinbach via rkanter)
(cherry picked from commit 8478732bb2)
2018-08-08 15:10:52 -07:00
Wangda Tan f16c311486 Make 3.1.1 awared by other branches - adding missing files
(cherry picked from commit 3214cd75ac)
2018-08-08 13:06:14 -07:00
Wangda Tan 781620a44d Make 3.1.1 awared by other branches
(cherry picked from commit 49c687608b)
2018-08-08 13:04:05 -07:00
bibinchundatt b4f957e655 YARN-8601. Print ExecutionType in Container report CLI. Contributed by Bilwa S T.
(cherry picked from commit ff06bd1be8)
2018-08-08 22:46:16 +05:30
Xiao Chen bf03b25f4b HDFS-13728. Disk Balancer should not fail if volume usage is greater than capacity. Contributed by Stephen O'Donnell.
(cherry picked from commit 6677717c68)
2018-08-07 22:05:51 -07:00
Wangda Tan f2768eaa38 YARN-8407. Container launch exception in AM log should be printed in ERROR level. (Yesha Vora via wangda)
Change-Id: I154e873df1df3503a09c41d6b3874ca195af91d9
(cherry picked from commit 861095f761)
2018-08-07 13:07:28 -07:00
Wangda Tan 450c791ecf YARN-8629. Container cleanup fails while trying to delete Cgroups. (Suma Shivaprasad via wangda)
Change-Id: I392ef4f8baa84d5d7b1f2e438c560b5426b6d4f2
(cherry picked from commit d4258fcad7)
2018-08-07 12:41:55 -07:00
Eric Yang 947dc34229 YARN-8624. Updated verbiage around entry point support.
Contributed by Craig Condit
2018-08-06 12:39:22 -04:00
Shane Kumpf 7773904974 YARN-8287. Update documentation and yarn-default related to the Docker runtime. Contributed by Craig Condit
(cherry picked from commit bcfc9851f4)
2018-08-03 18:23:37 -06:00
Sunil G d8fdcf8b42 YARN-8615. [UI2] Resource Usage tab shows only memory related info. No info available for vcores/gpu. Contributed by Akhil PB.
(cherry picked from commit 3426f4062a)
2018-08-03 19:36:19 +05:30
Sunil G 1bfce639e8 YARN-8620. [UI2] YARN Services UI new submission failures are not debuggable. Contributed by Akhil PB.
(cherry picked from commit 29417dbbf4)
2018-08-03 19:19:17 +05:30
Rohith Sharma K S 4816d10ddb YARN-8608. [UI2] No information available per application appAttempt about 'Total Outstanding Resource Requests'. Contributed by Akhil PB.
(cherry picked from commit 022592ae79)
2018-08-03 15:33:36 +05:30
Rohith Sharma K S 83ccb75b91 YARN-8603. [UI2] Latest run application should be listed first in the RM UI. Contributed by Akhil PB.
(cherry picked from commit 33482d35e8)
2018-08-03 15:33:24 +05:30
Jason Lowe 619019ccca YARN-8263. DockerClient still touches hadoop.tmp.dir. Contributed by Craig Condit
(cherry picked from commit 7526815e32)
2018-08-02 10:45:52 -05:00
Sunil G d76ab31961 YARN-8318. [UI2] IP address in component page shows N/A. Contributed by Yesha Vora.
(cherry picked from commit 5033d7da8f)
2018-08-02 20:10:08 +05:30
Sunil G b1fcbe7c2d YARN-8592. [UI2] rmip:port/ui2 endpoint shows a blank page in windows OS and Chrome browser. Contributed by Akhil PB.
(cherry picked from commit 97870ec1f6)
2018-08-02 16:12:12 +05:30
Sunil G 35b0686f24 YARN-8594. [UI2] Display current logged in user. Contributed by Akhil PB.
(cherry picked from commit 1ea81169ba)
2018-08-02 12:41:59 +05:30
Sunil G 1f77b20f08 YARN-8593. Add RM web service endpoint to get user information. Contributed by Akhil PB.
(cherry picked from commit 735b492556)
2018-08-02 08:35:54 +05:30
Eric Yang 680dac26d8 YARN-8610. Fixed initiate upgrade error message.
Contributed by Chandni Singh

(cherry picked from commit 23f394240e)
2018-08-01 20:43:22 -04:00
Arpit Agarwal c8fbe7921b HADOOP-15476. fix logging for split-dns multihome . Contributed by Ajay Kumar. 2018-08-01 12:32:13 -07:00
Shane Kumpf 62cc373dc5 YARN-8600. RegistryDNS hang when remote lookup does not reply. Contributed by Eric Yang
(cherry picked from commit 603a57476c)
2018-08-01 12:31:28 -06:00
Billie Rinaldi 2a94823f32 YARN-8403. Change the log level for fail to download resource from INFO to ERROR. Contributed by Eric Yang
(cherry picked from commit 67c65da261)
2018-08-01 08:58:15 -07:00
Sunil G a6525e0744 YARN-8595. [UI2] Container diagnostic information is missing from container page. Contributed by Akhil PB.
(cherry picked from commit d920b9db77)
2018-08-01 14:28:35 +05:30
Sunil G ff35f0c308 YARN-8606. Opportunistic scheduling does not work post RM failover. Contributed by Bibin A Chundatt.
(cherry picked from commit a48a0cc7fd)
2018-08-01 12:17:53 +05:30