Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,051 Commits 326 Branches 371 Tags
Commit Graph

19051 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wangda Tan
68279fcd65 YARN-8588. Logging improvements for better debuggability. (Suma Shivaprasad via wangda) 
Change-Id: I66aa4b0ec031ae5ce0fae558e2f8cbcbbfebc442
(cherry picked from commit 344c335a920e6f32a35ebace0a118a9dc4a22fb7)
 2018-08-09 12:04:25 -07:00
Weiwei Yang
0ee7e80047 YARN-8559. Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint. Contributed by Weiwei Yang. 
(cherry picked from commit d352f167ebb865a6486afbbdac8e2a5e97a7bbad)
 2018-08-10 00:43:53 +08:00
Jason Lowe
3dd299a770 YARN-8331. Race condition in NM container launched after done. Contributed by Pradeep Ambati 
(cherry picked from commit cd04e954d2db27f0a15b7d1c492b7cdb656a51db)
 2018-08-09 10:23:02 -05:00
Sunil G
c6013b060d YARN-8633. Update DataTables version in yarn-common in line with JQuery 3 upgrade. Contributed by Akhil PB. 
(cherry picked from commit 00013d6ef7fdf65fa8a0f6eb56c0aef2f6e19444)
 2018-08-09 12:35:21 +05:30
Bharat Viswanadham
5430aab133 YARN-8426:Upgrade jquery-ui to 1.12.1 in YARN. Contributed by Sunil Govindan 
(cherry picked from commit 361ffb26bebf2491bbe3219ef4a83eb753660018)
 2018-08-09 12:27:50 +05:30
Robert Kanter
0ed91309d3 YARN-8568. Replace the deprecated zk-address property in the HA config example in ResourceManagerHA.md (bsteinbach via rkanter) 
(cherry picked from commit 8478732bb28e9e71061d6b4a043a3a1b5c688902)
 2018-08-08 15:10:52 -07:00
Wangda Tan
f16c311486 Make 3.1.1 awared by other branches - adding missing files 
(cherry picked from commit 3214cd75acd0474373951870e1ba2ec11833a3da)
 2018-08-08 13:06:14 -07:00
Wangda Tan
781620a44d Make 3.1.1 awared by other branches 
(cherry picked from commit 49c687608b65b772faeed614700ece8e526432e8)
 2018-08-08 13:04:05 -07:00
bibinchundatt
b4f957e655 YARN-8601. Print ExecutionType in Container report CLI. Contributed by Bilwa S T. 
(cherry picked from commit ff06bd1be83a2a6d2ee39cb002e91499720a7243)
 2018-08-08 22:46:16 +05:30
Xiao Chen
bf03b25f4b HDFS-13728. Disk Balancer should not fail if volume usage is greater than capacity. Contributed by Stephen O'Donnell. 
(cherry picked from commit 6677717c689cc94a15f14c3466242e23652d473b)
 2018-08-07 22:05:51 -07:00
Wangda Tan
f2768eaa38 YARN-8407. Container launch exception in AM log should be printed in ERROR level. (Yesha Vora via wangda) 
Change-Id: I154e873df1df3503a09c41d6b3874ca195af91d9
(cherry picked from commit 861095f761b40171e0dc25f769f486d910cc3e88)
 2018-08-07 13:07:28 -07:00
Wangda Tan
450c791ecf YARN-8629. Container cleanup fails while trying to delete Cgroups. (Suma Shivaprasad via wangda) 
Change-Id: I392ef4f8baa84d5d7b1f2e438c560b5426b6d4f2
(cherry picked from commit d4258fcad71eabe2de3cf829cde36840200ab9b6)
 2018-08-07 12:41:55 -07:00
Eric Yang
947dc34229 YARN-8624. Updated verbiage around entry point support. 
Contributed by Craig Condit
 2018-08-06 12:39:22 -04:00
Shane Kumpf
7773904974 YARN-8287. Update documentation and yarn-default related to the Docker runtime. Contributed by Craig Condit 
(cherry picked from commit bcfc9851f4c6d37d9a119c16ea7d4d253d3b9614)
 2018-08-03 18:23:37 -06:00
Sunil G
d8fdcf8b42 YARN-8615. [UI2] Resource Usage tab shows only memory related info. No info available for vcores/gpu. Contributed by Akhil PB. 
(cherry picked from commit 3426f4062ae0867c1ff5c71bd4e3dcb2f1affb89)
 2018-08-03 19:36:19 +05:30
Sunil G
1bfce639e8 YARN-8620. [UI2] YARN Services UI new submission failures are not debuggable. Contributed by Akhil PB. 
(cherry picked from commit 29417dbbf4f6e3881baaaa97408b335c32fe6708)
 2018-08-03 19:19:17 +05:30
Rohith Sharma K S
4816d10ddb YARN-8608. [UI2] No information available per application appAttempt about 'Total Outstanding Resource Requests'. Contributed by Akhil PB. 
(cherry picked from commit 022592ae7941607091fa85e4a9e8608ba53f3814)
 2018-08-03 15:33:36 +05:30
Rohith Sharma K S
83ccb75b91 YARN-8603. [UI2] Latest run application should be listed first in the RM UI. Contributed by Akhil PB. 
(cherry picked from commit 33482d35e802ac3468317b844122b347fe486861)
 2018-08-03 15:33:24 +05:30
Jason Lowe
619019ccca YARN-8263. DockerClient still touches hadoop.tmp.dir. Contributed by Craig Condit 
(cherry picked from commit 7526815e3234ca352854ecfb142a13f1a188d5bd)
 2018-08-02 10:45:52 -05:00
Sunil G
d76ab31961 YARN-8318. [UI2] IP address in component page shows N/A. Contributed by Yesha Vora. 
(cherry picked from commit 5033d7da8f6f703d8774492c42e31e9b9cb692a5)
 2018-08-02 20:10:08 +05:30
Sunil G
b1fcbe7c2d YARN-8592. [UI2] rmip:port/ui2 endpoint shows a blank page in windows OS and Chrome browser. Contributed by Akhil PB. 
(cherry picked from commit 97870ec1f6e40ee863333f29411d71b6c687bbed)
 2018-08-02 16:12:12 +05:30
Sunil G
35b0686f24 YARN-8594. [UI2] Display current logged in user. Contributed by Akhil PB. 
(cherry picked from commit 1ea81169bad5bd6433348ef8e5e7ac12c5a9cb5e)
 2018-08-02 12:41:59 +05:30
Sunil G
1f77b20f08 YARN-8593. Add RM web service endpoint to get user information. Contributed by Akhil PB. 
(cherry picked from commit 735b4925569541fb8e65dc0c668ccc2aa2ffb30b)
 2018-08-02 08:35:54 +05:30
Eric Yang
680dac26d8 YARN-8610. Fixed initiate upgrade error message. 
Contributed by Chandni Singh

(cherry picked from commit 23f394240e1568a38025e63e9dc0842e8c5235f7)
 2018-08-01 20:43:22 -04:00
Arpit Agarwal
c8fbe7921b HADOOP-15476. fix logging for split-dns multihome . Contributed by Ajay Kumar. 2018-08-01 12:32:13 -07:00
Shane Kumpf
62cc373dc5 YARN-8600. RegistryDNS hang when remote lookup does not reply. Contributed by Eric Yang 
(cherry picked from commit 603a57476ce0bf9514f0432a235f29432ca4c323)
 2018-08-01 12:31:28 -06:00
Billie Rinaldi
2a94823f32 YARN-8403. Change the log level for fail to download resource from INFO to ERROR. Contributed by Eric Yang 
(cherry picked from commit 67c65da261464a0dccb63dc27668109a52e05714)
 2018-08-01 08:58:15 -07:00
Sunil G
a6525e0744 YARN-8595. [UI2] Container diagnostic information is missing from container page. Contributed by Akhil PB. 
(cherry picked from commit d920b9db77be44adc4f8a2a0c2df889af82be04f)
 2018-08-01 14:28:35 +05:30
Sunil G
ff35f0c308 YARN-8606. Opportunistic scheduling does not work post RM failover. Contributed by Bibin A Chundatt. 
(cherry picked from commit a48a0cc7fd8e7ac1c07b260e6078077824f27c35)
 2018-08-01 12:17:53 +05:30
Wangda Tan
f4a3b26f9a YARN-8522. Application fails with InvalidResourceRequestException. (Zian Chen via wangda) 
Change-Id: I34dd7fa49bd4d10580c4a78051033b1068d28f1e
(cherry picked from commit 5cc8e99147276a059979813f7fd323dd7d77b248)
 2018-07-31 22:35:16 -07:00
Sunil G
cbfd7358d2 YARN-8397. Potential thread leak in ActivitiesManager. Contributed by Rohith Sharma K S. 
(cherry picked from commit 6310c0d17d6422a595f856a55b4f1fb82be43739)
 2018-08-01 08:34:09 +05:30
Eric Yang
7640d62716 YARN-8579. Recover NMToken of previous attempted component data. 
Contributed by Gour Saha
 2018-07-31 18:35:31 -04:00
Wangda Tan
5583711419 Preparing for 3.1.2 release 
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
 2018-07-31 13:08:55 -07:00
Wangda Tan
7b552c9d72 YARN-8418. App local logs could leaked if log aggregation fails to initialize for the app. (Bibin A Chundatt via wangda) 
Change-Id: I29a23ca4b219b48c92e7975cd44cddb8b0e04104
(cherry picked from commit 4b540bbfcf02d828052999215c6135603d98f5db)
 2018-07-31 12:13:36 -07:00
Jonathan Hung
b91cf90e1c YARN-7974. Allow updating application tracking url after registration. Contributed by Jonathan Hung 2018-07-30 17:57:25 -07:00
Chen Liang
5194994757 HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 16:44:22 -07:00
Chen Liang
46fcbc5030 Revert "HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen." 
This reverts commit 6812535b0b4a0ec212e174637e5aedd3ff582f4c.
 2018-07-30 12:05:08 -07:00
bibinchundatt
8cd2a73777 YARN-8584. Several typos in Log Aggregation related classes. Contributed by Szilard Nemeth. 
(cherry picked from commit 2b39ad26984d641bad57db2cfcc0b7515ef95f46)
 2018-07-31 00:07:08 +05:30
Chen Liang
6812535b0b HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 10:33:02 -07:00
Brahma Reddy Battula
6f6d9ee9bf HDFS-12716. 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available. Contributed by Ranith Sardar and usharani 
(cherry picked from commit 3108d27edde941d153a58f71fb1096cce2995531)
 2018-07-30 15:57:58 +05:30
Sunil G
f1eb5777a0 YARN-8591. [ATSv2] NPE while checking for entity acl in non-secure cluster. Contributed by Rohith Sharma K S. 
(cherry picked from commit 63e08ec071852640babea9e39780327a0907712a)
 2018-07-30 14:49:03 +05:30
Sammi Chen
42e34dae57 HADOOP-15607. AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream. Contributed by Jinhu Wu. 
(cherry picked from commit 0857f116b754d83d3c540cd6f989087af24fef27)
(cherry picked from commit f9aedf32ecdc6075c8760220cdfadecb9f1b6738)
 2018-07-30 11:00:30 +08:00
bibinchundatt
2e7876a725 YARN-8558. NM recovery level db not cleaned up properly on container finish. Contributed by Bibin A Chundatt. 
(cherry picked from commit 3d586841aba99c7df98b2b4d3e48ec0144bad086)
 2018-07-28 20:56:35 +05:30
Eric Yang
c2c3eee69c YARN-8508. Release GPU resource for killed container. 
Contributed by Chandni Singh

(cherry picked from commit ed9d60e888d0acfd748fda7f66249f5b79a3ed6d)
 2018-07-27 19:36:21 -04:00
Billie Rinaldi
06166f2255 YARN-8571. Validate service principal format prior to launching yarn service. Contributed by Eric Yang 
(cherry picked from commit b429f19d32d8f60a3535e047ef10cfb3edeb54c8)
 2018-07-27 11:35:41 -07:00
Arpit Agarwal
0eb187f72b HDFS-13765. Fix javadoc for FSDirMkdirOp#createParentDirectories. Contributed by Lokesh Jain. 2018-07-27 10:14:20 -07:00
Anu Engineer
2ebd553072 HDFS-13727. Log full stack trace if DiskBalancer exits with an unhandled exception. 
Contributed by Gabor Bota.

(cherry picked from commit 64e739e344ac474046d4f4ecf0865dd92be13762)
 2018-07-27 09:43:44 -07:00
Eric Yang
d6627cda9d YARN-8429. Improve diagnostic message when artifact is not set properly. 
Contributed by Gour Saha

(cherry picked from commit 8d3c068e59fdddd18e3f8260713fee83c458aa1d)
 2018-07-27 11:29:43 -04:00
Eric Yang
a869bd970e HADOOP-15593. Fixed NPE in UGI spawnAutoRenewalThreadForUserCreds. 
Contributed by Gabor Bota

(cherry picked from commit 77721f39e26b630352a1f4087524a3fbd21ff06e)
 2018-07-26 18:47:58 -04:00
Eric Yang
177f6045ac YARN-8545. Return allocated resource to RM for failed container. 
Contributed by Chandni Singh

(cherry picked from commit 40fad32824d2f8f960c779d78357e62103453da0)
 2018-07-26 18:25:41 -04:00