Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,840 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

18840 Commits

Author SHA1 Message Date
Wangda Tan 450c791ecf YARN-8629. Container cleanup fails while trying to delete Cgroups. (Suma Shivaprasad via wangda) 
Change-Id: I392ef4f8baa84d5d7b1f2e438c560b5426b6d4f2
(cherry picked from commit d4258fcad7)
 2018-08-07 12:41:55 -07:00
Eric Yang 947dc34229 YARN-8624. Updated verbiage around entry point support. 
Contributed by Craig Condit
 2018-08-06 12:39:22 -04:00
Shane Kumpf 7773904974 YARN-8287. Update documentation and yarn-default related to the Docker runtime. Contributed by Craig Condit 
(cherry picked from commit bcfc9851f4)
 2018-08-03 18:23:37 -06:00
Sunil G d8fdcf8b42 YARN-8615. [UI2] Resource Usage tab shows only memory related info. No info available for vcores/gpu. Contributed by Akhil PB. 
(cherry picked from commit 3426f4062a)
 2018-08-03 19:36:19 +05:30
Sunil G 1bfce639e8 YARN-8620. [UI2] YARN Services UI new submission failures are not debuggable. Contributed by Akhil PB. 
(cherry picked from commit 29417dbbf4)
 2018-08-03 19:19:17 +05:30
Rohith Sharma K S 4816d10ddb YARN-8608. [UI2] No information available per application appAttempt about 'Total Outstanding Resource Requests'. Contributed by Akhil PB. 
(cherry picked from commit 022592ae79)
 2018-08-03 15:33:36 +05:30
Rohith Sharma K S 83ccb75b91 YARN-8603. [UI2] Latest run application should be listed first in the RM UI. Contributed by Akhil PB. 
(cherry picked from commit 33482d35e8)
 2018-08-03 15:33:24 +05:30
Jason Lowe 619019ccca YARN-8263. DockerClient still touches hadoop.tmp.dir. Contributed by Craig Condit 
(cherry picked from commit 7526815e32)
 2018-08-02 10:45:52 -05:00
Sunil G d76ab31961 YARN-8318. [UI2] IP address in component page shows N/A. Contributed by Yesha Vora. 
(cherry picked from commit 5033d7da8f)
 2018-08-02 20:10:08 +05:30
Sunil G b1fcbe7c2d YARN-8592. [UI2] rmip:port/ui2 endpoint shows a blank page in windows OS and Chrome browser. Contributed by Akhil PB. 
(cherry picked from commit 97870ec1f6)
 2018-08-02 16:12:12 +05:30
Sunil G 35b0686f24 YARN-8594. [UI2] Display current logged in user. Contributed by Akhil PB. 
(cherry picked from commit 1ea81169ba)
 2018-08-02 12:41:59 +05:30
Sunil G 1f77b20f08 YARN-8593. Add RM web service endpoint to get user information. Contributed by Akhil PB. 
(cherry picked from commit 735b492556)
 2018-08-02 08:35:54 +05:30
Eric Yang 680dac26d8 YARN-8610. Fixed initiate upgrade error message. 
Contributed by Chandni Singh

(cherry picked from commit 23f394240e)
 2018-08-01 20:43:22 -04:00
Arpit Agarwal c8fbe7921b HADOOP-15476. fix logging for split-dns multihome . Contributed by Ajay Kumar. 2018-08-01 12:32:13 -07:00
Shane Kumpf 62cc373dc5 YARN-8600. RegistryDNS hang when remote lookup does not reply. Contributed by Eric Yang 
(cherry picked from commit 603a57476c)
 2018-08-01 12:31:28 -06:00
Billie Rinaldi 2a94823f32 YARN-8403. Change the log level for fail to download resource from INFO to ERROR. Contributed by Eric Yang 
(cherry picked from commit 67c65da261)
 2018-08-01 08:58:15 -07:00
Sunil G a6525e0744 YARN-8595. [UI2] Container diagnostic information is missing from container page. Contributed by Akhil PB. 
(cherry picked from commit d920b9db77)
 2018-08-01 14:28:35 +05:30
Sunil G ff35f0c308 YARN-8606. Opportunistic scheduling does not work post RM failover. Contributed by Bibin A Chundatt. 
(cherry picked from commit a48a0cc7fd)
 2018-08-01 12:17:53 +05:30
Wangda Tan f4a3b26f9a YARN-8522. Application fails with InvalidResourceRequestException. (Zian Chen via wangda) 
Change-Id: I34dd7fa49bd4d10580c4a78051033b1068d28f1e
(cherry picked from commit 5cc8e99147)
 2018-07-31 22:35:16 -07:00
Sunil G cbfd7358d2 YARN-8397. Potential thread leak in ActivitiesManager. Contributed by Rohith Sharma K S. 
(cherry picked from commit 6310c0d17d)
 2018-08-01 08:34:09 +05:30
Eric Yang 7640d62716 YARN-8579. Recover NMToken of previous attempted component data. 
Contributed by Gour Saha
 2018-07-31 18:35:31 -04:00
Wangda Tan 5583711419 Preparing for 3.1.2 release 
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
 2018-07-31 13:08:55 -07:00
Wangda Tan 7b552c9d72 YARN-8418. App local logs could leaked if log aggregation fails to initialize for the app. (Bibin A Chundatt via wangda) 
Change-Id: I29a23ca4b219b48c92e7975cd44cddb8b0e04104
(cherry picked from commit 4b540bbfcf)
 2018-07-31 12:13:36 -07:00
Jonathan Hung b91cf90e1c YARN-7974. Allow updating application tracking url after registration. Contributed by Jonathan Hung 2018-07-30 17:57:25 -07:00
Chen Liang 5194994757 HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 16:44:22 -07:00
Chen Liang 46fcbc5030 Revert "HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen." 
This reverts commit 6812535b0b.
 2018-07-30 12:05:08 -07:00
bibinchundatt 8cd2a73777 YARN-8584. Several typos in Log Aggregation related classes. Contributed by Szilard Nemeth. 
(cherry picked from commit 2b39ad2698)
 2018-07-31 00:07:08 +05:30
Chen Liang 6812535b0b HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 10:33:02 -07:00
Brahma Reddy Battula 6f6d9ee9bf HDFS-12716. 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available. Contributed by Ranith Sardar and usharani 
(cherry picked from commit 3108d27edd)
 2018-07-30 15:57:58 +05:30
Sunil G f1eb5777a0 YARN-8591. [ATSv2] NPE while checking for entity acl in non-secure cluster. Contributed by Rohith Sharma K S. 
(cherry picked from commit 63e08ec071)
 2018-07-30 14:49:03 +05:30
Sammi Chen 42e34dae57 HADOOP-15607. AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream. Contributed by Jinhu Wu. 
(cherry picked from commit 0857f116b7)
(cherry picked from commit f9aedf32ec)
 2018-07-30 11:00:30 +08:00
bibinchundatt 2e7876a725 YARN-8558. NM recovery level db not cleaned up properly on container finish. Contributed by Bibin A Chundatt. 
(cherry picked from commit 3d586841ab)
 2018-07-28 20:56:35 +05:30
Eric Yang c2c3eee69c YARN-8508. Release GPU resource for killed container. 
Contributed by Chandni Singh

(cherry picked from commit ed9d60e888)
 2018-07-27 19:36:21 -04:00
Billie Rinaldi 06166f2255 YARN-8571. Validate service principal format prior to launching yarn service. Contributed by Eric Yang 
(cherry picked from commit b429f19d32)
 2018-07-27 11:35:41 -07:00
Arpit Agarwal 0eb187f72b HDFS-13765. Fix javadoc for FSDirMkdirOp#createParentDirectories. Contributed by Lokesh Jain. 2018-07-27 10:14:20 -07:00
Anu Engineer 2ebd553072 HDFS-13727. Log full stack trace if DiskBalancer exits with an unhandled exception. 
Contributed by Gabor Bota.

(cherry picked from commit 64e739e344)
 2018-07-27 09:43:44 -07:00
Eric Yang d6627cda9d YARN-8429. Improve diagnostic message when artifact is not set properly. 
Contributed by Gour Saha

(cherry picked from commit 8d3c068e59)
 2018-07-27 11:29:43 -04:00
Eric Yang a869bd970e HADOOP-15593. Fixed NPE in UGI spawnAutoRenewalThreadForUserCreds. 
Contributed by Gabor Bota

(cherry picked from commit 77721f39e2)
 2018-07-26 18:47:58 -04:00
Eric Yang 177f6045ac YARN-8545. Return allocated resource to RM for failed container. 
Contributed by Chandni Singh

(cherry picked from commit 40fad32824)
 2018-07-26 18:25:41 -04:00
Eric Yang 8e3807afe0 YARN-8330. Improved publishing ALLOCATED events to ATS. 
Contributed by Suma Shivaprasad

(cherry picked from commit f93ecf5c1e)
 2018-07-25 18:51:42 -04:00
Wei-Chiu Chuang 964f3454d1 HDFS-11060. make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable. Contributed by Lantao Jin. 
(cherry picked from commit e95c5e9f62)
 2018-07-25 11:05:18 -07:00
Eric E Payne 830ef12af8 YARN-4606. CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps. Contributed by Manikandan R 
(cherry picked from commit 9485c9aee6)
 2018-07-25 16:30:30 +00:00
bibinchundatt d2212c20c5 YARN-8577. Fix the broken anchor in SLS site-doc. Contributed by Weiwei Yang. 
(cherry picked from commit 3d3158cea4)
 2018-07-25 19:00:12 +05:30
bibinchundatt 8e65057eb1 YARN-8541. RM startup failure on recovery after user deletion. Contributed by Bibin A Chundatt. 2018-07-25 15:54:32 +05:30
Weiwei Yang b89624a943 YARN-8546. Resource leak caused by a reserved container being released more than once under async scheduling. Contributed by Tao Yang. 
(Cherry-picked from commit 5be9f4a5d0)
 2018-07-25 17:53:40 +08:00
Gera Shegalov 1396fa2a27 HADOOP-15612. Improve exception when tfile fails to load LzoCodec. (gera) 
(cherry picked from commit 6bec03cfc8)
 2018-07-24 23:05:34 -07:00
Xiao Chen 40c06b389a HADOOP-15609. Retry KMS calls when SSLHandshakeException occurs. Contributed by Kitti Nanasi. 
(cherry picked from commit 81d59506e5)
 2018-07-24 21:46:21 -07:00
Daniel Templeton 00c476abd8 HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica 
(Contributed by BELUGA BEHR via Daniel Templeton)

Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
(cherry picked from commit 849c45db18)
 2018-07-24 16:12:43 -07:00
Haibo Chen 7e7792dd7b YARN-6966. NodeManager metrics may return wrong negative values when NM restart. (Szilard Nemeth via Haibo Chen) 
(cherry picked from commit 9d3c39e9dd)
 2018-07-24 12:50:43 -07:00
Sunil G 4488fd8295 YARN-7748. TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted fails due to multiple container fail events. Contributed by Weiwei Yang. 
(cherry picked from commit 35ce6eb1f5)
 2018-07-24 22:21:15 +05:30