Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,880 Commits 326 Branches 371 Tags
Commit Graph

18880 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Sunil G
35b0686f24 YARN-8594. [UI2] Display current logged in user. Contributed by Akhil PB. 
(cherry picked from commit 1ea81169bad5bd6433348ef8e5e7ac12c5a9cb5e)
 2018-08-02 12:41:59 +05:30
Sunil G
1f77b20f08 YARN-8593. Add RM web service endpoint to get user information. Contributed by Akhil PB. 
(cherry picked from commit 735b4925569541fb8e65dc0c668ccc2aa2ffb30b)
 2018-08-02 08:35:54 +05:30
Eric Yang
680dac26d8 YARN-8610. Fixed initiate upgrade error message. 
Contributed by Chandni Singh

(cherry picked from commit 23f394240e1568a38025e63e9dc0842e8c5235f7)
 2018-08-01 20:43:22 -04:00
Arpit Agarwal
c8fbe7921b HADOOP-15476. fix logging for split-dns multihome . Contributed by Ajay Kumar. 2018-08-01 12:32:13 -07:00
Shane Kumpf
62cc373dc5 YARN-8600. RegistryDNS hang when remote lookup does not reply. Contributed by Eric Yang 
(cherry picked from commit 603a57476ce0bf9514f0432a235f29432ca4c323)
 2018-08-01 12:31:28 -06:00
Billie Rinaldi
2a94823f32 YARN-8403. Change the log level for fail to download resource from INFO to ERROR. Contributed by Eric Yang 
(cherry picked from commit 67c65da261464a0dccb63dc27668109a52e05714)
 2018-08-01 08:58:15 -07:00
Sunil G
a6525e0744 YARN-8595. [UI2] Container diagnostic information is missing from container page. Contributed by Akhil PB. 
(cherry picked from commit d920b9db77be44adc4f8a2a0c2df889af82be04f)
 2018-08-01 14:28:35 +05:30
Sunil G
ff35f0c308 YARN-8606. Opportunistic scheduling does not work post RM failover. Contributed by Bibin A Chundatt. 
(cherry picked from commit a48a0cc7fd8e7ac1c07b260e6078077824f27c35)
 2018-08-01 12:17:53 +05:30
Wangda Tan
f4a3b26f9a YARN-8522. Application fails with InvalidResourceRequestException. (Zian Chen via wangda) 
Change-Id: I34dd7fa49bd4d10580c4a78051033b1068d28f1e
(cherry picked from commit 5cc8e99147276a059979813f7fd323dd7d77b248)
 2018-07-31 22:35:16 -07:00
Sunil G
cbfd7358d2 YARN-8397. Potential thread leak in ActivitiesManager. Contributed by Rohith Sharma K S. 
(cherry picked from commit 6310c0d17d6422a595f856a55b4f1fb82be43739)
 2018-08-01 08:34:09 +05:30
Eric Yang
7640d62716 YARN-8579. Recover NMToken of previous attempted component data. 
Contributed by Gour Saha
 2018-07-31 18:35:31 -04:00
Wangda Tan
5583711419 Preparing for 3.1.2 release 
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
 2018-07-31 13:08:55 -07:00
Wangda Tan
7b552c9d72 YARN-8418. App local logs could leaked if log aggregation fails to initialize for the app. (Bibin A Chundatt via wangda) 
Change-Id: I29a23ca4b219b48c92e7975cd44cddb8b0e04104
(cherry picked from commit 4b540bbfcf02d828052999215c6135603d98f5db)
 2018-07-31 12:13:36 -07:00
Jonathan Hung
b91cf90e1c YARN-7974. Allow updating application tracking url after registration. Contributed by Jonathan Hung 2018-07-30 17:57:25 -07:00
Chen Liang
5194994757 HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 16:44:22 -07:00
Chen Liang
46fcbc5030 Revert "HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen." 
This reverts commit 6812535b0b4a0ec212e174637e5aedd3ff582f4c.
 2018-07-30 12:05:08 -07:00
bibinchundatt
8cd2a73777 YARN-8584. Several typos in Log Aggregation related classes. Contributed by Szilard Nemeth. 
(cherry picked from commit 2b39ad26984d641bad57db2cfcc0b7515ef95f46)
 2018-07-31 00:07:08 +05:30
Chen Liang
6812535b0b HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 10:33:02 -07:00
Brahma Reddy Battula
6f6d9ee9bf HDFS-12716. 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available. Contributed by Ranith Sardar and usharani 
(cherry picked from commit 3108d27edde941d153a58f71fb1096cce2995531)
 2018-07-30 15:57:58 +05:30
Sunil G
f1eb5777a0 YARN-8591. [ATSv2] NPE while checking for entity acl in non-secure cluster. Contributed by Rohith Sharma K S. 
(cherry picked from commit 63e08ec071852640babea9e39780327a0907712a)
 2018-07-30 14:49:03 +05:30
Sammi Chen
42e34dae57 HADOOP-15607. AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream. Contributed by Jinhu Wu. 
(cherry picked from commit 0857f116b754d83d3c540cd6f989087af24fef27)
(cherry picked from commit f9aedf32ecdc6075c8760220cdfadecb9f1b6738)
 2018-07-30 11:00:30 +08:00
bibinchundatt
2e7876a725 YARN-8558. NM recovery level db not cleaned up properly on container finish. Contributed by Bibin A Chundatt. 
(cherry picked from commit 3d586841aba99c7df98b2b4d3e48ec0144bad086)
 2018-07-28 20:56:35 +05:30
Eric Yang
c2c3eee69c YARN-8508. Release GPU resource for killed container. 
Contributed by Chandni Singh

(cherry picked from commit ed9d60e888d0acfd748fda7f66249f5b79a3ed6d)
 2018-07-27 19:36:21 -04:00
Billie Rinaldi
06166f2255 YARN-8571. Validate service principal format prior to launching yarn service. Contributed by Eric Yang 
(cherry picked from commit b429f19d32d8f60a3535e047ef10cfb3edeb54c8)
 2018-07-27 11:35:41 -07:00
Arpit Agarwal
0eb187f72b HDFS-13765. Fix javadoc for FSDirMkdirOp#createParentDirectories. Contributed by Lokesh Jain. 2018-07-27 10:14:20 -07:00
Anu Engineer
2ebd553072 HDFS-13727. Log full stack trace if DiskBalancer exits with an unhandled exception. 
Contributed by Gabor Bota.

(cherry picked from commit 64e739e344ac474046d4f4ecf0865dd92be13762)
 2018-07-27 09:43:44 -07:00
Eric Yang
d6627cda9d YARN-8429. Improve diagnostic message when artifact is not set properly. 
Contributed by Gour Saha

(cherry picked from commit 8d3c068e59fdddd18e3f8260713fee83c458aa1d)
 2018-07-27 11:29:43 -04:00
Eric Yang
a869bd970e HADOOP-15593. Fixed NPE in UGI spawnAutoRenewalThreadForUserCreds. 
Contributed by Gabor Bota

(cherry picked from commit 77721f39e26b630352a1f4087524a3fbd21ff06e)
 2018-07-26 18:47:58 -04:00
Eric Yang
177f6045ac YARN-8545. Return allocated resource to RM for failed container. 
Contributed by Chandni Singh

(cherry picked from commit 40fad32824d2f8f960c779d78357e62103453da0)
 2018-07-26 18:25:41 -04:00
Eric Yang
8e3807afe0 YARN-8330. Improved publishing ALLOCATED events to ATS. 
Contributed by Suma Shivaprasad

(cherry picked from commit f93ecf5c1e0b3db27424963814fc01ec43eb76e0)
 2018-07-25 18:51:42 -04:00
Wei-Chiu Chuang
964f3454d1 HDFS-11060. make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable. Contributed by Lantao Jin. 
(cherry picked from commit e95c5e9f62452ee848875ec2f8642eab4992cd23)
 2018-07-25 11:05:18 -07:00
Eric E Payne
830ef12af8 YARN-4606. CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps. Contributed by Manikandan R 
(cherry picked from commit 9485c9aee6e9bb935c3e6ae4da81d70b621781de)
 2018-07-25 16:30:30 +00:00
bibinchundatt
d2212c20c5 YARN-8577. Fix the broken anchor in SLS site-doc. Contributed by Weiwei Yang. 
(cherry picked from commit 3d3158cea4580eb2e3b2af635c3a7d30f4dbb873)
 2018-07-25 19:00:12 +05:30
bibinchundatt
8e65057eb1 YARN-8541. RM startup failure on recovery after user deletion. Contributed by Bibin A Chundatt. 2018-07-25 15:54:32 +05:30
Weiwei Yang
b89624a943 YARN-8546. Resource leak caused by a reserved container being released more than once under async scheduling. Contributed by Tao Yang. 
(Cherry-picked from commit 5be9f4a5d05c9cb99348719fe35626b1de3055db)
 2018-07-25 17:53:40 +08:00
Gera Shegalov
1396fa2a27 HADOOP-15612. Improve exception when tfile fails to load LzoCodec. (gera) 
(cherry picked from commit 6bec03cfc8bdcf6aa3df9c22231ab959ba31f2f5)
 2018-07-24 23:05:34 -07:00
Xiao Chen
40c06b389a HADOOP-15609. Retry KMS calls when SSLHandshakeException occurs. Contributed by Kitti Nanasi. 
(cherry picked from commit 81d59506e539673edde12e19c0df5c2edd9d02ad)
 2018-07-24 21:46:21 -07:00
Daniel Templeton
00c476abd8 HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica 
(Contributed by BELUGA BEHR via Daniel Templeton)

Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
(cherry picked from commit 849c45db187224095b13fe297a4d7377fbb9d2cd)
 2018-07-24 16:12:43 -07:00
Haibo Chen
7e7792dd7b YARN-6966. NodeManager metrics may return wrong negative values when NM restart. (Szilard Nemeth via Haibo Chen) 
(cherry picked from commit 9d3c39e9dd88b8f32223c01328581bb68507d415)
 2018-07-24 12:50:43 -07:00
Sunil G
4488fd8295 YARN-7748. TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted fails due to multiple container fail events. Contributed by Weiwei Yang. 
(cherry picked from commit 35ce6eb1f526ce3db7e015fb1761eee15604100c)
 2018-07-24 22:21:15 +05:30
bibinchundatt
a684a2efb8 YARN-8548. AllocationRespose proto setNMToken initBuilder not done. Contributed by Bilwa S T. 
(cherry picked from commit ff7c2eda34c2c40ad71b50df6462a661bd213fbd)
 2018-07-24 16:30:31 +05:30
bibinchundatt
0710107f8d YARN-8544. [DS] AM registration fails when hadoop authorization is enabled. Contributed by Bibin A Chundatt. 
(cherry picked from commit 84612788339392fcda1aef0e27c43f5c6b2a19e5)
 2018-07-24 13:11:31 +05:30
Yiqun Lin
5aca0588ea HDFS-13583. RBF: Router admin clrQuota is not synchronized with nameservice. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 17a87977f29ced49724f561a68565217c8cb4e94)
 2018-07-24 11:19:21 +08:00
Eric Yang
23b8546a80 YARN-8380. Support bind propagation options for mounts in docker runtime. 
Contributed by Billie Rinaldi

(cherry picked from commit 8688a0c7f88f2adf1a7fce695e06f3dd1f745080)
 2018-07-23 20:13:41 -04:00
Eric Yang
e665c0a9dd YARN-8360. Improve YARN service restart policy and node manager auto restart policy. 
Contributed by Suma Shivaprasad

(cherry picked from commit 84d7bf1eeff6b9418361afa4aa713e5e6f771365)
 2018-07-23 12:59:37 -04:00
Eric Yang
4f2a129f2e YARN-8301. Added YARN service upgrade instructions. 
Contributed by Chandni Singh

(cherry picked from commit 10014a4d88f239d3c072e51bc0739cba1fca9406)
 2018-07-20 19:48:19 -04:00
Weiwei Yang
004e1f248e YARN-8528. Final states in ContainerAllocation might be modified externally causing unexpected allocation results. Contributed by Xintong Song. 2018-07-20 22:43:47 +08:00
Yiqun Lin
823d576a66 HDFS-13743. RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver. Contributed by Takanobu Asanuma. 
(cherry picked from commit 7b25fb949bf6f02df997beeca7df46c9e84c8d96)
 2018-07-20 17:31:13 +08:00
Wangda Tan
23624c9248 MAPREDUCE-7118. Distributed cache conflicts breaks backwards compatability. (Jason Lowe via wangda) 
Change-Id: I89ab4852b4ad305fec19812e8931c59d96581376
(cherry picked from commit b3b4d4ccb53fdf8dacc66e912822b34f8b3bf215)
 2018-07-19 14:26:40 -07:00
Steve Loughran
749fff577e
HADOOP-15547/ WASB: improve listStatus performance. 
Contributed by Thomas Marquardt.
 2018-07-19 12:29:21 -07:00