Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,401 Commits 326 Branches 371 Tags
Commit Graph

18401 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Inigo Goiri
8a9c2d7b97 HDFS-13651. TestReencryptionHandler fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit e308ac88d399e9bed3581ff4b1450aa2070dcedf)
 2018-06-02 20:13:21 -07:00
Billie Rinaldi
e59e9feefa YARN-8342. Enable untrusted docker image to run with launch command. Contributed by Eric Yang 
(cherry picked from commit 31998643a51f1e08f723f18dc5476ac1512d5b81)
 2018-06-02 14:49:21 -07:00
Rohith Sharma K S
61ae43f725 MapReduce JHS should honor yarn.webapp.filter-entity-list-by-user(addendum). Contributed by Sunil Govindan. 
(cherry picked from commit d5e69d89942fd5dcfafd56bf653565557ff85501)
 2018-06-02 09:57:20 +05:30
Rohith Sharma K S
f7d0ca71ac More YARN pages need to honor yarn.resourcemanager.display.per-user-apps(addendum). Contributed by Sunil G. 
(cherry picked from commit 8261f9e5710038ccbc475dbfcea3b9ae79b6f482)
 2018-06-02 09:43:08 +05:30
Inigo Goiri
fdacc8a088 HDFS-13637. RBF: Router fails when threadIndex (in ConnectionPool) wraps around Integer.MIN_VALUE. Contributed by CR Hota. 
(cherry picked from commit e11d67404945d80db2eb8a99453606419dbdc938)
 2018-06-01 16:59:35 -07:00
Wangda Tan
0be93a7973 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda) 
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
(cherry picked from commit ff583d3fa3325029bc691ec22d817aee37e5e85d)
 2018-06-01 15:53:26 -07:00
Wangda Tan
ed20576413 YARN-8372. Distributed shell app master should not release containers when shutdown if keep-container is true. (Suma Shivaprasad via wangda) 
Change-Id: Ief04d1ca865621f348fba4ac85fa78bc47465904
(cherry picked from commit 8956e5b8db3059e0872e49f59adc6affc76e2274)
 2018-06-01 15:47:59 -07:00
Wangda Tan
1cee85d8c4 YARN-7962. Race Condition When Stopping DelegationTokenRenewer causes RM crash during failover. (BELUGA BEHR via wangda) 
Change-Id: I617e2645f60a57080058ad5f06af860fb3f682c8
(cherry picked from commit 931f78718f3a09775bfa1f9a952c069c416d0914)
 2018-06-01 15:47:51 -07:00
Wangda Tan
cc460fea2d YARN-8384. stdout.txt, stderr.txt logs of a launched docker container is coming with primary group of submit user instead of hadoop. (Eric Yang via wangda) 
Change-Id: Idbb2cd250f4f62dc32993e0d3ca3ec5684616baa
(cherry picked from commit 3a6bd775500343632bad5f9c1a2bfacd408f7760)
 2018-06-01 15:47:45 -07:00
Daniel Templeton
09fd1348e8 HDFS-13636. Cross-Site Scripting vulnerability in HttpServer2 
(Contributed by Haibo Yan via Daniel Templeton)

Change-Id: I28edde8125dd20d8d270f0e609d1c04d8173c8b7
(cherry picked from commit cba319499822a2475c60c43ea71f8e78237e139f)
 2018-06-01 14:44:22 -07:00
Sean Mackrory
58b5b3aa75 HDFS-13582. Improve backward compatibility for HDFS-13176 (WebHdfs file path gets truncated when having semicolon (;) inside). Contributed by Zsolt Venczel. 
(cherry picked from commit 1361030e59d7557a2bffac0ea8df116ce2eaae4a)
 2018-05-31 22:23:19 -06:00
Eric Yang
4193892de6 YARN-8308. Fixed YARN Service AM failure with HDFS token renewal. 
Contributed by Gour Saha

(cherry picked from commit 7c7ac07f013f46db89c73681806300699ee534d6)
 2018-05-31 21:10:04 -04:00
Chao Sun
2bbdf362cf HDFS-13602. Add checkOperation(WRITE) checks in FSNamesystem. Contributed by Chao Sun. 
(cherry picked from commit ff013d2c952272f3176dcf624251b05d610503b5)
 2018-05-31 17:39:46 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
a468400bad YARN-8197. Fixed AM IP Filter and Webapp proxy to redirect app tracking-URLs correctly when UI is secure. Contributed by Sunil Govindan. 
(cherry picked from commit 6b74f5d7fc509c55c331249256eec78b7e53b6ce)
 2018-05-31 17:04:45 -07:00
Konstantin V Shvachko
442dd87dcd HDFS-12978. Fine-grained locking while consuming journal stream. Contributed by Konstantin Shvachko. 2018-05-31 14:58:06 -07:00
Inigo Goiri
ad11e40557 HDFS-13631. TestDFSAdmin#testCheckNumOfBlocksInReportCommand should use a separate MiniDFSCluster path. Contributed by Anbang Hu. 
(cherry picked from commit 1f324e966136f69c3254f01b43b56cf077abba7f)
 2018-05-31 10:13:14 -07:00
Billie Rinaldi
1bb112cd96 YARN-8333. Load balance YARN services using RegistryDNS multiple A records. Contributed by Eric Yang 
(cherry picked from commit 6bc92e304fe05e80f13830104d1fd2c59da8344b)
 2018-05-31 06:49:04 -07:00
Weiwei Yang
ec4240a7fa YARN-8367. Fix NPE in SingleConstraintAppPlacementAllocator when placement constraint in SchedulingRequest is null. Contributed by Weiwei Yang. 
(Cherry picked from commit 6468071f137e6d918a7b4799ad54558fa26b25ce)
 2018-05-31 21:04:41 +08:00
Billie Rinaldi
58e7d6c3c0 YARN-8350. NPE in service AM related to placement policy. Contributed by Gour Saha 
(cherry picked from commit 778a4a24be176382a5704f709c00bdfcfe6ddc8c)
 2018-05-30 13:21:17 -07:00
Billie Rinaldi
7bd5d79177 YARN-8368. yarn app start cli should print applicationId. Contributed by Rohith Sharma K S 
(cherry picked from commit 96eefcc84aacc4cc82ad7e3e72c5bdad56f4a7b7)
 2018-05-30 12:38:53 -07:00
Eric E Payne
3d06d75423 YARN-8377: Javadoc build failed in hadoop-yarn-server-nodemanager. Contributed by Takanobu Asanuma 
(cherry picked from commit e44c0849d7982c8f1ed43af25d2092090881d19f)
 2018-05-30 17:28:14 +00:00
Inigo Goiri
5c09dadd73 HDFS-13629. Some tests in TestDiskBalancerCommand fail on Windows due to MiniDFSCluster path conflict and improper path usage. Contributed by Anbang Hu. 
(cherry picked from commit 47c31ff16b452d47afc6ffc1cf936ac2de9b788d)
 2018-05-30 10:23:00 -07:00
Inigo Goiri
6dc40bab4e HDFS-13632. Randomize baseDir for MiniJournalCluster in MiniQJMHACluster for TestDFSAdminWithHA. Contributed by Anbang Hu. 
(cherry picked from commit e1102865e6e16babaff9346212c824cb1f47c31c)
 2018-05-30 10:02:50 -07:00
Eric Yang
03209e8966 YARN-8362. Bugfix logic in container retries in node manager. 
Contributed by Chandni Singh

(cherry picked from commit 135941e00d762a417c3b4cc524cdc59b0d1810b1)
 2018-05-29 17:04:01 -04:00
Kihwal Lee
11a425d11a Additional check when unpacking archives. Contributed by Wilfred Spiegelenburg. 
(cherry picked from commit e3236a9680709de7a95ffbc11b20e1bdc95a8605)
 2018-05-29 15:02:33 -05:00
Jason Lowe
a1fd04c4f4 YARN-8329. Docker client configuration can still be set incorrectly. Contributed by Shane Kumpf 
(cherry picked from commit 4827e9a9085b306bc379cb6e0b1fe4b92326edcd)
 2018-05-29 14:48:01 -05:00
Wangda Tan
3eb1cb18c7 YARN-8369. Javadoc build failed due to 'bad use of >'. (Takanobu Asanuma via wangda) 
Change-Id: I79a42154e8f86ab1c3cc939b3745024b8eebe5f4
(cherry picked from commit 17aa40f669f197d43387d67dc00040d14cd00948)
 2018-05-29 09:28:34 -07:00
Wangda Tan
b262ea1381 YARN-8339. Service AM should localize static/archive resource types to container working directory instead of 'resources'. (Suma Shivaprasad via wangda) 
Change-Id: I9f8e8f621650347f6c2f9e3420edee9eb2f356a4
(cherry picked from commit 3061bfcde53210d2032df3814243498b27a997b7)
 2018-05-29 09:28:27 -07:00
Inigo Goiri
1dd9670ddd HADOOP-15497. TestTrash should use proper test path to avoid failing on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 3c75f8e4933221fa60a87e86a3db5e4727530b6f)
 2018-05-29 09:11:38 -07:00
Jason Lowe
500b0ee2ce YARN-8338. TimelineService V1.5 doesn't come up after HADOOP-15406. Contributed by Vinod Kumar Vavilapalli 
(cherry picked from commit 31ab960f4f931df273481927b897388895d803ba)
 2018-05-29 11:03:19 -05:00
Inigo Goiri
6918d9e9c8 HADOOP-15498. TestHadoopArchiveLogs (#testGenerateScript, #testPrepareWorkingDir) fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 8fdc993a993728c65084d7dc3ac469059cb1f603)
 2018-05-28 16:46:21 -07:00
Inigo Goiri
bc80290f28 HDFS-13591. TestDFSShell#testSetrepLow fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 9dbf4f01665d5480a70395a24519cbab5d4db0c5)
 2018-05-28 16:34:31 -07:00
Inigo Goiri
cc696f80d3 HDFS-13627. TestErasureCodingExerciseAPIs fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 91d7c74e6aa4850922f68bab490b585443e4fccb)
 2018-05-28 10:27:23 -07:00
Sunil G
7f9caf8986 YARN-4781. Support intra-queue preemption for fairness ordering policy. Contributed by Eric Payne. 
(cherry picked from commit 7c343669baf660df3b70d58987d6e68aec54d6fa)
 2018-05-28 16:33:48 +05:30
Karthik Palanisamy
b0ce76d71f
HADOOP-15449. Increase default timeout of ZK session to avoid frequent NameNode failover 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 61df174e8b3d582183306cabfa2347c8b96322ff)
 2018-05-28 19:41:58 +09:00
Takanobu Asanuma
499a90f152
HDFS-13628. Update Archival Storage doc for Provided Storage 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 04757e5864bd4904fd5a59d143fff480814700e4)
 2018-05-28 19:06:58 +09:00
Rohith Sharma K S
f19e8e2246 MAPREDUCE-7097. MapReduce JHS should honor yarn.webapp.filter-entity-list-by-user. Contributed by Sunil Govindan. 
(cherry picked from commit 88cbe57c069a1d2dd3bfb32e3ad742566470a10b)
 2018-05-28 14:06:50 +05:30
Wangda Tan
4d41cb1696 YARN-8213. Add Capacity Scheduler performance metrics. (Weiwei Yang via wangda) 
Change-Id: Ieea6f3eeb83c90cd74233fea896f0fcd0f325d5f
(cherry picked from commit f24c842d52e166e8566337ef93c96438f1c870d8)
 2018-05-25 22:04:54 -07:00
Inigo Goiri
c7d77a3bfe HDFS-13620. Randomize the test directory path for TestHDFSFileSystemContract. Contributed by Anbang Hu. 
(cherry picked from commit 8605a38514b4f7a2a549c7ecf8e1421e61bb4d67)
 2018-05-25 19:45:48 -07:00
Inigo Goiri
71ab85adce HDFS-13619. TestAuditLoggerWithCommands fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 13d25289076b39daf481fb1ee15939dbfe4a6b23)
 2018-05-25 13:33:05 -07:00
Xiao Chen
1c0ee35662 HADOOP-15473. Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997. Contributed by Gabor Bota. 
(cherry picked from commit 02322de3f95ba78a22c057037ef61aa3ab1d3824)
 2018-05-25 09:41:04 -07:00
Eric E Payne
053937f436 YARN-8292: Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative. Contributed by Wangda Tan. 
(cherry picked from commit 8d5509c68156faaa6641f4e747fc9ff80adccf88)
 2018-05-25 16:27:09 +00:00
Inigo Goiri
2d3d7a67f2 HDFS-13618. Fix TestDataNodeFaultInjector test failures on Windows. Contributed by Xiao Liang. 
(cherry picked from commit a8e9ee3fdf3aa1b889dfdd3bade91ba754ed9ee1)
 2018-05-25 09:11:07 -07:00
Miklos Szegedi
1483c90379 YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter. 
(cherry picked from commit 3e5f7ea986600e084fcac723b0423e7de1b3bb8a)
 2018-05-24 15:14:15 -07:00
Eric Yang
f49e697cc8 YARN-8357. Fixed NPE when YARN service is saved and not deployed. 
Contributed by Chandni Singh

(cherry picked from commit d9852eb5897a25323ab0302c2c0decb61d310e5e)
 2018-05-24 16:34:32 -04:00
Eric Yang
514c05abd0 YARN-8316. Improved diagnostic message for ATS unavailability for YARN Service. 
Contributed by Billie Rinaldi
 2018-05-24 16:26:53 -04:00
Andrew Wang
31d597f0c7 HDFS-13611. Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient. 
(cherry picked from commit c9b63deb533274ca8ef4939f6cd13f728a067f7b)
 2018-05-24 09:56:37 -07:00
Shane Kumpf
de43b41d0f YARN-6919. Add default volume mount list. Contributed by Eric Badger 2018-05-24 09:35:35 -06:00
Rohith Sharma K S
923c833da4 YARN-8319. More YARN pages need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G. 
(cherry picked from commit c05b5d424b000bab766f57e88a07f2b4e9a56647)
 2018-05-24 14:22:43 +05:30
Rohith Sharma K S
67842c56fe YARN-8346. Upgrading to 3.1 kills running containers with error 'Opportunistic container queue is full'. Contributed by Jason Lowe. 
(cherry picked from commit 4cc0c9b0baa93f5a1c0623eee353874e858a7caa)
 2018-05-24 12:25:33 +05:30