Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,101 Commits 326 Branches 371 Tags
Commit Graph

17101 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Subru Krishnan
926b188871 YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru). 
(cherry picked from commit 3fae675383489129b3ca3c66683a1215d0c6edf0)
 2017-10-25 15:08:19 -07:00
Xiao Chen
e18d2c548b HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen. 
(cherry picked from commit e3f25f361720b544b464c5e4fbeb4f31e6c53c67)
 2017-10-25 14:11:38 -07:00
Akira Ajisaka
20ca6773f1 HADOOP-14977. Xenial dockerfile needs ant in main build for findbugs 
Signed-off-by: Allen Wittenauer <aw@apache.org>
 2017-10-25 08:10:26 -07:00
Akira Ajisaka
ed93af8965
HADOOP-14979. Upgrade maven-dependency-plugin to 3.0.2. Contributed by liyunzhang. 
(cherry picked from commit 54b72acd7731f358c4b35e81f46e2bea850deeca)
 2017-10-25 23:42:02 +09:00
Akira Ajisaka
79ea3e8ea7
HADOOP-14030. PreCommit TestKDiag failure. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4c970088afefe5395c18c6715c7b27e6c0358c96)
 2017-10-25 17:18:49 +09:00
Zhe Zhang
f3409e71d9 Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit aecf6c50d351e7aed2008a682677a1edb104585d.
 2017-10-24 15:06:01 -07:00
Varun Saxena
5be228e43b HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena. 
(cherry picked from commit 67e7673750e731f5ecfa84e82b84b7fc7ee0b233)
 2017-10-25 03:22:18 +05:30
Eric Yang
107afed848 YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger. 2017-10-24 16:59:17 -04:00
Yufei Gu
6e953eb6a3 YARN-7045. Remove FSLeafQueue#addAppSchedulable. (Contributed by Sen Zhao via Yufei Gu) 
(cherry picked from commit a92ef030a2707182e90acee644e47c8ef7e1fd8d)
 2017-10-24 13:52:02 -07:00
Robert Kanter
c5eeb2e4ce YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter) 
(cherry picked from commit 03af442e7608db2f8e6eb85a15aa0ba42781edab)
 2017-10-24 13:40:06 -07:00
Carlo Curino
8b200ab395 YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino) 
(cherry picked from commit 1c5c2b5dde6f2cffc587ca8f79a18828e1b1faf9)
 2017-10-24 10:53:08 -07:00
Robert Kanter
4bae02a97d YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter) 
(cherry picked from commit 025c6565725c1819566377632753e8b9055617a6)
 2017-10-24 10:25:43 -07:00
Yiqun Lin
1e7ea66044 HDFS-12695. Add a link to HDFS router federation document in site.xml. Contributed by Yiqun Lin. 
(cherry picked from commit b90750cfb8887fecbd83caff3800455b4f911339)
 2017-10-24 10:48:19 +08:00
Robert Kanter
61aba4f0c1 YARN-7320. Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_ (misha@cloudera.com via rkanter) 
(cherry picked from commit 5da295a34e39b507e8291073782e0576cd06896a)
 2017-10-23 18:02:11 -07:00
Wei-Chiu Chuang
b8a2fd37dc HDFS-12249. dfsadmin -metaSave to output maintenance mode blocks. Contributed by Wellington Chevreuil. 
(cherry picked from commit 0f2a69127aa40b7dccdf74ff63e2205a10ae8998)
 2017-10-23 15:24:54 -07:00
Daniel Templeton
9da9023371 YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations 
(Contributed by Sen Zhao via Daniel Templeton)

(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
 2017-10-23 13:51:39 -07:00
Naganarasimha
faf23e6298 HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt. 
(cherry picked from commit 6b8122458ede9ececb138bed99d368580e5439a1)
 2017-10-23 23:43:57 +05:30
Eric Payne
3f315a526b YARN-4163: Audit getQueueInfo and getApplications calls 
(cherry picked from commit 921338cd86e7215b0c4b1efdf2daf9449fb12c7b)
 2017-10-23 11:48:41 -05:00
Sunil G
4b872e5e9f YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. Contributed by Tanuj Nayak. 
(cherry picked from commit 8facf1f976d7e12a846f12baabf54be1b7a49f9d)
 2017-10-20 17:20:39 -07:00
Xiao Chen
a7e34be69a HDFS-12518. Re-encryption should handle task cancellation and progress better. 
(cherry picked from commit 0f5287bb2fe71b35f70f977a06c31094b352512c)
 2017-10-20 16:25:39 -07:00
Wangda Tan
881263260c YARN-7318. Fix shell check warnings of SLS. (Gergely Novák via wangda) 
(cherry picked from commit 281d83604df8341c210cee39bdc745ca793c5afa)
 2017-10-20 16:02:04 -07:00
Steve Loughran
2bacb429a1 HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. 
Contributed by Andras Bokor.

(cherry picked from commit f36cbc847560d53e7955ced9ce7ce2773c805793)
 2017-10-20 22:29:22 +01:00
Andrew Wang
ea149c10cf HDFS-12497. Re-enable TestDFSStripedOutputStreamWithFailure tests. Contributed by Huafeng Wang. 
(cherry picked from commit 0477eff8be4505ad2730ec16621105b6df9099ae)
 2017-10-20 13:27:29 -07:00
Yufei Gu
d375645d50 YARN-7355. TestDistributedShell should be scheduler agnostic. (Contributed by Haibo) 
(cherry picked from commit 6b7c87c94592606966a4229313b3d0da48f16158)
 2017-10-20 11:17:05 -07:00
Yufei Gu
2a0ef092d3 YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu) 
(cherry picked from commit 0799fde35e7f3b9e8a85284ac0b30f6bdcbffad1)
 2017-10-20 10:01:52 -07:00
Yufei Gu
96106b8f5f YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin) 
(cherry picked from commit 1f4cdf10681b6903207a63fb5c306c9665ed9464)
 2017-10-20 01:34:05 -07:00
Wangda Tan
dc2ae3f20b YARN-7170. Improve bower dependencies for YARN UI v2. (Sunil G via wangda) 
(cherry picked from commit 4afd308b62d2335f31064c05bfefaf2294d874b0)
 2017-10-19 21:59:28 -07:00
Kai Zheng
b7cb58a21d HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang 2017-10-20 09:34:58 +08:00
Inigo Goiri
f4a2f0ee9f HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 
(cherry picked from commit 0f1c0376186de6446d595be7bb445ed6b71ae499)
 2017-10-19 18:10:47 -07:00
Yufei Gu
b2f516118c YARN-7359. TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic. (Contributed by Haibo Chen) 
(cherry picked from commit 7b4b0187806601e33f5a88d48991e7c12ee4419f)
 2017-10-19 16:53:10 -07:00
Chris Douglas
612350eb95 HADOOP-14816. Update Dockerfile to use Xenial. Contributed by Allen Wittenauer 
(cherry picked from commit ca8ddc6aa413de347866ad9a0a3407356a280a1f)
 2017-10-19 16:47:19 -07:00
Yufei Gu
288d2fc309 YARN-7294. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair Scheduler. (Contributed by Miklos Szegedi) 
(cherry picked from commit cbd2b73ef81a7e275c5d4f842cac5b81ff2f8c84)
 2017-10-19 16:40:36 -07:00
Wangda Tan
73cbc373e0 YARN-7345. GPU Isolation: Incorrect minor device numbers written to devices.deny file. (Jonathan Hung via wangda) 
(cherry picked from commit c1b08ba720486e74461f0ec94a204c1ba4014c06)
 2017-10-19 14:51:22 -07:00
Wangda Tan
03fee4de9e YARN-7338. Support same origin policy for cross site scripting prevention. (Sunil G via wangda) 
(cherry picked from commit 298b174f663a06e67098f7b5cd645769c1a98a80)
 2017-10-19 14:51:14 -07:00
Haibo Chen
362f67c1f3 HADOOP-14771. hadoop-client does not include hadoop-yarn-client. (Ajay Kumar via Haibo Chen) 
(cherry picked from commit 3dd3d1dd77515be6d62e637c27d7d37d24058617)
 2017-10-19 13:39:44 -07:00
Zhe Zhang
aecf6c50d3 HDFS-12502. nntop should support a category based on FilesInGetListingOps. 
(cherry picked from commit 60bfee270ed3a653c44c0bc92396167b5022df6e)
 2017-10-18 23:52:07 -07:00
Junping Du
9433f9eb09 HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du. 
(cherry picked from commit b016f08f67830ed3ca741bc6a10c3f5164781be5)
 2017-10-18 15:07:20 -07:00
Anu Engineer
0160a708ae HADOOP-14752. TestCopyFromLocal#testCopyFromLocalWithThreads is fleaky. Contributed by Andras Bokor. 
(cherry picked from commit 442ea85545ce3591f45211773a10346340abaed5)
 2017-10-18 11:26:23 -07:00
Akira Ajisaka
a887016e1d
MAPREDUCE-6972. Enable try-with-resources for RecordReader. Contributed by Zoltan Haindrich. 
(cherry picked from commit 2523e1cce5f6d6c3762c958c7f3138ab486c8497)
 2017-10-18 11:19:00 +09:00
Xiao Chen
12d19d3978 HADOOP-14944. Add JvmMetrics to KMS. 
(cherry picked from commit 86ee0c5e4e304d9551a24a3d8b9161ca1502b70e)
 2017-10-17 19:07:19 -07:00
Arpit Agarwal
5897095d53 HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar. 
(cherry picked from commit b6942cbe9b8c9469e8c2b64c3268d671f5a43e75)
 2017-10-17 16:45:21 -07:00
Haibo Chen
175c4472d5 YARN-6546. SLS is slow while loading 10k queues. (Yufei Gu via Haibo Chen) 
(cherry picked from commit 46eb1033a86ca53e7b94202567aef8af2417bdf8)
 2017-10-17 16:04:49 -07:00
Lei Xu
6959db9c20 HDFS-12612. DFSStripedOutputStream.close will throw if called a second time with a failed streamer. (Lei (Eddy) Xu) 2017-10-17 15:53:07 -07:00
Subru Krishnan
81a86860bf YARN-7311. Fix TestRMWebServicesReservation parametrization for fair scheduler. (Yufei Gu via Subru). 
(cherry picked from commit 75323394fbc4211596a2c8fbb5e584f3183f742f)
 2017-10-17 12:39:40 -07:00
Haibo Chen
5334deb089 YARN-7341. TestRouterWebServiceUtil#testMergeMetrics is flakey. (Robert Kanter via Haibo Chen) 
(cherry picked from commit acabc657ff5433f36ce1b238cecd3a3b5bbe87ae)
 2017-10-17 10:26:02 -07:00
Lei Xu
cdfcd384b2 HDFS-12613. Native EC coder should implement release() as idempotent function. (Lei (Eddy) Xu) 
(cherry picked from commit 31ebccc96238136560f4210bdf6766fe18e0650c)
 2017-10-16 19:46:26 -07:00
Robert Kanter
a9cbfb0398 HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter) 2017-10-16 16:39:25 -07:00
Robert Kanter
6971699099 YARN-7308. TestApplicationACLs fails with FairScheduler (rkanter) 
(cherry picked from commit 8a615259281511de639c1f9aa719a842e34a523f)
 2017-10-16 15:34:50 -07:00
Nathan Roberts
a809ce8f50 YARN-7333. container-executor fails to remove entries from a directory that is not writable or executable. Contributed by Jason Lowe. 
(cherry picked from commit 8620140a6a3ec0117675ede06d92d830da3da551)
 2017-10-16 16:41:42 -05:00
Xiao Chen
23ec4a788a HADOOP-14949. TestKMS#testACLs fails intermittently. 
(cherry picked from commit 152317d40ece8abfa76fb5bd29f04878c1b0d3d8)
 2017-10-16 14:19:44 -07:00