Commit Graph

17922 Commits

Author SHA1 Message Date
Akira Ajisaka 432cd74c72
HADOOP-15261. Upgrade commons-io from 2.4 to 2.5. Contributed by PandaMonkey. 2018-03-02 15:47:43 -08:00
Tsz-Wo Nicholas Sze 60080fbfcf HDFS-13171. Handle Deletion of nodes in SnasphotSkipList. Contributed by Shashikant Banerjee 2018-03-02 10:51:05 -08:00
Tsz-Wo Nicholas Sze 850b2f2567 HDFS-1686. Federation: Add more Balancer tests with federation setting. Contributed by Bharat Viswanadham 2018-03-02 10:42:39 -08:00
Jason Lowe 83798f15f8 YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang 2018-03-02 09:59:46 -06:00
Yiqun Lin 55669515f6 HDFS-13210. Fix the typo in MiniDFSCluster class. Contributed by fang zhenyi. 2018-03-02 11:49:12 +08:00
Ray Chiang 923e1773e1 HADOOP-14652. Update metrics-core version to 3.2.4. (rchiang) 2018-03-01 15:36:10 -08:00
Allen Wittenauer d4cc50f622 HADOOP-15279. increase maven heap size recommendations
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2018-03-01 15:32:43 -08:00
fang zhenyi 29233c3c4a
HADOOP-15274. Move hadoop-openstack to slf4j
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-01 15:08:30 -08:00
Tsz-Wo Nicholas Sze 96e8f260ab HDFS-13211. Fix a bug in DirectoryDiffList.getMinListForRange. Contributed by Shashikant Banerjee 2018-03-01 14:12:15 -08:00
Sunil G 22928c0c60 YARN-7637. GPU volume creation command fails when work preserving is disabled at NM. Contributed by Zian Chen. 2018-03-01 22:39:32 +05:30
Yufei Gu 6ca4e3017b YARN-5028. RMStateStore should trim down app state for completed applications(addendum). Contributed by Rohith Sharma K S. 2018-03-01 08:38:53 -08:00
Billie Rinaldi 5ed689e33a YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh 2018-03-01 08:00:13 -08:00
Nanda kumar 55d04a6db1
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-01 19:03:47 +09:00
Yiqun Lin ececeea8f2 HDFS-13202. Fix the outdated javadocs in HAUtil. Contributed by Chao Sun. 2018-03-01 17:51:43 +08:00
Haibo Chen 10663b78c8 Revert "yarn-7346.07.patch"
This reverts commit 5e37ca5bb4.
2018-02-28 21:11:36 -08:00
Haibo Chen d1274c3b71 YARN-7835. Race condition in NM while publishing events if second attempt is launched on the same node. (Rohith Sharma K S via Haibo Chen) 2018-02-28 21:10:42 -08:00
Haibo Chen 5e37ca5bb4 yarn-7346.07.patch 2018-02-28 21:04:54 -08:00
Weiwei Yang 6e6945cd78 MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster. Contributed by Jiandan Yang. 2018-03-01 10:18:53 +08:00
Eric Yang 17f387e3c2 YARN-7985. Removed duplicate service name validation in Yarn Service.
Contributed by Chandni Singh
2018-02-28 20:48:55 -05:00
Billie Rinaldi 315f48e791 YARN-7955. Improve result of calling stop on an already stopped service. Contributed by Gour Saha 2018-02-28 15:01:56 -08:00
Tsz-Wo Nicholas Sze 81d9446a92 HDFS-13102. Implement SnapshotSkipList class to store Multi level DirectoryDiffs. Contributed by Shashikant Banerjee 2018-02-28 13:42:58 -08:00
Billie Rinaldi 31009034bd YARN-7954. Set component status to STOPPED when YARN service is stopped. Contributed by Gour Saha 2018-02-28 11:57:24 -08:00
Xiaoyu Yao f20e10b2dd HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar. 2018-02-28 09:44:39 -08:00
Xiaoyu Yao 2574375bf5 HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path. Contributed by Hanisha Koneru. 2018-02-28 08:37:01 -08:00
Steve Loughran edc9f1451b HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake.
Contributed by Steve Loughran
2018-02-28 14:42:25 +00:00
Steve Loughran e015e00989 HADOOP-15264. AWS "shaded" SDK 1.271 is pulling in netty 4.1.17.
Contributed by Steve Loughran.

(cherry picked from commit b580196a16)
2018-02-28 13:11:07 +00:00
Weiwei Yang 7af4f34de5 YARN-7929. Support to set container execution type in SLS. (Jiandan Yang via Weiwei Yang) 2018-02-28 17:58:09 +08:00
Yiqun Lin a9c14b1119 HDFS-13194. CachePool permissions incorrectly checked. Contributed by Jianfei Jiang. 2018-02-28 10:17:43 +08:00
Inigo Goiri d86f301d46 HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong. 2018-02-27 17:39:02 -08:00
Tsz-Wo Nicholas Sze 55c77bf722 HDFS-13143. SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree. Contributed by Shashikant Banerjee 2018-02-27 15:28:41 -08:00
Billie Rinaldi 727c033997 YARN-7446. Remove --user flag when running privileged mode docker container. Contributed by Eric Yang 2018-02-27 14:33:57 -08:00
Wangda Tan eea0b069e7 YARN-7959. Add .vm extension to PlacementConstraints.md to ensure proper filtering. (Weiwei Yang via wangda)
Change-Id: I34ec516994a5de7accaa5ef7044e443b340bd294
(cherry picked from commit 0d516b30769471d9114214b3a518e2146ff2f25e)
2018-02-27 13:19:24 -08:00
Wangda Tan 5bbbbb6a1e YARN-7893. Document the FPGA isolation feature. (Zhankun Tang via wangda)
Change-Id: I8723320377a4bd0a7db168670d183ef5543caa67
(cherry picked from commit c2af2f16718bd1d38ceb05e354f34d7bef89127d)
2018-02-27 13:19:16 -08:00
Arpit Agarwal ac42dfc888 MAPREDUCE-7061. SingleCluster setup document needs to be updated. Contributed by Bharat Viswanadham. 2018-02-27 10:27:18 -08:00
Arpit Agarwal 1cc9a58dda HDFS-13181. DiskBalancer: Add an configuration for valid plan hours . Contributed by Bharat Viswanadham. 2018-02-27 10:18:07 -08:00
Arpit Agarwal 137f0d324a HADOOP-14959. DelegationTokenAuthenticator.authenticate() to wrap network exceptions. Contributed by Ajay Kumar. 2018-02-27 10:15:43 -08:00
Inigo Goiri cd4a97bf80 HDFS-13192. Change the code order in getFileEncryptionInfo to avoid unnecessary call of assignment. Contributed by LiXin Ge. 2018-02-27 08:53:00 -08:00
Inigo Goiri 225d877092 HDFS-13193. Various Improvements for BlockTokenSecretManager. Contributed by BELUGA BEHR. 2018-02-27 08:48:03 -08:00
Arpit Agarwal 28f644bf25 HADOOP-15178. Generalize NetUtils#wrapException to handle other subclasses with String Constructor. Contributed by Ajay Kumar. 2018-02-27 07:38:29 -08:00
Yiqun Lin 1e85a995d1 HDFS-13184. RBF: Improve the unit test TestRouterRPCClientRetries. Contributed by Yiqun Lin. 2018-02-27 10:48:52 +08:00
Chao Sun ae290a4bb4 HDFS-13145. SBN crash when transition to ANN with in-progress edit tailing enabled. Contributed by Chao Sun. 2018-02-26 16:15:00 -08:00
Eric Yang b4f1ba1413 YARN-7963. Updated MockServiceAM unit test to prevent test hang.
Contributed by Chandni Singh
2018-02-26 18:49:01 -05:00
Wei Yan 6ce9f79cc9 HDFS-13187. RBF: Fix Routers information shown in the web UI. Contributed by Inigo Goiri and Wei Yan. 2018-02-26 15:13:41 -08:00
Billie Rinaldi 7dd385098c MAPREDUCE-7010. Make Job History File Permissions configurable. Contributed by Gergely Novák 2018-02-26 14:32:46 -08:00
Arpit Agarwal 78a10029ec HADOOP-15265. Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively. Contributed by Nishant Bangarwa. 2018-02-26 13:56:53 -08:00
Arpit Agarwal 46c93453e9 HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula. 2018-02-26 13:56:34 -08:00
Konstantinos Karanasos e85188101c YARN-7921. Transform a PlacementConstraint to a string expression. Contributed by Weiwei Yang. 2018-02-26 12:15:16 -08:00
Kihwal Lee 451265a83d HDFS-12070. Failed block recovery leaves files open indefinitely and at risk for data loss. Contributed by Kihwal Lee. 2018-02-26 10:28:04 -06:00
Arpit Agarwal 2fa7963c3d HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi. 2018-02-24 14:41:55 -08:00
Arpit Agarwal c30a26abc5 HDFS-12865. RequestHedgingProxyProvider should handle case when none of the proxies are available. Contributed by Mukul Kumar Singh. 2018-02-24 14:25:56 -08:00