Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,897 Commits 326 Branches 371 Tags
Commit Graph

17897 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Hanisha Koneru
885d46a245 HDFS-13225. StripeReader#checkMissingBlocks() 's IOException info is incomplete. Contributed by lufei. 
(cherry picked from commit 19ae4429f9a2807548bb4b9ff296521fbdbbb2bc)
 2018-03-07 14:21:04 -08:00
Steve Loughran
1dedc68f9d HADOOP-15267. S3A multipart upload fails when SSE-C encryption is enabled. 
Contributed by Anis Elleuch.
 2018-03-07 18:50:27 +00:00
Jason Lowe
c0986b1b7e YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan 
(cherry picked from commit d69b31f7f70f296ddd180e004fa0f827c2f737f2)
 2018-03-07 09:21:54 -06:00
Yiqun Lin
8262b63c8c HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin. 
(cherry picked from commit 58ea2d7a65ccd8b7775021bae1d24b9e5561e67b)
 2018-03-07 15:29:16 +08:00
Xiaoyu Yao
07a966ede3 HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru. 
(cherry picked from commit edf9445708ffb7a9e59cb933e049b540f99add1e)
 2018-03-06 18:29:42 -08:00
Allen Wittenauer
1a8e6a52a5
HADOOP-15279. increase maven heap size recommendations 
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
(cherry picked from commit d4cc50f62279dc4d607cd05c16de480a76f05880)
 2018-03-06 13:55:11 -08:00
Xiao Chen
2d93a7381e HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell. 
(cherry picked from commit 92c15e19272a8bb59f8704c44d4cd713d3a58bcb)
 2018-03-06 09:58:01 -08:00
Steve Loughran
e8ecd4fa1d HADOOP-15289. FileStatus.readFields() assertion incorrect. 
Contributed by Steve Loughran.

(cherry picked from commit 12ecb55ffee2b89108eea2565e7ad955ea1fabe7)
 2018-03-06 10:06:11 +00:00
Sen Zhao
429e9d6c19
YARN-7736. Fix itemization in YARN federation document 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 245751ffdc4229715a0c031f57f20748ed16d8a6)
 2018-03-05 11:54:49 -08:00
Steve Loughran
1901987ffe HADOOP-13761. S3Guard: implement retries for DDB failures and throttling; translate exceptions. 
Contributed by Aaron Fabbri.

(cherry picked from commit 8110d6a0d59e7dc2ddb25fa424fab188c5e9ce35)
 2018-03-05 14:08:12 +00:00
Ajay Kumar
92e2e6c22e
HADOOP-15286. Remove unused imports from TestKMSWithZK.java 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3dc30bc24e50343efe1f514b923d27a0786d3ac1)
 2018-03-04 07:19:33 -08:00
Xiao Chen
d35baf157e HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen. 
(cherry picked from commit c75105f07b4cdbc2773435fc1125446233113c15)
 2018-03-02 16:47:19 -08:00
Gergely Novák
162e99c696
MAPREDUCE-7023. TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e99a1e77671fa0e74a652bc2221bbe01d1a579d3)
 2018-03-02 16:21:41 -08:00
Jason Lowe
9e5ac217ac YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang 
(cherry picked from commit 83798f15f8602ef580a7885876de114b2425da89)
 2018-03-02 10:00:59 -06:00
Weiwei Yang
46b14efb05 MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster. Contributed by Jiandan Yang. 2018-03-02 10:33:17 +08:00
Sunil G
37b8b24dfb YARN-7637. GPU volume creation command fails when work preserving is disabled at NM. Contributed by Zian Chen. 
(cherry picked from commit 22928c0c60de3ccbd6b27ac3a410e7566ce4136b)
 2018-03-01 22:40:11 +05:30
Billie Rinaldi
5621254bd0 YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh 
(cherry picked from commit 5ed689e33ac0becfc36d5fa424466bb1732aa59b)
 2018-03-01 08:01:38 -08:00
Nanda kumar
749abde043
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db10d0e58cfe0ff82fa646bb6ba57aaac)
 2018-03-01 19:04:23 +09:00
Anu Engineer
f0c70a3494 HADOOP-15007. Stabilize and document Configuration <tag> element. Contributed by Ajay Kumar. 2018-02-28 10:46:20 -08:00
Xiaoyu Yao
a795302539 HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar. 
(cherry picked from commit f20e10b2dd59f99d9af009bbbb60a067b9893e69)
 2018-02-28 09:47:57 -08:00
Xiaoyu Yao
b241491173 HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path. Contributed by Hanisha Koneru. 
(cherry picked from commit 90fbe5c6834a6685e65542fa69e396fad2678927)
 2018-02-28 08:38:32 -08:00
Steve Loughran
abfe1eaf29 HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake. 
Contributed by Steve Loughran

(cherry picked from commit edc9f1451b4af79069cd4b1d608b0fa68648ee72)
 2018-02-28 14:43:10 +00:00
Steve Loughran
b580196a16 HADOOP-15264. AWS "shaded" SDK 1.271 is pulling in netty 4.1.17. 
Contributed by Steve Loughran.
 2018-02-28 13:09:22 +00:00
Yiqun Lin
d975c104f5 HDFS-13194. CachePool permissions incorrectly checked. Contributed by Jianfei Jiang. 
(cherry picked from commit a9c14b11193adeaa31389578f4cb90fa79cad8c3)
 2018-02-28 10:20:32 +08:00
Inigo Goiri
b375bcfd6b HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong. 
(cherry picked from commit d86f301d464683f8d392dad50e83f50d823e862e)
 2018-02-27 17:40:29 -08:00
Tsz-Wo Nicholas Sze
3141e17d83 HDFS-13143. SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree. Contributed by Shashikant Banerjee 2018-02-27 15:38:05 -08:00
Tsz-Wo Nicholas Sze
7abcea0378 HDFS-12998. SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff. Contributed by Shashikant Banerjee 2018-02-27 15:37:48 -08:00
Wangda Tan
164ad48fa7 YARN-7959. Add .vm extension to PlacementConstraints.md to ensure proper filtering. (Weiwei Yang via wangda) 
Change-Id: I34ec516994a5de7accaa5ef7044e443b340bd294
(cherry picked from commit 0d516b30769471d9114214b3a518e2146ff2f25e)
 2018-02-27 13:20:05 -08:00
Wangda Tan
6798adb12d YARN-7893. Document the FPGA isolation feature. (Zhankun Tang via wangda) 
Change-Id: I8723320377a4bd0a7db168670d183ef5543caa67
(cherry picked from commit c2af2f16718bd1d38ceb05e354f34d7bef89127d)
 2018-02-27 13:19:57 -08:00
Arpit Agarwal
ab2674a1ee MAPREDUCE-7061. SingleCluster setup document needs to be updated. Contributed by Bharat Viswanadham. 2018-02-27 10:27:48 -08:00
Arpit Agarwal
7da0b78cf2 HDFS-13181. DiskBalancer: Add an configuration for valid plan hours . Contributed by Bharat Viswanadham. 2018-02-27 10:18:21 -08:00
Billie Rinaldi
b22eaa05a1 MAPREDUCE-7010. Make Job History File Permissions configurable. Contributed by Gergely Novák 2018-02-27 08:50:02 -08:00
Arpit Agarwal
a2e824f9c6 HADOOP-14959. DelegationTokenAuthenticator.authenticate() to wrap network exceptions. Contributed by Ajay Kumar. 2018-02-27 08:48:24 -08:00
Arpit Agarwal
4d1d1d7aec HADOOP-15178. Generalize NetUtils#wrapException to handle other subclasses with String Constructor. Contributed by Ajay Kumar. 2018-02-27 07:38:40 -08:00
Yiqun Lin
e54c76625f HDFS-13184. RBF: Improve the unit test TestRouterRPCClientRetries. Contributed by Yiqun Lin. 
(cherry picked from commit 1e85a995d1c7fe3dbf4b36a481feb5fdeeb6015b)
 2018-02-27 10:51:32 +08:00
Chao Sun
c58cec2507 HDFS-13145. SBN crash when transition to ANN with in-progress edit tailing enabled. Contributed by Chao Sun. 
(cherry picked from commit ae290a4bb4e514e2fe9b40d28426a7589afe2a3f)
 2018-02-26 16:17:36 -08:00
Eric Yang
9b37d18693 YARN-7963. Updated MockServiceAM unit test to prevent test hang. 
Contributed by Chandni Singh
 2018-02-26 18:53:14 -05:00
Wei Yan
6ca6ae7910 HDFS-13187. RBF: Fix Routers information shown in the web UI. Contributed by Inigo Goiri and Wei Yan. 
(cherry picked from commit 6ce9f79cc9b2107e5953a39d05b22966aff0b7ff)
 2018-02-26 15:20:50 -08:00
Arpit Agarwal
0ccd7138a7 HADOOP-15265. Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively. Contributed by Nishant Bangarwa. 2018-02-26 13:58:54 -08:00
Konstantinos Karanasos
eb8765bbe9 YARN-7921. Transform a PlacementConstraint to a string expression. Contributed by Weiwei Yang. 
(cherry picked from commit e85188101c6c74b348a2fb6aa0f4e85c81b4a28c)
 2018-02-26 12:17:08 -08:00
Kihwal Lee
33f82323b0 HDFS-12070. Failed block recovery leaves files open indefinitely and at risk for data loss. Contributed by Kihwal Lee. 
(cherry picked from commit 451265a83d8798624ae2a144bc58fa41db826704)
 2018-02-26 10:29:28 -06:00
Arpit Agarwal
cb260a2d34 HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula. 2018-02-24 14:52:44 -08:00
Arpit Agarwal
9f3be797be HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi. 2018-02-24 14:42:48 -08:00
Arpit Agarwal
c5602ea124 HDFS-12865. RequestHedgingProxyProvider should handle case when none of the proxies are available. Contributed by Mukul Kumar Singh. 2018-02-24 14:26:20 -08:00
Xiaoyu Yao
57095b68dc HDFS-13052. WebHDFS: Add support for snasphot diff. Contributed by Lokesh Jain. 
(cherry picked from commit 1e84e46f1621fe694f806bfc41d3b2a06c9500b6)
 2018-02-23 19:35:36 -08:00
Arpit Agarwal
83ac13a59a HADOOP-15255. Upper/Lower case conversion support for group names in LdapGroupsMapping. Contributed by Nanda kumar. 2018-02-23 15:37:41 -08:00
Jason Lowe
de7a079554 YARN-5714. ContainerExecutor does not order environment map. Contributed by Remi Catherinot and Jim Brennan 
(cherry picked from commit 8e728f39c961f034369b43e087d68d01aa4a0e7d)
 2018-02-23 16:06:08 -06:00
Xiao Chen
25f18619f8 HDFS-13164. File not closed if streamer fail with DSQuotaExceededException. 
(cherry picked from commit 51088d323359587dca7831f74c9d065c2fccc60d)
 2018-02-23 14:00:17 -08:00
Kihwal Lee
1f0952bfc7 HADOOP-9747. Reduce unnecessary UGI synchronization. Contributed by Daryn Sharp. 2018-02-23 13:13:20 -06:00
Xiaoyu Yao
efbbcf9221 HDFS-13136. Avoid taking FSN lock while doing group member lookup for FSD permission check. Contributed by Xiaoyu Yao. 
(cherry picked from commit e978e1d9064fc794ea83217d0af2315d4167211e)
 2018-02-23 09:01:45 -08:00