Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,875 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17875 Commits

Author SHA1 Message Date
Steve Loughran b580196a16 HADOOP-15264. AWS "shaded" SDK 1.271 is pulling in netty 4.1.17. 
Contributed by Steve Loughran.
 2018-02-28 13:09:22 +00:00
Yiqun Lin d975c104f5 HDFS-13194. CachePool permissions incorrectly checked. Contributed by Jianfei Jiang. 
(cherry picked from commit a9c14b1119)
 2018-02-28 10:20:32 +08:00
Inigo Goiri b375bcfd6b HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong. 
(cherry picked from commit d86f301d46)
 2018-02-27 17:40:29 -08:00
Tsz-Wo Nicholas Sze 3141e17d83 HDFS-13143. SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree. Contributed by Shashikant Banerjee 2018-02-27 15:38:05 -08:00
Tsz-Wo Nicholas Sze 7abcea0378 HDFS-12998. SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff. Contributed by Shashikant Banerjee 2018-02-27 15:37:48 -08:00
Wangda Tan 164ad48fa7 YARN-7959. Add .vm extension to PlacementConstraints.md to ensure proper filtering. (Weiwei Yang via wangda) 
Change-Id: I34ec516994a5de7accaa5ef7044e443b340bd294
(cherry picked from commit 0d516b30769471d9114214b3a518e2146ff2f25e)
 2018-02-27 13:20:05 -08:00
Wangda Tan 6798adb12d YARN-7893. Document the FPGA isolation feature. (Zhankun Tang via wangda) 
Change-Id: I8723320377a4bd0a7db168670d183ef5543caa67
(cherry picked from commit c2af2f16718bd1d38ceb05e354f34d7bef89127d)
 2018-02-27 13:19:57 -08:00
Arpit Agarwal ab2674a1ee MAPREDUCE-7061. SingleCluster setup document needs to be updated. Contributed by Bharat Viswanadham. 2018-02-27 10:27:48 -08:00
Arpit Agarwal 7da0b78cf2 HDFS-13181. DiskBalancer: Add an configuration for valid plan hours . Contributed by Bharat Viswanadham. 2018-02-27 10:18:21 -08:00
Billie Rinaldi b22eaa05a1 MAPREDUCE-7010. Make Job History File Permissions configurable. Contributed by Gergely Novák 2018-02-27 08:50:02 -08:00
Arpit Agarwal a2e824f9c6 HADOOP-14959. DelegationTokenAuthenticator.authenticate() to wrap network exceptions. Contributed by Ajay Kumar. 2018-02-27 08:48:24 -08:00
Arpit Agarwal 4d1d1d7aec HADOOP-15178. Generalize NetUtils#wrapException to handle other subclasses with String Constructor. Contributed by Ajay Kumar. 2018-02-27 07:38:40 -08:00
Yiqun Lin e54c76625f HDFS-13184. RBF: Improve the unit test TestRouterRPCClientRetries. Contributed by Yiqun Lin. 
(cherry picked from commit 1e85a995d1)
 2018-02-27 10:51:32 +08:00
Chao Sun c58cec2507 HDFS-13145. SBN crash when transition to ANN with in-progress edit tailing enabled. Contributed by Chao Sun. 
(cherry picked from commit ae290a4bb4)
 2018-02-26 16:17:36 -08:00
Eric Yang 9b37d18693 YARN-7963. Updated MockServiceAM unit test to prevent test hang. 
Contributed by Chandni Singh
 2018-02-26 18:53:14 -05:00
Wei Yan 6ca6ae7910 HDFS-13187. RBF: Fix Routers information shown in the web UI. Contributed by Inigo Goiri and Wei Yan. 
(cherry picked from commit 6ce9f79cc9)
 2018-02-26 15:20:50 -08:00
Arpit Agarwal 0ccd7138a7 HADOOP-15265. Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively. Contributed by Nishant Bangarwa. 2018-02-26 13:58:54 -08:00
Konstantinos Karanasos eb8765bbe9 YARN-7921. Transform a PlacementConstraint to a string expression. Contributed by Weiwei Yang. 
(cherry picked from commit e85188101c)
 2018-02-26 12:17:08 -08:00
Kihwal Lee 33f82323b0 HDFS-12070. Failed block recovery leaves files open indefinitely and at risk for data loss. Contributed by Kihwal Lee. 
(cherry picked from commit 451265a83d)
 2018-02-26 10:29:28 -06:00
Arpit Agarwal cb260a2d34 HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula. 2018-02-24 14:52:44 -08:00
Arpit Agarwal 9f3be797be HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi. 2018-02-24 14:42:48 -08:00
Arpit Agarwal c5602ea124 HDFS-12865. RequestHedgingProxyProvider should handle case when none of the proxies are available. Contributed by Mukul Kumar Singh. 2018-02-24 14:26:20 -08:00
Xiaoyu Yao 57095b68dc HDFS-13052. WebHDFS: Add support for snasphot diff. Contributed by Lokesh Jain. 
(cherry picked from commit 1e84e46f16)
 2018-02-23 19:35:36 -08:00
Arpit Agarwal 83ac13a59a HADOOP-15255. Upper/Lower case conversion support for group names in LdapGroupsMapping. Contributed by Nanda kumar. 2018-02-23 15:37:41 -08:00
Jason Lowe de7a079554 YARN-5714. ContainerExecutor does not order environment map. Contributed by Remi Catherinot and Jim Brennan 
(cherry picked from commit 8e728f39c9)
 2018-02-23 16:06:08 -06:00
Xiao Chen 25f18619f8 HDFS-13164. File not closed if streamer fail with DSQuotaExceededException. 
(cherry picked from commit 51088d3233)
 2018-02-23 14:00:17 -08:00
Kihwal Lee 1f0952bfc7 HADOOP-9747. Reduce unnecessary UGI synchronization. Contributed by Daryn Sharp. 2018-02-23 13:13:20 -06:00
Xiaoyu Yao efbbcf9221 HDFS-13136. Avoid taking FSN lock while doing group member lookup for FSD permission check. Contributed by Xiaoyu Yao. 
(cherry picked from commit e978e1d9064fc794ea83217d0af2315d4167211e)
 2018-02-23 09:01:45 -08:00
Sunil G 40feeeeec7 YARN-7949. [UI2] ArtifactsId should not be a compulsory field for new service. Contributed by Yesha Vora. 
(cherry picked from commit d1cd573687)
 2018-02-23 16:50:59 +05:30
Sunil G c152187275 YARN-7675. [UI2] Support loading pre-2.8 version /scheduler REST response for queue page. Contributed by Gergely Novák. 
(cherry picked from commit cc683952d2)
 2018-02-23 16:11:20 +05:30
Gabor Bota b8942cb3bf
HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c36b4aa31c)
 2018-02-23 13:56:26 +09:00
Eric Yang 7fac69ea48 YARN-7942. Add check for JAAS configuration for Yarn Service. 
Contributed by Billie Rinaldi
(Cherry-picked from commit 95904f6b3c)
 2018-02-22 16:19:26 -05:00
Eric Yang 13922cc32d YARN-7836. Added error check for updating service components. 
(Contributed by Gour Saha)
(Cherry-picked from commit 190969006d)
 2018-02-22 16:11:22 -05:00
Jason Lowe bfbd43f2f7 YARN-7916. Remove call to docker logs on failure in container-executor. Contributed by Shane Kumpf 
(cherry picked from commit 3132709b46)
 2018-02-21 16:55:06 -06:00
Steve Loughran 958b445047 HADOOP-15247. Move commons-net up to 3.6. 
Contributed by Steve Loughran.

(cherry picked from commit 004b722372)
 2018-02-21 10:41:20 +00:00
Sunil G e53da3914a YARN-7947. Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps. Contributed by Eric Payne. 
(cherry picked from commit bdd2a184d7)
 2018-02-21 14:57:43 +05:30
Sunil G 21af27995d YARN-7223. Document GPU isolation feature. Contributed by Wangda Tan. 
(cherry picked from commit 86b227a1fb)
 2018-02-21 14:17:18 +05:30
Anu Engineer 4aa4bb46af HDFS-13175. Add more information for checking argument in DiskBalancerVolume. 
Contributed by  Lei (Eddy) Xu.

(cherry picked from commit 121e1e1280)
 2018-02-20 19:58:58 -08:00
Eric Yang 7506e100fc YARN-7940. Fixed a bug in ServiceAM ZooKeeper initialization. 
(Contributed by Billie Rinaldi)

(cherry-picked from commit 7280c5af82)
 2018-02-20 14:16:46 -05:00
Yiqun Lin 538c473f49 HDFS-13119. RBF: Manage unavailable clusters. Contributed by Yiqun Lin. 
(cherry picked from commit 8896d20b91)
 2018-02-20 10:14:09 +08:00
Jason Lowe 94def88889 YARN-7813. Capacity Scheduler Intra-queue Preemption should be configurable for each queue. Contributed by Eric Payne 
(cherry picked from commit 9497215084)
 2018-02-19 14:22:52 -06:00
Jason Lowe 1481adbabe Revert "YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan" 
This reverts commit 6f64530fc3.
 2018-02-19 08:23:29 -06:00
fang zhenyi 55669df4f9
HADOOP-15223. Replace Collections.EMPTY* with empty* when available 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 4d4dde5112)
 2018-02-18 22:22:06 +09:00
Rohith Sharma K S 7ee3713f73 YARN-7937. Fix http method name in Cluster Application Timeout Update API example request. Contributed by Charan Hebri. 
(cherry picked from commit 87bdde6943)
 2018-02-18 14:05:59 +05:30
Arun Suresh 950566230c YARN-7918. Fix TestAMRMClientPlacementConstraints. (Gergely Novák via asuresh) 
(cherry picked from commit a1e56a6286)
 2018-02-17 03:26:13 -08:00
Wangda Tan f878ddb067 YARN-7328. ResourceUtils allows yarn.nodemanager.resource-types.memory-mb and .vcores to override yarn.nodemanager.resource.memory-mb and .cpu-vcores. (lovekesh bansal via wangda) 
Change-Id: Ibb1faf0beefec079dae2208986976b2f64650672
(cherry picked from commit ca1043ab90)
 2018-02-17 13:03:58 +08:00
Wangda Tan ac9e5ee568 HADOOP-14875. Create end user documentation from the compatibility guidelines. (Daniel Templeton via wangda) 
Change-Id: I5d66d0f034874623af22aecae0a0b858b65396ed
(cherry picked from commit 31db977cb3)
 2018-02-17 13:03:58 +08:00
Jason Lowe 03aba69835 HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka 
(cherry picked from commit 0898ff42e9)
 2018-02-16 14:50:14 -06:00
Arpit Agarwal c880a87101 HDFS-13058. Fix dfs.namenode.shared.edits.dir in TestJournalNode. Contributed by Bharat Viswanadham. 2018-02-16 10:29:29 -08:00
Arpit Agarwal f43f32bd31 HDFS-13153. Enable HDFS diskbalancer by default. Contributed by Ajay Kumar. 2018-02-16 09:38:51 -08:00