Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,929 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17929 Commits

Author SHA1 Message Date
Xiao Chen 441576528b HDFS-12587. Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3b8dbc2cb7)
 2018-03-13 10:14:32 -07:00
Xiao Chen c9bfe3822f HDFS-13239. Fix non-empty dir warning message when setting default EC policy. Contributed by Bharat Viswanadham. 
(cherry picked from commit d6931c30c5)
 2018-03-13 10:08:02 -07:00
Xiao Chen 98d69733f7 HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 84c1095586)
 2018-03-13 09:58:43 -07:00
Chris Douglas 032f05ea90 HDFS-13271. WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument. Contributed by Lokesh Jain 
(cherry picked from commit b2b9ce5859)
 2018-03-13 09:44:30 -07:00
Xiaoyu Yao 509d6b1fe0 HDFS-13141. WebHDFS: Add support for getting snasphottable directory list. Contributed by Lokesh Jain. 
(cherry picked from commit c927054687c77e5ef16ee7e0a0f36bbb7fc8a464)
 2018-03-12 20:49:03 -07:00
Chris Douglas 09940b1eb3 HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 
(cherry picked from commit 45d1b0fdcc)
 2018-03-12 20:06:04 -07:00
Yiqun Lin c966731742 HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong. 
(cherry picked from commit 19292bc264)
 2018-03-13 11:04:51 +08:00
Yiqun Lin e908a52f19 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin. 
(cherry picked from commit 7fab787de7)
 2018-03-13 10:31:53 +08:00
Akira Ajisaka b01f8fd2bc
HDFS-12156. TestFSImage fails without -Pnative 
(cherry picked from commit 319defafc1)
 2018-03-13 11:27:28 +09:00
Inigo Goiri c73f34fead HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong. 
(cherry picked from commit 91c82c90f0)
 2018-03-12 17:29:11 -07:00
Chris Douglas 75d3699a00 HDFS-12677. Extend TestReconstructStripedFile with a random EC policy. Contributed by Takanobu Asanuma 
(cherry picked from commit 39a5fbae47)
 2018-03-12 14:30:06 -07:00
Chris Douglas c9364b3bce HADOOP-14742. Document multi-URI replication Inode for ViewFS. Contributed by Gera Shegalov 
(cherry picked from commit ddb67ca707)
 2018-03-12 13:47:01 -07:00
Inigo Goiri 2bda1ffe72 HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 
(cherry picked from commit ac627f561f)
 2018-03-12 10:06:20 -07:00
Steve Loughran 41a3f378bc HADOOP-15297. Make S3A etag => checksum feature optional. 
Contributed by Steve Loughran.

(cherry picked from commit dd05871b8b)
 2018-03-12 14:02:36 +00:00
Billie Rinaldi 8f27c35da8 YARN-7523. Introduce description and version field in Service record. Contributed by Chandni Singh 
(cherry picked from commit e1f5251f3c)
 2018-03-10 07:53:20 -08:00
Wangda Tan 4b9eb2188b Updated timeline reader to use AuthenticationFilter 
Change-Id: I961771589180c1eb377d36c37a79aa23754effbf
(cherry picked from commit 837338788eb903d0e8bbb1230694782a707891be)
 2018-03-09 23:01:11 -08:00
Owen O'Malley 4cd4219206 Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu." 
This reverts commit a847903b6e.

Change-Id: I3122a2142f5bdf8507dece930e447556a43cd9ae
(cherry picked from commit 8fad3ec76070ccfcd3ed80feaba4355077bc6f5c)
 2018-03-09 23:01:11 -08:00
Owen O'Malley 26540a64d4 Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu." 
This reverts commit 172b23af33.

(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
 2018-03-09 23:01:11 -08:00
Yiqun Lin 60c6ded483 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. 
(cherry picked from commit 4743d4a2c7)
 2018-03-10 11:30:52 +08:00
Inigo Goiri 86a1c89754 HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S. 
(cherry picked from commit 8133cd5305)
 2018-03-09 18:25:46 -08:00
Inigo Goiri 4d41f933a2 HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu. 
(cherry picked from commit afe1a3ccd5)
 2018-03-09 17:19:50 -08:00
Hanisha Koneru c337c97c63 HDFS-13244. Add stack, conf, metrics links to utilities dropdown in NN webUI. Contributed by Bharat Viswanadham. 
(cherry picked from commit 4eeff62f69)
 2018-03-09 15:48:28 -08:00
Lokesh Jain 0f76690c73
HDFS-13190. Document WebHDFS support for snapshot diff 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Xiaoyu Yao <xyao@apache.org>
(cherry picked from commit 7b0dc31020)
 2018-03-09 15:07:16 -08:00
Hanisha Koneru 32e8290e20 HDFS-11394. Support for getting erasure coding policy through WebHDFS#FileStatus. 
(cherry picked from commit 9a082fbe6e)
 2018-03-09 13:21:39 -08:00
Jason Lowe af48a2a0f3 MAPREDUCE-6930. mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml. Contributed by Sen Zhao 
(cherry picked from commit 32fa3a63e0)
 2018-03-09 10:43:08 -06:00
Steve Loughran 2958666e04 HADOOP-15277. Remove .FluentPropertyBeanIntrospector from CLI operation log output. 
Contributed by Steve Loughran.

(cherry picked from commit 3f7bd46797)
 2018-03-09 10:44:53 +00:00
Yiqun Lin 9368f7fbab HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan. 
(cherry picked from commit 122805b43a)
 2018-03-09 15:44:35 +08:00
Sunil G f313e59494 YARN-7944. [UI2] Remove master node link from headers of application pages. Contributed by Yesha Vora. 
(cherry picked from commit 113f401f41)
 2018-03-08 23:54:15 +05:30
Inigo Goiri e27ee2302c HDFS-13232. RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns. Contributed by Chao Sun. 
(cherry picked from commit 0c2b969e01)
 2018-03-08 09:32:51 -08:00
Steve Loughran ba0184376e HADOOP-15273.distcp can't handle remote stores with different checksum algorithms. 
Contributed by Steve Loughran.

(cherry picked from commit 7ef4d942dd)
 2018-03-08 11:25:05 +00:00
Steve Loughran f0b486f6ae HADOOP-15292. Distcp's use of pread is slowing it down. 
Contributed by Virajith Jalaparti.

(cherry picked from commit 3bd6b1fd85)
 2018-03-08 11:18:33 +00:00
Yiqun Lin 56f14cb5fb HADOOP-15296. Fix a wrong link for RBF in the top page. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cc9a6d9bb)
 2018-03-08 16:04:20 +08:00
Hanisha Koneru 885d46a245 HDFS-13225. StripeReader#checkMissingBlocks() 's IOException info is incomplete. Contributed by lufei. 
(cherry picked from commit 19ae4429f9)
 2018-03-07 14:21:04 -08:00
Steve Loughran 1dedc68f9d HADOOP-15267. S3A multipart upload fails when SSE-C encryption is enabled. 
Contributed by Anis Elleuch.
 2018-03-07 18:50:27 +00:00
Jason Lowe c0986b1b7e YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan 
(cherry picked from commit d69b31f7f7)
 2018-03-07 09:21:54 -06:00
Yiqun Lin 8262b63c8c HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin. 
(cherry picked from commit 58ea2d7a65)
 2018-03-07 15:29:16 +08:00
Xiaoyu Yao 07a966ede3 HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru. 
(cherry picked from commit edf9445708)
 2018-03-06 18:29:42 -08:00
Allen Wittenauer 1a8e6a52a5
HADOOP-15279. increase maven heap size recommendations 
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
(cherry picked from commit d4cc50f622)
 2018-03-06 13:55:11 -08:00
Xiao Chen 2d93a7381e HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell. 
(cherry picked from commit 92c15e19272a8bb59f8704c44d4cd713d3a58bcb)
 2018-03-06 09:58:01 -08:00
Steve Loughran e8ecd4fa1d HADOOP-15289. FileStatus.readFields() assertion incorrect. 
Contributed by Steve Loughran.

(cherry picked from commit 12ecb55ffe)
 2018-03-06 10:06:11 +00:00
Sen Zhao 429e9d6c19
YARN-7736. Fix itemization in YARN federation document 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 245751ffdc)
 2018-03-05 11:54:49 -08:00
Steve Loughran 1901987ffe HADOOP-13761. S3Guard: implement retries for DDB failures and throttling; translate exceptions. 
Contributed by Aaron Fabbri.

(cherry picked from commit 8110d6a0d5)
 2018-03-05 14:08:12 +00:00
Ajay Kumar 92e2e6c22e
HADOOP-15286. Remove unused imports from TestKMSWithZK.java 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3dc30bc24e)
 2018-03-04 07:19:33 -08:00
Xiao Chen d35baf157e HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen. 
(cherry picked from commit c75105f07b)
 2018-03-02 16:47:19 -08:00
Gergely Novák 162e99c696
MAPREDUCE-7023. TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e99a1e7767)
 2018-03-02 16:21:41 -08:00
Jason Lowe 9e5ac217ac YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang 
(cherry picked from commit 83798f15f8)
 2018-03-02 10:00:59 -06:00
Weiwei Yang 46b14efb05 MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster. Contributed by Jiandan Yang. 2018-03-02 10:33:17 +08:00
Sunil G 37b8b24dfb YARN-7637. GPU volume creation command fails when work preserving is disabled at NM. Contributed by Zian Chen. 
(cherry picked from commit 22928c0c60)
 2018-03-01 22:40:11 +05:30
Billie Rinaldi 5621254bd0 YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh 
(cherry picked from commit 5ed689e33a)
 2018-03-01 08:01:38 -08:00
Nanda kumar 749abde043
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db1)
 2018-03-01 19:04:23 +09:00