Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,951 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17951 Commits

Author SHA1 Message Date
Inigo Goiri eafacdbbbb HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 
(cherry picked from commit 08ff1586d5)
 2018-03-16 10:30:01 -07:00
Weiwei Yang 815a00580a YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang. 2018-03-16 19:33:52 +08:00
Xiaoyu Yao 9d0a68721d HDFS-13280. WebHDFS: Fix NPE in get snasphottable directory list call. Contributed by Lokesh Jain. 
(cherry picked from commit 78b05fde6c)
 2018-03-15 11:16:01 -07:00
Xiaoyu Yao 03a9ffbf5e HDFS-13251. Avoid using hard coded datanode data dirs in unit tests(addendum). Contributed by Ajay Kumar. 
(cherry picked from commit 9a73fe8bd4d5ec79fc2fe437fcd4fa11518be647)
 2018-03-15 11:16:01 -07:00
Xiaoyu Yao d09975a453 HDFS-13251. Avoid using hard coded datanode data dirs in unit tests. Contributed by Ajay Kumar. 
(cherry picked from commit f83716b7f2)
 2018-03-15 11:16:01 -07:00
Steve Loughran 8f84559819 HADOOP-15209. DistCp to eliminate needless deletion of files under already-deleted directories. 
Contributed by Steve Loughran.

(cherry picked from commit 1976e0066e)
 2018-03-15 18:06:32 +00:00
Inigo Goiri 13f2ee05e9 HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit e71bc00a47)
 2018-03-15 10:34:45 -07:00
Inigo Goiri 87f6d33e49 HDFS-12723. TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Contributed by Ajay Kumar. 
(cherry picked from commit 6de135169e)
 2018-03-15 10:15:20 -07:00
Yiqun Lin f4088e524a HDFS-13261. Fix incorrect null value check. Contributed by Jianfei Jiang. 
(cherry picked from commit 3a0f4bc0d5)
 2018-03-15 11:09:46 +08:00
Aaron Fabbri 307b0bce7c
HADOOP-15278 log s3a at info. Contributed by Steve Loughran. 2018-03-14 15:52:10 -07:00
Wangda Tan 3a7067a96b Revert "HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu" 
Change-Id: I946a466a43d56c73bb0135384e73cb8513595461
(cherry picked from commit 80ee5248b2dda1cb8d122d4f362f2f8cf02b9467)
(cherry picked from commit 252c2b4d52)
 2018-03-14 13:37:27 -07:00
Inigo Goiri d51692b759 HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan. 
(cherry picked from commit 41fc7f80be)
 2018-03-14 13:15:08 -07:00
Jason Lowe bc4ce6c018 MAPREDUCE-7064. Flaky test TestTaskAttempt#testReducerCustomResourceTypes. Contributed by Peter Bacsko 
(cherry picked from commit 2626ec35e9)
 2018-03-14 15:06:28 -05:00
Xiaoyu Yao 411e82e72e HDFS-13275. Adding log for BlockPoolManager#refreshNamenodes failures. Contributed by Ajay Kumar. 
(cherry picked from commit 0be0f1ce1d)
 2018-03-14 10:38:48 -07:00
Xiaoyu Yao d12418b12c HDFS-13249. Document webhdfs support for getting snapshottable directory list. Contributed by Lokesh Jain. 
(cherry picked from commit 8cd22552eb7969cf9cf93f17d780b59405372d4b)
 2018-03-14 09:09:38 -07:00
Sammi Chen ec951a3dde HDFS-11600. Refactor TestDFSStripedOutputStreamWithFailure test classes. Contributed by Sammi Chen. 
(cherry picked from commit ad1b988a82)
(cherry picked from commit e97234f274)
 2018-03-14 15:19:05 +08:00
Rohith Sharma K S c662e688d1 YARN-8022. ResourceManager UI cluster/app/<app-id> page fails to render. Contributed by Tarun Parimi. 
(cherry picked from commit e6de10d0a6)
 2018-03-14 09:48:04 +05:30
Yiqun Lin 19521f71d4 HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri. 
(cherry picked from commit 76be6cbf6c)
 2018-03-14 11:23:01 +08:00
Inigo Goiri d7aa93b2ff HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang. 
(cherry picked from commit 427fd027a3)
 2018-03-13 20:01:41 -07:00
Chris Douglas 80641508c7 HADOOP-15311. HttpServer2 needs a way to configure the acceptor/selector count. Contributed by Erik Krogen 
(cherry picked from commit 9d6994da19)
 2018-03-13 14:20:28 -07:00
Xiao Chen 189c1cb6ff HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 8211a3d469)
 2018-03-13 11:18:15 -07:00
Xiao Chen ccb799e3a0 Revert "HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma." 
This reverts commit 98d69733f7.
 2018-03-13 10:39:42 -07:00
Xiao Chen 441576528b HDFS-12587. Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3b8dbc2cb7)
 2018-03-13 10:14:32 -07:00
Xiao Chen c9bfe3822f HDFS-13239. Fix non-empty dir warning message when setting default EC policy. Contributed by Bharat Viswanadham. 
(cherry picked from commit d6931c30c5)
 2018-03-13 10:08:02 -07:00
Xiao Chen 98d69733f7 HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 84c1095586)
 2018-03-13 09:58:43 -07:00
Chris Douglas 032f05ea90 HDFS-13271. WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument. Contributed by Lokesh Jain 
(cherry picked from commit b2b9ce5859)
 2018-03-13 09:44:30 -07:00
Xiaoyu Yao 509d6b1fe0 HDFS-13141. WebHDFS: Add support for getting snasphottable directory list. Contributed by Lokesh Jain. 
(cherry picked from commit c927054687c77e5ef16ee7e0a0f36bbb7fc8a464)
 2018-03-12 20:49:03 -07:00
Chris Douglas 09940b1eb3 HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 
(cherry picked from commit 45d1b0fdcc)
 2018-03-12 20:06:04 -07:00
Yiqun Lin c966731742 HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong. 
(cherry picked from commit 19292bc264)
 2018-03-13 11:04:51 +08:00
Yiqun Lin e908a52f19 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin. 
(cherry picked from commit 7fab787de7)
 2018-03-13 10:31:53 +08:00
Akira Ajisaka b01f8fd2bc
HDFS-12156. TestFSImage fails without -Pnative 
(cherry picked from commit 319defafc1)
 2018-03-13 11:27:28 +09:00
Inigo Goiri c73f34fead HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong. 
(cherry picked from commit 91c82c90f0)
 2018-03-12 17:29:11 -07:00
Chris Douglas 75d3699a00 HDFS-12677. Extend TestReconstructStripedFile with a random EC policy. Contributed by Takanobu Asanuma 
(cherry picked from commit 39a5fbae47)
 2018-03-12 14:30:06 -07:00
Chris Douglas c9364b3bce HADOOP-14742. Document multi-URI replication Inode for ViewFS. Contributed by Gera Shegalov 
(cherry picked from commit ddb67ca707)
 2018-03-12 13:47:01 -07:00
Inigo Goiri 2bda1ffe72 HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 
(cherry picked from commit ac627f561f)
 2018-03-12 10:06:20 -07:00
Steve Loughran 41a3f378bc HADOOP-15297. Make S3A etag => checksum feature optional. 
Contributed by Steve Loughran.

(cherry picked from commit dd05871b8b)
 2018-03-12 14:02:36 +00:00
Billie Rinaldi 8f27c35da8 YARN-7523. Introduce description and version field in Service record. Contributed by Chandni Singh 
(cherry picked from commit e1f5251f3c)
 2018-03-10 07:53:20 -08:00
Wangda Tan 4b9eb2188b Updated timeline reader to use AuthenticationFilter 
Change-Id: I961771589180c1eb377d36c37a79aa23754effbf
(cherry picked from commit 837338788eb903d0e8bbb1230694782a707891be)
 2018-03-09 23:01:11 -08:00
Owen O'Malley 4cd4219206 Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu." 
This reverts commit a847903b6e.

Change-Id: I3122a2142f5bdf8507dece930e447556a43cd9ae
(cherry picked from commit 8fad3ec76070ccfcd3ed80feaba4355077bc6f5c)
 2018-03-09 23:01:11 -08:00
Owen O'Malley 26540a64d4 Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu." 
This reverts commit 172b23af33.

(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
 2018-03-09 23:01:11 -08:00
Yiqun Lin 60c6ded483 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. 
(cherry picked from commit 4743d4a2c7)
 2018-03-10 11:30:52 +08:00
Inigo Goiri 86a1c89754 HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S. 
(cherry picked from commit 8133cd5305)
 2018-03-09 18:25:46 -08:00
Inigo Goiri 4d41f933a2 HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu. 
(cherry picked from commit afe1a3ccd5)
 2018-03-09 17:19:50 -08:00
Hanisha Koneru c337c97c63 HDFS-13244. Add stack, conf, metrics links to utilities dropdown in NN webUI. Contributed by Bharat Viswanadham. 
(cherry picked from commit 4eeff62f69)
 2018-03-09 15:48:28 -08:00
Lokesh Jain 0f76690c73
HDFS-13190. Document WebHDFS support for snapshot diff 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Xiaoyu Yao <xyao@apache.org>
(cherry picked from commit 7b0dc31020)
 2018-03-09 15:07:16 -08:00
Hanisha Koneru 32e8290e20 HDFS-11394. Support for getting erasure coding policy through WebHDFS#FileStatus. 
(cherry picked from commit 9a082fbe6e)
 2018-03-09 13:21:39 -08:00
Jason Lowe af48a2a0f3 MAPREDUCE-6930. mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml. Contributed by Sen Zhao 
(cherry picked from commit 32fa3a63e0)
 2018-03-09 10:43:08 -06:00
Steve Loughran 2958666e04 HADOOP-15277. Remove .FluentPropertyBeanIntrospector from CLI operation log output. 
Contributed by Steve Loughran.

(cherry picked from commit 3f7bd46797)
 2018-03-09 10:44:53 +00:00
Yiqun Lin 9368f7fbab HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan. 
(cherry picked from commit 122805b43a)
 2018-03-09 15:44:35 +08:00
Sunil G f313e59494 YARN-7944. [UI2] Remove master node link from headers of application pages. Contributed by Yesha Vora. 
(cherry picked from commit 113f401f41)
 2018-03-08 23:54:15 +05:30