Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,455 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17455 Commits

Author SHA1 Message Date
Lei Xu 7b47400ce0 Update releasenotes and changelogs for 3.0.1 release 2018-03-23 11:51:32 -07:00
Wei Yan f4d6fee96b HDFS-12512. RBF: Add WebHDFS. 
(cherry picked from commit 6e31a09084)
 2018-03-23 08:55:26 -07:00
Arpit Agarwal 26b08e002f
HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 46c93453e9)
 2018-03-23 18:12:48 +09:00
Rohith Sharma K S dc02823d2c YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri. 
(cherry picked from commit 75fc05f369)
 2018-03-23 12:24:38 +05:30
Sunil G 2f6d6cc0d6 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S. 
(cherry picked from commit 22c5ddb7c4)
 2018-03-23 10:55:46 +05:30
Inigo Goiri 50b6dc9f3e HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri. 
(cherry picked from commit e196d158a2)
 2018-03-22 13:35:24 -07:00
Arpit Agarwal cdf3e758cc HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 2018-03-22 10:55:30 -07:00
Kihwal Lee 7212c98ba5 HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong. 
(cherry picked from commit 66461ed98b)
 2018-03-22 12:29:21 -05:00
Inigo Goiri 471f758673 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S. 
(cherry picked from commit 3d0ee8b804)
 2018-03-22 09:22:46 -07:00
Konstantin V Shvachko 987d90aa4c HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan. 
(cherry picked from commit 8d898ab25f)
 2018-03-21 17:17:41 -07:00
Jason Lowe 8f60b50f28 YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles 
(cherry picked from commit 5aa7052e31)
 2018-03-21 17:23:01 -05:00
Yiqun Lin e65db99799 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit 2caba999bb)
 2018-03-21 11:41:14 +08:00
Inigo Goiri 981fda128f HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang. 
(cherry picked from commit fe224ff972)
 2018-03-20 11:21:09 -07:00
weiy 62a819d5ee HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:15:53 -07:00
Inigo Goiri a97fe585b3 HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang. 
(cherry picked from commit e65ff1c8be)
 2018-03-19 17:21:20 -07:00
Sammi Chen 7985c5fdc9 HADOOP-15262. AliyunOSS: move files under a directory in parallel when rename a directory. Contributed by Jinhu Wu. 
(cherry picked from commit d67a5e2dec)
(cherry picked from commit 2285afb32e)
(cherry picked from commit 322520eb76)
 2018-03-19 15:44:15 +08:00
Inigo Goiri c6b1125a24 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 
(cherry picked from commit 08ff1586d5)
 2018-03-16 10:30:34 -07:00
Weiwei Yang 7c286fe804 YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang. 2018-03-16 19:11:54 +08:00
Inigo Goiri ba9a656ffa HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit e71bc00a47)
 2018-03-15 10:35:20 -07:00
Inigo Goiri 6b8a60b62a HDFS-12723. TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Contributed by Ajay Kumar. 
(cherry picked from commit 6de135169e)
 2018-03-15 10:15:46 -07:00
Wangda Tan 78f103d6e6 Revert "HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu" 
Change-Id: I946a466a43d56c73bb0135384e73cb8513595461
(cherry picked from commit 80ee5248b2dda1cb8d122d4f362f2f8cf02b9467)
(cherry picked from commit 252c2b4d52)
 2018-03-14 13:40:46 -07:00
Jason Lowe 31eef823f0 MAPREDUCE-7064. Flaky test TestTaskAttempt#testReducerCustomResourceTypes. Contributed by Peter Bacsko 
(cherry picked from commit 2626ec35e9)
 2018-03-14 15:21:09 -05:00
Inigo Goiri cfa7cc2aa4 HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan. 
(cherry picked from commit 41fc7f80be)
 2018-03-14 13:15:51 -07:00
Rohith Sharma K S 117984a2cb YARN-8022. ResourceManager UI cluster/app/<app-id> page fails to render. Contributed by Tarun Parimi. 
(cherry picked from commit e6de10d0a6)
 2018-03-14 22:14:43 +05:30
Sammi Chen e97234f274 HDFS-11600. Refactor TestDFSStripedOutputStreamWithFailure test classes. Contributed by Sammi Chen. 
(cherry picked from commit ad1b988a82)
 2018-03-14 14:51:51 +08:00
Yiqun Lin a105069729 HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri. 
(cherry picked from commit 76be6cbf6c)
 2018-03-14 11:31:35 +08:00
Inigo Goiri 95a4665ad5 HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang. 
(cherry picked from commit 427fd027a3)
 2018-03-13 20:02:06 -07:00
Chris Douglas 9889e55e5a HADOOP-15311. HttpServer2 needs a way to configure the acceptor/selector count. Contributed by Erik Krogen 
(cherry picked from commit 9d6994da19)
(cherry picked from commit 80641508c7)
 2018-03-13 14:20:44 -07:00
Xiao Chen fc6f3e2a6f HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 8211a3d469)
 2018-03-13 11:18:22 -07:00
Xiao Chen f23ef858ff Revert "HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma." 
This reverts commit 752e116f41.
 2018-03-13 10:39:50 -07:00
Xiao Chen c0aa249a1d HDFS-12587. Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3b8dbc2cb7)
 2018-03-13 10:14:39 -07:00
Xiao Chen 8f4bfb3ed5 HDFS-13239. Fix non-empty dir warning message when setting default EC policy. Contributed by Bharat Viswanadham. 
(cherry picked from commit d6931c30c5)
 2018-03-13 10:08:09 -07:00
Xiao Chen 752e116f41 HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 84c1095586)
 2018-03-13 09:58:50 -07:00
Xiaoyu Yao 2a93ba690c HDFS-12455. WebHDFS - Adding "snapshot enabled" status to ListStatus query result. Contributed by Ajay Kumar. 
(cherry picked from commit 107c177782)
 2018-03-12 20:23:52 -07:00
Yiqun Lin 840c83bf7a HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong. 2018-03-13 11:13:15 +08:00
Chris Douglas a03c8ea61f HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 
(cherry picked from commit 45d1b0fdcc)
(cherry picked from commit 09940b1eb3)
 2018-03-12 20:06:22 -07:00
Yiqun Lin 430cdfefc0 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin. 2018-03-13 10:41:44 +08:00
Akira Ajisaka 89105a623b
HDFS-12156. TestFSImage fails without -Pnative 
(cherry picked from commit 319defafc1)
 2018-03-13 11:27:46 +09:00
Inigo Goiri 177dd6580d HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong. 
(cherry picked from commit 91c82c90f0)
 2018-03-12 17:30:00 -07:00
Chris Douglas 2210593dad HADOOP-14742. Document multi-URI replication Inode for ViewFS. Contributed by Gera Shegalov 
(cherry picked from commit ddb67ca707)
(cherry picked from commit c9364b3bce)
 2018-03-12 13:55:10 -07:00
Inigo Goiri 29cf29a853 HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 
(cherry picked from commit ac627f561f)
 2018-03-12 10:05:43 -07:00
Wangda Tan 8034faa888 Updated timeline reader to use AuthenticationFilter 
Change-Id: I961771589180c1eb377d36c37a79aa23754effbf
(cherry picked from commit 837338788eb903d0e8bbb1230694782a707891be)
 2018-03-10 13:36:09 -08:00
Owen O'Malley 0f3b6102ef Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu." 
This reverts commit a847903b6e.

Change-Id: I3122a2142f5bdf8507dece930e447556a43cd9ae
(cherry picked from commit 8fad3ec76070ccfcd3ed80feaba4355077bc6f5c)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/http/TestHttpServerWithSpengo.java
 2018-03-10 13:35:47 -08:00
Owen O'Malley 0f106df4d6 Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu." 
This reverts commit 172b23af33.

(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
 2018-03-10 13:33:52 -08:00
Yiqun Lin 2e607f2103 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. 
(cherry picked from commit 4743d4a2c7)
 2018-03-10 11:32:12 +08:00
Inigo Goiri 465c3f0e24 HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S. 
(cherry picked from commit 8133cd5305)
 2018-03-09 18:27:17 -08:00
Inigo Goiri c453fcb23f HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu. 
(cherry picked from commit afe1a3ccd5)
 2018-03-09 17:20:29 -08:00
Hanisha Koneru bd2ebf031c HDFS-13244. Add stack, conf, metrics links to utilities dropdown in NN webUI. Contributed by Bharat Viswanadham. 
(cherry picked from commit 4eeff62f69)
 2018-03-09 15:49:09 -08:00
Lokesh Jain 80aabd72c2
HDFS-13190. Document WebHDFS support for snapshot diff 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Xiaoyu Yao <xyao@apache.org>
(cherry picked from commit 7b0dc31020)
 2018-03-09 15:07:34 -08:00
Hanisha Koneru dec53bb9e1 HDFS-11394. Support for getting erasure coding policy through WebHDFS#FileStatus. 
(cherry picked from commit 9a082fbe6e)
 2018-03-09 13:39:49 -08:00