Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,441 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17441 Commits

Author SHA1 Message Date
Inigo Goiri a97fe585b3 HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang. 
(cherry picked from commit e65ff1c8be)
 2018-03-19 17:21:20 -07:00
Sammi Chen 7985c5fdc9 HADOOP-15262. AliyunOSS: move files under a directory in parallel when rename a directory. Contributed by Jinhu Wu. 
(cherry picked from commit d67a5e2dec)
(cherry picked from commit 2285afb32e)
(cherry picked from commit 322520eb76)
 2018-03-19 15:44:15 +08:00
Inigo Goiri c6b1125a24 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 
(cherry picked from commit 08ff1586d5)
 2018-03-16 10:30:34 -07:00
Weiwei Yang 7c286fe804 YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang. 2018-03-16 19:11:54 +08:00
Inigo Goiri ba9a656ffa HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit e71bc00a47)
 2018-03-15 10:35:20 -07:00
Inigo Goiri 6b8a60b62a HDFS-12723. TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Contributed by Ajay Kumar. 
(cherry picked from commit 6de135169e)
 2018-03-15 10:15:46 -07:00
Wangda Tan 78f103d6e6 Revert "HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu" 
Change-Id: I946a466a43d56c73bb0135384e73cb8513595461
(cherry picked from commit 80ee5248b2dda1cb8d122d4f362f2f8cf02b9467)
(cherry picked from commit 252c2b4d52)
 2018-03-14 13:40:46 -07:00
Jason Lowe 31eef823f0 MAPREDUCE-7064. Flaky test TestTaskAttempt#testReducerCustomResourceTypes. Contributed by Peter Bacsko 
(cherry picked from commit 2626ec35e9)
 2018-03-14 15:21:09 -05:00
Inigo Goiri cfa7cc2aa4 HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan. 
(cherry picked from commit 41fc7f80be)
 2018-03-14 13:15:51 -07:00
Rohith Sharma K S 117984a2cb YARN-8022. ResourceManager UI cluster/app/<app-id> page fails to render. Contributed by Tarun Parimi. 
(cherry picked from commit e6de10d0a6)
 2018-03-14 22:14:43 +05:30
Sammi Chen e97234f274 HDFS-11600. Refactor TestDFSStripedOutputStreamWithFailure test classes. Contributed by Sammi Chen. 
(cherry picked from commit ad1b988a82)
 2018-03-14 14:51:51 +08:00
Yiqun Lin a105069729 HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri. 
(cherry picked from commit 76be6cbf6c)
 2018-03-14 11:31:35 +08:00
Inigo Goiri 95a4665ad5 HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang. 
(cherry picked from commit 427fd027a3)
 2018-03-13 20:02:06 -07:00
Chris Douglas 9889e55e5a HADOOP-15311. HttpServer2 needs a way to configure the acceptor/selector count. Contributed by Erik Krogen 
(cherry picked from commit 9d6994da19)
(cherry picked from commit 80641508c7)
 2018-03-13 14:20:44 -07:00
Xiao Chen fc6f3e2a6f HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 8211a3d469)
 2018-03-13 11:18:22 -07:00
Xiao Chen f23ef858ff Revert "HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma." 
This reverts commit 752e116f41.
 2018-03-13 10:39:50 -07:00
Xiao Chen c0aa249a1d HDFS-12587. Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3b8dbc2cb7)
 2018-03-13 10:14:39 -07:00
Xiao Chen 8f4bfb3ed5 HDFS-13239. Fix non-empty dir warning message when setting default EC policy. Contributed by Bharat Viswanadham. 
(cherry picked from commit d6931c30c5)
 2018-03-13 10:08:09 -07:00
Xiao Chen 752e116f41 HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 84c1095586)
 2018-03-13 09:58:50 -07:00
Xiaoyu Yao 2a93ba690c HDFS-12455. WebHDFS - Adding "snapshot enabled" status to ListStatus query result. Contributed by Ajay Kumar. 
(cherry picked from commit 107c177782)
 2018-03-12 20:23:52 -07:00
Yiqun Lin 840c83bf7a HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong. 2018-03-13 11:13:15 +08:00
Chris Douglas a03c8ea61f HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 
(cherry picked from commit 45d1b0fdcc)
(cherry picked from commit 09940b1eb3)
 2018-03-12 20:06:22 -07:00
Yiqun Lin 430cdfefc0 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin. 2018-03-13 10:41:44 +08:00
Akira Ajisaka 89105a623b
HDFS-12156. TestFSImage fails without -Pnative 
(cherry picked from commit 319defafc1)
 2018-03-13 11:27:46 +09:00
Inigo Goiri 177dd6580d HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong. 
(cherry picked from commit 91c82c90f0)
 2018-03-12 17:30:00 -07:00
Chris Douglas 2210593dad HADOOP-14742. Document multi-URI replication Inode for ViewFS. Contributed by Gera Shegalov 
(cherry picked from commit ddb67ca707)
(cherry picked from commit c9364b3bce)
 2018-03-12 13:55:10 -07:00
Inigo Goiri 29cf29a853 HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 
(cherry picked from commit ac627f561f)
 2018-03-12 10:05:43 -07:00
Wangda Tan 8034faa888 Updated timeline reader to use AuthenticationFilter 
Change-Id: I961771589180c1eb377d36c37a79aa23754effbf
(cherry picked from commit 837338788eb903d0e8bbb1230694782a707891be)
 2018-03-10 13:36:09 -08:00
Owen O'Malley 0f3b6102ef Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu." 
This reverts commit a847903b6e.

Change-Id: I3122a2142f5bdf8507dece930e447556a43cd9ae
(cherry picked from commit 8fad3ec76070ccfcd3ed80feaba4355077bc6f5c)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/http/TestHttpServerWithSpengo.java
 2018-03-10 13:35:47 -08:00
Owen O'Malley 0f106df4d6 Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu." 
This reverts commit 172b23af33.

(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
 2018-03-10 13:33:52 -08:00
Yiqun Lin 2e607f2103 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. 
(cherry picked from commit 4743d4a2c7)
 2018-03-10 11:32:12 +08:00
Inigo Goiri 465c3f0e24 HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S. 
(cherry picked from commit 8133cd5305)
 2018-03-09 18:27:17 -08:00
Inigo Goiri c453fcb23f HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu. 
(cherry picked from commit afe1a3ccd5)
 2018-03-09 17:20:29 -08:00
Hanisha Koneru bd2ebf031c HDFS-13244. Add stack, conf, metrics links to utilities dropdown in NN webUI. Contributed by Bharat Viswanadham. 
(cherry picked from commit 4eeff62f69)
 2018-03-09 15:49:09 -08:00
Lokesh Jain 80aabd72c2
HDFS-13190. Document WebHDFS support for snapshot diff 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Xiaoyu Yao <xyao@apache.org>
(cherry picked from commit 7b0dc31020)
 2018-03-09 15:07:34 -08:00
Hanisha Koneru dec53bb9e1 HDFS-11394. Support for getting erasure coding policy through WebHDFS#FileStatus. 
(cherry picked from commit 9a082fbe6e)
 2018-03-09 13:39:49 -08:00
Jason Lowe 9dacb9fb27 MAPREDUCE-6930. mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml. Contributed by Sen Zhao 
(cherry picked from commit 32fa3a63e0)
 2018-03-09 10:44:49 -06:00
Steve Loughran ca5c4d454e HADOOP-15277. Remove .FluentPropertyBeanIntrospector from CLI operation log output. 
Contributed by Steve Loughran.
 2018-03-09 10:50:04 +00:00
Steve Loughran 1771af2320 HADOOP-15273.distcp can't handle remote stores with different checksum algorithms. 
Contributed by Steve Loughran.

(cherry picked from commit 7ef4d942dd)
 2018-03-09 10:49:11 +00:00
Yiqun Lin f879504fe1 HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan. 2018-03-09 15:48:36 +08:00
Inigo Goiri 68cff8c235 HDFS-13232. RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns. Contributed by Chao Sun. 
(cherry picked from commit 0c2b969e01)
 2018-03-08 09:33:24 -08:00
Yiqun Lin 7a9aea17a2 HADOOP-15296. Fix a wrong link for RBF in the top page. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cc9a6d9bb)
 2018-03-08 16:05:53 +08:00
Hanisha Koneru 0b1e9665df HDFS-13225. StripeReader#checkMissingBlocks() 's IOException info is incomplete. Contributed by lufei. 
(cherry picked from commit 19ae4429f9)
 2018-03-07 14:22:01 -08:00
Steve Loughran cc0f14c13c HADOOP-15267. S3A multipart upload fails when SSE-C encryption is enabled. 
Contributed by Anis Elleuch.

(cherry picked from commit 1dedc68f9d)
 2018-03-07 19:20:53 +00:00
Yiqun Lin 253ef33f80 HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin. 2018-03-07 16:07:05 +08:00
Xiaoyu Yao b74df5523c HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru. 
(cherry picked from commit edf9445708)
 2018-03-06 18:30:10 -08:00
Allen Wittenauer 5aaf88d401
HADOOP-15279. increase maven heap size recommendations 
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
(cherry picked from commit d4cc50f622)
 2018-03-06 13:56:40 -08:00
Xiao Chen 283d48a4f7 HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell. 
(cherry picked from commit 92c15e19272a8bb59f8704c44d4cd713d3a58bcb)
 2018-03-06 09:58:09 -08:00
Steve Loughran a5cb7f3616 HADOOP-15289. FileStatus.readFields() assertion incorrect. 
Contributed by Steve Loughran.

(cherry picked from commit 12ecb55ffe)
 2018-03-06 10:08:28 +00:00
Sen Zhao 4df200bc6d
YARN-7736. Fix itemization in YARN federation document 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 245751ffdc)
 2018-03-05 11:55:01 -08:00