Commit Graph

17478 Commits

Author SHA1 Message Date
Lei Xu 9fe337096d HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu).
(cherry picked from commit 1cbf23df145af01692b8aaa438642b64e330cd05)
2018-04-05 09:54:15 -07:00
Yiqun Lin f2d89d7bf9 HDFS-13364. Addendum to fix branch-3.0 compilation. 2018-04-05 09:52:50 +08:00
Yiqun Lin 794ecb0284 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri.
(cherry picked from commit 2be64eb201)
2018-04-03 15:26:02 +08:00
Xiao Chen 973a7b16b9 HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. Contributed by LiXin Ge.
(cherry picked from commit f614b44fe583033947cc78d8f04cfe6fb64fc892)
2018-04-02 23:10:26 -07:00
Xiao Chen ce37f586f5 HADOOP-15317. Improve NetworkTopology chooseRandom's loop.
(cherry picked from commit 57374c4737)
2018-04-02 22:49:03 -07:00
Steve Loughran a3945e4cf1 HADOOP-14651. Update okhttp version to 2.7.5. Contributed by Ray Chiang and John Zhuge.
(cherry picked from commit 8aca46e53f)
2018-04-02 16:38:19 +01:00
Inigo Goiri 8266696aa3 HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar.
(cherry picked from commit dc8e343201)
2018-03-31 09:47:06 -07:00
Konstantin V Shvachko 4ba5efa96f HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie.
(cherry picked from commit acfd764fcc)
2018-03-30 19:05:01 -07:00
Yiqun Lin 7483acf484
HDFS-13349. Unresolved merge conflict in ViewFs.md
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-30 23:28:59 +09:00
Konstantin V Shvachko 3912bdb2b0 HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko.
(cherry picked from commit 2216bde322)
2018-03-29 17:22:53 -07:00
Xiao Chen cd74a281a7 HDFS-13087. Snapshotted encryption zone information should be immutable. Contributed by LiXin Ge.
(cherry picked from commit 2c6cfad5a3)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirEncryptionZoneOp.java
2018-03-29 16:07:09 -07:00
Sean Mackrory ca92d1810b HADOOP-15342. Updating ADLS connector to use the current SDK version (2.2.7). Contributed by Atul Sikaria.
(cherry picked from commit 9d7a9031a5)
2018-03-29 14:05:42 -06:00
Arpit Agarwal 198f2bc35e HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 12:49:09 -07:00
Zhe Zhang f3b41bb1ad YARN-7623. Fix the CapacityScheduler Queue configuration documentation. Contributed by Jonathan Hung.
(cherry picked from commit 0b1c2b5fe1)
(cherry picked from commit 0db6b8c93c)
2018-03-28 11:43:34 -07:00
Weiwei Yang bedf30e594 YARN-7734. Fix UT failure TestContainerLogsPage#testContainerLogPageAccess. Contributed by Tao Yang. 2018-03-28 17:44:45 +08:00
Yiqun Lin c903efeb51 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri.
(cherry picked from commit a71656c1c1)
2018-03-28 11:05:58 +08:00
Wei-Chiu Chuang c6939e9330 HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge.
(cherry picked from commit 3fe41c65d8)
(cherry picked from commit 1176a128d6)
2018-03-27 13:37:14 -07:00
Inigo Goiri 7cc06217de HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma.
(cherry picked from commit 4cef01147f)
2018-03-27 10:32:56 -07:00
Wangda Tan 48778eee52 YARN-8068. Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ (Sunil G via wangda)
Change-Id: I7910bd1064a1b4dbbe2084080c060822ea6f3b48
(cherry picked from commit 9eef19b2ad)
2018-03-26 11:33:33 -07:00
Wangda Tan a465026207 YARN-8062. yarn rmadmin -getGroups returns group from which the user has been removed. (Sunil G via wangda)
Change-Id: I80ed63846502bf7751b890b6c6c6a7c0679e2b4a
(cherry picked from commit 5d381570f8)
2018-03-26 11:33:24 -07:00
Inigo Goiri b8e82a4f66 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong.
(cherry picked from commit 947b282984)
2018-03-26 09:43:59 -07:00
Yiqun Lin fdcd139c55 HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin.
(cherry picked from commit cfc3a1c8f0)
2018-03-26 18:37:40 +08:00
Lei Xu beb98bb419 Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:51:40 -07:00
Lei Xu 7b47400ce0 Update releasenotes and changelogs for 3.0.1 release 2018-03-23 11:51:32 -07:00
Wei Yan f4d6fee96b HDFS-12512. RBF: Add WebHDFS.
(cherry picked from commit 6e31a09084)
2018-03-23 08:55:26 -07:00
Arpit Agarwal 26b08e002f
HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula.
(cherry picked from commit 46c93453e9)
2018-03-23 18:12:48 +09:00
Rohith Sharma K S dc02823d2c YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri.
(cherry picked from commit 75fc05f369)
2018-03-23 12:24:38 +05:30
Sunil G 2f6d6cc0d6 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S.
(cherry picked from commit 22c5ddb7c4)
2018-03-23 10:55:46 +05:30
Inigo Goiri 50b6dc9f3e HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri.
(cherry picked from commit e196d158a2)
2018-03-22 13:35:24 -07:00
Arpit Agarwal cdf3e758cc HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 2018-03-22 10:55:30 -07:00
Kihwal Lee 7212c98ba5 HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong.
(cherry picked from commit 66461ed98b)
2018-03-22 12:29:21 -05:00
Inigo Goiri 471f758673 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S.
(cherry picked from commit 3d0ee8b804)
2018-03-22 09:22:46 -07:00
Konstantin V Shvachko 987d90aa4c HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan.
(cherry picked from commit 8d898ab25f)
2018-03-21 17:17:41 -07:00
Jason Lowe 8f60b50f28 YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles
(cherry picked from commit 5aa7052e31)
2018-03-21 17:23:01 -05:00
Yiqun Lin e65db99799 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri.
(cherry picked from commit 2caba999bb)
2018-03-21 11:41:14 +08:00
Inigo Goiri 981fda128f HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang.
(cherry picked from commit fe224ff972)
2018-03-20 11:21:09 -07:00
weiy 62a819d5ee HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:15:53 -07:00
Inigo Goiri a97fe585b3 HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang.
(cherry picked from commit e65ff1c8be)
2018-03-19 17:21:20 -07:00
Sammi Chen 7985c5fdc9 HADOOP-15262. AliyunOSS: move files under a directory in parallel when rename a directory. Contributed by Jinhu Wu.
(cherry picked from commit d67a5e2dec)
(cherry picked from commit 2285afb32e)
(cherry picked from commit 322520eb76)
2018-03-19 15:44:15 +08:00
Inigo Goiri c6b1125a24 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak.
(cherry picked from commit 08ff1586d5)
2018-03-16 10:30:34 -07:00
Weiwei Yang 7c286fe804 YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang. 2018-03-16 19:11:54 +08:00
Inigo Goiri ba9a656ffa HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri.
(cherry picked from commit e71bc00a47)
2018-03-15 10:35:20 -07:00
Inigo Goiri 6b8a60b62a HDFS-12723. TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Contributed by Ajay Kumar.
(cherry picked from commit 6de135169e)
2018-03-15 10:15:46 -07:00
Wangda Tan 78f103d6e6 Revert "HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu"
Change-Id: I946a466a43d56c73bb0135384e73cb8513595461
(cherry picked from commit 80ee5248b2dda1cb8d122d4f362f2f8cf02b9467)
(cherry picked from commit 252c2b4d52)
2018-03-14 13:40:46 -07:00
Jason Lowe 31eef823f0 MAPREDUCE-7064. Flaky test TestTaskAttempt#testReducerCustomResourceTypes. Contributed by Peter Bacsko
(cherry picked from commit 2626ec35e9)
2018-03-14 15:21:09 -05:00
Inigo Goiri cfa7cc2aa4 HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan.
(cherry picked from commit 41fc7f80be)
2018-03-14 13:15:51 -07:00
Rohith Sharma K S 117984a2cb YARN-8022. ResourceManager UI cluster/app/<app-id> page fails to render. Contributed by Tarun Parimi.
(cherry picked from commit e6de10d0a6)
2018-03-14 22:14:43 +05:30
Sammi Chen e97234f274 HDFS-11600. Refactor TestDFSStripedOutputStreamWithFailure test classes. Contributed by Sammi Chen.
(cherry picked from commit ad1b988a82)
2018-03-14 14:51:51 +08:00
Yiqun Lin a105069729 HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri.
(cherry picked from commit 76be6cbf6c)
2018-03-14 11:31:35 +08:00
Inigo Goiri 95a4665ad5 HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang.
(cherry picked from commit 427fd027a3)
2018-03-13 20:02:06 -07:00