Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
15,511 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

5045 Commits

Author SHA1 Message Date
Wei-Chiu Chuang 90ebbaa393 HDFS-13174. hdfs mover -p /path times out after 20 min. Contributed by Istvan Fajth. 
(cherry picked from commit c966a3837a)
(cherry picked from commit 975d4b3d60)
 2020-10-24 13:38:58 -07:00
Konstantin V Shvachko 104dd85ad8 HDFS-15567. [SBN Read] HDFS should expose msync() API to allow downstream applications call it explicitly. Contributed by Konstantin V Shvachko. 
(cherry picked from commit b3786d6c3c)
 2020-10-12 18:02:05 -07:00
Masatake Iwasaki 7b0dbcb657 Publishing the bits for release 2.10.1 (addendum) 2020-09-22 11:51:53 +09:00
Masatake Iwasaki f4e0c14fe9 Preparing for 2.10.2 development 2020-09-13 14:33:36 +09:00
Jitendra Pandey 43c6c54b8c HADOOP-14910. Upgrade netty-all jar to latest 4.0.x.Final. Contributed by Vinayakumar B. 
(cherry picked from commit f29e55bf5e)
 2020-09-08 22:35:01 +09:00
Chen Liang 2b6b5476ba HDFS-15290. NPE in HttpServer during NameNode startup. Contributed by Simbarashe Dzinamarira. 
(cherry picked from commit f734455e5d)
 2020-08-28 17:48:38 -07:00
S O'Donnell a1fe3eed9b HDFS-15313. Ensure inodes in active filesytem are not deleted during snapshot delete. Contributed by Shashikant Banerjee. 2020-07-30 15:48:15 +01:00
Chen Liang 3044a13080 HDFS-15404. ShellCommandFencer should expose info about source. Contributed by Chen Liang. 
(cherry picked from commit 3833c616e0)
(cherry picked from commit 370efc6d95)
(cherry picked from commit 1e33696bc8)
 2020-07-20 15:26:44 -07:00
Akira Ajisaka e53186954d HADOOP-16753. Refactor HAAdmin. Contributed by Xieming Li. 
(cherry picked from commit 1defe3a65a)
(cherry picked from commit 0d949d375e)
(cherry picked from commit 635067d03d)
 2020-07-20 13:39:00 -07:00
He Xiaoqiao 685b81f447 HDFS-14498. LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell. 2020-07-17 00:17:17 +08:00
He Xiaoqiao b2c44db79e Revert "HDFS-14498 LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell." 
This reverts commit 3ebd783dc7.
 2020-07-13 23:57:11 +08:00
He Xiaoqiao 3ebd783dc7 HDFS-14498 LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell. 2020-07-13 14:45:09 +08:00
Yiqun Lin c63068be5f HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin. 
(cherry picked from commit 2e43c28e01)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
 2020-07-10 15:16:51 +09:00
Akira Ajisaka fb694e87a6
HDFS-15421. IBR leak causes standby NN to be stuck in safe mode. 
(cherry picked from commit c71ce7ac33)
 2020-06-28 17:23:27 +09:00
Kihwal Lee 17109758dd HDFS-12453. TestDataNodeHotSwapVolumes fails in trunk Jenkins runs. Contributed by Jim Brennan and Lei Xu. 2020-06-12 16:19:36 -05:00
Toshihiro Suzuki d1f4c8f10f
HDFS-15386. ReplicaNotFoundException keeps happening in DN after removing multiple DN's data directories (#2054) 
Contributed by Toshihiro Suzuki.
 2020-06-09 21:44:27 +01:00
Inigo Goiri b411fcee86 HDFS-14054. TestLeaseRecovery2: testHardLeaseRecoveryAfterNameNodeRestart2 and testHardLeaseRecoveryWithRenameAfterNameNodeRestart are flaky. Contributed by Zsolt Venczel. 
(cherry picked from commit 993c2140cc)
 2020-06-03 14:16:38 -07:00
Kihwal Lee 54c7d23e58 HDFS-14931. hdfs crypto commands limit column width. Contributed by Eric Badger 
(cherry picked from commit 9ef6ed9c1c)
 2020-06-02 09:52:06 -05:00
cnauroth 73ae3cee85 HDFS-9376. TestSeveralNameNodes fails occasionally. Contributed by Masatake Iwasaki. 
(cherry picked from commit 84a8147791)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2020-05-20 08:22:47 +09:00
Chen Liang d0504cf74d HDFS-15293. Relax the condition for accepting a fsimage when receiving a checkpoint. Contributed by Chen Liang 2020-05-18 12:10:05 -07:00
Yiqun Lin e6374f031a HDFS-15264. Backport Datanode detection to branch-2.10. Contributed by Lisheng Sun. 2020-05-17 11:59:10 +08:00
Inigo Goiri b5eb08a0d9 HDFS-15038. TestFsck testFsckListCorruptSnapshotFiles is failing in trunk. Contributed by hemanthboyina. 2020-05-14 11:26:31 -07:00
Konstantin V Shvachko 4aac3406f6 HDFS-15323. StandbyNode fails transition to active due to insufficient transaction tailing. Contributed by Konstantin V Shvachko. 
(cherry picked from commit ebb878bab9)
 2020-05-04 10:57:32 -07:00
Chen Liang 4cf7bbf043 HDFS-14647. NPE during secure namenode startup. Contributed by Fengnan Li. 2020-05-01 11:40:37 -07:00
Akira Ajisaka b22fb90350
HDFS-15302. Backport HDFS-15286 to branch-2.x. Contributed by hemanthboyina. 2020-05-01 15:11:08 +09:00
Kihwal Lee be6070081d HDFS-10499. TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently. Contributed by Yiqun Lin and Ahmed Hussein. 2020-04-30 16:29:40 -05:00
Mingliang Liu 18f5997b95
HDFS-15297. TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently. Contributed by Ayush Saxena 2020-04-25 15:50:00 -07:00
Dhiraj 23b15089ad
HDFS-15281. Make sure ZKFC uses dfs.namenode.rpc-address to bind to host address (#1964) 
Contributed by Dhiraj Hegde.

Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Inigo Goiri <inigoiri@apache.org>
 2020-04-25 13:54:26 -07:00
Mingliang Liu 4ebe78496f
HDFS-15276. Concat on INodeRefernce fails with illegal state exception. Contributed by hemanthboyina 2020-04-22 14:53:15 -07:00
Stephen O'Donnell 9ec141c77f HDFS-15283. Cache pool MAXTTL is not persisted and restored on cluster restart. Contributed by Stephen O'Donnell. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 3481895f8a)
(cherry picked from commit aaad947c74)
(cherry picked from commit 041c93a26c)
(cherry picked from commit 0ea8f3a19c)
 2020-04-16 20:19:38 -07:00
Chen Liang 70c2a2992f HDFS-15036. Active NameNode should not silently fail the image transfer. Contributed by Chen Liang. 2020-04-16 11:24:22 -07:00
Masatake Iwasaki 00b313d6ff HDFS-15048. Fix findbug in DirectoryScanner. Contributed by Sean Chow. 2020-04-13 16:00:50 +09:00
Masatake Iwasaki 01ed6832f4 HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow. 2020-04-13 16:00:50 +09:00
Inigo Goiri 4069d5d438 HDFS-11396. TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out. Contributed by Ayush Saxena 2020-03-13 15:39:25 -07:00
Masatake Iwasaki 40c755d809 HDFS-15077. Fix intermittent failure of TestDFSClientRetries#testLeaseRenewSocketTimeout. 2020-03-12 12:49:38 +09:00
Inigo Goiri d547630804 HDFS-15204. TestRetryCacheWithHA testRemoveCacheDescriptor fails intermittently. Contributed by Ahmed Hussein. 2020-03-04 10:07:08 -08:00
Wei-Chiu Chuang 024c33384b Revert "HDFS-15111. stopStandbyServices() should log which service state it is transitioning from. Contributed by Xieming Li." 
This reverts commit cb6b6b4320.
 2020-03-02 15:43:13 -08:00
Ayush Saxena cb6b6b4320 HDFS-15111. stopStandbyServices() should log which service state it is transitioning from. Contributed by Xieming Li. 
(cherry picked from commit b182dd809c)
(cherry picked from commit 7bfa123d58)
 2020-03-02 15:39:21 -08:00
Kihwal Lee 232e9f8ee1 HDFS-15147. LazyPersistTestCase wait logic is error-prone. Contributed 
by Ahmed Hussein.
 2020-02-27 09:58:44 -06:00
Ayush Saxena a5c3620bc2 HDFS-15166. Remove redundant field fStream in ByteStringLog. Contributed by Xieming Li. 2020-02-24 20:18:10 +05:30
Konstantin V Shvachko 9c2c14f36d HDFS-15185. StartupProgress reports edits segments until the entire startup completes. Contributed by Konstantin V Shvachko. 
(cherry picked from commit 6f84269bcd)
 2020-02-21 11:02:04 -08:00
Masatake Iwasaki 3fc1c44974 HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem object creation. (#1758) 
(cherry picked from commit 2338d25dc7)

 Conflicts:
        hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java

(cherry picked from commit 610805ec72)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
 2020-02-21 14:27:26 +09:00
Ayush Saxena ce06503599 HDFS-15115. Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug. Contributed by wangzhixiang 2020-02-19 20:56:08 +05:30
Hanisha Koneru 73ab4a42a6
HDFS-10659. Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory. Contributed by star, Hanisha Koneru. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 7217494f40)
 2020-02-19 18:33:10 +09:00
Kihwal Lee 38e97c2061 HDFS-12459. Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 3ead525c71)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
 2020-02-17 15:49:48 -06:00
Kihwal Lee e847768c3f Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang." 
This reverts commit d4ca1c5226.

-JsonUtil not reverted. A later commit in httpfs uses the new methods.
-jackson databind was introduced in pom.xml. This is not reverted as
later changes are using it.
 2020-02-17 15:06:00 -06:00
Ayush Saxena 9e34e6a6e8 HDFS-15164. Fix TestDelegationTokensWithHA. Contributed by Ayush Saxena. 2020-02-14 22:08:05 +05:30
Kihwal Lee 2861936228 HDFS-14758. Make lease hard limit configurable and reduce the default. 
Contributed by hemanthboyina.

(cherry picked from commit 9b8a78d97b)
(cherry picked from commit f1840669cf)
(cherry picked from commit bf09bfa2db)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/impl/DfsClientConf.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/LeaseManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2020-02-11 15:31:01 -06:00
Chen Liang b97fdb7b4c HDFS-15148. dfs.namenode.send.qop.enabled should not apply to primary NN port. Contributed by Chen Liang. 2020-02-04 12:59:31 -08:00
Kihwal Lee fb8ee3228e HDFS-12491. Support wildcard in CLASSPATH for libhdfs. Contributed by Muhammad Samir Khan. 
(cherry picked from commit 10a60fbe20)
 2020-02-04 12:38:05 -06:00
Wei-Chiu Chuang 1d0e2ba335 HDFS-15046. Backport HDFS-7060 to branch-2.10. Contributed by Lisheng Sun. 2020-01-31 16:16:31 -08:00
Inigo Goiri 9f7820e729 HDFS-13179. TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently. Contributed by Ahmed Hussein. 2020-01-31 11:37:07 -08:00
Chen Liang 29572686c4 HDFS-15118. [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster. Contributed by Chen Liang 2020-01-29 12:44:12 -08:00
Kihwal Lee d9198b2d1b HDFS-15146. TestBalancerRPCDelay.testBalancerRPCDelay fails 
intermittently. Contributed by Ahmed Hussein.
 2020-01-29 11:07:50 -06:00
Kihwal Lee 0ead38b59a HDFS-14968. Add ability to log stale datanodes. Contributed by Ahmed Hussein. 
(cherry picked from commit bd03053ea2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/HeartbeatManager.java

(cherry picked from commit 4842708320)
 2020-01-22 09:30:41 -06:00
Kihwal Lee c5d43b65a9 HDFS-15125. Pull back HDFS-11353, HDFS-13993, HDFS-13945, and HDFS-14324 
to branch-2.10. Contributed by Jim Brennan.
 2020-01-21 09:59:14 -06:00
Wei-Chiu Chuang d5f7aa2285 HDFS-13339. Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume. Contributed by Jim Brennan, Zsolt Venczel. 
(cherry picked from commit c675719c3f)
 2020-01-15 11:06:15 -08:00
Chen Liang 6deb6be252 HDFS-15099. [SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException for ObserverNode. Contributed by Chen Liang. 
(cherry picked from commit 26a969ec73)
 2020-01-10 17:19:59 -08:00
Takanobu Asanuma 01a29f12c0 HDFS-14934. [SBN Read] Standby NN throws many InterruptedExceptions when dfs.ha.tail-edits.period is 0. Contributed by Ayush Saxena. 
(cherry picked from commit dc32f583af)
 2019-12-28 22:24:28 +09:00
Konstantin V Shvachko 199c7cc62c HDFS-15076. Fix tests that hold FSDirectory lock, without holding FSNamesystem lock. Contributed by Konstantin V Shvachko. 
(cherry picked from commit b98ac2a3af)
 2019-12-24 12:48:10 -08:00
Shashikant Banerjee abbf2a4446 HDFS-15012. NN fails to parse Edit logs after applying HDFS-13101. Contributed by Shashikant Banerjee. 
(cherry picked from commit fdd96e46d1)
 2019-12-18 23:30:34 +05:30
Ayush Saxena 0927041589 HDFS-14519. NameQuota is not update after concat operation, so namequota is wrong. Contributed by Ranith Sardar. 2019-12-17 21:55:58 +05:30
Erik Krogen a22698fa52 HDFS-15032. Properly handle InvocationTargetExceptions in the proxy created by ProxyCombiner. This fixes a bug encountered by the HDFS balancer when used with Observer Nodes. Contributed by Erik Krogen. 
(cherry picked from c174d50b30)
(cherry picked from 3402c87353)
(cherry picked from b06965ae32)
 2019-12-11 09:41:40 -08:00
Jonathan Hung d74f64aa99 Setting version to 2.10.1-SNAPSHOT after branch-2 to branch-2.10 rename 2019-12-09 11:49:59 -08:00
Chao Sun 9a385e00a4 HDFS-15017. Remove redundant import of AtomicBoolean in NameNodeConnector. Contributed by Chao Sun. 2019-12-07 13:45:17 -08:00
Chao Sun c6ce4011d7 HDFS-15005. Backport HDFS-12300 to branch-2. Contributed by Chao Sun. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-12-06 15:25:30 -08:00
Yiqun Lin fc2cdb6cca HDFS-14986. ReplicaCachingGetSpaceUsed throws ConcurrentModificationException. Contributed by Aiphago. 
(cherry picked from commit 2b452b4e60)
 2019-11-28 10:45:25 +08:00
Erik Krogen 403892264b HDFS-14973. More strictly enforce Balancer/Mover/SPS throttling of getBlocks RPCs to NameNodes. Contributed by Erik Krogen. 
(cherry picked from b2cc8b6b4a)
(cherry picked from 60655bfe54)
(cherry picked from 17779adb32)
 2019-11-26 16:46:38 -08:00
He Xiaoqiao ae7469cb67 HDFS-14952. Skip safemode if blockTotal is 0 in new NN. Contributed by Xiaoqiao He. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Mukul Kumar Singh <msingh@apache.org>
(cherry picked from commit 0b50aa29fd)
(cherry picked from commit 1d383436f09f8e490171c8f6af4605971ad2f904)
(cherry picked from commit 7909c5df572a5cbc729ebc6c7c6e59f17803d50f)
 2019-11-19 12:23:01 -08:00
Chen Liang 238781ab98 HDFS-14991. Backport better time precision of configuration#getTimeDuration to branch-2 to support SBN read. Contributed by Chen Liang. 2019-11-18 20:26:27 -08:00
Erik Krogen 792e2aecb3 HDFS-14979 Allow Balancer to submit getBlocks calls to Observer Nodes when possible. Contributed by Erik Krogen. 
(cherry picked from 586defe711)
(cherry picked from dec765b329)
(cherry picked from 5cf36aa2b1)
 2019-11-15 07:40:20 -08:00
Mukul Kumar Singh 594307fe21 HDFS-14884. Add sanity check that zone key equals feinfo key while setting Xattrs. Contributed by Yuval Degani, Mukul Kumar Singh. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: Yuval Degani <ydegani@linkedin.com>
 2019-11-14 20:50:51 -08:00
Ayush Saxena d1b91ede4c HDFS-14958. TestBalancerWithNodeGroup is not using NetworkTopologyWithNodeGroup. Contributed by Jim Brennan. 2019-11-07 22:32:13 +05:30
Chen Liang 92c9b1de5b HDFS-14806. Bootstrap standby may fail if with in-progress tailing. Contributed by Chen Liang and Erik Krogen. 2019-11-06 16:23:51 -08:00
Chen Liang db887f66d8 HDFS-14941. Potential editlog race condition can cause corrupted file. Contributed by Chen Liang and Konstantin Shvachko. 2019-11-06 15:47:57 -08:00
Duo Zhang e649b30b32 HADOOP-16598. Backport "HADOOP-16558 [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes" to all active branches 
Reapply but this time with proper patch.

Signed-off-by: stack <stack@apache.org>
 2019-11-01 09:22:23 -07:00
stack e880347d53 Revert "HADOOP-16598. Backport "HADOOP-16558 [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes" to all active branches" 
Wrong patch applied; missed jdk7 handling

This reverts commit a36dbe6f35.
 2019-11-01 09:21:33 -07:00
Duo Zhang a36dbe6f35 HADOOP-16598. Backport "HADOOP-16558 [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes" to all active branches 
Signed-off-by: stack <stack@apache.org>
 2019-10-30 22:33:51 -07:00
Jonathan Hung 915b795358 Make upstream aware of 2.10.0 release 
(cherry picked from commit 7663db59c097c82eeed2df7a91168a4d7123c96b)
(cherry picked from commit 5d2ffcc7aa)
(cherry picked from commit 4d274f60bc)
 2019-10-30 21:01:40 -07:00
Wei-Chiu Chuang a805d80ebe HDFS-13901. INode access time is ignored because of race between open and rename. Contributed by Jinglun. 2019-10-22 16:43:25 -07:00
Kihwal Lee b634bd225b HDFS-12749. DN may not send block report to NN after NN restart. Contributed by Xiaoqiao He. 
(cherry picked from commit c4e27ef773)
 2019-10-21 16:36:42 -05:00
Jonathan Hung 108127238b Preparing for 2.11.0 development 2019-10-15 10:01:45 -07:00
Chen Liang 6566402a1b HDFS-14509. DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x. Contributed by Yuxuan Wang and Konstantin Shvachko. 2019-10-10 13:29:30 -07:00
Erik Krogen 200c52f78b HDFS-14245. [SBN read] Enable ObserverReadProxyProvider to work with non-ClientProtocol proxy types. Contributed by Erik Krogen. 
(cherry picked from 5847e00143)
(cherry picked from 6630c9b75d)
(cherry picked from 9fdb849e03)
 2019-10-10 09:09:50 -07:00
Erik Krogen 8337d1a489 HDFS-14162. [SBN read] Allow Balancer to work with Observer node. Add a new ProxyCombiner allowing for multiple related protocols to be combined. Allow AlignmentContext to be passed in NameNodeProxyFactory. Contributed by Erik Krogen. 2019-10-10 09:07:18 -07:00
Ayush Saxena ca777db3ca HDFS-14655. [SBN Read] Namenode crashes if one of The JN is down. Contributed by Ayush Saxena. 2019-10-08 13:30:30 +05:30
Shweta Yakkali 56e2ad2dce HDFS-14262. [SBN read] Make Log.WARN message in GlobalStateIdContext more informative. Contributed by Shweta Yakkali. 2019-10-03 16:43:27 -07:00
Ayush Saxena a3b9b955be HDFS-14660. [SBN Read] ObserverNameNode should throw StandbyException for requests not from ObserverProxyProvider. Contributed by Chao Sun. 2019-10-03 16:36:50 -07:00
Shweta Yakkali c87b1f6f5b HDFS-14494. Move Server logging of StatedId inside receiveRequestState(). Contributed by Shweta Yakkali. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-10-03 16:25:31 -07:00
Chen Liang 72b37e8833 HDFS-12979. StandbyNode should upload FsImage to ObserverNode after checkpointing. Contributed by Chen Liang. 2019-10-03 12:23:25 -07:00
Chen Liang ed8f1ae602 HDFS-14858. [SBN read] Allow configurably enable/disable AlignmentContext on NameNode. Contributed by Chen Liang. 2019-10-02 16:51:59 -07:00
Konstantin V Shvachko dc2b838a8e HDFS-14305. Fix serial number calculation in BlockTokenSecretManager to avoid token key ID overlap between NameNodes. Contributed by Konstantin V Shvachko. 2019-09-30 18:04:16 -07:00
Masatake Iwasaki 9482da7053 HADOOP-16544. update io.netty in branch-2. 
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
 2019-10-01 05:24:32 +09:00
Ayush Saxena 66e60942e9 HDFS-14853. Addendum: NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is not present. Contributed by Ranith Sardar. 2019-09-28 09:14:50 +05:30
Ayush Saxena 40becd37d0 HDFS-14853. NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is not present. Contributed by Ranith Sardar. 2019-09-28 08:30:55 +05:30
Chen Liang dc72b2e65a HDFS-14822. [SBN read] Revisit GlobalStateIdContext locking when getting server state id. Contributed by Chen Liang. 2019-09-18 17:22:49 -07:00
Kihwal Lee d4038e7a39 HDFS-13959. TestUpgradeDomainBlockPlacementPolicy is flaky. Contributed by Ayush Saxena. 
(cherry picked from commit 1851d06eb3)
 2019-09-18 16:51:21 -05:00
He Xiaoqiao 6fe8261fa0 HDFS-14771. Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index). Contributed by He Xiaoqiao and Stephen O'Donnel. 
Reviewed-by: Stephen O'Donnell <sodonnell@cloudera.com>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-09-17 09:34:54 -07:00
Ayush Saxena b9e832bf73 HDFS-14303. Addendum: check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu. 2019-09-14 10:30:46 +05:30
Xiaoyu Yao c44e53e7a3
HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun. 
(cherry picked from commit 62d71fbac3789c7d484bc76ced9ec7fa6ff94de1)
 2019-09-05 16:24:17 -07:00