Commit Graph

7971 Commits

Author SHA1 Message Date
crossfire 31a6b45117 HDFS-15709. Socket file descriptor leak in StripedBlockChecksumReconstructor. (#2518)
(cherry picked from commit 40f7543a6d)
(cherry picked from commit edd9b659ca)
2020-12-07 15:50:47 -08:00
Jim Brennan d7c955b646 HDFS-15707. NNTop counts don't add up as expected. (#2516) Contributed by Ahmed Hussein and Daryn Sharp
(cherry picked from commit 6a5864ee4a)
2020-12-07 21:22:15 +00:00
Hui Fei 6e215953e6
HDFS-15240. Erasure Coding: dirty buffer causes reconstruction block error. Contributed by HuangTao. 2020-12-04 17:11:21 +08:00
Ahmed Hussein 91310102d7 HDFS-15703. Don't generate edits for set operations that are no-op (#2508). Contributed by Daryn Sharp and Ahmed Hussein
(cherry picked from commit 60201cbf69)
2020-12-02 21:52:52 +00:00
Ahmed Hussein 6cc0824072 HDFS-15695. NN should not let the balancer run in safemode (#2489). Contributed by Daryn Sharp and Ahmed Hussein
(cherry picked from commit 2b5b556dd7)
2020-12-02 20:31:04 +00:00
Ahmed Hussein 625f85f40f HDFS-15694. Avoid calling UpdateHeartBeatState inside DataNodeDescriptor. (#2487) Contributed by Kuhu Shukla and Ahmed Hussein
(cherry picked from commit 918ba9e82f)
2020-12-01 21:31:18 +00:00
Takanobu Asanuma 3ee0a174dd HDFS-15538. Fix the documentation for dfs.namenode.replication.max-streams in hdfs-default.xml. Contributed by Xieming Li.
(cherry picked from commit f56cd88d7d)
2020-11-13 11:08:57 +09:00
Yizhong Zhang 52c2ce53c2 HADOOP-17142. Fix outdated properties of JournalNode when performing rollback. Contributed by Deegue.
(cherry picked from commit 82de07c794)
(cherry picked from commit 12bfd9194a)
2020-11-10 09:14:25 -08:00
Ayush Saxena ce883fe1bb HDFS-15643. EC: Fix checksum computation in case of native encoders. (#2424). Contributed by Ayush Saxena. 2020-11-04 09:53:28 +05:30
Konstantin V Shvachko 23dcd8edb6 HDFS-15665. Balancer logging improvements. Contributed by Konstantin V Shvachko.
(cherry picked from commit d07dc7afb4)
2020-11-03 12:04:38 -08:00
Ahmed Hussein dedf0d42bc
HDFS-9776. testMultipleAppendsDuringCatchupTailing is flaky (#2410)
Co-authored-by: ahussein <ahmed.hussein@verizonmedia.com>
(cherry picked from commit ae74407ac4)
2020-10-27 20:52:23 +09:00
Ahmed Hussein 244fd5eed2
HDFS-15461. TestDFSClientRetries testGetFileChecksum fails (#2404)
Co-authored-by: ahussein <ahmed.hussein@verizonmedia.com>
(cherry picked from commit afaab3d332)
2020-10-27 17:09:20 +09:00
Hui Fei b32926f110 HDFS-15641. DataNode could meet deadlock if invoke refreshNameNode. Contributed by Hongbing Wang.
(cherry picked from commit 12c908c827)
2020-10-26 22:34:06 +08:00
Wei-Chiu Chuang 87666e2438 HDFS-15644. Failed volumes can cause DNs to stop block reporting. Contributed by Ahmed Hussein.
(cherry picked from commit 74634eb002)
(cherry picked from commit c8eb86ee3d)
2020-10-23 12:06:36 -07:00
Inigo Goiri 7119af2c6d HDFS-15459. TestBlockTokenWithDFSStriped fails intermittently. Contributed by Ahmed Hussein.
(cherry picked from commit e7aa4da0a2)
2020-10-23 09:49:46 -07:00
Kihwal Lee f363c3b315 HDFS-15622. Deleted blocks linger in the replications queue. Contributed by Ahmed Hussein.
(cherry picked from commit da1b6e3cc2)
2020-10-22 19:48:42 -05:00
Kihwal Lee f3b2d85690 HDFS-15618. Improve datanode shutdown latency. Contributed by Ahmed Hussein.
(cherry picked from commit cf932a7e2d)
2020-10-22 14:59:09 -05:00
Kihwal Lee 7e4572e56a HDFS-15627. Log delete audits before collecting blocks.
(cherry picked from commit 740a2c4635)
2020-10-16 11:17:34 -05:00
He Xiaoqiao 3274fd139d
Preparing for 3.2.3 development 2020-10-16 14:52:41 +08:00
Konstantin V Shvachko 23b6ab67f7 HDFS-15567. [SBN Read] HDFS should expose msync() API to allow downstream applications call it explicitly. Contributed by Konstantin V Shvachko.
(cherry picked from commit b3786d6c3c)
2020-10-12 17:42:58 -07:00
Stephen O'Donnell 71d006130e HDFS-15415. Reduce locking in Datanode DirectoryScanner. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-09-28 12:45:28 -07:00
S O'Donnell 5f34e3214e HDFS-15583. Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1. Contributed by Stephen O'Donnell 2020-09-22 10:34:05 +01:00
hemanthboyina aa582ccc2a HDFS-15574. Remove unnecessary sort of block list in DirectoryScanner. Contributed by Stephen O'Donnell. 2020-09-17 10:15:18 +05:30
Ayush Saxena 544d6da3ab HDFS-15117. EC: Add getECTopologyResultForPolicies to DistributedFileSystem. Contributed by Ayush Saxena. (#2261) 2020-09-06 07:56:16 +05:30
Kitti Nanasi 9b8eaa0572 HDFS-14188. Make hdfs ec -verifyClusterSetup command accept an erasure coding policy as a parameter. Contributed by Kitti Nanasi.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 14282e311b)
2020-08-30 10:21:53 +05:30
Kitti Nanasi 3ba40d0ccf HDFS-14125. Use parameterized log format in ECTopologyVerifier. Contributed by Kitti Nanasi.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 5f15a60e32)
2020-08-30 10:21:53 +05:30
Kitti Nanasi 0dbcb81a41 HDFS-14061. Check if the cluster topology supports the EC policy before setting, enabling or adding it. Contributed by Kitti Nanasi.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 951cdd7e4c)
2020-08-30 10:21:53 +05:30
Kitti Nanasi a78430abf4 HDFS-12946. Add a tool to check rack configuration against EC policies. Contributed by Kitti Nanasi.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit dd5e7c6b72)
2020-08-30 10:21:35 +05:30
Uma Maheswara Rao G 0512b27172 HDFS-8631. WebHDFS : Support setQuota. Contributed by Chao Sun. (Backported) 2020-08-26 09:33:51 -07:00
Uma Maheswara Rao G 978ce5a1ee HDFS-15515: mkdirs on fallback should throw IOE out instead of suppressing and returning false (#2205)
* HDFS-15515: mkdirs on fallback should throw IOE out instead of suppressing and returning false

* Used LambdaTestUtils#intercept in test

(cherry picked from commit 99b120a06e)
2020-08-25 12:05:31 -07:00
S O'Donnell a3f12f7f20 HDFS-14852. Removing from LowRedundancyBlocks does not remove the block from all queues. Contributed by Fei Hui.
(cherry picked from commit 6a49bf9bff)
2020-08-25 15:49:54 +01:00
Chen Liang 4ab14692e6 HDFS-15290. NPE in HttpServer during NameNode startup. Contributed by Simbarashe Dzinamarira.
(cherry picked from commit f734455e5d)
2020-08-20 15:26:44 -07:00
Ayush Saxena d6a9ed8140 HDFS-15514. Remove useless dfs.webhdfs.enabled. Contributed by Fei Hui. 2020-08-07 22:23:02 +05:30
Uma Maheswara Rao G cd5efe91d9 HDFS-15478: When Empty mount points, we are assigning fallback link to self. But it should not use full URI for target fs. (#2160). Contributed by Uma Maheswara Rao G.
(cherry picked from commit ac9a07b51a)
2020-07-31 01:39:41 -07:00
Uma Maheswara Rao G 65778cdd47 HDFS-15464: ViewFsOverloadScheme should work when -fs option pointing to remote cluster without mount links (#2132). Contributed by Uma Maheswara Rao G.
(cherry picked from commit 3e70006639)
2020-07-31 01:39:06 -07:00
Uma Maheswara Rao G 1369e41c65 HDFS-15449. Optionally ignore port number in mount-table name when picking from initialized uri. Contributed by Uma Maheswara Rao G.
(cherry picked from commit dc0626b5f2)
2020-07-31 01:38:45 -07:00
Uma Maheswara Rao G 512d1d6d27 HDFS-15450. Fix NN trash emptier to work if ViewFSOveroadScheme enabled. Contributed by Uma Maheswara Rao G.
(cherry picked from commit 55a2ae80dc)
2020-07-31 01:38:18 -07:00
Uma Maheswara Rao G 655b39cc30 HDFS-15430. create should work when parent dir is internalDir and fallback configured. Contributed by Uma Maheswara Rao G.
(cherry picked from commit 1f2a80b5e5)
2020-07-31 01:37:14 -07:00
Ayush Saxena 27a97e4f28 HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein. 2020-07-22 18:39:49 +05:30
Chen Liang 370efc6d95 HDFS-15404. ShellCommandFencer should expose info about source. Contributed by Chen Liang.
(cherry picked from commit 3833c616e0)
2020-07-20 14:07:10 -07:00
Akira Ajisaka 0d949d375e HADOOP-16753. Refactor HAAdmin. Contributed by Xieming Li.
(cherry picked from commit 1defe3a65a)
2020-07-20 13:20:34 -07:00
He Xiaoqiao 6d003f67dd HDFS-14498. LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell. 2020-07-16 23:59:05 +08:00
Ahmed Hussein 8fd3dcc9ce HADOOP-17099. Replace Guava Predicate with Java8+ Predicate
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit 1f71c4ae71)
2020-07-15 12:05:49 -05:00
Ahmed Hussein 43a865dc07 HADOOP-17101. Replace Guava Function with Java8+ Function
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit 98fcffe93f)
2020-07-15 10:18:47 -05:00
Shashikant Banerjee acaee85a69 HDFS-15313. Ensure inodes in active filesytem are not deleted during snapshot delete. Contributed by Shashikant Banerjee.
(cherry picked from commit 82343790ee)
2020-07-15 13:38:29 +01:00
Eric Badger 37032bcaf6 Revert "HDFS-14498 LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell."
This reverts commit edb45cac82.
2020-07-13 21:08:12 +00:00
He Xiaoqiao edb45cac82 HDFS-14498 LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell. 2020-07-13 14:40:21 +08:00
Uma Maheswara Rao G 7607f24c9e HDFS-15394. Add all available fs.viewfs.overload.scheme.target.<scheme>.impl classes in core-default.xml bydefault. Contributed by Uma Maheswara Rao G.
(cherry picked from commit 3ca15292c5)
2020-07-09 16:29:02 -07:00
Shanyu Zhao 8d4028864d HDFS-15451. Do not discard non-initial block report for provided storage. (#2119). Contributed by Shanyu Zhao.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2020-07-07 11:53:29 +08:00
Ayush Saxena 642aafb106 HDFS-15446. CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path. Contributed by Stephen O'Donnell. 2020-07-04 12:25:54 +05:30
Akira Ajisaka 37e0a1208c
HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
(cherry picked from commit c71ce7ac33)
2020-06-28 16:16:49 +09:00
Virajith Jalaparti 704b273ec8 HDFS-15436. Default mount table name used by ViewFileSystem should be configurable (#2100)
* HDFS-15436. Default mount table name used by ViewFileSystem should be configurable

* Replace Constants.CONFIG_VIEWFS_DEFAULT_MOUNT_TABLE use in tests

* Address Uma's comments on PR#2100

* Sort lists in test to match without concern to order

* Address comments, fix checkstyle and fix failing tests

* Fix checkstyle

(cherry picked from commit bed0a3a374)
2020-06-27 16:25:04 -07:00
Uma Maheswara Rao G d030f4b2a6 HDFS-15429. mkdirs should work when parent dir is an internalDir and fallback configured. Contributed by Uma Maheswara Rao G.
(cherry picked from commit d5e1bb6155)
2020-06-27 15:56:10 -07:00
Uma Maheswara Rao G 80111fe5bb HDFS-15427. Merged ListStatus with Fallback target filesystem and InternalDirViewFS. Contributed by Uma Maheswara Rao G.
(cherry picked from commit 7c02d1889b)
2020-06-27 15:55:41 -07:00
Uma Maheswara Rao G 6c22210baa HDFS-15418. ViewFileSystemOverloadScheme should represent mount links as non symlinks. Contributed by Uma Maheswara Rao G.
(cherry picked from commit b27810aa60)
2020-06-27 15:55:11 -07:00
Uma Maheswara Rao G aa8de2f43b HDFS-15387. FSUsage#DF should consider ViewFSOverloadScheme in processPath. Contributed by Uma Maheswara Rao G.
(cherry picked from commit 785b1def95)
(cherry picked from commit 120ee793fc)
2020-06-27 15:53:07 -07:00
Ayush Saxena e80421820a HDFS-15389. DFSAdmin should close filesystem and dfsadmin -setBalancerBandwidth should work with ViewFSOverloadScheme. Contributed by Ayush Saxena
(cherry picked from commit cc671b16f7)
(cherry picked from commit bee2846bee)
2020-06-27 15:52:47 -07:00
Uma Maheswara Rao G e7cead1143 HDFS-15330. Document the ViewFSOverloadScheme details in ViewFS guide. Contributed by Uma Maheswara Rao G.
(cherry picked from commit 76fa0222f0)
(cherry picked from commit 418580446b)
2020-06-27 15:52:18 -07:00
Uma Maheswara Rao G 852ee71354 HDFS-15321. Make DFSAdmin tool to work with ViewFileSystemOverloadScheme. Contributed by Uma Maheswara Rao G.
(cherry picked from commit ed83c865dd)
(cherry picked from commit 0b5e202614)
2020-06-27 15:51:51 -07:00
Uma Maheswara Rao G 84ceb6d520 HDFS-15322. Make NflyFS to work when ViewFsOverloadScheme's scheme and target uris schemes are same. Contributed by Uma Maheswara Rao G.
(cherry picked from commit 4734c77b4b)
(cherry picked from commit 8e71e85af7)
2020-06-27 15:51:28 -07:00
Abhishek Das 7cf9601987 HADOOP-17024. ListStatus on ViewFS root (ls "/") should list the linkFallBack root (configured target root). Contributed by Abhishek Das.
(cherry picked from commit ce4ec74453)
(cherry picked from commit 5b248de42d)
2020-06-27 15:50:41 -07:00
Uma Maheswara Rao G 3dcc9aed4d HDFS-15306. Make mount-table to read from central place ( Let's say from HDFS). Contributed by Uma Maheswara Rao G.
(cherry picked from commit ac4a2e11d9)
(cherry picked from commit 544996c857)
2020-06-27 15:49:48 -07:00
S O'Donnell 240974932b HDFS-15406. Improve the speed of Datanode Block Scan. Contributed by hemanthboyina
(cherry picked from commit 123777823e)
2020-06-18 12:44:42 +01:00
Takanobu Asanuma 695d20615d HDFS-15403. NPE in FileIoProvider#transferToSocketFully. Contributed by hemanthboyina.
(cherry picked from commit f41a144077)
2020-06-15 09:18:22 +09:00
Ayush Saxena 452d801f1b HDFS-15211. EC: File write hangs during close in case of Exception during updatePipeline. Contributed by Ayush Saxena.
*Added missed test file.
2020-06-09 18:48:48 +05:30
Toshihiro Suzuki e5a02a7499 HDFS-15386. ReplicaNotFoundException keeps happening in DN after removing multiple DN's data directories (#2052)
Contributed by Toshihiro Suzuki.

(cherry picked from commit 545a0a147c)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java
2020-06-05 12:26:52 +01:00
Takanobu Asanuma d6de530bbb HDFS-15363. BlockPlacementPolicyWithNodeGroup should validate if it is initialized by NetworkTopologyWithNodeGroup. Contributed by hemanthboyina.
(cherry picked from commit 4d22d1c58f)
2020-05-23 17:31:59 +09:00
Chen Liang 1813d25bf2 HDFS-15293. Relax the condition for accepting a fsimage when receiving a checkpoint. Contributed by Chen Liang 2020-05-18 12:05:47 -07:00
Ayush Saxena b706ac11f7 HDFS-14367. EC: Parameter maxPoolSize in striped reconstruct thread pool isn't affecting number of threads. Contributed by Guo Lei. 2020-05-12 18:44:56 +05:30
Uma Maheswara Rao G 0d0aac1a2a HDFS-15305. Extend ViewFS and provide ViewFileSystemOverloadScheme implementation with scheme configurable. Contributed by Uma Maheswara Rao G.
(cherry picked from commit 9c8236d04d)
2020-05-11 15:29:26 -07:00
Virajith Jalaparti e5e824bd6f HADOOP-15565. Add an inner FS cache to ViewFileSystem, separate from the global cache, to avoid file system leaks. Contributed by Jinglun. 2020-05-11 12:50:14 -07:00
Ayush Saxena c3fffa8451 HDFS-15339. TestHDFSCLI fails for user names with the dot/dash character. Contributed by Yan Xiaole. 2020-05-08 00:57:24 +05:30
Inigo Goiri 53f6d26500 HDFS-14599. HDFS-12487 breaks test TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty. Contributed by He Xiaoqiao.
(cherry picked from commit 4a212242d9)
2020-05-04 18:04:07 -07:00
Konstantin V Shvachko e95a4ddbb1 HDFS-15323. StandbyNode fails transition to active due to insufficient transaction tailing. Contributed by Konstantin V Shvachko.
(cherry picked from commit ebb878bab9)
2020-05-04 10:47:07 -07:00
Ayush Saxena d451c9e2a4 Erasure Coding: metrics xmitsInProgress become to negative. Contributed by maobaolong and Toshihiko Uchida. 2020-05-03 19:17:44 +05:30
Akira Ajisaka 5154f6eef4
HDFS-15286. Concat on a same file deleting the file. Contributed by hemanthboyina.
(cherry picked from commit 5e0eda5d5f)
2020-04-28 06:19:17 +09:00
Mingliang Liu 57c1e7ad9b
HDFS-15297. TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently. Contributed by Ayush Saxena 2020-04-25 15:44:27 -07:00
Dhiraj 6225fce50d
HDFS-15281. Make sure ZKFC uses dfs.namenode.rpc-address to bind to host address (#1964)
Contributed by Dhiraj Hegde.

Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Inigo Goiri <inigoiri@apache.org>
2020-04-25 13:08:32 -07:00
Wei-Chiu Chuang 9e3b4c9ebd HDFS-15295. AvailableSpaceBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance. Contributed by Jinglun.
(cherry picked from commit 453771f170)
(cherry picked from commit d6c48f8100)
2020-04-24 11:54:20 -07:00
Mingliang Liu e154d9d9f7
HDFS-15276. Concat on INodeRefernce fails with illegal state exception. Contributed by hemanthboyina 2020-04-22 13:56:15 -07:00
Inigo Goiri 7d64d44515 HDFS-14004. TestLeaseRecovery2#testCloseWhileRecoverLease fails intermittently in trunk. Contributed by Ayush Saxena.
(cherry picked from commit efdfe679d6)
2020-04-21 09:50:20 -07:00
Stephen O'Donnell 041c93a26c HDFS-15283. Cache pool MAXTTL is not persisted and restored on cluster restart. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 3481895f8a)
(cherry picked from commit aaad947c74)
2020-04-16 20:19:14 -07:00
Eric Badger 17fc8e4a64 Revert "HDFS-14986. ReplicaCachingGetSpaceUsed throws ConcurrentModificationException. Contributed by Aiphago."
This reverts commit 26b51f3e22.
2020-04-02 19:24:42 +00:00
Chen Liang 10fe37b704 HDFS-15191. EOF when reading legacy buffer in BlockTokenIdentifier. Contributed by Steven Rand. 2020-03-27 13:01:00 -07:00
Ayush Saxena 6cd9290401 HDFS-14647. NPE during secure namenode startup. Contributed by Fengnan Li.
(cherry picked from commit 62deab17a3)
2020-03-25 17:12:52 -07:00
Eric Yang ba6b3a3848 HDFS-14434. Ignore user.name query parameter in secure WebHDFS.
Contributed by KWON BYUNGCHANG

(cherry picked from commit d78854b928)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java
2020-03-25 17:12:01 -07:00
Giovanni Matteo Fumarola eca7bc7ac4 HDFS-14006. Refactor name node to allow different token verification implementations. Contributed by CR Hota.
(cherry picked from commit 00d5e631b5)
2020-03-25 17:06:17 -07:00
Ayush Saxena 1e3b0df6ab HDFS-15158. The number of failed volumes mismatch with volumeFailures of Datanode metrics. Contributed by Yang Yun.
(cherry picked from commit 6191d4b4a0)
2020-03-25 16:41:48 -07:00
Yiqun Lin 26b51f3e22 HDFS-14986. ReplicaCachingGetSpaceUsed throws ConcurrentModificationException. Contributed by Aiphago.
(cherry picked from commit 2b452b4e60)
2020-03-25 16:31:42 -07:00
Ayush Saxena 853eafa81a HDFS-15223. FSCK fails if one namenode is not available. Contributed by Ayush Saxena.
(cherry picked from commit bb41ddaf1e)
2020-03-25 16:31:34 -07:00
Wei-Chiu Chuang 1d55e1e229 HDFS-15208. Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs.
Contributed by Wei-Chiu Chuang.

Change-Id: I7abeaf4b65e2a4758356aa69ab8930f7e993077d
(cherry picked from commit 096533c2dc)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/resources/log4j.properties
2020-03-18 09:58:35 -07:00
S O'Donnell b7f33e2e37 HDFS-15216. Wrong Use Case of -showprogress in fsck. Contributed by Ravuri Sushma sree.
(cherry picked from commit 25497799cb)
2020-03-13 15:34:20 +00:00
Surendra Singh Lilhore 269aa25a73 HDFS-14442. Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId. Contributed by Ravuri Sushma sree. 2020-03-12 19:10:27 +05:30
Surendra Singh Lilhore 57f887a529 HDFS-15135. EC : ArrayIndexOutOfBoundsException in BlockRecoveryWorker#RecoveryTaskStriped. Contributed by Ravuri Sushma sree. 2020-03-10 23:56:42 +05:30
Inigo Goiri 1d89ba72f6 HDFS-15204. TestRetryCacheWithHA testRemoveCacheDescriptor fails intermittently. Contributed by Ahmed Hussein.
(cherry picked from commit 1d4d0fcbe1)
2020-03-04 10:04:22 -08:00
Akshay Nehe 369f4f9c58
HADOOP-16899. Update HdfsDesign.md to reduce ambiguity. (#1871)
(cherry picked from commit bbd704bb82)
2020-03-04 11:12:00 +09:00
Surendra Singh Lilhore d33aec93f1 HDFS-15199. NPE in BlockSender. Contributed by Ayush Saxena. 2020-02-28 18:43:57 +05:30
Masatake Iwasaki e1ff3b2f97 HDFS-15068. DataNode could meet deadlock if invoke refreshVolumes when register. Contributed by Aiphago.
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 037ec8cfb1)
2020-02-27 16:36:46 -08:00
Konstantin V Shvachko c82e20f9f8 HDFS-14731. [FGL] Remove redundant locking on NameNode. Contributed by Konstantin V Shvachko.
(cherry picked from commit ecbcb058b8)
2020-02-27 15:29:31 -08:00
Kihwal Lee 27cfda708e HDFS-15147. LazyPersistTestCase wait logic is error-prone. Contributed
by Ahmed Hussein.
2020-02-27 09:17:44 -06:00