Stephen O'Donnell
|
900430b990
|
HDFS-14861. Reset LowRedundancyBlocks Iterator periodically. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2020-02-25 13:28:50 -08:00 |
Wei-Chiu Chuang
|
1c5d2f1fdc
|
HDFS-15174. Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations. Contributed by Lisheng Sun.
|
2020-02-24 13:39:16 -08:00 |
Ayush Saxena
|
7f8685f476
|
HDFS-15187. CORRUPT replica mismatch between namenodes after failover. Contributed by Ayush Saxena.
|
2020-02-24 20:38:04 +05:30 |
|
Ayush Saxena
|
93b8f453b9
|
HDFS-15166. Remove redundant field fStream in ByteStringLog. Contributed by Xieming Li.
|
2020-02-24 20:17:01 +05:30 |
|
Ayush Saxena
|
b5698e0c33
|
HDFS-15176. Enable GcTimePercentage Metric in NameNode's JvmMetrics. Contributed by Jinglun.
|
2020-02-24 00:07:18 +05:30 |
|
Ayush Saxena
|
9eb7a8bdf8
|
HDFS-15041. Make MAX_LOCK_HOLD_MS and full queue size configurable. Contributed by zhuqi.
|
2020-02-23 14:25:39 +05:30 |
|
Ayush Saxena
|
ba9025c7cd
|
HDFS-15182. TestBlockManager#testOneOfTwoRacksDecommissioned() fail in trunk. Contributed by Lisheng Sun.
|
2020-02-22 14:27:26 +05:30 |
Konstantin V Shvachko
|
ecbcb058b8
|
HDFS-14731. [FGL] Remove redundant locking on NameNode. Contributed by Konstantin V Shvachko.
|
2020-02-21 17:53:37 -08:00 |
Inigo Goiri
|
ed70c115a8
|
HDFS-15172. Remove unnecessary deadNodeDetectInterval in DeadNodeDetector#checkDeadNodes(). Contributed by Lisheng Sun.
|
2020-02-21 16:36:30 -08:00 |
|
Konstantin V Shvachko
|
6f84269bcd
|
HDFS-15185. StartupProgress reports edits segments until the entire startup completes. Contributed by Konstantin V Shvachko.
|
2020-02-21 10:51:14 -08:00 |
Masatake Iwasaki
|
2338d25dc7
|
HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem object creation. (#1758)
|
2020-02-21 11:56:07 +09:00 |
|
Inigo Goiri
|
ec7507162c
|
HDFS-15165. In Du missed calling getAttributesProvider. Contributed by Bharat Viswanadham.
|
2020-02-19 11:33:58 -08:00 |
|
Ayush Saxena
|
ac4b556e2d
|
HDFS-13739. Add option to disable rack local write preference. Contributed by Ayush Saxena.
|
2020-02-19 08:20:59 +05:30 |
|
Ayush Saxena
|
84f7638840
|
HADOOP-13666. Supporting rack exclusion in countNumOfAvailableNodes in NetworkTopology. Contributed by Inigo Goiri.
|
2020-02-18 00:43:33 +05:30 |
xiaoxiaopan118
|
439d935e1d
|
HDFS-15173. RBF: Delete repeated configuration 'dfs.federation.router.metrics.enable' (#1849)
|
2020-02-17 15:55:10 +09:00 |
Surendra Singh Lilhore
|
810783d443
|
HDFS-15135. EC : ArrayIndexOutOfBoundsException in BlockRecoveryWorker#RecoveryTaskStriped. Contributed by Ravuri Sushma sree.
|
2020-02-16 12:15:03 +05:30 |
|
Ayush Saxena
|
c75756fe13
|
HDFS-15164. Fix TestDelegationTokensWithHA. Contributed by Ayush Saxena.
|
2020-02-14 22:07:24 +05:30 |
|
Surendra Singh Lilhore
|
a98352ced1
|
HDFS-15086. Block scheduled counter never get decremet if the block got deleted before replication. Contributed by hemanthboyina.
|
2020-02-13 16:57:41 +05:30 |
Akira Ajisaka
|
0ddb5f0881
|
HDFS-13989. RBF: Add FSCK to the Router (#1832)
Co-authored-by: Inigo Goiri <inigoiri@apache.org>
|
2020-02-13 10:06:07 +09:00 |
|
Ayush Saxena
|
f09710bbb8
|
HDFS-15161. When evictableMmapped or evictable size is zero, do not throw NoSuchElementException in ShortCircuitCache#close(). Contributed by Lisheng Sun
|
2020-02-12 20:29:35 +05:30 |
|
Ayush Saxena
|
3df0adaaea
|
HDFS-15127. RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points. Contributed by Inigo Goiri
|
2020-02-12 19:41:04 +05:30 |
Kihwal Lee
|
9b8a78d97b
|
HDFS-14758. Make lease hard limit configurable and reduce the default.
Contributed by hemanthboyina.
|
2020-02-11 12:40:00 -06:00 |
|
Stephen O'Donnell
|
d7c136b9ed
|
HDFS-15150. Introduce read write lock to Datanode. Contributed Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2020-02-11 08:00:15 -08:00 |
|
Ayush Saxena
|
6191d4b4a0
|
HDFS-15158. The number of failed volumes mismatch with volumeFailures of Datanode metrics. Contributed by Yang Yun.
|
2020-02-09 23:32:22 +05:30 |
|
Ayush Saxena
|
d23317b102
|
HDFS-15115. Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug. Contributed by wangzhixiang
|
2020-02-08 10:33:57 +05:30 |
Vinayakumar B
|
7dac7e1d13
|
HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency (#1635). Contributed by Vinayakumar B.
|
2020-02-07 14:51:24 +05:30 |
Chen Liang
|
ce7b8b5634
|
HDFS-15148. dfs.namenode.send.qop.enabled should not apply to primary NN port. Contributed by Chen Liang.
|
2020-02-04 12:12:35 -08:00 |
|
Kihwal Lee
|
10a60fbe20
|
HDFS-12491. Support wildcard in CLASSPATH for libhdfs. Contributed by Muhammad Samir Khan.
|
2020-02-04 12:22:35 -06:00 |
|
Stephen O'Donnell
|
1e3a0b0d93
|
HDFS-7175. Client-side SocketTimeoutException during Fsck. Contributed by Stephen O'Donnell, Akira Ajisaka.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: Akira Ajisaka <aajisaka@apache.org>
|
2020-01-31 16:13:02 -08:00 |
|
Kihwal Lee
|
799d4c1cf4
|
HDFS-15146. TestBalancerRPCDelay.testBalancerRPCDelay fails
intermittently. Contributed by Ahmed Hussein.
|
2020-01-29 11:00:27 -06:00 |
|
Chen Liang
|
483397c7f7
|
[SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster. Conntributed by Chen Liang
|
2020-01-28 15:20:36 -08:00 |
|
Chen Liang
|
3e86807802
|
Revert "[SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster. Contributed by Chen Liang."
This reverts commit ff8ff0f7e5.
|
2020-01-28 15:19:47 -08:00 |
|
Chen Liang
|
ff8ff0f7e5
|
[SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster. Contributed by Chen Liang.
|
2020-01-28 15:14:58 -08:00 |
|
Inigo Goiri
|
1839c467f6
|
HDFS-13179. TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently. Contributed by Ahmed Hussein.
|
2020-01-28 10:10:35 -08:00 |
|
Inigo Goiri
|
061421fc6d
|
HDFS-15145. HttpFS: getAclStatus() returns permission as null. Contributed by hemanthboyina.
|
2020-01-28 10:04:38 -08:00 |
|
Ayush Saxena
|
87c198468b
|
HDFS-14993. checkDiskError doesn't work during datanode startup. Contributed by Yang Yun.
|
2020-01-28 23:09:38 +05:30 |
|
Ayush Saxena
|
f876dc228b
|
HDFS-15143. LocatedStripedBlock returns wrong block type. Contributed by Ayush Saxena.
|
2020-01-28 19:34:21 +05:30 |
|
Ayush Saxena
|
6d008c0d39
|
HDFS-15128. Unit test failing to clean testing data and crashed future Maven test run due to failure in TestDataNodeVolumeFailureToleration. Contributed by Ctest
|
2020-01-25 11:47:29 +05:30 |
|
Kihwal Lee
|
d10f77e3c9
|
HDFS-15119. Allow expiration of cached locations in DFSInputStream.
Contributed by Ahmed Hussein.
|
2020-01-24 09:15:27 -06:00 |
|
Ayush Saxena
|
92c58901d7
|
HDFS-15117. EC: Add getECTopologyResultForPolicies to DistributedFileSystem. Contributed by Ayush Saxena
|
2020-01-23 18:18:34 +05:30 |
|
Kihwal Lee
|
bd03053ea2
|
HDFS-14968. Add ability to log stale datanodes. Contributed by Ahmed Hussein.
|
2020-01-22 09:14:38 -06:00 |
|
Inigo Goiri
|
8cfc3673dc
|
HDFS-15092. TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock sometimes fails. Contributed by Fei Hui.
|
2020-01-21 13:29:20 -08:00 |
|
Inigo Goiri
|
b657822b98
|
HDFS-15126. TestDatanodeRegistration#testForcedRegistration fails intermittently. Contributed by Ahmed Hussein.
|
2020-01-21 13:22:53 -08:00 |
|
Akira Ajisaka
|
f6d20daf40
|
HADOOP-16808. Use forkCount and reuseForks parameters instead of forkMode in the config of maven surefire plugin. Contributed by Xieming Li.
|
2020-01-21 18:03:24 +09:00 |
|
Akira Ajisaka
|
1defe3a65a
|
HADOOP-16753. Refactor HAAdmin. Contributed by Xieming Li.
|
2020-01-21 10:58:32 +09:00 |
|
Inigo Goiri
|
263413e838
|
HDFS-15112. RBF: Do not return FileNotFoundException when a subcluster is unavailable.
|
2020-01-16 10:39:14 -08:00 |
|
Vinayakumar B
|
edbbc03ce7
|
HADOOP-16621. [pb-upgrade] Remove Protobuf classes from signatures of Public APIs. Contributed by Vinayakumar B. (#1803)
|
2020-01-16 23:27:50 +05:30 |
Chao Sun
|
d7c4f8ab21
|
HDFS-13616. Batch listing of multiple directories (#1725)
|
2020-01-15 17:22:47 -08:00 |
|
Wei-Chiu Chuang
|
6b86a5110e
|
HDFS-15097. Purge log in KMS and HttpFS. Contributed by Doris Gu.
|
2020-01-13 10:48:53 -08:00 |
|
Vinayakumar B
|
52b360a928
|
HADOOP-16797. Add Dockerfile for ARM builds. Contributed by Vinayakumar B. (#1801)
|
2020-01-13 10:40:29 +05:30 |
|
Ayush Saxena
|
cebce0a348
|
HDFS-14578. AvailableSpaceBlockPlacementPolicy always prefers local node. Contributed by Ayush Saxena.
|
2020-01-11 10:29:11 +05:30 |
|
Ayush Saxena
|
7b62409ace
|
HDFS-15108. RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update. Contributed by Ayush Saxena.
|
2020-01-11 10:21:31 +05:30 |
|
Chen Liang
|
26a969ec73
|
HDFS-15099. [SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException for ObserverNode. Contributed by Chen Liang.
|
2020-01-10 17:06:59 -08:00 |
|
Kihwal Lee
|
5fb901ac40
|
HDFS-15095. Fix TestDecommissioningStatus. Contributed by Ahmed Hussein.
|
2020-01-10 12:43:21 -06:00 |
Takanobu Asanuma
|
9da294a140
|
HDFS-15110. HttpFS: post requests are not supported for path "/". Contributed by hemanthboyina.
|
2020-01-10 17:53:19 +09:00 |
|
Akira Ajisaka
|
0315ef8448
|
HDFS-15100. RBF: Print stacktrace when DFSRouter fails to fetch/parse JMX output from NameNode. (#1800)
|
2020-01-10 13:16:57 +09:00 |
|
Ayush Saxena
|
b32757c616
|
HDFS-15107. dfs.client.server-defaults.validity.period.ms to support time units. Contributed by Ayush Saxena.
|
2020-01-10 08:14:56 +05:30 |
|
Takanobu Asanuma
|
782c0556fb
|
HDFS-15102. HttpFS: put requests are not supported for path "/". Contributed by hemanthboyina.
|
2020-01-10 09:52:13 +09:00 |
|
Surendra Singh Lilhore
|
bf45f3b80a
|
HDFS-14957. INodeReference Space Consumed was not same in QuotaUsage and ContentSummary. Contributed by hemanthboyina.
|
2020-01-09 12:04:05 +05:30 |
|
Ayush Saxena
|
8fe01db34a
|
HDFS-15094. RBF: Reuse ugi string in ConnectionPoolID. Contributed by Ayush Saxena.
|
2020-01-09 09:02:38 +05:30 |
|
Ayush Saxena
|
fd30f4c52b
|
HDFS-15096. RBF: GetServerDefaults Should be Cached At Router. Contributed by Ayush Saxena.
|
2020-01-09 08:26:51 +05:30 |
Rakesh Radhakrishnan
|
7030722e5d
|
HDFS-15080. Fix the issue in reading persistent memory cached data with an offset. Contributed by Feilong He.
|
2020-01-08 14:25:17 +05:30 |
|
Masatake Iwasaki
|
aba3f6c3e1
|
HDFS-15077. Fix intermittent failure of TestDFSClientRetries#testLeaseRenewSocketTimeout. (#1797)
|
2020-01-08 16:45:39 +09:00 |
|
Masatake Iwasaki
|
a43c177f1d
|
HDFS-15072. HDFS MiniCluster fails to start when run in directory path with a %. (#1775)
|
2020-01-08 11:28:34 +09:00 |
|
Takanobu Asanuma
|
59aac00283
|
HDFS-15066. HttpFS: Implement setErasureCodingPolicy , unsetErasureCodingPolicy , getErasureCodingPolicy. Contributed by hemanthboyina.
|
2020-01-07 11:10:32 +09:00 |
|
Takanobu Asanuma
|
4a76ab777f
|
HDFS-15090. RBF: MountPoint Listing Should Return Flag Values Of Destination. Contributed by Ayush Saxena.
|
2020-01-06 18:09:59 +09:00 |
luhuachao
|
77ae7b9ce2
|
HDFS-15089. RBF: SmallFix for RBFMetrics in doc (#1786)
|
2020-01-06 12:31:13 +09:00 |
|
Ayush Saxena
|
f8644fbe9f
|
HDFS-15091. Cache Admin and Quota Commands Should Check SuperUser Before Taking Lock. Contributed by Ayush Saxena.
|
2020-01-04 19:02:59 +05:30 |
|
Masatake Iwasaki
|
037ec8cfb1
|
HDFS-15068. DataNode could meet deadlock if invoke refreshVolumes when register. Contributed by Aiphago.
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
|
2020-01-04 01:55:36 +09:00 |
|
Rakesh Radhakrishnan
|
d79cce20ab
|
HDFS-14740. Recover data blocks from persistent memory read cache during datanode restarts. Contributed by Feilong He.
|
2020-01-02 11:44:00 +05:30 |
|
Takanobu Asanuma
|
074050ca59
|
HDFS-15063. HttpFS: getFileStatus doesn't return ecPolicy. Contributed by hemanthboyina.
|
2020-01-01 11:26:38 +09:00 |
|
Ayush Saxena
|
62423910a4
|
HDFS-14937. [SBN read] ObserverReadProxyProvider should throw InterruptException. Contributed by xuzq.
|
2019-12-29 13:07:22 +05:30 |
|
Surendra Singh Lilhore
|
ee51eadda0
|
HDFS-15074. DataNode.DataTransfer thread should catch all the expception and log it. Contributed by hemanthboyina.
|
2019-12-29 11:15:54 +05:30 |
|
Takanobu Asanuma
|
dc32f583af
|
HDFS-14934. [SBN Read] Standby NN throws many InterruptedExceptions when dfs.ha.tail-edits.period is 0. Contributed by Ayush Saxena.
|
2019-12-28 21:32:15 +09:00 |
|
Ayush Saxena
|
8730a7bf60
|
HDFS-15003. RBF: Make Router support storage type quota. Contributed by Jinglun.
|
2019-12-27 09:22:58 +05:30 |
|
Ayush Saxena
|
80f91d14ab
|
HDFS-14997. Addendum: BPServiceActor processes commands from NameNode asynchronously. Contributed by Xiaoqiao He.
|
2019-12-27 09:12:44 +05:30 |
|
Ayush Saxena
|
300505c562
|
HDFS-15054. Delete Snapshot not updating new modification time. Contributed by hemanthboyina.
|
2019-12-25 12:42:50 +05:30 |
|
Ayush Saxena
|
df622cf4a3
|
HDFS-12999. When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice. Contributed by lufei and Fei Hui.
|
2019-12-25 11:07:25 +05:30 |
Chandra Sanivarapu
|
d8cd7098b4
|
HDFS-15073. Replace curator-shaded guava import with the standard one (#1782)
|
2019-12-25 10:50:01 +09:00 |
|
Konstantin V Shvachko
|
b98ac2a3af
|
HDFS-15076. Fix tests that hold FSDirectory lock, without holding FSNamesystem lock. Contributed by Konstantin V Shvachko.
|
2019-12-24 12:08:34 -08:00 |
|
Inigo Goiri
|
52d7b745c6
|
HDFS-15062. Add LOG when sendIBRs failed. Contributed by Fei Hui.
|
2019-12-19 09:42:17 -08:00 |
|
Inigo Goiri
|
b86895485d
|
HDFS-14997. BPServiceActor processes commands from NameNode asynchronously. Contributed by Xiaoqiao He.
|
2019-12-19 09:34:43 -08:00 |
Shashikant Banerjee
|
fdd96e46d1
|
HDFS-15012. NN fails to parse Edit logs after applying HDFS-13101. Contributed by Shashikant Banerjee.
|
2019-12-18 22:50:46 +05:30 |
|
Inigo Goiri
|
24080666e5
|
HDFS-14908. LeaseManager should check parent-child relationship when filter open files. Contributed by Jinglun.
|
2019-12-16 18:41:45 -08:00 |
|
Masatake Iwasaki
|
dc6cf17b34
|
HDFS-15048. Fix findbug in DirectoryScanner.
|
2019-12-16 19:00:57 +09:00 |
|
Ayush Saxena
|
7a87007545
|
HDFS-15038. TestFsck testFsckListCorruptSnapshotFiles is failing in trunk. Contributed by hemanthboyina.
|
2019-12-15 00:33:32 +05:30 |
|
Ayush Saxena
|
72aee114f8
|
HDFS-15053. RBF: Add permission check for safemode operation. Contributed by Xiaoqiao He.
|
2019-12-14 17:57:23 +05:30 |
|
Inigo Goiri
|
7fe924b1c0
|
HDFS-15016. RBF: getDatanodeReport() should return the latest update. Contributed by Inigo Goiri.
|
2019-12-13 10:51:14 -08:00 |
|
Chen Liang
|
65c4660bcd
|
HDFS-15036. Active NameNode should not silently fail the image transfer. Contributed by Chen Liang.
|
2019-12-12 10:22:05 -08:00 |
|
Masatake Iwasaki
|
bdd00f10b4
|
HDFS-15047. Document the new decommission monitor (HDFS-14854). (#1755)
|
2019-12-13 00:35:41 +09:00 |
He Xiaoqiao
|
0e28cd8f63
|
HDFS-15050. Optimize log information when DFSInputStream meet CannotObtainBlockLengthException. Contributed by Xiaoqiao He.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2019-12-12 02:23:32 -08:00 |
|
Takanobu Asanuma
|
93bb368094
|
HDFS-14983. RBF: Add dfsrouteradmin -refreshSuperUserGroupsConfiguration command option. Contributed by Xieming Li
|
2019-12-12 10:56:19 +09:00 |
Erik Krogen
|
c174d50b30
|
HDFS-15032. Properly handle InvocationTargetExceptions in the proxy created by ProxyCombiner. This fixes a bug encountered by the HDFS balancer when used with Observer Nodes. Contributed by Erik Krogen.
|
2019-12-11 09:39:37 -08:00 |
|
Surendra Singh Lilhore
|
c2e9783d5f
|
HDFS-15045. DataStreamer#createBlockOutputStream() should log exception in warn. Contributed by Ravuri Sushma Sree.
|
2019-12-11 08:52:55 +05:30 |
|
Stephen O'Donnell
|
c93cb6790e
|
HDFS-14854. Create improved decommission monitor implementation. Contributed by Stephen O'Donnell.
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2019-12-10 17:16:43 -08:00 |
|
Takanobu Asanuma
|
c4733377d0
|
HDFS-15040. RBF: Secured Router should not run when SecretManager is not running. (#1745)
|
2019-12-10 16:03:32 +09:00 |
|
Akira Ajisaka
|
9f09852051
|
HDFS-15043. RBF: The detail of the Exception is not shown in ZKDelegationTokenSecretManagerImpl (#1748)
|
2019-12-10 16:00:20 +09:00 |
|
Masatake Iwasaki
|
4dffd81bb7
|
HDFS-14522. Allow compact property description in xml in httpfs. (#1737)
|
2019-12-10 10:30:57 +09:00 |
|
Masatake Iwasaki
|
11cd5b6e39
|
HDFS-15028. Keep the capacity of volume and reduce a system call. Contributed by Yang Yun.
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
|
2019-12-07 08:46:45 +09:00 |
|
Wei-Chiu Chuang
|
ecd461f940
|
HDFS-14751. Synchronize on diffs in DirectoryScanner. Contributed by Lisheng Sun.
|
2019-12-06 15:10:40 -08:00 |