5f0452602f
HDFS-16222. Fix ViewDFS with mount points for HDFS only API. ( #3422 ). Contributed by Ayush Saxena.
...
Signed-off-by: Vinayakumar B <vinayakumarb@apache.org>
2021-10-03 10:02:35 +05:30
bf9106c812
HDFS-16242. JournalMetrics should add JournalId MetricTag. ( #3494 )
...
Contributed by Max Xie
2021-10-01 09:35:14 +02:00
1789c7c8c0
HDFS-16238.Improve comments related to EncryptionZoneManager. ( #3483 )
...
Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local>
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
2021-10-01 10:30:41 +08:00
1f8f53f7d7
HDFS-16231. Fix TestDataNodeMetrics#testReceivePacketSlowMetrics ( #3471 )
2021-09-28 13:09:18 +08:00
02993bc11e
HDFS-16237.Record the BPServiceActor information that communicates with Standby. ( #3479 )
2021-09-28 13:07:36 +08:00
1397cf2496
Revert "HADOOP-16878. FileUtil.copy() to throw IOException if the source and destination are the same"
...
This reverts commit 59f01a548e
2021-09-25 21:32:43 -07:00
87632bbacf
HDFS-16233. Do not use exception handler to implement copy-on-write for EnumCounters. ( #3468 )
2021-09-24 08:35:23 -07:00
98e2781dde
HDFS-16063. Add toString to EditLogFileInputStream. Contributed by Dionisii Iuzhakov.
2021-09-23 10:45:02 +05:30
b1431813d0
HDFS-10648. Expose Balancer metrics through Metrics2 ( #3427 )
2021-09-21 12:26:17 -07:00
feee41aa00
HDFS-16213. Flaky test TestFsDatasetImpl#testDnRestartWithHardLink ( #3386 )
...
Reviewed-by: Fei Hui <feihui.ustc@gmail.com>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-09-21 10:11:20 +09:00
f92c6750ec
HDFS-16230. Remove irrelevant trim() call in TestStorageRestore. ( #3455 ). Contributed by Thomas Leplus.
2021-09-20 00:09:05 +05:30
c9763a99c1
HDFS-16227. De-flake TestMover#testMoverWithStripedFile ( #3429 )
2021-09-18 19:02:45 +08:00
cd5c6395e8
HDFS-16229.Remove the use of obsolete BLOCK_DELETION_INCREMENT. ( #3451 ). Contributed by JiangHua Zhu.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-09-18 11:06:51 +05:30
deb52cdcbb
HDFS-16224. testBalancerWithObserverWithFailedNode times out ( #3425 )
2021-09-16 23:59:36 -07:00
2d479309cc
HDFS-16203. Discover datanodes with unbalanced block pool usage by the standard deviation ( #3366 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-09-16 10:00:02 +09:00
3ecaa39668
HDFS-16181. [SBN Read] Fix display of JournalNode metric RpcRequestCacheMissAmount ( #3317 )
...
Co-authored-by: wangzhaohui8 <wangzhaohui8@jd.com>
2021-09-15 09:56:51 -07:00
1032104b9a
HDFS-15920.Solve the problem that the value of SafeModeMonitor#RECHECK_INTERVAL can be configured. ( #2831 ). Contributed by JiangHua Zhu.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-09-14 14:24:36 +05:30
c4c5883d8b
HDFS-16198. Short circuit read leaks Slot objects when InvalidToken exception is thrown ( #3359 )
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-09-14 13:18:15 +08:00
d9eb5ad6d3
HADOOP-17900. Move ClusterStorageCapacityExceededException to Public from LimitedPrivate. ( #3404 ). Contributed by Ayush Saxena.
2021-09-13 22:50:39 +05:30
17c58ac959
HDFS-16223. AvailableSpaceRackFaultTolerantBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance. ( #3424 ). Contributed by Ayush Saxena.
2021-09-13 17:54:38 +08:00
356ebbbe80
HDFS-16187. SnapshotDiff behaviour with Xattrs and Acls is not consistent across NN restarts with checkpointing ( #3340 )
2021-09-13 10:25:19 +05:30
edfde6eebc
HDFS-16197.Simplify getting NNStorage in FSNamesystem. ( #3357 )
2021-09-12 19:58:30 +08:00
7f6553af75
HDFS-16221. RBF: Add usage of refreshCallQueue for Router ( #3421 )
2021-09-12 19:52:47 +08:00
90bc688c78
HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS ( #3346 ) Contributed by Leon Gao
...
* Router to support resolving monitored namenodes with DNS
* Style
* fix style and test failure
* Add test for NNHAServiceTarget const
* Resolve comments
* Fix test
* Comments and style
* Create a simple function to extract port
* Use LambdaTestUtils.intercept
* fix javadoc
* Trigger Build
2021-09-10 16:40:08 -07:00
bddc9bf63c
HDFS-16207. Remove NN logs stack trace for non-existent xattr query ( #3375 )
2021-09-08 21:21:16 -07:00
5a306955a4
HDFS-16209. Add description for dfs.namenode.caching.enabled ( #3378 )
2021-09-08 12:38:55 +08:00
4e4d4fcc7c
HDFS-16204. Improve FSDirEncryptionZoneOp related parameter comments. ( #3368 )
2021-09-06 18:06:12 +08:00
dd6b2cebed
HDFS-16138. BlockReportProcessingThread exit doesn't print the actual stack ( #3244 ). Contributed by Renukaprasad C.
2021-09-05 17:07:59 +08:00
364a1fbfb3
HDFS-16194. Simplify the code with DatanodeID#getXferAddrWithHostname ( #3354 ). Contributed by tomscut.
2021-09-05 14:19:01 +08:00
24af52efab
HDFS-15966. Empty the statistical parameters when emptying the redundant queue ( #2894 )
2021-09-01 19:37:34 +08:00
164608b546
HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst. ( #3353 )
...
Co-authored-by: Uma Maheswara Rao G <umagangumalla@cloudera.com>
2021-08-31 12:25:03 +08:00
aa9cdf2af6
HDFS-16143. Add Timer in EditLogTailer and de-flake TestEditLogTailer#testStandbyTriggersLogRollsWhenTailInProgressEdits ( #3235 )
...
Contributed by Viraj Jasani.
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-08-26 00:37:38 -07:00
b53cae0ffb
HDFS-16157. Support configuring DNS record to get list of journal nodes contributed by Leon Gao. ( #3284 )
...
* Add DNS resolution for QJM
* Add log
* Resolve comments
* checkstyle
* typo
2021-08-25 17:40:12 -07:00
1b9927afe1
HDFS-16184. De-flake TestBlockScanner#testSkipRecentAccessFile ( #3329 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-08-25 17:37:25 +09:00
9084c728eb
HDFS-16180.FsVolumeImpl.nextBlock should consider that the block meta file has been deleted. ( #3315 )
2021-08-24 11:15:47 +08:00
07627ef19e
HDFS-16177. Bug fix for Util#receiveFile ( #3310 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
2021-08-19 12:30:38 +08:00
0e922aab41
HDFS-16160. Improve the parameter annotation in DatanodeProtocol#sendHeartbeat ( #3291 )
2021-08-19 09:51:00 +08:00
53a2c65694
HDFS-16162.Improve DFSUtil#checkProtectedDescendants() related parameter comments. ( #3295 )
...
Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
2021-08-17 16:47:10 +08:00
6342d5e523
HDFS-16171. De-flake testDecommissionStatus ( #3280 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-08-16 14:54:25 +09:00
919a99bbb4
HDFS-16163. Avoid locking entire blockPinningFailures map ( #3296 )
2021-08-16 13:40:05 +08:00
e85c44657c
HDFS-16154. TestMiniJournalCluster failing intermittently because of not reseting UserGroupInformation completely ( #3270 )
...
Co-authored-by: wangzhaohui8 <wangzhaohui8@jd.com>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
2021-08-06 18:23:00 +08:00
a73b64f86b
HDFS-16153. Avoid evaluation of LOG.debug statement in QuorumJournalManager ( #3269 ). Contributed by wangzhaohui.
2021-08-06 09:27:05 +01:00
10a2526b0b
HDFS-16146. All three replicas are lost due to not adding a new DataN… ( #3247 ) Contributed by Shuyan Zhang.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-08-04 00:22:21 +08:00
ccfa072dc7
HADOOP-17612. Upgrade Zookeeper to 3.6.3 and Curator to 5.2.0 ( #3241 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-08-03 14:44:00 +09:00
6d77f3b6cd
HDFS-14529. SetTimes to throw FileNotFoundException if inode is not found ( #3243 )
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-07-30 08:29:56 -07:00
6f730fd25c
HDFS-15936.Solve SocketTimeoutException#sendPacket() does not record SocketTimeout exception. ( #2836 )
...
Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local>
Reviewed-by: cxorm <lianp964@gmail.com>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
2021-07-28 21:57:28 -07:00
683feaa1d4
HDFS-15175. Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog. Contributed by Wan Chang.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Stephen O'Donnell <sodonnel@apache.org>
2021-07-29 11:19:17 +08:00
4eae284827
HDFS-16144. Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions). Contributed by Stephen O'Donnell
2021-07-28 14:49:23 +01:00
ae20516ebc
HDFS-16111. Add a configuration to RoundRobinVolumeChoosingPolicy to avoid failed volumes at datanodes. ( #3175 )
...
Change-Id: Iead25812d4073e3980893e3e76f7d2b03b57442a
Co-authored-by: Zhihai Xu <zxu@apache.org>
2021-07-27 19:18:44 -07:00
aecfcf165f
HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid. ( #3185 )
...
* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid
* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid
* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid
* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid
* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid
Co-authored-by: jiaguodong5 <jiaguodong5@jd.com>
2021-07-27 22:25:21 +05:30
Ayush Saxena
Neil
jianghuazhu
huhaiyang
Chao Sun
Wei-Chiu Chuang
LeonGao
Viraj Jasani
Thomas Leplus
litao
wangzhaohui
EungsopYoo
bshashikant
Symious
Ahmed Hussein
Renukaprasad C
langlaile1221
Uma Maheswara Rao G
zhangshuyan0
He Xiaoqiao
S O'Donnell
zhihaixu2012
JiaguodongF