Wei-Chiu Chuang
5333e872e2
HDFS-16187. SnapshotDiff behaviour with Xattrs and Acls is not consistent across NN restarts with checkpointing ( #3340 ) ( #3640 )
...
(cherry picked from commit 356ebbbe80
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestEncryptionZones.java
Change-Id: If76fd0d77fafc90fe2f2c19ab1d0c43a58510f6b
Co-authored-by: bshashikant <shashikant@apache.org>
2021-11-12 14:32:02 +08:00
litao
c4e8826194
HDFS-16311. Metric metadataOperationRate calculation error in DataNodeVolumeMetrics ( #3636 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 1c1cf64616
)
2021-11-12 10:25:40 +09:00
litao
808da62cfa
HDFS-16312. Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents ( #3637 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
(cherry picked from commit 2a1a11c039
)
2021-11-10 19:23:58 +09:00
litao
0db04fab20
HDFS-16298. Improve error msg for BlockMissingException ( #3615 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
(cherry picked from commit ea65fc26d8
)
2021-11-10 19:18:18 +09:00
jianghuazhu
46e69715b5
HDFS-16301. Improve BenchmarkThroughput#SIZE naming standardization. ( #3622 )
...
(cherry picked from commit b307f18a58
)
2021-11-10 11:40:08 +09:00
litao
26b7bc75ed
HDFS-16299. Fix bug for TestDataNodeVolumeMetrics#verifyDataNodeVolumeMetrics ( #3616 )
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit cbc7fb6bca
)
2021-11-09 17:09:05 +09:00
jianghuazhu
4d04efb900
HDFS-16294.Remove invalid DataNode#CONFIG_PROPERTY_SIMULATED. ( #3605 )
...
(cherry picked from commit 72718a8dc1
)
2021-11-04 16:50:31 +09:00
daimin
2844b98558
HDFS-16286. Add a debug tool to verify the correctness of erasure coding on file ( #3593 )
...
(cherry picked from commit a21895a5b3
)
2021-11-03 20:41:55 +00:00
Stephen O'Donnell
9cf841b1a6
HDFS-16259. Catch and re-throw sub-classes of AccessControlException thrown by any permission provider plugins (eg Ranger) ( #3598 )
...
(cherry picked from commit 2f35cc36cd
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeAttributeProvider.java
2021-11-02 11:17:59 +00:00
jianghuazhu
5fbd9d333e
HDFS-16269. [Fix] Improve NNThroughputBenchmark#blockReport operation. ( #3544 )
...
Reviewed-by: Fei Hui <feihui.ustc@gmail.com>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 618fea27d2
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNNThroughputBenchmark.java
2021-11-02 01:04:33 +09:00
litao
7e57fc053a
HDFS-16279. Print detail datanode info when process first storage report ( #3564 )
...
(cherry picked from commit 6aa664c624
)
2021-10-29 10:28:40 +09:00
daimin
847cff7d91
HDFS-16282. Remove duplicate generic usage information to hdfs debug command ( #3576 ). Contributed by daimin.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-10-22 21:16:06 +05:30
GuoPhilipse
c4f1db1966
HDFS-16277. improve decision in AvailableSpaceBlockPlacementPolicy ( #3559 ). Contributed by guo.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-10-22 08:02:21 +05:30
Michael Kuchenbecker
78723e045a
HDFS-7612: Fix default cache directory in TestOfflineEditsViewer.testStored. Contributed by Michael Kuchenbecker ( #3571 )
...
(cherry picked from commit a73ff6915a
)
2021-10-21 13:48:38 -07:00
daimin
6019239825
HDFS-16272. Fix int overflow in computing safe length during EC block recovery ( #3548 )
...
(cherry picked from commit 5337bebcc5
)
2021-10-18 12:02:26 +01:00
Ayush Saxena
5b1cf17f88
HDFS-16271. RBF: NullPointerException when setQuota through routers with quota disabled. Contributed by Chengwei Wang.
2021-10-16 14:35:53 +05:30
Masatake Iwasaki
9e2936f8d1
HADOOP-17424. Replace HTrace with No-Op tracer ( #3520 )
...
(cherry picked from commit 1a205cc3ad
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tracing/TestTracing.java
Co-authored-by: Siyao Meng <50227127+smengcl@users.noreply.github.com>
2021-10-12 00:07:09 +09:00
langlaile1221
a35a6ec06b
HDFS-16241. Standby close reconstruction thread ( #3493 )
...
Co-authored-by: zhanghuazong <Zhz@20068867>
(cherry picked from commit 88d8c3d0c8
)
2021-10-11 16:22:46 +08:00
Viraj Jasani
77ee5a4266
HADOOP-17950. Provide replacement for deprecated APIs of commons-io IOUtils ( #3515 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 8071dbb9c6
)
2021-10-07 11:00:19 +09:00
S O'Donnell
f437b3bdaf
HDFS-16252. Correct docs for dfs.http.client.retry.policy.spec. Contributed by Stephen O'Donnell
...
(cherry picked from commit a30231ff8e
)
2021-10-06 15:39:34 +01:00
AngersZhuuuu
4475d8bfe7
HDFS-16235. Fix Deadlock in LeaseRenewer for static remove method ( #3472 )
...
(cherry picked from commit 5f9321a5d4
)
2021-09-29 18:36:36 +08:00
He Xiaoqiao
06954af6f0
HDFS-14575. LeaseRenewer#daemon threads leak in DFSClient. Contributed by Renukaprasad C.
...
Co-authored-by: Tao Yang <taoyang1@apache.org>
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 10b79a26fe
)
2021-09-29 18:36:36 +08:00
Wei-Chiu Chuang
bb08de559a
HDFS-16233. Do not use exception handler to implement copy-on-write for EnumCounters. ( #3468 )
...
(cherry picked from commit 87632bbacf
)
2021-09-24 09:13:15 -07:00
Akira Ajisaka
f1c0dc84cd
HDFS-15977. Call explicit_bzero only if it is available. ( #2914 )
...
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
(cherry picked from commit f0241ec216
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
2021-09-24 11:50:12 +09:00
Chao Sun
ff26a7700d
Revert "HADOOP-16878. FileUtil.copy() to throw IOException if the source and destination are the same ( #2383 )"
...
This reverts commit 54c40cbf49
.
2021-09-23 15:04:27 -07:00
Ayush Saxena
80d2bda51c
HDFS-15288. Add Available Space Rack Fault Tolerant BPP. Contributed by Ayush Saxena.(Addendum)
2021-09-23 10:33:16 +05:30
Ayush Saxena
38f529abf7
HDFS-16223. AvailableSpaceRackFaultTolerantBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance. ( #3424 ). Contributed by Ayush Saxena.
2021-09-23 08:54:01 +05:30
Ayush Saxena
3355126062
HDFS-15288. Add Available Space Rack Fault Tolerant BPP. Contributed by Ayush Saxena.
2021-09-23 08:52:20 +05:30
wangzhaohui
2f73ac1c14
HDFS-16181. [SBN Read] Fix display of JournalNode metric RpcRequestCacheMissAmount ( #3317 )
...
Co-authored-by: wangzhaohui8 <wangzhaohui8@jd.com>
(cherry picked from commit 232fd7cae170de8c6b52c14841a47dca8735c6d2)
2021-09-15 10:02:13 -07:00
EungsopYoo
51a4a23e37
HDFS-16198. Short circuit read leaks Slot objects when InvalidToken exception is thrown ( #3359 )
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit c4c5883d8b
)
2021-09-14 16:27:59 +08:00
Symious
c0f32f3cf8
HDFS-16221. RBF: Add usage of refreshCallQueue for Router ( #3421 )
...
(cherry picked from commit 7f6553af75
)
2021-09-13 10:48:09 +08:00
Symious
8affaa6312
HDFS-16210. RBF: Add the option of refreshCallQueue to RouterAdmin ( #3379 )
...
(cherry picked from commit c0890e6d04
)
2021-09-10 10:01:27 +08:00
Ahmed Hussein
1f61944e3b
HDFS-16207. Remove NN logs stack trace for non-existent xattr query ( #3375 )
...
Change-Id: Ibde523b20a6b8ac92991da52583e625a018d2ee6
2021-09-09 05:27:13 +00:00
Uma Maheswara Rao G
580b6c400b
HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst. ( #3353 )
...
Co-authored-by: Uma Maheswara Rao G <umagangumalla@cloudera.com>
(cherry picked from commit 164608b546
)
2021-08-31 12:27:43 +08:00
Viraj Jasani
0967483b7c
HDFS-16184. De-flake TestBlockScanner#testSkipRecentAccessFile ( #3329 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit 1b9927afe1
)
2021-08-25 17:42:56 +09:00
litao
5a1ed37893
HDFS-16177. Bug fix for Util#receiveFile ( #3310 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
(cherry picked from commit 07627ef19e
)
2021-08-19 12:31:52 +08:00
Akira Ajisaka
00c382d118
Fix potential heap buffer overflow in hdfs.c. Contributed by Igor Chervatyuk.
...
(cherry picked from commit 4972e7a246
)
2021-08-07 11:27:52 +09:00
wangzhaohui
7068e18842
HDFS-16154. TestMiniJournalCluster failing intermittently because of not reseting UserGroupInformation completely ( #3270 )
...
Co-authored-by: wangzhaohui8 <wangzhaohui8@jd.com>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit e85c44657c
)
2021-08-06 18:25:00 +08:00
wangzhaohui
e9ba4f4591
HDFS-16153. Avoid evaluation of LOG.debug statement in QuorumJournalManager ( #3269 ). Contributed by wangzhaohui.
...
(cherry picked from commit a73b64f86b
)
2021-08-06 09:28:39 +01:00
Siyao Meng
72508e6430
HDFS-16055. Quota is not preserved in snapshot INode ( #3078 )
...
(cherry picked from commit ebee2aed00
)
2021-08-03 20:24:18 +01:00
He Xiaoqiao
797c595ba5
HDFS-15175. Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog. Contributed by Wan Chang.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Stephen O'Donnell <sodonnel@apache.org>
(cherry picked from commit 683feaa1d4
)
2021-07-29 19:04:08 +08:00
jianghuazhu
43f15578fc
HDFS-15936.Solve SocketTimeoutException#sendPacket() does not record SocketTimeout exception. ( #2836 )
...
Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local>
Reviewed-by: cxorm <lianp964@gmail.com>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 6f730fd25c
)
2021-07-29 15:44:02 +08:00
S O'Donnell
d661afc06f
HDFS-16144. Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions). Contributed by Stephen O'Donnell
...
(cherry picked from commit 4eae284827
)
2021-07-28 15:02:16 +01:00
Akira Ajisaka
9e72b697a2
HDFS-16140. TestBootstrapAliasmap fails by BindException. ( #3229 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
(cherry picked from commit d710ec8d85
)
2021-07-26 16:47:26 +09:00
Akira Ajisaka
3f573b6751
HDFS-12920. HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop. ( #3227 )
...
Revert "HDFS-10845. Change defaults in hdfs-site.xml to match timeunit type. Contributed by Yiqun Lin"
This reverts commit b6d839a60c
.
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
(cherry picked from commit 2f2f822488
)
2021-07-26 01:54:32 +09:00
Kihwal Lee
95a70c0fdf
HDFS-16127. Improper pipeline close recovery causes a permanent write failure or data loss. Contributed by Kihwal Lee.
...
(cherry picked from commit 47002719f2
)
2021-07-16 14:23:36 -05:00
crossfire
3faae2e06d
HDFS-15650. Make the socket timeout for computing checksum of striped blocks configurable ( #2414 )
...
(cherry picked from commit 4bb25c810b
)
2021-07-16 11:07:27 +08:00
Jim Brennan
0f2b89b791
HDFS-16042. DatanodeAdminMonitor scan should be delay based. Contributed by Ahmed Hussein.
2021-07-15 20:47:02 +00:00
Abhishek Das
450dae7383
HADOOP-17028. ViewFS should initialize mounted target filesystems lazily. Contributed by Abhishek Das ( #2260 )
...
(cherry picked from commit 1dd03cc4b5
)
2021-07-13 18:23:27 -07:00
Artem Smotrakov
c18ad9a007
HADOOP-17793. Better token validation ( #3189 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit ba325a8ada
)
2021-07-10 13:43:31 +09:00
S O'Donnell
705884b87a
HDFS-15796. ConcurrentModificationException error happens on NameNode occasionally. Contributed by Daniel Ma
...
(cherry picked from commit b6c06c4b76
)
2021-07-09 10:19:47 +01:00
bshashikant
ab939814a3
HDFS-16121. Iterative snapshot diff report can generate duplicate records for creates, deletes and Renames. ( #3188 )
...
(cherry picked from commit 6450c1ea9a
)
2021-07-09 09:17:10 +01:00
Viraj Jasani
2d56335a3d
HDFS-16108. Fix incorrect log placeholders used in JournalNodeSyncer ( #3169 )
...
(cherry picked from commit da575a53cf
)
2021-07-05 13:42:51 +09:00
litao
aec8c9188a
HDFS-16109. Fix flaky some unit tests since they offen timeout ( #3172 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit b87bac13e4
)
2021-07-05 08:15:10 +09:00
Viraj Jasani
bf6ed21104
HDFS-16090. Fine grained lock for datanodeNetworkCounts ( #3148 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: stack Chuang <stack@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-06-30 12:59:25 -07:00
litao
4ee7bd345f
HDFS-16089. Add metric EcReconstructionValidateTimeMillis for StripedBlockReconstructor ( #3146 )
...
(cherry picked from commit 95454d821c
)
2021-06-29 18:15:56 +08:00
Viraj Jasani
8538881710
HDFS-16092. Avoid creating LayoutFlags redundant objects ( #3150 )
...
(cherry picked from commit 93a1685073
)
2021-06-29 18:13:00 +08:00
litao
4ca49fcd44
HDFS-16085. Move the getPermissionChecker out of the read lock ( #3134 ). Contributed by tomscut.
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-24 16:00:47 +05:30
litao
5fc61d2e56
HDFS-16076. Avoid using slow DataNodes for reading by sorting locations ( #3117 )
...
(cherry picked from commit fdef2b4cca
)
2021-06-24 13:27:33 +09:00
Viraj Jasani
68604b4cd0
HDFS-16082. Atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer ( #3127 )
...
(cherry picked from commit d9fbb3c508
)
2021-06-23 11:24:00 +08:00
Viraj Jasani
b8a98e4f82
HDFS-16075. Use empty array constants present in StorageType and DatanodeInfo to avoid creating redundant objects ( #3115 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
(cherry picked from commit c488abbc79
)
2021-06-21 10:28:05 +09:00
litao
7d202e8365
HDFS-16079. Improve the block state change log ( #3120 ). Contributed by tomscut.
...
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-20 17:24:03 +05:30
Viraj Jasani
ef3a2a3b3b
HDFS-16080. RBF: Invoking method in all locations should break the loop after successful result ( #3121 ). Contributed by Viraj Jasani.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-20 17:23:52 +05:30
Ahmed Hussein
92ade1f6f9
HDFS-16061. DFTestUtil.waitReplication can produce false positives ( #3095 ). Contributed by Ahmed Hussein.
...
Reviewed-by: Jim Brennan <jbrennan@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-20 10:26:49 +05:30
litao
8d241482bd
HDFS-16078. Remove unused parameters for DatanodeManager.handleLifeline() ( #3119 ). Contributed by tomscut.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-20 10:26:38 +05:30
Hui Fei
e55d76e26c
HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet ( #3113 )
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockManager.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java
2021-06-18 14:41:02 +08:00
Wei-Chiu Chuang
577b96ef42
HDFS-16074. Remove an expensive debug string concatenation ( #3107 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: litao <tomleescut@gmail.com>
(cherry picked from commit 1ad674e548
)
2021-06-17 11:39:34 +08:00
Ayush Saxena
3e03ecd680
HDFS-16073. Remove redundant RPC requests for getFileLinkInfo in ClientNamenodeProtocolTranslatorPB. Contributed by lei w.
2021-06-16 15:54:36 +05:30
Takanobu Asanuma
546c66b812
HDFS-16068. WebHdfsFileSystem has a possible connection leak in connection with HttpFS ( #3104 )
...
(cherry picked from commit 839fcf7682
)
2021-06-15 17:22:34 +09:00
Ahmed Hussein
840612b3b1
HDFS-15659. MiniDFSCluster dfs.namenode.redundancy.considerLoad default to false ( #2443 ). Contributed by Ahmed Hussein.
...
(cherry picked from commit 747883af4d
)
2021-06-14 14:37:27 +00:00
litao
52d055a7eb
HDFS-16057. Make sure the order for location in ENTERING_MAINTENANCE state ( #3084 )
...
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 51ebf7b2a0
)
2021-06-11 17:33:06 +09:00
Wei-Chiu Chuang
83d119fe94
HDFS-15916. DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff. ( #2863 ). Contributed by Ayush Saxena. ( #3054 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit c6539e3289
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
Co-authored-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-08 19:32:34 -07:00
litao
02249171b1
HDFS-16048. RBF: Print network topology on the router web ( #3062 )
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Hemanth Boyina <hemanthboyina@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c748fce17a
)
2021-06-08 16:59:59 +09:00
litao
46d4b51bff
HDFS-15814. Make some parameters configurable for DataNodeDiskMetrics for branch-3.3 ( #3021 )
2021-06-08 00:10:37 -07:00
huhaiyang
ede03cc35c
HDFS-15998. Fix NullPointException In listOpenFiles ( #3036 )
...
Co-authored-by: huhaiyang <huhaiyang@didichuxing.com>
(cherry picked from commit b38b00e528
)
2021-06-01 15:30:50 +08:00
Konstantin V Shvachko
c5535caf6e
HDFS-16040. RpcQueueTime metric counts requeued calls as unique events. Contributed by Simbarashe Dzinamarira.
...
(cherry picked from commit 8ce30f51f9
)
2021-05-27 18:53:46 -07:00
Konstantin V Shvachko
5308d44be4
HDFS-15915. Race condition with async edits logging due to updating txId outside of the namesystem log. Contributed by Konstantin V Shvachko.
...
(cherry picked from commit 1abd03d68f
)
2021-05-26 15:09:47 -07:00
Narges Shadab
41025cd585
HDFS-16031. Possible Resource Leak in org.apache.hadoop.hdfs.server.aliasmap#InMemoryAliasMap ( #3027 )
...
(cherry picked from commit 3fdeb7435a
)
2021-05-26 14:45:20 +09:00
Wei-Chiu Chuang
86c28f0639
Revert "HADOOP-17669. Backport HADOOP-17079, HADOOP-17505 to branch-3.3 ( #2959 )"
...
This reverts commit 4ffe5eb1dd
.
2021-05-24 17:37:18 +08:00
Yiqun Lin
ca52d9946b
HDFS-15660. StorageTypeProto is not compatiable between 3.x and 2.6. Contributed by Ryan Wu.
...
(cherry picked from commit da1ea2530f
)
2021-05-24 10:48:48 +08:00
Wei-Chiu Chuang
fa4915fdbb
Preparing for 3.3.2 development
2021-05-19 21:52:37 +08:00
Wei-Chiu Chuang
63392376c9
HDFS-16027. Replace abstract methods with default methods in JournalNodeMXBean. ( #3018 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-05-18 19:49:00 -07:00
Wei-Chiu Chuang
4ffe5eb1dd
HADOOP-17669. Backport HADOOP-17079, HADOOP-17505 to branch-3.3 ( #2959 )
...
* HADOOP-17079. Optimize UGI#getGroups by adding UGI#getGroupsSet.
Co-authored-by: Wei-Chiu Chuang <weichiu@apache.org>
Change-Id: I0f31409923ece24a82dfba4c4610d8a38c52d9fb
* HADOOP-17505. public interface GroupMappingServiceProvider needs default impl for getGroupsSet() (#2661 ). Contributed by Vinayakumar B.
(cherry picked from commit c4c0683dff
)
Co-authored-by: Xiaoyu Yao <xyao@apache.org>
Co-authored-by: Vinayakumar B <vinayakumarb@apache.org>
2021-05-17 18:57:46 -07:00
litao
2f56e2b54d
HDFS-15873. Add namenode address in logs for block report ( #2743 )
...
(cherry picked from commit 6a922f9896
)
2021-05-17 12:29:11 +08:00
Aryan Gupta
28079e9c30
HADOOP-17283. Hadoop - Upgrade to jQuery 3.5.1 ( #2330 )
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit 486ddb73f9
)
2021-05-13 12:16:17 +08:00
Ayush Saxena
41b39ff292
HDFS-15245. Improve JournalNode web UI. Contributed by Jianfei Jiang.
...
(cherry picked from commit 960c9ebaea
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalNode.java
2021-05-13 12:14:09 +08:00
Viraj Jasani
3176ab028b
HDFS-16007. Deserialization of ReplicaState should avoid throwing ArrayIndexOutOfBoundsException ( #2982 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit b944084b32
)
2021-05-11 12:39:42 +09:00
Ayush Saxena
43db94c7a3
HDFS-16003. ProcessReport print invalidatedBlocks should judge debug level at first. Contributed by lei w.
2021-05-10 17:11:09 +05:30
Akira Ajisaka
1326cad66a
HDFS-16001. TestOfflineEditsViewer.testStored() fails reading negative value of FSEditsLogOpCodes (branch-3.3) ( #2989 ). Contributed by Akira Ajisaka.
2021-05-08 10:48:56 +08:00
Karthik Palanisamy
00c3f3c42f
HDFS-15865. Interrupt DataStreamer thread if no ack ( #2728 )
...
(cherry picked from commit bd3da73a0f
)
2021-05-04 11:11:36 +01:00
Akira Ajisaka
25244c4eec
HDFS-15952. TestRouterRpcMultiDestination#testProxyGetTransactionID and testProxyVersionRequest are flaky. ( #2970 )
...
(cherry picked from commit 7c561e2a02
)
2021-05-04 00:26:34 +09:00
lfengnan
43fac739bb
HDFS-15810. RBF: RBFMetrics's TotalCapacity out of bounds ( #2910 )
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 6e525ab81c
)
2021-05-02 19:19:55 +09:00
Wei-Chiu Chuang
670205c541
HADOOP-17653. Do not use guava's Files.createTempDir(). ( #2945 )
...
Reviewed-by: Steve Loughran <stevel@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit f1e1809029
)
2021-05-02 11:12:37 +09:00
Hui Fei
9aa6106689
HDFS-15652. Make block size from NNThroughputBenchmark configurable ( #2416 )
...
(cherry picked from commit 8a6d5b9151
)
2021-04-29 12:10:04 -07:00
litao
0e9042fed5
HDFS-15991. Add location into datanode info for NameNodeMXBean ( #2933 )
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit b968fa0957
)
2021-04-28 18:52:05 +09:00
Hui Fei
842e05ba53
HDFS-15698. Fix the typo of dfshealth.html after HDFS-15358 ( #2495 )
...
(cherry picked from commit 68442b48c8
)
2021-04-28 18:51:50 +09:00
Ayush Saxena
f809b863fe
HDFS-15358. RBF: Unify router datanode UI with namenode datanode UI. Contributed by Ayush Saxena.
...
(cherry picked from commit 6e416a83d1
)
2021-04-28 18:51:43 +09:00
Ayush Saxena
3c7433f2a1
HDFS-15247. RBF: Provide Non DFS Used per DataNode in DataNode UI. Contributed by Lisheng Sun.
...
(cherry picked from commit 8d49229c37
)
2021-04-28 18:51:37 +09:00
Ayush Saxena
187b4a63a4
HDFS-15378. TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk. Contributed by hemanthboyina.
...
(cherry picked from commit 8db38c98a6
)
2021-04-27 23:18:12 +09:00
litao
f45365f201
HDFS-15975. Use LongAdder instead of AtomicLong for branch-3.3 ( #2940 )
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-04-27 22:39:25 +09:00