Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
25,198 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9348 Commits

Author SHA1 Message Date
Siyao Meng 6f54c9ecde [Check static addition] Fix TestFileStatus. 
Change-Id: I7c583eb61f72f7ba020d8f149c6574110fe9af06
 2021-08-19 22:47:36 -07:00
Siyao Meng e724af14b8 Fix TestWebHDFS. 
Change-Id: I86bf8b05d3a5cf384706e761198107de83e18cf7
 2021-08-19 22:45:55 -07:00
Siyao Meng c5518ca777 Fix TestBlockReaderFactory. 
Change-Id: Ic39ad7c369fdf3d32fdeeec01bef3b1d8f0799f6
 2021-08-19 22:44:39 -07:00
Siyao Meng e2e50d72a2 Fix TestParallelUnixDomainRead. 
Change-Id: I69ad15df625b7af843eda3c35e9cfa8e161e54d9
 2021-08-19 22:44:02 -07:00
Siyao Meng 2c41ebb2cd Fix TestHDFSFileContextMainOperations. 
Change-Id: If657c2fd2b73f7479f87d786e00b1aab20fe8d33
 2021-08-19 22:43:27 -07:00
Siyao Meng cfab28a0ee Fix TestParallelShortCircuitRead. 
Change-Id: I72a2b5e59c3bb906253b2ea64f91f7ae6bdef1d7
 2021-08-19 22:42:42 -07:00
Siyao Meng 2216695e08 Fix TestDFSInputStream. 
Change-Id: I6abdbdb3ee8cd0ce0a9d900b924f8d11d3986c97
 2021-08-19 22:42:18 -07:00
Siyao Meng 68e3463367 Fix TestViewFileSystemOverloadSchemeHdfsFileSystemContract. 
Change-Id: I4b3c43886439f2f304f685ec858338dbc49a6c77
 2021-08-19 22:41:45 -07:00
Siyao Meng 3c9a7f508d Fix TestParallelShortCircuitReadUnCached. 
Change-Id: I9ed12a84d988426d3e7c1780e82258079a5ce91d
 2021-08-19 22:40:51 -07:00
Siyao Meng 3ddb921f7a Fix TestShortCircuitLocalRead. 
Change-Id: Ida09040d6fd050d4706ba9b68c77594a877b1077
 2021-08-19 22:39:46 -07:00
Siyao Meng cbc4094ca6 Fix TestSecureNameNodeWithExternalKdc. 
Change-Id: I73a3020dab2de350504933e45c398bd128761adf
 2021-08-19 22:35:56 -07:00
Siyao Meng 3d9f8f227c Fix TestParallelShortCircuitReadNoChecksum. 
Change-Id: I74b8b10acdb84c86c2e5066f1b9541c0480a11c0
 2021-08-19 22:35:18 -07:00
Siyao Meng 2c242cea25 Fix TestEncryptionZones. 
Change-Id: I2d81b095144a168105fa87088218be2e9bdbdada
 2021-08-19 22:34:34 -07:00
Siyao Meng cd0cf9262d Fix TestKeyManager. 
Change-Id: I985689f78229d7c54f74cc58284b2688f5d0b97a
 2021-08-19 22:32:49 -07:00
Siyao Meng d90c32005c Fix TestSaslDataTransfer. 
Change-Id: Ia54a79c4a0058c2fa280f55b3080a9fa7a3046a0
 2021-08-19 22:31:32 -07:00
Siyao Meng 9ad0317212 Fix TestGlobPaths. 
Change-Id: I455c7fb933eb882d16e007db9645fc957d690013
 2021-08-19 22:30:40 -07:00
Siyao Meng b483a3f6f6 Fix TestStartSecureDataNode. 
Change-Id: I14028f6acc5cd95257bbdfab44357ec35f763819
 2021-08-19 22:29:15 -07:00
Siyao Meng 6a05d93de5 Fix TestFileStatusWithDefaultECPolicy. 
Change-Id: I5980792c534bdbdafab787552c467cf45e9336fe
 2021-08-19 22:28:19 -07:00
Siyao Meng 991fd8d746 Fix TestViewFileSystemHdfs. 
Change-Id: I026e35eecf45a5f2a0c0ba3c59cfea67a57d1125
 2021-08-19 22:26:15 -07:00
Siyao Meng 28dbf672c5 [Check static addition] Fix TestFSMainOperationsWebHdfs. 
Change-Id: Id3cd5178cd4b6a212a585f358a489cc50904b548
 2021-08-19 22:20:40 -07:00
Siyao Meng 52a0ca301b Fix TestErasureCodingPolicyWithSnapshot. 
Change-Id: I8169990a55f8aaa4429cede4d571ad0e3f489a0d
 2021-08-19 22:20:26 -07:00
Siyao Meng d5adaac439 Fix TestShortCircuitCache. 
Change-Id: Ie6fcec5dde5e19406e243df3bd88b232a5e49d06
 2021-08-19 22:20:26 -07:00
Siyao Meng 93e3046bf0 Fix TestScrLazyPersistFiles. 
Change-Id: I670fcb9a6429b6011f6ba13b8f716696d064655a
 2021-08-19 22:20:26 -07:00
Siyao Meng d11470c05e [Check line removal] Fix TestDFSClientFailover. 
Change-Id: Idb57ccbee96be77d6bb2df5ec5e3f2d25e846894
 2021-08-19 22:20:26 -07:00
Siyao Meng 800010489a Fix TestBlockReaderLocal. 
Change-Id: I3edfec1a5ed087a754ab36e58e4fe901ec6d2345
 2021-08-19 17:32:27 -07:00
Siyao Meng fa4dcdcf84 Fix TestDistributedFileSystem. 
Change-Id: I96b1cc10371a6a04d026c4bdd2d1f0ff1971714a
 2021-08-19 17:31:37 -07:00
Siyao Meng 8ba43d9210 Fix TestDiskBalancerRPC. 
Change-Id: Ib55211d6dd15615ff072ec8ba395b7449f0727a2
 2021-08-19 17:31:01 -07:00
Siyao Meng 8eeb645af4 Fix TestHDFSContractPathHandle. 
Change-Id: I23bf20e1a6ec8f864d5f250335d6b70debc71a44
 2021-08-19 17:31:01 -07:00
Akira Ajisaka a8b5d1d648 Test PR: Ran rewrite plugin 2021-08-14 23:00:44 +09:00
Gautham B A 77383a4d55
HDFS-15976. Make mkdtemp cross platform (#2908) 2021-08-10 09:23:28 -07:00
Akira Ajisaka 4972e7a246
Fix potential heap buffer overflow in hdfs.c. Contributed by Igor Chervatyuk. 2021-08-07 11:27:25 +09:00
wangzhaohui e85c44657c
HDFS-16154. TestMiniJournalCluster failing intermittently because of not reseting UserGroupInformation completely (#3270) 
Co-authored-by: wangzhaohui8 <wangzhaohui8@jd.com>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
 2021-08-06 18:23:00 +08:00
wangzhaohui a73b64f86b
HDFS-16153. Avoid evaluation of LOG.debug statement in QuorumJournalManager (#3269). Contributed by wangzhaohui. 2021-08-06 09:27:05 +01:00
zhangshuyan0 10a2526b0b
HDFS-16146. All three replicas are lost due to not adding a new DataN… (#3247) Contributed by Shuyan Zhang. 
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
 2021-08-04 00:22:21 +08:00
Viraj Jasani ccfa072dc7
HADOOP-17612. Upgrade Zookeeper to 3.6.3 and Curator to 5.2.0 (#3241) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-08-03 14:44:00 +09:00
Wei-Chiu Chuang 6d77f3b6cd
HDFS-14529. SetTimes to throw FileNotFoundException if inode is not found (#3243) 
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
 2021-07-30 08:29:56 -07:00
jianghuazhu 6f730fd25c
HDFS-15936.Solve SocketTimeoutException#sendPacket() does not record SocketTimeout exception. (#2836) 
Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local>
Reviewed-by: cxorm <lianp964@gmail.com>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
 2021-07-28 21:57:28 -07:00
He Xiaoqiao 683feaa1d4
HDFS-15175. Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog. Contributed by Wan Chang. 
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Stephen O'Donnell <sodonnel@apache.org>
 2021-07-29 11:19:17 +08:00
S O'Donnell 4eae284827 HDFS-16144. Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions). Contributed by Stephen O'Donnell 2021-07-28 14:49:23 +01:00
zhihaixu2012 ae20516ebc
HDFS-16111. Add a configuration to RoundRobinVolumeChoosingPolicy to avoid failed volumes at datanodes. (#3175) 
Change-Id: Iead25812d4073e3980893e3e76f7d2b03b57442a

Co-authored-by: Zhihai Xu <zxu@apache.org>
 2021-07-27 19:18:44 -07:00
JiaguodongF aecfcf165f
HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid. (#3185) 
* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid

* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid

* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid

* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid

* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid

Co-authored-by: jiaguodong5 <jiaguodong5@jd.com>
 2021-07-27 22:25:21 +05:30
Viraj Jasani b038042ece
HDFS-16139. Update BPServiceActor Scheduler's nextBlockReportTime atomically (#3228). Contributed by Viraj Jasani. 
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
 2021-07-27 14:57:12 +08:00
Akira Ajisaka d710ec8d85
HDFS-16140. TestBootstrapAliasmap fails by BindException. (#3229) 
Reviewed-by: Hui Fei <ferhui@apache.org>
 2021-07-26 16:46:07 +09:00
litao 5d765497c5
HDFS-16131. Show storage type for failed volumes on namenode web (#3211). Contributed by tomscut. 
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
 2021-07-26 12:45:01 +08:00
Akira Ajisaka 2f2f822488
HDFS-12920. HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop. (#3227) 
Revert "HDFS-10845. Change defaults in hdfs-site.xml to match timeunit type. Contributed by Yiqun Lin"

This reverts commit b6d839a60c.

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2021-07-26 01:53:39 +09:00
Eric Yin de41ce8a16
HDFS-16087. Fix stuck issue in rbfbalance tool (#3141). Contributed by Eric Yin. 2021-07-21 00:01:55 +08:00
He Xiaoqiao 6ed7670a93
HDFS-16067. Support Append API in NNThroughputBenchmark. Contributed by Renukaprasad C. 2021-07-17 21:57:00 +08:00
Kihwal Lee 47002719f2 HDFS-16127. Improper pipeline close recovery causes a permanent write failure or data loss. Contributed by Kihwal Lee. 2021-07-16 14:22:39 -05:00
crossfire 4bb25c810b
HDFS-15650. Make the socket timeout for computing checksum of striped blocks configurable (#2414) 2021-07-15 19:58:12 -07:00
Abhishek Das 1dd03cc4b5 HADOOP-17028. ViewFS should initialize mounted target filesystems lazily. Contributed by Abhishek Das (#2260) 2021-07-13 18:11:50 -07:00