Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
25,214 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

25214 Commits

Author SHA1 Message Date
Siyao Meng 4900d04823
Merge branch 'trunk' into rewrite-junit5-hdfs 2021-08-22 20:26:17 -07:00
Gautham B A b6d1971820
HDFS-16178. Make recursive rmdir in libhdfs++ cross platform (#3311) 2021-08-20 10:04:55 -07:00
Siyao Meng fac9d35332 Fix TestDiskBalancerWithMockMover. 
Change-Id: Id31b53479d96b569256ddf03c5ea4f5fdc017bef
 2021-08-19 22:56:06 -07:00
Siyao Meng 9c751079b6 Fix TestPermissionSymlinks. 
Change-Id: Iab6145ea3ec2932f8ab594d71c0de36198c0141d
 2021-08-19 22:48:59 -07:00
Siyao Meng 6f54c9ecde [Check static addition] Fix TestFileStatus. 
Change-Id: I7c583eb61f72f7ba020d8f149c6574110fe9af06
 2021-08-19 22:47:36 -07:00
Siyao Meng e724af14b8 Fix TestWebHDFS. 
Change-Id: I86bf8b05d3a5cf384706e761198107de83e18cf7
 2021-08-19 22:45:55 -07:00
Siyao Meng c5518ca777 Fix TestBlockReaderFactory. 
Change-Id: Ic39ad7c369fdf3d32fdeeec01bef3b1d8f0799f6
 2021-08-19 22:44:39 -07:00
Siyao Meng e2e50d72a2 Fix TestParallelUnixDomainRead. 
Change-Id: I69ad15df625b7af843eda3c35e9cfa8e161e54d9
 2021-08-19 22:44:02 -07:00
Siyao Meng 2c41ebb2cd Fix TestHDFSFileContextMainOperations. 
Change-Id: If657c2fd2b73f7479f87d786e00b1aab20fe8d33
 2021-08-19 22:43:27 -07:00
Siyao Meng cfab28a0ee Fix TestParallelShortCircuitRead. 
Change-Id: I72a2b5e59c3bb906253b2ea64f91f7ae6bdef1d7
 2021-08-19 22:42:42 -07:00
Siyao Meng 2216695e08 Fix TestDFSInputStream. 
Change-Id: I6abdbdb3ee8cd0ce0a9d900b924f8d11d3986c97
 2021-08-19 22:42:18 -07:00
Siyao Meng 68e3463367 Fix TestViewFileSystemOverloadSchemeHdfsFileSystemContract. 
Change-Id: I4b3c43886439f2f304f685ec858338dbc49a6c77
 2021-08-19 22:41:45 -07:00
Siyao Meng 3c9a7f508d Fix TestParallelShortCircuitReadUnCached. 
Change-Id: I9ed12a84d988426d3e7c1780e82258079a5ce91d
 2021-08-19 22:40:51 -07:00
Siyao Meng 3ddb921f7a Fix TestShortCircuitLocalRead. 
Change-Id: Ida09040d6fd050d4706ba9b68c77594a877b1077
 2021-08-19 22:39:46 -07:00
Siyao Meng cbc4094ca6 Fix TestSecureNameNodeWithExternalKdc. 
Change-Id: I73a3020dab2de350504933e45c398bd128761adf
 2021-08-19 22:35:56 -07:00
Siyao Meng 3d9f8f227c Fix TestParallelShortCircuitReadNoChecksum. 
Change-Id: I74b8b10acdb84c86c2e5066f1b9541c0480a11c0
 2021-08-19 22:35:18 -07:00
Siyao Meng 2c242cea25 Fix TestEncryptionZones. 
Change-Id: I2d81b095144a168105fa87088218be2e9bdbdada
 2021-08-19 22:34:34 -07:00
Siyao Meng cd0cf9262d Fix TestKeyManager. 
Change-Id: I985689f78229d7c54f74cc58284b2688f5d0b97a
 2021-08-19 22:32:49 -07:00
Siyao Meng d90c32005c Fix TestSaslDataTransfer. 
Change-Id: Ia54a79c4a0058c2fa280f55b3080a9fa7a3046a0
 2021-08-19 22:31:32 -07:00
Siyao Meng 9ad0317212 Fix TestGlobPaths. 
Change-Id: I455c7fb933eb882d16e007db9645fc957d690013
 2021-08-19 22:30:40 -07:00
Siyao Meng b483a3f6f6 Fix TestStartSecureDataNode. 
Change-Id: I14028f6acc5cd95257bbdfab44357ec35f763819
 2021-08-19 22:29:15 -07:00
Siyao Meng 6a05d93de5 Fix TestFileStatusWithDefaultECPolicy. 
Change-Id: I5980792c534bdbdafab787552c467cf45e9336fe
 2021-08-19 22:28:19 -07:00
Siyao Meng 991fd8d746 Fix TestViewFileSystemHdfs. 
Change-Id: I026e35eecf45a5f2a0c0ba3c59cfea67a57d1125
 2021-08-19 22:26:15 -07:00
Siyao Meng 28dbf672c5 [Check static addition] Fix TestFSMainOperationsWebHdfs. 
Change-Id: Id3cd5178cd4b6a212a585f358a489cc50904b548
 2021-08-19 22:20:40 -07:00
Siyao Meng 52a0ca301b Fix TestErasureCodingPolicyWithSnapshot. 
Change-Id: I8169990a55f8aaa4429cede4d571ad0e3f489a0d
 2021-08-19 22:20:26 -07:00
Siyao Meng d5adaac439 Fix TestShortCircuitCache. 
Change-Id: Ie6fcec5dde5e19406e243df3bd88b232a5e49d06
 2021-08-19 22:20:26 -07:00
Siyao Meng 93e3046bf0 Fix TestScrLazyPersistFiles. 
Change-Id: I670fcb9a6429b6011f6ba13b8f716696d064655a
 2021-08-19 22:20:26 -07:00
Siyao Meng d11470c05e [Check line removal] Fix TestDFSClientFailover. 
Change-Id: Idb57ccbee96be77d6bb2df5ec5e3f2d25e846894
 2021-08-19 22:20:26 -07:00
Siyao Meng 800010489a Fix TestBlockReaderLocal. 
Change-Id: I3edfec1a5ed087a754ab36e58e4fe901ec6d2345
 2021-08-19 17:32:27 -07:00
Siyao Meng fa4dcdcf84 Fix TestDistributedFileSystem. 
Change-Id: I96b1cc10371a6a04d026c4bdd2d1f0ff1971714a
 2021-08-19 17:31:37 -07:00
Siyao Meng 8ba43d9210 Fix TestDiskBalancerRPC. 
Change-Id: Ib55211d6dd15615ff072ec8ba395b7449f0727a2
 2021-08-19 17:31:01 -07:00
Siyao Meng 8eeb645af4 Fix TestHDFSContractPathHandle. 
Change-Id: I23bf20e1a6ec8f864d5f250335d6b70debc71a44
 2021-08-19 17:31:01 -07:00
litao 07627ef19e
HDFS-16177. Bug fix for Util#receiveFile (#3310) 
Reviewed-by: Hui Fei <ferhui@apache.org>
 2021-08-19 12:30:38 +08:00
litao 0e922aab41
HDFS-16160. Improve the parameter annotation in DatanodeProtocol#sendHeartbeat (#3291) 2021-08-19 09:51:00 +08:00
sumangala-patki dcddc6a59f
HADOOP-17682. ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters (#2975) 2021-08-18 19:14:10 +05:30
Steve Loughran ee07b90286
HADOOP-17836. Improve logging on ABFS error reporting (#3281) 
Contributed by Steve Loughran.
 2021-08-18 11:39:17 +01:00
Gautham B A 409878ef80
HDFS-16174. Refactor TempFile and TempDir in libhdfs++ (#3303) 2021-08-17 09:49:52 -07:00
srinivasst 4f3f26ce09
YARN-10873: Account for scheduled AM containers before deactivating node (#3287) 
* Account for scheduled AM containers before deactivating node

* Move AM container check to separate method.

* Fix UTs

* Fix UTs

* Remove unnecessary import

* Add timeout for UT
 2021-08-17 14:18:55 +05:30
jianghuazhu 53a2c65694
HDFS-16162.Improve DFSUtil#checkProtectedDescendants() related parameter comments. (#3295) 
Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
 2021-08-17 16:47:10 +08:00
Liang-Chi Hsieh 6014a089fd
HADOOP-17825. Add BuiltInGzipCompressor (#3250) 
Currently, GzipCodec only supports BuiltInGzipDecompressor, if native zlib is not loaded. So, without Hadoop native codec installed, saving SequenceFile using GzipCodec will throw exception like "SequenceFile doesn't work with GzipCodec without native-hadoop code!"

Same as other codecs which we migrated to using prepared packages (lz4, snappy), it will be better if we support GzipCodec generally without Hadoop native codec installed. Similar to BuiltInGzipDecompressor, we can use Java Deflater to support BuiltInGzipCompressor.
 2021-08-16 10:08:03 -07:00
Viraj Jasani 6342d5e523
HDFS-16171. De-flake testDecommissionStatus (#3280) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-08-16 14:54:25 +09:00
Viraj Jasani 919a99bbb4
HDFS-16163. Avoid locking entire blockPinningFailures map (#3296) 2021-08-16 13:40:05 +08:00
Akira Ajisaka a8b5d1d648 Test PR: Ran rewrite plugin 2021-08-14 23:00:44 +09:00
Siyao Meng 3aaac8a1f6
HADOOP-17834. Bump aliyun-sdk-oss to 3.13.0 (#3261) 
Change-Id: I335d4a2cb08c75dc24ef36bdfab51111f87e0762
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-08-14 21:19:10 +09:00
Akira Ajisaka 3ec53a33ba
HADOOP-17799. Improve the GitHub pull request template (#3277) 
Reviewed-by: Yi Sheng <yisheng@apache.org>
 2021-08-14 21:16:15 +09:00
Renukaprasad C b90389ae98
HADOOP-17844. Upgrade JSON smart to 2.4.7 (#3299) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-08-14 19:55:32 +09:00
Gautham B A 77383a4d55
HDFS-15976. Make mkdtemp cross platform (#2908) 2021-08-10 09:23:28 -07:00
Viraj Jasani 6a7883431f
HADOOP-17841. Remove ListenerHandle from Hadoop registry (#3278) 2021-08-09 16:57:53 +08:00
jianghuazhu 0c7b951e03
HDFS-16151. Improve the parameter comments related to ProtobufRpcEngine2#Server(). (#3256) 
Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-08-08 14:55:55 +09:00
Akira Ajisaka 3565c9477d
HADOOP-17370. Upgrade commons-compress to 1.21 (#3274) 2021-08-08 11:23:28 +09:00