Szilard Nemeth
|
01de8fd9d6
|
YARN-6862. Nodemanager resource usage metrics sometimes are negative. Contributed by Benjamin Teke
|
2021-12-17 14:53:06 +01:00 |
|
Dhananjay Badaya
|
253b217efa
|
HADOOP-13500. Synchronizing iteration of Configuration properties object (#3775)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 4483607a4edc0f13264f4ea37abd90aba97e1ef0)
|
2021-12-17 16:13:25 +09:00 |
|
litao
|
3257646975
|
HDFS-16377. Should CheckNotNull before access FsDatasetSpi (#3784)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit 22f5e1885d21c9db9ceecf611128508542ec0f11)
|
2021-12-16 13:52:01 +09:00 |
|
Akira Ajisaka
|
07d3d5ea0b
|
HADOOP-17534. Update Jackson to 2.10.5 and Jackson databind to 2.10.5.1 (#2708)
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit e119063a078f06523158dba3b9e16ca04768e920)
|
2021-12-14 23:53:33 +09:00 |
|
Ayush Saxena
|
a57e83a47b
|
HDFS-16373. Fix MiniDFSCluster restart in case of multiple namenodes. (#3756)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: litao <tomleescut@gmail.com>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2021-12-14 17:24:05 +09:00 |
|
GuoPhilipse
|
038759e444
|
HDFS-16345. Fix test case fail in TestBlockStoragePolicy (#3696). Contributed by guophilipse.
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 25849ff7b7430692d1f40f59e9cb24690cbda216)
|
2021-12-10 16:36:40 +09:00 |
|
Akira Ajisaka
|
bc6874139f
|
HADOOP-16905. Update jackson-databind to 2.10.3 to relieve us from the endless CVE patches (#3748)
(cherry picked from commit 69faaa1d58ad7de18a8dfa477531653a2c061568)
Conflicts:
hadoop-project/pom.xml
|
2021-12-10 16:24:06 +09:00 |
|
Akira Ajisaka
|
94ca965e21
|
HADOOP-18040. Use maven.test.failure.ignore instead of ignoreTestFailure (#3774)
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 9b9e2ef87ffe7b33dc01699892acf62965fb3550)
Conflicts:
hadoop-tools/hadoop-federation-balance/pom.xml
(cherry picked from commit 35c5c6bb83beb4f68e1ff18907589b062a0467e8)
Conflicts:
hadoop-common-project/hadoop-registry/pom.xml
|
2021-12-10 01:41:44 +09:00 |
|
Akira Ajisaka
|
3854b59bd1
|
HADOOP-18035. Ignore unit test failures to run all the unit tests from root (#3765)
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
|
2021-12-10 01:27:27 +09:00 |
|
qinyuren
|
72ffbd956a
|
HDFS-16333. fix balancer bug when transfer an EC block (#3777)
|
2021-12-10 00:42:07 +09:00 |
|
Anoop Sam John
|
84cab2ee29
|
HADOOP-17643 WASB : Make metadata checks case insensitive (#3102)
|
2021-12-09 14:45:48 +05:30 |
|
Takanobu Asanuma
|
2315849b8f
|
Revert "HDFS-16333. fix balancer bug when transfer an EC block (#3679)"
This reverts commit 2072a6a47654c140d4bc9e386a0bc333114d1c2c.
|
2021-12-09 16:37:43 +09:00 |
|
qinyuren
|
2072a6a476
|
HDFS-16333. fix balancer bug when transfer an EC block (#3679)
(cherry picked from commit 35556ea043c063f548b81ad431d9452f010b18f7)
|
2021-12-09 13:27:33 +09:00 |
|
lzx404243
|
6114816b03
|
HDFS-15862. Make TestViewfsWithNfs3.testNfsRenameSingleNN() idempotent (#2724)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 7ba91c123544e1c1cbee759a11879af3b19260b3)
|
2021-12-08 20:49:27 +09:00 |
|
Ashutosh Gupta
|
c8cf7a9bdb
|
YARN-9063. ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing (#3728)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 5a950b8900aa143f6db281eb22928965f3b2754f)
|
2021-12-06 20:15:11 +09:00 |
|
LeonGao
|
b4fc326acf
|
HDFS-16268. Balancer stuck when moving striped blocks due to NPE (#3546)
(cherry picked from commit 7279fe8661d694fb0775f4f84333c1317f4e6899)
|
2021-12-06 16:19:05 +09:00 |
|
Prabhu Joseph
|
292527b325
|
YARN-10820. Make GetClusterNodesRequestPBImpl thread safe. Contributed by Swathi Chandrashekar.
(cherry picked from commit 6b4987f09cbc53e00e85cb82ad97505858cada11)
|
2021-12-06 14:46:34 +09:00 |
|
bitterfox
|
7bdb50c793
|
HDFS-16332. Handle invalid token exception in sasl handshake (#3677)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit dd6b987c93e8319560b633360f30ac84fc48e403)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferServer.java
|
2021-12-03 23:43:37 +09:00 |
|
Ananya Singh
|
b8dbc24727
|
HDFS-16317 : Backport HDFS-14729 for branch-3.2 (#3692)
Co-authored-by: Sunil G <sunilg@apache.org>,Ananya Singh <purpul90@gmail.com>
|
2021-11-30 18:01:53 +05:30 |
|
smarthan
|
2f3e186978
|
HADOOP-18023. Allow cp command to run with multi threads. (#3721)
(cherry picked from commit 932a78fe38b34a923f6852a1a19482075806ecba)
|
2021-11-29 15:06:29 +00:00 |
|
Eric Yang
|
c35b3be700
|
YARN-7266. Fixed deadlock in Timeline Server thread initialization.
Contributed by Prabhu Joseph
(cherry picked from commit 7b42e0e32ac7dfb60f25fa656a9bef69c2a62501)
|
2021-11-29 11:53:34 +09:00 |
|
litao
|
86084637db
|
HDFS-16339. Show the threshold when mover threads quota is exceeded (#3689)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
(cherry picked from commit 86705eda82208b6b04551e637414d0d9d64a4173)
|
2021-11-26 19:54:25 +09:00 |
|
Akira Ajisaka
|
6a28496fb0
|
Revert "HDFS-16336. Addendum: De-flake TestRollingUpgrade#testRollback (#3686). Contributed by Viraj Jasani.."
This reverts commit 4231067d0b1932f891410f7b461b986848b855d3.
|
2021-11-25 22:18:32 +09:00 |
|
Viraj Jasani
|
03c908fb04
|
HDFS-16171. De-flake testDecommissionStatus (#3280) (#3720)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-11-25 22:18:01 +09:00 |
|
GuoPhilipse
|
253883fd8d
|
YARN-11007. Correct words in YARN documents (#3680)
Reviewed-by: cxorm <lianp964@gmail.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c9d64bad37fbfbaa77481f67338b39a029d7dc51)
|
2021-11-25 17:51:58 +09:00 |
|
Viraj Jasani
|
2ff303ea00
|
HDFS-16350. Datanode start time should be set after RPC server starts successfully (#3711)
(cherry picked from commit cdc13e91b619159dc4bf185ad53b950bdf5de52a)
|
2021-11-25 10:26:57 +08:00 |
|
Ayush Saxena
|
4231067d0b
|
HDFS-16336. Addendum: De-flake TestRollingUpgrade#testRollback (#3686). Contributed by Viraj Jasani..
|
2021-11-25 02:01:36 +05:30 |
|
Viraj Jasani
|
af452d2fc5
|
HDFS-16336. De-flake TestRollingUpgrade#testRollback (#3686)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e8566b38129bcef687506742b3d7d35e8e4947a9)
|
2021-11-24 22:56:44 +09:00 |
|
Istvan Fajth
|
dbcadcc21e
|
HADOOP-17975. Fallback to simple auth does not work for a secondary DistributedFileSystem instance. (#3579)
(cherry picked from commit ae3ba45db58467ce57b0a440e236fd80f6be9ec6)
|
2021-11-24 11:20:27 +00:00 |
|
Ashutosh Gupta
|
850224255c
|
YARN-10991. Fix to ignore the grouping "[]" for resourcesStr in parseResourcesString method (#3592)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 08f3df3ea2afcce3973749199269a032df3732e0)
|
2021-11-24 18:50:31 +09:00 |
|
Mukul Kumar Singh
|
f5ff4e1ca8
|
HDFS-16343. Add some debug logs when the dfsUsed are not used during Datanode startup. (#3694)
(cherry picked from commit faa4eeacb1f708b7c3a0701886fa63068327e9b3)
|
2021-11-23 13:53:22 +00:00 |
|
litao
|
2b0339cd34
|
HDFS-16337. Show start time of Datanode on Web (#3682)
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
(cherry picked from commit 0ed817babbcaa0560c11e2065cff3fff0bf328c5)
(cherry picked from commit d746e2cdd80335c86526b293f284187ce07758c4)
|
2021-11-23 15:43:36 +08:00 |
|
smarthan
|
6e179d421d
|
HADOOP-17998. Allow get command to run with multi threads. (#3645)
(cherry picked from commit 63018dc73f4d29632e93be08d035ab9a7e73531c)
Conflicts:
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CopyCommands.java
(cherry picked from commit cbb3ba135cfa3a9bc9f444e8b4a7875758721a3c)
|
2021-11-22 13:39:34 +00:00 |
|
litao
|
abf8572a16
|
HDFS-16326. Simplify the code for DiskBalancer (#3663)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 965e3874e90f7ca7cf6d1418893340338eb8760f)
|
2021-11-19 11:39:48 +09:00 |
|
GuoPhilipse
|
583a41090c
|
HDFS-16328. Correct disk balancer desc (#3669)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 0c1eb0125b1e0c8bdc3f4170295771d75c5ed776)
|
2021-11-19 01:02:49 +09:00 |
|
Viraj Jasani
|
12960d7fd4
|
HDFS-16330. Fix incorrect placeholder for Exception logs in DiskBalancer (#3672)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 38614d05e118711852c58e9f0ebc3493fcb5ebeb)
|
2021-11-19 00:56:38 +09:00 |
|
litao
|
381e41b97c
|
HDFS-16329. Fix log format for BlockManager (#3670)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit dc751df63b4ab2c9c26a1efe7479c31fd1de80d5)
|
2021-11-19 00:43:42 +09:00 |
|
Shubham Gupta
|
ccb711544b
|
YARN-10438. Handle null containerId in ClientRMService#getContainerReport() (#2313)
Co-authored-by: Shubham Gupta <gshubham@microsoft.com>
(cherry picked from commit e3cd627069c7d35b4638af3f2299a248eeca3923)
|
2021-11-19 00:25:14 +09:00 |
|
Takanobu Asanuma
|
210464b08f
|
HDFS-15963. Unreleased volume references cause an infinite loop. Contributed by Shuyan Zhang. (#2941, #3668)
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
(cherry picked from commit 9f2db2c9fdcf1e61b39651a51f8223cfb8ce2e31)
Co-authored-by: zhangshuyan0 <81411509+zhangshuyan0@users.noreply.github.com>
|
2021-11-18 16:32:54 +09:00 |
|
Abhishek Das
|
0e02f03eae
|
HADOOP-17999. No-op implementation of setWriteChecksum and setVerifyChecksum in ViewFileSystem. Contributed by Abhishek Das. (#3639)
(cherry picked from commit 54a1d78e16533e286455de62a545ee75cbc1eff5)
|
2021-11-16 22:21:14 -08:00 |
|
litao
|
81f6cbc715
|
HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode (#3666)
(cherry picked from commit 026d5860cbf3acd701437bfd7c8084aba3d43881)
|
2021-11-17 13:53:33 +09:00 |
|
Neil
|
78c56f39b4
|
HDFS-16182.numOfReplicas is given the wrong value in BlockPlacementPolicyDefault$chooseTarget can cause DataStreamer to fail with Heterogeneous Storage. (#3320)
(cherry picked from commit 5626734a36b9794f4b1af8b9a7d8d0055914a094)
(cherry picked from commit ce3a7155335416ed4665f90f0ddd7ac3a3edd7e6)
|
2021-11-16 22:59:35 +08:00 |
|
Gautham B A
|
980c35ec2d
|
HADOOP-17993. Disable JIRA plugin for YETUS on Hadoop (#3624)
|
2021-11-12 19:56:42 +05:30 |
|
Wei-Chiu Chuang
|
002b5fbdc0
|
HDFS-16187. SnapshotDiff behaviour with Xattrs and Acls is not consistent across NN restarts with checkpointing (#3340) (#3640)
(cherry picked from commit 356ebbbe80aef991d564a6140e341ddd76176416)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestEncryptionZones.java
Change-Id: If76fd0d77fafc90fe2f2c19ab1d0c43a58510f6b
Co-authored-by: bshashikant <shashikant@apache.org>
(cherry picked from commit 5333e872e2a07de8ff2431c9ff041bb582e8e173)
|
2021-11-12 15:03:15 +08:00 |
|
litao
|
c95df2eb6f
|
HDFS-16311. Metric metadataOperationRate calculation error in DataNodeVolumeMetrics (#3636)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 1c1cf64616f34d039cf9246da9613914aa870515)
|
2021-11-12 10:26:19 +09:00 |
|
litao
|
ee871a6afd
|
HDFS-16312. Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents (#3637)
Reviewed-by: Hui Fei <ferhui@apache.org>
(cherry picked from commit 2a1a11c039518bab7e5b581ef23bc5a2e8c81544)
|
2021-11-10 19:24:32 +09:00 |
|
litao
|
ba61dd9b73
|
HDFS-16298. Improve error msg for BlockMissingException (#3615)
Reviewed-by: Hui Fei <ferhui@apache.org>
(cherry picked from commit ea65fc26d80db478f7e49749065c69da7e241bf0)
|
2021-11-10 19:18:56 +09:00 |
|
jianghuazhu
|
9ddafb2eee
|
HDFS-16301. Improve BenchmarkThroughput#SIZE naming standardization. (#3622)
(cherry picked from commit b307f18a584b207782124bee0a377b2dbfc13df0)
|
2021-11-10 11:40:28 +09:00 |
|
litao
|
b103be470c
|
HDFS-16299. Fix bug for TestDataNodeVolumeMetrics#verifyDataNodeVolumeMetrics (#3616)
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit cbc7fb6bcad8c959830a84521ea642cbf973ea83)
|
2021-11-09 17:10:01 +09:00 |
|
Jinhu Wu
|
2b6f7bf209
|
HADOOP-17374. support listObjectV2 (#3587)
(cherry picked from commit a9c51ea57d29cabaed12953b9866f6bf6c686b0f)
|
2021-11-04 21:44:12 -07:00 |
|