1658a5140a
YARN-10503. Support queue capacity in terms of absolute resources with custom
...
resourceType. Contributed by Qi Zhu.
2021-04-09 17:51:01 +00:00
0e6cd352b5
HDFS-15160. ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock. Contributed by Stephen O'Donnell. ( #2813 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 2a67e2b1a0
2021-04-09 10:25:14 +01:00
068f114066
MAPREDUCE-7329: HadoopPipes task may fail when linux kernel version change from 3.x to 4.x ( #2775 )
...
(cherry picked from commit 663ca14a76
2021-04-09 12:00:38 +09:00
4994b73eeb
HDFS-15940. Fix TestBlockRecovery2#testRaceBetweenReplicaRecoveryAndFinalizeBlock (ADDENDUM) ( #2874 )
...
(cherry picked from commit 56bd968fb4
2021-04-09 11:13:39 +09:00
df99ac0399
HDFS-15942. Increase Quota initialization threads. Contributed by Stephen O'Donnell.
...
(cherry picked from commit 459df41997
2021-04-08 13:15:37 +01:00
ef95f7a963
HDFS-15937. Reduce memory used during datanode layout upgrade. Contributed by Stephen O'Donnell ( #2838 )
...
(cherry picked from commit 4c567fcff7
2021-04-08 12:15:31 +01:00
dca2bf9dd5
HDFS-15759. EC: Verify EC reconstruction correctness on DataNode ( #2585 )
...
(cherry picked from commit 95e6892675
2021-04-08 17:20:08 +08:00
7f7535534d
HADOOP-17625. Update to Jetty 9.4.39. ( #2870 )
...
Reviewed-by: cxorm <lianp964@gmail.com>
(cherry picked from commit 6040e86e99
2021-04-08 14:28:03 +08:00
236a9a7713
HADOOP-17617. Incorrect representation of RESPONSE for Get Key Version in KMS index.md.vm file. Contributed by Ravuri Sushma sree
...
(cherry picked from commit ae88174c29
2021-04-07 23:50:02 +05:30
b59bde61f6
HDFS-15948. Fix test4tests for libhdfspp ( #2873 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 02b9506c5a
2021-04-07 19:58:03 +09:00
1110b03752
HADOOP-17621. hadoop-auth to remove jetty-server dependency. ( #2865 )
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit dac60b8282
2021-04-07 13:17:40 +08:00
44365244e6
HADOOP-17624. Remove any rocksdb exclusion code. ( #2867 )
...
Reviewed-by: Márton Elek <elek@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit f608cda729
2021-04-07 12:53:34 +08:00
fb5809984e
YARN-10702. Add cluster metric for amount of CPU used by RM Event Processor.
...
Contributed by Jim Brennan.
2021-04-06 23:34:35 +00:00
d7b31acbba
HDFS-15949. Fix integer overflow ( #2857 )
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 36014b8282
2021-04-06 18:23:38 +09:00
8b4b3d6fe6
HADOOP-17622. Avoid usage of deprecated IOUtils#cleanup API. ( #2862 )
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit 3f2682b92b
2021-04-06 14:18:31 +09:00
2b5fd341b9
HDFS-15940. Fixing and refactoring tests specific to Block recovery.( #2844 ). Contributed by Viraj Jasani
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-04-06 00:20:56 +05:30
7a7e194228
HDFS-15951. Remove unused parameters in NameNodeProxiesClient ( #2859 )
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit 9e2d5d6d05
2021-04-05 17:49:27 +09:00
e4d04a640b
HDFS-15950. Remove unused hdfs.proto import ( #2858 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit ca5e13fd74
2021-04-05 11:42:52 +09:00
cc0cc7ab5f
HADOOP-17614. Bump netty to the latest 4.1.61. ( #2850 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 29a6769b68
2021-04-05 08:37:10 +08:00
e079aaa820
MAPREDUCE-7199. HsJobsBlock reuse JobACLsManager for checkAccess. Contributed by Bilwa S T
...
(cherry picked from commit a1b0697d37
2021-04-02 21:31:45 +05:30
d973f37054
HDFS-15362. FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks. Contributed by hemanthboyina.
...
(cherry picked from commit 2148a8fe64
2021-04-02 17:14:34 +08:00
887948d127
HDFS-15351. Blocks scheduled count was wrong on truncate. Contributed by hemanthboyina.
...
(cherry picked from commit 719b53a79d
2021-04-02 17:14:24 +08:00
02d37c7d22
HDFS-15316. Deletion failure should not remove directory from snapshottables. Contributed by hemanthboyina
...
(cherry picked from commit 743c2e9071
2021-04-02 17:14:14 +08:00
14fddba715
HDFS-15252. HttpFS: setWorkingDirectory should not accept invalid paths. Contributed by hemanthboyina.
...
(cherry picked from commit 736659e0e1
2021-04-02 17:13:59 +08:00
2da3356428
HDFS-15591. RBF: Fix webHdfs file display error. Contributed by wangzhaohui.
...
(cherry picked from commit fc8a6dd8a9
2021-04-02 17:13:00 +08:00
f5cc1540b4
HDFS-15510. RBF: Quota and Content Summary was not correct in Multiple Destinations. Contributed by Hemanth Boyina.
...
(cherry picked from commit ca8e7a7725
2021-04-02 17:11:33 +08:00
a549b4a82e
HDFS-15300. RBF: updateActiveNamenode() is invalid when RPC address is IP. Contributed by xuzq.
...
(cherry picked from commit 936bf09c37
2021-04-02 17:11:16 +08:00
5bfc3a4c3a
HDFS-15198. RBF: Add test for MountTableRefresherService failed to refresh other router MountTableEntries in secure mode. Contributed by zhengchenyu.
...
(cherry picked from commit 8a9a674ef1
2021-04-02 17:10:56 +08:00
327488d688
HDFS-15196. RBF: RouterRpcServer getListing cannot list large dirs correctly. Contributed by Fengnan Li.
...
(cherry picked from commit 80b877a72f
2021-04-02 14:12:17 +08:00
57d2fff84b
HDFS-15246. ArrayIndexOfboundsException in BlockManager CreateLocatedBlock. Contributed by Hemanth Boyina.
...
(cherry picked from commit 8b7695bb26
2021-04-02 14:06:52 +08:00
1148d3895f
HDFS-15332. Quota Space consumed was wrong in truncate with Snapshots. Contributed by hemanthboyina.
...
(cherry picked from commit 130f89e068
2021-04-02 14:06:52 +08:00
41fad5056c
HDFS-15265. HttpFS: validate content-type in HttpFSUtils. Contributed by hemanthboyina.
...
(cherry picked from commit 31b2f687ef
2021-04-02 14:06:52 +08:00
5187bd37ae
HDFS-15266. Add missing DFSOps Statistics in WebHDFS. Contributed by Ayush Saxena.
...
(cherry picked from commit 37d6582223
2021-04-02 14:06:52 +08:00
2b207ea402
HDFS-15667. Audit log record the unexpected allowed result when delete ( #2437 )
...
(cherry picked from commit 95c96605b3
2021-04-02 14:06:52 +08:00
90bbaca88b
HADOOP-17587. Kinit with keytab should not display the keytab file's full path in any logs. Contributed by Ravuri Sushma sree.
...
(cherry picked from commit bc7689abf5
2021-04-02 10:04:19 +05:30
c60e81b5a8
HADOOP-17610. DelegationTokenAuthenticator prints token information. Contributed by Ravuri Sushma sree.
...
(cherry picked from commit 478402cc74
2021-04-02 09:56:47 +05:30
62937d15bb
HDFS-15892. Add metric for editPendingQ in FSEditLogAsync ( #2770 )
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit 4bd04126d6
2021-04-02 10:57:05 +09:00
f707d8407a
HDFS-15931 : Fix non-static inner classes for better memory management ( #2830 ). Contributed by Viraj Jasani
...
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2021-04-01 16:35:44 -07:00
e5d7b22b8b
HDFS-15921. Improve the log for the Storage Policy Operations. Contributed by Bhavik Patel.
2021-04-01 11:59:53 +08:00
13878fc06b
HDFS-15494. TestReplicaCachingGetSpaceUsed#testReplicaCachingGetSpaceUsedByRBWReplica Fails on Windows. Contributed by Ravuri Sushma sree.
...
(cherry picked from commit 0665ce9930
2021-04-01 09:22:18 +05:30
c365149e16
HADOOP-16524. Automatic keystore reloading for HttpServer2
...
Reapply of issue reverted first because it caused yarn failures.
Signed-off-by: stack <stack@apache.org>
2021-03-31 10:50:28 -07:00
c70f5eb8fa
MAPREDUCE-6826. Job fails with InvalidStateTransitonException: Invalid event: JOB_TASK_COMPLETED at SUCCEEDED/COMMITTING. Contributed by Bilwa S T.
...
(cherry picked from commit d4e36409d4
2021-03-31 21:35:06 +05:30
ae2d856515
HDFS-15932. Improve the balancer error message when process exits abnormally. Contributed by Renukaprasad C.
2021-03-31 12:24:01 +08:00
ab451b8e42
HDFS-15651. Client could not obtain block when DN CommandProcessingThread exit. Contributed by Aiphago.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Yiqun Lin <yqlin@apache.org>
(cherry picked from commit 3067a25fa1
2021-03-30 22:29:49 +08:00
872839416b
HDFS-15331. Remove invalid exclusions that minicluster dependency on HDFS ( #1996 ). Contributed by Wanqiang Ji
...
(cherry picked from commit e877118454
2021-03-30 22:29:49 +08:00
53b024a2b7
HDFS-15508. [JDK 11] Fix javadoc errors in hadoop-hdfs-rbf module
...
(cherry picked from commit 9062814bab
2021-03-30 22:29:49 +08:00
a407f7de5a
HDFS-15507. [JDK 11] Fix javadoc errors in hadoop-hdfs-client module. Contributed by Xieming Li.
...
(cherry picked from commit 32895f4f7e
2021-03-30 22:29:49 +08:00
c4f7b8578b
HDFS-15506. [JDK 11] Fix javadoc errors in hadoop-hdfs module. Contributed by Xieming Li.
...
(cherry picked from commit 7938ebfb9d
2021-03-30 22:29:49 +08:00
769df1e964
HDFS-15253 Default checkpoint transfer speed, 50mb per second ( #2366 )
...
(cherry picked from commit df4006eb81
2021-03-30 22:29:49 +08:00
7f20fad419
HDFS-14383. Compute datanode load based on StoragePolicy. Contributed by Ayush Saxena.
...
(cherry picked from commit 2e8cafac3b
2021-03-30 22:29:48 +08:00
Eric Badger
Stephen O'Donnell
lichaojacobs
Viraj Jasani
He Xiaoqiao
touchida
Wei-Chiu Chuang
Brahma Reddy Battula
Gautham B A
litao
Surendra Singh Lilhore
Inigo Goiri
Takanobu Asanuma
Ayush Saxena
maobaolong
Borislav Iordanov
Wanqiang Ji
Akira Ajisaka
Karthik Palanisamy