298cda22a3
HDFS-15010. BlockPoolSlice#addReplicaThreadPool static pool should be initialized by static method. Contributed by Surendra Singh Lilhore.
2019-11-28 23:58:46 +05:30
2ad7b90505
YARN-9993. Remove incorrectly committed files from YARN-9011. Contributed by Wilfred Spiegelenburg
2019-11-28 12:39:54 +01:00
e8304426b1
MAPREDUCE-7249. Fix Invalid event TA_TOO_MANY_FETCH_FAILURE at SUCCESS_CONTAINER_CLEANUP causes job failure.
...
Contributed by Wilfred Spiegelenburg.
2019-11-28 14:32:28 +05:30
f9b872b6ec
YARN-9949. Add missing queue configs for root queue in RMWebService#CapacitySchedulerInfo.
...
Contributed by Prabhu Joseph.
2019-11-27 23:14:33 +05:30
8eda9fcab8
YARN-9937. Add missing queue configs in RMWebService#CapacitySchedulerQueueInfo.
...
Contributed by Prabhu Joseph.
2019-11-27 22:24:06 +05:30
66e58b5525
MAPREDUCE-7240. Fix Invalid event: TA_TOO_MANY_FETCH_FAILURE at SUCCESS_FINISHING_CONTAINER.
...
Contributed by Huachao and Peter Bacsko. Reviewed by Wilfred Spiegelenburg.
2019-11-27 16:09:24 +05:30
3fc8930129
YARN-9011. Race condition during decommissioning. Contributed by Peter Bacsko
2019-11-26 14:26:58 +01:00
59a6261e81
YARN-9966. Code duplication in UserGroupMappingPlacementRule ( #1709 )
...
(cherry picked from commit f8e36e03b4
2019-11-25 15:29:37 +09:00
32fdb3004a
HDFS-14519. NameQuota is not update after concat operation, so namequota is wrong. Contributed by Ranith Sardar.
2019-11-23 02:36:38 +05:30
dcc453b4b8
YARN-9968. Public Localizer is exiting in NodeManager due to NullPointerException. Contributed by Tarun Parimi
2019-11-22 12:59:35 +01:00
af495192a5
YARN-9838. Fix resource inconsistency for queues when moving app with reserved container to another queue. Contributed by jiulongzhu.
2019-11-22 16:14:16 +08:00
39366b1370
HDFS-14940. HDFS Balancer : Do not allow to set balancer maximum network bandwidth more than 1TB. Contributed by hemanthboyina.
2019-11-22 00:33:42 +05:30
bd2f79cfd8
HADOOP-15686. Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr. Contributed by Wei-Chiu Chuang.
...
Reviewed-by: Xiaoyu Yao <xyao@apache.org>
(cherry picked from commit 9664b9c7a6
2019-11-20 13:08:40 -08:00
4c79e2a02b
HADOOP-16719. Remove the disallowed element config within maven-checkstyle-plugin ( #1724 )
...
(cherry picked from commit dfc61d8ea5
2019-11-20 16:19:45 +09:00
5fe9b81941
HDFS-14952. Skip safemode if blockTotal is 0 in new NN. Contributed by Xiaoqiao He.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Mukul Kumar Singh <msingh@apache.org>
(cherry picked from commit 0b50aa29fd
2019-11-19 12:22:30 -08:00
62622ab9c1
YARN-9836. General usability improvements in showSimulationTrace.html. Contributed by Adam Antal
2019-11-19 21:21:17 +01:00
6951689f4c
YARN-9983. Fixed typo in YARN Service overview.
...
Contributed by Denes Gerencser
2019-11-19 14:19:49 -05:00
31591bb296
YARN-9791. Queue Mutation API does not allow to remove a config. Contributed by Prabhu Joseph.
...
(cherry picked from commit 751b5a1ac8
2019-11-19 16:49:14 +05:30
b04f152876
YARN-9909. Offline Format of YarnConfigurationStore. Contributed by Prabhu Joseph
2019-11-19 16:10:02 +05:30
c1ec51696c
YARN-8373. RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH. Contributed by Wilfred Spiegelenburg.
...
(cherry picked from commit ea68756c0c
2019-11-19 14:12:03 +05:30
049279bb66
YARN-9984. FSPreemptionThread can cause NullPointerException while app is unregistered with containers running on a node. Contributed by Wilfred Spiegelenburg.
...
(cherry picked from commit 215f2052fc
2019-11-19 14:05:11 +05:30
051dae1f89
HDFS-14942. Change Log Level to debug in JournalNodeSyncer#syncWithJournalAtIndex. Contributed by Lisheng Sun.
...
(cherry picked from commit 9e287054a8
2019-11-18 10:24:53 -08:00
bcca7120e0
HADOOP-16712. Config ha.failover-controller.active-standby-elector.zk.op.retries is not in core-default.xml. Contributed by Xieming Li.
2019-11-18 19:52:36 +05:30
89e95370a4
HADOOP-16710. Testing_azure.md documentation is misleading.
...
Contributed by Andras Bokor.
Change-Id: Icf07a53145936953629c7dace2e9648b7b21588d
2019-11-17 17:06:10 +00:00
b914f385a0
HADOOP-16705. MBeanInfoBuilder puts unnecessary memory pressure on the system with a debug log.
...
MBeanInfoBuilder's get() method DEBUG logs all the MBeanAttributeInfo attributes that it gathered. This can have a high memory churn that can be easily avoided.
(cherry picked from commit c73334a924
2019-11-15 13:30:11 -08:00
60655bfe54
HDFS-14973. More strictly enforce Balancer/Mover/SPS throttling of getBlocks RPCs to NameNodes. Contributed by Erik Krogen.
...
(cherry picked from b2cc8b6b4a
2019-11-15 10:11:56 -08:00
ea9c74d9c1
HADOOP-15097. AbstractContractDeleteTest::testDeleteNonEmptyDirRecursive with misleading path. Contributed by Xieming Li.
...
(cherry picked from commit 92c28c100e
2019-11-15 13:51:09 +09:00
dec765b329
HDFS-14979 Allow Balancer to submit getBlocks calls to Observer Nodes when possible. Contributed by Erik Krogen.
...
(cherry picked from 586defe711
2019-11-13 11:57:42 -08:00
975f669141
HADOOP-16677. Recalculate the remaining timeout millis correctly while throwing an InterupptedException in SocketIOWithTimeout. ( #1687 )
...
(cherry picked from commit df6b3162c1
2019-11-12 14:21:50 -08:00
0c12d633b9
HDFS-14959: [SBNN read] access time should be turned off ( #1706 ) Contributed by Chao Sun.
...
(cherry picked from commit 97ec34e117
2019-11-12 11:40:56 -08:00
e0cf1735e1
HADOOP-16676. Backport HADOOP-16152 to branch-3.2. Contributed by Siyao Meng.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-11-12 11:38:42 -08:00
c4e22e0c80
HDFS-14720. DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE. Contributed by hemanthboyina.
...
(cherry picked from commit 320008bb7c
2019-11-09 22:28:15 +05:30
2e843cb773
HDFS-14958. TestBalancerWithNodeGroup is not using NetworkTopologyWithNodeGroup. Contributed by Jim Brennan.
2019-11-07 22:50:30 +05:30
3aa161a114
HDFS-14590. [SBN Read] Add the document link to the top page. Contributed by Takanobu Asanuma.
...
(cherry picked from commit 48d7f00da8
2019-11-07 22:29:01 +09:00
c9ed0c3a37
HDFS-14806. Bootstrap standby may fail if with in-progress tailing. Contributed by Chen Liang and Erik Krogen.
2019-11-06 16:12:51 -08:00
431edfcbe4
HDFS-14941. Potential editlog race condition can cause corrupted file. Contributed by Chen Liang and Konstantin Shvachko.
2019-11-06 15:00:15 -08:00
5941a91f64
HDFS-14946. Erasure Coding: Block recovery failed during decommissioning. Contributed by Fei Hui.
2019-11-06 22:10:27 +05:30
aa1c795dc9
HDFS-14384. When lastLocatedBlock token expire, it will take 1~3s second to refetch it. Contributed by Surendra Singh Lilhore.
...
(cherry picked from commit c36014165c
2019-11-06 19:37:41 +05:30
56988e88f7
MAPREDUCE-7208. Tuning TaskRuntimeEstimator. (Ahmed Hussein via jeagles)
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit ed302f1fed
2019-11-05 15:21:51 -06:00
254e18dcaf
Revert "YARN-9949. Add missing queue configs for root queue in RMWebService#CapacitySchedulerInfo. Contributed by Prabhu Joseph."
...
This reverts commit 11c763c220
2019-11-05 15:10:01 -06:00
a58f466d07
HADOOP-16013. DecayRpcScheduler decay thread should run as a daemon. Contributed by Erik Krogen.
...
(cherry picked from commit 01cb958af4
2019-11-04 17:18:27 -08:00
597b315811
YARN-9950. Unset Ordering Policy of Leaf/Parent queue converted from Parent/Leaf queue respectively. Contributed by Prabhu Joseph.
...
(cherry picked from commit 51e7d1b37e
2019-11-04 23:28:39 +05:30
240b5ee380
HDFS-14945. Revise PacketResponder's log. Contributed by Xudong Cao.
...
(cherry picked from commit eb73ba6ed5
2019-11-04 09:40:57 -08:00
11c763c220
YARN-9949. Add missing queue configs for root queue in RMWebService#CapacitySchedulerInfo. Contributed by Prabhu Joseph.
...
(cherry picked from commit d462308e04
2019-11-03 08:48:04 +05:30
c9fc118991
HDFS-14925. Rename operation should check nest snapshot ( #1670 )
...
If the src directory or any of its descendant is snapshottable
and the dst directory or any of its ancestors is snapshottable,
we consider this as nested snapshot, which should be denied.
Reviewed-by: Shashikant Banerjee <shashikant@apache.org>
(cherry picked from commit de6b8b0c0b
2019-11-01 16:39:18 -07:00
b1821be1ec
HDFS-13736. BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false. Contributed by hu xiaodong.
2019-11-01 22:51:50 +05:30
9ccfc2d6d3
Add 2.10.0 release notes for HDFS-12943
...
(cherry picked from commit ef9d12df24
2019-10-31 20:34:36 -07:00
239505a0af
HDFS-14920. Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission. Contributed by Fei Hui.
2019-10-31 23:53:06 +05:30
5d2ffcc7aa
Make upstream aware of 2.10.0 release
...
(cherry picked from commit 7663db59c097c82eeed2df7a91168a4d7123c96b)
2019-10-30 20:59:20 -07:00
a37a4bc62f
HADOOP-16598. Backport "HADOOP-16558 [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes" to all active branches
...
Signed-off-by: stack <stack@apache.org>
2019-10-30 20:26:54 -07:00
Surendra Singh Lilhore
Szilard Nemeth
prabhujoseph
Sunil G
HUAN-PING SU
Ayush Saxena
Tao Yang
Wei-Chiu Chuang
Wanqiang Ji
He Xiaoqiao
Eric Yang
Abhishek Modi
Andras Bokor
Lukas Majercak
Erik Krogen
Akira Ajisaka
Xudong Cao
Chao Sun
Siyao Meng
Chen Liang
Ahmed Hussein
Jonathan Eagles
Zhao Junwang
Jonathan Hung
Jonathan Hung
Duo Zhang