He Xiaoqiao
5fe9b81941
HDFS-14952. Skip safemode if blockTotal is 0 in new NN. Contributed by Xiaoqiao He.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Mukul Kumar Singh <msingh@apache.org>
(cherry picked from commit 0b50aa29fd
)
2019-11-19 12:22:30 -08:00
Szilard Nemeth
62622ab9c1
YARN-9836. General usability improvements in showSimulationTrace.html. Contributed by Adam Antal
2019-11-19 21:21:17 +01:00
Eric Yang
6951689f4c
YARN-9983. Fixed typo in YARN Service overview.
...
Contributed by Denes Gerencser
2019-11-19 14:19:49 -05:00
Abhishek Modi
31591bb296
YARN-9791. Queue Mutation API does not allow to remove a config. Contributed by Prabhu Joseph.
...
(cherry picked from commit 751b5a1ac8
)
2019-11-19 16:49:14 +05:30
Sunil G
b04f152876
YARN-9909. Offline Format of YarnConfigurationStore. Contributed by Prabhu Joseph
2019-11-19 16:10:02 +05:30
Sunil G
c1ec51696c
YARN-8373. RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH. Contributed by Wilfred Spiegelenburg.
...
(cherry picked from commit ea68756c0c
)
2019-11-19 14:12:03 +05:30
Sunil G
049279bb66
YARN-9984. FSPreemptionThread can cause NullPointerException while app is unregistered with containers running on a node. Contributed by Wilfred Spiegelenburg.
...
(cherry picked from commit 215f2052fc
)
2019-11-19 14:05:11 +05:30
Ayush Saxena
051dae1f89
HDFS-14942. Change Log Level to debug in JournalNodeSyncer#syncWithJournalAtIndex. Contributed by Lisheng Sun.
...
(cherry picked from commit 9e287054a8
)
2019-11-18 10:24:53 -08:00
Ayush Saxena
bcca7120e0
HADOOP-16712. Config ha.failover-controller.active-standby-elector.zk.op.retries is not in core-default.xml. Contributed by Xieming Li.
2019-11-18 19:52:36 +05:30
Andras Bokor
89e95370a4
HADOOP-16710. Testing_azure.md documentation is misleading.
...
Contributed by Andras Bokor.
Change-Id: Icf07a53145936953629c7dace2e9648b7b21588d
2019-11-17 17:06:10 +00:00
Lukas Majercak
b914f385a0
HADOOP-16705. MBeanInfoBuilder puts unnecessary memory pressure on the system with a debug log.
...
MBeanInfoBuilder's get() method DEBUG logs all the MBeanAttributeInfo attributes that it gathered. This can have a high memory churn that can be easily avoided.
(cherry picked from commit c73334a924
)
2019-11-15 13:30:11 -08:00
Erik Krogen
60655bfe54
HDFS-14973. More strictly enforce Balancer/Mover/SPS throttling of getBlocks RPCs to NameNodes. Contributed by Erik Krogen.
...
(cherry picked from b2cc8b6b4a
)
2019-11-15 10:11:56 -08:00
Akira Ajisaka
ea9c74d9c1
HADOOP-15097. AbstractContractDeleteTest::testDeleteNonEmptyDirRecursive with misleading path. Contributed by Xieming Li.
...
(cherry picked from commit 92c28c100e
)
2019-11-15 13:51:09 +09:00
Erik Krogen
dec765b329
HDFS-14979 Allow Balancer to submit getBlocks calls to Observer Nodes when possible. Contributed by Erik Krogen.
...
(cherry picked from 586defe711
)
2019-11-13 11:57:42 -08:00
Xudong Cao
975f669141
HADOOP-16677. Recalculate the remaining timeout millis correctly while throwing an InterupptedException in SocketIOWithTimeout. ( #1687 )
...
(cherry picked from commit df6b3162c1
)
2019-11-12 14:21:50 -08:00
Chao Sun
0c12d633b9
HDFS-14959: [SBNN read] access time should be turned off ( #1706 ) Contributed by Chao Sun.
...
(cherry picked from commit 97ec34e117
)
2019-11-12 11:40:56 -08:00
Siyao Meng
e0cf1735e1
HADOOP-16676. Backport HADOOP-16152 to branch-3.2. Contributed by Siyao Meng.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-11-12 11:38:42 -08:00
Surendra Singh Lilhore
c4e22e0c80
HDFS-14720. DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE. Contributed by hemanthboyina.
...
(cherry picked from commit 320008bb7c
)
2019-11-09 22:28:15 +05:30
Ayush Saxena
2e843cb773
HDFS-14958. TestBalancerWithNodeGroup is not using NetworkTopologyWithNodeGroup. Contributed by Jim Brennan.
2019-11-07 22:50:30 +05:30
Akira Ajisaka
3aa161a114
HDFS-14590. [SBN Read] Add the document link to the top page. Contributed by Takanobu Asanuma.
...
(cherry picked from commit 48d7f00da8
)
2019-11-07 22:29:01 +09:00
Chen Liang
c9ed0c3a37
HDFS-14806. Bootstrap standby may fail if with in-progress tailing. Contributed by Chen Liang and Erik Krogen.
2019-11-06 16:12:51 -08:00
Chen Liang
431edfcbe4
HDFS-14941. Potential editlog race condition can cause corrupted file. Contributed by Chen Liang and Konstantin Shvachko.
2019-11-06 15:00:15 -08:00
Ayush Saxena
5941a91f64
HDFS-14946. Erasure Coding: Block recovery failed during decommissioning. Contributed by Fei Hui.
2019-11-06 22:10:27 +05:30
Surendra Singh Lilhore
aa1c795dc9
HDFS-14384. When lastLocatedBlock token expire, it will take 1~3s second to refetch it. Contributed by Surendra Singh Lilhore.
...
(cherry picked from commit c36014165c
)
2019-11-06 19:37:41 +05:30
Ahmed Hussein
56988e88f7
MAPREDUCE-7208. Tuning TaskRuntimeEstimator. (Ahmed Hussein via jeagles)
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit ed302f1fed
)
2019-11-05 15:21:51 -06:00
Jonathan Eagles
254e18dcaf
Revert "YARN-9949. Add missing queue configs for root queue in RMWebService#CapacitySchedulerInfo. Contributed by Prabhu Joseph."
...
This reverts commit 11c763c220
.
2019-11-05 15:10:01 -06:00
Chen Liang
a58f466d07
HADOOP-16013. DecayRpcScheduler decay thread should run as a daemon. Contributed by Erik Krogen.
...
(cherry picked from commit 01cb958af4
)
2019-11-04 17:18:27 -08:00
Sunil G
597b315811
YARN-9950. Unset Ordering Policy of Leaf/Parent queue converted from Parent/Leaf queue respectively. Contributed by Prabhu Joseph.
...
(cherry picked from commit 51e7d1b37e
)
2019-11-04 23:28:39 +05:30
Wei-Chiu Chuang
240b5ee380
HDFS-14945. Revise PacketResponder's log. Contributed by Xudong Cao.
...
(cherry picked from commit eb73ba6ed5
)
2019-11-04 09:40:57 -08:00
Sunil G
11c763c220
YARN-9949. Add missing queue configs for root queue in RMWebService#CapacitySchedulerInfo. Contributed by Prabhu Joseph.
...
(cherry picked from commit d462308e04
)
2019-11-03 08:48:04 +05:30
Zhao Junwang
c9fc118991
HDFS-14925. Rename operation should check nest snapshot ( #1670 )
...
If the src directory or any of its descendant is snapshottable
and the dst directory or any of its ancestors is snapshottable,
we consider this as nested snapshot, which should be denied.
Reviewed-by: Shashikant Banerjee <shashikant@apache.org>
(cherry picked from commit de6b8b0c0b
)
2019-11-01 16:39:18 -07:00
Ayush Saxena
b1821be1ec
HDFS-13736. BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false. Contributed by hu xiaodong.
2019-11-01 22:51:50 +05:30
Jonathan Hung
9ccfc2d6d3
Add 2.10.0 release notes for HDFS-12943
...
(cherry picked from commit ef9d12df24
)
2019-10-31 20:34:36 -07:00
Ayush Saxena
239505a0af
HDFS-14920. Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission. Contributed by Fei Hui.
2019-10-31 23:53:06 +05:30
Jonathan Hung
5d2ffcc7aa
Make upstream aware of 2.10.0 release
...
(cherry picked from commit 7663db59c097c82eeed2df7a91168a4d7123c96b)
2019-10-30 20:59:20 -07:00
Duo Zhang
a37a4bc62f
HADOOP-16598. Backport "HADOOP-16558 [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes" to all active branches
...
Signed-off-by: stack <stack@apache.org>
2019-10-30 20:26:54 -07:00
Wei-Chiu Chuang
d25211af30
HADOOP-16675. Upgrade jackson-databind to 2.9.10.1. Contributed by Lisheng Sun.
...
(cherry picked from commit 012756a0d9
)
2019-10-29 13:37:42 -07:00
Steve Loughran
1932499eaf
HADOOP-16669. TestRawLocalFileSystemContract.testPermission fails if no native library.
...
Contributed by Steve Loughran.
Change-Id: I622e36f17a63c775c5e33e93b8b26e461d0bc451
2019-10-29 17:10:46 +00:00
Eric Badger
3d9127dc97
HDFS-14931. hdfs crypto commands limit column width. Contributed by Eric Badger
...
(cherry picked from commit 9ef6ed9c1c
)
2019-10-28 16:38:28 +00:00
Rakesh Radhakrishnan
a6cdcf676e
HDFS-14818. Check native pmdk lib by 'hadoop checknative' command. Contributed by Feilong He.
...
(cherry picked from commit 659c88801d
)
2019-10-28 10:41:40 +05:30
Rakesh Radhakrishnan
dc2fad4bd3
HDFS-14700. Clean up pmem cache before setting pmem cache capacity. Contributed by Feilong He.
...
(cherry picked from commit f6fa865d6f
)
2019-10-28 10:41:25 +05:30
Rakesh Radhakrishnan
c6d59e6a47
HDFS-14357. Update documentation for HDFS cache on SCM support. Contributed by Feilong He.
...
(cherry picked from commit 30a8f840f1
)
2019-10-28 10:41:12 +05:30
Rakesh Radhakrishnan
75c66bf044
HDFS-14458. Report pmem stats to namenode. Contributed by Feilong He.
...
(cherry picked from commit e98adb00b7
)
2019-10-28 10:40:59 +05:30
Sammi Chen
6eb5fb596f
HDFS-14356. Implement HDFS cache on SCM with native PMDK libs. Contributed by Feilong He.
...
(cherry picked from commit d1aad44490
)
2019-10-28 10:40:46 +05:30
Rakesh Radhakrishnan
0fe720dc48
HDFS-14402. Use FileChannel.transferTo() method for transferring block to SCM cache. Contributed by Feilong He.
...
(cherry picked from commit 37900c5639
)
2019-10-28 10:40:32 +05:30
Rakesh Radhakrishnan
f3571c1f09
HDFS-14401. Refine the implementation for HDFS cache on SCM. Contributed by Feilong He.
2019-10-28 10:40:15 +05:30
Uma Maheswara Rao G
6bc73a983d
HDFS-14355 : Implement HDFS cache on SCM by using pure java mapped byte buffer. Contributed by Feilong He.
2019-10-28 10:37:34 +05:30
Rakesh Radhakrishnan
0c6824120a
HDFS-14393. Refactor FsDatasetCache for SCM cache implementation. Contributed by Rakesh R
...
(cherry picked from commit f3f51284d5
)
2019-10-28 10:33:45 +05:30
Uma Maheswara Rao G
3f6f095c06
HDFS-14354: Refactor MappableBlock to align with the implementation of SCM cache. Contributed by Feilong He.
...
(cherry picked from commit ba50a36a3e
)
2019-10-28 10:33:29 +05:30
Fei Hui
54d3e212bf
HDFS-14923. Remove dead code from HealthMonitor. Contributed by Fei Hui.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 7be5508d9b
)
2019-10-25 15:06:46 -07:00