Commit Graph

21042 Commits

Author SHA1 Message Date
Aravindan Vijayan f0c1403ec3 HADOOP-16718. Allow disabling Server Name Indication (SNI) for Jetty. Contributed by Aravindan Vijayan.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Siyao Meng <smeng@cloudera.com>
(cherry picked from commit f1ab7f18c4)
2019-12-03 15:48:15 -08:00
Erik Krogen c1ed247459 HADOOP-16700. Track response time separately in Server.Call to avoid negative RpcQueueTime values. Contributed by xuzq.
(cherry picked from be77231452)
2019-12-03 14:01:16 -08:00
Sahil Takiar c47d4d9c3f HADOOP-16685: FileSystem#listStatusIterator does not check if given path exists (#1695)
(cherry picked from commit 3161813482)
2019-12-03 13:34:41 -08:00
Surendra Singh Lilhore 298cda22a3 HDFS-15010. BlockPoolSlice#addReplicaThreadPool static pool should be initialized by static method. Contributed by Surendra Singh Lilhore. 2019-11-28 23:58:46 +05:30
Szilard Nemeth 2ad7b90505 YARN-9993. Remove incorrectly committed files from YARN-9011. Contributed by Wilfred Spiegelenburg 2019-11-28 12:39:54 +01:00
prabhujoseph e8304426b1 MAPREDUCE-7249. Fix Invalid event TA_TOO_MANY_FETCH_FAILURE at SUCCESS_CONTAINER_CLEANUP causes job failure.
Contributed by Wilfred Spiegelenburg.
2019-11-28 14:32:28 +05:30
Sunil G f9b872b6ec YARN-9949. Add missing queue configs for root queue in RMWebService#CapacitySchedulerInfo.
Contributed by Prabhu Joseph.
2019-11-27 23:14:33 +05:30
Szilard Nemeth 8eda9fcab8 YARN-9937. Add missing queue configs in RMWebService#CapacitySchedulerQueueInfo.
Contributed by Prabhu Joseph.
2019-11-27 22:24:06 +05:30
prabhujoseph 66e58b5525 MAPREDUCE-7240. Fix Invalid event: TA_TOO_MANY_FETCH_FAILURE at SUCCESS_FINISHING_CONTAINER.
Contributed by Huachao and Peter Bacsko. Reviewed by Wilfred Spiegelenburg.
2019-11-27 16:09:24 +05:30
Szilard Nemeth 3fc8930129 YARN-9011. Race condition during decommissioning. Contributed by Peter Bacsko 2019-11-26 14:26:58 +01:00
HUAN-PING SU 59a6261e81
YARN-9966. Code duplication in UserGroupMappingPlacementRule (#1709)
(cherry picked from commit f8e36e03b4)
2019-11-25 15:29:37 +09:00
Ayush Saxena 32fdb3004a HDFS-14519. NameQuota is not update after concat operation, so namequota is wrong. Contributed by Ranith Sardar. 2019-11-23 02:36:38 +05:30
Szilard Nemeth dcc453b4b8 YARN-9968. Public Localizer is exiting in NodeManager due to NullPointerException. Contributed by Tarun Parimi 2019-11-22 12:59:35 +01:00
Tao Yang af495192a5 YARN-9838. Fix resource inconsistency for queues when moving app with reserved container to another queue. Contributed by jiulongzhu. 2019-11-22 16:14:16 +08:00
Surendra Singh Lilhore 39366b1370 HDFS-14940. HDFS Balancer : Do not allow to set balancer maximum network bandwidth more than 1TB. Contributed by hemanthboyina. 2019-11-22 00:33:42 +05:30
Wei-Chiu Chuang bd2f79cfd8 HADOOP-15686. Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr. Contributed by Wei-Chiu Chuang.
Reviewed-by: Xiaoyu Yao <xyao@apache.org>
(cherry picked from commit 9664b9c7a6)
2019-11-20 13:08:40 -08:00
Wanqiang Ji 4c79e2a02b
HADOOP-16719. Remove the disallowed element config within maven-checkstyle-plugin (#1724)
(cherry picked from commit dfc61d8ea5)
2019-11-20 16:19:45 +09:00
He Xiaoqiao 5fe9b81941 HDFS-14952. Skip safemode if blockTotal is 0 in new NN. Contributed by Xiaoqiao He.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Mukul Kumar Singh <msingh@apache.org>
(cherry picked from commit 0b50aa29fd)
2019-11-19 12:22:30 -08:00
Szilard Nemeth 62622ab9c1 YARN-9836. General usability improvements in showSimulationTrace.html. Contributed by Adam Antal 2019-11-19 21:21:17 +01:00
Eric Yang 6951689f4c YARN-9983. Fixed typo in YARN Service overview.
Contributed by Denes Gerencser
2019-11-19 14:19:49 -05:00
Abhishek Modi 31591bb296 YARN-9791. Queue Mutation API does not allow to remove a config. Contributed by Prabhu Joseph.
(cherry picked from commit 751b5a1ac8)
2019-11-19 16:49:14 +05:30
Sunil G b04f152876 YARN-9909. Offline Format of YarnConfigurationStore. Contributed by Prabhu Joseph 2019-11-19 16:10:02 +05:30
Sunil G c1ec51696c YARN-8373. RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH. Contributed by Wilfred Spiegelenburg.
(cherry picked from commit ea68756c0c)
2019-11-19 14:12:03 +05:30
Sunil G 049279bb66 YARN-9984. FSPreemptionThread can cause NullPointerException while app is unregistered with containers running on a node. Contributed by Wilfred Spiegelenburg.
(cherry picked from commit 215f2052fc)
2019-11-19 14:05:11 +05:30
Ayush Saxena 051dae1f89 HDFS-14942. Change Log Level to debug in JournalNodeSyncer#syncWithJournalAtIndex. Contributed by Lisheng Sun.
(cherry picked from commit 9e287054a8)
2019-11-18 10:24:53 -08:00
Ayush Saxena bcca7120e0 HADOOP-16712. Config ha.failover-controller.active-standby-elector.zk.op.retries is not in core-default.xml. Contributed by Xieming Li. 2019-11-18 19:52:36 +05:30
Andras Bokor 89e95370a4 HADOOP-16710. Testing_azure.md documentation is misleading.
Contributed by Andras Bokor.

Change-Id: Icf07a53145936953629c7dace2e9648b7b21588d
2019-11-17 17:06:10 +00:00
Lukas Majercak b914f385a0 HADOOP-16705. MBeanInfoBuilder puts unnecessary memory pressure on the system with a debug log.
MBeanInfoBuilder's get() method DEBUG logs all the MBeanAttributeInfo attributes that it gathered. This can have a high memory churn that can be easily avoided.

(cherry picked from commit c73334a924)
2019-11-15 13:30:11 -08:00
Erik Krogen 60655bfe54 HDFS-14973. More strictly enforce Balancer/Mover/SPS throttling of getBlocks RPCs to NameNodes. Contributed by Erik Krogen.
(cherry picked from b2cc8b6b4a)
2019-11-15 10:11:56 -08:00
Akira Ajisaka ea9c74d9c1
HADOOP-15097. AbstractContractDeleteTest::testDeleteNonEmptyDirRecursive with misleading path. Contributed by Xieming Li.
(cherry picked from commit 92c28c100e)
2019-11-15 13:51:09 +09:00
Erik Krogen dec765b329 HDFS-14979 Allow Balancer to submit getBlocks calls to Observer Nodes when possible. Contributed by Erik Krogen.
(cherry picked from 586defe711)
2019-11-13 11:57:42 -08:00
Xudong Cao 975f669141 HADOOP-16677. Recalculate the remaining timeout millis correctly while throwing an InterupptedException in SocketIOWithTimeout. (#1687)
(cherry picked from commit df6b3162c1)
2019-11-12 14:21:50 -08:00
Chao Sun 0c12d633b9 HDFS-14959: [SBNN read] access time should be turned off (#1706) Contributed by Chao Sun.
(cherry picked from commit 97ec34e117)
2019-11-12 11:40:56 -08:00
Siyao Meng e0cf1735e1 HADOOP-16676. Backport HADOOP-16152 to branch-3.2. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-11-12 11:38:42 -08:00
Surendra Singh Lilhore c4e22e0c80 HDFS-14720. DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE. Contributed by hemanthboyina.
(cherry picked from commit 320008bb7c)
2019-11-09 22:28:15 +05:30
Ayush Saxena 2e843cb773 HDFS-14958. TestBalancerWithNodeGroup is not using NetworkTopologyWithNodeGroup. Contributed by Jim Brennan. 2019-11-07 22:50:30 +05:30
Akira Ajisaka 3aa161a114 HDFS-14590. [SBN Read] Add the document link to the top page. Contributed by Takanobu Asanuma.
(cherry picked from commit 48d7f00da8)
2019-11-07 22:29:01 +09:00
Chen Liang c9ed0c3a37 HDFS-14806. Bootstrap standby may fail if with in-progress tailing. Contributed by Chen Liang and Erik Krogen. 2019-11-06 16:12:51 -08:00
Chen Liang 431edfcbe4 HDFS-14941. Potential editlog race condition can cause corrupted file. Contributed by Chen Liang and Konstantin Shvachko. 2019-11-06 15:00:15 -08:00
Ayush Saxena 5941a91f64 HDFS-14946. Erasure Coding: Block recovery failed during decommissioning. Contributed by Fei Hui. 2019-11-06 22:10:27 +05:30
Surendra Singh Lilhore aa1c795dc9 HDFS-14384. When lastLocatedBlock token expire, it will take 1~3s second to refetch it. Contributed by Surendra Singh Lilhore.
(cherry picked from commit c36014165c)
2019-11-06 19:37:41 +05:30
Ahmed Hussein 56988e88f7 MAPREDUCE-7208. Tuning TaskRuntimeEstimator. (Ahmed Hussein via jeagles)
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit ed302f1fed)
2019-11-05 15:21:51 -06:00
Jonathan Eagles 254e18dcaf Revert "YARN-9949. Add missing queue configs for root queue in RMWebService#CapacitySchedulerInfo. Contributed by Prabhu Joseph."
This reverts commit 11c763c220.
2019-11-05 15:10:01 -06:00
Chen Liang a58f466d07 HADOOP-16013. DecayRpcScheduler decay thread should run as a daemon. Contributed by Erik Krogen.
(cherry picked from commit 01cb958af4)
2019-11-04 17:18:27 -08:00
Sunil G 597b315811 YARN-9950. Unset Ordering Policy of Leaf/Parent queue converted from Parent/Leaf queue respectively. Contributed by Prabhu Joseph.
(cherry picked from commit 51e7d1b37e)
2019-11-04 23:28:39 +05:30
Wei-Chiu Chuang 240b5ee380 HDFS-14945. Revise PacketResponder's log. Contributed by Xudong Cao.
(cherry picked from commit eb73ba6ed5)
2019-11-04 09:40:57 -08:00
Sunil G 11c763c220 YARN-9949. Add missing queue configs for root queue in RMWebService#CapacitySchedulerInfo. Contributed by Prabhu Joseph.
(cherry picked from commit d462308e04)
2019-11-03 08:48:04 +05:30
Zhao Junwang c9fc118991 HDFS-14925. Rename operation should check nest snapshot (#1670)
If the src directory or any of its descendant is snapshottable
and the dst directory or any of its ancestors is snapshottable,
we consider this as nested snapshot, which should be denied.

Reviewed-by: Shashikant Banerjee <shashikant@apache.org>
(cherry picked from commit de6b8b0c0b)
2019-11-01 16:39:18 -07:00
Ayush Saxena b1821be1ec HDFS-13736. BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false. Contributed by hu xiaodong. 2019-11-01 22:51:50 +05:30
Jonathan Hung 9ccfc2d6d3 Add 2.10.0 release notes for HDFS-12943
(cherry picked from commit ef9d12df24)
2019-10-31 20:34:36 -07:00