Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,502 Commits 326 Branches 371 Tags
Commit Graph

13502 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Naganarasimha
b08ef44d9e YARN-6428. Queue AM limit is not honored in CS always. Contributed by Bibin A Chundatt. 
(cherry picked from commit 626d730bfc4c1f6ea54e8a246a0a676cdb74937f)
 2017-07-09 17:27:50 +05:30
Daniel Templeton
fcef28e53b YARN-6410. FSContext.scheduler should be final (Contributed by Yeliang Cang via Daniel Templeton) 
(cherry picked from commit 9d278804425f0118b590d302985408e0794b88bb)
 2017-07-09 19:38:37 +09:00
Daniel Templeton
a6d194d720 YARN-6746. SchedulerUtils.checkResourceRequestMatchingNodePartition() is dead code 
(Contributed by Deepti Sawhney via Daniel Templeton)

(cherry picked from commit c5a0c38d8e1752031d1dd8bdd4a7a3894cf775cb)
 2017-07-09 19:31:20 +09:00
Daniel Templeton
edcfae8258 YARN-6752. Display reserved resources in web UI per application 
(Contributed by Abdullah Yousufi via Daniel Templeton)

(cherry picked from commit 06159858868a9cbeefc31bc6be5ae48a59cc8a6c)
 2017-07-09 19:19:07 +09:00
Junping Du
f823f9fd78 MAPREDUCE-6246. DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2. Contributed by ramtin and Gergely Novák. 
(cherry picked from commit f484a6ff602d48413556a1d046670e2003c71c2e)
 2017-07-07 13:27:56 -07:00
Akira Ajisaka
1c40df5bcd
HADOOP-14587. Use GenericTestUtils.setLogLevel when available in hadoop-common. Contributed by Wenxin He. 2017-07-08 03:01:18 +09:00
Wei-Chiu Chuang
730b21e9f9 HADOOP-14563. LoadBalancingKMSClientProvider#warmUpEncryptedKeys swallows IOException. Contributed by Rushabh S Shah. 
(cherry picked from commit 8153fe2bd35fb4df0b64f93ac0046e34d4807ac3)
 2017-07-07 06:14:07 -07:00
Eric Payne
eda4ac07c1 YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Contributed by Sunil G) 2017-07-06 10:43:00 -05:00
Jason Lowe
53c2441c10 YARN-6708. Nodemanager container crash after ext3 folder limit. Contributed by Bibin A Chundatt 
(cherry picked from commit 7576a688ea84aed7206321b1f03594e43a5f216e)
 2017-07-06 09:44:02 -05:00
Jason Lowe
f0435db089 MAPREDUCE-6911. TestMapreduceConfigFields.testCompareXmlAgainstConfigurationClass fails consistently. Contributed by Eric Badger 2017-07-06 09:22:55 -05:00
Mingliang Liu
b803641523 HDFS-12089. Fix ambiguous NN retry log message in WebHDFS. Contributed by Eric Badger 
(cherry picked from commit 6436768baf1b2ac05f6786edcd76fd3a66c03eaa)
 2017-07-05 11:12:15 -07:00
Vinayakumar B
1e8301b215 HADOOP-13414. Hide Jetty Server version header in HTTP responses. Contributed by Surendra Singth Lilhore. 2017-07-05 16:06:19 +05:30
Steve Loughran
3404824854 HADOOP-14617. Add ReflectionUtils.logThreadInfo that accept slf4j logger API. 
Contributed by Wenxin He.

(cherry picked from commit 128d8bc3e9d792fde9cacd9e1d786db8ef682b0b)
 2017-07-04 11:40:46 +01:00
Wenxin He
ca8102962f
HADOOP-14571. Deprecate public APIs relate to log4j1 
This closes #244

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit f2aba1da30aae482a2d65696493b609948f9b904)
 2017-07-04 18:56:41 +09:00
Steve Loughran
4ceb3bd4b3
HADOOP-14615. Add ServiceOperations.stopQuietly that accept slf4j logger API. 
Contributed by Wenxin He.

(cherry picked from commit 1aaa7f1eacab20d1c27f410333a536033cad1aab)
 2017-07-04 10:49:20 +01:00
Akira Ajisaka
ac333155fb
MAPREDUCE-6909. LocalJobRunner fails when run on a node from multiple users. Contributed by Jason Lowe. 2017-07-04 15:25:33 +09:00
Akira Ajisaka
063f2132ef
HDFS-12078. Add time unit to the description of property dfs.namenode.stale.datanode.interval in hdfs-default.xml. Contributed by Weiwei Yang. 
(cherry picked from commit 186650d21d482e2f3bc4523ae989ebe76081b0e3)
 2017-07-04 14:52:39 +09:00
Akira Ajisaka
003b4a1675
HDFS-12079. Description of dfs.block.invalidate.limit is incorrect in hdfs-default.xml. Contributed by Weiwei Yang. 
(cherry picked from commit b0560e0624756e2b3ce7b6bc741eee3c18d2a873)
 2017-07-04 14:03:07 +09:00
Naganarasimha
4fd6aad010 MAPREDUCE-6905. HADOOP_JOB_HISTORY_OPTS should be HADOOP_JOB_HISTORYSERVER_OPTS in mapred-config.sh. Contributed by LiXin Ge. 
(cherry picked from commit bf1f59937dd5d860c9ed7fefce203d6a9f645182)
 2017-07-02 16:01:02 +05:30
Naganarasimha
87c81cfad3 YARN-6681. Eliminate double-copy of child queues in canAssignToThisQueue. Contributed by Daryn Sharp. 
(cherry picked from commit fa1aaee87b0141a0255b5f8e5fd8e8f49d7efe86)
 2017-07-01 12:32:01 +05:30
Wei-Chiu Chuang
94bc5cdbb3 HDFS-12042. Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption. Contributed by Misha Dmitriev. 
(cherry picked from commit bcba844d1144cc334e2babbc34c9d42eac1c203a)
 2017-06-30 11:42:51 -07:00
Mingliang Liu
2d69952925 HADOOP-14596. AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs error. Contributed by Steve Loughran 
Change-Id: I49173bf6163796903d64594a8ca8a4bd26ad2bfc
(cherry picked from commit 72993b33b704991f2a0bf743f31b164e58a2dabc)
 2017-06-29 17:08:51 -07:00
Daniel Templeton
93c5421a43 YARN-6751. Display reserved resources in web UI per queue 
(Contributed by Abdullah Yousufi via Daniel Templeton)

(cherry picked from commit ec975197799417a1d5727dedc395fe6c15c30eb2)
 2017-06-29 16:57:23 -07:00
Daniel Templeton
367f525e81 HADOOP-14611. NetworkTopology.DEFAULT_HOST_LEVEL is unused 
(Contributed by Chen Liang via Daniel Templeton)

(cherry picked from commit 5a75f73893567151f525950cc1a15b3f1bfeac26)
 2017-06-29 16:56:55 -07:00
John Zhuge
1272ee153b HADOOP-14024. KMS JMX endpoint throws ClassNotFoundException. Contributed by John Zhuge. 2017-06-29 15:54:30 -07:00
Wei-Chiu Chuang
6917c19167 HDFS-11881. NameNode consumes a lot of memory for snapshot diff report generation. Contributed by Manoj Govindassamy. 
(cherry picked from commit 16c8dbde574f49827fde5ee9add1861ee65d4645)
 2017-06-29 06:40:24 -07:00
Daniel Templeton
15242786b6 YARN-6743. yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml 
(Contributed by Lori Loberg via Daniel Templeton)

(cherry picked from commit 25d891a784304fcf02f57bc7984c31af45003553)
 2017-06-28 17:17:56 -07:00
Junping Du
c5f43feb7c YARN-5311. Document graceful decommission CLI and usage. Contributed by Elek, Marton. 
(cherry picked from commit 4e3eebc943835077e3dd0df9e0b9239ae604cb89)
 2017-06-28 15:32:49 -07:00
Mingliang Liu
ba76897392 HADOOP-14609. NPE in AzureNativeFileSystemStore.checkContainer() if StorageException lacks an error code. Contributed by Steve Loughran 
(cherry picked from commit 990aa34de23c625163745ebc338483065d955bbe)
 2017-06-28 14:20:44 -07:00
Naganarasimha
a5ae7c0cae YARN-6467. CSQueueMetrics needs to update the current metrics for default partition only. Contributed by Manikandan R. 2017-06-29 00:09:30 +05:30
Steve Loughran
44d43a8848
HADOOP-14190. Add more on S3 regions to the s3a documentation. 
Contributed by Steve Loughran

(cherry picked from commit ee243e5289212aa2912d191035802ea023367e19)
 2017-06-28 10:26:05 +01:00
Xiao Chen
7e66e133dd HADOOP-14515. Addendum. Specifically configure zookeeper-related log levels in KMS log4j. 
(cherry picked from commit aff7a3f8eddd55501366a43d2f44f531c6e8ef48)
 2017-06-27 23:49:16 -07:00
Akira Ajisaka
2a5a313539
MAPREDUCE-6697. Concurrent task limits should only be applied when necessary. Contributed by Nathan Roberts. 
(cherry picked from commit a5c0476a990ec1e7eb34ce2462a45aa52cc1350d)
 2017-06-28 10:51:23 +09:00
Mingliang Liu
ce57458ec5 HADOOP-14546. Azure: Concurrent I/O does not work when secure.mode is enabled. Contributed by Thomas 
(cherry picked from commit 7e031c2c18b8812ec9f843ed3b4abe9e6d12bb28)
 2017-06-27 17:32:56 -07:00
Mingliang Liu
1b1065a163 HADOOP-14573. regression: Azure tests which capture logs failing with move to SLF4J. Contributed by Steve Loughran 
(cherry picked from commit 686a634f01e454537d1a9d531330e60a60233ca4)
 2017-06-27 16:49:48 -07:00
Jason Lowe
44b3c6ffaa YARN-6738. LevelDBCacheTimelineStore should reuse ObjectMapper instances. Contributed by Zoltan Haindrich 
(cherry picked from commit 63ce1593c5b78eb172773e7498d9c321debe81e8)
 2017-06-27 17:13:49 -05:00
Mingliang Liu
ea402c364f HADOOP-14594. ITestS3AFileOperationCost::testFakeDirectoryDeletion to uncomment metric assertions. Contributed by Mingliang Liu 
(cherry picked from commit bc4dfe9c9cb31f39e8f1532d5c5837faf2e92bde)
 2017-06-27 13:20:03 -07:00
Steve Loughran
15d88b77d1
HADOOP-14536. Update azure-storage sdk to version 5.3.0 
Contributed by Georgi Chalakov
 2017-06-27 15:23:06 +01:00
Akira Ajisaka
a896c0f11e
HDFS-12040. TestFsDatasetImpl.testCleanShutdownOfVolume fails. Contributed by hu xiaodong. 
(cherry picked from commit 07defa4c09db6e8c552167019ca0d2444cfc8fe7)
 2017-06-27 20:49:56 +09:00
Steve Loughran
3a87591df8 HADOOP-14461 Azure: handle failure gracefully in case of missing account access key. Contributed by Mingliang Liu. 
(cherry picked from commit 48f4a229a93b65df9e99df2505719dd3538f1188)
 2017-06-26 15:22:44 -07:00
Ravi Prakash
ef491f4637 HDFS-11993. Add log info when connect to datanode socket address failed. Contributed by chencan 
(cherry picked from commit a9d3412b4ce40f5ab5a18756ede7e0606b653171)
 2017-06-26 13:25:32 -07:00
Akira Ajisaka
b59b96deee
HDFS-11992. Replace commons-logging APIs with slf4j in FsDatasetImpl. Contributed by hu xiaodong. 2017-06-27 03:28:09 +09:00
Akira Ajisaka
239b382153
HADOOP-14549. Use GenericTestUtils.setLogLevel when available in hadoop-tools. Contributed by wenxin he. 
(cherry picked from commit a594f96fb1155d94fe08ed8f85dca789a9a4c790)
 2017-06-26 16:41:44 +09:00
Naganarasimha
92e266c2b6 YARN-5006. ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk. Contributed by Bibin A Chundatt. 2017-06-24 23:14:51 +05:30
Arpit Agarwal
4b420e0678 HADOOP-14543. ZKFC should use getAversion() while setting the zkacl. Contributed by Brahma Reddy Battula. 2017-06-23 16:50:56 -07:00
Steve Loughran
093eb0d361
HADOOP-14547. [WASB] the configured retry policy is not used for all storage operations. 
Contributed by Thomas.

(cherry picked from commit c6bd73c6c5760c3a52203e6a51628587ceec6896)
 2017-06-23 21:40:05 +01:00
Yufei Gu
4c59b446e2 YARN-5876. TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunk. (Robert Kanter via Yufei Gu) 
(cherry picked from commit 0b77262890d76b0a3a35fa64befc8a406bc70b27)
 2017-06-23 13:30:20 -07:00
Kihwal Lee
0719345909 Addendum for HADOOP-14146. Use commons Base64 instead of jdk8 Base64. 2017-06-23 13:26:29 -05:00
Kihwal Lee
4c6184b41c Addendum for HADOOP-14146 jdk7 support. 2017-06-23 09:57:51 -05:00
Steve Loughran
5858bc70a2
HADOOP-14568. GenericTestUtils#waitFor missing parameter verification. 
Contributed by Yiqun Lin

(cherry picked from commit e5db9af8a00ded73ee1c75bb4c0d5d50e15a305c)
 2017-06-23 14:41:08 +01:00