Commit Graph

14219 Commits

Author SHA1 Message Date
Subru Krishnan 0282efab14 YARN-7476. Fix miscellaneous issues in ATSv2 after merge to branch-2. (Varun Saxena via Subru). 2017-11-12 09:19:30 -08:00
Subru Krishnan 3c5b46c2ed YARN-7475. Fix Container log link in new YARN UI. (Sunil G via Subru). 2017-11-12 09:18:08 -08:00
Arun Suresh 5cd92ed555 YARN-6627. Addendum patch for branch-2. (Sunil G via asuresh) 2017-11-11 09:10:17 -08:00
Subru Krishnan 132c2e7a2a HADOOP-15030. [branch-2] Include hadoop-cloud-storage-project in the main hadoop pom modules. 2017-11-10 13:48:46 -08:00
Arun Suresh 0411c710d2 YARN-6102. Addendum patch for branch-2. (Rohith Sharma K S via asuresh) 2017-11-10 13:44:03 -08:00
Xiao Chen 39fb402da4 HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by Misha Dmitriev.
(cherry picked from commit 3c6adda291)
2017-11-09 21:06:55 -08:00
Arun Suresh 7af9b8ad1e Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh) 2017-11-09 15:10:21 -08:00
Haibo Chen 3fbe67d3e1 YARN-7388. TestAMRestart should be scheduler agnostic.
(cherry picked from commit a1382a18df)
(cherry picked from commit 91a7f8d246)
2017-11-09 10:57:50 -08:00
John Zhuge a42a19e139 HDFS-12052. Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS. Contributed by Zoran Dimitrijevic.
(cherry picked from commit 12c8fdceaf)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebServer.java
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java
2017-11-09 09:47:11 -08:00
John Zhuge d946307faa HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend.
(cherry picked from commit 3123895db0)
2017-11-09 08:58:03 -08:00
Subru Krishnan 5991c218a0 HADOOP-15026. Rebase ResourceEstimator start/stop scripts for branch-2. (Rui Li via Subru). 2017-11-09 00:32:34 -08:00
Subru Krishnan 46a740a82e HADOOP-15025. Ensure singleton for ResourceEstimatorService. (Rui Li via Subru).
(cherry picked from commit f2df6b8983)
2017-11-08 18:09:02 -08:00
Arun Suresh 5486542074 YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh)
(cherry picked from commit a9c70b0e84)
2017-11-08 08:02:23 -08:00
Brahma Reddy Battula eca6385fdd HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula
(cherry picked from commit 410d0319cf)
2017-11-08 14:43:13 +05:30
Brahma Reddy Battula 135abcac4b HDFS-12783. [branch-2] dfsrouter should use hdfsScript. Contributed by Brahma Reddy Battula 2017-11-08 01:45:53 +05:30
bibinchundatt fd4868bdb4 Add containerId to Localizer failed logs. Contributed by Prabhu Joseph
(cherry picked from commit dcd99c4b9a)
2017-11-06 23:09:41 +05:30
Naganarasimha 45e6d36e5c MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph.
(cherry picked from commit 61bbdc511e)
2017-11-06 13:10:41 +05:30
Subru Krishnan 656ab06873 YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure.
(cherry picked from commit 0542e6f86e)
2017-11-03 11:11:25 -07:00
Inigo Goiri 2d8d420f26 YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri.
(cherry picked from commit 6e2259264ad9525eeec2a14055d53236711659d7)
2017-11-02 21:34:34 -07:00
Subru Krishnan 931987f470 YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru).
(cherry picked from commit ad0fff2b41)
2017-11-02 17:40:26 -07:00
Arun Suresh 0200fbac5b HADOOP-15013. Fix ResourceEstimator findbugs issues. (asuresh)
(cherry picked from commit 53c0fb7efe)
2017-11-02 17:18:03 -07:00
Eric Payne 1516a9ef61 YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák.
(cherry picked from commit e6ec02001f)
2017-11-02 12:56:41 -05:00
Wangda Tan 752f000e0f YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda)
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
2017-11-02 09:50:00 -07:00
Jason Lowe 6ad6882343 YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger
(cherry picked from commit b7dee1f060)
2017-11-02 09:50:55 -05:00
Akira Ajisaka 82fc80a987
MAPREDUCE-6999. Fix typo onf in DynamicInputChunk.java. Contributed by fang zhenyi.
(cherry picked from commit cc3f3eca40)
2017-11-02 18:33:25 +09:00
Rohith Sharma K S e53fcd52ee addendum patch for YARN-7289.
(cherry picked from commit 940ffe3f9c)
2017-11-02 14:07:28 +05:30
Junping Du d1f8854a1b YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong.
(cherry picked from commit d57dba9942)
2017-11-01 14:50:44 -07:00
Haibo Chen 32a712a740 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen)
(cherry picked from commit d7f3737f3b)
2017-11-01 14:19:59 -07:00
Daniel Templeton 956d814034 YARN-7146. Many RM unit tests failing with FairScheduler
(Contributed by Robert Kanter via Daniel Templeton)
2017-11-01 14:11:26 -07:00
Inigo Goiri 8180ab436a YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri. 2017-11-01 13:21:15 -07:00
Weiwei Yang 0f20434e18 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang.
(cherry picked from commit 56b88b0670)
2017-11-01 17:01:23 +08:00
Arun Suresh 71a55bebfb Preparing for 2.10.0 development 2017-10-31 12:51:14 -07:00
Subru Krishnan ac41107423 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru).
(cherry picked from commit ed24da3dd7)
2017-10-31 12:11:40 -07:00
Inigo Goiri 15b839c446 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri.
(cherry picked from commit 982bd2a5bf)
2017-10-31 10:24:12 -07:00
Jason Lowe 347997c959 HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
(cherry picked from commit 2fae63aa60)
2017-10-31 09:32:45 -05:00
Sunil G 6dd1db68ff YARN-7398. Update LICENSE.txt with respect to new YARN UI merge. Contributed by Varun Saxena. 2017-10-31 15:36:41 +05:30
Junping Du 76ec5eab12 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release.
(cherry picked from commit a8083aaa6f)
2017-10-30 15:17:30 -07:00
Vrushali C 3454c02c96 YARN-7378 Documentation changes post branch-2 merge (Vrushali C with Varun Saxena) 2017-10-30 14:09:29 -07:00
Chris Douglas 2afb8ba14f HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham
(cherry picked from commit e4878a59b3)
(cherry picked from commit 85be67ebe4)
2017-10-30 09:49:49 -07:00
Yufei Gu 243b70eca8 YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi)
(cherry picked from commit d4811c8cfa)
2017-10-29 16:47:22 -07:00
Varun Saxena e1b3bbde60 YARN-7380. Fix findbugs warning in timeline service on branch-2 (Vrushali C via Varun Saxena). 2017-10-29 16:38:20 +05:30
Arun Suresh 2654d9973e YARN-7299. Fix TestDistributedScheduler. (asuresh)
(cherry picked from commit 9c5c68745e)
2017-10-27 23:11:34 -07:00
Arun Suresh 519aa0e804 YARN-7178. Add documentation for Container Update API. (asuresh)
(cherry picked from commit 24f8c5cce3)
2017-10-27 22:57:46 -07:00
Chris Douglas ee89241282 HADOOP-14991. Add missing figures to Resource Estimator tool. Contributed by Rui Li
(cherry picked from commit 139cc752d2)
(cherry picked from commit 77ad73501c)
2017-10-27 22:01:41 -07:00
Chris Douglas 9e721775a4 HADOOP-14986. Enforce JDK limitations.
(cherry picked from commit b50def3697)
(cherry picked from commit 1660a638f0)
2017-10-27 21:42:42 -07:00
Jason Lowe 9093ad6168 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla
(cherry picked from commit 665bb147aa)
2017-10-27 17:09:29 -05:00
Rohith Sharma K S 548116c3f5 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi.
(cherry picked from commit 5c799ecf09)
2017-10-27 22:51:41 +05:30
Sunil G 88c3b444bd YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh.
(cherry picked from commit 792388e1c0)
2017-10-27 21:11:48 +05:30
Arpit Agarwal 8f28af4fac HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:45:11 -07:00
Steve Loughran 3fbcf76324 HADOOP-14553. Add (parallelized) integration tests to hadoop-azure.
Contributed by Steve Loughran.

(backport JIRA HADOOP-14870)
2017-10-27 12:55:12 +01:00