14121 Commits

Author SHA1 Message Date
Arun Suresh
c153bed6e3 YARN-5049. Addendum patch for branch-2. (asuresh) 2017-11-12 10:16:00 -08:00
Eric Yang
90ac8cd5a1 YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed by Eric Badger)
(cherry picked from commit 7a49ddfdde2e2a7b407f4a62a42d97bfe456075a)
2017-11-12 09:59:39 -08:00
Subru Krishnan
0282efab14 YARN-7476. Fix miscellaneous issues in ATSv2 after merge to branch-2. (Varun Saxena via Subru). 2017-11-12 09:19:30 -08:00
Subru Krishnan
3c5b46c2ed YARN-7475. Fix Container log link in new YARN UI. (Sunil G via Subru). 2017-11-12 09:18:08 -08:00
Arun Suresh
5cd92ed555 YARN-6627. Addendum patch for branch-2. (Sunil G via asuresh) 2017-11-11 09:10:17 -08:00
Subru Krishnan
132c2e7a2a HADOOP-15030. [branch-2] Include hadoop-cloud-storage-project in the main hadoop pom modules. 2017-11-10 13:48:46 -08:00
Arun Suresh
0411c710d2 YARN-6102. Addendum patch for branch-2. (Rohith Sharma K S via asuresh) 2017-11-10 13:44:03 -08:00
Xiao Chen
39fb402da4 HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by Misha Dmitriev.
(cherry picked from commit 3c6adda291745c592741b87cd613214ae11887e4)
2017-11-09 21:06:55 -08:00
Arun Suresh
7af9b8ad1e Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh) 2017-11-09 15:10:21 -08:00
Haibo Chen
3fbe67d3e1 YARN-7388. TestAMRestart should be scheduler agnostic.
(cherry picked from commit a1382a18dff8a70aa25240d6fbba6e22832a7679)
(cherry picked from commit 91a7f8d2463de0a94ded0884143e4661c29868a4)
2017-11-09 10:57:50 -08:00
John Zhuge
a42a19e139 HDFS-12052. Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS. Contributed by Zoran Dimitrijevic.
(cherry picked from commit 12c8fdceaf263425661169cba25402df89d444c1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebServer.java
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java
2017-11-09 09:47:11 -08:00
John Zhuge
d946307faa HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend.
(cherry picked from commit 3123895db0518552eb357093fddf0e8ff1a6cadf)
2017-11-09 08:58:03 -08:00
Subru Krishnan
5991c218a0 HADOOP-15026. Rebase ResourceEstimator start/stop scripts for branch-2. (Rui Li via Subru). 2017-11-09 00:32:34 -08:00
Subru Krishnan
46a740a82e HADOOP-15025. Ensure singleton for ResourceEstimatorService. (Rui Li via Subru).
(cherry picked from commit f2df6b8983aace73ad27934bd9f7f4d766e0b25f)
2017-11-08 18:09:02 -08:00
Arun Suresh
5486542074 YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh)
(cherry picked from commit a9c70b0e84dab0c41e480a0dc0cb1a22efdc64ee)
2017-11-08 08:02:23 -08:00
Brahma Reddy Battula
eca6385fdd HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula
(cherry picked from commit 410d0319cf72b9b5f3807c522237f52121d98cd5)
2017-11-08 14:43:13 +05:30
Brahma Reddy Battula
135abcac4b HDFS-12783. [branch-2] dfsrouter should use hdfsScript. Contributed by Brahma Reddy Battula 2017-11-08 01:45:53 +05:30
bibinchundatt
fd4868bdb4 Add containerId to Localizer failed logs. Contributed by Prabhu Joseph
(cherry picked from commit dcd99c4b9a7a15649dc9823ac060ce23c6a31056)
2017-11-06 23:09:41 +05:30
Naganarasimha
45e6d36e5c MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph.
(cherry picked from commit 61bbdc511e4e98c11a05d7c3bc01f3e971adbe13)
2017-11-06 13:10:41 +05:30
Subru Krishnan
656ab06873 YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure.
(cherry picked from commit 0542e6f86e6734f8ceea00960bebe719827136db)
2017-11-03 11:11:25 -07:00
Inigo Goiri
2d8d420f26 YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri.
(cherry picked from commit 6e2259264ad9525eeec2a14055d53236711659d7)
2017-11-02 21:34:34 -07:00
Subru Krishnan
931987f470 YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru).
(cherry picked from commit ad0fff2b419e8fe8bb5c9a7e19b79dec16cbd96f)
2017-11-02 17:40:26 -07:00
Arun Suresh
0200fbac5b HADOOP-15013. Fix ResourceEstimator findbugs issues. (asuresh)
(cherry picked from commit 53c0fb7efebfac4a79f5cce2dd42cf00411d51e7)
2017-11-02 17:18:03 -07:00
Eric Payne
1516a9ef61 YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák.
(cherry picked from commit e6ec02001fc4eed9eb51c8653d8f931135e49eda)
2017-11-02 12:56:41 -05:00
Wangda Tan
752f000e0f YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda)
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
2017-11-02 09:50:00 -07:00
Jason Lowe
6ad6882343 YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger
(cherry picked from commit b7dee1f0608006e776624a9e4de39811d8aebc97)
2017-11-02 09:50:55 -05:00
Akira Ajisaka
82fc80a987
MAPREDUCE-6999. Fix typo onf in DynamicInputChunk.java. Contributed by fang zhenyi.
(cherry picked from commit cc3f3eca409f5e57e540849a80e6448bb4924cc6)
2017-11-02 18:33:25 +09:00
Rohith Sharma K S
e53fcd52ee addendum patch for YARN-7289.
(cherry picked from commit 940ffe3f9ce74286a8863e3743faf88a33c817a3)
2017-11-02 14:07:28 +05:30
Junping Du
d1f8854a1b YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong.
(cherry picked from commit d57dba99428cbe3f3dfcec834d79f709e7529ef9)
2017-11-01 14:50:44 -07:00
Haibo Chen
32a712a740 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen)
(cherry picked from commit d7f3737f3b3236fbf8c25fdd4656251ed63a2be9)
2017-11-01 14:19:59 -07:00
Daniel Templeton
956d814034 YARN-7146. Many RM unit tests failing with FairScheduler
(Contributed by Robert Kanter via Daniel Templeton)
2017-11-01 14:11:26 -07:00
Inigo Goiri
8180ab436a YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri. 2017-11-01 13:21:15 -07:00
Weiwei Yang
0f20434e18 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang.
(cherry picked from commit 56b88b06705441f6f171eec7fb2fa77946ca204b)
2017-11-01 17:01:23 +08:00
Arun Suresh
71a55bebfb Preparing for 2.10.0 development 2017-10-31 12:51:14 -07:00
Subru Krishnan
ac41107423 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru).
(cherry picked from commit ed24da3dd73c137b44235e525112056ace6d3843)
2017-10-31 12:11:40 -07:00
Inigo Goiri
15b839c446 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri.
(cherry picked from commit 982bd2a5bff4c490a5d62f2e4fd0d3755305349c)
2017-10-31 10:24:12 -07:00
Jason Lowe
347997c959 HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
(cherry picked from commit 2fae63aa60c43b62bd908a9499562fe528603185)
2017-10-31 09:32:45 -05:00
Sunil G
6dd1db68ff YARN-7398. Update LICENSE.txt with respect to new YARN UI merge. Contributed by Varun Saxena. 2017-10-31 15:36:41 +05:30
Junping Du
76ec5eab12 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release.
(cherry picked from commit a8083aaa6f4bcc7287f2b65018a946a840123c50)
2017-10-30 15:17:30 -07:00
Vrushali C
3454c02c96 YARN-7378 Documentation changes post branch-2 merge (Vrushali C with Varun Saxena) 2017-10-30 14:09:29 -07:00
Chris Douglas
2afb8ba14f HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham
(cherry picked from commit e4878a59b3a380e323bb4627a69266bbf2524b36)
(cherry picked from commit 85be67ebe46b0d14e2689fecf4d56374c3a084be)
2017-10-30 09:49:49 -07:00
Yufei Gu
243b70eca8 YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi)
(cherry picked from commit d4811c8cfae02f42a7aae1f775e87b6726caa3c9)
2017-10-29 16:47:22 -07:00
Varun Saxena
e1b3bbde60 YARN-7380. Fix findbugs warning in timeline service on branch-2 (Vrushali C via Varun Saxena). 2017-10-29 16:38:20 +05:30
Arun Suresh
2654d9973e YARN-7299. Fix TestDistributedScheduler. (asuresh)
(cherry picked from commit 9c5c68745ed18883ce8bdbdca379025b23f17f60)
2017-10-27 23:11:34 -07:00
Arun Suresh
519aa0e804 YARN-7178. Add documentation for Container Update API. (asuresh)
(cherry picked from commit 24f8c5cce3adb88e5af84b3e48c4c447ac91e6d3)
2017-10-27 22:57:46 -07:00
Chris Douglas
ee89241282 HADOOP-14991. Add missing figures to Resource Estimator tool. Contributed by Rui Li
(cherry picked from commit 139cc752d21c30bf4d1ca263bb4b0717c48b2c0a)
(cherry picked from commit 77ad73501ce519851f2f80a90aca2d73e8b2e20d)
2017-10-27 22:01:41 -07:00
Chris Douglas
9e721775a4 HADOOP-14986. Enforce JDK limitations.
(cherry picked from commit b50def36970e0afa65bd3fd3f40d8c4f81119200)
(cherry picked from commit 1660a638f04435ca363fe4f07c7f03f109a6784a)
2017-10-27 21:42:42 -07:00
Jason Lowe
9093ad6168 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla
(cherry picked from commit 665bb147aa3fc198e53335931562dd69f9f0e345)
2017-10-27 17:09:29 -05:00
Rohith Sharma K S
548116c3f5 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi.
(cherry picked from commit 5c799ecf09617f634c41bba26d341b2ad45ee852)
2017-10-27 22:51:41 +05:30
Sunil G
88c3b444bd YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh.
(cherry picked from commit 792388e1c0ebaeb01db194412e30c08c0144b77c)
2017-10-27 21:11:48 +05:30