Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,115 Commits 326 Branches 371 Tags
Commit Graph

14115 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Arun Suresh
45aabb3c8d YARN-6627. Addendum patch for branch-2. (Sunil G via asuresh) 
(cherry picked from commit 5cd92ed555cadf4897e4ab378fcc6691bfbd6bbe)
 2017-11-11 09:11:43 -08:00
Subru Krishnan
b35c5ba472 HADOOP-15030. [branch-2] Include hadoop-cloud-storage-project in the main hadoop pom modules. 
(cherry picked from commit 132c2e7a2a2dcb8050770a85aca8e66a7c33934b)
 2017-11-10 13:52:39 -08:00
Arun Suresh
dc65df2a1a YARN-6102. Addendum patch for branch-2. (Rohith Sharma K S via asuresh) 
(cherry picked from commit 0411c710d2ea553fe783075c5299a013f89902cc)
 2017-11-10 13:45:14 -08:00
Arun Suresh
d754b24738 Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh) 
(cherry picked from commit 7af9b8ad1e993ef791aa38740b6aabc4c233a30f)
 2017-11-09 15:17:59 -08:00
Haibo Chen
288d9506f0 YARN-7388. TestAMRestart should be scheduler agnostic. 
(cherry picked from commit a1382a18dff8a70aa25240d6fbba6e22832a7679)
(cherry picked from commit 91a7f8d2463de0a94ded0884143e4661c29868a4)
(cherry picked from commit 3fbe67d3e1a93b998e3d056ebd9008e17a35f8b0)
 2017-11-09 11:02:05 -08:00
John Zhuge
120d868963 HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend. 
(cherry picked from commit 3123895db0518552eb357093fddf0e8ff1a6cadf)
 2017-11-09 09:18:53 -08:00
Subru Krishnan
26110ec335 HADOOP-15026. Rebase ResourceEstimator start/stop scripts for branch-2. (Rui Li via Subru). 
(cherry picked from commit 5991c218a0cd72fc6a2b10ef77729ee6181c9443)
 2017-11-09 00:33:23 -08:00
Subru Krishnan
d45672a144 HADOOP-15025. Ensure singleton for ResourceEstimatorService. (Rui Li via Subru). 
(cherry picked from commit f2df6b8983aace73ad27934bd9f7f4d766e0b25f)
(cherry picked from commit 46a740a82ebb5143038296bbedc9d455f68bae63)
 2017-11-08 18:11:32 -08:00
Arun Suresh
1ddd0a7958 YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh) 
(cherry picked from commit a9c70b0e84dab0c41e480a0dc0cb1a22efdc64ee)
(cherry picked from commit 5486542074a7025061a427df968755f53c692477)
 2017-11-08 08:08:26 -08:00
Brahma Reddy Battula
ce027c6f48 HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula 
(cherry picked from commit 410d0319cf72b9b5f3807c522237f52121d98cd5)
 2017-11-08 14:46:27 +05:30
Brahma Reddy Battula
53891b7f8f HDFS-12783. [branch-2] dfsrouter should use hdfsScript. Contributed by Brahma Reddy Battula 
(cherry picked from commit 135abcac4ba3fda0e287b0766c415ce4e0c37931)
 2017-11-08 10:19:58 +05:30
Subru Krishnan
8746a65e78 YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure. 
(cherry picked from commit 0542e6f86e6734f8ceea00960bebe719827136db)
 2017-11-03 11:15:48 -07:00
Arun Suresh
bb6a1aa5fa Preparing for 2.9.1 development 2017-11-02 22:49:38 -07:00
Inigo Goiri
6f5a95ff98 YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri. 
(cherry picked from commit 6e2259264ad9525eeec2a14055d53236711659d7)
 2017-11-02 21:35:45 -07:00
Subru Krishnan
a60bb3b36f YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru). 
(cherry picked from commit ad0fff2b419e8fe8bb5c9a7e19b79dec16cbd96f)
 2017-11-02 17:42:38 -07:00
Arun Suresh
e44ff3f60a HADOOP-15013. Fix ResourceEstimator findbugs issues. (asuresh) 
(cherry picked from commit 53c0fb7efebfac4a79f5cce2dd42cf00411d51e7)
 2017-11-02 17:21:57 -07:00
Eric Payne
9a61d12c03 YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák. 
(cherry picked from commit e6ec02001fc4eed9eb51c8653d8f931135e49eda)
 2017-11-02 13:09:27 -05:00
Wangda Tan
7a658363d9 YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda) 
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
(cherry picked from commit 752f000e0f521ca7be173d6ca338da4585284fd0)
 2017-11-02 09:53:20 -07:00
Jason Lowe
cfef479b73 YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger 
(cherry picked from commit b7dee1f0608006e776624a9e4de39811d8aebc97)
(cherry picked from commit 6ad6882343f73c285a00753dfef81ab68c7333ef)
 2017-11-02 11:02:37 -05:00
Arun Suresh
da6ea5c144 Add missing 2.8.2 jdiff for YARN API 2017-11-02 07:09:54 -07:00
Akira Ajisaka
05b7b3d126
MAPREDUCE-6999. Fix typo onf in DynamicInputChunk.java. Contributed by fang zhenyi. 
(cherry picked from commit cc3f3eca409f5e57e540849a80e6448bb4924cc6)
(cherry picked from commit 82fc80a9875fbb440834165d29bb4f19b7f4227e)
 2017-11-02 18:34:46 +09:00
Rohith Sharma K S
6005f0a3ee addendum patch for YARN-7289. 
(cherry picked from commit 940ffe3f9ce74286a8863e3743faf88a33c817a3)
 2017-11-02 14:11:33 +05:30
Weiwei Yang
3555397179 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang. 
(cherry picked from commit 56b88b06705441f6f171eec7fb2fa77946ca204b)
(cherry picked from commit 0f20434e18cfedcc36c969cc2df25123153e0b99)
 2017-11-01 18:13:28 -07:00
Junping Du
d1accde1cd YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong. 
(cherry picked from commit d57dba99428cbe3f3dfcec834d79f709e7529ef9)
(cherry picked from commit d1f8854a1b9ff2473c1784aa8a8bb06a61819359)
 2017-11-01 15:01:55 -07:00
Haibo Chen
955f3c30e4 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen) 
(cherry picked from commit d7f3737f3b3236fbf8c25fdd4656251ed63a2be9)
(cherry picked from commit 32a712a7406dd1e742131d1f0aa01279c8335ec1)
 2017-11-01 14:22:53 -07:00
Daniel Templeton
951d5a46f4 YARN-7146. Many RM unit tests failing with FairScheduler 
(Contributed by Robert Kanter via Daniel Templeton)

(cherry picked from commit 956d814034c98a7e49a759f692fbf5df1ba04e09)
 2017-11-01 14:13:42 -07:00
Inigo Goiri
d6a5f8a06d YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri. 
(cherry picked from commit 8180ab436a19b8e253c3b6c4f392daa32680e187)
 2017-11-01 13:22:26 -07:00
Arun Suresh
efa708f546 Updating jdiff version in anticipation of 2.9.0 release. 2017-10-31 12:56:11 -07:00
Subru Krishnan
ac41107423 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru). 
(cherry picked from commit ed24da3dd73c137b44235e525112056ace6d3843)
 2017-10-31 12:11:40 -07:00
Inigo Goiri
15b839c446 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri. 
(cherry picked from commit 982bd2a5bff4c490a5d62f2e4fd0d3755305349c)
 2017-10-31 10:24:12 -07:00
Jason Lowe
347997c959 HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe 
(cherry picked from commit 2fae63aa60c43b62bd908a9499562fe528603185)
 2017-10-31 09:32:45 -05:00
Sunil G
6dd1db68ff YARN-7398. Update LICENSE.txt with respect to new YARN UI merge. Contributed by Varun Saxena. 2017-10-31 15:36:41 +05:30
Junping Du
76ec5eab12 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release. 
(cherry picked from commit a8083aaa6f4bcc7287f2b65018a946a840123c50)
 2017-10-30 15:17:30 -07:00
Vrushali C
3454c02c96 YARN-7378 Documentation changes post branch-2 merge (Vrushali C with Varun Saxena) 2017-10-30 14:09:29 -07:00
Chris Douglas
2afb8ba14f HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham 
(cherry picked from commit e4878a59b3a380e323bb4627a69266bbf2524b36)
(cherry picked from commit 85be67ebe46b0d14e2689fecf4d56374c3a084be)
 2017-10-30 09:49:49 -07:00
Yufei Gu
243b70eca8 YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi) 
(cherry picked from commit d4811c8cfae02f42a7aae1f775e87b6726caa3c9)
 2017-10-29 16:47:22 -07:00
Varun Saxena
e1b3bbde60 YARN-7380. Fix findbugs warning in timeline service on branch-2 (Vrushali C via Varun Saxena). 2017-10-29 16:38:20 +05:30
Arun Suresh
2654d9973e YARN-7299. Fix TestDistributedScheduler. (asuresh) 
(cherry picked from commit 9c5c68745ed18883ce8bdbdca379025b23f17f60)
 2017-10-27 23:11:34 -07:00
Arun Suresh
519aa0e804 YARN-7178. Add documentation for Container Update API. (asuresh) 
(cherry picked from commit 24f8c5cce3adb88e5af84b3e48c4c447ac91e6d3)
 2017-10-27 22:57:46 -07:00
Chris Douglas
ee89241282 HADOOP-14991. Add missing figures to Resource Estimator tool. Contributed by Rui Li 
(cherry picked from commit 139cc752d21c30bf4d1ca263bb4b0717c48b2c0a)
(cherry picked from commit 77ad73501ce519851f2f80a90aca2d73e8b2e20d)
 2017-10-27 22:01:41 -07:00
Chris Douglas
9e721775a4 HADOOP-14986. Enforce JDK limitations. 
(cherry picked from commit b50def36970e0afa65bd3fd3f40d8c4f81119200)
(cherry picked from commit 1660a638f04435ca363fe4f07c7f03f109a6784a)
 2017-10-27 21:42:42 -07:00
Jason Lowe
9093ad6168 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla 
(cherry picked from commit 665bb147aa3fc198e53335931562dd69f9f0e345)
 2017-10-27 17:09:29 -05:00
Rohith Sharma K S
548116c3f5 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi. 
(cherry picked from commit 5c799ecf09617f634c41bba26d341b2ad45ee852)
 2017-10-27 22:51:41 +05:30
Sunil G
88c3b444bd YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh. 
(cherry picked from commit 792388e1c0ebaeb01db194412e30c08c0144b77c)
 2017-10-27 21:11:48 +05:30
Arpit Agarwal
8f28af4fac HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:45:11 -07:00
Steve Loughran
3fbcf76324 HADOOP-14553. Add (parallelized) integration tests to hadoop-azure. 
Contributed by Steve Loughran.

(backport JIRA HADOOP-14870)
 2017-10-27 12:55:12 +01:00
Junping Du
3793d2b9cf Add CHANGES.md and RELEASENOTES for 2.8.2 release. 2017-10-26 23:23:39 -07:00
Junping Du
1f2a2ba2be Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf5189247fa38e7b0a188d568eba1b6c)
 2017-10-26 23:20:24 -07:00
Junping Du
4b75ebb68e Set jdiff stable version to 2.8.2. 
(cherry picked from commit 06b56f649376020cde382bde25f90dc0547c4277)
 2017-10-26 23:20:10 -07:00
Subru Krishnan
a0dceec586 YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru). 
(cherry picked from commit 25932da6d1ee56299c8f9911576a42792c435407)
 2017-10-26 20:16:01 -07:00