Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,145 Commits 326 Branches 371 Tags
Commit Graph

14145 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
05b7b3d126
MAPREDUCE-6999. Fix typo onf in DynamicInputChunk.java. Contributed by fang zhenyi. 
(cherry picked from commit cc3f3eca409f5e57e540849a80e6448bb4924cc6)
(cherry picked from commit 82fc80a9875fbb440834165d29bb4f19b7f4227e)
 2017-11-02 18:34:46 +09:00
Rohith Sharma K S
6005f0a3ee addendum patch for YARN-7289. 
(cherry picked from commit 940ffe3f9ce74286a8863e3743faf88a33c817a3)
 2017-11-02 14:11:33 +05:30
Weiwei Yang
3555397179 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang. 
(cherry picked from commit 56b88b06705441f6f171eec7fb2fa77946ca204b)
(cherry picked from commit 0f20434e18cfedcc36c969cc2df25123153e0b99)
 2017-11-01 18:13:28 -07:00
Junping Du
d1accde1cd YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong. 
(cherry picked from commit d57dba99428cbe3f3dfcec834d79f709e7529ef9)
(cherry picked from commit d1f8854a1b9ff2473c1784aa8a8bb06a61819359)
 2017-11-01 15:01:55 -07:00
Haibo Chen
955f3c30e4 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen) 
(cherry picked from commit d7f3737f3b3236fbf8c25fdd4656251ed63a2be9)
(cherry picked from commit 32a712a7406dd1e742131d1f0aa01279c8335ec1)
 2017-11-01 14:22:53 -07:00
Daniel Templeton
951d5a46f4 YARN-7146. Many RM unit tests failing with FairScheduler 
(Contributed by Robert Kanter via Daniel Templeton)

(cherry picked from commit 956d814034c98a7e49a759f692fbf5df1ba04e09)
 2017-11-01 14:13:42 -07:00
Inigo Goiri
d6a5f8a06d YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri. 
(cherry picked from commit 8180ab436a19b8e253c3b6c4f392daa32680e187)
 2017-11-01 13:22:26 -07:00
Arun Suresh
efa708f546 Updating jdiff version in anticipation of 2.9.0 release. 2017-10-31 12:56:11 -07:00
Subru Krishnan
ac41107423 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru). 
(cherry picked from commit ed24da3dd73c137b44235e525112056ace6d3843)
 2017-10-31 12:11:40 -07:00
Inigo Goiri
15b839c446 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri. 
(cherry picked from commit 982bd2a5bff4c490a5d62f2e4fd0d3755305349c)
 2017-10-31 10:24:12 -07:00
Jason Lowe
347997c959 HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe 
(cherry picked from commit 2fae63aa60c43b62bd908a9499562fe528603185)
 2017-10-31 09:32:45 -05:00
Sunil G
6dd1db68ff YARN-7398. Update LICENSE.txt with respect to new YARN UI merge. Contributed by Varun Saxena. 2017-10-31 15:36:41 +05:30
Junping Du
76ec5eab12 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release. 
(cherry picked from commit a8083aaa6f4bcc7287f2b65018a946a840123c50)
 2017-10-30 15:17:30 -07:00
Vrushali C
3454c02c96 YARN-7378 Documentation changes post branch-2 merge (Vrushali C with Varun Saxena) 2017-10-30 14:09:29 -07:00
Chris Douglas
2afb8ba14f HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham 
(cherry picked from commit e4878a59b3a380e323bb4627a69266bbf2524b36)
(cherry picked from commit 85be67ebe46b0d14e2689fecf4d56374c3a084be)
 2017-10-30 09:49:49 -07:00
Yufei Gu
243b70eca8 YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi) 
(cherry picked from commit d4811c8cfae02f42a7aae1f775e87b6726caa3c9)
 2017-10-29 16:47:22 -07:00
Varun Saxena
e1b3bbde60 YARN-7380. Fix findbugs warning in timeline service on branch-2 (Vrushali C via Varun Saxena). 2017-10-29 16:38:20 +05:30
Arun Suresh
2654d9973e YARN-7299. Fix TestDistributedScheduler. (asuresh) 
(cherry picked from commit 9c5c68745ed18883ce8bdbdca379025b23f17f60)
 2017-10-27 23:11:34 -07:00
Arun Suresh
519aa0e804 YARN-7178. Add documentation for Container Update API. (asuresh) 
(cherry picked from commit 24f8c5cce3adb88e5af84b3e48c4c447ac91e6d3)
 2017-10-27 22:57:46 -07:00
Chris Douglas
ee89241282 HADOOP-14991. Add missing figures to Resource Estimator tool. Contributed by Rui Li 
(cherry picked from commit 139cc752d21c30bf4d1ca263bb4b0717c48b2c0a)
(cherry picked from commit 77ad73501ce519851f2f80a90aca2d73e8b2e20d)
 2017-10-27 22:01:41 -07:00
Chris Douglas
9e721775a4 HADOOP-14986. Enforce JDK limitations. 
(cherry picked from commit b50def36970e0afa65bd3fd3f40d8c4f81119200)
(cherry picked from commit 1660a638f04435ca363fe4f07c7f03f109a6784a)
 2017-10-27 21:42:42 -07:00
Jason Lowe
9093ad6168 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla 
(cherry picked from commit 665bb147aa3fc198e53335931562dd69f9f0e345)
 2017-10-27 17:09:29 -05:00
Rohith Sharma K S
548116c3f5 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi. 
(cherry picked from commit 5c799ecf09617f634c41bba26d341b2ad45ee852)
 2017-10-27 22:51:41 +05:30
Sunil G
88c3b444bd YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh. 
(cherry picked from commit 792388e1c0ebaeb01db194412e30c08c0144b77c)
 2017-10-27 21:11:48 +05:30
Arpit Agarwal
8f28af4fac HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:45:11 -07:00
Steve Loughran
3fbcf76324 HADOOP-14553. Add (parallelized) integration tests to hadoop-azure. 
Contributed by Steve Loughran.

(backport JIRA HADOOP-14870)
 2017-10-27 12:55:12 +01:00
Junping Du
3793d2b9cf Add CHANGES.md and RELEASENOTES for 2.8.2 release. 2017-10-26 23:23:39 -07:00
Junping Du
1f2a2ba2be Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf5189247fa38e7b0a188d568eba1b6c)
 2017-10-26 23:20:24 -07:00
Junping Du
4b75ebb68e Set jdiff stable version to 2.8.2. 
(cherry picked from commit 06b56f649376020cde382bde25f90dc0547c4277)
 2017-10-26 23:20:10 -07:00
Subru Krishnan
a0dceec586 YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru). 
(cherry picked from commit 25932da6d1ee56299c8f9911576a42792c435407)
 2017-10-26 20:16:01 -07:00
Arun Suresh
f6fde85c5c YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh) 
(cherry picked from commit 00bebb7e58ba6899904e1619d151aa1b2f5b6acd)
 2017-10-26 20:04:33 -07:00
Arun Suresh
098a6b8f19 YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh) 
(cherry picked from commit d82e797b652f248e238bdf1818e6b4a5b91cea7a)
 2017-10-26 20:04:19 -07:00
Subru Krishnan
9897538a96 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 
(cherry picked from commit 625039ef20e6011ab360131d70582a6e4bf2ec1d)
 2017-10-26 19:14:24 -07:00
Robert Kanter
7c26ae506a YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter) 
(cherry picked from commit b1de78619f3e5e25d6f9d5eaf41925f22d212fb9)
 2017-10-26 17:51:05 -07:00
John Zhuge
952aa3f168 HDFS-12710. HTTPFS HTTP max header size env variable is not respected in branch-2. Contributed by Istvan Fajth. 2017-10-26 17:43:01 -07:00
Robert Kanter
46783158f8 YARN-7358. TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler (haibochen via rkanter) 
(cherry picked from commit 2da654e34a436aae266c1fbdec5c1067da8d854e)
 2017-10-26 10:49:57 -07:00
Akira Ajisaka
13f1a7e0ed
Revert "HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru)." 
This reverts commit da7f989d86d28ee6f4a7ac410fc8a4a163e11012.
 2017-10-26 15:33:53 +09:00
Subru Krishnan
da7f989d86 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 
(cherry picked from commit 625039ef20e6011ab360131d70582a6e4bf2ec1d)
 2017-10-25 17:05:35 -07:00
Subru Krishnan
04dfb4898d Reverting to 6aa75106812007eeac07ce09ef4e0a4a44f056aa as YARN-4849 pushed a stale LICENSE file. 2017-10-25 16:47:58 -07:00
Subru Krishnan
74aee8673f YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru). 
(cherry picked from commit 3fae675383489129b3ca3c66683a1215d0c6edf0)
 2017-10-25 15:32:03 -07:00
Arun Suresh
774a575363 YARN-4687. Document Reservation ACLs (Contributed by Sean Po) 
(cherry picked from commit 2e1d0ff4e901b8313c8d71869735b94ed8bc40a0)
 2017-10-25 15:29:32 -07:00
Carlo Curino
fa86fdc3cc YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino) 
Edited cherry-pick from 1c5c2b5dde6f2cffc587ca8f79a18828e1b1faf9
 2017-10-25 13:56:35 -07:00
Zhe Zhang
736fb3b66c Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit 86c2adc4528ffd27b744ee7e88109b86aaa3ec02.
 2017-10-24 15:05:26 -07:00
Varun Saxena
0c8a2c2609 HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena. 
(cherry picked from commit 67e7673750e731f5ecfa84e82b84b7fc7ee0b233)
 2017-10-25 03:09:07 +05:30
Eric Yang
f6d3c101a6 YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger. 2017-10-24 17:01:08 -04:00
Inigo Goiri
89ad6adab3 YARN-3661. Basic Federation UI. Contributed by Inigo Goiri. 2017-10-24 13:55:13 -07:00
Robert Kanter
85eadec67b YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter) 
(cherry picked from commit 03af442e7608db2f8e6eb85a15aa0ba42781edab)
 2017-10-24 13:43:27 -07:00
Robert Kanter
1d34a4805e YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter) 
(cherry picked from commit 025c6565725c1819566377632753e8b9055617a6)
 2017-10-24 10:29:36 -07:00
Yiqun Lin
3d36f75f23 HDFS-12695. Add a link to HDFS router federation document in site.xml. Contributed by Yiqun Lin. 
(cherry picked from commit b90750cfb8887fecbd83caff3800455b4f911339)
 2017-10-24 10:50:39 +08:00
Daniel Templeton
08cfd010a3 YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations 
(Contributed by Sen Zhao via Daniel Templeton)

(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
(cherry picked from commit 9da9023371d0d6c9a1f507c04fc6b88e6c587005)
 2017-10-23 13:52:15 -07:00