Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,235 Commits 326 Branches 371 Tags
Commit Graph

9235 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Vinod Kumar Vavilapalli
87862970f1 Fixing MR intermediate spills. Contributed by Arun Suresh. 
(cherry picked from commit 6b710a42e00acca405e085724c89cda016cf7442)
 2015-05-14 16:56:56 -07:00
Ravi Prakash
4caadaa8bb YARN-1519. Check in container-executor if sysconf is implemented before using it (Radim Kolar and Eric Payne via raviprak) 
(cherry picked from commit 53fe4eff09fdaeed75a8cad3a26156bf963a8d37)
 2015-05-14 15:56:36 -07:00
cnauroth
fa082e1a0a HADOOP-11713. ViewFileSystem should support snapshot methods. Contributed by Rakesh R. 
(cherry picked from commit 09fe16f166392a99e1e54001a9112c6a4632dfc8)
 2015-05-14 14:56:13 -07:00
Junping Du
bc13c7d84b YARN-3505. Node's Log Aggregation Report with SUCCEED should not cached in RMApps. Contributed by Xuan Gong. 
(cherry picked from commit 15ccd967ee3e7046a50522089f67ba01f36ec76a)
 2015-05-14 10:59:48 -07:00
Devaraj K
454236ec19 MAPREDUCE-5708. Duplicate String.format in 
YarnOutputFiles.getSpillFileForWrite. Contributed by Konstantin Weitz.

(cherry picked from commit 05ff54c66c49301c4ec2549704d9d459e784572c)
 2015-05-14 22:11:15 +05:30
Vinayakumar B
4bbcffa510 HDFS-8150. Make getFileChecksum fail for blocks under construction (Contributed by J.Andreina) 
(cherry picked from commit def9136e0259e118e6fd7b656260765d28ac9ae6)
 2015-05-14 15:55:20 +05:30
Vinayakumar B
085841d9ac HADOOP-8174. Remove confusing comment in Path#isAbsolute() (Contributed by Suresh Srinivas) 
(cherry picked from commit 0daa5ada68db483275aaa7f2ed9a2b5eaf5bb9bd)
 2015-05-14 14:18:00 +05:30
Haohui Mai
4b5915be9f HDFS-7728. Avoid updating quota usage while loading edits. Contributed by Jing Zhao. 2015-05-13 21:50:41 -07:00
Arpit Agarwal
33f6136ee3 HDFS-8243. Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings. (Contributed by Ruth Wisniewski) 2015-05-13 19:46:34 -07:00
Tsuyoshi Ozawa
9f89c6656e HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 4356e8a5ef0ac6d11a34704b80ef360a710e623a)
 2015-05-14 10:20:57 +09:00
Wangda Tan
3a11baa15f YARN-3362. Add node label usage in RM CapacityScheduler web UI. (Naganarasimha G R via wangda) 
(cherry picked from commit 0e85044e26da698c45185585310ae0e99448cd80)
 2015-05-13 17:01:23 -07:00
Colin Patrick Mccabe
52da75180a HDFS-8380. Always call addStoredBlock on blocks which have been shifted from one storage to another (cmccabe) 
(cherry picked from commit 281d47a96937bc329b1b4051ffcb8f5fcac98354)
 2015-05-13 14:45:37 -07:00
Jason Lowe
a81ad81461 YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services. Contributed by Junping Du 
(cherry picked from commit 711d77cc54a64b2c3db70bdacc6bf2245c896a4b)
 2015-05-13 21:08:45 +00:00
Jason Lowe
aefc2bae9e Update fix version for YARN-3457 and YARN-3537. 
(cherry picked from commit f7de6198da030cb9cd62dcfd3c378dbbf857e017)
 2015-05-13 20:54:21 +00:00
Wangda Tan
d49262a172 YARN-3521. Support return structured NodeLabel objects in REST API (Sunil G via wangda) 
(cherry picked from commit 7f19e7a2549a098236d06b29b7076bb037533f05)
 2015-05-13 13:43:57 -07:00
Wangda Tan
8555a5146d YARN-3579. CommonNodeLabelsManager should support NodeLabel instead of string label name when getting node-to-label/label-to-label mappings. (Sunil G via wangda) 
(cherry picked from commit d4f53fc9631d682cd79ba440aefa6750dcc898be)
 2015-05-13 13:33:38 -07:00
Xuan
487d9b0f3f YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch 
(cherry picked from commit 0f95921447ea547bdf9caf18f7fde46bc66031f8)
 2015-05-13 13:12:04 -07:00
Wangda Tan
3df8880bbe YARN-2921. Fix MockRM/MockAM#waitForState sleep too long. (Tsuyoshi Ozawa via wangda) 
(cherry picked from commit 341a476812015d0d584b198b451ea9458645a47c)
 2015-05-13 13:07:05 -07:00
cnauroth
ddc4afeff2 HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth. 2015-05-13 12:25:49 -07:00
Kihwal Lee
2e9392c157 HDFS-8358. TestTraceAdmin fails. Contributed by Masatake Iwasaki. 
(cherry picked from commit f9a46a00d2020c6d6466fbc829ada0521cb78dc0)
 2015-05-13 14:16:37 -05:00
Tsz-Wo Nicholas Sze
bdf8f64be8 HDFS-8143. Mover should exit after some retry when failed to move blocks. Contributed by surendra singh lilhore 2015-05-13 11:58:35 -07:00
Vinayakumar B
2adb1257b1 HDFS-6300. Prevent multiple balancers from running simultaneously (Contributed by Rakesh R) 
(cherry picked from commit 065d8f2a34296b566e7ca541a284f7991212f14c)
 2015-05-13 17:30:40 +05:30
Akira Ajisaka
b9a92c4452 HADOOP-9723. Improve error message when hadoop archive output path already exists. Contributed by Jean-Baptiste Onofré and Yongjun Zhang. 
(cherry picked from commit 92c38e41e1fffb9d60d4fa5d4d2212777af9e9a5)
 2015-05-13 17:30:49 +09:00
Tsuyoshi Ozawa
780d4f416e MAPREDUCE-6366. mapreduce.terasort.final.sync configuration in TeraSort doesn't work. Contributed by Takuya Fukudome. 
(cherry picked from commit e82067bfe680ce04acc0153693cce3cd385e5567)
 2015-05-13 16:45:46 +09:00
Akira Ajisaka
345e62c6d5 Revert "MAPREDUCE-5762. Port MAPREDUCE-3223 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)" 
This reverts commit 853cc0466811c310486fff6042d7b76ab3b78947.
 2015-05-13 14:02:41 +09:00
Zhijie Shen
6043224458 YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran. 
(cherry picked from commit fcd0702c10ce574b887280476aba63d6682d5271)
 2015-05-12 21:13:47 -07:00
Akira Ajisaka
7596c6e731 HDFS-6184. Capture NN's thread dump when it fails over. Contributed by Ming Ma. 
(cherry picked from commit 2463666ecb553dbde1b8c540a21ad3d599239acf)
 2015-05-13 11:37:59 +09:00
Vinod Kumar Vavilapalli
d5755ba241 MAPREDUCE-6251. Added a new config for JobClient to retry JobStatus calls so that they don't fail on history-server backed by DFSes with not so strong guarantees. Contributed by Craig Welch. 
(cherry picked from commit f24452d14e9ba48cdb82e5e6e5c10ce5b1407308)
 2015-05-12 12:13:23 -07:00
Karthik Kambatla
9d6c63f8be YARN-3613. TestContainerManagerSecurity should init and start Yarn cluster in setup instead of individual methods. (nijel via kasha) 
(cherry picked from commit fe0df596271340788095cb43a1944e19ac4c2cf7)
 2015-05-12 10:45:51 -07:00
Haohui Mai
8011d4688f HADOOP-11962. Sasl message with MD5 challenge text shouldn't be LOG out even in debug level. Contributed by Junping Du. 2015-05-12 10:30:43 -07:00
Devaraj K
5fceebd696 YARN-3629. NodeID is always printed as "null" in node manager 
initialization log. Contributed by nijel.

(cherry picked from commit 5c2f05cd9bad9bf9beb0f4ca18f4ae1bc3e84499)
 2015-05-12 22:22:40 +05:30
Tsuyoshi Ozawa
fb5b0ebb45 MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host. Contributed by Junping Du. 
(cherry picked from commit f4e2b3cc0b1f4e49c306bc09a9dddd0495225bb2)
 2015-05-13 00:28:36 +09:00
yliu
c31c6fbda7 HDFS-8255. Rename getBlockReplication to getPreferredBlockReplication. (Contributed by Zhe Zhang) 2015-05-12 21:26:57 +08:00
Devaraj K
f887243f88 YARN-3513. Remove unused variables in ContainersMonitorImpl and add debug 
log for overall resource usage by all containers.  Contributed by
Naganarasimha G R.

(cherry picked from commit 8badd82ce256e4dc8c234961120d62a88358ab39)
 2015-05-12 16:56:26 +05:30
Vinayakumar B
cda1962996 MAPREDUCE-6360. TestMapreduceConfigFields is placed in wrong dir, introducing compile error (Contributed by Arshad Mohammad) 
(cherry picked from commit 360dff5903085c3c7f02ccf9f17d71a842275e48)
 2015-05-12 12:50:44 +05:30
Vinayakumar B
e1b8bb9d84 HDFS-8362. Java Compilation Error in TestHdfsConfigFields.java (Contributed by Arshad Mohammad) 
(cherry picked from commit 987abc99b0309a07f0a342746b2a5048d5c36ce0)
 2015-05-12 12:10:14 +05:30
Wangda Tan
12584ac10e Move YARN-3493 from 2.8 to 2.7.1 in CHANGES.txt 2015-05-11 18:08:25 -07:00
Wangda Tan
d06d2a96f5 YARN-3489. RMServerUtils.validateResourceRequests should only obtain queue info once. (Varun Saxena via wangda) 
(cherry picked from commit d6f6741296639a73f5306e3ebefec84a40ca03e5)
 2015-05-11 17:35:01 -07:00
Jason Lowe
53e9973afc MAPREDUCE-5465. Tasks are often killed before they exit on their own. Contributed by Ming Ma 2015-05-11 22:40:05 +00:00
Wangda Tan
2c80a3fe19 Moved YARN-3434. (Interaction between reservations and userlimit can result in significant ULF violation.) From 2.8.0 to 2.7.1 
(cherry picked from commit 1952f88889395870e7b631d43418e075e774b9d2)
 2015-05-11 15:22:25 -07:00
Kihwal Lee
50778f9d45 HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop. Contributed by Rushabh Shah. 
(cherry picked from commit ea11590aad952b5b560a5101d064adf27d8656db)
 2015-05-11 14:33:45 -05:00
Allen Wittenauer
733579ddc8 re-commit of HADOOP-11881 2015-05-11 12:13:55 -07:00
Allen Wittenauer
93bbbddda2 HADOOP-11947. test-patch should return early from determine-issue when run in jenkins mode. (Sean Busbey via aw) 2015-05-11 12:08:23 -07:00
Allen Wittenauer
5c7c7b7b74 HADOOP-11948. test-patch's issue matching regex should be configurable. (Sean Busbey via aw) 2015-05-11 11:54:21 -07:00
Allen Wittenauer
cea8213c3e HADOOP-11950. Add cli option to test-patch to set the project-under-test (Sean Busbey via aw) 2015-05-11 11:51:04 -07:00
Allen Wittenauer
6307687f7d HADOOP-11951. test-patch should give better info about failures to handle dev-support updates without resetrepo option (Sean Busbey via aw) 2015-05-11 11:46:14 -07:00
Allen Wittenauer
fa1cf5a51a HADOOP-11928. Test-patch check for @author tags incorrectly flags removal of @author tags (Kengo Seki via aw) 2015-05-11 11:35:42 -07:00
Akira Ajisaka
77587fe198 HADOOP-11663. Remove description about Java 6 from docs. Contributed by Masatake Iwasaki. 
(cherry picked from commit b9cebfc0ba871beb99f634a1a8c797e143ecc6d4)
 2015-05-12 00:31:28 +09:00
Junping Du
a1a7deebf8 YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak. 
(cherry picked from commit 7e543c27fa2881aa65967be384a6203bd5b2304f)
 2015-05-11 05:28:25 -07:00
Akira Ajisaka
703f1e9d16 HDFS-8351. Remove namenode -finalize option from document. (aajisaka) 
(cherry picked from commit 3fa2efc09f051b6fc6244f0edca46d3d06f4ae3b)
 2015-05-11 15:37:12 +09:00