Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,345 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9345 Commits

Author SHA1 Message Date
Haohui Mai 1796d94d62 HDFS-8394. Move getAdditionalBlock() and related functionalities into a separate class. Contributed by Haohui Mai. 2015-05-15 19:10:05 -07:00
Jing Zhao d6aa65d037 HDFS-8397. Refactor the error handling code in DataStreamer. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 8f37873342)
 2015-05-15 16:32:25 -07:00
Jason Lowe ce64720516 YARN-2421. RM still allocates containers to an app in the FINISHING state. Contributed by Chang Li 
(cherry picked from commit f7e051c431)
 2015-05-15 22:10:16 +00:00
Junping Du cc671349bc YARN-3505 addendum: fix an issue in previous patch. 
(cherry picked from commit 03a293aed6)
 2015-05-15 06:40:28 -07:00
Devaraj K b9865cbf3d MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists 
to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED
state. Contributed by zhihai xu.

(cherry picked from commit 1ea90144d5)
 2015-05-15 12:34:08 +05:30
Vinayakumar B d9455c790f HDFS-6888. Allow selectively audit logging ops (Contributed by Chen He) 
(cherry picked from commit 7f2e89fa7082840bfa3e8e593c93db050a80d04f)
 2015-05-15 11:05:26 +05:30
cnauroth 91855c2340 HADOOP-11960. Enable Azure-Storage Client Side logging. Contributed by Dushyanth. 
(cherry picked from commit cb8e69a80c)
 2015-05-14 22:22:46 -07:00
Akira Ajisaka 7fb3486eb3 HDFS-8350. Remove old webhdfs.xml and other outdated documentation stuff. Contributed by Brahma Reddy Battula. 2015-05-15 13:57:58 +09:00
Akira Ajisaka 2e5b7f24ab HDFS-8371. Fix test failure in TestHdfsConfigFields for spanreceiver properties. Contributed by Ray Chiang. 
(cherry picked from commit cbc01ed08e)
 2015-05-15 12:15:26 +09:00
Vinod Kumar Vavilapalli ad3196e016 Fixing HDFS state-store. Contributed by Arun Suresh. 
(cherry picked from commit 9a2a9553ee)
 2015-05-14 16:57:03 -07:00
Vinod Kumar Vavilapalli 87862970f1 Fixing MR intermediate spills. Contributed by Arun Suresh. 
(cherry picked from commit 6b710a42e0)
 2015-05-14 16:56:56 -07:00
Ravi Prakash 4caadaa8bb YARN-1519. Check in container-executor if sysconf is implemented before using it (Radim Kolar and Eric Payne via raviprak) 
(cherry picked from commit 53fe4eff09)
 2015-05-14 15:56:36 -07:00
cnauroth fa082e1a0a HADOOP-11713. ViewFileSystem should support snapshot methods. Contributed by Rakesh R. 
(cherry picked from commit 09fe16f166)
 2015-05-14 14:56:13 -07:00
Junping Du bc13c7d84b YARN-3505. Node's Log Aggregation Report with SUCCEED should not cached in RMApps. Contributed by Xuan Gong. 
(cherry picked from commit 15ccd967ee)
 2015-05-14 10:59:48 -07:00
Devaraj K 454236ec19 MAPREDUCE-5708. Duplicate String.format in 
YarnOutputFiles.getSpillFileForWrite. Contributed by Konstantin Weitz.

(cherry picked from commit 05ff54c66c)
 2015-05-14 22:11:15 +05:30
Vinayakumar B 4bbcffa510 HDFS-8150. Make getFileChecksum fail for blocks under construction (Contributed by J.Andreina) 
(cherry picked from commit def9136e02)
 2015-05-14 15:55:20 +05:30
Vinayakumar B 085841d9ac HADOOP-8174. Remove confusing comment in Path#isAbsolute() (Contributed by Suresh Srinivas) 
(cherry picked from commit 0daa5ada68)
 2015-05-14 14:18:00 +05:30
Haohui Mai 4b5915be9f HDFS-7728. Avoid updating quota usage while loading edits. Contributed by Jing Zhao. 2015-05-13 21:50:41 -07:00
Arpit Agarwal 33f6136ee3 HDFS-8243. Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings. (Contributed by Ruth Wisniewski) 2015-05-13 19:46:34 -07:00
Tsuyoshi Ozawa 9f89c6656e HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 4356e8a5ef)
 2015-05-14 10:20:57 +09:00
Wangda Tan 3a11baa15f YARN-3362. Add node label usage in RM CapacityScheduler web UI. (Naganarasimha G R via wangda) 
(cherry picked from commit 0e85044e26)
 2015-05-13 17:01:23 -07:00
Colin Patrick Mccabe 52da75180a HDFS-8380. Always call addStoredBlock on blocks which have been shifted from one storage to another (cmccabe) 
(cherry picked from commit 281d47a969)
 2015-05-13 14:45:37 -07:00
Jason Lowe a81ad81461 YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services. Contributed by Junping Du 
(cherry picked from commit 711d77cc54)
 2015-05-13 21:08:45 +00:00
Jason Lowe aefc2bae9e Update fix version for YARN-3457 and YARN-3537. 
(cherry picked from commit f7de6198da)
 2015-05-13 20:54:21 +00:00
Wangda Tan d49262a172 YARN-3521. Support return structured NodeLabel objects in REST API (Sunil G via wangda) 
(cherry picked from commit 7f19e7a254)
 2015-05-13 13:43:57 -07:00
Wangda Tan 8555a5146d YARN-3579. CommonNodeLabelsManager should support NodeLabel instead of string label name when getting node-to-label/label-to-label mappings. (Sunil G via wangda) 
(cherry picked from commit d4f53fc963)
 2015-05-13 13:33:38 -07:00
Xuan 487d9b0f3f YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch 
(cherry picked from commit 0f95921447)
 2015-05-13 13:12:04 -07:00
Wangda Tan 3df8880bbe YARN-2921. Fix MockRM/MockAM#waitForState sleep too long. (Tsuyoshi Ozawa via wangda) 
(cherry picked from commit 341a476812)
 2015-05-13 13:07:05 -07:00
cnauroth ddc4afeff2 HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth. 2015-05-13 12:25:49 -07:00
Kihwal Lee 2e9392c157 HDFS-8358. TestTraceAdmin fails. Contributed by Masatake Iwasaki. 
(cherry picked from commit f9a46a00d2)
 2015-05-13 14:16:37 -05:00
Tsz-Wo Nicholas Sze bdf8f64be8 HDFS-8143. Mover should exit after some retry when failed to move blocks. Contributed by surendra singh lilhore 2015-05-13 11:58:35 -07:00
Vinayakumar B 2adb1257b1 HDFS-6300. Prevent multiple balancers from running simultaneously (Contributed by Rakesh R) 
(cherry picked from commit 065d8f2a34)
 2015-05-13 17:30:40 +05:30
Akira Ajisaka b9a92c4452 HADOOP-9723. Improve error message when hadoop archive output path already exists. Contributed by Jean-Baptiste Onofré and Yongjun Zhang. 
(cherry picked from commit 92c38e41e1)
 2015-05-13 17:30:49 +09:00
Tsuyoshi Ozawa 780d4f416e MAPREDUCE-6366. mapreduce.terasort.final.sync configuration in TeraSort doesn't work. Contributed by Takuya Fukudome. 
(cherry picked from commit e82067bfe6)
 2015-05-13 16:45:46 +09:00
Akira Ajisaka 345e62c6d5 Revert "MAPREDUCE-5762. Port MAPREDUCE-3223 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)" 
This reverts commit 853cc04668.
 2015-05-13 14:02:41 +09:00
Zhijie Shen 6043224458 YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran. 
(cherry picked from commit fcd0702c10)
 2015-05-12 21:13:47 -07:00
Akira Ajisaka 7596c6e731 HDFS-6184. Capture NN's thread dump when it fails over. Contributed by Ming Ma. 
(cherry picked from commit 2463666ecb)
 2015-05-13 11:37:59 +09:00
Vinod Kumar Vavilapalli d5755ba241 MAPREDUCE-6251. Added a new config for JobClient to retry JobStatus calls so that they don't fail on history-server backed by DFSes with not so strong guarantees. Contributed by Craig Welch. 
(cherry picked from commit f24452d14e)
 2015-05-12 12:13:23 -07:00
Karthik Kambatla 9d6c63f8be YARN-3613. TestContainerManagerSecurity should init and start Yarn cluster in setup instead of individual methods. (nijel via kasha) 
(cherry picked from commit fe0df59627)
 2015-05-12 10:45:51 -07:00
Haohui Mai 8011d4688f HADOOP-11962. Sasl message with MD5 challenge text shouldn't be LOG out even in debug level. Contributed by Junping Du. 2015-05-12 10:30:43 -07:00
Devaraj K 5fceebd696 YARN-3629. NodeID is always printed as "null" in node manager 
initialization log. Contributed by nijel.

(cherry picked from commit 5c2f05cd9b)
 2015-05-12 22:22:40 +05:30
Tsuyoshi Ozawa fb5b0ebb45 MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host. Contributed by Junping Du. 
(cherry picked from commit f4e2b3cc0b)
 2015-05-13 00:28:36 +09:00
yliu c31c6fbda7 HDFS-8255. Rename getBlockReplication to getPreferredBlockReplication. (Contributed by Zhe Zhang) 2015-05-12 21:26:57 +08:00
Devaraj K f887243f88 YARN-3513. Remove unused variables in ContainersMonitorImpl and add debug 
log for overall resource usage by all containers.  Contributed by
Naganarasimha G R.

(cherry picked from commit 8badd82ce2)
 2015-05-12 16:56:26 +05:30
Vinayakumar B cda1962996 MAPREDUCE-6360. TestMapreduceConfigFields is placed in wrong dir, introducing compile error (Contributed by Arshad Mohammad) 
(cherry picked from commit 360dff5903)
 2015-05-12 12:50:44 +05:30
Vinayakumar B e1b8bb9d84 HDFS-8362. Java Compilation Error in TestHdfsConfigFields.java (Contributed by Arshad Mohammad) 
(cherry picked from commit 987abc99b0)
 2015-05-12 12:10:14 +05:30
Wangda Tan 12584ac10e Move YARN-3493 from 2.8 to 2.7.1 in CHANGES.txt 2015-05-11 18:08:25 -07:00
Wangda Tan d06d2a96f5 YARN-3489. RMServerUtils.validateResourceRequests should only obtain queue info once. (Varun Saxena via wangda) 
(cherry picked from commit d6f6741296)
 2015-05-11 17:35:01 -07:00
Jason Lowe 53e9973afc MAPREDUCE-5465. Tasks are often killed before they exit on their own. Contributed by Ming Ma 2015-05-11 22:40:05 +00:00
Wangda Tan 2c80a3fe19 Moved YARN-3434. (Interaction between reservations and userlimit can result in significant ULF violation.) From 2.8.0 to 2.7.1 
(cherry picked from commit 1952f88889)
 2015-05-11 15:22:25 -07:00