Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,610 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

373 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli 77c29ccb53 MAPREDUCE-3656. Fixed a race condition in MR AM which is failing the sort benchmark consistently. Contributed by Siddarth Seth. 
svn merge --ignore-ancestry -c 1231314 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1231316 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 21:32:58 +00:00
Tsz-wo Sze 66f4e8b694 svn merge -c 1214066 from trunk for MAPREDUCE-3545. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23-PB@1230880 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 03:26:08 +00:00
Vinod Kumar Vavilapalli 28c7235172 MAPREDUCE-3512. Batching JobHistory flushing to DFS so that we don't flush for every event slowing down AM. Contributed by Siddarth Seth. 
svn merge --ignore-ancestry -c 1230353 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1230354 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 01:43:33 +00:00
Mahadev Konar 350ed9a0e1 MAPREDUCE-3553. Add support for data returned when exceptions thrown from web service apis to be in either xml or in JSON. (Thomas Graves via mahadev) - Merging r1230330 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1230333 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 00:02:02 +00:00
Vinod Kumar Vavilapalli 8327271efc MAPREDUCE-3618. Fixed TaskHeartbeatHandler to not hold a global lock for all task-updates. Contributed by Siddarth Seth. 
svn merge --ignore-ancestry -c 1229906 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1229908 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 06:55:18 +00:00
Mahadev Konar 5b330e9119 MAPREDUCE-3380. Token infrastructure for running clients which are not kerberos authenticated. (mahadev) - Merging r1229855 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1229856 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 01:56:34 +00:00
Vinod Kumar Vavilapalli dd807a1e8a MAPREDUCE-3299. Added AMInfo table to the MR AM job pages to list all the job-attempts when AM restarts and recovers. (Jonathan Eagles via vinodkv) 
svn merge --ignore-ancestry -c 1229766 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1229768 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 22:28:22 +00:00
Vinod Kumar Vavilapalli 6821efa3ae MAPREDUCE-3382. Enhanced MR AM to use a proxy to ping the job-end notification URL. Contributed by Ravi Prakash. 
svn merge --ignore-ancestry -c 1229736 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1229737 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 21:09:41 +00:00
Vinod Kumar Vavilapalli 4175e70020 MAPREDUCE-3312. Modified MR AM to not send a stop-container request for a container that isn't launched at all. Contributed by Robert Joseph Evans. 
svn merge --ignore-ancestry -c 1229451 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1229452 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 02:16:53 +00:00
Vinod Kumar Vavilapalli 70fb248629 MAPREDUCE-3528. Fixed TaskHeartBeatHandler to use a new configuration for the thread loop interval separate from task-timeout configuration property. Contributed by Siddharth Seth. 
svn merge --ignore-ancestry -c 1229403 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1229405 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 22:38:10 +00:00
Siddharth Seth 16288c5a7c merge MAPREDUCE-3616 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1229395 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 22:21:42 +00:00
Vinod Kumar Vavilapalli 65e6abb477 MAPREDUCE-3511. Removed a multitude of cloned/duplicate counters in the AM thereby reducing the AM heap size and preventing full GCs. (vinodkv) 
svn merge -c 1229347 trunk


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1229350 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 21:07:25 +00:00
Alejandro Abdelnur e3e457398e Merge -r 1227786:1227787 from trunk to branch. FIXES: HADOOP-7934 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1227805 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 20:06:52 +00:00
Arun Murthy 2281b945d8 Merge -c 1227801 from trunk to branch-0.23 to fix MAPREDUCE-3548. MAPREDUCE-3548. Added more unit tests for MR AM & JHS web-services. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1227802 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 20:02:15 +00:00
Siddharth Seth 2d360c5514 merge MAPREDUCE-3569 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1227486 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 05:20:40 +00:00
Arun Murthy fa86b57c30 Merge -c 1227426 from trunk to branch-0.23 to fix MAPREDUCE-3572. Moved AM event dispatcher to a separate thread for performance reasons. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1227428 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 01:38:49 +00:00
Arun Murthy 2122954a0d Merge -c 1227422 from trunk to branch-0.23 to fix MAPREDUCE-3566. Fixed MR AM to construct CLC only once across all tasks. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1227424 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 01:34:48 +00:00
Vinod Kumar Vavilapalli 16b1c5c24d MAPREDUCE-3490. Fixed MapReduce AM to count failed maps also towards Reduce ramp up. Contributed by Sharad Agarwal and Arun C Murthy. 
svn merge -c 1227226 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1227227 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 17:12:06 +00:00
Harsh J aa4147c428 merge MAPREDUCE-3610 (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1227098 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 10:18:24 +00:00
Vinod Kumar Vavilapalli a1b5b3541e MAPREDUCE-3568. Optimized Job's progress calculations in MR AM. (vinodkv) 
svn merge -c 1224995 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1224996 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-27 19:55:56 +00:00
Siddharth Seth 67e975d653 Merge MAPREDUCE-3567 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1222499 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-22 22:36:08 +00:00
Siddharth Seth 769178f3c0 MAPREDUCE-3349. Log rack-name in JobHistory for unsuccessful tasks. (Contributed by Amar Kamat and Devaraj K) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1221939 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 23:36:14 +00:00
Vinod Kumar Vavilapalli cc6328635b MAPREDUCE-3339. Fixed MR AM to stop considering node blacklisting after the number of nodes blacklisted crosses a threshold. Contributed by Siddharth Seth. 
svn merge -c 1221523 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1221524 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 23:27:57 +00:00
Vinod Kumar Vavilapalli edc58b0916 MAPREDUCE-3564. Fixed failures in TestStagingCleanup and TestJobEndNotifier tests. Contributed by Siddharth Seth. 
svn merge -c 1215022 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1215023 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 02:09:54 +00:00
Vinod Kumar Vavilapalli 660fb6cbf8 MAPREDUCE-3487. Fixed JobHistory web-UI to display links to single task's counters' page. Contributed by Jason Lowe. 
svn merge -c 1215016 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1215017 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 01:52:12 +00:00
Vinod Kumar Vavilapalli 87b8d8612c MAPREDUCE-3484. Fixed JobEndNotifier to not get interrupted before completing all its retries. Contributed by Ravi Prakash. 
svn merge -c 1214563 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1214566 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 23:59:54 +00:00
Vinod Kumar Vavilapalli 88fe1ae2ed MAPREDUCE-3426. Fixed MR AM in uber mode to write map intermediate outputs in the correct directory to work properly in secure mode. Contributed by Hitesh Shah. 
svn merge -c 1213987 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1213989 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:42:50 +00:00
Vinod Kumar Vavilapalli affa6d2ee1 MAPREDUCE-2863. Support web services for YARN and MR components. Contributed by Thomas Graves. 
svn merge -c 1213975 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1213978 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:12:33 +00:00
Siddharth Seth 1912f4c7b8 mrege MAPREDUCE-3460 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1209740 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-02 22:22:01 +00:00
Mahadev Konar 2ef6051da9 MAPREDUCE-3463. Second AM fails to recover properly when first AM is killed with java.lang.IllegalArgumentException causing lost job. (Siddharth Seth via mahadev) - Merging r1208994 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1208995 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 08:37:14 +00:00
Mahadev Konar 2ba32989db MAPREDUCE-3450. NM port info no longer available in JobHistory. (Siddharth Seth via mahadev) - Merging r1208327 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1208328 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 08:44:52 +00:00
Mahadev Konar 7f97bed786 MAPREDUCE-3413. RM web ui applications not sorted in any order by default. (Jonathan Eagles via mahadev) - Merging r1206926 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1206928 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-27 23:59:31 +00:00
Arun Murthy fbfe1b0afa Changing branch-0.23 to 0.23.1-SNAPSHOT. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1205240 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 23:47:40 +00:00
Vinod Kumar Vavilapalli 6a1621e32c MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) 
svn merge -c r1202744 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1202745 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 15:40:05 +00:00
Vinod Kumar Vavilapalli b7ff3d01b5 MAPREDUCE-3280. Removed the unnecessary job user-name configuration in mapred-site.xml. (vinodkv) 
svn merge -c r1200441 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1200444 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-10 17:31:14 +00:00
Vinod Kumar Vavilapalli cfbea52bd9 MAPREDUCE-3333. Fixed bugs in ContainerLauncher of MR AppMaster due to which per-container connections to NodeManager were lingering long enough to hit the ulimits on number of processes. (vinodkv) 
svn merge -c r1199751 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1199757 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-09 13:45:02 +00:00
Vinod Kumar Vavilapalli fe6c20b02a MAPREDUCE-3342. Fixed JobHistoryServer to also show the job's queue name. Contributed by Jonathan Eagles. 
svn merge -c r1199133 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1199135 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 07:30:56 +00:00
Arun Murthy 46d9ffc886 Merge -c 1196977 from trunk to branch-0.23 to fix MAPREDUCE-3337. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196978 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 07:08:33 +00:00
Thomas White 92fd345d14 Merge -r 1195816:1195817 from trunk to branch-0.23. Fixes: HADOOP-7782. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195821 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 04:53:00 +00:00
Mahadev Konar 17795f65ea MAPREDUCE-3103. Implement Job ACLs for MRAppMaster. (mahadev) - Merging r1195761 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195763 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 01:54:20 +00:00
Arun Murthy 07c755a394 Merge -c 1195575 from trunk to branch-0.23 to fix MAPREDUCE-3035. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195576 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 17:29:35 +00:00
Vinod Kumar Vavilapalli 4b4b1c89cc MAPREDUCE-3146. Added a MR specific command line to dump logs for a given TaskAttemptID. Contributed by Siddharth Seth. 
svn merge -c r1195349 --ignore-ancestry ../../trunk


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195353 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 06:48:08 +00:00
Vinod Kumar Vavilapalli 80ecd29d8a MAPREDUCE-3274. Fixed a race condition in MRAppMaster that was causing a task-scheduling deadlock. Contributed by Robert Joseph Evans. 
svn merge -c r1195145 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195146 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-30 11:33:34 +00:00
Arun Murthy 6f2f253446 Merge -c 1194850 from trunk to branch-0.23 to fix MAPREDUCE-3256. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1194851 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 09:37:02 +00:00
Alejandro Abdelnur 954b0ff8ab Merge -r 1188475:1188476 from trunk to branch. FIXES: MAPREDUCE-3248 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1190671 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 23:30:05 +00:00
Alejandro Abdelnur 073139bb57 Merge -r 1185966:1185967 from trunk to branch. FIXES: MAPREDUCE-3199 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1190667 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 23:14:55 +00:00
Alejandro Abdelnur 0eba9bcc06 Merge -r 1180282:1180283 from trunk to branch. FIXES: MAPREDUCE-3003 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1190643 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 22:36:55 +00:00
Arun Murthy f9376e264d Merge -c 1190495 from trunk to branch-0.23 to fix MAPREDUCE-3304. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1190496 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 18:46:27 +00:00
Vinod Kumar Vavilapalli 4fbaa0ff46 MAPREDUCE-3296. Fixed the remaining nine FindBugs warnings. (vinodkv) 
svn merge -c r1190187 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1190188 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 07:46:21 +00:00
Vinod Kumar Vavilapalli fc8079e054 MAPREDUCE-2989. Modified JobHistory to link to task and AM logs from the JobHistoryServer. Contributed by Siddharth Seth. 
svn merge -c r1190174 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1190175 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 06:52:40 +00:00
Arun Murthy 524b2d514f Merge -c 1190160 from trunk to branch-0.23 to fix MAPREDUCE-3258. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1190161 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 05:08:53 +00:00
Mahadev Konar e8b692c4f6 MAPREDUCE-3186. User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed. (Eric Payne via mahadev) - Merging r1190122 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1190123 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 01:42:21 +00:00
Arun Murthy 4499878392 Merge -c 1189879 from trunk to branch-0.23 to fix MAPREDUCE-3228. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189880 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 17:32:39 +00:00
Vinod Kumar Vavilapalli c5028eaa38 MAPREDUCE-3240. Fixed NodeManager to be able to forcefully cleanup its containers (process-trees) irrespective of whether the container succeeded, or killed. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189713 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 12:06:08 +00:00
Arun Murthy 23eb484fa1 Merge -c 1189630 from trunk to branch-0.23 to fix MAPREDUCE-3257. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189631 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 06:25:07 +00:00
Arun Murthy b211fc72cc Merge -c 1189036 from trunk to branch-0.23 to fix for MAPREDUCE-2858. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189037 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 06:32:26 +00:00
Arun Murthy b0384fc087 Merge -c 1189012 from trunk to branch-0.23 to complete fix for MAPREDUCE-2977. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189013 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 02:58:00 +00:00
Arun Murthy 1bef05715d Merge -c 1188528 from trunk to branch-0.23 to complete fix for MAPREDUCE-2821. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188529 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 06:27:24 +00:00
Mahadev Konar ddccefbefb MAPREDUCE-2746. Yarn servers can't communicate with each other with hadoop.security.authorization set to true (acmurthy via mahadev) - Merging r1188522 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188524 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 06:12:14 +00:00
Arun Murthy 1527edc627 Merge -c 1188388 from trunk to branch-0.23 to complete fix for MAPREDUCE-3252. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188467 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 00:41:52 +00:00
Arun Murthy 28d52eabfa Merge -c 1188377 from trunk to branch-0.23 to complete fix for MAPREDUCE-3028. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188378 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 21:03:22 +00:00
Vinod Kumar Vavilapalli df7a66844b MAPREDUCE-2747. Cleaned up LinuxContainerExecutor binary sources and changed the configuration to use yarn names. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188261 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 17:59:30 +00:00
Vinod Kumar Vavilapalli 6069c2a82d MAPREDUCE-2708. Designed and implemented MR Application Master recovery to make MR AMs resume their progress after restart. Contributed by Sharad Agarwal. 
svn merge -c r1188043 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188044 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 08:44:54 +00:00
Vinod Kumar Vavilapalli b9e90a3319 MAPREDUCE-3233. Fixed a bug in MR Job so as to be able to restart the application on AM crash. Contributed by Mahadev Konar. 
svn merge -c r1187669 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187670 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-22 08:13:20 +00:00
Vinod Kumar Vavilapalli 1605fb7dbc MAPREDUCE-3058. Fixed MR YarnChild to report failure when task throws an error and thus prevent a hanging task and job. (vinodkv) 
svn merge -c r1187654 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187655 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-22 06:17:25 +00:00
Vinod Kumar Vavilapalli 9a8b923418 MAPREDUCE-3104. Implemented Application-acls. (vinodkv) 
svn merge -c r1186748 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186754 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 12:01:54 +00:00
Arun Murthy 38a73eebaf Merge -c 1186529 from trunk to branch-0.23 to complete fix for MAPREDUCE-2693. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186530 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 22:02:57 +00:00
Vinod Kumar Vavilapalli e3b9d11da8 MAPREDUCE-3144. Augmented JobHistory with the information needed for serving aggregated logs. Contributed by Siddharth Seth. 
svn merge -c r1185976 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185977 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 05:28:22 +00:00
Mahadev Konar a9fe990f7b MAPREDUCE-3203. Fix some javac warnings in MRAppMaster. (mahadev) - Merging r1185909 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185910 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 22:48:09 +00:00
Arun Murthy dfb1c18558 Merge -c 1185887 from trunk to branch-0.23 to complete fix for MAPREDUCE-3165. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185888 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 21:46:15 +00:00
Arun Murthy a990576916 Merge -c 1185880 from trunk to branch-0.23 to complete fix for MAPREDUCE-2762. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185881 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 21:38:08 +00:00
Mahadev Konar c1c9ad377e MAPREDUCE-3197. TestMRClientService failing on building clean checkout of branch 0.23 (mahadev) - Merging r1185486 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185487 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 05:13:11 +00:00
Arun Murthy df93e27dd6 Merge -c 1185447 from trunk to branch-0.23 to complete fix for MAPREDUCE-3068. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185448 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 01:23:14 +00:00
Vinod Kumar Vavilapalli 2ce6540fb0 MAPREDUCE-3032. Fixed TaskAttemptImpl so that JobHistory can have error information about failed tasks. Contributed by Devaraj K. 
svn merge -c r1185247 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185250 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 15:21:34 +00:00
Mahadev Konar 065ca399c8 MAPREDUCE-3187. Add names for various unnamed threads in MR2. (Todd Lipcon and Siddharth Seth via mahadev) - Merging r1184904 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1184905 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-16 19:30:13 +00:00
Arun Murthy b57ac1cf61 Merge -c 1182613 from trunk to branch-0.23 to fix MAPREDUCE-2666. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1182614 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 23:12:37 +00:00
Vinod Kumar Vavilapalli a6d54ece55 MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah. 
svn merge -c r1182230 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1182231 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 06:53:14 +00:00
Vinod Kumar Vavilapalli af72e41ee1 MAPREDUCE-3020. Fixed TaskAttemptImpl to log the correct node-address for a finished Reduce task. (Chackaravarthy via vinodkv) 
svn merge -c r1181793 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1181794 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-11 14:12:11 +00:00
Vinod Kumar Vavilapalli ddaf7c8a7f MAPREDUCE-3161. svn merge -c r1181622 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1181623 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-11 04:47:28 +00:00
Arun Murthy 8d0daf8843 Merge -c 1181310 from trunk to branch-0.23 to fix MAPREDUCE-3158. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1181311 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-11 00:27:39 +00:00
Vinod Kumar Vavilapalli 3c053ee51e MAPREDUCE-3141. svn merge -c r1180007 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1180008 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 11:36:36 +00:00
Vinod Kumar Vavilapalli 8ccbd7d135 MAPREDUCE-2907. svn merge -c r1179178 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1179181 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 11:58:41 +00:00
Vinod Kumar Vavilapalli c4148c8db1 MAPREDUCE-3013. svn merge -c r1179174 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1179175 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 11:47:00 +00:00
Vinod Kumar Vavilapalli fd1e8b15d5 MAPREDUCE-3056. svn merge -c r1178740 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1178741 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 09:39:50 +00:00
Arun Murthy 9efc5089de Merge -r 1178630:1178631 from trunk to branch-0.23 to fix MAPREDUCE-2792. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1178633 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 23:23:04 +00:00
Vinod Kumar Vavilapalli 908f1d5d01 MAPREDUCE-3098. svn merge -c r1177633 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1177639 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 12:54:53 +00:00
Arun Murthy be51b71dee Merge -r 1177530:1177531 from trunk to branch-0.23 to fix MAPREDUCE-2996. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1177532 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 06:49:43 +00:00
Arun Murthy f99d1f7fde Merge -r 1177486:1177487 from trunk to branch-0.23 to fix MAPREDUCE-2791. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1177490 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 03:10:57 +00:00
Vinod Kumar Vavilapalli 3513e3d673 MAPERDUCE-3001. svn merge -c r1177203 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1177206 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 08:13:15 +00:00
Arun Murthy e6f5bf6dd8 Merge -r 1176761:1176762 from trunk to branch-0.23 to fix MAPREDUCE-3078. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1176763 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 07:32:22 +00:00
Arun Murthy eb30a784d1 Merge -r 1176680:1176681 from trunk to branch-0.23 to fix MAPREDUCE-3021. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1176683 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 01:25:32 +00:00
Mahadev Konar 876bb258d2 MAPREDUCE-3071. app master configuration web UI link under the Job menu opens up application menu. (thomas graves via mahadev) - merging r1176203 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1176205 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-27 05:33:48 +00:00
Vinod Kumar Vavilapalli 8a01676b92 MAPREDUCE-2646. svn merge -c r1175859 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1175861 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-26 13:29:26 +00:00
Arun Murthy b92299d168 Merge -r 1175717:1175718 from trunk to branch-0.23 to fix MAPREDUCE-3090. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1175719 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-26 08:45:56 +00:00
Arun Murthy da47ed5089 Merge -r 1175293:1175294 from trunk to branch-0.23 to fix MAPREDUCE-2961. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1175295 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-25 04:51:23 +00:00
Vinod Kumar Vavilapalli 2377d1697f MAPREDUCE-3055. svn merge -c r1174785 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1174792 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-23 14:12:27 +00:00
Vinod Kumar Vavilapalli c679348aa5 MAPREDUCE-2754. svn merge -c r1174194 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1174195 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-22 15:18:50 +00:00
Mahadev Konar 9b93426833 MAPREDUCE-3044. Pipes jobs stuck without making progress. (mahadev) - Merging -r1173909 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1173910 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 23:54:44 +00:00
Vinod Kumar Vavilapalli 01da4430d2 MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1173792 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 18:52:27 +00:00
Vinod Kumar Vavilapalli 9a8f4b655a MAPREDUCE-2930. svn merge -c r1173524 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1173525 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 08:40:17 +00:00
Arun Murthy be05e01471 Merge -r 1173455:1173456 from trunk to branch-0.23 to fix MAPREDUCE-2998. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1173457 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 01:27:49 +00:00
Vinod Kumar Vavilapalli eed08c0356 MAPREDUCE-2726. svn merge -c r1172704 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1172708 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-19 17:05:06 +00:00
Vinod Kumar Vavilapalli dffecdf85a MAPREDUCE-3006. svn merge -c r1172206 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1172207 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-18 07:18:42 +00:00
Mahadev Konar 66ad5a6154 MAPREDUCE-2672. MR-279: JobHistory Server needs Analysis this job. (Robert Evans via mahadev) - Merging r1171297 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1171299 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-15 22:23:11 +00:00
Vinod Kumar Vavilapalli 3e8f0b3c8e MAPREDUCE-2966. svn merge -c r1170746 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1170751 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-14 18:01:53 +00:00
Mahadev Konar 90a5181501 MAPREDUCE-2899. Replace major parts of ApplicationSubmissionContext with a ContainerLaunchContext (Arun Murthy via mahadev) - Merging r1170459 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1170460 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-14 07:29:45 +00:00
Mahadev Konar cc9369f691 MAPREDUCE-2676. MR-279: JobHistory Job page needs reformatted. (Robert Evans via mahadev) - Merging r1170379 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1170380 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 22:57:59 +00:00
Arun Murthy ba9254b44f fMerge -r 1170280:1170281 from trunk to branch-0.23 to fix MAPREDUCE-2997. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1170283 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 18:15:54 +00:00
Arun Murthy cd7c0749ca fMerge -r 1170278:1170279 from trunk to branch-0.23 to fix MAPREDUCE-2995. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1170280 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 18:13:05 +00:00
Arun Murthy 677c212467 Merge -r 1169979:1169980 from trunk to branch-0.23 to fix MAPREDUCE-2896. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1169981 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 00:07:09 +00:00
Arun Murthy 6ad35c6378 Merge -r 1169972:1169973 from trunk to branch-0.23 to fix MAPREDUCE-2874. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1169974 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-12 23:18:30 +00:00
Vinod Kumar Vavilapalli a7b3a14363 MAPREDUCE-2675. svn merge -c r1169763 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1169767 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-12 14:28:02 +00:00
Arun Murthy cbd0ddfebe Merge -r 1169483:1169484 from trunk to branch-0.23 to fix MAPREDUCE-2933. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1169485 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-11 17:28:08 +00:00
Vinod Kumar Vavilapalli 6814d04c3e MAPREDUCE-2691. svn merge -c r1167676 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1167677 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-11 06:29:05 +00:00
Arun Murthy 3dd8d9476b Merge -r 1166954:1166955 from trunk to branch-0.23 to fix MAPREDUCE-2864. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1166957 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 01:58:40 +00:00
Arun Murthy 2df748af75 Merge -r 1166900:1166901 from trunk to branch-0.23 to fix MAPREDUCE-2677. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1166904 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-08 21:04:17 +00:00
Arun Murthy e7c0ee77c6 Merge -r 1165929:1165930 from trunk to branch-0.23 to fix MAPREDUCE-2800. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1165932 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 23:37:04 +00:00
Vinod Kumar Vavilapalli cb8d102f97 MAPREDUCE-2716. svn merge -c r1164805 --ignore-ancestry ../../trunk/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1164807 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-03 06:46:45 +00:00
Vinod Kumar Vavilapalli 464486bee3 MAPREDUCE-2652. svn merge -c r1163585 --ignore-ancestry trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1163626 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 14:07:25 +00:00
Mahadev Konar e123403fda MAPREDUCE-2886. Fix Javadoc warnings in MapReduce. (mahadev) - Merge r1163050 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1163051 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-29 23:31:00 +00:00
Arun Murthy 58676edf98 MAPREDUCE-2879. Fix version for MR-279 to 0.23.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161705 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 19:13:50 +00:00
Mahadev Konar 7c85f33ce1 MAPREDUCE-2877. Add missing Apache license header in some files in MR and also add the rat plugin to the poms. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161650 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 17:16:36 +00:00
Arun Murthy cd7157784e HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161332 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 00:14:24 +00:00