Commit Graph

1790 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli 3861f9f50d MAPREDUCE-3716. Fixing YARN+MR to allow MR jobs to be able to use java.io.File.createTempFile to create temporary files as part of their tasks. Contributed by Jonathan Eagles.
svn merge --ignore-ancestry -c 1238136 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1238138 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 02:24:54 +00:00
Mahadev Konar fc432d7f33 MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) - Merge r1237920 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1237921 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 18:51:03 +00:00
Mahadev Konar 4954e376d0 HADOOP-7999. "hadoop archive" fails with ClassNotFoundException. (Jason Lowe via mahadev) - Merging r1237915 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1237916 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 18:34:55 +00:00
Amar Kamat 4b946ebdf2 MAPREDUCE-2784. [Gridmix] Bug fixes in ExecutionSummarizer and ResourceUsageMatcher. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1237579 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 09:41:20 +00:00
Amar Kamat 2ef107ff90 MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1237578 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 09:38:47 +00:00
Tsz-wo Sze 71bbbd85b4 svn merge -c 1237549 from trunk for deleting svn:mergeinfo from .gitignore and test java source files.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1237552 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 07:30:43 +00:00
Mahadev Konar e1ff641291 HADOOP-8002. SecurityUtil acquired token message should be a debug rather than info. (Arpit Gupta via mahadev) - Merging r1236976 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236977 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 04:08:56 +00:00
Jitendra Nath Pandey 0b69afc808 Merged r1236960 from trunk for HADOOP-7988.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236962 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 02:35:25 +00:00
Vinod Kumar Vavilapalli 94790f2a1c MAPREDUCE-3732. Modified CapacityScheduler to use only users with pending requests for computing user-limits. Contributed by Arun C Murthy.
svn merge --ignore-ancestry -c 1236953 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236954 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 01:35:45 +00:00
Todd Lipcon 8f9e2627dc HDFS-2791. If block report races with closing of file, replica is incorrectly marked corrupt. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236944 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:39:19 +00:00
Alejandro Abdelnur 56b07f1ab2 Merge -r 1236939:1236940 from trunk to branch. FIXES: HDFS-2840
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236942 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:28:37 +00:00
Alejandro Abdelnur 4132e3991e Merge -r 1236928:1236929 from trunk to branch. FIXES: HADOOP-7939
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236934 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:10:34 +00:00
Mahadev Konar 8d3893bb96 HADOOP-8000. fetchdt command not available in bin/hadoop. (Arpit Gupta via mahadev) - Merging r1236921 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236923 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 23:17:58 +00:00
Robert Joseph Evans 58960cf419 merge HADOOP-7998
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236913 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 22:50:45 +00:00
Mahadev Konar 36bfc71cdf MAPREDUCE-3742. "yarn logs" command fails with ClassNotFoundException. (Jason Lowe via mahadev) - Merging r1236816 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236818 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 18:54:24 +00:00
Arun Murthy 599264116d Merge -c 1236594 from trunk to branch-0.23 to fix MAPREDUCE-3693. Added mapreduce.admin.user.env to mapred-default.xml.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236596 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 08:50:24 +00:00
Arun Murthy f1b833c8a3 Merge -c 1236588 from trunk to branch-0.23 to fix MAPREDUCE-3720. Changed bin/mapred job -list to not print job-specific information not available at RM.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236589 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 08:45:24 +00:00
Mahadev Konar ef144fd7a0 HADOOP-7993. Hadoop ignores old-style config options for enabling compressed output. (Anupam Seth via mahadev) - Merging r1236506 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236507 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 03:44:55 +00:00
Eli Collins 1f235fbb04 HADOOP-7997. svn merge -c 1236456 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236461 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 00:14:31 +00:00
Vinod Kumar Vavilapalli 890abf867c MAPREDUCE-3360. Added information about lost/rebooted/decommissioned nodes on the webapps. Contributed by Bhallamudi Venkata Siva Kamesh and Jason Lowe.
svn merge --ignore-ancestry -c 1236433 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236438 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 22:58:12 +00:00
Vinod Kumar Vavilapalli 981ba68664 MAPREDUCE-3699. Increased RPC handlers for all YARN servers to reasonable values for working at scale. Contributed by Hitesh Shah.
svn merge --ignore-ancestry -c 1236396 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236398 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 21:38:31 +00:00
Mahadev Konar ccaba4ba7e MAPREDUCE-3737. The Web Application Proxy's is not documented very well. (Robert Evans via mahadev) - Merging r1236371 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236373 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 20:12:24 +00:00
Siddharth Seth 82c1a407d5 merge MAPREDUCE-3718 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236360 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 19:31:49 +00:00
Alejandro Abdelnur c1fd273580 Merge -r 1236337:1236338 from trunk to branch. FIXES: HDFS-2837
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236339 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:16:27 +00:00
Mahadev Konar 5dd4c5a6f7 MAPREDUCE-3735. Add distcp jar to the distribution (tar). (mahadev) - Merging r1236336 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236337 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:14:01 +00:00
Alejandro Abdelnur 5f2d286963 Merge -r 1236327:1236328 from trunk to branch. FIXES: HDFS-2836
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236331 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:00:41 +00:00
Harsh J 26b88c3279 merge HADOOP-4515 HADOOP-6490 HADOOP-7574 HADOOP-7736 HADOOP-7919 to 0.23 from trunk and update CHANGES.txt file accordingly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236124 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 10:05:40 +00:00
Mahadev Konar c9a5c42efd MAPREDUCE-3733. Add Apache License Header to hadoop-distcp/pom.xml. (mahadev) - Merging r1236066 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236068 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 08:31:54 +00:00
Mahadev Konar 505dd18690 MAPREDUCE-2765. DistCp Rewrite. (Mithun Radhakrishnan via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236049 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 06:50:00 +00:00
Arun Murthy 10a3c56fcf Merge -c 1236041 from trunk to branch-0.23 to fix MAPREDUCE-3721. Fixed a race in shuffle which caused reduces to hang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1236042 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 05:41:17 +00:00
Vinod Kumar Vavilapalli 6d5b37e261 MAPREDUCE-3713. Fixed the way head-room is allocated to applications by CapacityScheduler so that it deducts current-usage per user and not per-application. Contributed by Arun C Murthy.
svn merge --ignore-ancestry -c 1235989 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235990 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 23:32:11 +00:00
Robert Joseph Evans 142b34f065 merge MAPREDUCE-3194
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235959 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 21:28:49 +00:00
Jitendra Nath Pandey 5f8d2a075f Merged r1235945 from trunk for HADOOP-7987.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235948 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 21:09:27 +00:00
Arun Murthy 8507d72465 Merge -c 1235858 from trunk to branch-0.23 to fix MAPREDUCE-3683. Fixed maxCapacity of queues to be product of parent maxCapacities.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235860 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 18:19:02 +00:00
Siddharth Seth ac9e1a8103 merge MAPREDUCE-3630 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235642 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 06:31:08 +00:00
Mahadev Konar c929ba95a9 MAPREDUCE-3717. JobClient test jar has missing files to run all the test programs. (mahadev) - Merging r1235639 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235640 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 06:26:22 +00:00
Mahadev Konar 75f8caf8d3 MAPREDUCE-3712. The mapreduce tar does not contain the hadoop-mapreduce-client-jobclient-tests.jar. (mahadev) - Merging r1235566 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235567 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 00:16:42 +00:00
Vinod Kumar Vavilapalli c516cc863a MAPREDUCE-3714. Fixed EventFetcher and Fetcher threads to shut-down properly so that reducers don't hang in corner cases. (vinodkv)
svn merge --ignore-ancestry -c 1235545 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235546 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 23:18:46 +00:00
Vinod Kumar Vavilapalli 0bf9779489 MAPREDUCE-3710. Improved FileInputFormat to return better locality for the last split. Contributed by Siddarth Seth.
svn merge --ignore-ancestry -c 1235510 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235511 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 21:30:48 +00:00
Alejandro Abdelnur 1a1474885b Merge -r 1235390:1235391 from trunk to branch. FIXES: MAPREDUCE-3505
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235397 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 18:26:17 +00:00
Harsh J 5f28329fe0 merge HDFS-442. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235139 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:17:36 +00:00
Eli Collins 517766b98b HDFS-2397. svn merge -c 1235135 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235136 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:10:21 +00:00
Arun Murthy 439446057d Merge -c 1235103 from trunk to branch-0.23 to fix MAPREDUCE-3681. Fixed computation of queue's usedCapacity.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235104 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 01:06:55 +00:00
Todd Lipcon d6ebd72325 HDFS-2826. Add test case for HDFS-1476 (safemode can initialize replication queues before exiting) (todd)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235068 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 23:42:25 +00:00
Mahadev Konar cfff5ff7f4 MAPREDUCE-3646. Remove redundant URL info from "mapred job" output. (Jonathan Eagles via mahadev) - Merging r1235034 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235042 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 22:34:44 +00:00
Todd Lipcon 747551a184 HDFS-2825. Add test hook to turn off the writer preferring its local DN. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235024 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 22:06:53 +00:00
Mahadev Konar 118333dbe0 HADOOP-7981. Improve documentation for org.apache.hadoop.io.compress. Decompressor.getRemaining (Jonathan Eagles via mahadev) - Merging r1235007 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1235010 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:47:42 +00:00
Mahadev Konar d0b1cd9b7e MAPREDUCE-3702 and MAPREDUCE-3691 - merging r1234991 and r1234989 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1234994 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:27:19 +00:00
Todd Lipcon 1b935dd6be HDFS-2822. processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1234926 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 18:12:25 +00:00
Harsh J d1cab74401 merge HDFS-2818 (Devaraj K via harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1234561 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 17:55:00 +00:00