23e336a0ed
MAPREDUCE-3765. FifoScheduler does not respect yarn.scheduler.fifo.minimum-allocation-mb setting (Hitesh Shah via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240634 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 22:44:43 +00:00
f3c35222e6
MAPREDUCE-3775. Change MiniYarnCluster to escape special chars in testname. (Hitesh Shah via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240603 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:20:00 +00:00
c7d64769c1
MAPREDUCE-3759. ClassCastException thrown in -list-active-trackers when there are a few unhealthy nodes (vinodkv via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240598 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:03:37 +00:00
f2280f612c
MAPREDUCE-3795. "job -status" command line output is malformed. (vinodkv via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240593 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 19:32:10 +00:00
caed1cfaf9
MAPREDUCE-3723. TestAMWebServicesJobs & TestHSWebServicesJobs incorrectly asserting tests (Bhallamudi Venkata Siva Kamesh via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240590 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 18:55:03 +00:00
2c32cd7008
MAPREDUCE-3791. can't build site in hadoop-yarn-server-common. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240587 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 18:41:50 +00:00
1de317a945
MAPREDUCE-3803. Fix broken build of raid contrib due to HDFS-2864. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240441 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 02:24:21 +00:00
fe1cf3b0ac
MAPREDUCE-3417. Fixed job-access-controls to work with MR AM and JobHistoryServer web-apps. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240428 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 01:21:12 +00:00
3343494d6c
MAPREDUCE-3760. Changed active nodes list to not contain unhealthy nodes on the webUI and metrics. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240421 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 01:03:51 +00:00
94242c9385
MAPREDUCE-3711. Fixed MR AM recovery so that only single selected task output is recovered and thus reduce the unnecessarily bloated recovery time. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240413 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 00:04:53 +00:00
b030231108
MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong jobtoken file (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240410 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 23:48:48 +00:00
a5c46c9165
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239971 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 01:16:32 +00:00
72d34e6594
MAPREDUCE-3708. Metrics: Incorrect Apps Submitted Count (Bhallamudi via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239954 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 00:33:05 +00:00
1950f97ab9
HADOOP-8012. hadoop-daemon.sh and yarn-daemon.sh are trying to mkdir and chown log/pid dirs which can fail. Contributed by Roman Shaposhnik
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 18:45:07 +00:00
cc74881acb
MAPREDUCE-3771. Un-deprecated the old mapred apis, port of MAPREDUCE-1735.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239482 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 08:37:58 +00:00
70bc14f234
MAPREDUCE-3780. Fixed a bug where applications killed before getting activated were not getting cleaned up properly. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239443 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 02:31:05 +00:00
6ba0375b21
MAPREDUCE-3744. Fix the yarn logs command line. Improve error messages for mapred job -logs. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239433 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 01:43:49 +00:00
ef1a619a4d
MAPREDUCE-3752. Modified application limits to include queue max-capacities besides the usual user limits. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239422 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 00:41:09 +00:00
b4929bcf14
MAPREDUCE-3640. Allow AMRecovery to work with partial JobHistory files. (Contributed by Arun C Murthy)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239402 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 23:33:58 +00:00
ab75b8b420
MAPREDUCE-3427. Fix streaming unit tests broken after mavenization. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239391 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 23:05:14 +00:00
42d1c9b251
HADOOP-7470. Move up to Jackson 1.8.8. Contributed by Enis Soztutar
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239386 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 22:55:59 +00:00
947ede4c4e
MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239310 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 20:43:10 +00:00
b33c66efc5
MAPREDUCE-3774. Moved yarn-default.xml to hadoop-yarn-common from hadoop-server-common.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239291 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 19:55:20 +00:00
e3d555a656
MAPREDUCE-3499. New MiniMR does not setup proxyuser configuration correctly, thus tests using doAs do not work. (johnvijoe via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239207 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 17:03:27 +00:00
f49ba355e5
MAPREDUCE-3762. Fixed default CapacityScheduler configs. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238987 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 07:57:35 +00:00
d1f805f942
MAPREDUCE-3754. Modified RM UI to filter applications based on state of the applications. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238887 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 00:51:40 +00:00
05efddf28e
MAPREDUCE-3749. ConcurrentModificationException in counter groups.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238734 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 18:30:58 +00:00
a8b6ee0491
MAPREDUCE-3756. Made single shuffle limit configurable. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238721 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 18:08:11 +00:00
7f23d72352
MAPREDUCE-3764. Fixed resource usage metrics for queues and users.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238255 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 08:30:31 +00:00
7ed0f74997
MAPREDUCE-3748. Changed a log in CapacityScheduler.nodeUpdate to debug. Contributed by Ramya Sunil.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238157 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 06:22:22 +00:00
443d8f6c0b
MAPREDUCE-3679. AM logs and others should not automatically refresh after every 1 second. (Vinod KV via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238146 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 04:53:49 +00:00
76b653a367
MAPREDUCE-3716. Fixing YARN+MR to allow MR jobs to be able to use java.io.File.createTempFile to create temporary files as part of their tasks. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238136 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 02:23:38 +00:00
7e4725db41
MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237920 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 18:47:55 +00:00
5652e71992
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237543 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 06:20:53 +00:00
327c216c2f
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236965 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 02:50:23 +00:00
5262b7ba4d
MAPREDUCE-3732. Modified CapacityScheduler to use only users with pending requests for computing user-limits. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236953 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 01:32:29 +00:00
2b2e56056e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236936 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:21:07 +00:00
8a234f394e
HADOOP-7939. Improve Hadoop subcomponent integration in Hadoop 0.23. (rvs via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236929 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 23:53:35 +00:00
fe4bff77e1
MAPREDUCE-3740. Fixed broken mapreduce compilation after the patch for HADOOP-7965. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236901 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 21:49:15 +00:00
fdb9d51cec
MAPREDUCE-3742. "yarn logs" command fails with ClassNotFoundException. (Jason Lowe via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236816 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 18:46:56 +00:00
f57de0d6dd
MAPREDUCE-3693. Added mapreduce.admin.user.env to mapred-default.xml. Contributed by Roman Shapshonik.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236594 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 08:49:18 +00:00
0cb3dd913b
MAPREDUCE-3720. Changed bin/mapred job -list to not print job-specific information not available at RM. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236588 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 08:44:19 +00:00
3cdc100369
MAPREDUCE-3360. Added information about lost/rebooted/decommissioned nodes on the webapps. Contributed by Bhallamudi Venkata Siva Kamesh and Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236433 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 22:56:53 +00:00
54f738575c
MAPREDUCE-3699. Increased RPC handlers for all YARN servers to reasonable values for working at scale. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236396 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 21:37:28 +00:00
af6448e543
MAPREDUCE-3737. The Web Application Proxy's is not documented very well. (Robert Evans via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236371 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 20:10:50 +00:00
5283398187
MAPREDUCE-3718. Amending incorrect JIRA number in CHANGES.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236358 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 19:31:00 +00:00
2bd728b366
MAPREDUCE-3712. Change default AM heartbeat interval to 1 second. (Contributed by Hitesh Shah)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236356 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 19:28:45 +00:00
faa6806df3
MAPREDUCE-3735. Add distcp jar to the distribution (tar). (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236336 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:10:11 +00:00
1c95060a72
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236333 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:03:46 +00:00
34a6a9f4bc
MAPREDUCE-3733. Add Apache License Header to hadoop-distcp/pom.xml. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236066 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 08:30:17 +00:00
d06948002f
MAPREDUCE-2765. DistCp Rewrite. (Mithun Radhakrishnan via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236045 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 06:36:52 +00:00
fae75c2d7f
MAPREDUCE-3721. Fixed a race in shuffle which caused reduces to hang. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236041 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 05:40:29 +00:00
21c9116309
MAPREDUCE-3713. Fixed the way head-room is allocated to applications by CapacityScheduler so that it deducts current-usage per user and not per-application. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235989 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 23:31:14 +00:00
1149d9a13d
MAPREDUCE-3194. "mapred mradmin" command is broken in mrv2 (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235956 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 21:22:33 +00:00
9d1621da52
MAPREDUCE-3683. Fixed maxCapacity of queues to be product of parent maxCapacities.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235858 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 18:17:55 +00:00
1853b9d188
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235856 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 18:07:43 +00:00
a02f07c4bc
MAPREDUCE-3630. Fixes a NullPointer exception while running TeraGen - if a map is asked to generate 0 records. (Contributed by Mahadev Konar)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235641 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 06:30:09 +00:00
c43a5a992e
MAPREDUCE-3717. JobClient test jar has missing files to run all the test programs. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235639 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 06:24:46 +00:00
c7642a135c
MAPREDUCE-3712. The mapreduce tar does not contain the hadoop-mapreduce-client-jobclient-tests.jar. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235566 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 00:14:26 +00:00
078ae89a47
MAPREDUCE-3714. Fixed EventFetcher and Fetcher threads to shut-down properly so that reducers don't hang in corner cases. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235545 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 23:18:05 +00:00
dc615c312b
MAPREDUCE-3710. Improved FileInputFormat to return better locality for the last split. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235510 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 21:29:39 +00:00
f73daf6af1
MAPREDUCE-3505. yarn APPLICATION_CLASSPATH needs to be overridable. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235391 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 18:21:27 +00:00
83bcb1bbf4
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235380 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 17:59:14 +00:00
5dfe62d845
HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235135 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:05:52 +00:00
9a153334ac
MAPREDUCE-3681. Fixed computation of queue's usedCapacity.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235103 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 01:00:51 +00:00
fa4a33a566
Merge trunk into HA branch.
...
- Some conflicts on BlockManager due to the recent commit of HDFS-2822 - moved logic to processMisReplicatedBlock function
- testNoExtensionIfNoBlocks(org.apache.hadoop.hdfs.TestSafeMode) is now failing due to an existing bug in the HA branch, to be fixed soon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235078 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 00:00:05 +00:00
27c56b02b3
MAPREDUCE-3646. Remove redundant URL info from "mapred job" output. (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235034 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 22:22:53 +00:00
4b36997b1b
MAPREDUCE-3702. internal server error trying access application master via proxy with filter enabled. (Thomas Graves via mahadev.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234991 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:22:09 +00:00
c415dee2b7
MAPREDUCE-3691. webservices add support to compress response. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234989 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:15:55 +00:00
e42bbfbca2
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234924 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 18:07:27 +00:00
355ba01374
MAPREDUCE-3705. ant build fails on 0.23 branch. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234227 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 01:15:24 +00:00
8a1719e999
MAPREDUCE-3549. write api documentation for web service apis for RM, NM, mapreduce app master, and job history server (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234222 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 00:53:02 +00:00
b49aae0635
MAPREDUCE-3689. RM web UI doesn't handle newline in job name. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234148 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 21:27:39 +00:00
c6923061d0
MAPREDUCE-3698. Client cannot talk to the history server in secure mode. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234120 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 20:44:17 +00:00
2abe5c818d
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234087 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 19:30:53 +00:00
6861560098
MAPREDUCE-3692. yarn-resourcemanager out and log files can get big. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233605 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 22:23:53 +00:00
6177bf6c8f
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233105 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 23:02:17 +00:00
10325d9732
MAPREDUCE-3582. Move successfully passing MR1 tests to MR2 maven tree.(ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233090 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 22:10:12 +00:00
8b2f6909ec
MAPREDUCE-3684. LocalDistributedCacheManager does not shut down its thread pool.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232981 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 18:20:13 +00:00
d737c323a6
MAPREDUCE-3669. Allow clients to talk to MR HistoryServer using both delegation tokens and kerberos. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232580 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 21:25:08 +00:00
d05e6d2671
MAPREDUCE-2450. Fixed a corner case with interrupted communication threads leading to a long timeout in Task. Contributed by Rajesh Balamohan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232314 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 06:10:50 +00:00
940eeb866c
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232184 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:57:28 +00:00
4a343c9d4a
MAPREDUCE-3641. Making CapacityScheduler more conservative so as to assign only one off-switch container in a single scheduling iteration. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232182 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:56:14 +00:00
c81995e370
MAPREDUCE-3657. State machine visualize build fails. (Jason Lowe via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232167 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:22:21 +00:00
a24339e50d
MAPREDUCE-3649. Job End notification gives an error on calling back. (Ravi Prakash via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232126 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 19:35:06 +00:00
b62c1b8563
MAPREDUCE-3404. Corrected MR AM to honor speculative configuration and enable speculating either maps or reduces. Contributed by Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231395 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 23:41:23 +00:00
90f096d86c
MAPREDUCE-3532. Modified NM to report correct http address when an ephemeral web port is configured. Contributed by Bhallamudi Venkata Siva Kamesh.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231342 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 22:21:33 +00:00
0c278b0f63
MAPREDUCE-3656. Fixed a race condition in MR AM which is failing the sort benchmark consistently. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231314 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 21:31:40 +00:00
78ff0b720e
MAPREDUCE-3596. Fix scheduler to handle cleaned up containers, which NMs may subsequently report as running. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231297 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 21:15:22 +00:00
58f2da1c85
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1231242 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 18:54:02 +00:00
f717c5785e
MAPREDUCE-3664. Federation Documentation has incorrect configuration example. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230708 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 19:11:33 +00:00
8610a9231a
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230696 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 18:40:50 +00:00
74697f2317
MAPREDUCE-3512. Batching JobHistory flushing to DFS so that we don't flush for every event slowing down AM. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230353 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 01:42:10 +00:00
0086014703
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230336 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 00:15:35 +00:00
5f79f180f6
MAPREDUCE-3553. Add support for data returned when exceptions thrown from web service apis to be in either xml or in JSON. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230330 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 23:59:23 +00:00
0510e0659c
MAPREDUCE-3652. org.apache.hadoop.mapred.TestWebUIAuthorization.testWebUIAuthorization fails. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230328 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 23:50:09 +00:00
d0f89303e9
MAPREDUCE-3645. TestJobHistory fails. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230307 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 22:53:36 +00:00
c832b46d0b
MAPREDUCE-3651. TestQueueManagerRefresh fails. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230292 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 22:32:56 +00:00
ede7f21278
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230248 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 20:53:50 +00:00
c4c6d8ece3
MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230202 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 19:37:52 +00:00
39b8bbe663
MAPREDUCE-3618. Fixed TaskHeartbeatHandler to not hold a global lock for all task-updates. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229906 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 06:53:10 +00:00
bc4b1f48d3
MAPREDUCE-3380. Token infrastructure for running clients which are not kerberos authenticated. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229855 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 01:50:10 +00:00
7712e70090
MAPREDUCE-3251. Network ACLs can prevent some clients to talk to MR AM. Improved the earlier patch to not to JobHistoryServer repeatedly. Contributed by Anupam Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229787 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 23:07:54 +00:00
bc374626be
MAPREDUCE-3299. Added AMInfo table to the MR AM job pages to list all the job-attempts when AM restarts and recovers. (Jonathan Eagles via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229766 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 22:26:45 +00:00
44e0bb831b
MAPREDUCE-3382. Enhanced MR AM to use a proxy to ping the job-end notification URL. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229736 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 21:08:34 +00:00
849c68c7b5
MAPREDUCE-3312. Modified MR AM to not send a stop-container request for a container that isn't launched at all. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229451 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 02:15:48 +00:00
48150cddaf
MAPREDUCE-3639. Fixed TokenCache to work with absent FileSystem canonical service-names. (Siddharth Seth via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229444 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 01:38:27 +00:00
428529b58f
MAPREDUCE-3528. Fixed TaskHeartBeatHandler to use a new configuration for the thread loop interval separate from task-timeout configuration property. (Siddharth Seth via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229403 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 22:37:00 +00:00
239a5549ea
MAPREDUCE-3616. Thread pool for launching containers in MR AM not expanding as expected. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229394 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 22:20:23 +00:00
e8645636ce
MAPREDUCE-3511. Removed a multitude of cloned/duplicate counters in the AM thereby reducing the AM heap size and preventing full GCs. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 21:04:58 +00:00
ade897636d
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229279 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 18:01:55 +00:00
5ba6477099
MAPREDUCE-3624. Remove unnecessary dependency on JDK's tools.jar. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1228354 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 19:12:02 +00:00
d680080da0
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228339 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 18:47:05 +00:00
5f5561d057
Fixing CHANGES.txt files, moving JIRAs from trunk to 0.23.1 section. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227859 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 21:55:43 +00:00
2919ce8c8b
MAPREDUCE-3617. Removed wrong default value for yarn.resourcemanager.principal and yarn.nodemanager.principal. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227808 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 20:11:09 +00:00
7440a8aa37
MAPREDUCE-3548. Added more unit tests for MR AM & JHS web-services. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227801 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 20:01:20 +00:00
4404f20671
MAPREDUCE-3326. Added detailed information about queue's to the CapacityScheduler web-ui. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227788 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:50:18 +00:00
6d45b9e31d
HADOOP-7934. Normalize dependencies versions across all modules. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227787 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:46:42 +00:00
3187a3ae05
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227775 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:21:01 +00:00
a2bcb867e1
MAPREDUCE-3615. Fix some ant test failures. (Contributed by Thomas Graves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227741 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 18:47:59 +00:00
03d46dc571
MAPREDUCE-3569. TaskAttemptListener holds a global lock for all task-updates. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227485 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 05:19:44 +00:00
08f8abf563
MAPREDUCE-3572. Moved AM event dispatcher to a separate thread for performance reasons. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227426 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:37:13 +00:00
0870734787
MAPREDUCE-3566. Fixed MR AM to construct CLC only once across all tasks. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227422 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:29:52 +00:00
e793ba8cba
MAPREDUCE-3478. Cannot build against ZooKeeper 3.4.0. (Tom White via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227408 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 00:13:39 +00:00
be285fc27f
MAPREDUCE-3595. Add missing TestCounters#testCounterValue test from branch 1 to 0.23 (Contributed by Tom White)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227380 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 23:15:41 +00:00
f445eb31f1
MAPREDUCE-3529. TokenCache does not cache viewfs credentials correctly. (sseth)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227374 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 23:07:27 +00:00
cd81cc6664
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227260 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 18:47:51 +00:00
c27de4bd0b
MAPREDUCE-1744. DistributedCache creates its own FileSytem instance when adding a file/archive to the path. (Dick King via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227238 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 17:51:17 +00:00
55e94dc5ef
MAPREDUCE-3490. Fixed MapReduce AM to count failed maps also towards Reduce ramp up. Contributed by Sharad Agarwal and Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227226 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 17:10:31 +00:00
2f19c59f1d
MAPREDUCE-3610. Remove use of the 'dfs.block.size' config for default block size fetching. Use FS#getDefaultBlocksize instead. (Sho Shimauchi via harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227091 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 09:39:14 +00:00
4c0bac5670
MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227051 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 05:38:17 +00:00
4d768140b3
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225900 13f79535-47bb-0310-9956-ffa450edef68
2011-12-30 19:25:18 +00:00
4ab6ae543e
MAPREDUCE-3608. Fixed compile issue with MAPREDUCE-3522. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225726 13f79535-47bb-0310-9956-ffa450edef68
2011-12-30 02:24:14 +00:00
743a5b78e3
MAPREDUCE-3522. Ensure queues inherit ACLs from parent if they aren't explicitly specified. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225618 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 19:06:34 +00:00
f216303598
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225612 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 18:25:48 +00:00
7afb9aca70
MAPREDUCE-3521. Fixed streaming to ensure it doesn't silently ignore unknown arguments. Contributed by Robert Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225471 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 08:24:09 +00:00
f025652fda
MAPREDUCE-3547. Added a bunch of unit tests for the the RM/NM webservices. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225463 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 08:06:04 +00:00
d619dee4ed
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225264 13f79535-47bb-0310-9956-ffa450edef68
2011-12-28 18:37:22 +00:00
919f56c3d4
MAPREDUCE-3604. Fixed streaming to use new mapreduce.framework.name to check for local mode.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225259 13f79535-47bb-0310-9956-ffa450edef68
2011-12-28 18:23:12 +00:00
a9ffbdd0d7
MAPREDUCE-2944. Improve checking of input for JobClient.displayTasks() (XieXianshan via harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225188 13f79535-47bb-0310-9956-ffa450edef68
2011-12-28 14:11:02 +00:00
fcbad14a3d
MAPREDUCE-3568. Optimized Job's progress calculations in MR AM. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224995 13f79535-47bb-0310-9956-ffa450edef68
2011-12-27 19:54:51 +00:00
cd90b82227
MAPREDUCE-3399. Modifying ContainerLocalizer to send a heartbeat to NM immediately after downloading a resource instead of always waiting for a second. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224970 13f79535-47bb-0310-9956-ffa450edef68
2011-12-27 18:26:21 +00:00
a500ba50c2
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1224965 13f79535-47bb-0310-9956-ffa450edef68
2011-12-27 18:18:36 +00:00
1dcc4b57ee
MAPREDUCE-3597. [Rumen] Rumen should provide APIs to access all the job-history related information.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1222695 13f79535-47bb-0310-9956-ffa450edef68
2011-12-23 14:47:23 +00:00
8fa0a3c737
MAPREDUCE-3567. Extraneous JobConf objects in AM heap. Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1222498 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 22:34:40 +00:00
ef9b974879
MAPREDUCE-3586. Modified CompositeService to avoid duplicate stop operations thereby solving race conditions in MR AM shutdown. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221950 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 23:47:54 +00:00
264d3b7dd0
MAPREDUCE-3349. Log rack-name in JobHistory for unsuccessful tasks. (Devaraj K and Amar Kamat via amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221578 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 02:58:00 +00:00
8626f1bc6c
MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221533 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 00:06:06 +00:00
e7543b944c
MAPREDUCE-3339. Fixed MR AM to stop considering node blacklisting after the number of nodes blacklisted crosses a threshold. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221523 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 23:27:02 +00:00
4e1d5a0d71
MAPREDUCE-3391. Making a trivial change to correct a log message in DistributedShell app's AM. Contributed by Subroto Sanyal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221516 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 23:13:15 +00:00
96247ead03
MAPREDUCE-3376. Fixed Task to ensure it passes reporter to combiners using old MR api. Contributed by Subroto Sanyal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221501 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 22:01:13 +00:00
a61a18cc09
MAPREDUCE-3563. Fixed LocalJobRunner to work correctly with new mapreduce apis.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220996 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 23:07:17 +00:00
8ff28f4549
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220616 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 05:34:51 +00:00
2cf4aca02e
MAPREDUCE-3579. ConverterUtils shouldn't include a port in a path from a url without a port (Contributed by atm)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215528 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 17:10:12 +00:00
08c9dc3780
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215367 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:31:46 +00:00
feb3a23c71
MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215345 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 23:41:36 +00:00
a238f931ea
MAPREDUCE-778. Rumen Anonymizer. (Amar Kamat and Chris Douglas via amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215141 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 14:20:58 +00:00
6d551b83de
MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215065 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 09:09:28 +00:00
c4ff892520
MAPREDUCE-3422. Counter display names are not being picked up. Contributed by Jonathan Eagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215031 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 03:10:31 +00:00
f73bd5402e
MAPREDUCE-3564. Fixed failures in TestStagingCleanup and TestJobEndNotifier tests. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215022 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 02:09:00 +00:00
c2fe4a7e83
MAPREDUCE-3487. Fixed JobHistory web-UI to display links to single task's counters' page. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215016 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 01:51:15 +00:00
d937abd434
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214944 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 20:05:38 +00:00
227fb568b8
MAPREDUCE-3560. TestRMNodeTransitions is failing on trunk. (Siddharth Seth via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214668 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 09:11:18 +00:00
beec374542
MAPREDUCE-3251. Network ACLs can prevent some clients to talk to MR ApplicationMaster (Anupam Seth via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214662 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 08:58:51 +00:00
14ba2e65c9
MAPREDUCE-3531. Fixed a race in ContainerTokenSecretManager. (Contributed by Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214593 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 02:09:16 +00:00
cfbde6ac0f
MAPREDUCE-3484. Fixed JobEndNotifier to not get interrupted before completing all its retries. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214563 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 23:58:35 +00:00
b77c107ccb
Committing rest of merge from trunk (accidentally only committed the HDFS portion before)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214546 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 23:34:04 +00:00
c32ca00a75
MAPREDUCE-3530. Fixed an NPE occuring during scheduling in the ResourceManager. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214476 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 21:22:32 +00:00
50fa9b89f4
MAPREDUCE-3398. Fixed log aggregation to work correctly in secure mode. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214429 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:55:22 +00:00
739f8871f2
MAPREDUCE-3541. Fix broken TestJobQueueClient test. (Ravi Prakash via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214421 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:45:59 +00:00
2e6c75a062
MAPREDUCE-3557. MR1 test fail to compile because of missing hadoop-archives dependency. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214354 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 17:21:43 +00:00
f7f5e51431
Missed deleting the files in r1214066
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214106 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 08:30:37 +00:00
ec4971a280
MAPREDUCE-3545. Remove Avro RPC. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214066 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 06:57:00 +00:00
a839f875e8
MAPREDUCE-3544. gridmix build is broken, requires hadoop-archives to be added as ivy dependency. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214017 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 01:18:14 +00:00
b7ae5a6cb7
MAPREDUCE-3426. Fixed MR AM in uber mode to write map intermediate outputs in the correct directory to work properly in secure mode. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213987 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:35:11 +00:00
0ea8570be5
MAPREDUCE-2863. Support web services for YARN and MR components. (Thomas Graves via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213975 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:05:56 +00:00
37b8cc3f19
MAPREDUCE-3542. Support "FileSystemCounter" legacy counter group name for compatibility.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213971 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 22:59:49 +00:00
0201be46c2
HADOOP-7810. move hadoop archive to core from tools. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213907 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 20:17:59 +00:00
a0fe4f476a
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213867 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 19:02:37 +00:00
f611e1d1b1
MAPREDUCE-3537. Fix race condition in DefaultContainerExecutor which led to container localization occuring in wrong directories.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213575 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 06:33:30 +00:00
e52291ea88
MAPREDUCE-3510. Capacity Scheduler inherited ACLs not displayed by mapred queue -showacls (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213511 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 00:20:01 +00:00
9b75b05163
MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213504 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 23:56:26 +00:00
14e6f1e796
MAPREDUCE-3518. mapred queue -info <queue> -showJobs throws NPE. (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213464 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 22:08:09 +00:00
7c2a8c7ff2
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213390 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 19:42:07 +00:00
89379bc1a3
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213389 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 19:41:20 +00:00
6571d39a74
MAPREDUCE-3527. Fix minor API incompatibilities between 1.0 and 0.23.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213350 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 18:29:20 +00:00
3128c78636
JDiff output for release 0.22.0
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213146 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 05:45:08 +00:00
2c1ee1d342
Preparing for release 0.22.0
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213121 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 00:26:01 +00:00
b0d3781b64
MAPREDUCE-3519. Fixed a deadlock in NodeManager LocalDirectories's handling service. Contributed by Ravi Gummadi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212680 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 23:16:15 +00:00
9b1f47226b
HDFS-2594. Support getDelegationTokens and createSymlink in WebHDFS.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212299 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 09:26:33 +00:00
066cddb44e
MAPREDUCE-3513. Capacity Scheduler web UI has a spelling mistake for Memory. (chackaravarthy via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212215 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 01:58:29 +00:00
224fc101fd
MAPREDUCE-3327. RM web ui scheduler link doesn't show correct max value for queues (Anupam Seth via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212212 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 01:38:35 +00:00
d9ea5bb489
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1211749 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 02:57:47 +00:00
ec87e163d4
MAPREDUCE-3147. Handle leaf queues with the same name properly. (Ravi Prakash via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211243 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 00:29:45 +00:00
a55599062c
MAPREDUCE-3496. Fixed client to print queue acls in consistent order. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210738 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 01:34:03 +00:00
6a358ee140
MAPREDUCE-3389. MRApps loads the 'mrapp-generated-classpath' file with classpath from the build machine. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210548 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 18:02:47 +00:00
8a4db4d331
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210547 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 18:00:44 +00:00
65200998c0
HADOOP-7862 Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it (includes HDFS and MR changes to match) (Sanjay)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210208 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 20:44:36 +00:00
e948247715
MAPREDUCE-3485. DISKS_FAILED -101 error code should be defined in same location as ABORTED_CONTAINER_EXIT_STATUS. (Ravi Gummadi via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210192 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 20:11:08 +00:00
1972a76e5a
MAPREDUCE-3458. Fix findbugs warnings in hadoop-examples. (Devaraj K via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210190 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 19:58:32 +00:00
bb2b8f565c
MAPREDUCE-3456. /bin/yarn should set defaults for *_HOME (Eric Payne via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209825 13f79535-47bb-0310-9956-ffa450edef68
2011-12-03 03:38:05 +00:00
f7eda5a8d3
MAPREDUCE-3500. MRJobConfig creates an LD_LIBRARY_PATH using the platform ARCH. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209813 13f79535-47bb-0310-9956-ffa450edef68
2011-12-03 01:07:39 +00:00
72e9ec7a45
MAPREDUCE-3479. JobClient#getJob cannot find local jobs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209791 13f79535-47bb-0310-9956-ffa450edef68
2011-12-03 00:16:30 +00:00
6b2cbe1198
MAPREDUCE-3453. RM web ui application details page shows RM cluster about information. (Contributed by Jonathan Eagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209759 13f79535-47bb-0310-9956-ffa450edef68
2011-12-02 22:51:01 +00:00
a3f37e15f7
MAPREDUCE-3460. MR AM can hang if containers are allocated on a node blacklisted by the AM. (Contributed by Hitesh Shah and Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209737 13f79535-47bb-0310-9956-ffa450edef68
2011-12-02 22:18:38 +00:00
714ae6e62f
MAPREDUCE-3369. Migrate MR1 tests to run on MR2 using the new interfaces introduced in MAPREDUCE-3169. Contributed by Ahmed Radwan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209281 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 22:29:42 +00:00
449554f782
MAPREDUCE-3169 amendment. Deprecate MiniMRCluster. Contributed by Ahmed Radwan)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209235 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 21:00:28 +00:00
102541b12b
MAPREDUCE-3443. JobClient and Job should function in the context of the UGI which created them. (Contributed by Mahadev Konar)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209231 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 20:39:37 +00:00
2033b52673
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209169 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 18:15:46 +00:00
6a9624dcec
MAPREDUCE-3452. fifoscheduler web ui page always shows 0% used for the queue (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208999 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 08:43:29 +00:00
08da8ea5db
MAPREDUCE-3463. Second AM fails to recover properly when first AM is killed with java.lang.IllegalArgumentException causing lost job. (Siddharth Seth via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208994 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 08:35:20 +00:00
e2a78da87b
MAPREDUCE-3488. Streaming jobs are failing because the main class isnt set in the pom files. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208792 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 21:17:06 +00:00
ff9bae6b7d
MAREDUCE-3477. Hadoop site documentation cannot be built anymore. (jeagles via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208768 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 20:48:47 +00:00
0eec2218a1
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208644 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 18:27:04 +00:00
94bf0dacba
MAPREDUCE-3450. NM port info no longer available in JobHistory. (Siddharth Seth via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208327 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 08:43:00 +00:00
03e8ec7faf
MAPREDUCE-3448. TestCombineOutputCollector javac unchecked warning on mocked generics (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208136 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 23:33:13 +00:00
ea17da82f7
MAPREDUCE-3121. NodeManager should handle disk-failures (Ravi Gummadi via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208131 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 23:17:54 +00:00
ee97365f58
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208002 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 17:55:28 +00:00
be9c46a447
MAPREDUCE-3433. Finding counters by legacy group name returns empty counters.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207755 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 05:07:47 +00:00
784a4a3084
MAPREDUCE-3045. Fixed UI filters to not filter on hidden title-numeric sort fields. Contributed by Jonathan Eagles
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207714 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 00:10:56 +00:00
73b3de6204
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1207490 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 18:21:46 +00:00
cc4a468113
MAPREDUCE-3413. RM web ui applications not sorted in any order by default. (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206926 13f79535-47bb-0310-9956-ffa450edef68
2011-11-27 23:56:46 +00:00
7f0f8cb7b0
MAPREDUCE-3238. Small cleanup in SchedulerApp. (Todd Lipcon via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206921 13f79535-47bb-0310-9956-ffa450edef68
2011-11-27 23:40:03 +00:00
64b5a70a53
MAPREDUCE-3371. Review and improve the yarn-api javadocs. (Ravi Prakash via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206899 13f79535-47bb-0310-9956-ffa450edef68
2011-11-27 23:02:48 +00:00
080a34143d
HADOOP-7861. changes2html.pl generates links to HADOOP, HDFS, and MAPREDUCE jiras. Contributed by Konstantin Shvachko.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205988 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 21:44:36 +00:00
f17ed541c7
MAPREDUCE-3265. Removed debug logs during job submission to LOG.debug to cut down noise.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205628 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 22:04:33 +00:00
d3a51478e3
HDFS-2587. Add apt doc for WebHDFS REST API.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205626 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 22:02:19 +00:00
db092f5048
HADOOP-7827 HDFS-2588 MAPREDUCE-3464. jsp pages missing DOCTYPE. Contributed by Dave Vronay.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205519 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 18:15:37 +00:00
41b1e3ffec
MAPREDUCE-3329. Fixed CapacityScheduler to ensure maximum-capacity cannot be lesser than capacity for any queue.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205260 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 01:42:51 +00:00
865cd32885
MAPREDUCE-3411. Performance Upgrade for jQuery (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205210 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 22:46:59 +00:00
2e3f531735
MAPREDUCE-3408. yarn-daemon.sh unconditionnaly sets yarn.root.logger (Bruno Mahe via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205200 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 22:31:55 +00:00
fac80b85ae
MAPREDUCE-3454. [Gridmix] TestDistCacheEmulation is broken (Hitesh Shah MAPREDUCE-3454. via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205143 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 19:46:10 +00:00
e21c2ff5f1
MAPREDUCE-3412. Fix 'ant docs'. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204885 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 09:52:50 +00:00
6a0671977b
Merge trunk into HDFS-1623 branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1204794 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 03:18:47 +00:00
38fea39be7
MAPREDUCE-3444. trunk/0.23 builds broken (Hitesh Shah via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204698 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 20:57:03 +00:00
6ee82eefa8
MAPREDUCE-3447. mapreduce examples not working (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204695 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 20:50:20 +00:00
63edb9d724
MAPREDUCE-3434. Nightly build broken (Hitesh Shah via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204638 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 18:25:51 +00:00
26447229ba
HADOOP-7590. Mavenize streaming and MR examples. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203941 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 01:24:32 +00:00
67c372991c
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1203781 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 18:29:26 +00:00
bd0fbbb942
MAPREDUCE-3372. HADOOP_PREFIX cannot be overridden. Contributed by Bruno Mahé.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203488 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 05:14:15 +00:00
bd2e2aaf99
MAPREDUCE-3373. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203455 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 00:57:08 +00:00
ed45ad0fcc
MAPREDUCE-3415. improve MiniMRYarnCluster & DistributedShell JAR resolution (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203411 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 22:58:44 +00:00
302e3dfe2c
MAPREDUCE-3169. Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2. (Ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203371 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 21:13:29 +00:00
61f77396fa
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1202940 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 23:46:19 +00:00
9d7402e0af
MAPREDUCE-3407. Fixed pom files to refer to the correct MR app-jar needed by the integration tests. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202766 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 16:30:05 +00:00
00b50a5c94
MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202744 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 15:37:27 +00:00
c56e051961
MAPREDUCE-3102. Changed NodeManager to fail fast when LinuxContainerExecutor has wrong configuration or permissions. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202117 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 10:30:26 +00:00
0d171f6513
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1202013 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 02:39:13 +00:00
3491205b0a
MAPREDUCE-3331. Improvement to single node cluster setup documentation for 0.23 (Anupam Seth via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202002 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 02:05:25 +00:00
116b91cdfb
MAPREDUCE-3375. [Gridmix] Memory Emulation system tests. (Vinay Thota via amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201997 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:48:42 +00:00
4cdcf7b867
MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201951 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:44:44 +00:00
58bfa24ae4
MAPREDUCE-3341. Enhance logging of initalized queue limit values. (Anupam Seth via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201947 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:38:56 +00:00
503593af1e
MAPREDUCE-3325. Improvements to CapacityScheduler doc. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201925 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 21:59:56 +00:00
ac320f5046
MAPREDUCE-3324. Not All HttpServer tools links (stacks,logs,config,metrics) are accessible through all UI servers (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201914 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 21:30:10 +00:00
27c9b8833b
MAPREDUCE-3370. More changes accidentally missed from the previous commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200775 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 08:51:21 +00:00
9c17410c50
MAPREDUCE-3370. Fixed MiniMRYarnCluster and related tests to not use a hard-coded path for the mr-app jar. Contributed by Ahmed Radwan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200768 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 08:44:52 +00:00
dbc82dbdfb
MAPREDUCE-3379. Fixed LocalResourceTracker in NodeManager to remove deleted cache entries correctly. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200747 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 06:30:27 +00:00
200bb27557
MAPREDUCE-3392. Fixed Cluster's getDelegationToken's API to return null when there isn't a supported token. Contributed by John George.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200484 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 19:19:25 +00:00
15150cd997
MAPREDUCE-3280. Removed the unnecessary job user-name configuration in mapred-site.xml. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200441 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 17:28:16 +00:00
2df83e5b4d
MAPREDUCE-3333. Fixed bugs in ContainerLauncher of MR AppMaster due to which per-container connections to NodeManager were lingering long enough to hit the ulimits on number of processes. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199751 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 13:41:19 +00:00
3853d112ea
MAPREDUCE-3336. Replaced guice internal.Preconditions api usage with the public Preconditions API. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199714 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 12:40:41 +00:00
cec9f82344
MAPREDUCE-2733. [Gridmix] Gridmix3 cpu emulation system tests. (Vinay Thota via amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199678 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 09:47:50 +00:00
80cc8e9486
MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199144 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 07:55:51 +00:00
9fe9f42c8f
MAPREDUCE-3342. Fixed JobHistoryServer to also show the job's queue name. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199133 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 07:28:56 +00:00
6749d1395f
[Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199105 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 04:44:25 +00:00
00b5aa76f9
Update CHANGES.txt for commit 1198910.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198912 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 20:14:33 +00:00
9a6da7979e
MAPREDUCE-3344. o.a.h.mapreduce.Reducer since 0.21 blindly casts to ReduceContext.ValueIterator. Contributed by Brock Noland.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198910 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 20:13:00 +00:00
6733a1ca5e
MAPREDUCE-3291. App fail to launch due to delegation token not found in cache (Robert Evans via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198583 13f79535-47bb-0310-9956-ffa450edef68
2011-11-06 22:58:47 +00:00
0b5a4823a9
MAPREDUCE-3217. Reenabled and fixed bugs in the failing ant test TestAuditLogger. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197438 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 09:01:51 +00:00
08cb4cf334
MAPREDUCE-3219. Reenabled and fixed bugs in the failing test TestDelegationToken. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197415 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 07:48:26 +00:00
dae055bb70
MAPREDUCE-3215. Reneabled and fixed bugs in the failing test TestNoJobSetupCleanup. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197101 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 13:19:29 +00:00
aa297b188e
MAPREDUCE-3221. Reneabled the previously ignored test in TestSubmitJob and fixed bugs in it. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197080 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 12:25:18 +00:00
c27601fefe
MAPREDUCE-3297. Moved log related components into yarn-common so that HistoryServer and clients can use them without depending on the yarn-server-nodemanager module. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196986 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 08:02:19 +00:00
0df4878033
MAPREDUCE-3337. Added missing license headers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196977 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 07:06:53 +00:00
201a18de0c
MAPREDUCE-3139. SlivePartitioner generates negative partitions.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196776 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 19:38:31 +00:00
571d7990f4
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1196458 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 05:34:31 +00:00
3ad6024a84
HADOOP-7789. Fixed site to include yarn-default.xml.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196412 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 00:50:59 +00:00
073210043d
HADOOP-7789. Fixed site to include yarn-default.xml.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196411 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 00:50:41 +00:00
bb35bff29b
MAPREDUCE-3332. contrib/raid compile breaks due to changes in hdfs/protocol/datatransfer/Sender#writeBlock related to checksum handling (Hitesh Shah via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196356 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 23:07:56 +00:00
1112a50ad3
HADOOP-7789. Improvements to site navigation.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195876 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:53:38 +00:00
4e42044b1c
Preparing for release 0.23.0.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195872 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:46:22 +00:00
a3a4ccfed7
Preparing for release 0.23.0.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195838 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 06:02:53 +00:00
8e04fa8b84
HADOOP-7782. Aggregate project javadocs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195817 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:47:10 +00:00
adf58e70a0
MAPREDUCE-3317. Rumen TraceBuilder is emiting null as hostname. (Ravi Gummadi via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195814 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:32:03 +00:00
68dfbff8db
MAPREDUCE-3316. Rebooted link is not working properly. (Bhallamudi Venkata Siva Kamesh via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195805 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:06:39 +00:00
cfb6a9883d
MAPREDUCE-3237. Move LocalJobRunner to hadoop-mapreduce-client-core. Contributed by Tom White.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195792 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 03:16:44 +00:00
e5badc0c1a
Fixing CHANGES.txt to reflect 0.23 content.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195766 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 02:09:51 +00:00
d36f847b87
MAPREDUCE-3322. Added a better index.html and an brief overview of YARN architecture.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195764 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 02:00:58 +00:00
68fa208b1c
MAPREDUCE-3103. Implement Job ACLs for MRAppMaster. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195761 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:51:56 +00:00
b451dd7aaa
MAPREDUCE-3220. Fixed TestCombineOutputCollector. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195745 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:04:15 +00:00
5f7e991659
MAPREDUCE-3321. Disabled a few MR tests for 0.23. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195743 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 00:57:22 +00:00
b3f90c7060
MAPREDUCE-3275. Added documentation for AM WebApp Proxy. Contributed by Robert Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195579 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 17:33:29 +00:00
9db078212f
MAPREDUCE-3035. Fixed MR JobHistory to ensure rack information is present. Contributed by chakravarthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195575 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 17:27:42 +00:00
7e056015ad
MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195535 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 15:51:32 +00:00
21b1e1da49
MAPREDUCE-3262. Fixed Container's state-machine in NodeManager to handle a couple of events in failure states correctly. Contributed by Hitesh Shah and Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195416 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 11:29:23 +00:00
a75c4cf4e4
MAPREDUCE-2696. Fixed NodeManager to cleanup logs in a thread when logs' aggregation is not enabled. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195383 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 09:55:29 +00:00
47a381e306
MAPREDUCE-3146. Added a MR specific command line to dump logs for a given TaskAttemptID. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195349 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 06:42:06 +00:00
5f9e67e226
MAPREDUCE-2766. Fixed NM to set secure permissions for files and directories in distributed-cache. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195340 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 05:51:33 +00:00
85fce9017c
Adding executable svn prop on mock-container-executor.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195336 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 05:29:13 +00:00
273e092c93
MAPREDUCE-3313. Fixed initialization of ClusterMetrics which was failing TestResourceTrackerService sometimes. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195319 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 03:30:56 +00:00
1c8d64f38a
MAPREDUCE-3274. Fixed a race condition in MRAppMaster that was causing a task-scheduling deadlock. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195145 13f79535-47bb-0310-9956-ffa450edef68
2011-10-30 11:29:41 +00:00
7f4dc27757
MAPREDUCE-3256. Added authorization checks for the protocol between NodeManager and ApplicationMaster. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1194850 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 09:35:36 +00:00
cd77a1668f
HADOOP-7763. Add top-level navigation to APT docs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190703 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 00:16:16 +00:00
1bcff6860c
Adding missing CHANGES.txt entry for MAPREDUCE-3014
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190585 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 21:27:08 +00:00
c1e333f32f
MAPREDUCE-3306. Fixed a bug in NodeManager ApplicationImpl that was causing NodeManager to crash. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190523 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 19:45:57 +00:00
b93abdcd66
MAPREDUCE-3304. Fixed intermittent test failure due to a race in TestRMContainerAllocator#testBlackListedNodes. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190495 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 18:45:48 +00:00
cbdb07f4ca
MAPREDUCE-2775. Fixed ResourceManager and NodeManager to force a decommissioned node to shutdown. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190467 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 17:31:06 +00:00
da1db28e93
HADOOP-7740. Fixed security audit logger configuration. (Arpit Gupta via Eric Yang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190452 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 17:08:09 +00:00
a39992ea63
MAPREDUCE-3296. Fixed the remaining nine FindBugs warnings. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190187 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 07:44:35 +00:00
670fa24b48
MAPREDUCE-2989. Modified JobHistory to link to task and AM logs from the JobHistoryServer. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190174 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 06:45:04 +00:00
47c28ce14d
MAPREDUCE-3292. In secure mode job submission fails with Provider org.apache.hadoop.mapreduce.security.token.JobTokenIndentifier not found. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190171 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 06:13:18 +00:00
062876bed7
MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190165 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 06:04:51 +00:00
69dd284452
MAPREDUCE-3290. Fixed a NPE in ClientRMService.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190162 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 05:45:59 +00:00
34e6de8f85
MAPREDUCE-3258. Fixed AM & JobHistory web-ui to display counters properly. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190160 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 05:08:04 +00:00
9b34900c89
MAPREDUCE-3209. Jenkins reports 160 FindBugs warnings (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190140 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 02:42:11 +00:00
3cccbc9e16
MAPREDUCE-2736. Removing bin/(start,stop)-mapred.sh
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190129 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 02:00:03 +00:00
caf07897a7
MAPREDUCE-2736. Resurrecting bin/mapred and bin/mapred-config.sh.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190128 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:56:57 +00:00
b304062f1f
MAPREDUCE-3186. User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed. (Eric Payne via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190122 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:40:24 +00:00
35b62e6e72
MAPREDUCE-3282. bin/mapred job -list throws exception. (acmurthy via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190110 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:16:29 +00:00
739acd6e14
MAPREDUCE-3284. Moved JobQueueClient to hadoop-mapreduce-client-core.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190084 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:21:09 +00:00
b9f6890db9
MAPREDUCE-3281. Fixed one more bug due to which TestLinuxContainerExecutorWithMocks was failing. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190007 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 20:38:40 +00:00
1ad8415b72
MAPREDUCE-2736. Remove unused contrib components dependent on MR1. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189982 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 20:06:26 +00:00
724f217343
MAPREDUCE-3228. Fixed MR AM to timeout RPCs to bad NodeManagers. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189879 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 17:32:02 +00:00
1b8511ef89
MAPREDUCE-3281. Fixed a bug in TestLinuxContainerExecutorWithMocks. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189818 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 15:55:41 +00:00
f114dad5ef
MAPREDUCE-2986. Fixed MiniYARNCluster to support multiple NodeManagers. Contributed by Anupam Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189721 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 12:42:12 +00:00
2fe343f963
MAPREDUCE-3240. Fixed NodeManager to be able to forcefully cleanup its containers (process-trees) irrespective of whether the container succeeded, or killed. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189711 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 12:03:17 +00:00
f799e61269
MAPREDUCE-3279. Fixed TestJobHistoryParsing which assumed user name to be mapred all the time. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189670 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 08:31:44 +00:00
fc74b5a25c
MAPREDUCE-3259. Added java.library.path of NodeManager to ContainerLocalizer in LinuxContainerExecutor. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189667 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 08:28:34 +00:00
db8ac0ec3c
MAPREDUCE-3257. Added authorization checks for the protocol between ResourceManager and ApplicatoinMaster. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189630 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 06:24:22 +00:00
5fadd4de2a
MAPREDUCE-3175. Add authorization to admin web-pages such as /stacks, /jmx etc. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189619 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 06:11:08 +00:00
33dc6578de
MAPREDUCE-3264. mapreduce.job.user.name needs to be set automatically. (acmurthy via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189616 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 06:04:17 +00:00
3e4efbb609
MAPREDUCE-3254. Fixed streaming to set the job.jar by using the right JobConf ctor.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189587 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 02:47:07 +00:00
237154982b
MAPREDUCE-3205. Fix memory specifications to be physical rather than virtual, allowing for a ratio between the two to be configurable. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189542 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 23:58:31 +00:00
8aabd3d4e6
MAPREDUCE-2858. Added a WebApp Proxy for applications. Contributed by Robert Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189036 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 06:29:21 +00:00
2adc51c618
MAPREDUCE-3250. When AM restarts, client keeps reconnecting to the new AM and prints a lots of logs. (vinodkv via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189023 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 04:31:28 +00:00
29c6c3ed32
MAPREDUCE-2977. Fix ResourceManager to renew HDFS delegation tokens for applications.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189012 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 02:53:22 +00:00
03659985a0
MAPREDUCE-3269. Fixed log4j properties to correctly set logging options for JobHistoryServer vis-a-vis JobSummary logs. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188999 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 02:16:19 +00:00
7dcef364a9
MAPREDUCE-3263. Fixed the MAPREDUCE-3028 commit which broke MR1. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188997 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 02:12:50 +00:00
2486e4eb09
MAPREDUCE-3253. Fixed ContextFactory to clone JobContext correctly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188842 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 18:14:12 +00:00
fffdf661e3
MAPREDUCE-2821. Added missing fields (resourcePerMap & resourcePerReduce) to JobSummary logs. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188528 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 06:26:14 +00:00
d19cfe0164
MAPREDUCE-2746. Yarn servers can't communicate with each other with hadoop.security.authorization set to true (acmurthy via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188522 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 06:07:13 +00:00
bccfd6a09f
Amend MAPREDUCE-3159. Fix JavaDoc warnings in previous commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188479 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 01:14:17 +00:00
c70ee2488c
MAPREDUCE-3248. Fixed log4j properties. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188476 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 01:03:08 +00:00
6217e54718
MAPREDUCE-3159. Ensure DefaultContainerExecutor doesn't delete application directories during app-init. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188466 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 00:36:19 +00:00
43553df4e3
MAPREDUCE-3252. Fix map tasks to not rewrite data an extra time when map output fits in spill buffer. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188424 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 22:33:02 +00:00
a503755990
MAPREDUCE-3249. Ensure shuffle-port is correctly used duringMR AM recovery. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188388 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 21:19:31 +00:00
6288dfa873
MAPREDUCE-3028. Added job-end notification support. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188377 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 21:02:43 +00:00
7ce1c4ab35
MAPREDUCE-2747. Cleaned up LinuxContainerExecutor binary sources and changed the configuration to use yarn names. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188236 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 17:09:37 +00:00
4086566144
MAPREDUCE-2708. Designed and implemented MR Application Master recovery to make MR AMs resume their progress after restart. Contributed by Sharad Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188043 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 08:41:48 +00:00
977d7cc5b9
MAPREDUCE-3233. Fixed a bug in MR Job so as to be able to restart the application on AM crash. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187669 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 08:11:47 +00:00
665a90cbf3
MAPREDUCE-3087. Fixed the mapreduce classpath to correctly include the generated-classpath file needed for tests. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187658 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 06:46:12 +00:00
5795fcfd99
MAPREDUCE-3058. Fixed MR YarnChild to report failure when task throws an error and thus prevent a hanging task and job. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187654 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 06:14:46 +00:00
e175574635
MAPREDUCE-3242. Trunk compilation broken with bad interaction from MAPREDUCE-3070 and MAPREDUCE-3239. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187587 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 22:44:39 +00:00
4186121c08
MAPREDUCE-3239. Use new createSocketAddr API in MRv2 to give better error messages on misconfig (Todd Lipcon via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187556 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 21:36:58 +00:00
89e7ca6a52
MAPREDUCE-3070. Fix NodeManager to use ephemeral ports by default. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187496 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 18:47:39 +00:00
45b2bce871
MAPREDUCE-3163. JobClient spews errors when killing MR2 job. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187491 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 18:35:35 +00:00
5945a05eee
MAPREDUCE-2629. Workaround a JVM class loading quirk which prevents JIT compilation of inner classes methods in ReduceContextImpl. Contributed by Eric Caspole.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187183 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 05:20:27 +00:00
02d5fa3e62
MAPREDUCE-3226. Fix shutdown of fetcher threads. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187116 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 22:44:38 +00:00
49baada6cc
MAPREDUCE-3204. mvn site:site fails on MapReduce. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187062 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 21:38:58 +00:00
df2991c0cb
MAPREDUCE-3104. Implemented Application-acls. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186748 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 11:45:38 +00:00
37137845c8
Merging change r1186579 for HDFS-2471 from 0.23 branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186584 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 00:38:42 +00:00
aeae1ba497
MAPREDUCE-3188. Ensure correct shutdown in services. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186554 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:59:30 +00:00
fc362b1caf
MAPREDUCE-3179. Ensure failed tests exit with right error code. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186552 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:54:23 +00:00
7a2744c458
MAPREDUCE-3212. Fix usage/help message for bin/yarn. Contributed by Bhallamudi Venkata Siva Kamesh.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186546 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:43:01 +00:00
7ca7fdadc4
MAPREDUCE-3208. Fix NPE task/container log appenders. Contributed by liangzhwa.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186542 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:38:17 +00:00
74748ec625
MAPREDUCE-2693. Fix NPE in job-blacklisting. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186529 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:02:21 +00:00
ba66ca6856
MAPREDUCE-3149. Add a test to verify that TokenCache handles file system uri with no authority. Contributed by John George.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186516 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 21:52:50 +00:00
e549ac9369
MAPREDUCE-2788. Normalize resource requests in FifoScheduler appropriately. Contributed by Ahmed Radwan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186467 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 20:37:01 +00:00
9473b2e43f
MAPREDUCE-3181. Fixed MapReduce runtime to load yarn-default.xml and yarn-site.xml.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186458 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 20:28:11 +00:00
94e1703b72
MAPREDUCE-3176. Fixed ant mapreduce tests that are timing out because of wrong framework name. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186368 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 17:55:08 +00:00
e3bb120e9f
MAPREDUCE-3162. Separated application-init and container-init event types in NodeManager's Application state machine. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185988 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 06:40:03 +00:00
13e4562924
MAPREDUCE-3144. Augmented JobHistory with the information needed for serving aggregated logs. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185976 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 05:21:18 +00:00
3e3abcb769
MAPREDUCE-3199. Fixed pom files to include correct log4j configuration for tests. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185967 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 04:30:27 +00:00
b4d20c707a
MAPREDUCE-3203. Fix some javac warnings in MRAppMaster. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185909 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 22:46:42 +00:00
ab787f44aa
MAPREDUCE-3165. Ensure logging options are set correctly for MR AM and tasks. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185887 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 21:45:38 +00:00
51a667bef8
MAPREDUCE-2762. Cleanup MR staging directory on completion. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185880 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 21:37:31 +00:00
bb00ab68c3
MAPREDUCE-279. Adding a changelog to branch-0.23.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185488 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 05:30:32 +00:00
9ff7c1b1de
MAPREDUCE-3197. TestMRClientService failing on building clean checkout of branch 0.23 (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185486 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 05:08:32 +00:00
c1d90772b6
MAPREDUCE-3068. Added a whitelist of environment variables for containers from the NodeManager and set MALLOC_ARENA_MAX for all daemons and containers. Contributed by Chris Riccomini.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185447 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 01:22:14 +00:00
955d8eca21
MAPREDUCE-3196. TestLinuxContainerExecutorWithMocks fails on Mac OSX. (Arun Murthy via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185417 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 22:41:26 +00:00
15a1d9af19
MAPREDUCE-3003. Publish MR JARs to Maven snapshot repository. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185286 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 17:06:42 +00:00
a26b1672a8
MAPREDUCE-3032. Fixed TaskAttemptImpl so that JobHistory can have error information about failed tasks. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185247 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 15:17:06 +00:00
9f36bdd731
MAPREDUCE-3127. Fixed CHANGES.txt to reflect correct jira.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184992 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 04:22:28 +00:00
6b2f3dd5ce
MAPREDUCE-3101. Changed default value of yarn.resourcemanager.acl.enable to true and added some more documentation.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184989 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 04:08:36 +00:00
bc6220c538
MAPREDUCE-3136. Added the missing link to index.html.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184981 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 02:35:20 +00:00
29f65be3e2
MAPREDUCE-3189. Add link decoration back to MR2's CSS. (Todd Lipcon via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184979 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 02:22:16 +00:00
86e1c9536f
MAPREDUCE-3136. Added documentation for setting up Hadoop clusters in both non-secure and secure mode for both HDFS & YARN.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184977 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 02:18:06 +00:00
4872615441
MAPREDUCE-3190. Ensure bin/yarn fails early with a clear error message when HADOOP_COMMON_HOME or HADOOP_HDFS_HOME are not set. Contributed by todd & acmurthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184975 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 02:14:10 +00:00
94b3bf9f75
MAPREDUCE-2840. mr279 TestUberAM.testSleepJob test fails. (jonathan eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184971 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 01:19:51 +00:00
68328ae926
MAPREDUCE-3187. Add names for various unnamed threads in MR2. (Todd Lipcon and Siddharth Seth via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184904 13f79535-47bb-0310-9956-ffa450edef68
2011-10-16 19:27:02 +00:00
b5e21e7e63
MAPREDUCE-3057. Job History Server goes of OutOfMemory with 1200 Jobs and Heap Size set to 10 GB. (Eric Payne via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183545 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 22:49:19 +00:00
b3284c4607
MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183540 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 22:38:52 +00:00
57f99c2b02
MAPREDUCE-3192. Fix Javadoc warning in JobClient.java and Cluster.java.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183513 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 21:49:35 +00:00
09eb725c06
MAPREDUCE-3124. Fixed location of native libs i.e. libhadoop.so for containers. Contributed by John George.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183188 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:27:10 +00:00
002dd6968b
MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183187 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:24:20 +00:00
c7fb49b3c5
MAPREDUCE-3170. Fixed job output commit for deep hierarchies. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183185 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:16:30 +00:00
59df2d48c3
MAPREDUCE-3183. hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml missing license header. (Hitesh Shah via tucu).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183160 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 23:16:07 +00:00
e9544ef3d2
HADOOP-7737. normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183068 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 20:23:59 +00:00
6b6f02c51d
MAPREDUCE-3133. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182688 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 07:07:01 +00:00
26d63ecdae
MAPREDUCE-2789. Complete schedulingInfo on CLI. Contributed by Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182616 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 23:29:01 +00:00
277e520579
MAPREDUCE-2666. Retrieve shuffle port number from JobHistory on MR AM restart. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182613 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 23:12:01 +00:00
327e02fdf4
MAPREDUCE-3171. normalize nodemanager native code compilation with common/hdfs native. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182575 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 20:38:51 +00:00
f143895bc2
MAPREDUCE-3166. [Rumen] Make Rumen use job history api instead of relying on current history file name format.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182330 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 12:19:02 +00:00
efb3cd64a2
MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182293 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 09:58:14 +00:00
d6546fc0a4
MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182230 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 06:51:32 +00:00
85588e5ce9
MAPREDUCE-3140. Fixed the invalid JobHistory URL for failed applications. Contributed by Subroto Sanyal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182216 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 06:23:20 +00:00
3f998db918
HADOOP-7642. create hadoop-dist module where TAR stitching would happen. Contributed by Thomas White.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182151 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 00:27:32 +00:00
ac64df85a9
MAPREDUCE-3148. Ported MAPREDUCE-2702 to old mapred api for aiding task recovery.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182008 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 18:27:51 +00:00
b8f0836f94
MAPREDUCE-3126. Fixed a corner case in CapacityScheduler where headroom wasn't updated on changes to cluster size.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182000 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 18:24:32 +00:00
1c358b0796
MAPREDUCE-2668. Fixed AuxServices to send a signal on application-finish to all the services. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181803 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 14:26:17 +00:00
7d5434c6b3
MAPREDUCE-3020. Fixed TaskAttemptImpl to log the correct node-address for a finished Reduce task. Contributed by Chackaravarthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181793 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 14:09:32 +00:00
5a249b76d3
MAPREDUCE-3167. container-executor is not being packaged with the assembly target. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181634 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 06:58:20 +00:00
11b9dd4e84
MAPREDUCE-3161. Improved some javadocs and fixed some typos in YARN. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181622 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 04:45:28 +00:00
42e93829e5
MAPREDUCE-3158. Fix test failures in MRv1 due to default framework being set to yarn. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181310 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 00:26:41 +00:00
a8190ce5c5
MAPREDUCE-2988. Reenabled TestLinuxContainerExecutor reflecting the current NodeManager code. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180833 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 09:18:44 +00:00
d0016c6120
MAPREDUCE-3154. Fix JobSubmitter to check for output specs before copying job submission files to fail fast. Contributed by Abhijit Suresh Shingate.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180774 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 03:29:38 +00:00
811a6a9e30
MAPREDUCE-3123. Fix NM to quote symlink names to escape special characters. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180772 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 03:27:01 +00:00
4f1cdab6d8
MAPREDUCE-3153. Fix TestFileOutputCommitter which was broken by MAPREDUCE-2702. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180769 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 03:10:45 +00:00
3ddb52cfc0
MAPREDUCE-2876. Use a different config for ContainerAllocationExpirer. Contributed by Anupam Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180767 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 03:06:47 +00:00
a09a2b48cd
Move MAPREDUCE-3138 changes to Release 0.22 section.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180751 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 00:36:04 +00:00
4972959173
Reverted MAPREDUCE-3003
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180283 13f79535-47bb-0310-9956-ffa450edef68
2011-10-08 00:38:41 +00:00
047b175aac
MAPREDUCE-2802. Ensure JobHistory filenames have jobId. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180220 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 20:44:37 +00:00
6b343adfe8
MAPREDUCE-3033. Ensure Master interface pays attention to classic v/s yarn frameworks. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180214 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 20:39:33 +00:00
68d1162f7a
MAPREDUCE-3003. Publish Yarn and MapReduce artifacts to Maven snapshot repository. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180155 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 19:01:01 +00:00
02ce6b3d07
MAPREDUCE-3014. Rename and invert logic of '-cbuild' profile to 'native' and off by default. Contributed by Alejandro Abdelnur.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180116 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 17:33:10 +00:00
02a81203bd
MAPREDUCE-2751. Modified NodeManager to stop leaving around local files after application finishes. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180071 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 15:23:20 +00:00
fa2529c931
MAPREDUCE-3141. Fix the broken MRAppMaster to work over YARN in security mode.(vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180007 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 11:35:17 +00:00
a56f3931d1
MAPREDUCE-2783. Fixing RM web-UI to show no tracking-URL when AM crashes. Contributed by Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179975 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 09:17:57 +00:00
b8102dbdf8
MAPREDUCE-2794. [MR-279] Incorrect metrics value for AvailableGB per queue per user. (John George via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179936 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 05:27:36 +00:00
c1c0e8c9ea
MAPREDUCE-3008. Improvements to cumulative CPU emulation for short running tasks in Gridmix. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179933 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 04:59:58 +00:00
60dcc5f237
Merging trunk to HDFS-1623 branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1179484 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 01:16:48 +00:00
282e2e910c
MAPREDUCE-2913. Fixed TestMRJobs.testFailingMapper to assert the correct TaskCompletionEventStatus. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179319 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 17:07:20 +00:00
9a4e890f4a
MAPREDUCE-2738. Added the missing cluster level statisticss on the RM web UI. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179229 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 14:01:32 +00:00
f29bfa0e0e
MAPREDUCE-2702. Added a new API in OutputCommitter for recovering the outputs of tasks from a crashed job so as to support MR Application Master recovery. Contributed by Sharad Agarwal and Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179188 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 12:15:44 +00:00
f24dcb3449
MAPREDUCE-2907. Changed log level for various messages in ResourceManager from INFO to DEBUG. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179178 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:56:54 +00:00
66137cf17c
MAPREDUCE-3013. Removed YarnConfiguration.YARN_SECURITY_INFO and its usage as it doesn't affect security any more. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179174 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:43:05 +00:00
45e6fb00af
MAPREDUCE-2950. [Gridmix] TestUserResolve fails in trunk. (Ravi Gummadi via amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179090 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 08:03:49 +00:00
ff9d7de705
Move MAPREDUCE-2531 changes to Release 0.22 section.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179078 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 07:39:35 +00:00
e979a3ddb1
MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178740 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 09:37:56 +00:00
a48e6f2519
MAPREDUCE-3112. Fixed recursive sourcing of HADOOP_OPTS environment
...
variable. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178657 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:51:13 +00:00
3edf3579c8
HADOOP-7684. Added init.d script for jobhistory server and
...
secondary namenode. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178653 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:44:08 +00:00
4f97e37648
MAPREDUCE-3138. Add a utility to help applications bridge changes in Context Objects APIs due to MAPREDUCE-954. Contributed by omalley.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178650 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:42:37 +00:00
abc2b45dfa
HADOOP-7603. Set hdfs, mapred uid, and hadoop uid to fixed numbers. (Eric Yang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178644 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:13:58 +00:00
12743d2169
MAPREDUCE-2792. Replace usage of node ip-addresses with hostnames. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178631 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 23:21:20 +00:00
43b59b894b
MAPREDUCE-3134. Added documentation the CapacityScheduler.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178530 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 19:35:41 +00:00
7aa8a3c9f8
MAPREDUCE-2889. Added documentation for writing new YARN applications. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177920 13f79535-47bb-0310-9956-ffa450edef68
2011-10-01 05:22:50 +00:00
f3b98a26c4
MAPREDUCE-3113. Ensure bin/yarn and bin/yarn-daemon.sh identify the root of the install properly. Contributed by Xie Xianshan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177874 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 23:58:58 +00:00
fad230a49d
MAPREDUCE-2719. Add a simple, DistributedShell, application to illustrate alternate frameworks on YARN. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177864 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 22:25:32 +00:00
dcf9d475e0
MAPREDUCE-3050. Add ability to get resource usage information for applications and nodes. Contributed by Robert Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177859 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 22:19:17 +00:00
960d7643fb
MAPREDUCE-2779. JobSplitWriter.java can't handle large job.split file. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177779 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 19:04:56 +00:00
063e33a862
MAPREDUCE-3098. Fixed RM and MR AM to report YarnApplicationState and application's FinalStatus separately. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177633 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 12:46:32 +00:00
964d4a1666
MAPREDUCE-2996. Add uber-ness information to JobHistory. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177531 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 06:47:53 +00:00
0b3c654d83
MAPREDUCE-2791. Added missing info on 'job -status' output. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177487 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 03:08:35 +00:00
71886657f8
MAPREDUCE-3001. Added task-specific counters to AppMaster and JobHistory web-UIs. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177203 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 08:08:49 +00:00
44090734c9
MAPREDUCE-3114. Fixed invalid ApplicationURL on RM WebUI. Contributed by Subroto Sanyal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177187 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 07:28:29 +00:00
ab0402bc1d
Merging trunk to HDFS-1623 branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1177130 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 00:42:47 +00:00
9992cae541
Reverting the previous trunk merge since it added other unintended changes in addition
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1177127 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 00:33:34 +00:00
122113922f
Merging trunk to HDFS-1623 branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1177117 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 00:09:56 +00:00
312a7e7100
MAPREDUCE-3078. Ensure MapReduce AM reports progress correctly for displaying on the RM Web-UI. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176762 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 07:31:03 +00:00
f4a425e10d
MAPREDUCE-3110. Fixed TestRPC failure. Contributed by Vinod Kumar Vavilapalli.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176739 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 06:03:18 +00:00
cc42ccf02a
MAPREDUCE-2843. Fixed the node-table to be completely displayed and making node entries on RM UI to be sortable. Contributed by Abhijit Suresh Shingate.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176730 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 05:35:43 +00:00
eda0ad4fd0
MAPREDUCE-3041. Fixed ClientRMProtocol to provide min/max resource capabilities along-with new ApplicationId for application submission. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176715 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 04:20:16 +00:00
d06916f033
MAPREDUCE-3021. Adding additional files needed for new web-ui.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176708 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 04:02:34 +00:00
5f6adcf396
MAPREDUCE-3021. Change base urls for RM web-ui. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176681 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 01:23:04 +00:00
8e4c70fb20
MAPREDUCE-3099. Add docs for setting up a single node MRv2 cluster. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176607 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 20:41:56 +00:00
0d2bb06236
MAPREDUCE-3054. Unable to kill submitted jobs. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176600 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 20:30:24 +00:00
359c17071b
MAPREDUCE-3095. fairscheduler ivy including wrong version for hdfs. (John George via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176566 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 19:44:56 +00:00
98cc200700
MAPREDUCE-3081. Fix vaidya startup script. Contributed by Suhas
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176550 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 19:35:29 +00:00
87b969c835
MAPREDUCE-2999. Fix YARN webapp framework to properly filter servlet paths. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176469 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 17:03:19 +00:00
6507a0bc35
MAPREDUCE-3092. Removed a special comparator for JobIDs in JobHistory as JobIDs are already comparable. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176453 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 16:11:54 +00:00
17da0bdb27
MAPREDUCE-3067. Ensure exit-code is set correctly for containers. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176235 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 06:56:50 +00:00
70388cffe0
MAPREDUCE-3071. app master configuration web UI link under the Job menu opens up application menu. (thomas graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176203 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 05:30:01 +00:00
81926396f6
MAPREDUCE-2984. Better error message for displaying completed containers. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176045 13f79535-47bb-0310-9956-ffa450edef68
2011-09-26 20:45:18 +00:00
eff931a1b1
MAPREDUCE-3031. Proper handling of killed containers to prevent stuck containers/AMs on an external kill signal. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175960 13f79535-47bb-0310-9956-ffa450edef68
2011-09-26 17:27:15 +00:00
1e6dfa7472
MAPREDUCE-2646. Fixed AMRMProtocol to return containers based on priority. Contributed by Sharad Agarwal and Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175859 13f79535-47bb-0310-9956-ffa450edef68
2011-09-26 13:25:27 +00:00
c9a7d3dbf9
MAPREDUCE-3090. Fix MR AM to use ApplicationAttemptId rather than (ApplicationId, startCount) consistently.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175718 13f79535-47bb-0310-9956-ffa450edef68
2011-09-26 08:44:41 +00:00
5a3040cad4
MAPREDUCE-3064. 27 unit test failures with Invalid mapreduce.jobtracker.address configuration value for JobTracker: local (Venu Gopala Rao via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175449 13f79535-47bb-0310-9956-ffa450edef68
2011-09-25 18:02:51 +00:00
a5c9ede143
MAPREDUCE-2952. Fixed ResourceManager/MR-client to consume diagnostics for AM failures in a couple of corner cases. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175403 13f79535-47bb-0310-9956-ffa450edef68
2011-09-25 14:46:59 +00:00
c285cf3114
MAPREDUCE-3053. Better diagnostic message for unknown methods in ProtoBuf RPCs. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175357 13f79535-47bb-0310-9956-ffa450edef68
2011-09-25 09:50:02 +00:00
5ace0cabe5
MAPREDUCE-2990. Fixed display of NodeHealthStatus. Contributed by Subroto Sanyal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175351 13f79535-47bb-0310-9956-ffa450edef68
2011-09-25 09:36:12 +00:00
d09ceac1f7
MAPREDUCE-2691. Increase threadpool size for launching containers in MapReduce ApplicationMaster. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175294 13f79535-47bb-0310-9956-ffa450edef68
2011-09-25 04:43:51 +00:00
b549c10782
MAPREDUCE-3055. Simplified ApplicationAttemptId passing to ApplicationMaster via environment variable. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174785 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 14:07:42 +00:00
1eb7008753
MAPREDUCE-3073. Fixed build issues in MR1. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174294 13f79535-47bb-0310-9956-ffa450edef68
2011-09-22 18:05:30 +00:00
4806d7ba74
MAPREDUCE-2754. Fixed MR AM stdout, stderr and syslog to redirect to correct log-files. Contributed by Ravi Teja Ch N V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174194 13f79535-47bb-0310-9956-ffa450edef68
2011-09-22 15:14:31 +00:00
3557202a92
MAPREDUCE-3044. Pipes jobs stuck without making progress. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173909 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 23:52:50 +00:00
ed7eda00cb
MAPREDUCE-3066. Fixed default ResourceTracker address for the NodeManager. Contributed by Chris Riccomini.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173904 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 23:32:31 +00:00
32f28e6994
MAPREDUCE-3062. Fixed default RMAdmin address. Contributed by Chris Riccomini.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173838 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 20:37:08 +00:00
d00b3c49f6
MAPREDUCE-2880. Improved classpath-construction for mapreduce AM and containers. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173783 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 18:28:23 +00:00
af61f4ae15
MAPREDUCE-2970. Fixed NPEs in corner cases with different configurations for mapreduce.framework.name. Contributed by Venu Gopala Rao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173534 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 09:13:34 +00:00
01fbb0fb45
MAPREDUCE-2930. Added the ability to be able to generate graphs from the state-machine definitions. Contributed by Binglin Chang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173524 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 08:37:00 +00:00
0e870d7d18
MAPREDUCE-3023. Fixed clients to display queue state correctly. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173458 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 01:32:14 +00:00
1d067c6e2b
MAPREDUCE-2998. Fixed a bug in TaskAttemptImpl which caused it to fork bin/mapred too many times. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173456 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 01:26:48 +00:00
339b85b88e
MAPREDUCE-3036. Fixed metrics for reserved resources in CS. Contributed by Robert Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173453 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 01:14:20 +00:00
b8e8b8da75
MAPREDUCE-3018. Fixed -file option for streaming. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173451 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 01:10:49 +00:00
c382e386b5
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1173012 13f79535-47bb-0310-9956-ffa450edef68
2011-09-20 07:40:04 +00:00
f0fedda8ef
MAPREDUCE-3040. Fixed extra copy of Configuration in YarnClientProtocolProvider and ensured MiniMRYarnCluster sets JobHistory configuration for tests.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172929 13f79535-47bb-0310-9956-ffa450edef68
2011-09-20 00:46:22 +00:00
bbfd81503c
MAPREDUCE-3017. The Web UI shows FINISHED for killed/successful/failed jobs. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172906 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 23:56:52 +00:00
482d840bcf
MAPREDUCE-3004. Fix ReduceTask to not assume 'local' mode in YARN. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172893 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 23:17:27 +00:00
e16f8a9fdf
MAPREDUCE-3038. job history server not starting because conf() missing HsController (Jeffrey Naisbitt via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172875 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 22:51:46 +00:00
8ae3cdeac7
MAPREDUCE-3042. Fixed default ResourceTracker address. Contributed by Chris Riccomini.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172847 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 21:31:15 +00:00
b7660f2bc9
MAPREDUCE-2726. Added job-file to the AM and JobHistoryServer web interfaces. Contributed by Jeffrey Naisbitt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172704 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 17:01:50 +00:00
2e61ed306f
MAPREDUCE-3030. Fixed a bug in NodeId.equals() that was causing RM to reject all NMs. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172638 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 14:17:56 +00:00
29552eeb36
MAPREDUCE-2925. Fixed Yarn+MR client code to behave saner with completed jobs. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172587 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 12:26:14 +00:00
e56579b9da
MAPREDUCE-2965. Fixed two FindBugs warnings in the previous commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172214 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 07:57:38 +00:00
34d3936bcd
MAPREDUCE-2965. Streamlined the methods hashCode(), equals(), compareTo() and toString() for all IDs. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172212 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 07:51:11 +00:00
61900651b1
MAPREDUCE-3006. Fixed MapReduce AM to exit only after properly writing out history file. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172206 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 07:16:18 +00:00
e1acb1222d
MAPREDUCE-1788. o.a.h.mapreduce.Job shouldn't make a copy of the JobConf. (Arun Murthy via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172171 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 02:50:30 +00:00
2eab7a28c7
MAPREDUCE-2987. Fixed display of logged user on RM Web-UI. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171901 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 05:52:49 +00:00
ca333f17c1
MAPREDUCE-2836. Provide option to fail jobs when submitted to non-existent fair scheduler pools. Contributed by Ahmed Radwan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171832 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 22:22:34 +00:00
70a180d0f5
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1171808 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 21:35:45 +00:00
341a15a23d
MAPREDUCE-2994. Fixed a bug in ApplicationID parsing that affects RM UI. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171485 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 10:08:52 +00:00
6af0c27930
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1171315 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 23:07:48 +00:00
d9ba4670ed
MAPREDUCE-2672. MR-279: JobHistory Server needs Analysis this job. (Robert Evans via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171297 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 22:21:00 +00:00
cb48bc1c93
MAPREDUCE-3007. Fixed Yarn Mapreduce client to be able to connect to JobHistoryServer in secure mode. Contributed by Vinod Kumar Vavilapalli.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171051 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 10:53:05 +00:00
9704960e42
MAPREDUCE-2991. queueinfo.jsp fails if queue names contain special symbols. Contributed by Priyo Mustafi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170917 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 01:38:44 +00:00
5183e88109
MAPREDUCE-3005. Fix both FifoScheduler and CapacityScheduler to correctly enforce locality constraints.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170879 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 22:46:57 +00:00
4ba2acf336
MAPREDUCE-2966. Added ShutDown hooks for MRV2 processes so that they can gracefully exit. Contributed by Abhijit Suresh Shingate.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170746 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 17:57:52 +00:00
47e04d3124
MAPREDUCE-2949. Fixed NodeManager to shut-down correctly if a service startup fails. Contributed by Ravi Teja Ch N V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170689 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 15:35:42 +00:00
88b82a0f66
MAPREDUCE-2899. Replace major parts of ApplicationSubmissionContext with a ContainerLaunchContext (Arun Murthy via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170459 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 07:26:37 +00:00
a3e8f6836b
MAPREDUCE-2676. MR-279: JobHistory Job page needs reformatted. (Robert Evans via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170379 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 22:55:22 +00:00
f4b2b63807
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1170378 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 22:49:27 +00:00
4d90df82a9
Merge -r 1170285:1170286 from branch-0.20-security to trunk to fix MAPREDUCE-2549.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170288 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 18:33:22 +00:00
88ff272cfd
MAPREDUCE-2995. Fixed race condition in ContainerLauncher. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170281 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 18:15:14 +00:00
53f921418d
MAPREDUCE-2995. Better handling of expired containers in MapReduce ApplicationMaster. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170279 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 18:12:02 +00:00
6165875dc6
MAPREDUCE-2896. Simplify all apis to in org.apache.hadoop.yarn.api.records.* to be get/set only. Added javadocs to all public records.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169980 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 00:05:51 +00:00
7fa0bf3558
MAPREDUCE-2874. Fix formatting of ApplicationId in web-ui. Contributed by Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169973 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 23:17:27 +00:00
c8383a5f49
MAPREDUCE-2985. Fixed findbugs warnings in ResourceLocalizationService. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169955 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 21:53:51 +00:00
1c01951264
MAPREDUCE-2669. Add new examples for Mean, Median, and Standard Deviation. Contributed by Plamen Jeliazkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169874 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 19:13:41 +00:00
fb65bfc661
MAPREDUCE-2979. Removed the needless ClientProtocolProvider configuration from the hadoop-mapreduce-client-core module. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169808 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 16:00:40 +00:00
be32d25c54
MAPREDUCE-2675. Reformat JobHistory Server main page to be more useful. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169763 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 14:24:32 +00:00
e14da3a72e
MAPREDUCE-2978. Fixed test-patch to make Jenkins report findbugs warnings properly. Contributed by Tom White.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169696 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 11:22:38 +00:00
6b2f2efe4d
MAPREDUCE-2749. Ensure NM registers with RM after starting all its services correctly. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169621 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 07:11:43 +00:00
817ead65b9
MAPREDUCE-2933. Change allocate call to return ContainerStatus for completed containers rather than Container.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169484 13f79535-47bb-0310-9956-ffa450edef68
2011-09-11 17:26:06 +00:00
8fb67650b1
MAPREDUCE-2691. Finish up the cleanup of distributed cache file resources and related tests. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167676 13f79535-47bb-0310-9956-ffa450edef68
2011-09-11 06:21:39 +00:00
b982e6205f
MAPREDUCE-2971. ant build mapreduce fails protected access jc.displayJobList (jobs) (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167383 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 22:42:57 +00:00
fbf0035ee6
MAPREDUCE-2975. Fixed YARNRunner to use YarnConfiguration rather than Configuration. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167331 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 19:01:08 +00:00
68cb2b01b6
HADOOP-7607 and MAPREDUCE-2934. Simplify the RPC proxy cleanup process. (atm)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167318 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 18:12:14 +00:00
1d84d983a2
MAPREDUCE-2954. Fixed a deadlock in NM caused due to wrong synchronization in protocol buffer records. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167061 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 09:47:15 +00:00
85e17fd2df
MAPREDUCE-2711. Update TestBlockPlacementPolicyRaid for the new namesystem and block management APIs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167001 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 04:48:35 +00:00
71e0515433
MAPREDUCE-2963. Fix hang in TestMRJobs. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166975 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 03:01:08 +00:00
a0f13a28f7
Adding back hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources which was missed during the merge of MAPREDUCE-279.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166972 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 02:52:22 +00:00
ca853445e9
MAPREDUCE-2953. Fix a race condition on submission which caused client to incorrectly assume application was gone by making submission synchronous for RMAppManager. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166968 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 02:19:24 +00:00
a0ef2d7503
MAPREDUCE-2937. Ensure reason for application failure is displayed to the user. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166966 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 02:14:33 +00:00
035937bee8
MAPREDUCE-2690. Web-page for FifoScheduler. Contributed by Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166958 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 02:04:55 +00:00
fafe8cd28e
MAPREDUCE-2864. Normalize configuration variable names for YARN. Contributed by Robert Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166955 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 01:44:58 +00:00
b3c9c3c182
MAPREDUCE-2677. Fixed 404 for some links from HistoryServer. Contributed by Robert Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166901 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 20:59:34 +00:00
dd34c4e24f
MAPREDUCE-2844. Fixed display of nodes in UI.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166856 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:49:28 +00:00
1b294f206b
MAPREDUCE-2844. Fixed display of nodes in UI. Contributed by Ravi Teja Ch N V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166855 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:48:10 +00:00
6b6ef7b8e3
MAPREDUCE-2947. Fixed race condition in AuxiliaryServices. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166849 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:40:27 +00:00
8ac20f92f5
MAPREDUCE-2942. TestNMAuditLogger.testNMAuditLoggerWithIP failing (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166842 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:29:49 +00:00
1f46b991da
MAPREDUCE-2908. Fix all findbugs warnings. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166838 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:26:20 +00:00
ae5e8e0104
MAPREDUCE-2784. [Gridmix] Bug fixes in ExecutionSummarizer and ResourceUsageMatcher. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166636 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 11:29:55 +00:00
d10631f728
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1166495 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 01:39:07 +00:00
1c15670d53
MAPREDUCE-2948. Hadoop streaming test failure, post MR-2767 (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166402 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 21:18:09 +00:00
0ecba04727
MAPREDUCE-2938. Log application submission failure in CapacityScheduler
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166006 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 05:54:25 +00:00
8815bdf304
Adding new files for MAPREDUCE-2655.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165950 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 01:26:21 +00:00
cdfabf5ae2
MAPREDUCE-2655. Add audit logs to ResourceManager and NodeManager. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165949 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 01:24:21 +00:00
d51078eb7e
MAPREDUCE-2774. Add startup message to ResourceManager & NodeManager on startup. Contributed by Venu Gopala Rao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165933 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 23:40:49 +00:00
03c1015d6e
MAPREDUCE-2800. Set final progress for tasks to ensure all task information is correctly logged to JobHistory. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165930 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 23:36:19 +00:00
3a3f277017
MAPREDUCE-2767. CHANGES.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165894 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 21:59:09 +00:00
f560a1066f
MAPREDUCE-2687. Fix NodeManager to use the right version of LocalDirAllocator.getLocalPathToWrite. Contributed by mahadev & acmurthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165890 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 21:49:46 +00:00
fd804b5993
MAPREDUCE-2767. Remove Linux task-controller. Contributed by Milind Bhandarkar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165864 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 21:29:26 +00:00
e20f135174
MAPREDUCE-2936. Contrib Raid compilation broken after HDFS-1620. Contributed by Vinod Kumar Vavilapalli.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165657 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 13:19:10 +00:00
ae367be8f3
MAPREDUCE-2882. TestLineRecordReader depends on ant jars. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165449 13f79535-47bb-0310-9956-ffa450edef68
2011-09-05 23:23:35 +00:00
6b608aad7d
MAPREDUCE-2697. Enhance CapacityScheduler to cap concurrently running applications per-queue & per-user.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165403 13f79535-47bb-0310-9956-ffa450edef68
2011-09-05 19:49:47 +00:00
6bdf5746d5
MAPREDUCE-2716. MRReliabilityTest job fails because of missing job-file. Contributed by Jeffrey Naisbitt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164805 13f79535-47bb-0310-9956-ffa450edef68
2011-09-03 06:22:03 +00:00
b97a4d40c8
HADOOP-7524 and MapReduce-2887 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164771 13f79535-47bb-0310-9956-ffa450edef68
2011-09-03 00:31:05 +00:00
07c5741c9a
HADOOP-7552. FileUtil#fullyDelete doesn't throw IOE but lists it in the throws clause. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164339 13f79535-47bb-0310-9956-ffa450edef68
2011-09-02 03:20:12 +00:00
5d4f16b93c
MAPREDUCE-2735. Add an applications summary log to ResourceManager. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164301 13f79535-47bb-0310-9956-ffa450edef68
2011-09-01 23:58:12 +00:00
a9bf33445e
MAPREDUCE-2756. Better error handling in JobControl for failed jobs. Contributed by Robert Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164255 13f79535-47bb-0310-9956-ffa450edef68
2011-09-01 20:24:38 +00:00
a2b1aa9471
HADOOP-7595. Upgrade dependency to Avro 1.5.3. (Alejandro Abdelnur via atm)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164174 13f79535-47bb-0310-9956-ffa450edef68
2011-09-01 17:13:44 +00:00
b9a5fd5190
MAPREDUCE-2917. Fixed corner case in container reservation which led to starvation and hung jobs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163768 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 19:52:20 +00:00
ade0f0560f
MAPREDUCE-2652. Enabled multiple NMs to be runnable on a single node by making shuffle service port to be truely configurable. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163585 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 11:38:32 +00:00
5786efbfa6
MAPREDUCE-2916. Ivy build for MRv1 fails with bad organization for common daemon. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163490 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 05:48:02 +00:00
c2b851b0f2
MAPREDUCE-2897. Javadoc for ClientRMProtocol protocol and related records.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163069 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 01:22:28 +00:00
fb6ecb9b27
MAPREDUCE-2886. Fix Javadoc warnings in MapReduce. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163050 13f79535-47bb-0310-9956-ffa450edef68
2011-08-29 23:27:47 +00:00
aad81a15ec
MAPREDUCE-2737. Update the progress of jobs on client side. (Siddharth Seth and Mahadev Konar via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162979 13f79535-47bb-0310-9956-ffa450edef68
2011-08-29 20:23:17 +00:00
3380d8f70c
MAPREDUCE-2904. Fixed bin/yarn to correctly include HDFS jars and clean up of stale refs to pre-mavenized Hadoop Common and HDFS. Contributed by Sharad Agarwal and Arun C. Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162954 13f79535-47bb-0310-9956-ffa450edef68
2011-08-29 19:36:26 +00:00
b9259a2710
MAPREDUCE-2898. Javadoc for ContainerManager protocol and related records.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162613 13f79535-47bb-0310-9956-ffa450edef68
2011-08-29 00:04:06 +00:00
00d2263908
MAPREDUCE-2891. Javadoc for AMRMProtocol and related records. Contributed by acmurthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162499 13f79535-47bb-0310-9956-ffa450edef68
2011-08-28 11:41:36 +00:00
c9cbd8e4e6
MAPREDUCE-2893. Remove duplicate entry of YarnClientProtocolProvider in ClientProtocolProvider services file. Contributed by Liang-Chi Hsieh.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162491 13f79535-47bb-0310-9956-ffa450edef68
2011-08-28 10:37:24 +00:00
5116ea4487
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1162279 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 22:46:17 +00:00
d8c3e63dce
MAPREDUCE-2885. Fix mapred-config.sh to look for hadoop-config.sh in HADOOP_COMMON_HOME/libexec.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162188 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 17:55:53 +00:00
0ee0fa45d2
MAPREDUCE-2881. Fix to include log4j 1.2.16 depenency. Contributed by Giridharan Kesavan
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161782 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 22:30:42 +00:00
a44ffcc0be
Preparing for hadoop-0.24.0 development.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161736 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 20:32:04 +00:00
5675dad8b7
MAPREDUCE-2879. Fix version for MR-279 to 0.23.0
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161722 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 20:01:59 +00:00
ee05510c42
Preparing for release 0.23.0
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161716 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:39:15 +00:00
01f24e1af7
HADOOP-7578. Fix test-patch to be able to run on MR patches. (mahadev and tom white)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161711 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:31:02 +00:00
58676edf98
MAPREDUCE-2879. Fix version for MR-279 to 0.23.0.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161705 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:13:50 +00:00
1dd113b24a
MAPREDUCE-2796. Set start times for MR applications for clients to see. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161704 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:12:35 +00:00
7c85f33ce1
MAPREDUCE-2877. Add missing Apache license header in some files in MR and also add the rat plugin to the poms. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161650 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 17:16:36 +00:00
f2b91a8367
MAPREDUCE-2807. Fix AM restart and client redirection. Contributed by Sharad Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161408 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 06:35:58 +00:00
6316e66279
HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161335 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 00:20:52 +00:00
cd7157784e
HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161332 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 00:14:24 +00:00
Mahadev Konar
Suresh Srinivas
Vinod Kumar Vavilapalli
Alejandro Abdelnur
Eli Collins
Arun Murthy
Siddharth Seth
Tsz-wo Sze
Thomas White
Amar Kamat
Todd Lipcon
Aaron Myers
Robert Joseph Evans
Jitendra Nath Pandey
Harsh J
Konstantin Shvachko
Sanjay Radia
Matthew Foley
Jakob Homan
Eric Yang
Ravi Gummadi
Giridharan Kesavan
Sharad Agarwal