Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,531 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

613 Commits

Author SHA1 Message Date
Thomas Graves d6170f00b1 MAPREDUCE-3913. RM application webpage is unresponsive after 2000 jobs (Jason Lowe via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294207 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-27 16:44:05 +00:00
Vinod Kumar Vavilapalli f071323343 MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293775 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-26 08:32:30 +00:00
Vinod Kumar Vavilapalli f3cc891148 MAPREDUCE-3910. Fixed a bug in CapacityScheduler LeafQueue which was causing app-submission to fail. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293750 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-26 06:49:21 +00:00
Vinod Kumar Vavilapalli 7a082ec2bd MAPREDUCE-2793. Corrected AppIDs, JobIDs, TaskAttemptIDs to be of correct format on the web pages. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293517 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-25 02:03:59 +00:00
Arun Murthy 1de3fa8653 Preparing for 0.23.3 release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293506 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-25 01:37:07 +00:00
Robert Joseph Evans 4e64d7b447 MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293469 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 23:00:17 +00:00
Thomas Graves 582b97c3e7 MAPREDUCE-3904. Job history produced with mapreduce.cluster.acls.enabled false can not be viewed with mapreduce.cluster.acls.enabled true (Jonathon Eagles via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293456 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 22:30:47 +00:00
Vinod Kumar Vavilapalli c0572656ce MAPREDUCE-3730. Modified RM to allow restarted NMs to be able to join the cluster without waiting for expiry. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293436 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 21:39:31 +00:00
Vinod Kumar Vavilapalli 969b3809e4 MAPREDUCE-3866. Fixed the bin/yarn script to not print the command line unnecessarily. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293425 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 21:21:20 +00:00
Siddharth Seth 6112940841 MAPREDUCE 3738. NM can hang during shutdown if AppLogAggregatorImpl thread dies unexpectedly. (Contributed by Jason Lowe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293060 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 02:12:06 +00:00
Thomas Graves 81f5c5933d MAPREDUCE-3878. Null user on filtered jobhistory job page (Jonathon Eagles via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292831 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 15:50:53 +00:00
Amar Kamat 8a2073cc61 MAPREDUCE-3787. [Gridmix] Optimize job monitoring and STRESS mode for faster job submission. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292736 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 10:41:07 +00:00
Alejandro Abdelnur 267bebeab0 MAPREDUCE-3884. PWD should be first in the classpath of MR tasks (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292424 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-22 17:57:32 +00:00
Vinod Kumar Vavilapalli b2172c394e MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291606 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 05:30:23 +00:00
Vinod Kumar Vavilapalli 5ee495e6f3 MAPREDUCE-3634. Fixed all daemons to crash instead of hanging around when their EventHandlers get exceptions. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291598 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 05:08:25 +00:00
Steve Loughran 3d8907fdd6 MAPREDUCE-3877 Add a test to formalise the current state transitions of the yarn lifecycle 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245918 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 13:22:47 +00:00
Arun Murthy 566f0b5ad2 MAPREDUCE-3880. Changed LCE binary to be 32-bit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245867 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 06:36:00 +00:00
Arun Murthy 3c5eb01263 MAPREDUCE-3856. Committing to 0.23.1. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245840 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 02:18:00 +00:00
Tsz-wo Sze b4c8567e1b MAPREDUCE-3583. Change pid to String and stime to BigInteger in order to handle integers larger than Long.MAX_VALUE. Contributed by Zhihong Yu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245828 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 01:12:18 +00:00
Robert Joseph Evans ff33b38734 MAPREDUCE-3862 Nodemanager can appear to hang on shutdown due to lingering DeletionService threads (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245781 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 21:57:49 +00:00
Ravi Gummadi 11c127bb51 MAPREDUCE-3757. [Rumen] Fixed Rumen Folder to adjust shuffleFinished and sortFinished times when needed. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245303 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 02:55:00 +00:00
Siddharth Seth a64046d16f MAPREDUCE-3856. Instances of RunningJob class givs incorrect job tracking urls when mutiple jobs are submitted from same client jvm. (Contributed by Eric Payne) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245276 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 00:54:44 +00:00
Robert Joseph Evans cfc4ad76a3 MAPREDUCE-3849. Change TokenCache's reading of the binary token file (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245099 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 17:49:20 +00:00
Todd Lipcon 20816218f0 MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode HTTPS parameters. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244852 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 05:53:25 +00:00
Alejandro Abdelnur 89bd2210a7 MAPREDUCE-3736. Variable substitution depth too large for fs.default.name causes jobs to fail (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244264 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 23:09:05 +00:00
Mahadev Konar 83ab8f087b MAPREDUCE-3858. Task attempt failure during commit results in task never completing. (Tom White via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244254 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 22:49:00 +00:00
Vinod Kumar Vavilapalli 16a44b6fa5 MAPREDUCE-3854. Fixed and reenabled tests related to MR child JVM's environmental variables in TestMiniMRChildTask. (Tom White via vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244223 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 21:39:59 +00:00
Vinod Kumar Vavilapalli 1903e544a4 MAPREDUCE-3802. Added test to validate that AM can crash multiple times and still can recover successfully after MAPREDUCE-3846. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244178 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 19:24:00 +00:00
Vinod Kumar Vavilapalli 0515b3322f MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then the recovery. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243752 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 00:06:37 +00:00
Konstantin Shvachko ce778462ee MAPREDUCE-3837. Job tracker is not able to recover jobs after crash. Contributed by Mayank Bansal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243695 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 21:12:03 +00:00
Mahadev Konar 5c46ba4d48 MAPREDUCE-3852. Test TestLinuxResourceCalculatorPlugin failing. (Thomas Graves via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243418 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 05:37:11 +00:00
Thomas Graves 0bf146b0dd MAPREDUCE-3843. Job summary log file found missing on the RM host (Anupam Seth via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242976 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 23:24:08 +00:00
Vinod Kumar Vavilapalli 56b6f4a8fc Cleaning up hadoop-mapreduce-project/CHANGES.txt a bit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242902 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 19:55:15 +00:00
Thomas Graves 73a72e0ef9 MAPREDUCE-3680. FifoScheduler web service rest API can print out invalid JSON. (B Anil Kumar via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242790 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 14:30:00 +00:00
Robert Joseph Evans b2d49acd08 MAPREDUCE-3840 JobEndNotifier doesn't use the proxyToUse during connecting (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241999 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 17:31:13 +00:00
Amar Kamat e5060d3bbb MAPREDUCE-3770. Zombie.getJobConf() results into NPE. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241845 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 10:15:41 +00:00
Arun Murthy 647f374607 Preparing for release 0.23.1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241795 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 07:27:58 +00:00
Arun Murthy 1de681b896 MAPREDUCE-3828. Ensure that urls in single-node mode are correct. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241791 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 07:12:24 +00:00
Arun Murthy 4018798d4b MAPREDUCE-3415. Moving to 0.23.1 section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241752 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 02:59:21 +00:00
Vinod Kumar Vavilapalli 7ae94c6678 MAPREDUCE-3834. Changed MR AM to not add the same rack entry multiple times into the container request table when multiple hosts for a split happen to be on the same rack. Contributed by Siddarth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241734 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 01:56:02 +00:00
Siddharth Seth 5fdfa2b4bd MAPREDUCE-3822. Changed FS counter computation to use all occurences of the same FS scheme, instead of randomly using one. (Contributed by Mahadev Konar) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241721 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 00:56:28 +00:00
Arun Murthy 04f685ea76 MAPREDUCE-3827. Changed Counters to use ConcurrentSkipListMap for performance. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241711 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 00:16:54 +00:00
Siddharth Seth ccc2807d86 MAPREDUCE-3823. Ensure counters are calculated only once after a job finishes. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241692 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 23:07:03 +00:00
Arun Murthy d8e9f84fb1 Fixed jira id in commit for MAPREDUCE-3826. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241688 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 23:04:29 +00:00
Arun Murthy 7dfe20d5a8 MAPREDUCE-3823. Fixed a bug in RM web-ui which broke sorting. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241685 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 22:59:58 +00:00
Arun Murthy 59b88655bc MAPREDUCE-3833. Fixed a bug in reinitiaziling of queues. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241659 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 22:08:55 +00:00
Vinod Kumar Vavilapalli 90bc439b66 MAPREDUCE-3815. Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly. Contributed by Siddarth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241654 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 21:58:54 +00:00
Siddharth Seth fb498926be MAPREDUCE-3436. JobHistory webapp address should use the host configured in the jobhistory address. (Contributed by Ahmed Radwan) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241620 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 20:55:10 +00:00
Mahadev Konar aaace5e84e MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241325 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 01:53:54 +00:00
Arun Murthy 6e376a39a0 MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241323 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 01:49:50 +00:00
Arun Murthy 35f12b9556 MAPREDUCE-3697. Support binary compatibility for Counters after MAPREDUCE-901. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241319 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 01:41:28 +00:00
Mahadev Konar 59d1f07d6c MAPREDUCE-3794. Support mapred.Task.Counter and mapred.JobInProgress.Counter enums for compatibility (Tom White via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241299 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 00:53:36 +00:00
Arun Murthy 8dbf374f16 MAPREDUCE-3811. Made jobclient-to-AM retries configurable. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241285 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 00:20:36 +00:00
Arun Murthy 75d2d6185e MAPREDUCE-3809. Ensure that there is no needless sleep in Task at the end of the task. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241282 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 00:13:40 +00:00
Vinod Kumar Vavilapalli 08479378c2 MAPREDUCE-3818. Fixed broken compilation in TestSubmitJob after the patch for HDFS-2895. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241253 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 23:16:37 +00:00
Arun Murthy 4f6839f23d MAPREDUCE-3354. Changed scripts so that jobhistory server is started by bin/mapred instead of bin/yarn. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241250 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 23:11:26 +00:00
Robert Joseph Evans bdf837a64a MAPREDUCE-3804. yarn webapp interface vulnerable to cross scripting attacks (Dave Thompson via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241225 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 22:34:28 +00:00
Vinod Kumar Vavilapalli 9f2b77aee4 MAPREDUCE-3808. Fixed an NPE in FileOutputCommitter for jobs with maps but no reduces. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241217 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 22:16:26 +00:00
Arun Murthy c6282df3e5 MAPREDUCE-3813. Added a cache for resolved racks. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241209 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 22:06:58 +00:00
Arun Murthy 28a2eb9d72 MAPREDUCE-3810. Performance tweaks - reduced logging in AM and defined hascode/equals for ResourceRequest & Priority. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241205 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 22:01:22 +00:00
Vinod Kumar Vavilapalli 3f02d8dd5c MAPREDUCE-3814. Fixed MRV1 compilation. (Arun C Murthy via vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241177 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 21:04:30 +00:00
Arun Murthy c7007a8a35 MAPREDUCE-3747. Initialize queue metrics upfront and added start/finish time to RM Web-UI. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240886 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 03:38:44 +00:00
Mahadev Konar 23e336a0ed MAPREDUCE-3765. FifoScheduler does not respect yarn.scheduler.fifo.minimum-allocation-mb setting (Hitesh Shah via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240634 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 22:44:43 +00:00
Mahadev Konar f3c35222e6 MAPREDUCE-3775. Change MiniYarnCluster to escape special chars in testname. (Hitesh Shah via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240603 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 20:20:00 +00:00
Mahadev Konar c7d64769c1 MAPREDUCE-3759. ClassCastException thrown in -list-active-trackers when there are a few unhealthy nodes (vinodkv via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240598 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 20:03:37 +00:00
Mahadev Konar f2280f612c MAPREDUCE-3795. "job -status" command line output is malformed. (vinodkv via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240593 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 19:32:10 +00:00
Mahadev Konar caed1cfaf9 MAPREDUCE-3723. TestAMWebServicesJobs & TestHSWebServicesJobs incorrectly asserting tests (Bhallamudi Venkata Siva Kamesh via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240590 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 18:55:03 +00:00
Mahadev Konar 2c32cd7008 MAPREDUCE-3791. can't build site in hadoop-yarn-server-common. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240587 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 18:41:50 +00:00
Suresh Srinivas 1de317a945 MAPREDUCE-3803. Fix broken build of raid contrib due to HDFS-2864. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240441 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 02:24:21 +00:00
Vinod Kumar Vavilapalli fe1cf3b0ac MAPREDUCE-3417. Fixed job-access-controls to work with MR AM and JobHistoryServer web-apps. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240428 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 01:21:12 +00:00
Vinod Kumar Vavilapalli 3343494d6c MAPREDUCE-3760. Changed active nodes list to not contain unhealthy nodes on the webUI and metrics. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240421 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 01:03:51 +00:00
Vinod Kumar Vavilapalli 94242c9385 MAPREDUCE-3711. Fixed MR AM recovery so that only single selected task output is recovered and thus reduce the unnecessarily bloated recovery time. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240413 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 00:04:53 +00:00
Alejandro Abdelnur b030231108 MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong jobtoken file (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240410 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-03 23:48:48 +00:00
Vinod Kumar Vavilapalli a5c46c9165 MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239971 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-03 01:16:32 +00:00
Mahadev Konar 72d34e6594 MAPREDUCE-3708. Metrics: Incorrect Apps Submitted Count (Bhallamudi via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239954 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-03 00:33:05 +00:00
Arun Murthy cc74881acb MAPREDUCE-3771. Un-deprecated the old mapred apis, port of MAPREDUCE-1735. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239482 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 08:37:58 +00:00
Arun Murthy 70bc14f234 MAPREDUCE-3780. Fixed a bug where applications killed before getting activated were not getting cleaned up properly. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239443 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 02:31:05 +00:00
Siddharth Seth 6ba0375b21 MAPREDUCE-3744. Fix the yarn logs command line. Improve error messages for mapred job -logs. (Contributed by Jason Lowe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239433 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 01:43:49 +00:00
Vinod Kumar Vavilapalli ef1a619a4d MAPREDUCE-3752. Modified application limits to include queue max-capacities besides the usual user limits. Contributed by Arun C Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239422 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 00:41:09 +00:00
Siddharth Seth b4929bcf14 MAPREDUCE-3640. Allow AMRecovery to work with partial JobHistory files. (Contributed by Arun C Murthy) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239402 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 23:33:58 +00:00
Arun Murthy ab75b8b420 MAPREDUCE-3427. Fix streaming unit tests broken after mavenization. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239391 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 23:05:14 +00:00
Mahadev Konar 947ede4c4e MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239310 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 20:43:10 +00:00
Vinod Kumar Vavilapalli b33c66efc5 MAPREDUCE-3774. Moved yarn-default.xml to hadoop-yarn-common from hadoop-server-common. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239291 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 19:55:20 +00:00
Alejandro Abdelnur e3d555a656 MAPREDUCE-3499. New MiniMR does not setup proxyuser configuration correctly, thus tests using doAs do not work. (johnvijoe via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239207 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 17:03:27 +00:00
Arun Murthy f49ba355e5 MAPREDUCE-3762. Fixed default CapacityScheduler configs. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238987 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 07:57:35 +00:00
Vinod Kumar Vavilapalli d1f805f942 MAPREDUCE-3754. Modified RM UI to filter applications based on state of the applications. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238887 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 00:51:40 +00:00
Thomas White 05efddf28e MAPREDUCE-3749. ConcurrentModificationException in counter groups. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238734 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 18:30:58 +00:00
Arun Murthy a8b6ee0491 MAPREDUCE-3756. Made single shuffle limit configurable. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238721 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 18:08:11 +00:00
Arun Murthy 7f23d72352 MAPREDUCE-3764. Fixed resource usage metrics for queues and users. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238255 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 08:30:31 +00:00
Arun Murthy 7ed0f74997 MAPREDUCE-3748. Changed a log in CapacityScheduler.nodeUpdate to debug. Contributed by Ramya Sunil. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238157 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 06:22:22 +00:00
Mahadev Konar 443d8f6c0b MAPREDUCE-3679. AM logs and others should not automatically refresh after every 1 second. (Vinod KV via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238146 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 04:53:49 +00:00
Vinod Kumar Vavilapalli 76b653a367 MAPREDUCE-3716. Fixing YARN+MR to allow MR jobs to be able to use java.io.File.createTempFile to create temporary files as part of their tasks. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238136 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 02:23:38 +00:00
Mahadev Konar 7e4725db41 MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237920 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 18:47:55 +00:00
Amar Kamat 5652e71992 MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237543 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 06:20:53 +00:00
Vinod Kumar Vavilapalli 5262b7ba4d MAPREDUCE-3732. Modified CapacityScheduler to use only users with pending requests for computing user-limits. Contributed by Arun C Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236953 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 01:32:29 +00:00
Vinod Kumar Vavilapalli fe4bff77e1 MAPREDUCE-3740. Fixed broken mapreduce compilation after the patch for HADOOP-7965. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236901 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 21:49:15 +00:00
Mahadev Konar fdb9d51cec MAPREDUCE-3742. "yarn logs" command fails with ClassNotFoundException. (Jason Lowe via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236816 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 18:46:56 +00:00
Arun Murthy f57de0d6dd MAPREDUCE-3693. Added mapreduce.admin.user.env to mapred-default.xml. Contributed by Roman Shapshonik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236594 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 08:49:18 +00:00
Arun Murthy 0cb3dd913b MAPREDUCE-3720. Changed bin/mapred job -list to not print job-specific information not available at RM. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236588 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 08:44:19 +00:00
Vinod Kumar Vavilapalli 3cdc100369 MAPREDUCE-3360. Added information about lost/rebooted/decommissioned nodes on the webapps. Contributed by Bhallamudi Venkata Siva Kamesh and Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236433 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 22:56:53 +00:00