Commit Graph

403 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli 5ee495e6f3 MAPREDUCE-3634. Fixed all daemons to crash instead of hanging around when their EventHandlers get exceptions. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291598 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 05:08:25 +00:00
Aaron Myers f0db867292 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291400 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 18:33:37 +00:00
Steve Loughran 3d8907fdd6 MAPREDUCE-3877 Add a test to formalise the current state transitions of the yarn lifecycle
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245918 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 13:22:47 +00:00
Arun Murthy 566f0b5ad2 MAPREDUCE-3880. Changed LCE binary to be 32-bit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245867 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 06:36:00 +00:00
Todd Lipcon ef5d7156db Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245834 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:27:51 +00:00
Tsz-wo Sze b4c8567e1b MAPREDUCE-3583. Change pid to String and stime to BigInteger in order to handle integers larger than Long.MAX_VALUE. Contributed by Zhihong Yu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245828 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:12:18 +00:00
Robert Joseph Evans ff33b38734 MAPREDUCE-3862 Nodemanager can appear to hang on shutdown due to lingering DeletionService threads (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245781 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:57:49 +00:00
Aaron Myers 833e96534f Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245117 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 18:35:32 +00:00
Todd Lipcon 20816218f0 MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode HTTPS parameters. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244852 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 05:53:25 +00:00
Aaron Myers 1fb0ab92f8 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244645 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:04:17 +00:00
Alejandro Abdelnur 89bd2210a7 MAPREDUCE-3736. Variable substitution depth too large for fs.default.name causes jobs to fail (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244264 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 23:09:05 +00:00
Todd Lipcon db187cf40e Merge trunk into HA branch.
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 21:00:37 +00:00
Thomas Graves 0bf146b0dd MAPREDUCE-3843. Job summary log file found missing on the RM host (Anupam Seth via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242976 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 23:24:08 +00:00
Aaron Myers 05d56e5e7e Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242871 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 18:01:01 +00:00
Thomas Graves 73a72e0ef9 MAPREDUCE-3680. FifoScheduler web service rest API can print out invalid JSON. (B Anil Kumar via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242790 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 14:30:00 +00:00
Todd Lipcon c14bb61a82 Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 01:49:08 +00:00
Tsz-wo Sze 03ee90b9eb HADOOP-7923. Automate the updating of version numbers in the doc system.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242485 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 19:47:11 +00:00
Arun Murthy 1de681b896 MAPREDUCE-3828. Ensure that urls in single-node mode are correct. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241791 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 07:12:24 +00:00
Arun Murthy 7dfe20d5a8 MAPREDUCE-3823. Fixed a bug in RM web-ui which broke sorting. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241685 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 22:59:58 +00:00
Arun Murthy 59b88655bc MAPREDUCE-3833. Fixed a bug in reinitiaziling of queues. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241659 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 22:08:55 +00:00
Mahadev Konar aaace5e84e MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241325 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 01:53:54 +00:00
Arun Murthy 4f6839f23d MAPREDUCE-3354. Changed scripts so that jobhistory server is started by bin/mapred instead of bin/yarn. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241250 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 23:11:26 +00:00
Robert Joseph Evans bdf837a64a MAPREDUCE-3804. yarn webapp interface vulnerable to cross scripting attacks (Dave Thompson via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241225 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:34:28 +00:00
Arun Murthy c6282df3e5 MAPREDUCE-3813. Added a cache for resolved racks. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241209 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:06:58 +00:00
Arun Murthy 28a2eb9d72 MAPREDUCE-3810. Performance tweaks - reduced logging in AM and defined hascode/equals for ResourceRequest & Priority. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241205 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:01:22 +00:00
Aaron Myers db7c013877 HDFS-2733. Document HA configuration and CLI. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241183 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 21:18:11 +00:00
Arun Murthy c7007a8a35 MAPREDUCE-3747. Initialize queue metrics upfront and added start/finish time to RM Web-UI.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240886 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 03:38:44 +00:00
Mahadev Konar 23e336a0ed MAPREDUCE-3765. FifoScheduler does not respect yarn.scheduler.fifo.minimum-allocation-mb setting (Hitesh Shah via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240634 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 22:44:43 +00:00
Mahadev Konar f3c35222e6 MAPREDUCE-3775. Change MiniYarnCluster to escape special chars in testname. (Hitesh Shah via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240603 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:20:00 +00:00
Mahadev Konar c7d64769c1 MAPREDUCE-3759. ClassCastException thrown in -list-active-trackers when there are a few unhealthy nodes (vinodkv via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240598 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:03:37 +00:00
Mahadev Konar 2c32cd7008 MAPREDUCE-3791. can't build site in hadoop-yarn-server-common. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240587 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 18:41:50 +00:00
Vinod Kumar Vavilapalli 3343494d6c MAPREDUCE-3760. Changed active nodes list to not contain unhealthy nodes on the webUI and metrics. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240421 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 01:03:51 +00:00
Vinod Kumar Vavilapalli a5c46c9165 MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239971 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 01:16:32 +00:00
Mahadev Konar 72d34e6594 MAPREDUCE-3708. Metrics: Incorrect Apps Submitted Count (Bhallamudi via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239954 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 00:33:05 +00:00
Eli Collins 1950f97ab9 HADOOP-8012. hadoop-daemon.sh and yarn-daemon.sh are trying to mkdir and chown log/pid dirs which can fail. Contributed by Roman Shaposhnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 18:45:07 +00:00
Arun Murthy 70bc14f234 MAPREDUCE-3780. Fixed a bug where applications killed before getting activated were not getting cleaned up properly. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239443 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 02:31:05 +00:00
Siddharth Seth 6ba0375b21 MAPREDUCE-3744. Fix the yarn logs command line. Improve error messages for mapred job -logs. (Contributed by Jason Lowe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239433 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 01:43:49 +00:00
Vinod Kumar Vavilapalli ef1a619a4d MAPREDUCE-3752. Modified application limits to include queue max-capacities besides the usual user limits. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239422 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 00:41:09 +00:00
Vinod Kumar Vavilapalli b33c66efc5 MAPREDUCE-3774. Moved yarn-default.xml to hadoop-yarn-common from hadoop-server-common.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239291 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 19:55:20 +00:00
Arun Murthy f49ba355e5 MAPREDUCE-3762. Fixed default CapacityScheduler configs. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238987 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 07:57:35 +00:00
Vinod Kumar Vavilapalli d1f805f942 MAPREDUCE-3754. Modified RM UI to filter applications based on state of the applications. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238887 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 00:51:40 +00:00
Arun Murthy 7f23d72352 MAPREDUCE-3764. Fixed resource usage metrics for queues and users.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238255 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 08:30:31 +00:00
Arun Murthy 7ed0f74997 MAPREDUCE-3748. Changed a log in CapacityScheduler.nodeUpdate to debug. Contributed by Ramya Sunil.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238157 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 06:22:22 +00:00
Mahadev Konar 443d8f6c0b MAPREDUCE-3679. AM logs and others should not automatically refresh after every 1 second. (Vinod KV via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238146 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 04:53:49 +00:00
Vinod Kumar Vavilapalli 76b653a367 MAPREDUCE-3716. Fixing YARN+MR to allow MR jobs to be able to use java.io.File.createTempFile to create temporary files as part of their tasks. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238136 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 02:23:38 +00:00
Mahadev Konar 7e4725db41 MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237920 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 18:47:55 +00:00
Todd Lipcon 327c216c2f Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236965 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 02:50:23 +00:00
Vinod Kumar Vavilapalli 5262b7ba4d MAPREDUCE-3732. Modified CapacityScheduler to use only users with pending requests for computing user-limits. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236953 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 01:32:29 +00:00
Aaron Myers 2b2e56056e Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236936 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:21:07 +00:00
Alejandro Abdelnur 8a234f394e HADOOP-7939. Improve Hadoop subcomponent integration in Hadoop 0.23. (rvs via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236929 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 23:53:35 +00:00
Vinod Kumar Vavilapalli fe4bff77e1 MAPREDUCE-3740. Fixed broken mapreduce compilation after the patch for HADOOP-7965. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236901 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 21:49:15 +00:00
Mahadev Konar fdb9d51cec MAPREDUCE-3742. "yarn logs" command fails with ClassNotFoundException. (Jason Lowe via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236816 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 18:46:56 +00:00
Vinod Kumar Vavilapalli 3cdc100369 MAPREDUCE-3360. Added information about lost/rebooted/decommissioned nodes on the webapps. Contributed by Bhallamudi Venkata Siva Kamesh and Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236433 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 22:56:53 +00:00
Vinod Kumar Vavilapalli 54f738575c MAPREDUCE-3699. Increased RPC handlers for all YARN servers to reasonable values for working at scale. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236396 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 21:37:28 +00:00
Mahadev Konar af6448e543 MAPREDUCE-3737. The Web Application Proxy's is not documented very well. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236371 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 20:10:50 +00:00
Aaron Myers 1c95060a72 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236333 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:03:46 +00:00
Vinod Kumar Vavilapalli 21c9116309 MAPREDUCE-3713. Fixed the way head-room is allocated to applications by CapacityScheduler so that it deducts current-usage per user and not per-application. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235989 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 23:31:14 +00:00
Arun Murthy 9d1621da52 MAPREDUCE-3683. Fixed maxCapacity of queues to be product of parent maxCapacities.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235858 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 18:17:55 +00:00
Aaron Myers 1853b9d188 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235856 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 18:07:43 +00:00
Alejandro Abdelnur f73daf6af1 MAPREDUCE-3505. yarn APPLICATION_CLASSPATH needs to be overridable. (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235391 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 18:21:27 +00:00
Aaron Myers 83bcb1bbf4 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235380 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 17:59:14 +00:00
Eli Collins 5dfe62d845 HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235135 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:05:52 +00:00
Arun Murthy 9a153334ac MAPREDUCE-3681. Fixed computation of queue's usedCapacity.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235103 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 01:00:51 +00:00
Todd Lipcon fa4a33a566 Merge trunk into HA branch.
- Some conflicts on BlockManager due to the recent commit of HDFS-2822 - moved logic to processMisReplicatedBlock function
- testNoExtensionIfNoBlocks(org.apache.hadoop.hdfs.TestSafeMode) is now failing due to an existing bug in the HA branch, to be fixed soon 


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235078 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 00:00:05 +00:00
Mahadev Konar c415dee2b7 MAPREDUCE-3691. webservices add support to compress response. (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234989 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:15:55 +00:00
Aaron Myers e42bbfbca2 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234924 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 18:07:27 +00:00
Mahadev Konar 8a1719e999 MAPREDUCE-3549. write api documentation for web service apis for RM, NM, mapreduce app master, and job history server (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234222 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 00:53:02 +00:00
Mahadev Konar b49aae0635 MAPREDUCE-3689. RM web UI doesn't handle newline in job name. (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234148 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 21:27:39 +00:00
Mahadev Konar c6923061d0 MAPREDUCE-3698. Client cannot talk to the history server in secure mode. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234120 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 20:44:17 +00:00
Aaron Myers 2abe5c818d Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234087 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 19:30:53 +00:00
Eli Collins 6861560098 MAPREDUCE-3692. yarn-resourcemanager out and log files can get big. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233605 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 22:23:53 +00:00
Aaron Myers 6177bf6c8f Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233105 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 23:02:17 +00:00
Aaron Myers 940eeb866c Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232184 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:57:28 +00:00
Vinod Kumar Vavilapalli 4a343c9d4a MAPREDUCE-3641. Making CapacityScheduler more conservative so as to assign only one off-switch container in a single scheduling iteration. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232182 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:56:14 +00:00
Mahadev Konar c81995e370 MAPREDUCE-3657. State machine visualize build fails. (Jason Lowe via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232167 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:22:21 +00:00
Vinod Kumar Vavilapalli 90f096d86c MAPREDUCE-3532. Modified NM to report correct http address when an ephemeral web port is configured. Contributed by Bhallamudi Venkata Siva Kamesh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231342 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 22:21:33 +00:00
Siddharth Seth 78ff0b720e MAPREDUCE-3596. Fix scheduler to handle cleaned up containers, which NMs may subsequently report as running. (Contributed by Vinod Kumar Vavilapalli)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231297 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 21:15:22 +00:00
Aaron Myers 58f2da1c85 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1231242 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 18:54:02 +00:00
Jitendra Nath Pandey f717c5785e MAPREDUCE-3664. Federation Documentation has incorrect configuration example. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230708 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 19:11:33 +00:00
Aaron Myers 8610a9231a Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230696 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 18:40:50 +00:00
Mahadev Konar 0086014703 MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230336 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 00:15:35 +00:00
Mahadev Konar 5f79f180f6 MAPREDUCE-3553. Add support for data returned when exceptions thrown from web service apis to be in either xml or in JSON. (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230330 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 23:59:23 +00:00
Aaron Myers ede7f21278 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230248 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 20:53:50 +00:00
Mahadev Konar bc4b1f48d3 MAPREDUCE-3380. Token infrastructure for running clients which are not kerberos authenticated. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229855 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 01:50:10 +00:00
Vinod Kumar Vavilapalli 7712e70090 MAPREDUCE-3251. Network ACLs can prevent some clients to talk to MR AM. Improved the earlier patch to not to JobHistoryServer repeatedly. Contributed by Anupam Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229787 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 23:07:54 +00:00
Aaron Myers ade897636d Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229279 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 18:01:55 +00:00
Arun Murthy 5ba6477099 MAPREDUCE-3624. Remove unnecessary dependency on JDK's tools.jar. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1228354 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 19:12:02 +00:00
Aaron Myers d680080da0 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228339 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 18:47:05 +00:00
Arun Murthy 2919ce8c8b MAPREDUCE-3617. Removed wrong default value for yarn.resourcemanager.principal and yarn.nodemanager.principal. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227808 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 20:11:09 +00:00
Arun Murthy 7440a8aa37 MAPREDUCE-3548. Added more unit tests for MR AM & JHS web-services. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227801 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 20:01:20 +00:00
Arun Murthy 4404f20671 MAPREDUCE-3326. Added detailed information about queue's to the CapacityScheduler web-ui. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227788 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:50:18 +00:00
Alejandro Abdelnur 6d45b9e31d HADOOP-7934. Normalize dependencies versions across all modules. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227787 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:46:42 +00:00
Aaron Myers 3187a3ae05 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227775 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:21:01 +00:00
Mahadev Konar e793ba8cba MAPREDUCE-3478. Cannot build against ZooKeeper 3.4.0. (Tom White via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227408 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 00:13:39 +00:00
Aaron Myers 4d768140b3 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225900 13f79535-47bb-0310-9956-ffa450edef68
2011-12-30 19:25:18 +00:00
Arun Murthy 4ab6ae543e MAPREDUCE-3608. Fixed compile issue with MAPREDUCE-3522. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225726 13f79535-47bb-0310-9956-ffa450edef68
2011-12-30 02:24:14 +00:00
Arun Murthy 743a5b78e3 MAPREDUCE-3522. Ensure queues inherit ACLs from parent if they aren't explicitly specified. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225618 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 19:06:34 +00:00
Aaron Myers f216303598 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225612 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 18:25:48 +00:00
Arun Murthy f025652fda MAPREDUCE-3547. Added a bunch of unit tests for the the RM/NM webservices. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225463 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 08:06:04 +00:00
Aaron Myers d619dee4ed Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225264 13f79535-47bb-0310-9956-ffa450edef68
2011-12-28 18:37:22 +00:00