Commit Graph

329 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli 27c9b8833b MAPREDUCE-3370. More changes accidentally missed from the previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200775 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 08:51:21 +00:00
Vinod Kumar Vavilapalli 9c17410c50 MAPREDUCE-3370. Fixed MiniMRYarnCluster and related tests to not use a hard-coded path for the mr-app jar. Contributed by Ahmed Radwan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200768 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 08:44:52 +00:00
Vinod Kumar Vavilapalli dbc82dbdfb MAPREDUCE-3379. Fixed LocalResourceTracker in NodeManager to remove deleted cache entries correctly. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200747 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 06:30:27 +00:00
Vinod Kumar Vavilapalli 200bb27557 MAPREDUCE-3392. Fixed Cluster's getDelegationToken's API to return null when there isn't a supported token. Contributed by John George.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200484 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 19:19:25 +00:00
Vinod Kumar Vavilapalli 15150cd997 MAPREDUCE-3280. Removed the unnecessary job user-name configuration in mapred-site.xml. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200441 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 17:28:16 +00:00
Vinod Kumar Vavilapalli 2df83e5b4d MAPREDUCE-3333. Fixed bugs in ContainerLauncher of MR AppMaster due to which per-container connections to NodeManager were lingering long enough to hit the ulimits on number of processes. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199751 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 13:41:19 +00:00
Vinod Kumar Vavilapalli 3853d112ea MAPREDUCE-3336. Replaced guice internal.Preconditions api usage with the public Preconditions API. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199714 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 12:40:41 +00:00
Amar Kamat cec9f82344 MAPREDUCE-2733. [Gridmix] Gridmix3 cpu emulation system tests. (Vinay Thota via amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199678 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 09:47:50 +00:00
Vinod Kumar Vavilapalli 80cc8e9486 MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199144 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 07:55:51 +00:00
Vinod Kumar Vavilapalli 9fe9f42c8f MAPREDUCE-3342. Fixed JobHistoryServer to also show the job's queue name. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199133 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 07:28:56 +00:00
Amar Kamat 6749d1395f [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199105 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 04:44:25 +00:00
Thomas White 00b5aa76f9 Update CHANGES.txt for commit 1198910.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198912 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 20:14:33 +00:00
Thomas White 9a6da7979e MAPREDUCE-3344. o.a.h.mapreduce.Reducer since 0.21 blindly casts to ReduceContext.ValueIterator. Contributed by Brock Noland.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198910 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 20:13:00 +00:00
Mahadev Konar 6733a1ca5e MAPREDUCE-3291. App fail to launch due to delegation token not found in cache (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198583 13f79535-47bb-0310-9956-ffa450edef68
2011-11-06 22:58:47 +00:00
Vinod Kumar Vavilapalli 0b5a4823a9 MAPREDUCE-3217. Reenabled and fixed bugs in the failing ant test TestAuditLogger. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197438 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 09:01:51 +00:00
Vinod Kumar Vavilapalli 08cb4cf334 MAPREDUCE-3219. Reenabled and fixed bugs in the failing test TestDelegationToken. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197415 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 07:48:26 +00:00
Vinod Kumar Vavilapalli dae055bb70 MAPREDUCE-3215. Reneabled and fixed bugs in the failing test TestNoJobSetupCleanup. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197101 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 13:19:29 +00:00
Vinod Kumar Vavilapalli aa297b188e MAPREDUCE-3221. Reneabled the previously ignored test in TestSubmitJob and fixed bugs in it. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197080 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 12:25:18 +00:00
Vinod Kumar Vavilapalli c27601fefe MAPREDUCE-3297. Moved log related components into yarn-common so that HistoryServer and clients can use them without depending on the yarn-server-nodemanager module. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196986 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 08:02:19 +00:00
Arun Murthy 0df4878033 MAPREDUCE-3337. Added missing license headers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196977 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 07:06:53 +00:00
Jakob Homan 201a18de0c MAPREDUCE-3139. SlivePartitioner generates negative partitions.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196776 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 19:38:31 +00:00
Arun Murthy 3ad6024a84 HADOOP-7789. Fixed site to include yarn-default.xml.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196412 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 00:50:59 +00:00
Arun Murthy 073210043d HADOOP-7789. Fixed site to include yarn-default.xml.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196411 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 00:50:41 +00:00
Mahadev Konar bb35bff29b MAPREDUCE-3332. contrib/raid compile breaks due to changes in hdfs/protocol/datatransfer/Sender#writeBlock related to checksum handling (Hitesh Shah via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196356 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 23:07:56 +00:00
Arun Murthy 1112a50ad3 HADOOP-7789. Improvements to site navigation.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195876 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:53:38 +00:00
Arun Murthy 4e42044b1c Preparing for release 0.23.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195872 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:46:22 +00:00
Arun Murthy a3a4ccfed7 Preparing for release 0.23.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195838 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 06:02:53 +00:00
Thomas White 8e04fa8b84 HADOOP-7782. Aggregate project javadocs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195817 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:47:10 +00:00
Mahadev Konar adf58e70a0 MAPREDUCE-3317. Rumen TraceBuilder is emiting null as hostname. (Ravi Gummadi via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195814 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:32:03 +00:00
Mahadev Konar 68dfbff8db MAPREDUCE-3316. Rebooted link is not working properly. (Bhallamudi Venkata Siva Kamesh via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195805 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:06:39 +00:00
Arun Murthy cfb6a9883d MAPREDUCE-3237. Move LocalJobRunner to hadoop-mapreduce-client-core. Contributed by Tom White.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195792 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 03:16:44 +00:00
Arun Murthy e5badc0c1a Fixing CHANGES.txt to reflect 0.23 content.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195766 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 02:09:51 +00:00
Arun Murthy d36f847b87 MAPREDUCE-3322. Added a better index.html and an brief overview of YARN architecture.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195764 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 02:00:58 +00:00
Mahadev Konar 68fa208b1c MAPREDUCE-3103. Implement Job ACLs for MRAppMaster. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195761 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:51:56 +00:00
Arun Murthy b451dd7aaa MAPREDUCE-3220. Fixed TestCombineOutputCollector. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195745 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:04:15 +00:00
Arun Murthy 5f7e991659 MAPREDUCE-3321. Disabled a few MR tests for 0.23. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195743 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 00:57:22 +00:00
Arun Murthy b3f90c7060 MAPREDUCE-3275. Added documentation for AM WebApp Proxy. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195579 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 17:33:29 +00:00
Arun Murthy 9db078212f MAPREDUCE-3035. Fixed MR JobHistory to ensure rack information is present. Contributed by chakravarthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195575 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 17:27:42 +00:00
Amar Kamat 7e056015ad MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195535 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 15:51:32 +00:00
Vinod Kumar Vavilapalli 21b1e1da49 MAPREDUCE-3262. Fixed Container's state-machine in NodeManager to handle a couple of events in failure states correctly. Contributed by Hitesh Shah and Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195416 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 11:29:23 +00:00
Vinod Kumar Vavilapalli a75c4cf4e4 MAPREDUCE-2696. Fixed NodeManager to cleanup logs in a thread when logs' aggregation is not enabled. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195383 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 09:55:29 +00:00
Vinod Kumar Vavilapalli 47a381e306 MAPREDUCE-3146. Added a MR specific command line to dump logs for a given TaskAttemptID. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195349 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 06:42:06 +00:00
Vinod Kumar Vavilapalli 5f9e67e226 MAPREDUCE-2766. Fixed NM to set secure permissions for files and directories in distributed-cache. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195340 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 05:51:33 +00:00
Arun Murthy 85fce9017c Adding executable svn prop on mock-container-executor.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195336 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 05:29:13 +00:00
Vinod Kumar Vavilapalli 273e092c93 MAPREDUCE-3313. Fixed initialization of ClusterMetrics which was failing TestResourceTrackerService sometimes. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195319 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 03:30:56 +00:00
Vinod Kumar Vavilapalli 1c8d64f38a MAPREDUCE-3274. Fixed a race condition in MRAppMaster that was causing a task-scheduling deadlock. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195145 13f79535-47bb-0310-9956-ffa450edef68
2011-10-30 11:29:41 +00:00
Arun Murthy 7f4dc27757 MAPREDUCE-3256. Added authorization checks for the protocol between NodeManager and ApplicationMaster. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1194850 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 09:35:36 +00:00
Thomas White cd77a1668f HADOOP-7763. Add top-level navigation to APT docs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190703 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 00:16:16 +00:00
Alejandro Abdelnur 1bcff6860c Adding missing CHANGES.txt entry for MAPREDUCE-3014
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190585 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 21:27:08 +00:00
Vinod Kumar Vavilapalli c1e333f32f MAPREDUCE-3306. Fixed a bug in NodeManager ApplicationImpl that was causing NodeManager to crash. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190523 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 19:45:57 +00:00