Commit Graph

76 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli 29552eeb36 MAPREDUCE-2925. Fixed Yarn+MR client code to behave saner with completed jobs. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172587 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 12:26:14 +00:00
Vinod Kumar Vavilapalli 34d3936bcd MAPREDUCE-2965. Streamlined the methods hashCode(), equals(), compareTo() and toString() for all IDs. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172212 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 07:51:11 +00:00
Vinod Kumar Vavilapalli 61900651b1 MAPREDUCE-3006. Fixed MapReduce AM to exit only after properly writing out history file. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172206 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 07:16:18 +00:00
Mahadev Konar e1acb1222d MAPREDUCE-1788. o.a.h.mapreduce.Job shouldn't make a copy of the JobConf. (Arun Murthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172171 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 02:50:30 +00:00
Arun Murthy 2eab7a28c7 MAPREDUCE-2987. Fixed display of logged user on RM Web-UI. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171901 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 05:52:49 +00:00
Todd Lipcon ca333f17c1 MAPREDUCE-2836. Provide option to fail jobs when submitted to non-existent fair scheduler pools. Contributed by Ahmed Radwan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171832 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 22:22:34 +00:00
Vinod Kumar Vavilapalli 341a15a23d MAPREDUCE-2994. Fixed a bug in ApplicationID parsing that affects RM UI. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171485 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 10:08:52 +00:00
Mahadev Konar d9ba4670ed MAPREDUCE-2672. MR-279: JobHistory Server needs Analysis this job. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171297 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 22:21:00 +00:00
Vinod Kumar Vavilapalli cb48bc1c93 MAPREDUCE-3007. Fixed Yarn Mapreduce client to be able to connect to JobHistoryServer in secure mode. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171051 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 10:53:05 +00:00
Konstantin Shvachko 9704960e42 MAPREDUCE-2991. queueinfo.jsp fails if queue names contain special symbols. Contributed by Priyo Mustafi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170917 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 01:38:44 +00:00
Arun Murthy 5183e88109 MAPREDUCE-3005. Fix both FifoScheduler and CapacityScheduler to correctly enforce locality constraints.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170879 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 22:46:57 +00:00
Vinod Kumar Vavilapalli 4ba2acf336 MAPREDUCE-2966. Added ShutDown hooks for MRV2 processes so that they can gracefully exit. Contributed by Abhijit Suresh Shingate.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170746 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 17:57:52 +00:00
Vinod Kumar Vavilapalli 47e04d3124 MAPREDUCE-2949. Fixed NodeManager to shut-down correctly if a service startup fails. Contributed by Ravi Teja Ch N V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170689 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 15:35:42 +00:00
Mahadev Konar 88b82a0f66 MAPREDUCE-2899. Replace major parts of ApplicationSubmissionContext with a ContainerLaunchContext (Arun Murthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170459 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 07:26:37 +00:00
Mahadev Konar a3e8f6836b MAPREDUCE-2676. MR-279: JobHistory Job page needs reformatted. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170379 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 22:55:22 +00:00
Arun Murthy 88ff272cfd MAPREDUCE-2995. Fixed race condition in ContainerLauncher. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170281 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 18:15:14 +00:00
Arun Murthy 53f921418d MAPREDUCE-2995. Better handling of expired containers in MapReduce ApplicationMaster. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170279 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 18:12:02 +00:00
Arun Murthy 6165875dc6 MAPREDUCE-2896. Simplify all apis to in org.apache.hadoop.yarn.api.records.* to be get/set only. Added javadocs to all public records.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169980 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 00:05:51 +00:00
Arun Murthy 7fa0bf3558 MAPREDUCE-2874. Fix formatting of ApplicationId in web-ui. Contributed by Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169973 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 23:17:27 +00:00
Arun Murthy c8383a5f49 MAPREDUCE-2985. Fixed findbugs warnings in ResourceLocalizationService. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169955 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 21:53:51 +00:00
Konstantin Shvachko 1c01951264 MAPREDUCE-2669. Add new examples for Mean, Median, and Standard Deviation. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169874 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 19:13:41 +00:00
Vinod Kumar Vavilapalli fb65bfc661 MAPREDUCE-2979. Removed the needless ClientProtocolProvider configuration from the hadoop-mapreduce-client-core module. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169808 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 16:00:40 +00:00
Vinod Kumar Vavilapalli be32d25c54 MAPREDUCE-2675. Reformat JobHistory Server main page to be more useful. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169763 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 14:24:32 +00:00
Vinod Kumar Vavilapalli e14da3a72e MAPREDUCE-2978. Fixed test-patch to make Jenkins report findbugs warnings properly. Contributed by Tom White.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169696 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 11:22:38 +00:00
Arun Murthy 6b2f2efe4d MAPREDUCE-2749. Ensure NM registers with RM after starting all its services correctly. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169621 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 07:11:43 +00:00
Arun Murthy 817ead65b9 MAPREDUCE-2933. Change allocate call to return ContainerStatus for completed containers rather than Container.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169484 13f79535-47bb-0310-9956-ffa450edef68
2011-09-11 17:26:06 +00:00
Vinod Kumar Vavilapalli 8fb67650b1 MAPREDUCE-2691. Finish up the cleanup of distributed cache file resources and related tests. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167676 13f79535-47bb-0310-9956-ffa450edef68
2011-09-11 06:21:39 +00:00
Mahadev Konar b982e6205f MAPREDUCE-2971. ant build mapreduce fails protected access jc.displayJobList (jobs) (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167383 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 22:42:57 +00:00
Arun Murthy fbf0035ee6 MAPREDUCE-2975. Fixed YARNRunner to use YarnConfiguration rather than Configuration. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167331 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 19:01:08 +00:00
Aaron Myers 68cb2b01b6 HADOOP-7607 and MAPREDUCE-2934. Simplify the RPC proxy cleanup process. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167318 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 18:12:14 +00:00
Vinod Kumar Vavilapalli 1d84d983a2 MAPREDUCE-2954. Fixed a deadlock in NM caused due to wrong synchronization in protocol buffer records. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167061 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 09:47:15 +00:00
Tsz-wo Sze 85e17fd2df MAPREDUCE-2711. Update TestBlockPlacementPolicyRaid for the new namesystem and block management APIs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167001 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 04:48:35 +00:00
Arun Murthy 71e0515433 MAPREDUCE-2963. Fix hang in TestMRJobs. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166975 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 03:01:08 +00:00
Arun Murthy ca853445e9 MAPREDUCE-2953. Fix a race condition on submission which caused client to incorrectly assume application was gone by making submission synchronous for RMAppManager. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166968 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 02:19:24 +00:00
Arun Murthy a0ef2d7503 MAPREDUCE-2937. Ensure reason for application failure is displayed to the user. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166966 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 02:14:33 +00:00
Arun Murthy 035937bee8 MAPREDUCE-2690. Web-page for FifoScheduler. Contributed by Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166958 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 02:04:55 +00:00
Arun Murthy fafe8cd28e MAPREDUCE-2864. Normalize configuration variable names for YARN. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166955 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 01:44:58 +00:00
Arun Murthy b3c9c3c182 MAPREDUCE-2677. Fixed 404 for some links from HistoryServer. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166901 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 20:59:34 +00:00
Arun Murthy 1b294f206b MAPREDUCE-2844. Fixed display of nodes in UI. Contributed by Ravi Teja Ch N V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166855 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:48:10 +00:00
Arun Murthy 6b6ef7b8e3 MAPREDUCE-2947. Fixed race condition in AuxiliaryServices. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166849 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:40:27 +00:00
Mahadev Konar 8ac20f92f5 MAPREDUCE-2942. TestNMAuditLogger.testNMAuditLoggerWithIP failing (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166842 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:29:49 +00:00
Arun Murthy 1f46b991da MAPREDUCE-2908. Fix all findbugs warnings. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166838 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:26:20 +00:00
Amar Kamat ae5e8e0104 MAPREDUCE-2784. [Gridmix] Bug fixes in ExecutionSummarizer and ResourceUsageMatcher. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166636 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 11:29:55 +00:00
Mahadev Konar 1c15670d53 MAPREDUCE-2948. Hadoop streaming test failure, post MR-2767 (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166402 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 21:18:09 +00:00
Arun Murthy 0ecba04727 MAPREDUCE-2938. Log application submission failure in CapacityScheduler
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166006 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 05:54:25 +00:00
Arun Murthy cdfabf5ae2 MAPREDUCE-2655. Add audit logs to ResourceManager and NodeManager. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165949 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 01:24:21 +00:00
Arun Murthy d51078eb7e MAPREDUCE-2774. Add startup message to ResourceManager & NodeManager on startup. Contributed by Venu Gopala Rao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165933 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 23:40:49 +00:00
Arun Murthy 03c1015d6e MAPREDUCE-2800. Set final progress for tasks to ensure all task information is correctly logged to JobHistory. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165930 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 23:36:19 +00:00
Konstantin Shvachko 3a3f277017 MAPREDUCE-2767. CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165894 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 21:59:09 +00:00
Arun Murthy f560a1066f MAPREDUCE-2687. Fix NodeManager to use the right version of LocalDirAllocator.getLocalPathToWrite. Contributed by mahadev & acmurthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165890 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 21:49:46 +00:00