Commit Graph

19302 Commits

Author SHA1 Message Date
Tsz-wo Sze e34d2c075d HDFS-2330. In NNStorage and FSImagePreTransactionalStorageInspector, IOExceptions of stream closures can mask root exceptions. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172219 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 08:30:47 +00:00
Vinod Kumar Vavilapalli e56579b9da MAPREDUCE-2965. Fixed two FindBugs warnings in the previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172214 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 07:57:38 +00:00
Vinod Kumar Vavilapalli 34d3936bcd MAPREDUCE-2965. Streamlined the methods hashCode(), equals(), compareTo() and toString() for all IDs. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172212 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 07:51:11 +00:00
Vinod Kumar Vavilapalli 61900651b1 MAPREDUCE-3006. Fixed MapReduce AM to exit only after properly writing out history file. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172206 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 07:16:18 +00:00
Devaraj Das 7985d3904c HADOOP-7631. Fixes a config problem to do with running streaming jobs. Contributed by Eric Yang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172186 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 03:53:55 +00:00
Mahadev Konar e1acb1222d MAPREDUCE-1788. o.a.h.mapreduce.Job shouldn't make a copy of the JobConf. (Arun Murthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172171 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 02:50:30 +00:00
Tsz-wo Sze dafa8f7a77 HDFS-362. FSEditLog should not writes long and short as UTF8, and should not use ArrayWritable for writing non-array items. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171945 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 10:53:44 +00:00
Devaraj Das 94096ff6f5 HADOOP-7633. Adds log4j.properties to the hadoop-conf dir on deploy. Contributed by Eric Yang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171909 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 06:06:21 +00:00
Arun Murthy 2eab7a28c7 MAPREDUCE-2987. Fixed display of logged user on RM Web-UI. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171901 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 05:52:49 +00:00
Devaraj Das 9a11a3a0b3 HADOOP-7637. Fix to include FairScheduler configuration file in RPM. Contributed by Eric Yang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171894 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 05:07:46 +00:00
Todd Lipcon ca333f17c1 MAPREDUCE-2836. Provide option to fail jobs when submitted to non-existent fair scheduler pools. Contributed by Ahmed Radwan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171832 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 22:22:34 +00:00
Aaron Myers 70a180d0f5 Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1171808 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 21:35:45 +00:00
Todd Lipcon 0d99429982 HADOOP-7608. SnappyCodec check for Hadoop native lib is wrong. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171719 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 18:52:38 +00:00
Aaron Myers a89d4609b2 HDFS-2337. DFSClient shouldn't keep multiple RPC proxy references (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171711 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 18:38:32 +00:00
Tsz-wo Sze ff44372895 Revised the entry for HDFS-2318 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171615 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 15:05:25 +00:00
Tsz-wo Sze 78e3821b81 HDFS-2318. Provide authentication to webhdfs using SPNEGO and delegation tokens.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171611 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 15:02:30 +00:00
Vinod Kumar Vavilapalli 341a15a23d MAPREDUCE-2994. Fixed a bug in ApplicationID parsing that affects RM UI. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171485 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 10:08:52 +00:00
Tsz-wo Sze cde0e484e7 HDFS-2338. Add configuration option to enable/disable webhdfs. Contributed by jitendra
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171379 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 04:01:51 +00:00
Aaron Myers 6af0c27930 Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1171315 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 23:07:48 +00:00
Mahadev Konar d9ba4670ed MAPREDUCE-2672. MR-279: JobHistory Server needs Analysis this job. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171297 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 22:21:00 +00:00
Aaron Myers e66d697a66 HADOOP-7635. RetryInvocationHandler should release underlying resources on close (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171221 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 18:45:36 +00:00
Aaron Myers b9af522c2a HADOOP-7641. Add Apache License to template config files (Eric Yang via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171213 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 18:28:29 +00:00
Tsz-wo Sze 376a1a2511 HDFS-2333. Change DFSOutputStream back to package private, otherwise, there are two SC_START_IN_CTOR findbugs warnings.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171136 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 15:28:23 +00:00
Vinod Kumar Vavilapalli cb48bc1c93 MAPREDUCE-3007. Fixed Yarn Mapreduce client to be able to connect to JobHistoryServer in secure mode. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171051 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 10:53:05 +00:00
Tsz-wo Sze be2b0921fa HDFS-2331. Fix WebHdfsFileSystem compilation problems for a bug in JDK version < 1.6.0_26. Contributed by Abhijit Suresh Shingate
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170996 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 08:04:46 +00:00
Konstantin Shvachko 9704960e42 MAPREDUCE-2991. queueinfo.jsp fails if queue names contain special symbols. Contributed by Priyo Mustafi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170917 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 01:38:44 +00:00
Arun Murthy 5183e88109 MAPREDUCE-3005. Fix both FifoScheduler and CapacityScheduler to correctly enforce locality constraints.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170879 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 22:46:57 +00:00
Vinod Kumar Vavilapalli 4ba2acf336 MAPREDUCE-2966. Added ShutDown hooks for MRV2 processes so that they can gracefully exit. Contributed by Abhijit Suresh Shingate.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170746 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 17:57:52 +00:00
Vinod Kumar Vavilapalli 47e04d3124 MAPREDUCE-2949. Fixed NodeManager to shut-down correctly if a service startup fails. Contributed by Ravi Teja Ch N V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170689 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 15:35:42 +00:00
Mahadev Konar 88b82a0f66 MAPREDUCE-2899. Replace major parts of ApplicationSubmissionContext with a ContainerLaunchContext (Arun Murthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170459 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 07:26:37 +00:00
Todd Lipcon 29eadf1b8f HADOOP-7629. Allow immutable FsPermission objects to be used as IPC parameters. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170451 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 06:51:21 +00:00
Mahadev Konar a3e8f6836b MAPREDUCE-2676. MR-279: JobHistory Job page needs reformatted. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170379 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 22:55:22 +00:00
Aaron Myers f4b2b63807 Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1170378 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 22:49:27 +00:00
Arun Murthy 4d90df82a9 Merge -r 1170285:1170286 from branch-0.20-security to trunk to fix MAPREDUCE-2549.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170288 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 18:33:22 +00:00
Arun Murthy 88ff272cfd MAPREDUCE-2995. Fixed race condition in ContainerLauncher. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170281 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 18:15:14 +00:00
Arun Murthy 53f921418d MAPREDUCE-2995. Better handling of expired containers in MapReduce ApplicationMaster. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170279 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 18:12:02 +00:00
Thomas White e4dc2e1f56 HDFS-2323. start-dfs.sh script fails for tarball install
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170233 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 16:53:57 +00:00
Tsz-wo Sze 6c3b59505b HDFS-2317. Support read access to HDFS in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170085 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 08:34:27 +00:00
Devaraj Das b6d5d02fc0 HADOOP-7626. Bugfix for a config generator. Contributed by Eric Yang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170046 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 05:42:49 +00:00
Devaraj Das 468775a21d HADOOP-7599. Script improvements to setup a secure Hadoop cluster. Contributed by Eric Yang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169986 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 00:31:29 +00:00
Arun Murthy 6165875dc6 MAPREDUCE-2896. Simplify all apis to in org.apache.hadoop.yarn.api.records.* to be get/set only. Added javadocs to all public records.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169980 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 00:05:51 +00:00
Arun Murthy 7fa0bf3558 MAPREDUCE-2874. Fix formatting of ApplicationId in web-ui. Contributed by Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169973 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 23:17:27 +00:00
Arun Murthy c8383a5f49 MAPREDUCE-2985. Fixed findbugs warnings in ResourceLocalizationService. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169955 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 21:53:51 +00:00
Konstantin Shvachko 8332126c52 HADOOP-7568. SequenceFile should not print into stdout. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169925 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 21:04:51 +00:00
Konstantin Shvachko 1c01951264 MAPREDUCE-2669. Add new examples for Mean, Median, and Standard Deviation. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169874 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 19:13:41 +00:00
Vinod Kumar Vavilapalli fb65bfc661 MAPREDUCE-2979. Removed the needless ClientProtocolProvider configuration from the hadoop-mapreduce-client-core module. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169808 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 16:00:40 +00:00
Vinod Kumar Vavilapalli be32d25c54 MAPREDUCE-2675. Reformat JobHistory Server main page to be more useful. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169763 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 14:24:32 +00:00
Vinod Kumar Vavilapalli e14da3a72e MAPREDUCE-2978. Fixed test-patch to make Jenkins report findbugs warnings properly. Contributed by Tom White.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169696 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 11:22:38 +00:00
Arun Murthy 6b2f2efe4d MAPREDUCE-2749. Ensure NM registers with RM after starting all its services correctly. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169621 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 07:11:43 +00:00
Arun Murthy 817ead65b9 MAPREDUCE-2933. Change allocate call to return ContainerStatus for completed containers rather than Container.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169484 13f79535-47bb-0310-9956-ffa450edef68
2011-09-11 17:26:06 +00:00