Commit Graph

25855 Commits

Author SHA1 Message Date
Suresh Srinivas 3617ed0bad HADOOP-6246. Add backward compatibility support to use deprecated decimal umask from old configuration. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814080 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 23:28:08 +00:00
Christopher Douglas c9cc61e853 HADOOP-6196. Fix a bug in SequenceFile.Reader where syncing within the header
would cause the reader to read the sync marker as a record. Contributed by Jay Booth


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813698 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 07:38:01 +00:00
Suresh Srinivas ae6721a85a HADOOP-6252. Provide a method to determine if a deprecated key is set in config file. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813639 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 00:14:22 +00:00
Christopher Douglas 86724941c5 HADOOP-4012. Provide splitting support for bzip2 compressed files. Contributed by Abdul Qadeer
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813581 13f79535-47bb-0310-9956-ffa450edef68
2009-09-10 20:51:48 +00:00
Tsz-wo Sze efb3e17bed HADOOP-6181. Fix .eclipse.templates/.classpath for avro and jets3t jar files. Contributed by Carlos Valiente
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813179 13f79535-47bb-0310-9956-ffa450edef68
2009-09-10 00:11:52 +00:00
Suresh Srinivas d9e6a9b15f HADOOP-5073. Add annotation mechanism for interface classification. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812740 13f79535-47bb-0310-9956-ffa450edef68
2009-09-09 00:43:47 +00:00
Suresh Srinivas cdbb724edb HADOOP-6234. Add new option dfs.umaskmode to set umask in configuration to use octal or symbolic instead of decimal. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812652 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 19:08:08 +00:00
Suresh Srinivas 3f384b42d2 HADOOP-6235. Adds new method to FileSystem for clients to get server defaults. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812597 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 17:54:16 +00:00
Thomas White 174b3e8a74 HADOOP-6009. S3N listStatus incorrectly returns null instead of empty array when called on empty root. Contributed by Ian Nowland.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812479 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 12:18:06 +00:00
Hemanth Yamijala 4a4dd27571 HADOOP-6243. Fix a NullPointerException in processing deprecated keys. Contributed by Sreekanth Ramakrishnan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812455 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 10:56:15 +00:00
Suresh Srinivas d09ade4d0b HADOOP-6203. FsShell rm/rmr error message indicates exceeding Trash quota and suggests using -skpTrash, when moving to trash fails. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812317 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 01:41:17 +00:00
Christopher Douglas f95ec3f5bf HADOOP-6133. Add a caching layer to Configuration::getClassByName to
alleviate a performance regression introduced in a compatibility layer.
Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812285 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 21:54:45 +00:00
Thomas White 9b0b37e410 HADOOP-6229. Attempt to make a directory under an existing file on LocalFileSystem should throw an Exception. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812127 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 13:25:48 +00:00
Hemanth Yamijala e24071be0a HADOOP-6105. Adds support for automatically handling deprecation of configuration keys. Contributed by V.V.Chaitanya Krishna.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812078 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 11:04:17 +00:00
Hemanth Yamijala e324c20692 HADOOP-6230. Moved process tree and memory calculator related classes from Common to Map/Reduce. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812031 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 08:16:09 +00:00
Thomas White 2aee3eda33 HADOOP-6231. Allow caching of filesystem instances to be disabled on a per-instance basis.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@811572 13f79535-47bb-0310-9956-ffa450edef68
2009-09-04 23:38:00 +00:00
Thomas White d6428581ff HADOOP-6165. Add metadata to Serializations.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810756 13f79535-47bb-0310-9956-ffa450edef68
2009-09-03 01:36:33 +00:00
Michael Stack e5fef21b18 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1 -- reversing this patch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810714 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 22:19:42 +00:00
Michael Stack 412efb84f2 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810710 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 22:02:04 +00:00
Michael Stack 51d1c6ffa7 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810709 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 22:01:34 +00:00
Devaraj Das a3c52b93ea HADOOP-6226. Moves BoundedByteArrayOutputStream from the tfile package to the io package and makes it available to other users (MAPREDUCE-318). Contributed by Jothi Padmanabhan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810451 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 11:07:27 +00:00
Christopher Douglas 9ea11c5fb3 HADOOP-6224. Add a method to WritableUtils supported a bounded read of an
encoded String. Contributed by Jothi Padmanabhan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810384 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 07:07:21 +00:00
Christopher Douglas faf9fe98ae HADOOP-6199. Move io.map.skip.index property to core-default from mapred.
Contributed by Amareshwari Sriramadasu


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810329 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 01:26:40 +00:00
Christopher Douglas 6145503acf Revert HADOOP-6224
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810325 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 01:00:34 +00:00
Hemanth Yamijala 75103dc925 HADOOP-6227. Fix Configuration to allow final parameters to be set to null and prevent them from being overridden. Contributed by Amareshwari Sriramadasu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810097 13f79535-47bb-0310-9956-ffa450edef68
2009-09-01 15:24:56 +00:00
Devaraj Das 4c66882a69 HADOOP-6224. Adds methods to read strings safely, makes the Buffer class in DataOutputBuffer public, and introduces public constructors there. These changes are required for MAPREDUCE-318. Contributed by Jothi Padmanabhan and Arun Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@809491 13f79535-47bb-0310-9956-ffa450edef68
2009-08-31 07:56:39 +00:00
Sharad Agarwal aa10f303e3 HADOOP-6215. fix GenericOptionParser to deal with -D with '=' in the value. Contributed by Amar Kamat.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@808415 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 13:55:19 +00:00
Christopher Douglas 8621b830f8 HADOOP-6166. Further improve the performance of the pure-Java CRC32
implementation. Contributed by Tsz Wo (Nicholas), SZE


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807753 13f79535-47bb-0310-9956-ffa450edef68
2009-08-25 18:34:57 +00:00
Tsz-wo Sze a72edd2b10 HADOOP-6152. Fix classpath variables in bin/hadoop-config.sh and some other scripts. Contributed by Aaron Kimball
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807404 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 22:06:54 +00:00
Hemanth Yamijala 280ab0cf7d HADOOP-6184. Provide an API to dump Configuration in a JSON format. Contributed by V.V.Chaitanya Krishna.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807149 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 11:21:18 +00:00
Christopher Douglas 76a77aea78 HADOOP-6201. Change FileSystem::listStatus contract to throw
FileNotFoundException if the directory does not exist, rather than letting
this be implementation-specific. Contributed by Jakob Homan.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806745 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 22:50:04 +00:00
Devaraj Das 0a8e65c23b HADOOP-6103. Clones the classloader as part of Configuration clone. Contributed by Amareshwari Sriramadasu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806430 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 06:59:45 +00:00
Tsz-wo Sze 1f3337996e HADOOP-6173. Change src/native/packageNativeHadoop.sh to package all native library files. Contributed by Hong Tang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806368 13f79535-47bb-0310-9956-ffa450edef68
2009-08-20 21:28:09 +00:00
Hemanth Yamijala e5b7248682 MAPREDUCE-711. Removed Distributed Cache from Common, to move it under Map/Reduce. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804918 13f79535-47bb-0310-9956-ffa450edef68
2009-08-17 10:06:36 +00:00
Giridharan Kesavan 07b43463b8 HADOOP-6182. Fix ReleaseAudit warnings. Contributed by Giridharan Kesavan and Lee Tucker
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804842 13f79535-47bb-0310-9956-ffa450edef68
2009-08-17 03:53:27 +00:00
Tsz-wo Sze a7303bd279 Delete the empty file src/core/org/apache/hadoop/fs/LengthFileChecksum.java which was removed by HADOOP-3981.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804352 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 20:05:35 +00:00
Arun Murthy 7ffe5b7f87 Reverting HADOOP-6182 and HADOOP-6195
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804317 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 18:22:41 +00:00
Giridharan Kesavan 43f95b50f2 HADOOP-6195. Fix checkstyle xml version tag. Contributed by Lee Tucker
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804297 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 17:00:03 +00:00
Giridharan Kesavan 2e34ced206 HADOOP-6182. Fix releaseaudit warnings by adding AL Headers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804157 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 10:23:41 +00:00
Arun Murthy ec8208f5d3 HADOOP-6192. Fix Shell.getUlimitMemoryCommand to not rely on Map-Reduce specific configs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804115 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 08:16:10 +00:00
Tsz-wo Sze 38a84a6c98 HADOOP-6188. TestTrash uses java.io.File api but not hadoop FileSystem api. Contributed by Boris Shkolnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803296 13f79535-47bb-0310-9956-ffa450edef68
2009-08-11 21:03:50 +00:00
Hairong Kuang d70dd1a2df HADOOP-6177. FSInputChecker.getPos() would return position greater than the file size. Contributed by Hong Tang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803190 13f79535-47bb-0310-9956-ffa450edef68
2009-08-11 16:26:55 +00:00
Tsz-wo Sze 5fe6906f2a HADOOP-6176. Add a couple package private methods to AccessTokenHandler for testing. Contributed by Kan Zhang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802224 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 21:40:01 +00:00
Hairong Kuang 09d826ebed HADOOP-6180. NameNode slowed down when many files with same filename were moved to Trash. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802107 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 17:59:57 +00:00
Tsz-wo Sze 5f53fd8ead HADOOP-6124. Fix javac warning detection in test-patch.sh. Contributed by Giridharan Kesavan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800919 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 19:01:51 +00:00
Thomas White ada9e3d79e JDiff output for release 0.19.2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800338 13f79535-47bb-0310-9956-ffa450edef68
2009-08-03 12:38:40 +00:00
Mahadev Konar 7be6fc4e5d HADOOP-6169. Removing deprecated method calls in TFile. (hong tang via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800199 13f79535-47bb-0310-9956-ffa450edef68
2009-08-03 05:06:59 +00:00
Tsz-wo Sze e5ea0ce4a6 HADOOP-6172. Fix jar file names in hadoop-config.sh and include ${build.src} as a part of the source list in build.xml. Contributed by Hong Tang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@799751 13f79535-47bb-0310-9956-ffa450edef68
2009-07-31 21:37:23 +00:00
Tsz-wo Sze 638a211067 HADOOP-6123. Add missing classpaths in hadoop-config.sh. Contributed by Sharad Agarwal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@798247 13f79535-47bb-0310-9956-ffa450edef68
2009-07-27 18:34:57 +00:00
Giridharan Kesavan 6c12fd3335 HADOOP-6160. Fix ant releaseaudit target to run on specific directories. (Contributed by Giridharan Kesavan)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@798093 13f79535-47bb-0310-9956-ffa450edef68
2009-07-27 10:09:38 +00:00