Commit Graph

160 Commits

Author SHA1 Message Date
Hemanth Yamijala 75103dc925 HADOOP-6227. Fix Configuration to allow final parameters to be set to null and prevent them from being overridden. Contributed by Amareshwari Sriramadasu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810097 13f79535-47bb-0310-9956-ffa450edef68
2009-09-01 15:24:56 +00:00
Devaraj Das 4c66882a69 HADOOP-6224. Adds methods to read strings safely, makes the Buffer class in DataOutputBuffer public, and introduces public constructors there. These changes are required for MAPREDUCE-318. Contributed by Jothi Padmanabhan and Arun Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@809491 13f79535-47bb-0310-9956-ffa450edef68
2009-08-31 07:56:39 +00:00
Sharad Agarwal aa10f303e3 HADOOP-6215. fix GenericOptionParser to deal with -D with '=' in the value. Contributed by Amar Kamat.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@808415 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 13:55:19 +00:00
Christopher Douglas 8621b830f8 HADOOP-6166. Further improve the performance of the pure-Java CRC32
implementation. Contributed by Tsz Wo (Nicholas), SZE


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807753 13f79535-47bb-0310-9956-ffa450edef68
2009-08-25 18:34:57 +00:00
Hemanth Yamijala 280ab0cf7d HADOOP-6184. Provide an API to dump Configuration in a JSON format. Contributed by V.V.Chaitanya Krishna.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807149 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 11:21:18 +00:00
Christopher Douglas 76a77aea78 HADOOP-6201. Change FileSystem::listStatus contract to throw
FileNotFoundException if the directory does not exist, rather than letting
this be implementation-specific. Contributed by Jakob Homan.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806745 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 22:50:04 +00:00
Devaraj Das 0a8e65c23b HADOOP-6103. Clones the classloader as part of Configuration clone. Contributed by Amareshwari Sriramadasu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806430 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 06:59:45 +00:00
Tsz-wo Sze 1f3337996e HADOOP-6173. Change src/native/packageNativeHadoop.sh to package all native library files. Contributed by Hong Tang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806368 13f79535-47bb-0310-9956-ffa450edef68
2009-08-20 21:28:09 +00:00
Hemanth Yamijala e5b7248682 MAPREDUCE-711. Removed Distributed Cache from Common, to move it under Map/Reduce. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804918 13f79535-47bb-0310-9956-ffa450edef68
2009-08-17 10:06:36 +00:00
Giridharan Kesavan 07b43463b8 HADOOP-6182. Fix ReleaseAudit warnings. Contributed by Giridharan Kesavan and Lee Tucker
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804842 13f79535-47bb-0310-9956-ffa450edef68
2009-08-17 03:53:27 +00:00
Tsz-wo Sze a7303bd279 Delete the empty file src/core/org/apache/hadoop/fs/LengthFileChecksum.java which was removed by HADOOP-3981.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804352 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 20:05:35 +00:00
Arun Murthy 7ffe5b7f87 Reverting HADOOP-6182 and HADOOP-6195
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804317 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 18:22:41 +00:00
Giridharan Kesavan 43f95b50f2 HADOOP-6195. Fix checkstyle xml version tag. Contributed by Lee Tucker
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804297 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 17:00:03 +00:00
Giridharan Kesavan 2e34ced206 HADOOP-6182. Fix releaseaudit warnings by adding AL Headers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804157 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 10:23:41 +00:00
Arun Murthy ec8208f5d3 HADOOP-6192. Fix Shell.getUlimitMemoryCommand to not rely on Map-Reduce specific configs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804115 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 08:16:10 +00:00
Tsz-wo Sze 38a84a6c98 HADOOP-6188. TestTrash uses java.io.File api but not hadoop FileSystem api. Contributed by Boris Shkolnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803296 13f79535-47bb-0310-9956-ffa450edef68
2009-08-11 21:03:50 +00:00
Hairong Kuang d70dd1a2df HADOOP-6177. FSInputChecker.getPos() would return position greater than the file size. Contributed by Hong Tang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803190 13f79535-47bb-0310-9956-ffa450edef68
2009-08-11 16:26:55 +00:00
Tsz-wo Sze 5fe6906f2a HADOOP-6176. Add a couple package private methods to AccessTokenHandler for testing. Contributed by Kan Zhang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802224 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 21:40:01 +00:00
Hairong Kuang 09d826ebed HADOOP-6180. NameNode slowed down when many files with same filename were moved to Trash. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802107 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 17:59:57 +00:00
Tsz-wo Sze 5f53fd8ead HADOOP-6124. Fix javac warning detection in test-patch.sh. Contributed by Giridharan Kesavan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800919 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 19:01:51 +00:00
Mahadev Konar 7be6fc4e5d HADOOP-6169. Removing deprecated method calls in TFile. (hong tang via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800199 13f79535-47bb-0310-9956-ffa450edef68
2009-08-03 05:06:59 +00:00
Raghu Angadi e4450e5487 HADOOP-6150. Users should be able to instantiate comparator using TFile
API. (Hong Tang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797274 13f79535-47bb-0310-9956-ffa450edef68
2009-07-24 00:11:20 +00:00
Raghu Angadi 53c127013c HADOOP-6132. RPC client create an extra connection because of incorrect
key for connection cache. (Kan Zhang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797248 13f79535-47bb-0310-9956-ffa450edef68
2009-07-23 22:28:26 +00:00
Doug Cutting 8296413d49 HADOOP-6120. Add support for Avro specific and reflect data. Contributed by sharad.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797197 13f79535-47bb-0310-9956-ffa450edef68
2009-07-23 19:21:21 +00:00
Christopher Douglas 3200b2ec58 HADOOP-6161. Add get/setEnum methods to Configuration.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@796052 13f79535-47bb-0310-9956-ffa450edef68
2009-07-20 22:58:21 +00:00
Giridharan Kesavan cd86632a70 HADOOP-5935. Fix the releaseaudit warning link with test-patch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795772 13f79535-47bb-0310-9956-ffa450edef68
2009-07-20 11:37:45 +00:00
Tsz-wo Sze 391112f6ce HADOOP-6138. Eliminate the depracate warnings introduced by H-5438. Contributed by He Yongqiang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795172 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 18:01:15 +00:00
Tsz-wo Sze 8bd2486b51 HADOOP-6148. Implement a fast, pure Java CRC32 calculator which outperforms java.util.zip.CRC32. Contributed by Todd Lipcon and Scott Carey
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794944 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 02:18:06 +00:00
Christopher Douglas fc1bf705e9 HADOOP-6142. Update documentation and use of harchives for relative paths added
in MAPREDUCE-739. Contributed by Mahadev Konar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794943 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 02:06:42 +00:00
Tsz-wo Sze 466f93c8b6 HADOOP-6145. Fix FsShell rm/rmr error messages when there is a FNFE. Contributed by Jakob Homan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793987 13f79535-47bb-0310-9956-ffa450edef68
2009-07-14 17:39:33 +00:00
Tsz-wo Sze d074c686b3 HADOOP-6139. Fix the FsShell help messages for rm and rmr. Contributed by Jakob Homan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793098 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 20:26:30 +00:00
Dhruba Borthakur c38c5a43ff HADOOP-6099. The RPC module can be configured to not send period pings.
The default behaviour remains unchanged. (dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792812 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 06:17:55 +00:00
Giridharan Kesavan 127254f4a5 HADOOP-6137. Fix project specific test-patch requirements
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792440 13f79535-47bb-0310-9956-ffa450edef68
2009-07-09 08:10:18 +00:00
Tsz-wo Sze 708f3fc781 HADOOP-5976. Add a new command, classpath, to the hadoop script. Contributed by Owen O'Malley and Gary Murry
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@791937 13f79535-47bb-0310-9956-ffa450edef68
2009-07-07 18:48:32 +00:00
Giridharan Kesavan aa471150ea Move eclipse-plugin from common to mapreduce
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790831 13f79535-47bb-0310-9956-ffa450edef68
2009-07-03 08:54:20 +00:00
Dhruba Borthakur cf3d3a0643 HADOOP-6114. Fix javadoc documentation for FileStatus.getLen.
(Dmitry Rzhevskiy via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790277 13f79535-47bb-0310-9956-ffa450edef68
2009-07-01 17:20:42 +00:00
Tsz-wo Sze b8d9ca281d HADOOP-6122. The great than operator in test-patch.sh should be "-gt" but not ">".
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790009 13f79535-47bb-0310-9956-ffa450edef68
2009-07-01 00:56:15 +00:00
Tsz-wo Sze a13237975d HADOOP-2366. Support trimmed strings in Configuration. Contributed by Michele Catasta
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789973 13f79535-47bb-0310-9956-ffa450edef68
2009-06-30 21:45:00 +00:00
Konstantin Shvachko 4824a54419 HADOOP-6080. Introduce -skipTrash option to rm and rmr. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789875 13f79535-47bb-0310-9956-ffa450edef68
2009-06-30 18:48:45 +00:00
Christopher Douglas e93ebeae51 HADOOP-6109. Change Text to grow its internal buffer exponentially, rather
than the max of the current length and the proposed length to improve
performance reading large values. Contributed by thushara wijeratna


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789242 13f79535-47bb-0310-9956-ffa450edef68
2009-06-29 07:16:56 +00:00
Thomas White efc6df7a11 HADOOP-5925. EC2 scripts should exit on error.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788699 13f79535-47bb-0310-9956-ffa450edef68
2009-06-26 13:40:07 +00:00
Hemanth Yamijala b089f4448d HADOOP-6106. Provides an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time. Contributed by Sreekanth Ramakrishnan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788600 13f79535-47bb-0310-9956-ffa450edef68
2009-06-26 06:18:04 +00:00
Christopher Douglas 8246aa28ff HADOOP-3315. Add a new, binary file foramt, TFile. Contributed by Hong Tang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787913 13f79535-47bb-0310-9956-ffa450edef68
2009-06-24 05:48:25 +00:00
Tsz-wo Sze 2c372c70cf HADOOP-5952. Change "-1 tests included" wording in test-patch.sh. Contributed by Gary Murry
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787541 13f79535-47bb-0310-9956-ffa450edef68
2009-06-23 04:45:15 +00:00
Owen O'Malley cfb9636781 HADOOP-4687. Pulling trunk docs to branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786720 13f79535-47bb-0310-9956-ffa450edef68
2009-06-19 23:39:51 +00:00
Owen O'Malley ff11be5426 HADOOP-4687 updating docs
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786719 13f79535-47bb-0310-9956-ffa450edef68
2009-06-19 23:39:09 +00:00
Owen O'Malley fb6308f280 HADOOP-4687. More merges from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786712 13f79535-47bb-0310-9956-ffa450edef68
2009-06-19 23:12:41 +00:00
Owen O'Malley b12d765467 HADOOP-4687. Merge -r 784663:785643 from trunk to branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@785794 13f79535-47bb-0310-9956-ffa450edef68
2009-06-17 20:55:51 +00:00
Owen O'Malley bcd64325a1 Merged src/core, src/test/core, src/contrib/eclipse-plugin, and
src/contrib/ec2 from trunk 776174:784663


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@784965 13f79535-47bb-0310-9956-ffa450edef68
2009-06-15 20:28:06 +00:00
Giridharan Kesavan 244380a885 Fix core test failrues
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@780977 13f79535-47bb-0310-9956-ffa450edef68
2009-06-02 09:11:13 +00:00
Owen O'Malley 5c7b7adacb HADOOP-4687. Fix some of the remaining javadoc warnings.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@780833 13f79535-47bb-0310-9956-ffa450edef68
2009-06-01 21:10:16 +00:00
Giridharan Kesavan bb957bd2cd Fix test-patch.sh script for eclipse classpath verification
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@780701 13f79535-47bb-0310-9956-ffa450edef68
2009-06-01 16:06:19 +00:00
Giridharan Kesavan 7e7fd2ce5b fixed test test-core and test-contrib targets
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@779613 13f79535-47bb-0310-9956-ffa450edef68
2009-05-28 14:55:35 +00:00
Giridharan Kesavan bd524bd960 move test and xml files
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@779196 13f79535-47bb-0310-9956-ffa450edef68
2009-05-27 14:48:04 +00:00
Giridharan Kesavan ac670cc47f Fixed basic hadoop core targets
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@778829 13f79535-47bb-0310-9956-ffa450edef68
2009-05-26 18:27:23 +00:00
Owen O'Malley 95a0db602b HADOOP-4687. move test dirs
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776186 13f79535-47bb-0310-9956-ffa450edef68
2009-05-19 04:56:52 +00:00
Owen O'Malley c967cef4d3 HADOOP-4687 move more src dirs
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776183 13f79535-47bb-0310-9956-ffa450edef68
2009-05-19 04:53:47 +00:00
Owen O'Malley cab0a4bf54 HADOOP-4687 split the contrib dirs
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776180 13f79535-47bb-0310-9956-ffa450edef68
2009-05-19 04:45:07 +00:00
Owen O'Malley abe7be9134 HADOOP-4687 Moving directories around
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776176 13f79535-47bb-0310-9956-ffa450edef68
2009-05-19 04:35:56 +00:00
Owen O'Malley 5128a9a453 HADOOP-4687 Moving src directories on branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776174 13f79535-47bb-0310-9956-ffa450edef68
2009-05-19 04:20:40 +00:00