Commit Graph

245 Commits

Author SHA1 Message Date
Thomas White 368b6cc85b HADOOP-6254. Slow reads cause s3n to fail with SocketTimeoutException. Contributed by Andrew Hitchcock.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888697 13f79535-47bb-0310-9956-ffa450edef68
2009-12-09 04:17:02 +00:00
Konstantin Boudnik 929e91a08c HADOOP-6386. NameNode's HttpServer can't instantiate InetSocketAddress: IllegalArgumentException is thrown. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888565 13f79535-47bb-0310-9956-ffa450edef68
2009-12-08 20:50:47 +00:00
Jakob Homan 934deda190 HADOOP-6396. Fix unhelpful exception message when unable to parse umask (jghoman)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887472 13f79535-47bb-0310-9956-ffa450edef68
2009-12-05 00:46:08 +00:00
Konstantin Boudnik 3549d30d7e HADOOP-6411. Remove deprecated file src/test/hadoop-site.xml. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887047 13f79535-47bb-0310-9956-ffa450edef68
2009-12-04 03:18:27 +00:00
Thomas White 8d6c5c41f2 HADOOP-6400. Log errors getting Unix UGI. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886645 13f79535-47bb-0310-9956-ffa450edef68
2009-12-03 01:14:15 +00:00
Konstantin Boudnik ef643fd06b HADOOP-6405. Update Eclipse configuration to match changes to Ivy configuration. Contributed by Edwin Chan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886348 13f79535-47bb-0310-9956-ffa450edef68
2009-12-03 00:44:00 +00:00
Tsz-wo Sze 98beeca09d HADOOP-6307. Add a new SequenceFile.Reader constructor in order to support reading on un-closed file.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886003 13f79535-47bb-0310-9956-ffa450edef68
2009-12-01 23:25:56 +00:00
Thomas White ff6c0ef547 HADOOP-6108. Add support for EBS storage on EC2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885888 13f79535-47bb-0310-9956-ffa450edef68
2009-12-01 19:33:10 +00:00
Konstantin Boudnik 36700348c1 HADOOP-6398. Build is broken after HADOOP-6395 patch has been applied. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885534 13f79535-47bb-0310-9956-ffa450edef68
2009-11-30 18:52:34 +00:00
Owen O'Malley fc880f9794 HADOOP-6395. Upgrade some libraries to be consistent across common, hdfs,
and mapreduce. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@884428 13f79535-47bb-0310-9956-ffa450edef68
2009-11-26 07:33:38 +00:00
Christopher Douglas f6990e06b4 HADOOP-6375. Sync documentation for FsShell du with its implementation.
Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@883206 13f79535-47bb-0310-9956-ffa450edef68
2009-11-23 00:59:29 +00:00
Christopher Douglas 09ec9c4ffc HADOOP-6269. Fix threading issue with defaultResource in Configuration.
Contributed by Sreekanth Ramakrishnan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@882831 13f79535-47bb-0310-9956-ffa450edef68
2009-11-21 04:22:02 +00:00
Devaraj Das bd92322d22 HADOOP-6367. Removes Access Token implementation from common. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@881509 13f79535-47bb-0310-9956-ffa450edef68
2009-11-17 20:59:46 +00:00
Tsz-wo Sze cdcb8514a0 HADOOP-6314. Fix "fs -help" for the "-count" commond. Contributed by Ravi Phulari
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@836019 13f79535-47bb-0310-9956-ffa450edef68
2009-11-13 22:10:01 +00:00
Konstantin Boudnik 2eba5972ed HADOOP-6366. Reduce ivy console output to ovservable level. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@835967 13f79535-47bb-0310-9956-ffa450edef68
2009-11-13 19:44:14 +00:00
Devaraj Das ad88440651 HADOOP-6337. Updates FilterInitializer class to be more visible, and the init of the class is made to take a Configuration argument. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@833553 13f79535-47bb-0310-9956-ffa450edef68
2009-11-06 20:54:40 +00:00
Giridharan Kesavan af59233ce1 HADOOP-6341. Fix test-patch.sh for checkTests function. ( gkesavan )
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832590 13f79535-47bb-0310-9956-ffa450edef68
2009-11-03 22:53:08 +00:00
Tsz-wo Sze f5f95fe43a HADOOP-6343. Log unexpected throwable object caught in RPC. Contributed by Jitendra Nath Pandey
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832249 13f79535-47bb-0310-9956-ffa450edef68
2009-11-03 01:30:11 +00:00
Konstantin Boudnik 408117957e HADOOP-6347. run-test-core-fault-inject runs a test case twice if -Dtestcase is set. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832157 13f79535-47bb-0310-9956-ffa450edef68
2009-11-02 22:26:56 +00:00
Suresh Srinivas 382af3f627 HADOOP-6344. Fix rm and rmr immediately delete files rather than sending to trash, if a user is over-quota. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831478 13f79535-47bb-0310-9956-ffa450edef68
2009-10-30 22:39:01 +00:00
Suresh Srinivas 3f371a0a64 Hadoop-6223. Add new file system interface AbstractFileSystem with implementation of some file systems that delegate to old FileSystem. Contributed by Sanjay Radia.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831475 13f79535-47bb-0310-9956-ffa450edef68
2009-10-30 22:24:22 +00:00
Suresh Srinivas b5c31f4ee6 HADOOP-6313. Implement Syncable interface in FSDataOutputStream to expose flush APIs to application users. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831416 13f79535-47bb-0310-9956-ffa450edef68
2009-10-30 18:33:00 +00:00
Tsz-wo Sze a5427fc7eb HADOOP-6334. Fix GenericOptionsParser and Path to have a better URI support. Contributed by Amareshwari Sriramadasu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831412 13f79535-47bb-0310-9956-ffa450edef68
2009-10-30 18:21:26 +00:00
Owen O'Malley f0f3fdbd3d HADOOP-5107. Use Maven ant tasks to publish the subproject jars.
(Giridharan Kesavan via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831032 13f79535-47bb-0310-9956-ffa450edef68
2009-10-29 17:08:42 +00:00
Doug Cutting f9dee28085 HADOOP-6318. Move CHANGES.txt message to 0.21 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829289 13f79535-47bb-0310-9956-ffa450edef68
2009-10-24 00:17:24 +00:00
Doug Cutting a13a0f3fba HADOOP-6318. Upgrade to Avro 1.2.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829279 13f79535-47bb-0310-9956-ffa450edef68
2009-10-23 23:36:29 +00:00
Konstantin Boudnik d7a7f02c3e HADOOP-6326. Hundson runs should check for AspectJ warnings and report failure if any is present. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829269 13f79535-47bb-0310-9956-ffa450edef68
2009-10-23 22:33:57 +00:00
Tsz-wo Sze 9b0a0745d8 HADOOP-6329. Add build-fi directory to the ignore lists.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829165 13f79535-47bb-0310-9956-ffa450edef68
2009-10-23 18:26:01 +00:00
Tsz-wo Sze 4f4c74f76e HADOOP-6327. FileContext tests should not use /tmp and should clean up files. Contributed by Sanjay Radia
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@828886 13f79535-47bb-0310-9956-ffa450edef68
2009-10-22 22:46:39 +00:00
Devaraj Das 19e8d6ad67 HADOOP-6218. Moving the commit comment to 0.20.2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@828181 13f79535-47bb-0310-9956-ffa450edef68
2009-10-21 20:11:21 +00:00
Christopher Douglas 22bb3c6b77 Remove entries moved to 0.20.2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827860 13f79535-47bb-0310-9956-ffa450edef68
2009-10-21 01:10:08 +00:00
Christopher Douglas 449ac4ab87 HADOOP-6292. Update native libraries guide. Contributed by Corinne Chandel
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827855 13f79535-47bb-0310-9956-ffa450edef68
2009-10-21 00:32:20 +00:00
Christopher Douglas 7313955d04 HADOOP-6097. Fix Path conversion in makeQualified and reset LineReader byte
count at the start of each block in Hadoop archives. Contributed by Ben Slusky,
Tom White, and Mahadev Konar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827837 13f79535-47bb-0310-9956-ffa450edef68
2009-10-20 23:39:49 +00:00
Christopher Douglas 1ecee2e062 HADOOP-6312. Remove unnecessary debug logging in Configuration constructor. Contributed by Aaron Kimball
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826141 13f79535-47bb-0310-9956-ffa450edef68
2009-10-17 00:22:39 +00:00
Christopher Douglas c5bce7be47 HADOOP-6293. Fix FsShell -text to work on filesystems other than the default.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826120 13f79535-47bb-0310-9956-ffa450edef68
2009-10-16 22:41:54 +00:00
Konstantin Boudnik 3e9ba35841 HADOOP-6204. Implementing aspects development and fault injeciton framework for Hadoop. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824942 13f79535-47bb-0310-9956-ffa450edef68
2009-10-13 21:54:48 +00:00
Tsz-wo Sze 512a39264f HADOOP-6309. Change build.xml to run tests with java asserts. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824899 13f79535-47bb-0310-9956-ffa450edef68
2009-10-13 19:59:17 +00:00
Devaraj Das fed32afd17 HADOOP-6218. Adds a feature where TFile can be split by Record Sequeunce number. Contributed by Hong Tang and Raghu Angadi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824516 13f79535-47bb-0310-9956-ffa450edef68
2009-10-12 22:07:17 +00:00
Konstantin Boudnik d3c314e450 HADOOP-6305. Unify build property names to facilitate cross-projects modifications. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823756 13f79535-47bb-0310-9956-ffa450edef68
2009-10-10 01:10:41 +00:00
Konstantin Boudnik 780efea7ae Eclipse .classpath template has outdated jar files and is missing some new
ones. Contributed by Konstantin Boudnik


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823355 13f79535-47bb-0310-9956-ffa450edef68
2009-10-08 23:08:59 +00:00
Christopher Douglas b903b25072 HADOOP-6279. Add Runtime::maxMemory to JVM metrics. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823271 13f79535-47bb-0310-9956-ffa450edef68
2009-10-08 18:54:04 +00:00
Tsz-wo Sze 710d517768 HADOOP-6283. Improve the exception messages thrown by FileUtil$HardLink.getLinkCount(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823263 13f79535-47bb-0310-9956-ffa450edef68
2009-10-08 18:37:37 +00:00
Suresh Srinivas 64f537da0a HADOOP-6286. Fix bugs in related to URI handling in glob methods in FileContext. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@822805 13f79535-47bb-0310-9956-ffa450edef68
2009-10-07 17:07:37 +00:00
Tsz-wo Sze 59ab2c5d31 HADOOP-6284. Add a new parameter, HADOOP_JAVA_PLATFORM_OPTS, to hadoop-config.sh so that it allows setting java command options for JAVA_PLATFORM. Contributed by Koji Noguchi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@820094 13f79535-47bb-0310-9956-ffa450edef68
2009-09-29 21:26:06 +00:00
Owen O'Malley 2031231edb HADOOP-6285. Fix the result type of the getParameterMap method in the
HttpServer.QuotingInputFilter. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@819670 13f79535-47bb-0310-9956-ffa450edef68
2009-09-28 19:03:45 +00:00
Owen O'Malley 9de98c42cb HADOOP-6281. Avoid null pointer exceptions when the jsps don't have
paramaters (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@818543 13f79535-47bb-0310-9956-ffa450edef68
2009-09-24 16:47:59 +00:00
Suresh Srinivas 0243cf3672 HADOOP-6261. Add URI based tests for FileContext. Contributed by Ravi Pulari.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817823 13f79535-47bb-0310-9956-ffa450edef68
2009-09-22 20:26:43 +00:00
Suresh Srinivas 373bf85f56 HADOOP-6274. Fix TestLocalFSFileContextMainOperations test failure. Contributed by Gary Murry.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817496 13f79535-47bb-0310-9956-ffa450edef68
2009-09-22 04:12:45 +00:00
Owen O'Malley 277dd0e2a3 Fix up formatting of header after branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817416 13f79535-47bb-0310-9956-ffa450edef68
2009-09-21 21:36:13 +00:00
Owen O'Malley 4342710434 Branching for 0.21
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816847 13f79535-47bb-0310-9956-ffa450edef68
2009-09-19 01:24:39 +00:00
Suresh Srinivas 7cc6a8e8ce HADOOP-6260. Add additional unit tests for FileContext util methods. Contributed by Gary Murray.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816841 13f79535-47bb-0310-9956-ffa450edef68
2009-09-19 01:02:35 +00:00
Suresh Srinivas 6ef2552953 HADOOP-6233. Rename configuration keys towards API standardization and backward compatibility. Contributed by Jithendra Pandey.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816830 13f79535-47bb-0310-9956-ffa450edef68
2009-09-19 00:26:01 +00:00
Suresh Srinivas fa48d9ea17 HADOOP-6271. Add recursive and non recursive create and mkdir to FileContext. Contributed by Sanjay Radia.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816818 13f79535-47bb-0310-9956-ffa450edef68
2009-09-19 00:03:04 +00:00
Suresh Srinivas 1695ecd1a3 HADOOP-6240. Add new FileContext rename operation that posix compliant that allows overwriting existing destination. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816794 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 21:52:59 +00:00
Doug Cutting c722a45f47 HADOOP-6267. Permit building contrib modules located in external source trees. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816752 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 19:22:10 +00:00
Tsz-wo Sze 758f8a5abe HADOOP-6270. Support deleteOnExit in FileContext. Contributed by Suresh Srinivas
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816751 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 19:13:29 +00:00
Doug Cutting ea50f15407 HADOOP-6170. Add facility to tunnel Avro RPCs through Hadoop RPCs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816727 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 17:47:08 +00:00
Owen O'Malley 366b1b1dd6 HADOOP-6151. Added a input filter to all of the http servlets that quotes
html characters in the parameters, to prevent cross site scripting 
attacks. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816703 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 16:31:34 +00:00
Christopher Douglas 446309b039 HADOOP-6268. Add ivy jar to .gitignore. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816532 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 08:31:02 +00:00
Owen O'Malley bec1f274cc HADOOP-6217. Update documentation for project split. (Corinne Chandel via
omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816409 13f79535-47bb-0310-9956-ffa450edef68
2009-09-17 23:24:38 +00:00
Suresh Srinivas 0294c49df6 HADOOP-4952. Add new improved file system interface FileContext for the application writer. Contributed by Sanjay Radia.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816398 13f79535-47bb-0310-9956-ffa450edef68
2009-09-17 22:27:15 +00:00
Thomas White 7ee09e0939 HADOOP-6257. Two TestFileSystem classes are confusing hadoop-hdfs-hdfwithmr. Contributed by Philip Zeyliger.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815809 13f79535-47bb-0310-9956-ffa450edef68
2009-09-16 14:41:08 +00:00
Tsz-wo Sze 9164c6319e HADOOP-6216. Support comments in host files. Contributed by Ravi Phulari and Dmytro Molkov
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815524 13f79535-47bb-0310-9956-ffa450edef68
2009-09-15 22:18:21 +00:00
Hemanth Yamijala 78cff65f33 HADOOP-6250. Modify test-patch to delete copied XML files before running patch build. Contributed by Rahul Kumar Singh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815317 13f79535-47bb-0310-9956-ffa450edef68
2009-09-15 13:17:07 +00:00
Christopher Douglas 254afbfe96 HADOOP-5879. Read compression level and strategy from Configuration for
gzip compression. Contributed by He Yongqiang


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814455 13f79535-47bb-0310-9956-ffa450edef68
2009-09-14 00:45:01 +00:00
Suresh Srinivas 3617ed0bad HADOOP-6246. Add backward compatibility support to use deprecated decimal umask from old configuration. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814080 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 23:28:08 +00:00
Christopher Douglas c9cc61e853 HADOOP-6196. Fix a bug in SequenceFile.Reader where syncing within the header
would cause the reader to read the sync marker as a record. Contributed by Jay Booth


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813698 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 07:38:01 +00:00
Suresh Srinivas ae6721a85a HADOOP-6252. Provide a method to determine if a deprecated key is set in config file. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813639 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 00:14:22 +00:00
Christopher Douglas 86724941c5 HADOOP-4012. Provide splitting support for bzip2 compressed files. Contributed by Abdul Qadeer
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813581 13f79535-47bb-0310-9956-ffa450edef68
2009-09-10 20:51:48 +00:00
Tsz-wo Sze efb3e17bed HADOOP-6181. Fix .eclipse.templates/.classpath for avro and jets3t jar files. Contributed by Carlos Valiente
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813179 13f79535-47bb-0310-9956-ffa450edef68
2009-09-10 00:11:52 +00:00
Suresh Srinivas d9e6a9b15f HADOOP-5073. Add annotation mechanism for interface classification. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812740 13f79535-47bb-0310-9956-ffa450edef68
2009-09-09 00:43:47 +00:00
Suresh Srinivas cdbb724edb HADOOP-6234. Add new option dfs.umaskmode to set umask in configuration to use octal or symbolic instead of decimal. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812652 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 19:08:08 +00:00
Suresh Srinivas 3f384b42d2 HADOOP-6235. Adds new method to FileSystem for clients to get server defaults. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812597 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 17:54:16 +00:00
Thomas White 174b3e8a74 HADOOP-6009. S3N listStatus incorrectly returns null instead of empty array when called on empty root. Contributed by Ian Nowland.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812479 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 12:18:06 +00:00
Hemanth Yamijala 4a4dd27571 HADOOP-6243. Fix a NullPointerException in processing deprecated keys. Contributed by Sreekanth Ramakrishnan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812455 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 10:56:15 +00:00
Suresh Srinivas d09ade4d0b HADOOP-6203. FsShell rm/rmr error message indicates exceeding Trash quota and suggests using -skpTrash, when moving to trash fails. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812317 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 01:41:17 +00:00
Christopher Douglas f95ec3f5bf HADOOP-6133. Add a caching layer to Configuration::getClassByName to
alleviate a performance regression introduced in a compatibility layer.
Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812285 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 21:54:45 +00:00
Thomas White 9b0b37e410 HADOOP-6229. Attempt to make a directory under an existing file on LocalFileSystem should throw an Exception. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812127 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 13:25:48 +00:00
Hemanth Yamijala e24071be0a HADOOP-6105. Adds support for automatically handling deprecation of configuration keys. Contributed by V.V.Chaitanya Krishna.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812078 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 11:04:17 +00:00
Hemanth Yamijala e324c20692 HADOOP-6230. Moved process tree and memory calculator related classes from Common to Map/Reduce. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812031 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 08:16:09 +00:00
Thomas White 2aee3eda33 HADOOP-6231. Allow caching of filesystem instances to be disabled on a per-instance basis.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@811572 13f79535-47bb-0310-9956-ffa450edef68
2009-09-04 23:38:00 +00:00
Thomas White d6428581ff HADOOP-6165. Add metadata to Serializations.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810756 13f79535-47bb-0310-9956-ffa450edef68
2009-09-03 01:36:33 +00:00
Michael Stack e5fef21b18 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1 -- reversing this patch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810714 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 22:19:42 +00:00
Michael Stack 51d1c6ffa7 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810709 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 22:01:34 +00:00
Devaraj Das a3c52b93ea HADOOP-6226. Moves BoundedByteArrayOutputStream from the tfile package to the io package and makes it available to other users (MAPREDUCE-318). Contributed by Jothi Padmanabhan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810451 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 11:07:27 +00:00
Christopher Douglas 9ea11c5fb3 HADOOP-6224. Add a method to WritableUtils supported a bounded read of an
encoded String. Contributed by Jothi Padmanabhan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810384 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 07:07:21 +00:00
Christopher Douglas faf9fe98ae HADOOP-6199. Move io.map.skip.index property to core-default from mapred.
Contributed by Amareshwari Sriramadasu


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810329 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 01:26:40 +00:00
Christopher Douglas 6145503acf Revert HADOOP-6224
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810325 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 01:00:34 +00:00
Hemanth Yamijala 75103dc925 HADOOP-6227. Fix Configuration to allow final parameters to be set to null and prevent them from being overridden. Contributed by Amareshwari Sriramadasu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810097 13f79535-47bb-0310-9956-ffa450edef68
2009-09-01 15:24:56 +00:00
Devaraj Das 4c66882a69 HADOOP-6224. Adds methods to read strings safely, makes the Buffer class in DataOutputBuffer public, and introduces public constructors there. These changes are required for MAPREDUCE-318. Contributed by Jothi Padmanabhan and Arun Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@809491 13f79535-47bb-0310-9956-ffa450edef68
2009-08-31 07:56:39 +00:00
Sharad Agarwal aa10f303e3 HADOOP-6215. fix GenericOptionParser to deal with -D with '=' in the value. Contributed by Amar Kamat.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@808415 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 13:55:19 +00:00
Christopher Douglas 8621b830f8 HADOOP-6166. Further improve the performance of the pure-Java CRC32
implementation. Contributed by Tsz Wo (Nicholas), SZE


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807753 13f79535-47bb-0310-9956-ffa450edef68
2009-08-25 18:34:57 +00:00
Tsz-wo Sze a72edd2b10 HADOOP-6152. Fix classpath variables in bin/hadoop-config.sh and some other scripts. Contributed by Aaron Kimball
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807404 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 22:06:54 +00:00
Hemanth Yamijala 280ab0cf7d HADOOP-6184. Provide an API to dump Configuration in a JSON format. Contributed by V.V.Chaitanya Krishna.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807149 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 11:21:18 +00:00
Christopher Douglas 76a77aea78 HADOOP-6201. Change FileSystem::listStatus contract to throw
FileNotFoundException if the directory does not exist, rather than letting
this be implementation-specific. Contributed by Jakob Homan.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806745 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 22:50:04 +00:00
Devaraj Das 0a8e65c23b HADOOP-6103. Clones the classloader as part of Configuration clone. Contributed by Amareshwari Sriramadasu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806430 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 06:59:45 +00:00
Tsz-wo Sze 1f3337996e HADOOP-6173. Change src/native/packageNativeHadoop.sh to package all native library files. Contributed by Hong Tang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806368 13f79535-47bb-0310-9956-ffa450edef68
2009-08-20 21:28:09 +00:00
Hemanth Yamijala e5b7248682 MAPREDUCE-711. Removed Distributed Cache from Common, to move it under Map/Reduce. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804918 13f79535-47bb-0310-9956-ffa450edef68
2009-08-17 10:06:36 +00:00
Giridharan Kesavan 07b43463b8 HADOOP-6182. Fix ReleaseAudit warnings. Contributed by Giridharan Kesavan and Lee Tucker
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804842 13f79535-47bb-0310-9956-ffa450edef68
2009-08-17 03:53:27 +00:00
Arun Murthy 7ffe5b7f87 Reverting HADOOP-6182 and HADOOP-6195
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804317 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 18:22:41 +00:00
Giridharan Kesavan 43f95b50f2 HADOOP-6195. Fix checkstyle xml version tag. Contributed by Lee Tucker
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804297 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 17:00:03 +00:00
Giridharan Kesavan 2e34ced206 HADOOP-6182. Fix releaseaudit warnings by adding AL Headers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804157 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 10:23:41 +00:00
Arun Murthy ec8208f5d3 HADOOP-6192. Fix Shell.getUlimitMemoryCommand to not rely on Map-Reduce specific configs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804115 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 08:16:10 +00:00
Tsz-wo Sze 38a84a6c98 HADOOP-6188. TestTrash uses java.io.File api but not hadoop FileSystem api. Contributed by Boris Shkolnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803296 13f79535-47bb-0310-9956-ffa450edef68
2009-08-11 21:03:50 +00:00
Hairong Kuang d70dd1a2df HADOOP-6177. FSInputChecker.getPos() would return position greater than the file size. Contributed by Hong Tang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803190 13f79535-47bb-0310-9956-ffa450edef68
2009-08-11 16:26:55 +00:00
Tsz-wo Sze 5fe6906f2a HADOOP-6176. Add a couple package private methods to AccessTokenHandler for testing. Contributed by Kan Zhang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802224 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 21:40:01 +00:00
Hairong Kuang 09d826ebed HADOOP-6180. NameNode slowed down when many files with same filename were moved to Trash. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802107 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 17:59:57 +00:00
Tsz-wo Sze 5f53fd8ead HADOOP-6124. Fix javac warning detection in test-patch.sh. Contributed by Giridharan Kesavan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800919 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 19:01:51 +00:00
Mahadev Konar 7be6fc4e5d HADOOP-6169. Removing deprecated method calls in TFile. (hong tang via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800199 13f79535-47bb-0310-9956-ffa450edef68
2009-08-03 05:06:59 +00:00
Tsz-wo Sze e5ea0ce4a6 HADOOP-6172. Fix jar file names in hadoop-config.sh and include ${build.src} as a part of the source list in build.xml. Contributed by Hong Tang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@799751 13f79535-47bb-0310-9956-ffa450edef68
2009-07-31 21:37:23 +00:00
Tsz-wo Sze 638a211067 HADOOP-6123. Add missing classpaths in hadoop-config.sh. Contributed by Sharad Agarwal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@798247 13f79535-47bb-0310-9956-ffa450edef68
2009-07-27 18:34:57 +00:00
Giridharan Kesavan 6c12fd3335 HADOOP-6160. Fix ant releaseaudit target to run on specific directories. (Contributed by Giridharan Kesavan)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@798093 13f79535-47bb-0310-9956-ffa450edef68
2009-07-27 10:09:38 +00:00
Raghu Angadi f4166ddfad move the last change long from trunk to 0.20.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797300 13f79535-47bb-0310-9956-ffa450edef68
2009-07-24 01:14:52 +00:00
Raghu Angadi e4450e5487 HADOOP-6150. Users should be able to instantiate comparator using TFile
API. (Hong Tang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797274 13f79535-47bb-0310-9956-ffa450edef68
2009-07-24 00:11:20 +00:00
Raghu Angadi 53c127013c HADOOP-6132. RPC client create an extra connection because of incorrect
key for connection cache. (Kan Zhang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797248 13f79535-47bb-0310-9956-ffa450edef68
2009-07-23 22:28:26 +00:00
Doug Cutting 8296413d49 HADOOP-6120. Add support for Avro specific and reflect data. Contributed by sharad.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797197 13f79535-47bb-0310-9956-ffa450edef68
2009-07-23 19:21:21 +00:00
Christopher Douglas 3200b2ec58 HADOOP-6161. Add get/setEnum methods to Configuration.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@796052 13f79535-47bb-0310-9956-ffa450edef68
2009-07-20 22:58:21 +00:00
Tsz-wo Sze 391112f6ce HADOOP-6138. Eliminate the depracate warnings introduced by H-5438. Contributed by He Yongqiang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795172 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 18:01:15 +00:00
Thomas White 5478e9a188 HADOOP-6146. Upgrade to JetS3t version 0.7.1.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795028 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 10:20:00 +00:00
Tsz-wo Sze 8bd2486b51 HADOOP-6148. Implement a fast, pure Java CRC32 calculator which outperforms java.util.zip.CRC32. Contributed by Todd Lipcon and Scott Carey
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794944 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 02:18:06 +00:00
Christopher Douglas fc1bf705e9 HADOOP-6142. Update documentation and use of harchives for relative paths added
in MAPREDUCE-739. Contributed by Mahadev Konar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794943 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 02:06:42 +00:00
Tsz-wo Sze 466f93c8b6 HADOOP-6145. Fix FsShell rm/rmr error messages when there is a FNFE. Contributed by Jakob Homan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793987 13f79535-47bb-0310-9956-ffa450edef68
2009-07-14 17:39:33 +00:00
Christopher Douglas c02527fd04 Move HADOOP-3315 from 0.21 to 0.20.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793162 13f79535-47bb-0310-9956-ffa450edef68
2009-07-11 01:21:43 +00:00
Tsz-wo Sze d074c686b3 HADOOP-6139. Fix the FsShell help messages for rm and rmr. Contributed by Jakob Homan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793098 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 20:26:30 +00:00
Dhruba Borthakur c38c5a43ff HADOOP-6099. The RPC module can be configured to not send period pings.
The default behaviour remains unchanged. (dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792812 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 06:17:55 +00:00
Owen O'Malley 34d67b1cc2 HADOOP-5170. Removed change log entry because HADOOP-5170 was reverted from
mapreduce.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792701 13f79535-47bb-0310-9956-ffa450edef68
2009-07-09 21:17:22 +00:00
Giridharan Kesavan 127254f4a5 HADOOP-6137. Fix project specific test-patch requirements
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792440 13f79535-47bb-0310-9956-ffa450edef68
2009-07-09 08:10:18 +00:00
Mahadev Konar da8cf6702a HADOOP-6131. A sysproperty should not be set unless the property is set on the ant command line in build.xml (hong tang via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792302 13f79535-47bb-0310-9956-ffa450edef68
2009-07-08 20:35:26 +00:00
Tsz-wo Sze 708f3fc781 HADOOP-5976. Add a new command, classpath, to the hadoop script. Contributed by Owen O'Malley and Gary Murry
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@791937 13f79535-47bb-0310-9956-ffa450edef68
2009-07-07 18:48:32 +00:00
Dhruba Borthakur cf3d3a0643 HADOOP-6114. Fix javadoc documentation for FileStatus.getLen.
(Dmitry Rzhevskiy via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790277 13f79535-47bb-0310-9956-ffa450edef68
2009-07-01 17:20:42 +00:00
Tsz-wo Sze b8d9ca281d HADOOP-6122. The great than operator in test-patch.sh should be "-gt" but not ">".
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790009 13f79535-47bb-0310-9956-ffa450edef68
2009-07-01 00:56:15 +00:00
Tsz-wo Sze a13237975d HADOOP-2366. Support trimmed strings in Configuration. Contributed by Michele Catasta
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789973 13f79535-47bb-0310-9956-ffa450edef68
2009-06-30 21:45:00 +00:00
Konstantin Shvachko 80bc92ac35 HADOOP-6080 is going to 0.20.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789876 13f79535-47bb-0310-9956-ffa450edef68
2009-06-30 18:52:11 +00:00
Konstantin Shvachko 4824a54419 HADOOP-6080. Introduce -skipTrash option to rm and rmr. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789875 13f79535-47bb-0310-9956-ffa450edef68
2009-06-30 18:48:45 +00:00
Christopher Douglas e93ebeae51 HADOOP-6109. Change Text to grow its internal buffer exponentially, rather
than the max of the current length and the proposed length to improve
performance reading large values. Contributed by thushara wijeratna


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789242 13f79535-47bb-0310-9956-ffa450edef68
2009-06-29 07:16:56 +00:00
Konstantin Shvachko 1d6d98c9fb HADOOP-5897. Promote new name-node metrics to branch 0.20.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788900 13f79535-47bb-0310-9956-ffa450edef68
2009-06-26 22:52:51 +00:00
Thomas White efc6df7a11 HADOOP-5925. EC2 scripts should exit on error.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788699 13f79535-47bb-0310-9956-ffa450edef68
2009-06-26 13:40:07 +00:00
Hemanth Yamijala b089f4448d HADOOP-6106. Provides an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time. Contributed by Sreekanth Ramakrishnan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788600 13f79535-47bb-0310-9956-ffa450edef68
2009-06-26 06:18:04 +00:00
Christopher Douglas 8246aa28ff HADOOP-3315. Add a new, binary file foramt, TFile. Contributed by Hong Tang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787913 13f79535-47bb-0310-9956-ffa450edef68
2009-06-24 05:48:25 +00:00
Thomas White 84541f6f91 HADOOP-6096. Fix Eclipse project and classpath files following project split.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787709 13f79535-47bb-0310-9956-ffa450edef68
2009-06-23 15:29:09 +00:00
Tsz-wo Sze 2c372c70cf HADOOP-5952. Change "-1 tests included" wording in test-patch.sh. Contributed by Gary Murry
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787541 13f79535-47bb-0310-9956-ffa450edef68
2009-06-23 04:45:15 +00:00
Owen O'Malley fb6308f280 HADOOP-4687. More merges from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786712 13f79535-47bb-0310-9956-ffa450edef68
2009-06-19 23:12:41 +00:00
Owen O'Malley b12d765467 HADOOP-4687. Merge -r 784663:785643 from trunk to branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@785794 13f79535-47bb-0310-9956-ffa450edef68
2009-06-17 20:55:51 +00:00
Owen O'Malley c2d07b4fcd HADOOP-4687. Updating CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@785393 13f79535-47bb-0310-9956-ffa450edef68
2009-06-16 20:55:03 +00:00
Owen O'Malley c94ff0f240 HADOOP-4687 More moving around
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776175 13f79535-47bb-0310-9956-ffa450edef68
2009-05-19 04:30:38 +00:00