Commit Graph

9269 Commits

Author SHA1 Message Date
Doug Cutting f3477eb324 HADOOP-6497. Add an adapter for Avro's SeekableInput interface, so that Avro can read FileSystem data. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@900607 13f79535-47bb-0310-9956-ffa450edef68
2010-01-18 23:39:04 +00:00
Doug Cutting 4cd159e83e HADOOP-6492. Make some Avro serialization APIs public. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@899866 13f79535-47bb-0310-9956-ffa450edef68
2010-01-16 01:06:57 +00:00
Suresh Srinivas a90d3205d2 HADOOP-6489. Fix 3 findbugs warnings. Contributed by Erik Steffl.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@899856 13f79535-47bb-0310-9956-ffa450edef68
2010-01-16 00:44:40 +00:00
Christopher Douglas 08561f76db HADOOP-6155. Deprecate RecordIO anticipating Avro. Contributed by Tom White
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898740 13f79535-47bb-0310-9956-ffa450edef68
2010-01-13 13:26:11 +00:00
Christopher Douglas daed679fc1 HADOOP-6451. Fix build to run contrib unit tests. Contributed by Tom White
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898736 13f79535-47bb-0310-9956-ffa450edef68
2010-01-13 13:14:29 +00:00
Christopher Douglas 4cecab7c10 HADOOP-6315. Avoid incorrect use of BuiltInflater/BuiltInDeflater in
GzipCodec. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898711 13f79535-47bb-0310-9956-ffa450edef68
2010-01-13 10:46:39 +00:00
Thomas White 8942119b04 HADOOP-6464. Write a Rackspace cloud provider.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@897023 13f79535-47bb-0310-9956-ffa450edef68
2010-01-07 21:43:38 +00:00
Christopher Douglas 1ca1bfb2e5 HADOOP-6420. Add functionality permitting subsets of Configuration to be
interpreted as Map<String,String>. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896966 13f79535-47bb-0310-9956-ffa450edef68
2010-01-07 18:55:45 +00:00
Thomas White dec4c1614e HADOOP-6479. TestUTF8 assertions could fail with better text. Contributed by Steve Loughran.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896691 13f79535-47bb-0310-9956-ffa450edef68
2010-01-06 22:03:33 +00:00
Thomas White 889528e387 HADOOP-6408. Add a /conf servlet to dump running configuration. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896641 13f79535-47bb-0310-9956-ffa450edef68
2010-01-06 19:44:07 +00:00
Thomas White b55377a30d HADOOP-6466. Add a ZooKeeper service to the cloud scripts.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896259 13f79535-47bb-0310-9956-ffa450edef68
2010-01-05 22:54:51 +00:00
Thomas White ae91b5d0f4 HADOOP-3205. Read multiple chunks directly from FSInputChecker subclass into user buffers. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896243 13f79535-47bb-0310-9956-ffa450edef68
2010-01-05 22:14:17 +00:00
Thomas White efcad06506 HADOOP-6443. Serialization classes accept invalid metadata. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895831 13f79535-47bb-0310-9956-ffa450edef68
2010-01-05 00:06:09 +00:00
Boris Shkolnik 3cb2e3112b HADOOP-6472. add tokenCache option to GenericOptionsParser for passing
file with secret keys to a map reduce job. (boryas)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895801 13f79535-47bb-0310-9956-ffa450edef68
2010-01-04 22:14:34 +00:00
Steve Loughran e683a0d221 HADOOP-5849 hadoop-env.sh still refers to java1.5
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895467 13f79535-47bb-0310-9956-ffa450edef68
2010-01-03 19:17:50 +00:00
Thomas White 7d2440515c HADOOP-6402. testConf.xsl is not well-formed XML. Contributed by Steve Loughran.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@894706 13f79535-47bb-0310-9956-ffa450edef68
2009-12-30 20:32:42 +00:00
Suresh Srinivas 29a1ba1e8f HADOOP-6460. Reinitializes buffers used for serializing responses in ipc server on exceeding maximum response size to free up Java heap. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893666 13f79535-47bb-0310-9956-ffa450edef68
2009-12-24 00:47:20 +00:00
Thomas White d115e2cc3a HADOOP-6435. Make RPC.waitForProxy with timeout public. Contributed by Steve Loughran.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893612 13f79535-47bb-0310-9956-ffa450edef68
2009-12-23 19:36:14 +00:00
Steve Loughran cc2f077d43 HADOOP-6452 Hadoop JSP pages don't work under a security manager
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893490 13f79535-47bb-0310-9956-ffa450edef68
2009-12-23 12:11:51 +00:00
Steve Loughran 583c41bfac HADOOP-6434 Make HttpServer slightly easier to manage/diagnose faults with
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893485 13f79535-47bb-0310-9956-ffa450edef68
2009-12-23 12:02:04 +00:00
Konstantin Boudnik bb9a3d38b4 Correction for the placement of some JIRAs: were put to the trunk's sections
instead of ones for Release 0.21.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893306 13f79535-47bb-0310-9956-ffa450edef68
2009-12-22 20:31:39 +00:00
Thomas White 0ebcb62515 HADOOP-6454. Create setup.py for EC2 cloud scripts.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893262 13f79535-47bb-0310-9956-ffa450edef68
2009-12-22 18:33:48 +00:00
Thomas White d2bae8756c HADOOP-6444. Support additional security group option in hadoop-ec2 script. Contributed by Paul Egan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893251 13f79535-47bb-0310-9956-ffa450edef68
2009-12-22 18:06:02 +00:00
Thomas White 3d3e1ff3f8 HADOOP-6462. Target compile does not exist in contrib/cloud.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893248 13f79535-47bb-0310-9956-ffa450edef68
2009-12-22 18:02:45 +00:00
Devaraj Das fe479755c3 HADOOP-6415. Adds a common token interface for both job token and delegation token. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@892113 13f79535-47bb-0310-9956-ffa450edef68
2009-12-18 02:33:11 +00:00
Boris Shkolnik ae93ba7501 HADOOP-4656. Add a user to groups mapping service (boryas and acmurthy_)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@892066 13f79535-47bb-0310-9956-ffa450edef68
2009-12-18 01:29:05 +00:00
Suresh Srinivas ea5db0c5ab HADOOP-6394. Add a helper class to simplify FileContext related tests and improve code reusability. Contributed by Jitendra Nath Pandey.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891511 13f79535-47bb-0310-9956-ffa450edef68
2009-12-17 01:30:33 +00:00
Thomas White 6a1e8bf452 HADOOP-6426. Create ant build for running EC2 unit tests.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891497 13f79535-47bb-0310-9956-ffa450edef68
2009-12-17 00:49:01 +00:00
Owen O'Malley 875c9d62c6 HADOOP-6441. Protect web ui from cross site scripting attacks (XSS) on
the host http header and using encoded utf-7. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891132 13f79535-47bb-0310-9956-ffa450edef68
2009-12-16 06:31:51 +00:00
Konstantin Boudnik e8d9bf47ab HADOOP-6222. Core doesn't have TestCommonCLI facility. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890964 13f79535-47bb-0310-9956-ffa450edef68
2009-12-15 19:59:20 +00:00
Thomas White 7a9ec5d90b Reverting HADOOP-5901. FileSystem.fixName() has unexpected behaviour.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890941 13f79535-47bb-0310-9956-ffa450edef68
2009-12-15 18:59:04 +00:00
Thomas White 74b46cf87e HADOOP-5901. FileSystem.fixName() has unexpected behaviour. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890651 13f79535-47bb-0310-9956-ffa450edef68
2009-12-15 05:43:03 +00:00
Thomas White 1a2ab63f87 Add missing file for HADOOP-6413.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890588 13f79535-47bb-0310-9956-ffa450edef68
2009-12-15 00:51:07 +00:00
Thomas White a0e1451108 HADOOP-6413. Move TestReflectionUtils to Common. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890585 13f79535-47bb-0310-9956-ffa450edef68
2009-12-15 00:38:38 +00:00
Thomas White ee6468b8a1 HADOOP-5958. Use JDK 1.6 File APIs in DF.java wherever possible. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890576 13f79535-47bb-0310-9956-ffa450edef68
2009-12-15 00:10:13 +00:00
Thomas White e28b9aefd7 HADOOP-6391. Classpath should not be part of command line arguments. Contributed by Cristian Ivascu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890561 13f79535-47bb-0310-9956-ffa450edef68
2009-12-14 23:46:28 +00:00
Thomas White 22fb49704b HADOOP-6414. Add command line help for -expunge command. Contributed by Ravi Phulari.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890551 13f79535-47bb-0310-9956-ffa450edef68
2009-12-14 23:28:40 +00:00
Dhruba Borthakur c4e1126980 HADOOP-6433. Introduce asychronous deletion of files via a pool of
threads. This can be used to delete files in the Distributed Cache. 
(Zheng Shao via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890502 13f79535-47bb-0310-9956-ffa450edef68
2009-12-14 22:17:19 +00:00
Doug Cutting 2ee80854a5 HADOOP-6422. Remove log line.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890410 13f79535-47bb-0310-9956-ffa450edef68
2009-12-14 17:45:51 +00:00
Doug Cutting 6c842ad4b5 AVRO-6422. Make RPC backend plugable.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889889 13f79535-47bb-0310-9956-ffa450edef68
2009-12-12 04:37:06 +00:00
Doug Cutting 843ac12f7a HADOOP-6323. Add comparators to the serialization API. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889877 13f79535-47bb-0310-9956-ffa450edef68
2009-12-12 01:26:22 +00:00
Thomas White f9cb8b0d45 Add pyAntTasks jar for HADOOP 6426.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889845 13f79535-47bb-0310-9956-ffa450edef68
2009-12-11 22:49:41 +00:00
Konstantin Boudnik d7fb2d3c85 HADOOP-6428. HttpServer sleeps with negative values. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889378 13f79535-47bb-0310-9956-ffa450edef68
2009-12-10 19:26:07 +00:00
Thomas White a473f37733 HADOOP-6346. Add support for specifying unpack pattern regex to RunJar.unJar. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889018 13f79535-47bb-0310-9956-ffa450edef68
2009-12-09 23:25:51 +00:00
Thomas White 2e5fd1c0ab HADOOP-6392. Run namenode and jobtracker on separate EC2 instances.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888998 13f79535-47bb-0310-9956-ffa450edef68
2009-12-09 21:57:10 +00:00
Thomas White 368b6cc85b HADOOP-6254. Slow reads cause s3n to fail with SocketTimeoutException. Contributed by Andrew Hitchcock.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888697 13f79535-47bb-0310-9956-ffa450edef68
2009-12-09 04:17:02 +00:00
Konstantin Boudnik 929e91a08c HADOOP-6386. NameNode's HttpServer can't instantiate InetSocketAddress: IllegalArgumentException is thrown. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888565 13f79535-47bb-0310-9956-ffa450edef68
2009-12-08 20:50:47 +00:00
Jakob Homan 934deda190 HADOOP-6396. Fix unhelpful exception message when unable to parse umask (jghoman)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887472 13f79535-47bb-0310-9956-ffa450edef68
2009-12-05 00:46:08 +00:00
Konstantin Boudnik 3549d30d7e HADOOP-6411. Remove deprecated file src/test/hadoop-site.xml. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887047 13f79535-47bb-0310-9956-ffa450edef68
2009-12-04 03:18:27 +00:00
Thomas White 8d6c5c41f2 HADOOP-6400. Log errors getting Unix UGI. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886645 13f79535-47bb-0310-9956-ffa450edef68
2009-12-03 01:14:15 +00:00