Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
597 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

539 Commits

Author SHA1 Message Date
Thomas White fe34ccdda8 HADOOP-6623. Add StringUtils.split for non-escaped single-character separator. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@941508 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-05 21:46:31 +00:00
Christopher Douglas 06a13750a5 HADOOP-6669. Respect compression configuration when creating DefaultCodec 
instances. Contributed by Koji Noguchi


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@940989 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-04 18:21:48 +00:00
Thomas White 322f9ac7b1 HADOOP-6727. Remove UnresolvedLinkException from public FileContext APIs. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@940527 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-03 17:36:07 +00:00
Jakob Homan fe49f6e473 HADOOP-6730. Bug in FileContext#copy and provide base class for FileContext tests. (Ravi Phulari via jghoman) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@940112 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-01 21:08:34 +00:00
Thomas White 14f02ef0f5 Preparing for 0.22.0 development 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939917 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-01 04:53:36 +00:00
Thomas White 4d04914ff4 Preparing for release 0.21.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939911 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-01 04:42:51 +00:00
Thomas White 494ef1e48c HADOOP-6742. Add methods HADOOP-6709 from to TestFilterFileSystem. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939864 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-30 22:49:08 +00:00
Suresh Srinivas 704e919a9b HADOOP-6563. Add more symlink tests to cover intermediate symlinks in paths. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939827 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-30 21:40:56 +00:00
Thomas White f8f275c1ad HADOOP-6630. hadoop-config.sh fails to get executed if hadoop wrapper scripts are in path. Contributed by Allen Wittenauer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939510 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 23:23:53 +00:00
Zheng Shao f6acb32e06 HADOOP-6515. Make maximum number of http threads configurable (Scott Chen via zshao) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939486 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 21:32:54 +00:00
Thomas White b56827c591 HADOOP-6709. Re-instate deprecated FileSystem methods that were removed after 0.20. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939470 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 19:55:44 +00:00
Thomas White 750fb2dbc1 HADOOP-6698. Revert the io.serialization package to 0.20.2's api. Reverted HADOOP-6165, HADOOP-6443, HADOOP-6323, and HADOOP-6420. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939412 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 18:09:56 +00:00
Sharad Agarwal 00cb892150 HADOOP-6634. Fix AccessControlList to use short names to verify access control. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939242 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 09:31:30 +00:00
Hairong Kuang 8991eb7959 HADOOP-6678. Remove FileContext#isFile, isDirectory and exists. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939140 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 23:58:25 +00:00
Thomas White c59b4cd966 HADOOP-6722. NetUtils.connect should check that it hasn't connected a socket to itself. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939026 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 17:46:06 +00:00
Thomas White cd85fc46dc HADOOP-6724. IPC doesn't properly handle IOEs thrown by socket factory. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939018 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 17:34:55 +00:00
Suresh Srinivas f1fee1804a Fixed incorrect description in CHANGES.txt for Hadoop-6701. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939017 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 17:30:48 +00:00
Suresh Srinivas d2ca51b859 HADOOP-6701. Fix incorrect exit codes returned from chgrp, chown and chgrp commands from FsShell. Contributed by Ravi Phulari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939016 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 17:27:01 +00:00
Suresh Srinivas e333072144 HADOOP-6703. Prevent renaming a file, directory or symbolic link to itself. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938788 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 05:45:40 +00:00
Hairong Kuang b212ed99c5 HADOOP-6713. The RPC server Listener thread is a scalability bottleneck. Contributed by Dmytro Molkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938590 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-27 18:13:12 +00:00
Thomas White 9ad633f011 HADOOP-6677. InterfaceAudience.LimitedPrivate should take a string not an enum. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938563 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-27 16:53:40 +00:00
Thomas White 2bec54de58 HADOOP-6667. RPC.waitForProxy should retry through NoRouteToHostException. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938322 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-27 04:38:23 +00:00
Hairong Kuang 75e0b765ea Move the change log of HADOOP-6692 to the right section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938264 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-26 22:52:30 +00:00
Hairong Kuang 33e3f7949b HADOOP-6692. Add FileContext#listStatus that returns an iterator. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938136 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-26 17:32:17 +00:00
Jakob Homan 5075d7dbde HADOOP-6717. Log levels in o.a.h.security.Groups too high. Todd Lipcon via jghoman. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937881 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-25 21:23:30 +00:00
Jakob Homan 18262cc096 HADOOP-6635. Install/deploy source jars to Maven repo. (Patrick Angeles via jghoman) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937853 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-25 18:58:13 +00:00
Suresh Srinivas 27a9fce10d HADOOP-6710. Symbolic umask for file creation is not conformant with posix. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937577 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-24 02:04:20 +00:00
Suresh Srinivas 67c006c322 HADOOP-6521. User specified umask using deprecated dfs.umask must override server configured using new dfs.umaskmode for backward compatibility. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937559 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-24 00:01:27 +00:00
Suresh Srinivas 50f24d774e HADOOP-6686. Remove redundant exception class name from the exception message for the exceptions thrown at RPC client. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937183 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-23 08:05:30 +00:00
Dhruba Borthakur 1e82194428 HADOOP-6719. Insert all missing methods in FilterFs. 
(Rodrigo Schmidt via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937093 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-22 22:47:44 +00:00
Dhruba Borthakur b183665c7f HADOOP-6690. FilterFileSystem correctly handles setTimes call. 
(Rodrigo Schmidt via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937092 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-22 22:40:23 +00:00
Thomas White 980f99bfb7 HADOOP-6658. Exclude Private elements from generated Javadoc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937052 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-22 20:48:04 +00:00
Hemanth Yamijala 97c38f94f5 HADOOP-6439. Fixes handling of deprecated keys to follow order in which keys are defined. Contributed by V.V.Chaitanya Krishna. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@936463 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-21 19:32:32 +00:00
Steve Loughran 6f89a64657 HADOOP-6657. Add a capitalization method to StringUtils for MAPREDUCE-1545 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@934619 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-15 22:06:52 +00:00
Giridharan Kesavan a0ef69df26 HADOOP-6705. Fix to work with 1.5 version of jiracli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@934273 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-15 03:08:09 +00:00
Boris Shkolnik b802476d9d HADOOP-6580. UGI should contain authentication method. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@933810 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-13 23:01:43 +00:00
Suresh Srinivas 87c788d2e1 HADOOP-6689. Add directory renaming test to existing FileContext tests. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@933705 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-13 17:00:26 +00:00
Thomas White 631f45618d HADOOP-6507. Hadoop Common Docs - delete 3 doc files that do not belong under Common. Contributed by Corinne Chandel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@933406 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-12 20:57:27 +00:00
Hairong Kuang fb154e3a03 HADOOP-6691. TestFileSystemCaching sometimes hangs. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@932115 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-08 21:13:58 +00:00
Thomas White 4c062c79c3 HADOOP-6680. hadoop-cloud push command invokes proxy creation. Contributed by Andrew Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@931226 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-06 17:05:11 +00:00
Hairong Kuang 7b1ac5ac13 HADOOP-6640. FileSystem.get() does RPC retries within a static synchronized block. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@930096 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-01 20:58:10 +00:00
Tsz-wo Sze 6f35c10aab HADOOP-6654. Fix code example in WritableComparable javadoc. Contributed by Tom White 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927979 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-26 17:38:47 +00:00
Christopher Douglas f4d31cd029 HADOOP-6566. Add methods supporting, enforcing narrower permissions on local daemon directories. 
Contributed by Arun Murthy and Luke Lu


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927728 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-26 08:25:00 +00:00
Mahadev Konar 980f819047 HADOOP-6646. Move HarfileSystem out of Hadoop Common. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927193 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-24 21:43:24 +00:00
Mahadev Konar e381af1e1e HADOOP-6645. Re: Bugs on listStatus for HarFileSystem (rodrigo via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927134 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-24 17:51:38 +00:00
Mahadev Konar 35de12b8ed HADOOP-6645. Bugs on listStatus for HarFileSystem (rodrigo via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@926421 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-23 01:16:03 +00:00
Thomas White 0485fe23ba HADOOP-6471. StringBuffer -> StringBuilder - conversion of references as necessary. Contributed by Kay Kay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@926256 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-22 19:08:03 +00:00
Thomas White 124137ff01 HADOOP-6175. Incorrect version compilation with es_ES.ISO8859-15 locale on Solaris 10. Contributed by Urko Benito. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@926252 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-22 18:46:44 +00:00
Konstantin Shvachko 81c448ae85 HADOOP-6637. Benchmark for establishing RPC session. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925528 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-20 02:17:38 +00:00
Thomas White f32ffc750a HADOOP-6593. TextRecordInputStream doesn't close SequenceFile.Reader. Contributed by Chase Bradford. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925487 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-19 23:52:51 +00:00
Thomas White c8ffb2249a HADOOP-6546. BloomMapFile can return false negatives. Contributed by Clark Jefcoat. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925479 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-19 23:19:13 +00:00
Thomas White a0a4bf08d3 HADOOP-3659. Patch to allow hadoop native to compile on Mac OS X. Contributed by Colin Evans and Allen Wittenauer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925468 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-19 22:51:29 +00:00
Thomas White b769d6463b HADOOP-6407. Have a way to automatically update Eclipse .classpath file when new libs are added to the classpath through Ivy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925465 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-19 22:39:28 +00:00
Dhruba Borthakur 637cf89e18 HADOOP-6591. HarFileSystem can handle paths with the whitespace characters. 
(Rodrigo Schmidt via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@923619 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-16 08:03:38 +00:00
Thomas White 74d409c4bb HADOOP-6486. fix common classes to work with Avro 1.3 reflection. Contributed by cutting. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@921577 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-10 21:24:13 +00:00
Thomas White fe01f920a1 HADOOP-6504. Invalid example in the documentation of org.apache.hadoop.util.Tool. Contributed by Benoit Sigoure. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@921542 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-10 20:06:07 +00:00
Owen O'Malley b1ec35e60c HADOOP-6609. Fixed deadlock in RPC by replacing shared static 
DataOutputBuffer in the UTF8 class with a thread local variable. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918880 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-04 07:20:29 +00:00
Hairong Kuang 393baff732 HADOOP-6569. FsShell#cat should avoid calling unecessary getFileStatus before opening a file to read. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918624 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-03 18:49:26 +00:00
Sanjay Radia 1ab5aa5279 HADOOP-6537 Declare more detailed exceptions in FileContext and AbstractFileSystem 
(Suresh Srinivas via Sanjay Radia)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918309 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-03 02:48:49 +00:00
Sanjay Radia 6b9fb8c78b HADOOP-6599 Split existing RpcMetrics into RpcMetrics & RpcDetailedMetrics. 
(Suresh Srinivas via Sanjay Radia)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@917737 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-01 21:36:23 +00:00
Owen O'Malley c93a9128ff HADOOP-6589. Provide better error messages when RPC authentication fails. 
(Kan Zhang via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916915 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-27 06:17:00 +00:00
Arun Murthy 1d8cb8b785 HADOOP-6594. Provide a fetchdt tool via bin/hdfs. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916907 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-27 03:31:19 +00:00
Boris Shkolnik c4c122a0de HADOOP-6586. Log authentication and authorization failures and successes for RPC 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916779 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-26 18:35:54 +00:00
Konstantin Shvachko ea650d8d6c HADOOP-1849. Add undocumented configuration parameter for per handler call queue size in IPC Server. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916529 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-26 01:37:57 +00:00
Konstantin Shvachko 27ab7f3db9 HADOOP-6573. Support for persistent delegation tokens. Contributed by Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916468 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-25 21:43:20 +00:00
Devaraj Das 7785232da5 HADOOP-6568. Adds authorization for the default servlets. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916467 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-25 21:39:38 +00:00
Owen O'Malley 37214591e9 HADOOP-6596. Add a version field to the AbstractDelegationTokenIdentifier's 
serialized value. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916390 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-25 18:34:05 +00:00
Owen O'Malley 831da66493 HADOOP-6579. Provide a mechanism for encoding/decoding Tokens from 
a url-safe string and change the commons-code library to 1.4. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916290 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-25 14:14:18 +00:00
Tsz-wo Sze 4eedc77275 HADOOP-6467. Improve the performance on HarFileSystem.listStatus(..). Contributed by mahadev 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915168 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-23 03:54:14 +00:00
Devaraj Das c5622e5d4d HADOOP-6543. Allows secure clients to talk to unsecure clusters. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915097 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-22 22:28:29 +00:00
Devaraj Das ffdde40b9f HADOOP-6583. Captures authentication and authorization metrics. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915095 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-22 22:26:03 +00:00
Devaraj Das 115ef5b8c7 HADOOP-6545. Changes the Key for the FileSystem cache to be UGI. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912207 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-20 20:13:26 +00:00
Suresh Srinivas 9871771bb5 HADOOP-6577. Add hidden configuration option "ipc.server.max.response.size" to change the default 1 MB, the maximum size when large IPC handler response buffer is reset. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912056 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-20 01:23:26 +00:00
Devaraj Das d099c1c78a HADOOP-6572. Makes sure that SASL encryption and push to responder queue for the RPC response happens atomically. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911748 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-19 09:04:47 +00:00
Owen O'Malley a417a8faea HADOOP-6551. Delegation token renewing and cancelling should provide 
meaningful exceptions when there are failures instead of returning 
false. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911743 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-19 08:49:22 +00:00
Tsz-wo Sze 50dcc335be HADOOP-6558. Return null in HarFileSystem.getFileChecksum(..) since no checksum algorithm is implemented. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911646 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-18 23:22:52 +00:00
Hairong Kuang 4b4e9d741e HADOOP-6570. RPC#stopProxy throws NPE if getProxyEngine(proxy) returns null. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911134 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-17 18:22:40 +00:00
Boris Shkolnik 3a7841aeb8 HADOOP-6549. TestDoAsEffectiveUser should use ip address of the host for superuser ip check 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910741 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 22:46:36 +00:00
Tsz-wo Sze 18c6d65749 HADOOP-6560. Handle invalid har:// uri in HarFileSystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910726 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 22:17:54 +00:00
Owen O'Malley 44185c3874 prep for making 0.20.2 rc2 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910709 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 21:53:15 +00:00
Sanjay Radia ea605b8cd7 HADOOP-6421 Adds Symbolic links to FileContext, AbstractFileSystem. 
It also adds a limited implementation for the local file system
     (RawLocalFs) that allows local symlinks. (Eli Collins via Sanjay Radia)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910706 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 21:43:30 +00:00
Devaraj Das 8b4b190cbd HADOOP-6559. Makes the RPC client automatically re-login when the SASL connection setup fails. This is applicable only to keytab based logins. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910169 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-15 07:28:17 +00:00
Christopher Douglas 96a1477d02 HADOOP-6534. Trim whitespace from directory lists initializing 
LocalDirAllocator. Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909806 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-13 12:46:38 +00:00
Christopher Douglas fc83909c3f HADOOP-6548. Replace mortbay imports with commons logging. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909802 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-13 12:21:26 +00:00
Christopher Douglas e0a0e6b9f5 HADOOP-6505. Use tr rather than sed to effect literal substitution in the 
build script. Contributed by Allen Wittenauer


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909801 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-13 12:16:52 +00:00
Christopher Douglas 139b2ea1a2 HADOOP-5612. Commit to branch 0.20 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909721 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-13 04:05:08 +00:00
Christopher Douglas e9ff6510bd HADOOP-5611. Commit to branch 0.20 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909242 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-12 05:28:35 +00:00
Doug Cutting 8061821ca2 HADOOP-6522. Fix decoding of codepoint zero in UTF8. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@908661 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-10 21:58:11 +00:00
Devaraj Das cfbdd1aff4 HADOOP-6552. Puts renewTGT=true and useTicketCache=true for the keytab kerberos options. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@908353 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-10 05:01:27 +00:00
Owen O'Malley 38c59c0af7 HADOOP-6547. Move DelegationToken into Common, so that it can be used by 
MapReduce also. (devaraj via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907956 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-09 08:10:37 +00:00
Thomas White 5b0d8a0162 HADOOP-6540. Contrib unit tests have invalid XML for core-site, etc. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907939 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-09 06:03:59 +00:00
Devaraj Das 1793e7d909 HADOOP-6510. Adds a way for superusers to impersonate other users in a secure environment. Contributed by Jitendra Nath Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907549 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-08 04:55:11 +00:00
Devaraj Das f786508cd3 HADOOP-6538. Sets hadoop.security.authentication to simple by default. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@906388 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-04 07:46:20 +00:00
Hemanth Yamijala 9f7a07f908 HADOOP-6531. Enhance FileUtil with an API to delete all contents of a directory. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@906177 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-03 19:04:36 +00:00
Devaraj Das 940389afce HADOOP-6419. Adds SASL based authentication to RPC. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@905860 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-03 01:30:25 +00:00
Devaraj Das fe0ddc03e1 HADOOP-6518. Makes the UGI honor the env var KRB5CCNAME. Contributed by Owen O'Malley. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904975 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-31 04:04:38 +00:00
Devaraj Das ba8647f511 HADOOP-6520. Adds APIs to read/write Token and secret keys. Also adds the automatic loading of tokens into UserGroupInformation upon login. The tokens are read from a file specified in the environment variable. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904861 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-30 19:57:39 +00:00
Devaraj Das 611340714b HADOOP-6517. Fix UserGroupInformation so that tokens are saved/retrieved to/from the embedded Subject. Contributed by Owen O'Malley & Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904339 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-29 01:56:57 +00:00
Owen O'Malley 0c5734e4ac HADOOP-6299. Reimplement the UserGroupInformation to use the OS 
specific and Kerberos JAAS login. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903560 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-27 08:08:29 +00:00
Hairong Kuang 34d1b39c75 HADOOP-6498. IPC client bug may cause rpc call hang. Contributed by Ruyue Ma and Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903471 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-26 22:55:17 +00:00
Hairong Kuang d6f4cf3dfe Revert commit 903015 because it was tagged with the wrong jira number HADOOP-6459. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903468 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-26 22:52:05 +00:00
Hairong Kuang 3ef40e1344 HADOOP-6459. IPC client bug may cause rpc call hang. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903015 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-25 23:51:13 +00:00
Christopher Douglas f38a996b4c HADOOP-6290. Prevent duplicate slf4j-simple jar via Avro's classpath. 
Contributed by Owen O'Malley


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@902745 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-25 09:29:09 +00:00
Boris Shkolnik aaf3b6c6ff HADOOP-6495. Identifier should be serialized after the password is 
created In Token constructor (jnp via boryas)  


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@901924 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-21 23:36:13 +00:00
Konstantin Boudnik c7a3c785f8 HADOOP-6374. JUnit tests should never depend on anything in conf. Contributed by Anatoli Fomenko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@901540 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-21 05:57:30 +00:00
Doug Cutting f3477eb324 HADOOP-6497. Add an adapter for Avro's SeekableInput interface, so that Avro can read FileSystem data. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@900607 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-18 23:39:04 +00:00
Doug Cutting 4cd159e83e HADOOP-6492. Make some Avro serialization APIs public. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@899866 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-16 01:06:57 +00:00
Suresh Srinivas a90d3205d2 HADOOP-6489. Fix 3 findbugs warnings. Contributed by Erik Steffl. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@899856 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-16 00:44:40 +00:00
Christopher Douglas 08561f76db HADOOP-6155. Deprecate RecordIO anticipating Avro. Contributed by Tom White 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898740 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 13:26:11 +00:00
Christopher Douglas daed679fc1 HADOOP-6451. Fix build to run contrib unit tests. Contributed by Tom White 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898736 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 13:14:29 +00:00
Christopher Douglas 4cecab7c10 HADOOP-6315. Avoid incorrect use of BuiltInflater/BuiltInDeflater in 
GzipCodec. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898711 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 10:46:39 +00:00
Thomas White 8942119b04 HADOOP-6464. Write a Rackspace cloud provider. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@897023 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-07 21:43:38 +00:00
Christopher Douglas 1ca1bfb2e5 HADOOP-6420. Add functionality permitting subsets of Configuration to be 
interpreted as Map<String,String>. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896966 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-07 18:55:45 +00:00
Thomas White dec4c1614e HADOOP-6479. TestUTF8 assertions could fail with better text. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896691 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-06 22:03:33 +00:00
Thomas White 889528e387 HADOOP-6408. Add a /conf servlet to dump running configuration. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896641 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-06 19:44:07 +00:00
Thomas White b55377a30d HADOOP-6466. Add a ZooKeeper service to the cloud scripts. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896259 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 22:54:51 +00:00
Thomas White ae91b5d0f4 HADOOP-3205. Read multiple chunks directly from FSInputChecker subclass into user buffers. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896243 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 22:14:17 +00:00
Thomas White efcad06506 HADOOP-6443. Serialization classes accept invalid metadata. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895831 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 00:06:09 +00:00
Boris Shkolnik 3cb2e3112b HADOOP-6472. add tokenCache option to GenericOptionsParser for passing 
file with secret keys to a map reduce job. (boryas)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895801 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-04 22:14:34 +00:00
Thomas White 7d2440515c HADOOP-6402. testConf.xsl is not well-formed XML. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@894706 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-30 20:32:42 +00:00
Suresh Srinivas 29a1ba1e8f HADOOP-6460. Reinitializes buffers used for serializing responses in ipc server on exceeding maximum response size to free up Java heap. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893666 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-24 00:47:20 +00:00
Thomas White d115e2cc3a HADOOP-6435. Make RPC.waitForProxy with timeout public. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893612 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-23 19:36:14 +00:00
Konstantin Boudnik bb9a3d38b4 Correction for the placement of some JIRAs: were put to the trunk's sections 
instead of ones for Release 0.21.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893306 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-22 20:31:39 +00:00
Thomas White 0ebcb62515 HADOOP-6454. Create setup.py for EC2 cloud scripts. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893262 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-22 18:33:48 +00:00
Thomas White d2bae8756c HADOOP-6444. Support additional security group option in hadoop-ec2 script. Contributed by Paul Egan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893251 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-22 18:06:02 +00:00
Thomas White 3d3e1ff3f8 HADOOP-6462. Target compile does not exist in contrib/cloud. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893248 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-22 18:02:45 +00:00
Devaraj Das fe479755c3 HADOOP-6415. Adds a common token interface for both job token and delegation token. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@892113 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-18 02:33:11 +00:00
Boris Shkolnik ae93ba7501 HADOOP-4656. Add a user to groups mapping service (boryas and acmurthy_) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@892066 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-18 01:29:05 +00:00
Suresh Srinivas ea5db0c5ab HADOOP-6394. Add a helper class to simplify FileContext related tests and improve code reusability. Contributed by Jitendra Nath Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891511 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-17 01:30:33 +00:00
Thomas White 6a1e8bf452 HADOOP-6426. Create ant build for running EC2 unit tests. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891497 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-17 00:49:01 +00:00
Owen O'Malley 875c9d62c6 HADOOP-6441. Protect web ui from cross site scripting attacks (XSS) on 
the host http header and using encoded utf-7. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891132 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-16 06:31:51 +00:00
Konstantin Boudnik e8d9bf47ab HADOOP-6222. Core doesn't have TestCommonCLI facility. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890964 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 19:59:20 +00:00
Thomas White 7a9ec5d90b Reverting HADOOP-5901. FileSystem.fixName() has unexpected behaviour. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890941 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 18:59:04 +00:00
Thomas White 74b46cf87e HADOOP-5901. FileSystem.fixName() has unexpected behaviour. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890651 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 05:43:03 +00:00
Thomas White a0e1451108 HADOOP-6413. Move TestReflectionUtils to Common. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890585 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 00:38:38 +00:00
Thomas White ee6468b8a1 HADOOP-5958. Use JDK 1.6 File APIs in DF.java wherever possible. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890576 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 00:10:13 +00:00
Thomas White e28b9aefd7 HADOOP-6391. Classpath should not be part of command line arguments. Contributed by Cristian Ivascu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890561 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-14 23:46:28 +00:00
Thomas White 22fb49704b HADOOP-6414. Add command line help for -expunge command. Contributed by Ravi Phulari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890551 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-14 23:28:40 +00:00
Dhruba Borthakur c4e1126980 HADOOP-6433. Introduce asychronous deletion of files via a pool of 
threads. This can be used to delete files in the Distributed Cache. 
(Zheng Shao via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890502 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-14 22:17:19 +00:00
Doug Cutting 6c842ad4b5 AVRO-6422. Make RPC backend plugable. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889889 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-12 04:37:06 +00:00
Doug Cutting 843ac12f7a HADOOP-6323. Add comparators to the serialization API. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889877 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-12 01:26:22 +00:00
Konstantin Boudnik d7fb2d3c85 HADOOP-6428. HttpServer sleeps with negative values. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889378 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-10 19:26:07 +00:00
Thomas White a473f37733 HADOOP-6346. Add support for specifying unpack pattern regex to RunJar.unJar. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889018 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-09 23:25:51 +00:00
Thomas White 2e5fd1c0ab HADOOP-6392. Run namenode and jobtracker on separate EC2 instances. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888998 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-09 21:57:10 +00:00
Thomas White 368b6cc85b HADOOP-6254. Slow reads cause s3n to fail with SocketTimeoutException. Contributed by Andrew Hitchcock. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888697 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-09 04:17:02 +00:00
Konstantin Boudnik 929e91a08c HADOOP-6386. NameNode's HttpServer can't instantiate InetSocketAddress: IllegalArgumentException is thrown. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888565 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-08 20:50:47 +00:00
Jakob Homan 934deda190 HADOOP-6396. Fix unhelpful exception message when unable to parse umask (jghoman) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887472 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-05 00:46:08 +00:00
Konstantin Boudnik 3549d30d7e HADOOP-6411. Remove deprecated file src/test/hadoop-site.xml. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887047 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-04 03:18:27 +00:00
Thomas White 8d6c5c41f2 HADOOP-6400. Log errors getting Unix UGI. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886645 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-03 01:14:15 +00:00
Konstantin Boudnik ef643fd06b HADOOP-6405. Update Eclipse configuration to match changes to Ivy configuration. Contributed by Edwin Chan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886348 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-03 00:44:00 +00:00
Tsz-wo Sze 98beeca09d HADOOP-6307. Add a new SequenceFile.Reader constructor in order to support reading on un-closed file. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886003 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-01 23:25:56 +00:00
Thomas White ff6c0ef547 HADOOP-6108. Add support for EBS storage on EC2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885888 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-01 19:33:10 +00:00
Konstantin Boudnik 36700348c1 HADOOP-6398. Build is broken after HADOOP-6395 patch has been applied. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885534 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-30 18:52:34 +00:00
Owen O'Malley fc880f9794 HADOOP-6395. Upgrade some libraries to be consistent across common, hdfs, 
and mapreduce. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@884428 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-26 07:33:38 +00:00
Christopher Douglas f6990e06b4 HADOOP-6375. Sync documentation for FsShell du with its implementation. 
Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@883206 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-23 00:59:29 +00:00
Christopher Douglas 09ec9c4ffc HADOOP-6269. Fix threading issue with defaultResource in Configuration. 
Contributed by Sreekanth Ramakrishnan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@882831 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-21 04:22:02 +00:00
Devaraj Das bd92322d22 HADOOP-6367. Removes Access Token implementation from common. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@881509 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-17 20:59:46 +00:00
Tsz-wo Sze cdcb8514a0 HADOOP-6314. Fix "fs -help" for the "-count" commond. Contributed by Ravi Phulari 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@836019 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-13 22:10:01 +00:00
Konstantin Boudnik 2eba5972ed HADOOP-6366. Reduce ivy console output to ovservable level. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@835967 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-13 19:44:14 +00:00
Devaraj Das ad88440651 HADOOP-6337. Updates FilterInitializer class to be more visible, and the init of the class is made to take a Configuration argument. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@833553 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-06 20:54:40 +00:00
Giridharan Kesavan af59233ce1 HADOOP-6341. Fix test-patch.sh for checkTests function. ( gkesavan ) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832590 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-03 22:53:08 +00:00
Tsz-wo Sze f5f95fe43a HADOOP-6343. Log unexpected throwable object caught in RPC. Contributed by Jitendra Nath Pandey 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832249 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-03 01:30:11 +00:00
Konstantin Boudnik 408117957e HADOOP-6347. run-test-core-fault-inject runs a test case twice if -Dtestcase is set. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832157 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-02 22:26:56 +00:00
Suresh Srinivas 382af3f627 HADOOP-6344. Fix rm and rmr immediately delete files rather than sending to trash, if a user is over-quota. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831478 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 22:39:01 +00:00
Suresh Srinivas 3f371a0a64 Hadoop-6223. Add new file system interface AbstractFileSystem with implementation of some file systems that delegate to old FileSystem. Contributed by Sanjay Radia. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831475 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 22:24:22 +00:00
Suresh Srinivas b5c31f4ee6 HADOOP-6313. Implement Syncable interface in FSDataOutputStream to expose flush APIs to application users. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831416 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 18:33:00 +00:00
Tsz-wo Sze a5427fc7eb HADOOP-6334. Fix GenericOptionsParser and Path to have a better URI support. Contributed by Amareshwari Sriramadasu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831412 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 18:21:26 +00:00
Owen O'Malley f0f3fdbd3d HADOOP-5107. Use Maven ant tasks to publish the subproject jars. 
(Giridharan Kesavan via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831032 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-29 17:08:42 +00:00
Doug Cutting f9dee28085 HADOOP-6318. Move CHANGES.txt message to 0.21 section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829289 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-24 00:17:24 +00:00
Doug Cutting a13a0f3fba HADOOP-6318. Upgrade to Avro 1.2.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829279 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-23 23:36:29 +00:00
Konstantin Boudnik d7a7f02c3e HADOOP-6326. Hundson runs should check for AspectJ warnings and report failure if any is present. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829269 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-23 22:33:57 +00:00
Tsz-wo Sze 9b0a0745d8 HADOOP-6329. Add build-fi directory to the ignore lists. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829165 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-23 18:26:01 +00:00
Tsz-wo Sze 4f4c74f76e HADOOP-6327. FileContext tests should not use /tmp and should clean up files. Contributed by Sanjay Radia 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@828886 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-22 22:46:39 +00:00
Devaraj Das 19e8d6ad67 HADOOP-6218. Moving the commit comment to 0.20.2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@828181 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-21 20:11:21 +00:00
Christopher Douglas 22bb3c6b77 Remove entries moved to 0.20.2 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827860 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-21 01:10:08 +00:00
Christopher Douglas 449ac4ab87 HADOOP-6292. Update native libraries guide. Contributed by Corinne Chandel 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827855 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-21 00:32:20 +00:00
Christopher Douglas 7313955d04 HADOOP-6097. Fix Path conversion in makeQualified and reset LineReader byte 
count at the start of each block in Hadoop archives. Contributed by Ben Slusky,
Tom White, and Mahadev Konar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827837 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-20 23:39:49 +00:00
Christopher Douglas 1ecee2e062 HADOOP-6312. Remove unnecessary debug logging in Configuration constructor. Contributed by Aaron Kimball 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826141 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-17 00:22:39 +00:00
Christopher Douglas c5bce7be47 HADOOP-6293. Fix FsShell -text to work on filesystems other than the default. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826120 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-16 22:41:54 +00:00
Konstantin Boudnik 3e9ba35841 HADOOP-6204. Implementing aspects development and fault injeciton framework for Hadoop. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824942 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-13 21:54:48 +00:00
Tsz-wo Sze 512a39264f HADOOP-6309. Change build.xml to run tests with java asserts. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824899 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-13 19:59:17 +00:00
Devaraj Das fed32afd17 HADOOP-6218. Adds a feature where TFile can be split by Record Sequeunce number. Contributed by Hong Tang and Raghu Angadi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824516 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-12 22:07:17 +00:00
Konstantin Boudnik d3c314e450 HADOOP-6305. Unify build property names to facilitate cross-projects modifications. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823756 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-10 01:10:41 +00:00
Konstantin Boudnik 780efea7ae Eclipse .classpath template has outdated jar files and is missing some new 
ones. Contributed by Konstantin Boudnik


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823355 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-08 23:08:59 +00:00
Christopher Douglas b903b25072 HADOOP-6279. Add Runtime::maxMemory to JVM metrics. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823271 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-08 18:54:04 +00:00
Tsz-wo Sze 710d517768 HADOOP-6283. Improve the exception messages thrown by FileUtil$HardLink.getLinkCount(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823263 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-08 18:37:37 +00:00
Suresh Srinivas 64f537da0a HADOOP-6286. Fix bugs in related to URI handling in glob methods in FileContext. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@822805 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-07 17:07:37 +00:00
Tsz-wo Sze 59ab2c5d31 HADOOP-6284. Add a new parameter, HADOOP_JAVA_PLATFORM_OPTS, to hadoop-config.sh so that it allows setting java command options for JAVA_PLATFORM. Contributed by Koji Noguchi 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@820094 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-29 21:26:06 +00:00
Owen O'Malley 2031231edb HADOOP-6285. Fix the result type of the getParameterMap method in the 
HttpServer.QuotingInputFilter. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@819670 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-28 19:03:45 +00:00
Owen O'Malley 9de98c42cb HADOOP-6281. Avoid null pointer exceptions when the jsps don't have 
paramaters (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@818543 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-24 16:47:59 +00:00
Suresh Srinivas 0243cf3672 HADOOP-6261. Add URI based tests for FileContext. Contributed by Ravi Pulari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817823 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-22 20:26:43 +00:00
Suresh Srinivas 373bf85f56 HADOOP-6274. Fix TestLocalFSFileContextMainOperations test failure. Contributed by Gary Murry. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817496 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-22 04:12:45 +00:00
Owen O'Malley 277dd0e2a3 Fix up formatting of header after branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817416 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-21 21:36:13 +00:00
Owen O'Malley 4342710434 Branching for 0.21 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816847 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-19 01:24:39 +00:00
Suresh Srinivas 7cc6a8e8ce HADOOP-6260. Add additional unit tests for FileContext util methods. Contributed by Gary Murray. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816841 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-19 01:02:35 +00:00
Suresh Srinivas 6ef2552953 HADOOP-6233. Rename configuration keys towards API standardization and backward compatibility. Contributed by Jithendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816830 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-19 00:26:01 +00:00
Suresh Srinivas fa48d9ea17 HADOOP-6271. Add recursive and non recursive create and mkdir to FileContext. Contributed by Sanjay Radia. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816818 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-19 00:03:04 +00:00
Suresh Srinivas 1695ecd1a3 HADOOP-6240. Add new FileContext rename operation that posix compliant that allows overwriting existing destination. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816794 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 21:52:59 +00:00
Doug Cutting c722a45f47 HADOOP-6267. Permit building contrib modules located in external source trees. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816752 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 19:22:10 +00:00
Tsz-wo Sze 758f8a5abe HADOOP-6270. Support deleteOnExit in FileContext. Contributed by Suresh Srinivas 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816751 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 19:13:29 +00:00
Doug Cutting ea50f15407 HADOOP-6170. Add facility to tunnel Avro RPCs through Hadoop RPCs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816727 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 17:47:08 +00:00
Owen O'Malley 366b1b1dd6 HADOOP-6151. Added a input filter to all of the http servlets that quotes 
html characters in the parameters, to prevent cross site scripting 
attacks. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816703 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 16:31:34 +00:00
Christopher Douglas 446309b039 HADOOP-6268. Add ivy jar to .gitignore. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816532 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 08:31:02 +00:00
Owen O'Malley bec1f274cc HADOOP-6217. Update documentation for project split. (Corinne Chandel via 
omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816409 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-17 23:24:38 +00:00
Suresh Srinivas 0294c49df6 HADOOP-4952. Add new improved file system interface FileContext for the application writer. Contributed by Sanjay Radia. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816398 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-17 22:27:15 +00:00
Thomas White 7ee09e0939 HADOOP-6257. Two TestFileSystem classes are confusing hadoop-hdfs-hdfwithmr. Contributed by Philip Zeyliger. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815809 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-16 14:41:08 +00:00
Tsz-wo Sze 9164c6319e HADOOP-6216. Support comments in host files. Contributed by Ravi Phulari and Dmytro Molkov 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815524 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-15 22:18:21 +00:00
Hemanth Yamijala 78cff65f33 HADOOP-6250. Modify test-patch to delete copied XML files before running patch build. Contributed by Rahul Kumar Singh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815317 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-15 13:17:07 +00:00
Christopher Douglas 254afbfe96 HADOOP-5879. Read compression level and strategy from Configuration for 
gzip compression. Contributed by He Yongqiang


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814455 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-14 00:45:01 +00:00
Suresh Srinivas 3617ed0bad HADOOP-6246. Add backward compatibility support to use deprecated decimal umask from old configuration. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814080 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-11 23:28:08 +00:00
Christopher Douglas c9cc61e853 HADOOP-6196. Fix a bug in SequenceFile.Reader where syncing within the header 
would cause the reader to read the sync marker as a record. Contributed by Jay Booth


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813698 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-11 07:38:01 +00:00
Suresh Srinivas ae6721a85a HADOOP-6252. Provide a method to determine if a deprecated key is set in config file. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813639 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-11 00:14:22 +00:00
Christopher Douglas 86724941c5 HADOOP-4012. Provide splitting support for bzip2 compressed files. Contributed by Abdul Qadeer 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813581 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-10 20:51:48 +00:00
Tsz-wo Sze efb3e17bed HADOOP-6181. Fix .eclipse.templates/.classpath for avro and jets3t jar files. Contributed by Carlos Valiente 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813179 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-10 00:11:52 +00:00
Suresh Srinivas d9e6a9b15f HADOOP-5073. Add annotation mechanism for interface classification. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812740 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-09 00:43:47 +00:00
Suresh Srinivas cdbb724edb HADOOP-6234. Add new option dfs.umaskmode to set umask in configuration to use octal or symbolic instead of decimal. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812652 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 19:08:08 +00:00
Suresh Srinivas 3f384b42d2 HADOOP-6235. Adds new method to FileSystem for clients to get server defaults. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812597 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 17:54:16 +00:00
Thomas White 174b3e8a74 HADOOP-6009. S3N listStatus incorrectly returns null instead of empty array when called on empty root. Contributed by Ian Nowland. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812479 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 12:18:06 +00:00
Hemanth Yamijala 4a4dd27571 HADOOP-6243. Fix a NullPointerException in processing deprecated keys. Contributed by Sreekanth Ramakrishnan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812455 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 10:56:15 +00:00
Suresh Srinivas d09ade4d0b HADOOP-6203. FsShell rm/rmr error message indicates exceeding Trash quota and suggests using -skpTrash, when moving to trash fails. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812317 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 01:41:17 +00:00
Christopher Douglas f95ec3f5bf HADOOP-6133. Add a caching layer to Configuration::getClassByName to 
alleviate a performance regression introduced in a compatibility layer.
Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812285 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-07 21:54:45 +00:00
Thomas White 9b0b37e410 HADOOP-6229. Attempt to make a directory under an existing file on LocalFileSystem should throw an Exception. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812127 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-07 13:25:48 +00:00
Hemanth Yamijala e24071be0a HADOOP-6105. Adds support for automatically handling deprecation of configuration keys. Contributed by V.V.Chaitanya Krishna. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812078 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-07 11:04:17 +00:00
Hemanth Yamijala e324c20692 HADOOP-6230. Moved process tree and memory calculator related classes from Common to Map/Reduce. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812031 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-07 08:16:09 +00:00
Thomas White 2aee3eda33 HADOOP-6231. Allow caching of filesystem instances to be disabled on a per-instance basis. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@811572 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-04 23:38:00 +00:00
Thomas White d6428581ff HADOOP-6165. Add metadata to Serializations. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810756 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-03 01:36:33 +00:00
Michael Stack e5fef21b18 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1 -- reversing this patch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810714 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 22:19:42 +00:00
Michael Stack 51d1c6ffa7 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810709 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 22:01:34 +00:00
Devaraj Das a3c52b93ea HADOOP-6226. Moves BoundedByteArrayOutputStream from the tfile package to the io package and makes it available to other users (MAPREDUCE-318). Contributed by Jothi Padmanabhan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810451 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 11:07:27 +00:00
Christopher Douglas 9ea11c5fb3 HADOOP-6224. Add a method to WritableUtils supported a bounded read of an 
encoded String. Contributed by Jothi Padmanabhan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810384 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 07:07:21 +00:00
Christopher Douglas faf9fe98ae HADOOP-6199. Move io.map.skip.index property to core-default from mapred. 
Contributed by Amareshwari Sriramadasu


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810329 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 01:26:40 +00:00
Christopher Douglas 6145503acf Revert HADOOP-6224 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810325 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 01:00:34 +00:00
Hemanth Yamijala 75103dc925 HADOOP-6227. Fix Configuration to allow final parameters to be set to null and prevent them from being overridden. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810097 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-01 15:24:56 +00:00
Devaraj Das 4c66882a69 HADOOP-6224. Adds methods to read strings safely, makes the Buffer class in DataOutputBuffer public, and introduces public constructors there. These changes are required for MAPREDUCE-318. Contributed by Jothi Padmanabhan and Arun Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@809491 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-31 07:56:39 +00:00
Sharad Agarwal aa10f303e3 HADOOP-6215. fix GenericOptionParser to deal with -D with '=' in the value. Contributed by Amar Kamat. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@808415 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-27 13:55:19 +00:00
Christopher Douglas 8621b830f8 HADOOP-6166. Further improve the performance of the pure-Java CRC32 
implementation. Contributed by Tsz Wo (Nicholas), SZE


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807753 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-25 18:34:57 +00:00
Tsz-wo Sze a72edd2b10 HADOOP-6152. Fix classpath variables in bin/hadoop-config.sh and some other scripts. Contributed by Aaron Kimball 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807404 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-24 22:06:54 +00:00
Hemanth Yamijala 280ab0cf7d HADOOP-6184. Provide an API to dump Configuration in a JSON format. Contributed by V.V.Chaitanya Krishna. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807149 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-24 11:21:18 +00:00
Christopher Douglas 76a77aea78 HADOOP-6201. Change FileSystem::listStatus contract to throw 
FileNotFoundException if the directory does not exist, rather than letting
this be implementation-specific. Contributed by Jakob Homan.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806745 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-21 22:50:04 +00:00
Devaraj Das 0a8e65c23b HADOOP-6103. Clones the classloader as part of Configuration clone. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806430 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-21 06:59:45 +00:00
Tsz-wo Sze 1f3337996e HADOOP-6173. Change src/native/packageNativeHadoop.sh to package all native library files. Contributed by Hong Tang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806368 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-20 21:28:09 +00:00
Hemanth Yamijala e5b7248682 MAPREDUCE-711. Removed Distributed Cache from Common, to move it under Map/Reduce. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804918 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-17 10:06:36 +00:00
Giridharan Kesavan 07b43463b8 HADOOP-6182. Fix ReleaseAudit warnings. Contributed by Giridharan Kesavan and Lee Tucker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804842 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-17 03:53:27 +00:00
Arun Murthy 7ffe5b7f87 Reverting HADOOP-6182 and HADOOP-6195 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804317 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 18:22:41 +00:00
Giridharan Kesavan 43f95b50f2 HADOOP-6195. Fix checkstyle xml version tag. Contributed by Lee Tucker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804297 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 17:00:03 +00:00
Giridharan Kesavan 2e34ced206 HADOOP-6182. Fix releaseaudit warnings by adding AL Headers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804157 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 10:23:41 +00:00
Arun Murthy ec8208f5d3 HADOOP-6192. Fix Shell.getUlimitMemoryCommand to not rely on Map-Reduce specific configs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804115 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 08:16:10 +00:00
Tsz-wo Sze 38a84a6c98 HADOOP-6188. TestTrash uses java.io.File api but not hadoop FileSystem api. Contributed by Boris Shkolnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803296 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-11 21:03:50 +00:00
Hairong Kuang d70dd1a2df HADOOP-6177. FSInputChecker.getPos() would return position greater than the file size. Contributed by Hong Tang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803190 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-11 16:26:55 +00:00
Tsz-wo Sze 5fe6906f2a HADOOP-6176. Add a couple package private methods to AccessTokenHandler for testing. Contributed by Kan Zhang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802224 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-07 21:40:01 +00:00
Hairong Kuang 09d826ebed HADOOP-6180. NameNode slowed down when many files with same filename were moved to Trash. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802107 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-07 17:59:57 +00:00
Tsz-wo Sze 5f53fd8ead HADOOP-6124. Fix javac warning detection in test-patch.sh. Contributed by Giridharan Kesavan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800919 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-04 19:01:51 +00:00
Mahadev Konar 7be6fc4e5d HADOOP-6169. Removing deprecated method calls in TFile. (hong tang via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800199 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-03 05:06:59 +00:00
Tsz-wo Sze e5ea0ce4a6 HADOOP-6172. Fix jar file names in hadoop-config.sh and include ${build.src} as a part of the source list in build.xml. Contributed by Hong Tang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@799751 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-31 21:37:23 +00:00
Tsz-wo Sze 638a211067 HADOOP-6123. Add missing classpaths in hadoop-config.sh. Contributed by Sharad Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@798247 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-27 18:34:57 +00:00
Giridharan Kesavan 6c12fd3335 HADOOP-6160. Fix ant releaseaudit target to run on specific directories. (Contributed by Giridharan Kesavan) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@798093 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-27 10:09:38 +00:00
Raghu Angadi f4166ddfad move the last change long from trunk to 0.20. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797300 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-24 01:14:52 +00:00
Raghu Angadi e4450e5487 HADOOP-6150. Users should be able to instantiate comparator using TFile 
API. (Hong Tang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797274 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-24 00:11:20 +00:00
Raghu Angadi 53c127013c HADOOP-6132. RPC client create an extra connection because of incorrect 
key for connection cache. (Kan Zhang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797248 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-23 22:28:26 +00:00
Doug Cutting 8296413d49 HADOOP-6120. Add support for Avro specific and reflect data. Contributed by sharad. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797197 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-23 19:21:21 +00:00
Christopher Douglas 3200b2ec58 HADOOP-6161. Add get/setEnum methods to Configuration. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@796052 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-20 22:58:21 +00:00
Tsz-wo Sze 391112f6ce HADOOP-6138. Eliminate the depracate warnings introduced by H-5438. Contributed by He Yongqiang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795172 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 18:01:15 +00:00
Thomas White 5478e9a188 HADOOP-6146. Upgrade to JetS3t version 0.7.1. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795028 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 10:20:00 +00:00
Tsz-wo Sze 8bd2486b51 HADOOP-6148. Implement a fast, pure Java CRC32 calculator which outperforms java.util.zip.CRC32. Contributed by Todd Lipcon and Scott Carey 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794944 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 02:18:06 +00:00
Christopher Douglas fc1bf705e9 HADOOP-6142. Update documentation and use of harchives for relative paths added 
in MAPREDUCE-739. Contributed by Mahadev Konar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794943 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 02:06:42 +00:00
Tsz-wo Sze 466f93c8b6 HADOOP-6145. Fix FsShell rm/rmr error messages when there is a FNFE. Contributed by Jakob Homan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793987 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-14 17:39:33 +00:00
Christopher Douglas c02527fd04 Move HADOOP-3315 from 0.21 to 0.20.1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793162 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-11 01:21:43 +00:00
Tsz-wo Sze d074c686b3 HADOOP-6139. Fix the FsShell help messages for rm and rmr. Contributed by Jakob Homan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793098 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-10 20:26:30 +00:00
Dhruba Borthakur c38c5a43ff HADOOP-6099. The RPC module can be configured to not send period pings. 
The default behaviour remains unchanged. (dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792812 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-10 06:17:55 +00:00
Owen O'Malley 34d67b1cc2 HADOOP-5170. Removed change log entry because HADOOP-5170 was reverted from 
mapreduce.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792701 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-09 21:17:22 +00:00
Giridharan Kesavan 127254f4a5 HADOOP-6137. Fix project specific test-patch requirements 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792440 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-09 08:10:18 +00:00
Mahadev Konar da8cf6702a HADOOP-6131. A sysproperty should not be set unless the property is set on the ant command line in build.xml (hong tang via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792302 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-08 20:35:26 +00:00
Tsz-wo Sze 708f3fc781 HADOOP-5976. Add a new command, classpath, to the hadoop script. Contributed by Owen O'Malley and Gary Murry 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@791937 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-07 18:48:32 +00:00
Dhruba Borthakur cf3d3a0643 HADOOP-6114. Fix javadoc documentation for FileStatus.getLen. 
(Dmitry Rzhevskiy via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790277 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-01 17:20:42 +00:00
Tsz-wo Sze b8d9ca281d HADOOP-6122. The great than operator in test-patch.sh should be "-gt" but not ">". 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790009 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-01 00:56:15 +00:00
Tsz-wo Sze a13237975d HADOOP-2366. Support trimmed strings in Configuration. Contributed by Michele Catasta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789973 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-30 21:45:00 +00:00
Konstantin Shvachko 80bc92ac35 HADOOP-6080 is going to 0.20. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789876 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-30 18:52:11 +00:00
Konstantin Shvachko 4824a54419 HADOOP-6080. Introduce -skipTrash option to rm and rmr. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789875 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-30 18:48:45 +00:00
Christopher Douglas e93ebeae51 HADOOP-6109. Change Text to grow its internal buffer exponentially, rather 
than the max of the current length and the proposed length to improve
performance reading large values. Contributed by thushara wijeratna


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789242 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-29 07:16:56 +00:00
Konstantin Shvachko 1d6d98c9fb HADOOP-5897. Promote new name-node metrics to branch 0.20. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788900 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-26 22:52:51 +00:00
Thomas White efc6df7a11 HADOOP-5925. EC2 scripts should exit on error. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788699 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-26 13:40:07 +00:00
Hemanth Yamijala b089f4448d HADOOP-6106. Provides an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time. Contributed by Sreekanth Ramakrishnan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788600 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-26 06:18:04 +00:00
Christopher Douglas 8246aa28ff HADOOP-3315. Add a new, binary file foramt, TFile. Contributed by Hong Tang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787913 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-24 05:48:25 +00:00
Thomas White 84541f6f91 HADOOP-6096. Fix Eclipse project and classpath files following project split. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787709 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-23 15:29:09 +00:00
Tsz-wo Sze 2c372c70cf HADOOP-5952. Change "-1 tests included" wording in test-patch.sh. Contributed by Gary Murry 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787541 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-23 04:45:15 +00:00
Owen O'Malley fb6308f280 HADOOP-4687. More merges from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786712 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-19 23:12:41 +00:00
Owen O'Malley b12d765467 HADOOP-4687. Merge -r 784663:785643 from trunk to branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@785794 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-17 20:55:51 +00:00
Owen O'Malley c2d07b4fcd HADOOP-4687. Updating CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@785393 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-16 20:55:03 +00:00
Owen O'Malley c94ff0f240 HADOOP-4687 More moving around 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776175 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-19 04:30:38 +00:00