Commit Graph

18840 Commits

Author SHA1 Message Date
Hairong Kuang fb154e3a03 HADOOP-6691. TestFileSystemCaching sometimes hangs. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@932115 13f79535-47bb-0310-9956-ffa450edef68
2010-04-08 21:13:58 +00:00
Thomas White 4c062c79c3 HADOOP-6680. hadoop-cloud push command invokes proxy creation. Contributed by Andrew Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@931226 13f79535-47bb-0310-9956-ffa450edef68
2010-04-06 17:05:11 +00:00
Hairong Kuang 7b1ac5ac13 HADOOP-6640. FileSystem.get() does RPC retries within a static synchronized block. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@930096 13f79535-47bb-0310-9956-ffa450edef68
2010-04-01 20:58:10 +00:00
Tsz-wo Sze 6f35c10aab HADOOP-6654. Fix code example in WritableComparable javadoc. Contributed by Tom White
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927979 13f79535-47bb-0310-9956-ffa450edef68
2010-03-26 17:38:47 +00:00
Christopher Douglas f4d31cd029 HADOOP-6566. Add methods supporting, enforcing narrower permissions on local daemon directories.
Contributed by Arun Murthy and Luke Lu


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927728 13f79535-47bb-0310-9956-ffa450edef68
2010-03-26 08:25:00 +00:00
Mahadev Konar 980f819047 HADOOP-6646. Move HarfileSystem out of Hadoop Common. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927193 13f79535-47bb-0310-9956-ffa450edef68
2010-03-24 21:43:24 +00:00
Mahadev Konar e381af1e1e HADOOP-6645. Re: Bugs on listStatus for HarFileSystem (rodrigo via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927134 13f79535-47bb-0310-9956-ffa450edef68
2010-03-24 17:51:38 +00:00
Mahadev Konar 35de12b8ed HADOOP-6645. Bugs on listStatus for HarFileSystem (rodrigo via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@926421 13f79535-47bb-0310-9956-ffa450edef68
2010-03-23 01:16:03 +00:00
Thomas White 0485fe23ba HADOOP-6471. StringBuffer -> StringBuilder - conversion of references as necessary. Contributed by Kay Kay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@926256 13f79535-47bb-0310-9956-ffa450edef68
2010-03-22 19:08:03 +00:00
Thomas White 124137ff01 HADOOP-6175. Incorrect version compilation with es_ES.ISO8859-15 locale on Solaris 10. Contributed by Urko Benito.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@926252 13f79535-47bb-0310-9956-ffa450edef68
2010-03-22 18:46:44 +00:00
Konstantin Shvachko 81c448ae85 HADOOP-6637. Benchmark for establishing RPC session. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925528 13f79535-47bb-0310-9956-ffa450edef68
2010-03-20 02:17:38 +00:00
Thomas White f32ffc750a HADOOP-6593. TextRecordInputStream doesn't close SequenceFile.Reader. Contributed by Chase Bradford.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925487 13f79535-47bb-0310-9956-ffa450edef68
2010-03-19 23:52:51 +00:00
Thomas White c8ffb2249a HADOOP-6546. BloomMapFile can return false negatives. Contributed by Clark Jefcoat.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925479 13f79535-47bb-0310-9956-ffa450edef68
2010-03-19 23:19:13 +00:00
Thomas White a0a4bf08d3 HADOOP-3659. Patch to allow hadoop native to compile on Mac OS X. Contributed by Colin Evans and Allen Wittenauer.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925468 13f79535-47bb-0310-9956-ffa450edef68
2010-03-19 22:51:29 +00:00
Thomas White b769d6463b HADOOP-6407. Have a way to automatically update Eclipse .classpath file when new libs are added to the classpath through Ivy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925465 13f79535-47bb-0310-9956-ffa450edef68
2010-03-19 22:39:28 +00:00
Dhruba Borthakur 637cf89e18 HADOOP-6591. HarFileSystem can handle paths with the whitespace characters.
(Rodrigo Schmidt via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@923619 13f79535-47bb-0310-9956-ffa450edef68
2010-03-16 08:03:38 +00:00
Doug Cutting 6e86a671e0 HADOOP-6486. Update a few straggling references to Avro 1.2.0 to 1.3.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@921980 13f79535-47bb-0310-9956-ffa450edef68
2010-03-11 18:49:38 +00:00
Thomas White 74d409c4bb HADOOP-6486. fix common classes to work with Avro 1.3 reflection. Contributed by cutting.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@921577 13f79535-47bb-0310-9956-ffa450edef68
2010-03-10 21:24:13 +00:00
Thomas White fe01f920a1 HADOOP-6504. Invalid example in the documentation of org.apache.hadoop.util.Tool. Contributed by Benoit Sigoure.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@921542 13f79535-47bb-0310-9956-ffa450edef68
2010-03-10 20:06:07 +00:00
Owen O'Malley b1ec35e60c HADOOP-6609. Fixed deadlock in RPC by replacing shared static
DataOutputBuffer in the UTF8 class with a thread local variable. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918880 13f79535-47bb-0310-9956-ffa450edef68
2010-03-04 07:20:29 +00:00
Hairong Kuang 393baff732 HADOOP-6569. FsShell#cat should avoid calling unecessary getFileStatus before opening a file to read. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918624 13f79535-47bb-0310-9956-ffa450edef68
2010-03-03 18:49:26 +00:00
Sanjay Radia 1ab5aa5279 HADOOP-6537 Declare more detailed exceptions in FileContext and AbstractFileSystem
(Suresh Srinivas via Sanjay Radia)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918309 13f79535-47bb-0310-9956-ffa450edef68
2010-03-03 02:48:49 +00:00
Sanjay Radia 6b9fb8c78b HADOOP-6599 Split existing RpcMetrics into RpcMetrics & RpcDetailedMetrics.
(Suresh Srinivas via Sanjay Radia)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@917737 13f79535-47bb-0310-9956-ffa450edef68
2010-03-01 21:36:23 +00:00
Christopher Douglas b4e4ed2b14 Set JDiff stable to 0.20.2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@917674 13f79535-47bb-0310-9956-ffa450edef68
2010-03-01 19:45:32 +00:00
Christopher Douglas 80d0e78a03 JDiff output for release 0.20.2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@917671 13f79535-47bb-0310-9956-ffa450edef68
2010-03-01 19:43:49 +00:00
Owen O'Malley c93a9128ff HADOOP-6589. Provide better error messages when RPC authentication fails.
(Kan Zhang via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916915 13f79535-47bb-0310-9956-ffa450edef68
2010-02-27 06:17:00 +00:00
Arun Murthy 1d8cb8b785 HADOOP-6594. Provide a fetchdt tool via bin/hdfs. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916907 13f79535-47bb-0310-9956-ffa450edef68
2010-02-27 03:31:19 +00:00
Boris Shkolnik c4c122a0de HADOOP-6586. Log authentication and authorization failures and successes for RPC
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916779 13f79535-47bb-0310-9956-ffa450edef68
2010-02-26 18:35:54 +00:00
Konstantin Shvachko ea650d8d6c HADOOP-1849. Add undocumented configuration parameter for per handler call queue size in IPC Server. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916529 13f79535-47bb-0310-9956-ffa450edef68
2010-02-26 01:37:57 +00:00
Konstantin Shvachko 27ab7f3db9 HADOOP-6573. Support for persistent delegation tokens. Contributed by Jitendra Pandey.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916468 13f79535-47bb-0310-9956-ffa450edef68
2010-02-25 21:43:20 +00:00
Devaraj Das 7785232da5 HADOOP-6568. Adds authorization for the default servlets. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916467 13f79535-47bb-0310-9956-ffa450edef68
2010-02-25 21:39:38 +00:00
Owen O'Malley 37214591e9 HADOOP-6596. Add a version field to the AbstractDelegationTokenIdentifier's
serialized value. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916390 13f79535-47bb-0310-9956-ffa450edef68
2010-02-25 18:34:05 +00:00
Owen O'Malley 831da66493 HADOOP-6579. Provide a mechanism for encoding/decoding Tokens from
a url-safe string and change the commons-code library to 1.4. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916290 13f79535-47bb-0310-9956-ffa450edef68
2010-02-25 14:14:18 +00:00
Tsz-wo Sze 4eedc77275 HADOOP-6467. Improve the performance on HarFileSystem.listStatus(..). Contributed by mahadev
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915168 13f79535-47bb-0310-9956-ffa450edef68
2010-02-23 03:54:14 +00:00
Devaraj Das c5622e5d4d HADOOP-6543. Allows secure clients to talk to unsecure clusters. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915097 13f79535-47bb-0310-9956-ffa450edef68
2010-02-22 22:28:29 +00:00
Devaraj Das ffdde40b9f HADOOP-6583. Captures authentication and authorization metrics. Contributed by Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915095 13f79535-47bb-0310-9956-ffa450edef68
2010-02-22 22:26:03 +00:00
Devaraj Das 115ef5b8c7 HADOOP-6545. Changes the Key for the FileSystem cache to be UGI. Contributed by Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912207 13f79535-47bb-0310-9956-ffa450edef68
2010-02-20 20:13:26 +00:00
Suresh Srinivas 9871771bb5 HADOOP-6577. Add hidden configuration option "ipc.server.max.response.size" to change the default 1 MB, the maximum size when large IPC handler response buffer is reset. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912056 13f79535-47bb-0310-9956-ffa450edef68
2010-02-20 01:23:26 +00:00
Devaraj Das d099c1c78a HADOOP-6572. Makes sure that SASL encryption and push to responder queue for the RPC response happens atomically. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911748 13f79535-47bb-0310-9956-ffa450edef68
2010-02-19 09:04:47 +00:00
Owen O'Malley a417a8faea HADOOP-6551. Delegation token renewing and cancelling should provide
meaningful exceptions when there are failures instead of returning 
false. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911743 13f79535-47bb-0310-9956-ffa450edef68
2010-02-19 08:49:22 +00:00
Tsz-wo Sze 50dcc335be HADOOP-6558. Return null in HarFileSystem.getFileChecksum(..) since no checksum algorithm is implemented.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911646 13f79535-47bb-0310-9956-ffa450edef68
2010-02-18 23:22:52 +00:00
Hairong Kuang 4b4e9d741e HADOOP-6570. RPC#stopProxy throws NPE if getProxyEngine(proxy) returns null. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911134 13f79535-47bb-0310-9956-ffa450edef68
2010-02-17 18:22:40 +00:00
Boris Shkolnik 3a7841aeb8 HADOOP-6549. TestDoAsEffectiveUser should use ip address of the host for superuser ip check
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910741 13f79535-47bb-0310-9956-ffa450edef68
2010-02-16 22:46:36 +00:00
Tsz-wo Sze 18c6d65749 HADOOP-6560. Handle invalid har:// uri in HarFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910726 13f79535-47bb-0310-9956-ffa450edef68
2010-02-16 22:17:54 +00:00
Owen O'Malley 44185c3874 prep for making 0.20.2 rc2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910709 13f79535-47bb-0310-9956-ffa450edef68
2010-02-16 21:53:15 +00:00
Sanjay Radia ea605b8cd7 HADOOP-6421 Adds Symbolic links to FileContext, AbstractFileSystem.
It also adds a limited implementation for the local file system
     (RawLocalFs) that allows local symlinks. (Eli Collins via Sanjay Radia)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910706 13f79535-47bb-0310-9956-ffa450edef68
2010-02-16 21:43:30 +00:00
Devaraj Das 8b4b190cbd HADOOP-6559. Makes the RPC client automatically re-login when the SASL connection setup fails. This is applicable only to keytab based logins. Contributed by Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910169 13f79535-47bb-0310-9956-ffa450edef68
2010-02-15 07:28:17 +00:00
Christopher Douglas 96a1477d02 HADOOP-6534. Trim whitespace from directory lists initializing
LocalDirAllocator. Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909806 13f79535-47bb-0310-9956-ffa450edef68
2010-02-13 12:46:38 +00:00
Christopher Douglas fc83909c3f HADOOP-6548. Replace mortbay imports with commons logging.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909802 13f79535-47bb-0310-9956-ffa450edef68
2010-02-13 12:21:26 +00:00
Christopher Douglas e0a0e6b9f5 HADOOP-6505. Use tr rather than sed to effect literal substitution in the
build script. Contributed by Allen Wittenauer


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909801 13f79535-47bb-0310-9956-ffa450edef68
2010-02-13 12:16:52 +00:00