Commit Graph

383 Commits

Author SHA1 Message Date
Owen O'Malley b1ec35e60c HADOOP-6609. Fixed deadlock in RPC by replacing shared static
DataOutputBuffer in the UTF8 class with a thread local variable. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918880 13f79535-47bb-0310-9956-ffa450edef68
2010-03-04 07:20:29 +00:00
Hairong Kuang 393baff732 HADOOP-6569. FsShell#cat should avoid calling unecessary getFileStatus before opening a file to read. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918624 13f79535-47bb-0310-9956-ffa450edef68
2010-03-03 18:49:26 +00:00
Sanjay Radia 1ab5aa5279 HADOOP-6537 Declare more detailed exceptions in FileContext and AbstractFileSystem
(Suresh Srinivas via Sanjay Radia)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918309 13f79535-47bb-0310-9956-ffa450edef68
2010-03-03 02:48:49 +00:00
Sanjay Radia 6b9fb8c78b HADOOP-6599 Split existing RpcMetrics into RpcMetrics & RpcDetailedMetrics.
(Suresh Srinivas via Sanjay Radia)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@917737 13f79535-47bb-0310-9956-ffa450edef68
2010-03-01 21:36:23 +00:00
Owen O'Malley c93a9128ff HADOOP-6589. Provide better error messages when RPC authentication fails.
(Kan Zhang via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916915 13f79535-47bb-0310-9956-ffa450edef68
2010-02-27 06:17:00 +00:00
Arun Murthy 1d8cb8b785 HADOOP-6594. Provide a fetchdt tool via bin/hdfs. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916907 13f79535-47bb-0310-9956-ffa450edef68
2010-02-27 03:31:19 +00:00
Boris Shkolnik c4c122a0de HADOOP-6586. Log authentication and authorization failures and successes for RPC
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916779 13f79535-47bb-0310-9956-ffa450edef68
2010-02-26 18:35:54 +00:00
Konstantin Shvachko ea650d8d6c HADOOP-1849. Add undocumented configuration parameter for per handler call queue size in IPC Server. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916529 13f79535-47bb-0310-9956-ffa450edef68
2010-02-26 01:37:57 +00:00
Konstantin Shvachko 27ab7f3db9 HADOOP-6573. Support for persistent delegation tokens. Contributed by Jitendra Pandey.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916468 13f79535-47bb-0310-9956-ffa450edef68
2010-02-25 21:43:20 +00:00
Devaraj Das 7785232da5 HADOOP-6568. Adds authorization for the default servlets. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916467 13f79535-47bb-0310-9956-ffa450edef68
2010-02-25 21:39:38 +00:00
Owen O'Malley 37214591e9 HADOOP-6596. Add a version field to the AbstractDelegationTokenIdentifier's
serialized value. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916390 13f79535-47bb-0310-9956-ffa450edef68
2010-02-25 18:34:05 +00:00
Owen O'Malley 831da66493 HADOOP-6579. Provide a mechanism for encoding/decoding Tokens from
a url-safe string and change the commons-code library to 1.4. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916290 13f79535-47bb-0310-9956-ffa450edef68
2010-02-25 14:14:18 +00:00
Tsz-wo Sze 4eedc77275 HADOOP-6467. Improve the performance on HarFileSystem.listStatus(..). Contributed by mahadev
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915168 13f79535-47bb-0310-9956-ffa450edef68
2010-02-23 03:54:14 +00:00
Devaraj Das c5622e5d4d HADOOP-6543. Allows secure clients to talk to unsecure clusters. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915097 13f79535-47bb-0310-9956-ffa450edef68
2010-02-22 22:28:29 +00:00
Devaraj Das ffdde40b9f HADOOP-6583. Captures authentication and authorization metrics. Contributed by Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915095 13f79535-47bb-0310-9956-ffa450edef68
2010-02-22 22:26:03 +00:00
Devaraj Das 115ef5b8c7 HADOOP-6545. Changes the Key for the FileSystem cache to be UGI. Contributed by Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912207 13f79535-47bb-0310-9956-ffa450edef68
2010-02-20 20:13:26 +00:00
Suresh Srinivas 9871771bb5 HADOOP-6577. Add hidden configuration option "ipc.server.max.response.size" to change the default 1 MB, the maximum size when large IPC handler response buffer is reset. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912056 13f79535-47bb-0310-9956-ffa450edef68
2010-02-20 01:23:26 +00:00
Devaraj Das d099c1c78a HADOOP-6572. Makes sure that SASL encryption and push to responder queue for the RPC response happens atomically. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911748 13f79535-47bb-0310-9956-ffa450edef68
2010-02-19 09:04:47 +00:00
Owen O'Malley a417a8faea HADOOP-6551. Delegation token renewing and cancelling should provide
meaningful exceptions when there are failures instead of returning 
false. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911743 13f79535-47bb-0310-9956-ffa450edef68
2010-02-19 08:49:22 +00:00
Tsz-wo Sze 50dcc335be HADOOP-6558. Return null in HarFileSystem.getFileChecksum(..) since no checksum algorithm is implemented.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911646 13f79535-47bb-0310-9956-ffa450edef68
2010-02-18 23:22:52 +00:00
Hairong Kuang 4b4e9d741e HADOOP-6570. RPC#stopProxy throws NPE if getProxyEngine(proxy) returns null. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911134 13f79535-47bb-0310-9956-ffa450edef68
2010-02-17 18:22:40 +00:00
Boris Shkolnik 3a7841aeb8 HADOOP-6549. TestDoAsEffectiveUser should use ip address of the host for superuser ip check
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910741 13f79535-47bb-0310-9956-ffa450edef68
2010-02-16 22:46:36 +00:00
Tsz-wo Sze 18c6d65749 HADOOP-6560. Handle invalid har:// uri in HarFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910726 13f79535-47bb-0310-9956-ffa450edef68
2010-02-16 22:17:54 +00:00
Owen O'Malley 44185c3874 prep for making 0.20.2 rc2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910709 13f79535-47bb-0310-9956-ffa450edef68
2010-02-16 21:53:15 +00:00
Sanjay Radia ea605b8cd7 HADOOP-6421 Adds Symbolic links to FileContext, AbstractFileSystem.
It also adds a limited implementation for the local file system
     (RawLocalFs) that allows local symlinks. (Eli Collins via Sanjay Radia)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910706 13f79535-47bb-0310-9956-ffa450edef68
2010-02-16 21:43:30 +00:00
Devaraj Das 8b4b190cbd HADOOP-6559. Makes the RPC client automatically re-login when the SASL connection setup fails. This is applicable only to keytab based logins. Contributed by Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910169 13f79535-47bb-0310-9956-ffa450edef68
2010-02-15 07:28:17 +00:00
Christopher Douglas 96a1477d02 HADOOP-6534. Trim whitespace from directory lists initializing
LocalDirAllocator. Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909806 13f79535-47bb-0310-9956-ffa450edef68
2010-02-13 12:46:38 +00:00
Christopher Douglas fc83909c3f HADOOP-6548. Replace mortbay imports with commons logging.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909802 13f79535-47bb-0310-9956-ffa450edef68
2010-02-13 12:21:26 +00:00
Christopher Douglas e0a0e6b9f5 HADOOP-6505. Use tr rather than sed to effect literal substitution in the
build script. Contributed by Allen Wittenauer


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909801 13f79535-47bb-0310-9956-ffa450edef68
2010-02-13 12:16:52 +00:00
Christopher Douglas 139b2ea1a2 HADOOP-5612. Commit to branch 0.20
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909721 13f79535-47bb-0310-9956-ffa450edef68
2010-02-13 04:05:08 +00:00
Christopher Douglas e9ff6510bd HADOOP-5611. Commit to branch 0.20
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909242 13f79535-47bb-0310-9956-ffa450edef68
2010-02-12 05:28:35 +00:00
Doug Cutting 8061821ca2 HADOOP-6522. Fix decoding of codepoint zero in UTF8.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@908661 13f79535-47bb-0310-9956-ffa450edef68
2010-02-10 21:58:11 +00:00
Devaraj Das cfbdd1aff4 HADOOP-6552. Puts renewTGT=true and useTicketCache=true for the keytab kerberos options. Contributed by Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@908353 13f79535-47bb-0310-9956-ffa450edef68
2010-02-10 05:01:27 +00:00
Owen O'Malley 38c59c0af7 HADOOP-6547. Move DelegationToken into Common, so that it can be used by
MapReduce also. (devaraj via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907956 13f79535-47bb-0310-9956-ffa450edef68
2010-02-09 08:10:37 +00:00
Thomas White 5b0d8a0162 HADOOP-6540. Contrib unit tests have invalid XML for core-site, etc. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907939 13f79535-47bb-0310-9956-ffa450edef68
2010-02-09 06:03:59 +00:00
Devaraj Das 1793e7d909 HADOOP-6510. Adds a way for superusers to impersonate other users in a secure environment. Contributed by Jitendra Nath Pandey.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907549 13f79535-47bb-0310-9956-ffa450edef68
2010-02-08 04:55:11 +00:00
Devaraj Das f786508cd3 HADOOP-6538. Sets hadoop.security.authentication to simple by default. Contributed by Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@906388 13f79535-47bb-0310-9956-ffa450edef68
2010-02-04 07:46:20 +00:00
Hemanth Yamijala 9f7a07f908 HADOOP-6531. Enhance FileUtil with an API to delete all contents of a directory. Contributed by Amareshwari Sriramadasu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@906177 13f79535-47bb-0310-9956-ffa450edef68
2010-02-03 19:04:36 +00:00
Devaraj Das 940389afce HADOOP-6419. Adds SASL based authentication to RPC. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@905860 13f79535-47bb-0310-9956-ffa450edef68
2010-02-03 01:30:25 +00:00
Devaraj Das fe0ddc03e1 HADOOP-6518. Makes the UGI honor the env var KRB5CCNAME. Contributed by Owen O'Malley.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904975 13f79535-47bb-0310-9956-ffa450edef68
2010-01-31 04:04:38 +00:00
Devaraj Das ba8647f511 HADOOP-6520. Adds APIs to read/write Token and secret keys. Also adds the automatic loading of tokens into UserGroupInformation upon login. The tokens are read from a file specified in the environment variable. Contributed by Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904861 13f79535-47bb-0310-9956-ffa450edef68
2010-01-30 19:57:39 +00:00
Devaraj Das 611340714b HADOOP-6517. Fix UserGroupInformation so that tokens are saved/retrieved to/from the embedded Subject. Contributed by Owen O'Malley & Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904339 13f79535-47bb-0310-9956-ffa450edef68
2010-01-29 01:56:57 +00:00
Owen O'Malley 0c5734e4ac HADOOP-6299. Reimplement the UserGroupInformation to use the OS
specific and Kerberos JAAS login. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903560 13f79535-47bb-0310-9956-ffa450edef68
2010-01-27 08:08:29 +00:00
Hairong Kuang 34d1b39c75 HADOOP-6498. IPC client bug may cause rpc call hang. Contributed by Ruyue Ma and Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903471 13f79535-47bb-0310-9956-ffa450edef68
2010-01-26 22:55:17 +00:00
Hairong Kuang d6f4cf3dfe Revert commit 903015 because it was tagged with the wrong jira number HADOOP-6459.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903468 13f79535-47bb-0310-9956-ffa450edef68
2010-01-26 22:52:05 +00:00
Hairong Kuang 3ef40e1344 HADOOP-6459. IPC client bug may cause rpc call hang. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903015 13f79535-47bb-0310-9956-ffa450edef68
2010-01-25 23:51:13 +00:00
Christopher Douglas f38a996b4c HADOOP-6290. Prevent duplicate slf4j-simple jar via Avro's classpath.
Contributed by Owen O'Malley


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@902745 13f79535-47bb-0310-9956-ffa450edef68
2010-01-25 09:29:09 +00:00
Boris Shkolnik aaf3b6c6ff HADOOP-6495. Identifier should be serialized after the password is
created In Token constructor (jnp via boryas)  


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@901924 13f79535-47bb-0310-9956-ffa450edef68
2010-01-21 23:36:13 +00:00
Konstantin Boudnik c7a3c785f8 HADOOP-6374. JUnit tests should never depend on anything in conf. Contributed by Anatoli Fomenko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@901540 13f79535-47bb-0310-9956-ffa450edef68
2010-01-21 05:57:30 +00:00
Doug Cutting f3477eb324 HADOOP-6497. Add an adapter for Avro's SeekableInput interface, so that Avro can read FileSystem data. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@900607 13f79535-47bb-0310-9956-ffa450edef68
2010-01-18 23:39:04 +00:00
Doug Cutting 4cd159e83e HADOOP-6492. Make some Avro serialization APIs public. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@899866 13f79535-47bb-0310-9956-ffa450edef68
2010-01-16 01:06:57 +00:00
Suresh Srinivas a90d3205d2 HADOOP-6489. Fix 3 findbugs warnings. Contributed by Erik Steffl.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@899856 13f79535-47bb-0310-9956-ffa450edef68
2010-01-16 00:44:40 +00:00
Christopher Douglas 08561f76db HADOOP-6155. Deprecate RecordIO anticipating Avro. Contributed by Tom White
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898740 13f79535-47bb-0310-9956-ffa450edef68
2010-01-13 13:26:11 +00:00
Christopher Douglas daed679fc1 HADOOP-6451. Fix build to run contrib unit tests. Contributed by Tom White
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898736 13f79535-47bb-0310-9956-ffa450edef68
2010-01-13 13:14:29 +00:00
Christopher Douglas 4cecab7c10 HADOOP-6315. Avoid incorrect use of BuiltInflater/BuiltInDeflater in
GzipCodec. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898711 13f79535-47bb-0310-9956-ffa450edef68
2010-01-13 10:46:39 +00:00
Thomas White 8942119b04 HADOOP-6464. Write a Rackspace cloud provider.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@897023 13f79535-47bb-0310-9956-ffa450edef68
2010-01-07 21:43:38 +00:00
Christopher Douglas 1ca1bfb2e5 HADOOP-6420. Add functionality permitting subsets of Configuration to be
interpreted as Map<String,String>. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896966 13f79535-47bb-0310-9956-ffa450edef68
2010-01-07 18:55:45 +00:00
Thomas White dec4c1614e HADOOP-6479. TestUTF8 assertions could fail with better text. Contributed by Steve Loughran.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896691 13f79535-47bb-0310-9956-ffa450edef68
2010-01-06 22:03:33 +00:00
Thomas White 889528e387 HADOOP-6408. Add a /conf servlet to dump running configuration. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896641 13f79535-47bb-0310-9956-ffa450edef68
2010-01-06 19:44:07 +00:00
Thomas White b55377a30d HADOOP-6466. Add a ZooKeeper service to the cloud scripts.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896259 13f79535-47bb-0310-9956-ffa450edef68
2010-01-05 22:54:51 +00:00
Thomas White ae91b5d0f4 HADOOP-3205. Read multiple chunks directly from FSInputChecker subclass into user buffers. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896243 13f79535-47bb-0310-9956-ffa450edef68
2010-01-05 22:14:17 +00:00
Thomas White efcad06506 HADOOP-6443. Serialization classes accept invalid metadata. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895831 13f79535-47bb-0310-9956-ffa450edef68
2010-01-05 00:06:09 +00:00
Boris Shkolnik 3cb2e3112b HADOOP-6472. add tokenCache option to GenericOptionsParser for passing
file with secret keys to a map reduce job. (boryas)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895801 13f79535-47bb-0310-9956-ffa450edef68
2010-01-04 22:14:34 +00:00
Thomas White 7d2440515c HADOOP-6402. testConf.xsl is not well-formed XML. Contributed by Steve Loughran.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@894706 13f79535-47bb-0310-9956-ffa450edef68
2009-12-30 20:32:42 +00:00
Suresh Srinivas 29a1ba1e8f HADOOP-6460. Reinitializes buffers used for serializing responses in ipc server on exceeding maximum response size to free up Java heap. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893666 13f79535-47bb-0310-9956-ffa450edef68
2009-12-24 00:47:20 +00:00
Thomas White d115e2cc3a HADOOP-6435. Make RPC.waitForProxy with timeout public. Contributed by Steve Loughran.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893612 13f79535-47bb-0310-9956-ffa450edef68
2009-12-23 19:36:14 +00:00
Konstantin Boudnik bb9a3d38b4 Correction for the placement of some JIRAs: were put to the trunk's sections
instead of ones for Release 0.21.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893306 13f79535-47bb-0310-9956-ffa450edef68
2009-12-22 20:31:39 +00:00
Thomas White 0ebcb62515 HADOOP-6454. Create setup.py for EC2 cloud scripts.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893262 13f79535-47bb-0310-9956-ffa450edef68
2009-12-22 18:33:48 +00:00
Thomas White d2bae8756c HADOOP-6444. Support additional security group option in hadoop-ec2 script. Contributed by Paul Egan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893251 13f79535-47bb-0310-9956-ffa450edef68
2009-12-22 18:06:02 +00:00
Thomas White 3d3e1ff3f8 HADOOP-6462. Target compile does not exist in contrib/cloud.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893248 13f79535-47bb-0310-9956-ffa450edef68
2009-12-22 18:02:45 +00:00
Devaraj Das fe479755c3 HADOOP-6415. Adds a common token interface for both job token and delegation token. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@892113 13f79535-47bb-0310-9956-ffa450edef68
2009-12-18 02:33:11 +00:00
Boris Shkolnik ae93ba7501 HADOOP-4656. Add a user to groups mapping service (boryas and acmurthy_)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@892066 13f79535-47bb-0310-9956-ffa450edef68
2009-12-18 01:29:05 +00:00
Suresh Srinivas ea5db0c5ab HADOOP-6394. Add a helper class to simplify FileContext related tests and improve code reusability. Contributed by Jitendra Nath Pandey.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891511 13f79535-47bb-0310-9956-ffa450edef68
2009-12-17 01:30:33 +00:00
Thomas White 6a1e8bf452 HADOOP-6426. Create ant build for running EC2 unit tests.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891497 13f79535-47bb-0310-9956-ffa450edef68
2009-12-17 00:49:01 +00:00
Owen O'Malley 875c9d62c6 HADOOP-6441. Protect web ui from cross site scripting attacks (XSS) on
the host http header and using encoded utf-7. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891132 13f79535-47bb-0310-9956-ffa450edef68
2009-12-16 06:31:51 +00:00
Konstantin Boudnik e8d9bf47ab HADOOP-6222. Core doesn't have TestCommonCLI facility. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890964 13f79535-47bb-0310-9956-ffa450edef68
2009-12-15 19:59:20 +00:00
Thomas White 7a9ec5d90b Reverting HADOOP-5901. FileSystem.fixName() has unexpected behaviour.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890941 13f79535-47bb-0310-9956-ffa450edef68
2009-12-15 18:59:04 +00:00
Thomas White 74b46cf87e HADOOP-5901. FileSystem.fixName() has unexpected behaviour. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890651 13f79535-47bb-0310-9956-ffa450edef68
2009-12-15 05:43:03 +00:00
Thomas White a0e1451108 HADOOP-6413. Move TestReflectionUtils to Common. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890585 13f79535-47bb-0310-9956-ffa450edef68
2009-12-15 00:38:38 +00:00
Thomas White ee6468b8a1 HADOOP-5958. Use JDK 1.6 File APIs in DF.java wherever possible. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890576 13f79535-47bb-0310-9956-ffa450edef68
2009-12-15 00:10:13 +00:00
Thomas White e28b9aefd7 HADOOP-6391. Classpath should not be part of command line arguments. Contributed by Cristian Ivascu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890561 13f79535-47bb-0310-9956-ffa450edef68
2009-12-14 23:46:28 +00:00
Thomas White 22fb49704b HADOOP-6414. Add command line help for -expunge command. Contributed by Ravi Phulari.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890551 13f79535-47bb-0310-9956-ffa450edef68
2009-12-14 23:28:40 +00:00
Dhruba Borthakur c4e1126980 HADOOP-6433. Introduce asychronous deletion of files via a pool of
threads. This can be used to delete files in the Distributed Cache. 
(Zheng Shao via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890502 13f79535-47bb-0310-9956-ffa450edef68
2009-12-14 22:17:19 +00:00
Doug Cutting 6c842ad4b5 AVRO-6422. Make RPC backend plugable.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889889 13f79535-47bb-0310-9956-ffa450edef68
2009-12-12 04:37:06 +00:00
Doug Cutting 843ac12f7a HADOOP-6323. Add comparators to the serialization API. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889877 13f79535-47bb-0310-9956-ffa450edef68
2009-12-12 01:26:22 +00:00
Konstantin Boudnik d7fb2d3c85 HADOOP-6428. HttpServer sleeps with negative values. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889378 13f79535-47bb-0310-9956-ffa450edef68
2009-12-10 19:26:07 +00:00
Thomas White a473f37733 HADOOP-6346. Add support for specifying unpack pattern regex to RunJar.unJar. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889018 13f79535-47bb-0310-9956-ffa450edef68
2009-12-09 23:25:51 +00:00
Thomas White 2e5fd1c0ab HADOOP-6392. Run namenode and jobtracker on separate EC2 instances.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888998 13f79535-47bb-0310-9956-ffa450edef68
2009-12-09 21:57:10 +00:00
Thomas White 368b6cc85b HADOOP-6254. Slow reads cause s3n to fail with SocketTimeoutException. Contributed by Andrew Hitchcock.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888697 13f79535-47bb-0310-9956-ffa450edef68
2009-12-09 04:17:02 +00:00
Konstantin Boudnik 929e91a08c HADOOP-6386. NameNode's HttpServer can't instantiate InetSocketAddress: IllegalArgumentException is thrown. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888565 13f79535-47bb-0310-9956-ffa450edef68
2009-12-08 20:50:47 +00:00
Jakob Homan 934deda190 HADOOP-6396. Fix unhelpful exception message when unable to parse umask (jghoman)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887472 13f79535-47bb-0310-9956-ffa450edef68
2009-12-05 00:46:08 +00:00
Konstantin Boudnik 3549d30d7e HADOOP-6411. Remove deprecated file src/test/hadoop-site.xml. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887047 13f79535-47bb-0310-9956-ffa450edef68
2009-12-04 03:18:27 +00:00
Thomas White 8d6c5c41f2 HADOOP-6400. Log errors getting Unix UGI. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886645 13f79535-47bb-0310-9956-ffa450edef68
2009-12-03 01:14:15 +00:00
Konstantin Boudnik ef643fd06b HADOOP-6405. Update Eclipse configuration to match changes to Ivy configuration. Contributed by Edwin Chan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886348 13f79535-47bb-0310-9956-ffa450edef68
2009-12-03 00:44:00 +00:00
Tsz-wo Sze 98beeca09d HADOOP-6307. Add a new SequenceFile.Reader constructor in order to support reading on un-closed file.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886003 13f79535-47bb-0310-9956-ffa450edef68
2009-12-01 23:25:56 +00:00
Thomas White ff6c0ef547 HADOOP-6108. Add support for EBS storage on EC2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885888 13f79535-47bb-0310-9956-ffa450edef68
2009-12-01 19:33:10 +00:00
Konstantin Boudnik 36700348c1 HADOOP-6398. Build is broken after HADOOP-6395 patch has been applied. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885534 13f79535-47bb-0310-9956-ffa450edef68
2009-11-30 18:52:34 +00:00
Owen O'Malley fc880f9794 HADOOP-6395. Upgrade some libraries to be consistent across common, hdfs,
and mapreduce. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@884428 13f79535-47bb-0310-9956-ffa450edef68
2009-11-26 07:33:38 +00:00
Christopher Douglas f6990e06b4 HADOOP-6375. Sync documentation for FsShell du with its implementation.
Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@883206 13f79535-47bb-0310-9956-ffa450edef68
2009-11-23 00:59:29 +00:00
Christopher Douglas 09ec9c4ffc HADOOP-6269. Fix threading issue with defaultResource in Configuration.
Contributed by Sreekanth Ramakrishnan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@882831 13f79535-47bb-0310-9956-ffa450edef68
2009-11-21 04:22:02 +00:00
Devaraj Das bd92322d22 HADOOP-6367. Removes Access Token implementation from common. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@881509 13f79535-47bb-0310-9956-ffa450edef68
2009-11-17 20:59:46 +00:00
Tsz-wo Sze cdcb8514a0 HADOOP-6314. Fix "fs -help" for the "-count" commond. Contributed by Ravi Phulari
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@836019 13f79535-47bb-0310-9956-ffa450edef68
2009-11-13 22:10:01 +00:00
Konstantin Boudnik 2eba5972ed HADOOP-6366. Reduce ivy console output to ovservable level. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@835967 13f79535-47bb-0310-9956-ffa450edef68
2009-11-13 19:44:14 +00:00
Devaraj Das ad88440651 HADOOP-6337. Updates FilterInitializer class to be more visible, and the init of the class is made to take a Configuration argument. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@833553 13f79535-47bb-0310-9956-ffa450edef68
2009-11-06 20:54:40 +00:00
Giridharan Kesavan af59233ce1 HADOOP-6341. Fix test-patch.sh for checkTests function. ( gkesavan )
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832590 13f79535-47bb-0310-9956-ffa450edef68
2009-11-03 22:53:08 +00:00
Tsz-wo Sze f5f95fe43a HADOOP-6343. Log unexpected throwable object caught in RPC. Contributed by Jitendra Nath Pandey
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832249 13f79535-47bb-0310-9956-ffa450edef68
2009-11-03 01:30:11 +00:00
Konstantin Boudnik 408117957e HADOOP-6347. run-test-core-fault-inject runs a test case twice if -Dtestcase is set. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832157 13f79535-47bb-0310-9956-ffa450edef68
2009-11-02 22:26:56 +00:00
Suresh Srinivas 382af3f627 HADOOP-6344. Fix rm and rmr immediately delete files rather than sending to trash, if a user is over-quota. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831478 13f79535-47bb-0310-9956-ffa450edef68
2009-10-30 22:39:01 +00:00
Suresh Srinivas 3f371a0a64 Hadoop-6223. Add new file system interface AbstractFileSystem with implementation of some file systems that delegate to old FileSystem. Contributed by Sanjay Radia.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831475 13f79535-47bb-0310-9956-ffa450edef68
2009-10-30 22:24:22 +00:00
Suresh Srinivas b5c31f4ee6 HADOOP-6313. Implement Syncable interface in FSDataOutputStream to expose flush APIs to application users. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831416 13f79535-47bb-0310-9956-ffa450edef68
2009-10-30 18:33:00 +00:00
Tsz-wo Sze a5427fc7eb HADOOP-6334. Fix GenericOptionsParser and Path to have a better URI support. Contributed by Amareshwari Sriramadasu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831412 13f79535-47bb-0310-9956-ffa450edef68
2009-10-30 18:21:26 +00:00
Owen O'Malley f0f3fdbd3d HADOOP-5107. Use Maven ant tasks to publish the subproject jars.
(Giridharan Kesavan via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831032 13f79535-47bb-0310-9956-ffa450edef68
2009-10-29 17:08:42 +00:00
Doug Cutting f9dee28085 HADOOP-6318. Move CHANGES.txt message to 0.21 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829289 13f79535-47bb-0310-9956-ffa450edef68
2009-10-24 00:17:24 +00:00
Doug Cutting a13a0f3fba HADOOP-6318. Upgrade to Avro 1.2.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829279 13f79535-47bb-0310-9956-ffa450edef68
2009-10-23 23:36:29 +00:00
Konstantin Boudnik d7a7f02c3e HADOOP-6326. Hundson runs should check for AspectJ warnings and report failure if any is present. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829269 13f79535-47bb-0310-9956-ffa450edef68
2009-10-23 22:33:57 +00:00
Tsz-wo Sze 9b0a0745d8 HADOOP-6329. Add build-fi directory to the ignore lists.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829165 13f79535-47bb-0310-9956-ffa450edef68
2009-10-23 18:26:01 +00:00
Tsz-wo Sze 4f4c74f76e HADOOP-6327. FileContext tests should not use /tmp and should clean up files. Contributed by Sanjay Radia
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@828886 13f79535-47bb-0310-9956-ffa450edef68
2009-10-22 22:46:39 +00:00
Devaraj Das 19e8d6ad67 HADOOP-6218. Moving the commit comment to 0.20.2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@828181 13f79535-47bb-0310-9956-ffa450edef68
2009-10-21 20:11:21 +00:00
Christopher Douglas 22bb3c6b77 Remove entries moved to 0.20.2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827860 13f79535-47bb-0310-9956-ffa450edef68
2009-10-21 01:10:08 +00:00
Christopher Douglas 449ac4ab87 HADOOP-6292. Update native libraries guide. Contributed by Corinne Chandel
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827855 13f79535-47bb-0310-9956-ffa450edef68
2009-10-21 00:32:20 +00:00
Christopher Douglas 7313955d04 HADOOP-6097. Fix Path conversion in makeQualified and reset LineReader byte
count at the start of each block in Hadoop archives. Contributed by Ben Slusky,
Tom White, and Mahadev Konar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827837 13f79535-47bb-0310-9956-ffa450edef68
2009-10-20 23:39:49 +00:00
Christopher Douglas 1ecee2e062 HADOOP-6312. Remove unnecessary debug logging in Configuration constructor. Contributed by Aaron Kimball
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826141 13f79535-47bb-0310-9956-ffa450edef68
2009-10-17 00:22:39 +00:00
Christopher Douglas c5bce7be47 HADOOP-6293. Fix FsShell -text to work on filesystems other than the default.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826120 13f79535-47bb-0310-9956-ffa450edef68
2009-10-16 22:41:54 +00:00
Konstantin Boudnik 3e9ba35841 HADOOP-6204. Implementing aspects development and fault injeciton framework for Hadoop. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824942 13f79535-47bb-0310-9956-ffa450edef68
2009-10-13 21:54:48 +00:00
Tsz-wo Sze 512a39264f HADOOP-6309. Change build.xml to run tests with java asserts. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824899 13f79535-47bb-0310-9956-ffa450edef68
2009-10-13 19:59:17 +00:00
Devaraj Das fed32afd17 HADOOP-6218. Adds a feature where TFile can be split by Record Sequeunce number. Contributed by Hong Tang and Raghu Angadi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824516 13f79535-47bb-0310-9956-ffa450edef68
2009-10-12 22:07:17 +00:00
Konstantin Boudnik d3c314e450 HADOOP-6305. Unify build property names to facilitate cross-projects modifications. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823756 13f79535-47bb-0310-9956-ffa450edef68
2009-10-10 01:10:41 +00:00
Konstantin Boudnik 780efea7ae Eclipse .classpath template has outdated jar files and is missing some new
ones. Contributed by Konstantin Boudnik


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823355 13f79535-47bb-0310-9956-ffa450edef68
2009-10-08 23:08:59 +00:00
Christopher Douglas b903b25072 HADOOP-6279. Add Runtime::maxMemory to JVM metrics. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823271 13f79535-47bb-0310-9956-ffa450edef68
2009-10-08 18:54:04 +00:00
Tsz-wo Sze 710d517768 HADOOP-6283. Improve the exception messages thrown by FileUtil$HardLink.getLinkCount(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823263 13f79535-47bb-0310-9956-ffa450edef68
2009-10-08 18:37:37 +00:00
Suresh Srinivas 64f537da0a HADOOP-6286. Fix bugs in related to URI handling in glob methods in FileContext. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@822805 13f79535-47bb-0310-9956-ffa450edef68
2009-10-07 17:07:37 +00:00
Tsz-wo Sze 59ab2c5d31 HADOOP-6284. Add a new parameter, HADOOP_JAVA_PLATFORM_OPTS, to hadoop-config.sh so that it allows setting java command options for JAVA_PLATFORM. Contributed by Koji Noguchi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@820094 13f79535-47bb-0310-9956-ffa450edef68
2009-09-29 21:26:06 +00:00
Owen O'Malley 2031231edb HADOOP-6285. Fix the result type of the getParameterMap method in the
HttpServer.QuotingInputFilter. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@819670 13f79535-47bb-0310-9956-ffa450edef68
2009-09-28 19:03:45 +00:00
Owen O'Malley 9de98c42cb HADOOP-6281. Avoid null pointer exceptions when the jsps don't have
paramaters (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@818543 13f79535-47bb-0310-9956-ffa450edef68
2009-09-24 16:47:59 +00:00
Suresh Srinivas 0243cf3672 HADOOP-6261. Add URI based tests for FileContext. Contributed by Ravi Pulari.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817823 13f79535-47bb-0310-9956-ffa450edef68
2009-09-22 20:26:43 +00:00
Suresh Srinivas 373bf85f56 HADOOP-6274. Fix TestLocalFSFileContextMainOperations test failure. Contributed by Gary Murry.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817496 13f79535-47bb-0310-9956-ffa450edef68
2009-09-22 04:12:45 +00:00
Owen O'Malley 277dd0e2a3 Fix up formatting of header after branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817416 13f79535-47bb-0310-9956-ffa450edef68
2009-09-21 21:36:13 +00:00
Owen O'Malley 4342710434 Branching for 0.21
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816847 13f79535-47bb-0310-9956-ffa450edef68
2009-09-19 01:24:39 +00:00
Suresh Srinivas 7cc6a8e8ce HADOOP-6260. Add additional unit tests for FileContext util methods. Contributed by Gary Murray.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816841 13f79535-47bb-0310-9956-ffa450edef68
2009-09-19 01:02:35 +00:00
Suresh Srinivas 6ef2552953 HADOOP-6233. Rename configuration keys towards API standardization and backward compatibility. Contributed by Jithendra Pandey.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816830 13f79535-47bb-0310-9956-ffa450edef68
2009-09-19 00:26:01 +00:00
Suresh Srinivas fa48d9ea17 HADOOP-6271. Add recursive and non recursive create and mkdir to FileContext. Contributed by Sanjay Radia.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816818 13f79535-47bb-0310-9956-ffa450edef68
2009-09-19 00:03:04 +00:00
Suresh Srinivas 1695ecd1a3 HADOOP-6240. Add new FileContext rename operation that posix compliant that allows overwriting existing destination. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816794 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 21:52:59 +00:00
Doug Cutting c722a45f47 HADOOP-6267. Permit building contrib modules located in external source trees. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816752 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 19:22:10 +00:00
Tsz-wo Sze 758f8a5abe HADOOP-6270. Support deleteOnExit in FileContext. Contributed by Suresh Srinivas
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816751 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 19:13:29 +00:00
Doug Cutting ea50f15407 HADOOP-6170. Add facility to tunnel Avro RPCs through Hadoop RPCs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816727 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 17:47:08 +00:00
Owen O'Malley 366b1b1dd6 HADOOP-6151. Added a input filter to all of the http servlets that quotes
html characters in the parameters, to prevent cross site scripting 
attacks. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816703 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 16:31:34 +00:00
Christopher Douglas 446309b039 HADOOP-6268. Add ivy jar to .gitignore. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816532 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 08:31:02 +00:00
Owen O'Malley bec1f274cc HADOOP-6217. Update documentation for project split. (Corinne Chandel via
omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816409 13f79535-47bb-0310-9956-ffa450edef68
2009-09-17 23:24:38 +00:00
Suresh Srinivas 0294c49df6 HADOOP-4952. Add new improved file system interface FileContext for the application writer. Contributed by Sanjay Radia.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816398 13f79535-47bb-0310-9956-ffa450edef68
2009-09-17 22:27:15 +00:00
Thomas White 7ee09e0939 HADOOP-6257. Two TestFileSystem classes are confusing hadoop-hdfs-hdfwithmr. Contributed by Philip Zeyliger.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815809 13f79535-47bb-0310-9956-ffa450edef68
2009-09-16 14:41:08 +00:00
Tsz-wo Sze 9164c6319e HADOOP-6216. Support comments in host files. Contributed by Ravi Phulari and Dmytro Molkov
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815524 13f79535-47bb-0310-9956-ffa450edef68
2009-09-15 22:18:21 +00:00
Hemanth Yamijala 78cff65f33 HADOOP-6250. Modify test-patch to delete copied XML files before running patch build. Contributed by Rahul Kumar Singh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815317 13f79535-47bb-0310-9956-ffa450edef68
2009-09-15 13:17:07 +00:00
Christopher Douglas 254afbfe96 HADOOP-5879. Read compression level and strategy from Configuration for
gzip compression. Contributed by He Yongqiang


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814455 13f79535-47bb-0310-9956-ffa450edef68
2009-09-14 00:45:01 +00:00
Suresh Srinivas 3617ed0bad HADOOP-6246. Add backward compatibility support to use deprecated decimal umask from old configuration. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814080 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 23:28:08 +00:00
Christopher Douglas c9cc61e853 HADOOP-6196. Fix a bug in SequenceFile.Reader where syncing within the header
would cause the reader to read the sync marker as a record. Contributed by Jay Booth


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813698 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 07:38:01 +00:00
Suresh Srinivas ae6721a85a HADOOP-6252. Provide a method to determine if a deprecated key is set in config file. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813639 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 00:14:22 +00:00
Christopher Douglas 86724941c5 HADOOP-4012. Provide splitting support for bzip2 compressed files. Contributed by Abdul Qadeer
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813581 13f79535-47bb-0310-9956-ffa450edef68
2009-09-10 20:51:48 +00:00
Tsz-wo Sze efb3e17bed HADOOP-6181. Fix .eclipse.templates/.classpath for avro and jets3t jar files. Contributed by Carlos Valiente
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813179 13f79535-47bb-0310-9956-ffa450edef68
2009-09-10 00:11:52 +00:00
Suresh Srinivas d9e6a9b15f HADOOP-5073. Add annotation mechanism for interface classification. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812740 13f79535-47bb-0310-9956-ffa450edef68
2009-09-09 00:43:47 +00:00
Suresh Srinivas cdbb724edb HADOOP-6234. Add new option dfs.umaskmode to set umask in configuration to use octal or symbolic instead of decimal. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812652 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 19:08:08 +00:00
Suresh Srinivas 3f384b42d2 HADOOP-6235. Adds new method to FileSystem for clients to get server defaults. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812597 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 17:54:16 +00:00
Thomas White 174b3e8a74 HADOOP-6009. S3N listStatus incorrectly returns null instead of empty array when called on empty root. Contributed by Ian Nowland.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812479 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 12:18:06 +00:00
Hemanth Yamijala 4a4dd27571 HADOOP-6243. Fix a NullPointerException in processing deprecated keys. Contributed by Sreekanth Ramakrishnan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812455 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 10:56:15 +00:00
Suresh Srinivas d09ade4d0b HADOOP-6203. FsShell rm/rmr error message indicates exceeding Trash quota and suggests using -skpTrash, when moving to trash fails. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812317 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 01:41:17 +00:00
Christopher Douglas f95ec3f5bf HADOOP-6133. Add a caching layer to Configuration::getClassByName to
alleviate a performance regression introduced in a compatibility layer.
Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812285 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 21:54:45 +00:00
Thomas White 9b0b37e410 HADOOP-6229. Attempt to make a directory under an existing file on LocalFileSystem should throw an Exception. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812127 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 13:25:48 +00:00
Hemanth Yamijala e24071be0a HADOOP-6105. Adds support for automatically handling deprecation of configuration keys. Contributed by V.V.Chaitanya Krishna.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812078 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 11:04:17 +00:00
Hemanth Yamijala e324c20692 HADOOP-6230. Moved process tree and memory calculator related classes from Common to Map/Reduce. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812031 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 08:16:09 +00:00
Thomas White 2aee3eda33 HADOOP-6231. Allow caching of filesystem instances to be disabled on a per-instance basis.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@811572 13f79535-47bb-0310-9956-ffa450edef68
2009-09-04 23:38:00 +00:00
Thomas White d6428581ff HADOOP-6165. Add metadata to Serializations.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810756 13f79535-47bb-0310-9956-ffa450edef68
2009-09-03 01:36:33 +00:00
Michael Stack e5fef21b18 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1 -- reversing this patch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810714 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 22:19:42 +00:00
Michael Stack 51d1c6ffa7 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810709 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 22:01:34 +00:00
Devaraj Das a3c52b93ea HADOOP-6226. Moves BoundedByteArrayOutputStream from the tfile package to the io package and makes it available to other users (MAPREDUCE-318). Contributed by Jothi Padmanabhan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810451 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 11:07:27 +00:00
Christopher Douglas 9ea11c5fb3 HADOOP-6224. Add a method to WritableUtils supported a bounded read of an
encoded String. Contributed by Jothi Padmanabhan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810384 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 07:07:21 +00:00
Christopher Douglas faf9fe98ae HADOOP-6199. Move io.map.skip.index property to core-default from mapred.
Contributed by Amareshwari Sriramadasu


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810329 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 01:26:40 +00:00
Christopher Douglas 6145503acf Revert HADOOP-6224
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810325 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 01:00:34 +00:00
Hemanth Yamijala 75103dc925 HADOOP-6227. Fix Configuration to allow final parameters to be set to null and prevent them from being overridden. Contributed by Amareshwari Sriramadasu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810097 13f79535-47bb-0310-9956-ffa450edef68
2009-09-01 15:24:56 +00:00
Devaraj Das 4c66882a69 HADOOP-6224. Adds methods to read strings safely, makes the Buffer class in DataOutputBuffer public, and introduces public constructors there. These changes are required for MAPREDUCE-318. Contributed by Jothi Padmanabhan and Arun Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@809491 13f79535-47bb-0310-9956-ffa450edef68
2009-08-31 07:56:39 +00:00
Sharad Agarwal aa10f303e3 HADOOP-6215. fix GenericOptionParser to deal with -D with '=' in the value. Contributed by Amar Kamat.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@808415 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 13:55:19 +00:00
Christopher Douglas 8621b830f8 HADOOP-6166. Further improve the performance of the pure-Java CRC32
implementation. Contributed by Tsz Wo (Nicholas), SZE


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807753 13f79535-47bb-0310-9956-ffa450edef68
2009-08-25 18:34:57 +00:00
Tsz-wo Sze a72edd2b10 HADOOP-6152. Fix classpath variables in bin/hadoop-config.sh and some other scripts. Contributed by Aaron Kimball
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807404 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 22:06:54 +00:00
Hemanth Yamijala 280ab0cf7d HADOOP-6184. Provide an API to dump Configuration in a JSON format. Contributed by V.V.Chaitanya Krishna.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807149 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 11:21:18 +00:00
Christopher Douglas 76a77aea78 HADOOP-6201. Change FileSystem::listStatus contract to throw
FileNotFoundException if the directory does not exist, rather than letting
this be implementation-specific. Contributed by Jakob Homan.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806745 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 22:50:04 +00:00
Devaraj Das 0a8e65c23b HADOOP-6103. Clones the classloader as part of Configuration clone. Contributed by Amareshwari Sriramadasu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806430 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 06:59:45 +00:00
Tsz-wo Sze 1f3337996e HADOOP-6173. Change src/native/packageNativeHadoop.sh to package all native library files. Contributed by Hong Tang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806368 13f79535-47bb-0310-9956-ffa450edef68
2009-08-20 21:28:09 +00:00
Hemanth Yamijala e5b7248682 MAPREDUCE-711. Removed Distributed Cache from Common, to move it under Map/Reduce. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804918 13f79535-47bb-0310-9956-ffa450edef68
2009-08-17 10:06:36 +00:00
Giridharan Kesavan 07b43463b8 HADOOP-6182. Fix ReleaseAudit warnings. Contributed by Giridharan Kesavan and Lee Tucker
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804842 13f79535-47bb-0310-9956-ffa450edef68
2009-08-17 03:53:27 +00:00
Arun Murthy 7ffe5b7f87 Reverting HADOOP-6182 and HADOOP-6195
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804317 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 18:22:41 +00:00
Giridharan Kesavan 43f95b50f2 HADOOP-6195. Fix checkstyle xml version tag. Contributed by Lee Tucker
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804297 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 17:00:03 +00:00
Giridharan Kesavan 2e34ced206 HADOOP-6182. Fix releaseaudit warnings by adding AL Headers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804157 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 10:23:41 +00:00
Arun Murthy ec8208f5d3 HADOOP-6192. Fix Shell.getUlimitMemoryCommand to not rely on Map-Reduce specific configs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804115 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 08:16:10 +00:00
Tsz-wo Sze 38a84a6c98 HADOOP-6188. TestTrash uses java.io.File api but not hadoop FileSystem api. Contributed by Boris Shkolnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803296 13f79535-47bb-0310-9956-ffa450edef68
2009-08-11 21:03:50 +00:00
Hairong Kuang d70dd1a2df HADOOP-6177. FSInputChecker.getPos() would return position greater than the file size. Contributed by Hong Tang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803190 13f79535-47bb-0310-9956-ffa450edef68
2009-08-11 16:26:55 +00:00
Tsz-wo Sze 5fe6906f2a HADOOP-6176. Add a couple package private methods to AccessTokenHandler for testing. Contributed by Kan Zhang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802224 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 21:40:01 +00:00
Hairong Kuang 09d826ebed HADOOP-6180. NameNode slowed down when many files with same filename were moved to Trash. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802107 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 17:59:57 +00:00
Tsz-wo Sze 5f53fd8ead HADOOP-6124. Fix javac warning detection in test-patch.sh. Contributed by Giridharan Kesavan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800919 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 19:01:51 +00:00
Mahadev Konar 7be6fc4e5d HADOOP-6169. Removing deprecated method calls in TFile. (hong tang via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800199 13f79535-47bb-0310-9956-ffa450edef68
2009-08-03 05:06:59 +00:00
Tsz-wo Sze e5ea0ce4a6 HADOOP-6172. Fix jar file names in hadoop-config.sh and include ${build.src} as a part of the source list in build.xml. Contributed by Hong Tang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@799751 13f79535-47bb-0310-9956-ffa450edef68
2009-07-31 21:37:23 +00:00
Tsz-wo Sze 638a211067 HADOOP-6123. Add missing classpaths in hadoop-config.sh. Contributed by Sharad Agarwal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@798247 13f79535-47bb-0310-9956-ffa450edef68
2009-07-27 18:34:57 +00:00
Giridharan Kesavan 6c12fd3335 HADOOP-6160. Fix ant releaseaudit target to run on specific directories. (Contributed by Giridharan Kesavan)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@798093 13f79535-47bb-0310-9956-ffa450edef68
2009-07-27 10:09:38 +00:00