2ab10e29d9
HDFS-2246. Enable reading a block directly from local file system for a client on the same node as the block file. Contributed by Andrew Purtell, Suresh Srinivas and Jitendra Nath Pandey
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204792 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 02:57:04 +00:00
a2e66776a9
HDFS-2573. TestFiDataXceiverServer is failing, not testing OOME. Contributed by Konstantin Boudnik.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204781 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 02:15:49 +00:00
5293760973
HDFS-2410. Further cleanup of hardcoded configuration keys and values. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204753 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 23:49:44 +00:00
b76b85986e
HDFS-2520. Add protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204709 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 21:11:43 +00:00
4754b80862
HDFS-2518. Add protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204707 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 21:10:04 +00:00
39ce694d05
HDFS-2566. Move BPOfferService to be a non-inner class. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204659 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 19:27:00 +00:00
68173af69d
HDFS-2575. DFSTestUtil may create empty files. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204652 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 19:03:31 +00:00
54ac7e5413
HDFS-2517. Add protobuf service for JounralProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204544 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 15:39:33 +00:00
9c2f4f634d
HDFS-2514. Link resolution bug for intermediate symlinks with relative targets. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204370 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 07:01:29 +00:00
5bc66c4c86
HDFS-2532. TestDfsOverAvroRpc timing out in trunk. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204366 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 06:41:56 +00:00
67f25b0a1b
HDFS-2572. Remove Unnecessary double-check in DN#getHostName (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204177 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 15:18:14 +00:00
5573b691d5
HDFS-2567. When 0 DNs are available, show a proper error when trying to browse DFS via web UI. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204131 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 06:28:37 +00:00
8686a00c7a
HDFS-2570. Add descriptions for dfs.*.https.address in hdfs-default.xml. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204129 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 06:22:44 +00:00
8e8bb50afd
HDFS-2454. Move maxXceiverCount check to before starting the thread in dataXceiver. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204124 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 04:27:59 +00:00
513718f92d
HDFS-2568. Use a set to manage child sockets in XceiverServer. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204122 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 04:13:32 +00:00
b2313021fd
HDFS-2536. Remove unused imports. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204120 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 03:58:50 +00:00
0e5c1a45bf
HDFS-208. name node should warn if only one dir is listed in dfs.name.dir. Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204119 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 03:38:51 +00:00
84f0c0f180
HDFS-2502. hdfs-default.xml should include dfs.name.dir.restore. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204117 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 03:29:20 +00:00
7a8015c0e2
HDFS-2541. For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204114 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 02:51:50 +00:00
b7cd8c0f86
HDFS-2564. Cleanup unnecessary exceptions thrown and unnecessary casts. Contributed by Hari Mankude
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203950 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 02:34:25 +00:00
1f92266516
HDFS-2563. Some cleanup in BPOfferService. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203943 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 01:31:59 +00:00
905a127850
HDFS-2562. Refactor DN configuration variables out of DataNode class. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203543 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 09:04:20 +00:00
6a01c22755
HDFS-2543. HADOOP_PREFIX cannot be overridden. Contributed by Bruno Mahé.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203486 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 05:10:40 +00:00
dc5a0ab245
HDFS-2544. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203452 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 00:53:46 +00:00
0864ef1908
HDFS-2560. Refactor BPOfferService to be a static inner class. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203444 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 00:45:31 +00:00
9a3f147fdd
HDFS-2476. More CPU efficient data structure for under-replicated, over-replicated, and invalidated blocks. Contributed by Tomasz Nykiel.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201991 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:13:58 +00:00
51ce383112
HDFS-2532. Add timeout to TestDfsOverAvroRpc
...
This test is timing out on trunk, causing tests below it to
fail spuriously. This patch doesn't fix the issue -- just adds
a JUnit timeout so that the failure is properly attributed
to this test.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201963 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 23:34:21 +00:00
09a156fcce
HDFS-2539. Support doAs and GETHOMEDIRECTORY in webhdfs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200731 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 04:19:45 +00:00
94c631af1f
HDFS-2540. Webhdfs: change "Expect: 100-continue" to two-step write; change "HdfsFileStatus" and "localName" respectively to "FileStatus" and "pathSuffix" in JSON response.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199396 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 19:25:57 +00:00
6dff9329d5
HDFS-2495. Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock. Contributed by Tomasz Nykiel.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199024 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 00:16:23 +00:00
a590b498ac
HDFS-2528. Webhdfs: set delegation kind to WEBHDFS and add a HDFS token when http requests are redirected to datanode.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198903 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 20:05:16 +00:00
db13c99940
Add the missing test file to HDFS-2477.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197801 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 21:49:15 +00:00
6afe3e0d22
HDFS-2527. WebHdfs: remove the use of "Range" header in Open; use ugi username if renewer parameter is null in GetDelegationToken; response OK when setting replication for non-files; rename GETFILEBLOCKLOCATIONS to GET_BLOCK_LOCATIONS and state that it is a private unstable API; replace isDirectory and isSymlink with enum {FILE, DIRECTORY, SYMLINK} in HdfsFileStatus JSON object.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197329 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 22:34:47 +00:00
40fe96546f
HDFS-2129. Simplify BlockReader to not inherit from FSInputChecker. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196976 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:54:59 +00:00
fd8c757b9f
Add new section to HDFS CHANGES.txt for 0.23.1. Moved two things that were recently committed post-0.23.0 to this new section.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196904 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 01:02:28 +00:00
11cf658d0a
HDFS-2533. Remove needless synchronization on some FSDataSet methods. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196902 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 01:00:25 +00:00
f84552ac35
HDFS-2130. Switch default checksum to CRC32C. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196889 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 00:35:37 +00:00
a4baabe4a4
HDFS-2477. Optimize computing the diff between a block report and the namenode state. Contributed by Tomasz Nykiel.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196676 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 16:31:21 +00:00
bd21ddcb78
HDFS-2416. distcp with a webhdfs uri on a secure cluster fails.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196434 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 02:08:20 +00:00
abe45f59ac
HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry (atm)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196171 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 17:59:53 +00:00
4961441584
HDFS-2308. NamenodeProtocol.endCheckpoint is vestigial and can be removed. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196113 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 16:44:28 +00:00
4e42044b1c
Preparing for release 0.23.0.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195872 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:46:22 +00:00
22000ce96d
HDFS-2002. Incorrect computation of needed blocks in getTurnOffTip(). Contributed by Plamen Jeliazkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195869 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:37:11 +00:00
a3a4ccfed7
Preparing for release 0.23.0.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195838 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 06:02:53 +00:00
1c940637b1
HDFS-2521. Remove custom checksum headers from data transfer protocol. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195829 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 05:17:08 +00:00
bb8fd6a267
TestHDFSCLI is failing due to HADOOP-7360. HDFS-2038 is going to fix it. Disable it for the moment.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195754 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:31:06 +00:00
8d1a09b741
HDFS-2065. Add null checks in DFSClient.getFileChecksum(..). Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195731 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 00:38:57 +00:00
c46876982e
HDFS-2512. Add textual error message to data transfer protocol responses. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195693 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 21:53:58 +00:00
32cad9affe
HDFS-2385. Support renew and cancel delegation tokens in webhdfs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195656 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 20:37:16 +00:00
7cb77a3b1b
HDFS-2334. Add Closeable to JournalManager. Contributed by Ivan Kelly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195620 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 19:03:55 +00:00
Tsz-wo Sze
Konstantin Boudnik
Suresh Srinivas
Todd Lipcon
Eli Collins
Harsh J
Thomas White
Hairong Kuang
Jitendra Nath Pandey
Aaron Myers
Arun Murthy
Konstantin Shvachko