Commit Graph

3216 Commits

Author SHA1 Message Date
Sanjay Radia 2116f28d9e HADOOP-8366 Use ProtoBuf for RpcResponseHeader (sanjay radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337283 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 16:56:52 +00:00
Eli Collins 235a28874b HADOOP-8276. Auto-HA: add config for java options to pass to zkfc daemon. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1337276 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 16:45:59 +00:00
Aaron Myers cc9c6bdce2 HADOOP-8353. hadoop-daemon.sh and yarn-daemon.sh can be misleading on stop. Contributed by Roman Shaposhnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337251 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 16:15:18 +00:00
Thomas White aea890f7d2 MAPREDUCE-4148. MapReduce should not have a compile-time dependency on HDFS.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337199 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 15:00:48 +00:00
Aaron Myers 5dbd09ee76 HDFS-3026. HA: Handle failure during HA state transition. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337030 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 05:57:37 +00:00
Eli Collins 8def56e51e HDFS-3400. DNs should be able start with jsvc even if security is disabled. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337017 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 03:15:54 +00:00
Tsz-wo Sze ba6360e493 HDFS-3385. The last block of INodeFileUnderConstruction is not necessarily a BlockInfoUnderConstruction, so do not cast it in FSNamesystem.recoverLeaseInternal(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336976 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 00:25:48 +00:00
Eli Collins fcb4b1995b HDFS-3401. Cleanup DatanodeDescriptor creation in the tests. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336972 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 00:03:37 +00:00
Eli Collins dfd733401d HADOOP-8388. Remove unused BlockLocation serialization. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336966 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 23:48:12 +00:00
Eli Collins 1a4539abf7 Remove SHORT_STRING_MAX, left out of the previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336946 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 23:17:29 +00:00
Eli Collins 032216a3a7 HADOOP-8361. Avoid out-of-memory problems when deserializing strings. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336945 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 23:15:53 +00:00
Eli Collins 98b00d7cc0 HDFS-3134. harden edit log loader against malformed or malicious input. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336943 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 23:13:02 +00:00
Tsz-wo Sze 7e8e983620 HDFS-3369. Rename {get|set|add}INode(..) methods in BlockManager and BlocksMap to {get|set|add}BlockCollection(..). Contributed by John George
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336909 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 21:41:25 +00:00
Robert Joseph Evans 6957c78066 HADOOP-8375. test-patch should stop immediately once it has found compilation errors (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336887 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 21:09:08 +00:00
Eli Collins 6a0865440e HDFS-3230. Cleanup DatanodeID creation in the tests. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336815 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 17:58:55 +00:00
Aaron Myers f5960f71d9 HDFS-3395. NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336690 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 13:49:06 +00:00
Uma Maheswara Rao G f1ff05bf47 Reverting (Need to re-do the patch. new BlockInfo does not set iNode ) HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336572 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 09:59:39 +00:00
Eli Collins 54303465a6 HDFS-3396. FUSE build fails on Ubuntu 12.04. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336495 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 06:28:56 +00:00
Eli Collins 1849fde096 HADOOP-7868. Hadoop native fails to compile when default linker option is -Wl,--as-needed. Contributed by Trevor Robinson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336491 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 06:16:01 +00:00
Eli Collins a67054d7c3 HDFS-3328. NPE in DataNode.getIpcPort. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336480 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 04:52:46 +00:00
Todd Lipcon b75f0187c8 HDFS-3341, HADOOP-8340. SNAPSHOT build versions should compare as less than their eventual release. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336459 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 00:30:53 +00:00
Suresh Srinivas 1ceecf2aa2 HADOOP-8372. NetUtils.normalizeHostName() incorrectly handles hostname starting with a numeric character. Contributed by Junping Du.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336446 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 23:18:15 +00:00
Robert Joseph Evans 0308423b9c MAPREDUCE-4237. TestNodeStatusUpdater can fail if localhost has a domain associated with it (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336399 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 21:08:53 +00:00
Aaron Myers e3fbc52686 HDFS-3390. DFSAdmin should print full stack traces of errors when DEBUG logging is enabled. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336324 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 18:16:40 +00:00
Robert Joseph Evans c853a425a0 HADOOP-8373. Port RPC.getServerAddress to 0.23 (Daryn Sharp via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336299 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 17:06:27 +00:00
Robert Joseph Evans b1e883132b HADOOP-8354. test-patch findbugs may fail if a dependent module is changed Contributed by Tom White and Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336213 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 14:08:28 +00:00
Tsz-wo Sze 27ce5a6fb0 Remove the empty file FSInodeInfo.java for HDFS-3363.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335788 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 21:53:11 +00:00
Uma Maheswara Rao G 408e558d8d HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened. Contributed by Ashish Singhi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335719 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 19:45:38 +00:00
Tsz-wo Sze f6d6218348 MAPREDUCE-4231. Update RAID to use the new BlockCollection interface.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335661 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 17:53:15 +00:00
Thomas Graves 0caac704fb MAPREDUCE-4215. RM app page shows 500 error on appid parse error (Jonathon Eagles via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335647 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 17:13:33 +00:00
Robert Joseph Evans 67a514b647 MAPREDUCE-3850. Avoid redundant calls for tokens in TokenCache (Daryn Sharp via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335585 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 15:25:08 +00:00
Robert Joseph Evans aa60da6c2e MAPREDUCE-4162. Correctly set token service (Daryn Sharp via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335567 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 15:07:40 +00:00
Robert Joseph Evans a9808de0d9 HADOOP-8341. Fix or filter findbugs issues in hadoop-tools (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335505 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 13:20:56 +00:00
Eli Collins 1d7b980592 HDFS-3378. Remove DFS_NAMENODE_SECONDARY_HTTPS_PORT_KEY and DEFAULT. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335309 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 00:25:34 +00:00
Tsz-wo Sze f0f9a3631f HDFS-3363. Define BlockCollection and MutableBlockCollection interfaces so that INodeFile and INodeFileUnderConstruction do not have to be used in block management. Contributed by John George
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335304 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 00:06:09 +00:00
Todd Lipcon 7aa2889f82 HDFS-3375. Put client name in DataXceiver thread name for readBlock and keepalive. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335270 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 21:34:30 +00:00
Tsz-wo Sze 07280c9761 HADOOP-8359. Fix javadoc warnings in Configuration. Contributed by Anupam Seth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335258 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 21:11:01 +00:00
Todd Lipcon 567aed4f2c HDFS-3365. Enable users to disable socket caching in DFS client configuration. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335222 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 19:56:23 +00:00
Thomas White 55cd161a35 MAPREDUCE-4226. ConcurrentModificationException in FileSystemCounterGroup.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335197 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 19:05:59 +00:00
Todd Lipcon eca2c850a5 HDFS-3376. DFSClient fails to make connection to DN if there are many unusable cached sockets. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335115 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 16:42:19 +00:00
Robert Joseph Evans d3599de399 MAPREDUCE-4220. RM apps page starttime/endtime sorts are incorrect (Jonathan Eagles via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335096 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 16:18:33 +00:00
Thomas White 35a33067bb HADOOP-8328. Duplicate FileSystem Statistics object for 'file' scheme.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335085 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 16:00:56 +00:00
Robert Joseph Evans 8069771a2d HADOOP-8327. distcpv2 and distcpv1 jars should not coexist (Dave Thompson via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335075 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 15:49:33 +00:00
Harsh J e7d03636a0 HADOOP-8323. Revert HADOOP-7940, cause it may cause a performance regression. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334603 13f79535-47bb-0310-9956-ffa450edef68
2012-05-06 11:20:16 +00:00
Aaron Myers 51e520c68a HADOOP-8349. ViewFS doesn't work when the root of a file system is mounted. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334231 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 22:14:10 +00:00
Eli Collins a2eb525ce1 Move HDFS-2617 commit message to the right place.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334223 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 22:01:57 +00:00
Eli Collins 5dbbe0e0a5 HDFS-2617. Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution. Contributed by Jakob Homan, Alejandro Abdelnur, and Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334216 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 21:58:44 +00:00
Tsz-wo Sze 0bf8f11860 HDFS-3303. Remove Writable implementation from RemoteEditLogManifest. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334156 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 20:16:23 +00:00
Todd Lipcon a701c792f8 HDFS-3357. DataXceiver reads from client socket with incorrect/no timeout. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334116 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 18:50:54 +00:00
Robert Joseph Evans 407cfa3b56 MAPREDUCE-3958. RM: Remove RMNodeState and replace it with NodeState (Bikas Saha via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334043 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 15:47:02 +00:00