Commit Graph

981 Commits

Author SHA1 Message Date
Jitendra Nath Pandey 817df4d5d3 HADOOP-7474. Refactor ClientCache out of WritableRpcEngine. Contributed by jitendra.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151978 13f79535-47bb-0310-9956-ffa450edef68
2011-07-28 19:28:18 +00:00
Eli Collins 44320eed17 HDFS-2212. Refactor double-buffering code out of EditLogOutputStreams. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151736 13f79535-47bb-0310-9956-ffa450edef68
2011-07-28 05:46:28 +00:00
Tsz-wo Sze 60c41c55e7 MAPREDUCE-2463. Job history files are not moved to done folder when job history location is hdfs. Contributed by Devaraj K
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151722 13f79535-47bb-0310-9956-ffa450edef68
2011-07-28 04:08:34 +00:00
Eli Collins ffbe9e5972 HDFS-2195. Refactor StorageDirectory to not be an non-static inner class. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151707 13f79535-47bb-0310-9956-ffa450edef68
2011-07-28 03:19:31 +00:00
Konstantin Shvachko 6f1ef980de HDFS-1981. NameNode does not saveNamespace() when editsNew is empty. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151666 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 23:28:16 +00:00
Suresh Srinivas 0850205088 HADOOP-7378. Add -d option to ls to not expand directories. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151594 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 19:09:55 +00:00
Eli Collins c4f7d2f015 HDFS-2210. Remove hdfsproxy. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151592 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 19:08:52 +00:00
Suresh Srinivas 5dbd26f2c7 HADOOP-7485. Add -h option to ls to list file sizes in human readable format. Contributed by XieXianshan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151505 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 15:35:58 +00:00
Suresh Srinivas b60772c47d HDFS-2198. Remove hardcoded configuration keys. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151501 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 15:29:50 +00:00
Tsz-wo Sze 4a535823a7 Fix a typo in CHANGE.txt: MAPREDUCE-2723 should be MAPREDUCE-2732.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151464 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 13:47:30 +00:00
Tsz-wo Sze f3f9029577 Temporarily disable NameNodeRaidTestUtil.getDatanodeMap(..) for MAPREDUCE-2711.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151351 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 06:41:45 +00:00
Tsz-wo Sze d356d64479 MAPREDUCE-2723. Remove directly accessing FSNamesystem.LOG from TestCopyFiles and TestDistCh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151349 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 06:27:00 +00:00
Tsz-wo Sze 0b12cc822d HDFS-2200. Change FSNamesystem.LOG to package private.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151344 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 05:59:50 +00:00
Tsz-wo Sze 969a263188 HDFS-2191. Move datanodeMap from FSNamesystem to DatanodeManager.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151339 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 05:46:52 +00:00
Todd Lipcon 438c32aaf9 HDFS-2149. Move EditLogOp serialization formats into FsEditLogOp implementations. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151238 13f79535-47bb-0310-9956-ffa450edef68
2011-07-26 20:46:58 +00:00
Matthew Foley 60e4947cc7 HADOOP-6385. dfs should support -rmdir (was HDFS-639). Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150987 13f79535-47bb-0310-9956-ffa450edef68
2011-07-26 04:57:09 +00:00
Todd Lipcon 01cd616d17 HDFS-2180. Refactor NameNode HTTP server into new class. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150960 13f79535-47bb-0310-9956-ffa450edef68
2011-07-26 00:04:30 +00:00
Aaron Myers d2b31fe25f HDFS-2144. If SNN shuts down during initialization it does not log the cause. (Ravi Prakash via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150927 13f79535-47bb-0310-9956-ffa450edef68
2011-07-25 21:44:00 +00:00
Todd Lipcon e8f12457c1 MAPREDUCE-2602. Allow setting of end-of-record delimiter for TextInputFormat for the old API. Contributed by Ahmed Radwan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150926 13f79535-47bb-0310-9956-ffa450edef68
2011-07-25 21:42:04 +00:00
Todd Lipcon ef6110e94d MAPREDUCE-2622. Remove the last remaining reference to the deprecated configuration "io.sort.mb". Contributed by Harsh J Chouraria.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150921 13f79535-47bb-0310-9956-ffa450edef68
2011-07-25 21:29:38 +00:00
Suresh Srinivas db9d8333b4 HADOOP-7438. Fix deprecated warnings from hadoop-daemon.sh script. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150914 13f79535-47bb-0310-9956-ffa450edef68
2011-07-25 21:12:18 +00:00
Todd Lipcon 672064500c HADOOP-7298. Add test utility for writing multi-threaded tests. Contributed by Todd Lipcon and Harsh J Chouraria.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150910 13f79535-47bb-0310-9956-ffa450edef68
2011-07-25 21:10:24 +00:00
Mahadev Konar 85461fb0fa HADOOP-7463. Adding a configuration parameter to SecurityInfo interface. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150565 13f79535-47bb-0310-9956-ffa450edef68
2011-07-25 07:48:54 +00:00
Mahadev Konar 00b526a146 MAPREDUCE-2575. TestMiniMRDFSCaching fails if test.build.dir is set to something other than build/test (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150533 13f79535-47bb-0310-9956-ffa450edef68
2011-07-25 04:18:23 +00:00
Dmytro Molkov c316d43a0a HDFS-1776 Bug in Bug in Concat code. Contributed by Bharath Mundlapudi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150247 13f79535-47bb-0310-9956-ffa450edef68
2011-07-24 01:43:05 +00:00
Tsz-wo Sze 598b85c9e2 HDFS-1739. Add available volume size to the error message when datanode throws DiskOutOfSpaceException. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150067 13f79535-47bb-0310-9956-ffa450edef68
2011-07-23 08:45:55 +00:00
Tsz-wo Sze 89537b7710 HDFS-2112. Move ReplicationMonitor to block management. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1149771 13f79535-47bb-0310-9956-ffa450edef68
2011-07-23 01:01:58 +00:00
Konstantin Shvachko ad3f694261 HDFS-2116. Use Mokito in TestStreamFile and TestByteRangeInputStream. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1149770 13f79535-47bb-0310-9956-ffa450edef68
2011-07-23 00:22:08 +00:00
Suresh Srinivas 184ff33de5 HADOOP-7460. Support pluggable trash policies. Contributed by Usman Masoon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1149760 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 23:23:32 +00:00
Tsz-wo Sze 233a7aa34f HDFS-2167. Move dnsToSwitchMapping and hostsReader from FSNamesystem to DatanodeManager.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1149455 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 04:20:21 +00:00
Owen O'Malley c187bdc0a2 HDFS-2156. Make hdfs and mapreduce rpm only depend on the same major
version for common and hdfs. (eyang via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1149323 13f79535-47bb-0310-9956-ffa450edef68
2011-07-21 19:16:09 +00:00
Christopher Douglas 3810266eae MAPREDUCE-2409. DistributedCache maps files and archives to the same path,
despite semantic incompatibility. Contributed by Siddharth Seth


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1149004 13f79535-47bb-0310-9956-ffa450edef68
2011-07-21 01:59:14 +00:00
Matthew Foley 08928d067b HDFS-2114. re-commission of a decommissioned node does not delete excess replicas. Contributed by John George.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148981 13f79535-47bb-0310-9956-ffa450edef68
2011-07-20 23:35:50 +00:00
Aaron Myers ee39160ab4 HADOOP-7111. Several TFile tests failing when native libraries are present. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148933 13f79535-47bb-0310-9956-ffa450edef68
2011-07-20 20:42:15 +00:00
Eli Collins cda43d71be HDFS-1774. Small optimization to FSDataset. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148894 13f79535-47bb-0310-9956-ffa450edef68
2011-07-20 18:52:57 +00:00
Tsz-wo Sze 54c5bf2b8c Correct way to temporarily disable TestBlockPlacementPolicyRaid for MAPREDUCE-2711.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148421 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 16:02:45 +00:00
Tsz-wo Sze cabec474e0 Revert r1148400 for MAPREDUCE-2711.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148416 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 15:54:10 +00:00
Tsz-wo Sze 2614f6e66b Temporarily disable TestBlockPlacementPolicyRaid for MAPREDUCE-2711.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148400 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 15:33:36 +00:00
Tsz-wo Sze f5690f57ed MAPREDUCE-2710. Update JobSubmitter.printTokens(..) for HDFS-2161.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148367 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 14:43:45 +00:00
Tsz-wo Sze 710e5a960e HDFS-2161. Move createNamenode(..), createClientDatanodeProtocolProxy(..) and Random object creation to DFSUtil; move DFSClient.stringifyToken(..) to DelegationTokenIdentifier.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148348 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 14:23:50 +00:00
Suresh Srinivas 6c0cb4d151 HDFS-2141. Remove NameNode roles Active and Standby (they become states of the namenode). Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148125 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 01:32:59 +00:00
Tsz-wo Sze c3f6575ca4 HDFS-2147. Move cluster network topology to block management and fix some javac warnings.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148112 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 00:26:21 +00:00
Eli Collins 2a49e1a3a4 MAPREDUCE-2623. Update ClusterMapReduceTestCase to use MiniDFSCluster.Builder. Contributed by Harsh J Chouraria
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147981 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 17:27:37 +00:00
Eli Collins 81001b87c1 HDFS-2157. Improve header comment in o.a.h.hdfs.server.namenode.NameNode. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147980 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 17:23:25 +00:00
Eli Collins d3b2f68050 HADOOP-2081. Configuration getInt, getLong, and getFloat replace invalid numbers with the default value. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147971 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 17:03:20 +00:00
Eli Collins 845889384b HADOOP-7471. The saveVersion.sh script sometimes fails to extract SVN URL. Contributed by Alejandro Abdelnur
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147967 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 16:54:57 +00:00
Eli Collins 0a84abfed0 HADOOP-7434. Display error when using "daemonlog -setlevel" with illegal level. Contributed by yanjinshuang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147966 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 16:49:00 +00:00
Suresh Srinivas 8a77d0b289 HDFS-2143. Federation: In cluster web console, add link to namenode page that displays live and dead datanodes. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147964 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 16:45:28 +00:00
Eli Collins 341b4a444e HADOOP-7465. A several tiny improvements for the LOG format. Contributed by Xie Xianshan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147952 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 16:24:45 +00:00
Aaron Myers eaa0638c12 HDFS-2152. TestWriteConfigurationToDFS causing the random failures. (Uma Maheswara Rao G via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147762 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 07:07:58 +00:00