Todd Lipcon
04416861eb
Amend HADOOP-8212 (Improve ActiveStandbyElector's behavior when session expires)
...
Amendment patch incorporates following feedback from Bikas Saha:
- adds a new functional test for session expiration while in the standby state
- adds a safety check in the StatCallback for session expiration
- improves some comments
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307128 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 21:49:37 +00:00
Todd Lipcon
a9471b97c1
Merge trunk into HDFS-3042 branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1306587 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 20:45:13 +00:00
Tsz-wo Sze
99a68a1423
HDFS-3155. Clean up FSDataset implemenation related code.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306582 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 20:37:34 +00:00
Eli Collins
0475795066
HDFS-3139. Minor Datanode logging improvement. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306549 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 19:33:22 +00:00
Aaron Myers
aa8cb2287f
HDFS-3143. TestGetBlocks.testGetBlocks is failing. Contributed by Arpit Gupta.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306542 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 19:02:16 +00:00
Aaron Myers
991eddd043
Change "0.23.3" to "2.0.0" in CHANGES.txt files.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306538 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 18:55:33 +00:00
Aaron Myers
1427468a72
HDFS-3156. TestDFSHAAdmin is failing post HADOOP-8202. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306517 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 17:58:23 +00:00
Arun Murthy
67a74198b1
Changed version in trunk to 3.0.0-SNAPSHOT.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306200 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 07:37:06 +00:00
Todd Lipcon
f23fc4ad10
Branch for automatic NN failover support (HDFS-3042)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1306185 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 06:55:09 +00:00
Todd Lipcon
84a97fbcf6
HADOOP-8218. RPC.closeProxy shouldn't throw error when closing a mock. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306164 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 04:53:26 +00:00
Eli Collins
f9fec982f7
HADOOP-8216. Address log4j.properties inconsistencies btw main and template dirs. Contributed by Patrick Hunt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305891 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 16:32:37 +00:00
Suresh Srinivas
940dac52a7
HDFS-3125. Add JournalService to enable Journal Daemon. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305726 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 04:02:03 +00:00
Suresh Srinivas
600e327a56
HADOOP-8202. RPC stopProxy() does not close the proxy correctly. Contributed by Hari Mankude.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305704 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 01:31:29 +00:00
Aaron Myers
466908e67b
HDFS-3131. Improve TestStorageRestore. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305688 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 00:13:42 +00:00
Todd Lipcon
578f413778
HADOOP-8206. Common portion of a ZK-based failover controller. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305673 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 23:37:33 +00:00
Tsz-wo Sze
525ceb99ad
HDFS-2413. Add an API DistributedFileSystem.isInSafeMode() and change DistributedFileSystem to @InterfaceAudience.LimitedPrivate. Contributed by harsh
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305632 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 22:18:04 +00:00
Eli Collins
7ef57bfc81
Fix CHANGES.txt for HDFS-3129
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305631 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 22:16:11 +00:00
Eli Collins
99a321419f
HDFS-3129. NetworkTopology: add test that getLeaf should check for invalid topologies. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305628 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 22:07:30 +00:00
Robert Joseph Evans
1650a49993
MAPREDUCE-4061. RM only has 1 AM launcher thread (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305607 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:23:31 +00:00
Tsz-wo Sze
67bdbd60cd
(recommit) HDFS-3089. Move FSDatasetInterface and the related classes to a package.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305603 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:14:12 +00:00
Tsz-wo Sze
5e38a9acea
Revert 1305590 for HDFS-3089.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305598 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:09:14 +00:00
Tsz-wo Sze
1ebcc378af
HDFS-3089. Move FSDatasetInterface and the related classes to a package.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305590 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:01:47 +00:00
Todd Lipcon
31c2e3f29c
HADOOP-8212. Improve ActiveStandbyElector's behavior when session expires. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305510 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 19:31:43 +00:00
Arun Murthy
1a9385d516
MAPREDUCE-3353. Fixed commit msg to point to right jira.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305457 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:29:02 +00:00
Aaron Myers
429baf606a
Move CHANGES.txt entry for HDFS-2941 to the right version.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305453 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:11:19 +00:00
Aaron Myers
ce1a7ec975
HDFS-2941. Add an administrative command to download a copy of the fsimage from the NN. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305447 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:02:40 +00:00
Harsh J
d5836856a2
MAPREDUCE-4066. Use default value when fetching MR_AM_STAGING_DIR. Contributed by xieguiming.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305343 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 13:21:36 +00:00
Arun Murthy
606114d602
MAPREDUCE-3533. Add a channel between RM and AM to get information on nodes. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305230 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 05:45:29 +00:00
Todd Lipcon
1d5e7dde95
HADOOP-8204. TestHealthMonitor fails occasionally. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305199 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 01:57:03 +00:00
Todd Lipcon
840df19cee
HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305195 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 01:54:14 +00:00
Todd Lipcon
39775dca68
Revert HADOOP-8193 from r1304967. Patch introduced some NPEs in a test case.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305152 13f79535-47bb-0310-9956-ffa450edef68
2012-03-25 21:38:31 +00:00
Aaron Myers
ea868d3d8b
HDFS-3116. Typo in fetchdt error message. Contributed by AOE Takashi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304996 13f79535-47bb-0310-9956-ffa450edef68
2012-03-25 08:45:04 +00:00
Todd Lipcon
90ea037d21
HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304967 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 23:48:07 +00:00
Todd Lipcon
4cb809bf04
HDFS-3132. Fix findbugs warning on HDFS trunk. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304681 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 00:21:52 +00:00
Todd Lipcon
805c1280ce
HADOOP-8163. Improve ActiveStandbyElector to provide hooks for fencing old active. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304675 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 00:05:33 +00:00
Thomas White
1ff0359aa0
HADOOP-7030. Add TableMapping topology implementation to read host to rack mapping from a file. Contributed by Patrick Angeles and tomwhite.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304597 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:03:30 +00:00
Robert Joseph Evans
f67c2d1bd0
MAPREDUCE-4043. Secret keys set in Credentials are not seen by tasks (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304587 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 20:46:18 +00:00
Tsz-wo Sze
081eda94fe
HADOOP-8184. ProtoBuf RPC engine uses the IPC layer reply packet. Contributed by Sanjay Radia
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304542 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 18:21:45 +00:00
Todd Lipcon
b795c65f49
HDFS-3071. haadmin failover command does not provide enough detail when target NN is not ready to be active. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304203 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 06:29:40 +00:00
Eli Collins
b5a8ccb75b
HADOOP-8159. NetworkTopology: getLeaf should check for invalid topologies. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304118 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 22:43:28 +00:00
Eli Collins
0259a3ea6b
HADOOP-8200. Remove HADOOP_[JOBTRACKER|TASKTRACKER]_OPTS. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304112 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 22:36:39 +00:00
Arun Murthy
4e58186987
Removed some logs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304099 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 22:20:29 +00:00
Eli Collins
4feef86372
HDFS-3044. fsck move should be non-destructive by default. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304063 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 21:11:18 +00:00
Alejandro Abdelnur
a8ebdaeb08
HADOOP-8197. Configuration logs WARNs on every use of a deprecated key (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303884 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 16:46:48 +00:00
Todd Lipcon
76817c28a2
HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303634 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 00:49:06 +00:00
Tsz-wo Sze
0c4acdc176
HDFS-3100. In BlockSender, throw an exception when it needs to verify checksum but the meta data does not exist. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303628 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 00:10:20 +00:00
Todd Lipcon
2f820dde17
HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303485 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 18:14:09 +00:00
Todd Lipcon
f55a1c0876
HDFS-2834. Add a ByteBuffer-based read API to DFSInputStream. Contributed by Henry Robinson.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303474 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 17:30:37 +00:00
Ravi Gummadi
7b3a98cfcd
MAPREDUCE-3953. [Gridmix] Gridmix throws NPE and does not simulate a job if the trace contains null taskStatus for a task.(ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303330 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 09:42:23 +00:00
Tsz-wo Sze
9e108e61fb
HDFS-3086. Change Datanode not to send storage list in registration.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303318 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 09:07:33 +00:00