Aaron Myers
d680080da0
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228339 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 18:47:05 +00:00
Jitendra Nath Pandey
4efd3699a6
HDFS-2697. Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings protocol to protocol buffers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227887 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 23:03:31 +00:00
Alejandro Abdelnur
5f5561d057
Fixing CHANGES.txt files, moving JIRAs from trunk to 0.23.1 section. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227859 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 21:55:43 +00:00
Alejandro Abdelnur
6d45b9e31d
HADOOP-7934. Normalize dependencies versions across all modules. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227787 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:46:42 +00:00
Aaron Myers
3187a3ae05
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227775 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:21:01 +00:00
Suresh Srinivas
472e971891
HDFS-2710. Add HDFS tests related to HADOOP-7933. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227756 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 18:57:01 +00:00
Todd Lipcon
5b8dcb20a2
HDFS-2291. Allow the StandbyNode to make checkpoints in an HA setup. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227411 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 00:22:54 +00:00
Todd Lipcon
d004ddee76
HDFS-2720. Fix MiniDFSCluster HA support to work properly on Windows. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227284 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 19:50:41 +00:00
Aaron Myers
cd81cc6664
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227260 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 18:47:51 +00:00
Harsh J
075122690c
HDFS-1314. Make dfs.blocksize accept size-indicating prefixes (Sho Shimauchi via harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227165 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 14:15:15 +00:00
Aaron Myers
1423fff096
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1226900 13f79535-47bb-0310-9956-ffa450edef68
2012-01-03 18:07:55 +00:00
Harsh J
05ed36cd52
HDFS-2722. HttpFs should not be using an int for block size. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226861 13f79535-47bb-0310-9956-ffa450edef68
2012-01-03 16:47:49 +00:00
Harsh J
8e8203f3c5
HDFS-554. Use System.arraycopy in BlockInfo.ensureCapacity. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226239 13f79535-47bb-0310-9956-ffa450edef68
2012-01-01 12:06:49 +00:00
Harsh J
11905517f1
HDFS-2574. Remove references to some deprecated properties in conf templates and defaults files. (Joe Crobak via harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226211 13f79535-47bb-0310-9956-ffa450edef68
2012-01-01 03:11:48 +00:00
Todd Lipcon
737df8b67b
HDFS-2716. Configuration needs to allow different dfs.http.addresses for each HA NN. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1226020 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 01:53:23 +00:00
Todd Lipcon
20a6560bdf
HDFS-2692. Fix bugs related to failover from/into safe mode. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225709 13f79535-47bb-0310-9956-ffa450edef68
2011-12-30 00:30:27 +00:00
Todd Lipcon
15ebdd5664
HDFS-2714. Fix test cases which use standalone FSNamesystems. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225708 13f79535-47bb-0310-9956-ffa450edef68
2011-12-30 00:25:21 +00:00
Aaron Myers
f216303598
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225612 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 18:25:48 +00:00
Harsh J
6c349f9420
HDFS-2729. Update BlockManager's comments regarding the invalid block set (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225591 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 16:51:59 +00:00
Harsh J
41737432c0
HDFS-2726. Fix a logging issue under DFSClient's createBlockOutputStream method (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225456 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 07:22:54 +00:00
Aaron Myers
a500ba50c2
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1224965 13f79535-47bb-0310-9956-ffa450edef68
2011-12-27 18:18:36 +00:00
Alejandro Abdelnur
ae0d48854d
HDFS-2707. HttpFS should read the hadoop-auth secret from a file instead inline from the configuration. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224794 13f79535-47bb-0310-9956-ffa450edef68
2011-12-26 19:37:25 +00:00
Alejandro Abdelnur
6b4f40cbf9
HttpFS server should check that upload requests have correct content-type. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221616 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 05:26:20 +00:00
Todd Lipcon
31c91706f7
HDFS-1972. Fencing mechanism for block invalidations and replications. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1221608 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 04:32:40 +00:00
Todd Lipcon
36d1c49486
HDFS-2693. Fix synchronization issues around state transition. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1221582 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 03:03:23 +00:00
Alejandro Abdelnur
8fe3dd3fea
HDFS-2657. TestHttpFSServer and TestServerWebApp are failing on trunk. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221580 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 03:03:16 +00:00
Alejandro Abdelnur
45620eee68
HDFS-2646. Hadoop HttpFS introduced 4 findbug warnings. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221572 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 02:46:04 +00:00
Tsz-wo Sze
3503d9a4a8
HDFS-2706. Use configuration for blockInvalidateLimit if it is set.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221106 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 05:49:24 +00:00
Todd Lipcon
57ef902bbc
HDFS-2682. When a FailoverProxyProvider is used, Client should not retry for 45 times if it is timing out to connect to server. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220965 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 21:49:39 +00:00
Todd Lipcon
4bb0456c66
HDFS-2678. When a FailoverProxyProvider is used, DFSClient should not retry connection ten times before failing over. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220942 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 20:57:13 +00:00
Todd Lipcon
08bde10e24
Merge trunk into HA branch to pick up fix for bkjournal findbugs
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220941 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 20:46:58 +00:00
Todd Lipcon
dfba847eb6
Amend HDFS-234 (bkjournal contrib). Fix findbugs build
...
- Fixes pom parent to point to hadoop-project instead of hadoop-project-dist
- Fix relative path in pom to have the correct number of ../s
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220940 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 20:42:25 +00:00
Alejandro Abdelnur
de928a4aa0
HDFS-2658. HttpFS introduced 70 javadoc warnings. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220810 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 15:53:53 +00:00
Todd Lipcon
8ff28f4549
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220616 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 05:34:51 +00:00
Todd Lipcon
625d1b380a
HDFS-2677. Web UI should indicate the NN state. Contributed by Eli Collins.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220613 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 05:26:07 +00:00
Todd Lipcon
329717264f
HDFS-2679. Add interface to query current state to HAServiceProtocol. Contributed by Eli Collins.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220612 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 05:24:32 +00:00
Eli Collins
5e185702ea
HDFS-2335. DataNodeCluster and NNStorage always pull fresh entropy. Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220510 13f79535-47bb-0310-9956-ffa450edef68
2011-12-18 18:12:48 +00:00
Todd Lipcon
a89baed833
HDFS-2553. Fix BlockPoolSliceScanner spinning in a tight loop. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220317 13f79535-47bb-0310-9956-ffa450edef68
2011-12-18 01:13:00 +00:00
Todd Lipcon
fa1edc9a1e
HDFS-2700. Fix failing TestDataNodeMultipleRegistrations in trunk. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220315 13f79535-47bb-0310-9956-ffa450edef68
2011-12-18 01:10:49 +00:00
Aaron Myers
08c9dc3780
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215367 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:31:46 +00:00
Suresh Srinivas
89553be90e
HDFS-2687. Tests failing with ClassCastException post protobuf RPC changes. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215366 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:26:46 +00:00
Aaron Myers
52c1491155
HDFS-2694. Removal of Avro broke non-PB NN services. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215364 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:19:01 +00:00
Thomas White
9b7617a909
HDFS-2640. Javadoc generation hangs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215354 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:09:04 +00:00
Todd Lipcon
371f4228e8
HDFS-2684. Fix up some failing unit tests on HA branch. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215241 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 18:36:24 +00:00
Todd Lipcon
cdb9f01ad4
HDFS-2667. Fix transition from active to standby. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215037 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 04:25:13 +00:00
Aaron Myers
71071b904d
HDFS-2602. NN should log newly-allocated blocks without losing BlockInfo. Contributed by Aaron T. Myers
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215036 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 04:18:58 +00:00
Aaron Myers
353bc3799d
HDFS-2689. HA: BookKeeperEditLogInputStream doesn't implement isInProgress(). Contributed by Aaron T. Myers
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214965 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 21:54:00 +00:00
Aaron Myers
d937abd434
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214944 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 20:05:38 +00:00
Alejandro Abdelnur
6cf3a15c52
HADOOP_7917. compilation of protobuf files fails in windows/cygwin. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214790 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 14:41:01 +00:00
Todd Lipcon
afd0333196
HDFS-2683. Authority-based lookup of proxy provider fails if path becomes canonicalized. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214579 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 00:42:50 +00:00