Todd Lipcon
bb91ebb53c
HDFS-2591. MiniDFSCluster support to mix and match federation with HA. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208297 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 06:49:30 +00:00
Aaron Myers
ee97365f58
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208002 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 17:55:28 +00:00
Todd Lipcon
9146ad23f3
HDFS-2582. Scope dfs.ha.namenodes config by nameservice. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1207738 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 02:27:45 +00:00
Konstantin Shvachko
68f56ca906
HDFS-2287. Fix second assert.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207710 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 00:03:49 +00:00
Konstantin Shvachko
3083d7d7db
Fix CHANGES.txt. Moving changes from 0.21.1 section to 0.22.0.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207709 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 00:00:20 +00:00
Konstantin Shvachko
82da8fb490
Fix CHANGES.txt. Some changes have been committed under 0.21.1 section rather than 0.22.0.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207706 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 23:53:49 +00:00
Konstantin Shvachko
32935d3e67
Fix CHANGES.txt for HDFS-2346 in trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207700 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 23:40:24 +00:00
Eli Collins
b32543d9ae
HDFS-2596. TestDirectoryScanner doesn't test parallel scans. (eli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207694 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 23:20:16 +00:00
Konstantin Shvachko
49c44117f3
Fix typo in HDFS-993 commit. Was -933.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207676 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 22:51:45 +00:00
Tsz-wo Sze
91a75ad34f
Fix WebHDFS capitalization in CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207585 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 20:47:38 +00:00
Aaron Myers
73b3de6204
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1207490 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 18:21:46 +00:00
Matthew Foley
e9c2307838
HDFS-2316. Record completion of umbrella jira. Contributed by Tsz Wo (Nicholas), Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206990 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 06:30:49 +00:00
Tsz-wo Sze
4b65d10cfe
HDFS-2590. Fix the missing links in the WebHDFS forrest doc.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206178 13f79535-47bb-0310-9956-ffa450edef68
2011-11-25 13:58:29 +00:00
Konstantin Shvachko
080a34143d
HADOOP-7861. changes2html.pl generates links to HADOOP, HDFS, and MAPREDUCE jiras. Contributed by Konstantin Shvachko.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205988 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 21:44:36 +00:00
Todd Lipcon
5f5b3bbdcd
HDFS-2577. NN fails to start since it tries to start secret manager in safemode. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1205689 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 00:55:37 +00:00
Tsz-wo Sze
d3a51478e3
HDFS-2587. Add apt doc for WebHDFS REST API.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205626 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 22:02:19 +00:00
Matthew Foley
db092f5048
HADOOP-7827 HDFS-2588 MAPREDUCE-3464. jsp pages missing DOCTYPE. Contributed by Dave Vronay.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205519 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 18:15:37 +00:00
Tsz-wo Sze
7381884e85
HDFS-2552. Add Forrest doc for WebHDFS REST API.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205146 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 20:04:58 +00:00
Suresh Srinivas
49417594e8
HDFS-2519. Add protobuf service for DatanodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204825 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 06:25:13 +00:00
Todd Lipcon
6a0671977b
Merge trunk into HDFS-1623 branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1204794 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 03:18:47 +00:00
Tsz-wo Sze
2ab10e29d9
HDFS-2246. Enable reading a block directly from local file system for a client on the same node as the block file. Contributed by Andrew Purtell, Suresh Srinivas and Jitendra Nath Pandey
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204792 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 02:57:04 +00:00
Konstantin Boudnik
a2e66776a9
HDFS-2573. TestFiDataXceiverServer is failing, not testing OOME. Contributed by Konstantin Boudnik.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204781 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 02:15:49 +00:00
Suresh Srinivas
5293760973
HDFS-2410. Further cleanup of hardcoded configuration keys and values. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204753 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 23:49:44 +00:00
Suresh Srinivas
b76b85986e
HDFS-2520. Add protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204709 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 21:11:43 +00:00
Suresh Srinivas
4754b80862
HDFS-2518. Add protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204707 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 21:10:04 +00:00
Todd Lipcon
39ce694d05
HDFS-2566. Move BPOfferService to be a non-inner class. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204659 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 19:27:00 +00:00
Todd Lipcon
68173af69d
HDFS-2575. DFSTestUtil may create empty files. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204652 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 19:03:31 +00:00
Suresh Srinivas
54ac7e5413
HDFS-2517. Add protobuf service for JounralProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204544 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 15:39:33 +00:00
Eli Collins
9c2f4f634d
HDFS-2514. Link resolution bug for intermediate symlinks with relative targets. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204370 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 07:01:29 +00:00
Todd Lipcon
5bc66c4c86
HDFS-2532. TestDfsOverAvroRpc timing out in trunk. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204366 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 06:41:56 +00:00
Harsh J
67f25b0a1b
HDFS-2572. Remove Unnecessary double-check in DN#getHostName (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204177 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 15:18:14 +00:00
Eli Collins
5573b691d5
HDFS-2567. When 0 DNs are available, show a proper error when trying to browse DFS via web UI. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204131 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 06:28:37 +00:00
Eli Collins
8686a00c7a
HDFS-2570. Add descriptions for dfs.*.https.address in hdfs-default.xml. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204129 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 06:22:44 +00:00
Eli Collins
8e8bb50afd
HDFS-2454. Move maxXceiverCount check to before starting the thread in dataXceiver. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204124 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 04:27:59 +00:00
Eli Collins
513718f92d
HDFS-2568. Use a set to manage child sockets in XceiverServer. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204122 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 04:13:32 +00:00
Eli Collins
b2313021fd
HDFS-2536. Remove unused imports. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204120 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 03:58:50 +00:00
Eli Collins
0e5c1a45bf
HDFS-208. name node should warn if only one dir is listed in dfs.name.dir. Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204119 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 03:38:51 +00:00
Eli Collins
84f0c0f180
HDFS-2502. hdfs-default.xml should include dfs.name.dir.restore. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204117 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 03:29:20 +00:00
Eli Collins
7a8015c0e2
HDFS-2541. For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204114 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 02:51:50 +00:00
Eli Collins
b7cd8c0f86
HDFS-2564. Cleanup unnecessary exceptions thrown and unnecessary casts. Contributed by Hari Mankude
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203950 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 02:34:25 +00:00
Todd Lipcon
1f92266516
HDFS-2563. Some cleanup in BPOfferService. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203943 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 01:31:59 +00:00
Aaron Myers
67c372991c
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1203781 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 18:29:26 +00:00
Todd Lipcon
905a127850
HDFS-2562. Refactor DN configuration variables out of DataNode class. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203543 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 09:04:20 +00:00
Thomas White
6a01c22755
HDFS-2543. HADOOP_PREFIX cannot be overridden. Contributed by Bruno Mahé.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203486 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 05:10:40 +00:00
Thomas White
dc5a0ab245
HDFS-2544. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203452 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 00:53:46 +00:00
Todd Lipcon
0864ef1908
HDFS-2560. Refactor BPOfferService to be a static inner class. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203444 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 00:45:31 +00:00
Aaron Myers
0d171f6513
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1202013 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 02:39:13 +00:00
Todd Lipcon
9a3f147fdd
HDFS-2476. More CPU efficient data structure for under-replicated, over-replicated, and invalidated blocks. Contributed by Tomasz Nykiel.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201991 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:13:58 +00:00
Todd Lipcon
51ce383112
HDFS-2532. Add timeout to TestDfsOverAvroRpc
...
This test is timing out on trunk, causing tests below it to
fail spuriously. This patch doesn't fix the issue -- just adds
a JUnit timeout so that the failure is properly attributed
to this test.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201963 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 23:34:21 +00:00
Tsz-wo Sze
09a156fcce
HDFS-2539. Support doAs and GETHOMEDIRECTORY in webhdfs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200731 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 04:19:45 +00:00