Commit Graph

1233 Commits

Author SHA1 Message Date
Suresh Srinivas 4167aed789 HDFS-4676. Merging change 1466099 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1466102 13f79535-47bb-0310-9956-ffa450edef68
2013-04-09 16:21:41 +00:00
Suresh Srinivas 97b95fb3a0 HDFS-3940. Merging change r1465851 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1466101 13f79535-47bb-0310-9956-ffa450edef68
2013-04-09 16:20:58 +00:00
Todd Lipcon b287d8de6d HDFS-3981. Fix handling of FSN lock in getBlockLocations. Contributed by Xiaobo Peng and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1465752 13f79535-47bb-0310-9956-ffa450edef68
2013-04-08 19:57:24 +00:00
Uma Maheswara Rao G d208e6a15e Merge HDFS-4525. Provide an API for knowing that whether file is closed or not. Contributed by SreeHari.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1465435 13f79535-47bb-0310-9956-ffa450edef68
2013-04-07 18:04:33 +00:00
Aaron Myers 85c29d073c HDFS-1804. Add a new block-volume device choosing policy that looks at free space. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1465184 13f79535-47bb-0310-9956-ffa450edef68
2013-04-06 04:11:18 +00:00
Konstantin Boudnik e4d027c3a2 svn merge -c1465121
HDFS-4646. createNNProxyWithClientProtocol ignores configured timeout value.
Contributed by Jagane Sundar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1465123 13f79535-47bb-0310-9956-ffa450edef68
2013-04-05 20:45:13 +00:00
Kihwal Lee c6f70e7072 svn merge -c 1464548 Merging from trunk to branch-2 to fix HDFS-4548.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1464553 13f79535-47bb-0310-9956-ffa450edef68
2013-04-04 14:03:51 +00:00
Kihwal Lee a7cdea51fa svn merge -c 1463698 Merging from trunk to branch-2 to fix HDFS-4649.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1463699 13f79535-47bb-0310-9956-ffa450edef68
2013-04-02 19:13:46 +00:00
Aaron Myers 1d2b7cea58 HDFS-4658. Standby NN will log that it has received a block report "after becoming active". Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1463644 13f79535-47bb-0310-9956-ffa450edef68
2013-04-02 17:50:56 +00:00
Aaron Myers 831d18a422 HDFS-4656. DN heartbeat loop can be briefly tight. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1463358 13f79535-47bb-0310-9956-ffa450edef68
2013-04-02 02:13:10 +00:00
Aaron Myers b05024a03a HDFS-4655. DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1463356 13f79535-47bb-0310-9956-ffa450edef68
2013-04-02 02:08:03 +00:00
Todd Lipcon 3e696b4273 HADOOP-9150. Avoid unnecessary DNS resolution attempts for logical URIs. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1462301 13f79535-47bb-0310-9956-ffa450edef68
2013-03-28 20:57:53 +00:00
Todd Lipcon 932a394ba5 HDFS-4618. Default transaction interval for checkpoints is too low. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1461784 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 18:46:39 +00:00
Todd Lipcon 388bf3c267 HDFS-4621. Additional logging to help diagnose slow QJM syncs. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1461779 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 18:43:55 +00:00
Kihwal Lee f0b9aeef47 svn merge -c 1461597 Merging from trunk to branch-2 to fix HDFS-4581.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1461602 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 14:23:43 +00:00
Suresh Srinivas 5a808d8c15 HDFS-4635. Merge 1461364 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1461365 13f79535-47bb-0310-9956-ffa450edef68
2013-03-26 23:04:52 +00:00
Tsz-wo Sze 17a304973c svn merge -c 1461040 from trunk for HDFS-4598. Fix the default value of ConcatSourcesParam and the WebHDFS doc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1461042 13f79535-47bb-0310-9956-ffa450edef68
2013-03-26 09:57:19 +00:00
Siddharth Seth 98fcb9eb89 reverting r1459593. HDFS-4584.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1460795 13f79535-47bb-0310-9956-ffa450edef68
2013-03-25 17:57:35 +00:00
Siddharth Seth 3c2c6e4247 reverting r1459588. HDFS-4615.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1460785 13f79535-47bb-0310-9956-ffa450edef68
2013-03-25 17:54:53 +00:00
Tsz-wo Sze 6af4449beb svn merge -c 1459592 from trunk for HDFS-4584. Skip TestNNWithQJM.testNewNamenodeTakesOverWriter() on Windows.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1459593 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 23:57:30 +00:00
Tsz-wo Sze 21210295d6 svn merge -c 1459586 from trunk for HDFS-4615. Fix TestDFSShell failures on Windows.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1459588 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 23:50:31 +00:00
Tsz-wo Sze 66dbdfeaf4 svn merge -c 1459576 from trunk for HDFS-4609. TestAuditLogs should release log handles between tests.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1459577 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 23:19:45 +00:00
Tsz-wo Sze b005b46a95 svn merge -c 1459573 from trunk for HDFS-4607. In TestGetConf.testGetSpecificKey(), use a platform-specific line separator; otherwise, it fails on Windows.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1459574 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 23:12:24 +00:00
Aaron Myers cbc30537d1 HDFS-4620. Documentation for dfs.namenode.rpc-address specifies wrong format. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1459550 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 22:00:05 +00:00
Aaron Myers 92af1b7d8d HDFS-4246. The exclude node list should be more forgiving, for each output stream. Contributed by Harsh J. Chouraria.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1459495 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 19:48:41 +00:00
Aaron Myers e25308f415 HDFS-4614. FSNamesystem#getContentSummary should use getPermissionChecker helper method. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1458595 13f79535-47bb-0310-9956-ffa450edef68
2013-03-20 00:38:26 +00:00
Aaron Myers eb6a563194 HDFS-4521. Invalid network toploogies should not be cached. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1457883 13f79535-47bb-0310-9956-ffa450edef68
2013-03-18 17:26:45 +00:00
Aaron Myers 7a02bc2bac HDFS-4596. Shutting down namenode during checkpointing can lead to md5sum error. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1456633 13f79535-47bb-0310-9956-ffa450edef68
2013-03-14 20:05:49 +00:00
Aaron Myers 600af6a60f HDFS-3277. fail over to loading a different FSImage if the first one we try to load is corrupt. Contributed by Colin Patrick McCabe and Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1456585 13f79535-47bb-0310-9956-ffa450edef68
2013-03-14 18:17:56 +00:00
Daryn Sharp daa634aa00 svn merge -c 1456469 FIXES: HDFS-3367. WebHDFS doesn't use the logged in user when opening connections (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1456470 13f79535-47bb-0310-9956-ffa450edef68
2013-03-14 15:16:13 +00:00
Kihwal Lee 3a4e568e42 svn merge -c 1456172 Merging from trunk to branch-2 to fix HDFS-3344.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1456176 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 22:00:15 +00:00
Aaron Myers b4716f96d2 HDFS-4591. HA clients can fail to fail over while Standby NN is performing long checkpoint. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1456109 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 19:56:03 +00:00
Suresh Srinivas 1ed2234b3d HDFS-4583. Merged 1456052 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1456055 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 17:34:07 +00:00
Suresh Srinivas e81ffd1705 HDFS-4595. Merging 1456047 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1456048 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 16:54:10 +00:00
Aaron Myers 35a933707f HDFS-4484. libwebhdfs compilation broken with gcc 4.6.2. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1455783 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 03:01:19 +00:00
Aaron Myers 22a53efbbb HDFS-4522. LightWeightGSet expects incrementing a volatile to be atomic. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1455781 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 02:56:25 +00:00
Aaron Myers 92d306e303 HDFS-4592. Default values for access time precision are out of sync between hdfs-default.xml and the code. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1455778 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 02:34:08 +00:00
Suresh Srinivas 4b663fd69b HDFS-4013. Merge r1455754 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1455756 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 23:38:18 +00:00
Kihwal Lee 95efc3d0fc svn merge -c 1454517 Merging from trunk to branch-2 to fix HDFS-4577.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1454519 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 20:04:07 +00:00
Alejandro Abdelnur 50d493c89a HDFS-4571. WebHDFS should not set the service hostname on the server side. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1454476 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 17:24:52 +00:00
Kihwal Lee 5a12614da7 svn merge -c 1454460. Merging from trunk to branch-2 to fix HDFS-4567.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1454468 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 16:59:29 +00:00
Suresh Srinivas 4e38de7c95 HDFS-4569. Merge r1454233 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1454236 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 04:01:17 +00:00
Suresh Srinivas 22cc69ee91 HDFS-4546. Merging 1r1454021 and r1454027 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1454235 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 03:58:19 +00:00
Daryn Sharp 1fd01d8355 svn merge -c 1454059 FIXES: HDFS-4566. Webdhfs token cancelation should use authentication (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1454064 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 20:00:36 +00:00
Daryn Sharp a3045acb37 svn merge -c 1453955 FIXES: HDFS-4560. Webhdfs cannot use tokens obtained by another user (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1453956 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 16:58:12 +00:00
Arun Murthy 7808df2ed5 Preparing for 2.0.4-alpha bug-fix release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1453888 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 14:23:26 +00:00
Jonathan Turner Eagles d66691a08e HADOOP-9209. Add shell command to dump file checksums (Todd Lipcon via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1453620 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 23:33:09 +00:00
Suresh Srinivas c21caa021d HDFS-4544. Merge 1453436 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1453444 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 17:31:35 +00:00
Suresh Srinivas 54d7d46552 HDFS-4519. Merge change 1453050 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1453051 13f79535-47bb-0310-9956-ffa450edef68
2013-03-05 22:39:43 +00:00
Suresh Srinivas 10f5644190 HDFS-4540. Merge 1453025 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1453030 13f79535-47bb-0310-9956-ffa450edef68
2013-03-05 21:54:57 +00:00
Kihwal Lee 3c241b2494 svn merge -c 1452978 Merging from trunk to branch-2 to fix HDFS-4542.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1452980 13f79535-47bb-0310-9956-ffa450edef68
2013-03-05 20:20:16 +00:00
Suresh Srinivas 3a3db918ff HDFS-4541. Merge 1452461 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1452463 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 19:36:18 +00:00
Daryn Sharp b57b5cec27 svn merge -c 1452435 FIXES: HDFS-4532. RPC call queue may fill due to current user lookup (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1452438 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 18:48:16 +00:00
Daryn Sharp 363d038e21 svn merge -c 1452384 FIXES: HDFS-4128. 2NN gets stuck in inconsistent state if edit log replay fails in the middle (kihwal via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1452388 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 16:48:24 +00:00
Suresh Srinivas a8dee7c237 HDFS-4518. Merge 1451348 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1451387 13f79535-47bb-0310-9956-ffa450edef68
2013-02-28 22:08:26 +00:00
Aaron Myers 0c9ceb03b2 HDFS-4235. When outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1449985 13f79535-47bb-0310-9956-ffa450edef68
2013-02-26 00:52:38 +00:00
Aaron Myers dcc8325c12 HADOOP-8569. CMakeLists.txt: define _GNU_SOURCE and _LARGEFILE_SOURCE. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1449923 13f79535-47bb-0310-9956-ffa450edef68
2013-02-25 22:08:33 +00:00
Konstantin Boudnik 8f5c630a58 HDFS-4269. DatanodeManager#registerDatanode rejects all datanode registrations
from localhost in single-node developer setup  (Contributed by Chris Nauroth)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1449256 13f79535-47bb-0310-9956-ffa450edef68
2013-02-22 23:53:56 +00:00
Aaron Myers 90e4d62cec HDFS-4304. Make FSEditLogOp.MAX_OP_SIZE configurable. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1449219 13f79535-47bb-0310-9956-ffa450edef68
2013-02-22 21:28:29 +00:00
Aaron Myers a58b66808b HADOOP-9267. hadoop -help, -h, --help should show usage instructions. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1449162 13f79535-47bb-0310-9956-ffa450edef68
2013-02-22 18:37:30 +00:00
Suresh Srinivas 9ce332ad39 HDFS-4222. Merge r1448801 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1448805 13f79535-47bb-0310-9956-ffa450edef68
2013-02-21 21:09:17 +00:00
Uma Maheswara Rao G 975d24feb1 Merge HDFS-4482. ReplicationMonitor thread can exit with NPE due to the race between delete and replication of same file. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1448716 13f79535-47bb-0310-9956-ffa450edef68
2013-02-21 16:39:40 +00:00
Alejandro Abdelnur 1709c222d9 HADOOP-9117. replace protoc ant plugin exec with a maven plugin. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1446021 13f79535-47bb-0310-9956-ffa450edef68
2013-02-14 01:36:47 +00:00
Kihwal Lee 6beda592cc svn merge 1445964:1445965 from trunk to branch-2 to fix HDFS-4495.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1445968 13f79535-47bb-0310-9956-ffa450edef68
2013-02-13 22:59:27 +00:00
Tsz-wo Sze 7ae27355bc svn merge -c 1445006 from trunk for HDFS-4342. Directories configured in dfs.namenode.edits.dir.required but not in dfs.namenode.edits.dir are silently ignored.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1445007 13f79535-47bb-0310-9956-ffa450edef68
2013-02-12 00:50:46 +00:00
Suresh Srinivas 1991072520 HDFS-4470. Merging change r1443744 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1444430 13f79535-47bb-0310-9956-ffa450edef68
2013-02-09 20:39:31 +00:00
Suresh Srinivas 50eba7b82e Revering r1444416 because it committed unnecessary changes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1444418 13f79535-47bb-0310-9956-ffa450edef68
2013-02-09 20:09:21 +00:00
Suresh Srinivas 36d614bac4 HADOOP-9294. Merge 1444415 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1444416 13f79535-47bb-0310-9956-ffa450edef68
2013-02-09 20:01:38 +00:00
Aaron Myers ccd19548db HDFS-4471. Namenode WebUI file browsing does not work with wildcard addresses configured. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1443809 13f79535-47bb-0310-9956-ffa450edef68
2013-02-08 00:30:01 +00:00
Tsz-wo Sze b3e306302a svn merge -c 1443309 from trunk for moving HDFS-4458 to 2.0.3-alpha in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1443310 13f79535-47bb-0310-9956-ffa450edef68
2013-02-07 03:19:24 +00:00
Tsz-wo Sze 0caafb63ef svn merge -c 1443297 from trunk for HDFS-4458. In DFSUtil.getNameServiceUris(..), convert default fs URI using NetUtils.createSocketAddr(..) for being consistent with other addresses.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1443300 13f79535-47bb-0310-9956-ffa450edef68
2013-02-07 03:06:15 +00:00
Arun Murthy d898116ded Preparing for hadoop-2.0.3-alpha release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442960 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 13:39:39 +00:00
Arun Murthy 196341fc09 Setting version to 2.0.4-SNAPSHOT in branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442956 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 13:23:45 +00:00
Tsz-wo Sze f817236ff2 svn merge -c 1442824 from trunk for HDFS-4468. Use the new StringUtils methods added by HADOOP-9252 and fix TestHDFSCLI and TestQuota.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442825 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 01:15:04 +00:00
Aaron Myers 400ea0cba2 HDFS-4344. dfshealth.jsp throws NumberFormatException when dfs.hosts/dfs.hosts.exclude includes port number. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442466 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 04:09:59 +00:00
Aaron Myers 0da09ea945 HDFS-4404. Create file failure when the machine of first attempted NameNode is down. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442462 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 03:23:46 +00:00
Aaron Myers f2db75247d HDFS-4462. 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442378 13f79535-47bb-0310-9956-ffa450edef68
2013-02-04 21:32:02 +00:00
Uma Maheswara Rao G 40033359d1 Merge HDFS-4445. All BKJM ledgers are not checked while tailing, So failover will fail. Contributed Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441936 13f79535-47bb-0310-9956-ffa450edef68
2013-02-03 17:37:12 +00:00
Suresh Srinivas 0267141ec6 HDFS-4350. Merging change 1441819 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441821 13f79535-47bb-0310-9956-ffa450edef68
2013-02-02 22:37:51 +00:00
Konstantin Shvachko 6db7aa6f89 HDFS-4452. getAdditionalBlock() can create multiple blocks if the client times out and retries. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441682 13f79535-47bb-0310-9956-ffa450edef68
2013-02-02 02:09:09 +00:00
Alejandro Abdelnur 1d068dee85 HDFS-4456. Add concat to HttpFS and WebHDFS REST API docs. (plamenj2003 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441606 13f79535-47bb-0310-9956-ffa450edef68
2013-02-01 19:46:14 +00:00
Suresh Srinivas e3aca293e5 HDFS-4451. Merge change 1441113 and 1441123 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441128 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 19:03:15 +00:00
Aaron Myers 3b1002517d HDFS-4428. FsDatasetImpl should disclose what the error is when a rename fails. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440866 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 07:34:03 +00:00
Konstantin Shvachko c4e9838d53 HDFS-3598. WebHDFS support for file concat. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440291 13f79535-47bb-0310-9956-ffa450edef68
2013-01-30 06:53:26 +00:00
Aaron Myers e8738643c4 merge HADOOP-9221 from trunk. Convert remaining xdocs to APT.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440246 13f79535-47bb-0310-9956-ffa450edef68
2013-01-30 01:56:42 +00:00
Kihwal Lee 64c6dd8f5c merge -r 1440191:1440192 from trunk to branch-2 to fix HDFS-4288
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440194 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 22:49:17 +00:00
Thomas Graves fc5e5a09ed HADOOP-9190. packaging docs is broken. (Andy Isaacson via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439966 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 16:08:57 +00:00
Suresh Srinivas e6d3fceb09 HDFS-4444. Mrege 1439559 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439562 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 18:59:05 +00:00
Harsh J 91c35f4464 HDFS-4259. Improve pipeline DN replacement failure message. Contributed by Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439127 13f79535-47bb-0310-9956-ffa450edef68
2013-01-27 17:43:09 +00:00
Tsz-wo Sze 8caa368fc9 svn merge -c 1438808 from trunk for HDFS-4443. Remove a trailing '`' character from the HTML code generated by NamenodeJspHelper.generateNodeData(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1438809 13f79535-47bb-0310-9956-ffa450edef68
2013-01-26 01:19:36 +00:00
Suresh Srinivas eaf5cea54f HDFS-4426. Merge change 1437627 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1437628 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 19:02:57 +00:00
Todd Lipcon ddeb98f4fd HDFS-4403. DFSClient can infer checksum type when not provided by reading first byte. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1436731 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 02:59:32 +00:00
Aaron Myers a5eaa11dd2 HDFS-4359. Slow RPC responses from NN can prevent metrics collection on DNs. Contributed by liang xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1435300 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 18:40:44 +00:00
Aaron Myers 6bf895b378 HDFS-4415. HostnameFilter should handle hostname resolution failures and continue processing. Contributed by Robert Kanter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1434952 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 23:11:18 +00:00
Suresh Srinivas 8b080841dd HDFS-4393. Merge 1434844 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1434852 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 18:29:49 +00:00
Todd Lipcon f596c9b629 HADOOP-9215. when using cmake-2.6, libhadoop.so doesn't get created (only libhadoop.so.1.0.0). Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1434531 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 01:37:45 +00:00
Thomas Graves d5334e1571 Preparing for release 0.23.6
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1434031 13f79535-47bb-0310-9956-ffa450edef68
2013-01-16 16:46:12 +00:00
Todd Lipcon af0243542c Revert r1433756: HDFS-4288. NN accepts incremental BR as IBR in safemode. Contributed by Daryn Sharp.
This commit caused TestBlockManager to fail.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433821 13f79535-47bb-0310-9956-ffa450edef68
2013-01-16 04:23:26 +00:00
Todd Lipcon 9a9e04d22b HDFS-4288. NN accepts incremental BR as IBR in safemode. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433756 13f79535-47bb-0310-9956-ffa450edef68
2013-01-16 00:09:59 +00:00
Todd Lipcon 467e811003 HADOOP-8712. Change default hadoop.security.group.mapping to JniBasedUnixGroupsNetgroupMappingWithFallback. Contributed by Robert Parker.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433625 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 20:43:35 +00:00
Suresh Srinivas 896c21ee69 HDFS-4392. Merge 1433578 change from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433579 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 18:50:33 +00:00
Arun Murthy 5e826c4b28 Merge -c 1433461 from trunk to branch-2 to fix HDFS-4399. Fix RAT warnings by excluding images sub-dir in docs. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433467 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 15:44:31 +00:00
Eli Collins 6ca7bde28d HADOOP-9178. src/main/conf is missing hadoop-policy.xml. Contributed by Sandy Ryza
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433278 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 03:30:19 +00:00
Suresh Srinivas f7fbf9e711 HDFS-4375. Merge 1433235 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433238 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 00:29:12 +00:00
Suresh Srinivas eae2575378 HDFS-4369. Merging change 1433206 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433211 13f79535-47bb-0310-9956-ffa450edef68
2013-01-14 23:18:54 +00:00
Suresh Srinivas 303cf8fa39 HDFS-4364. GetLinkTargetResponseProto does not handle null path. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433202 13f79535-47bb-0310-9956-ffa450edef68
2013-01-14 23:10:54 +00:00
Todd Lipcon 034ec8af5a HDFS-3429. DataNode reads checksums even if client does not need them. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433116 13f79535-47bb-0310-9956-ffa450edef68
2013-01-14 20:44:29 +00:00
Thomas Graves 0b366be496 HDFS-4385. Maven RAT plugin is not checking all source files (tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1432941 13f79535-47bb-0310-9956-ffa450edef68
2013-01-14 15:01:59 +00:00
Konstantin Shvachko 67d123c6b7 HDFS-1245. Pluggable block id generation. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1432541 13f79535-47bb-0310-9956-ffa450edef68
2013-01-13 01:29:57 +00:00
Eli Collins f07582bc84 HDFS-4274. BlockPoolSliceScanner does not close verification log during shutdown. Contributed by Chris Nauroth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1432318 13f79535-47bb-0310-9956-ffa450edef68
2013-01-11 22:21:21 +00:00
Eli Collins 0dadaa47c3 HDFS-4328. TestLargeBlock#testLargeBlockSize is timing out. Contributed by Chris Nauroth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1432226 13f79535-47bb-0310-9956-ffa450edef68
2013-01-11 18:56:02 +00:00
Eli Collins 2f33ec0298 HDFS-4387. test_libhdfs_threaded SEGV on OpenJDK 7. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1432223 13f79535-47bb-0310-9956-ffa450edef68
2013-01-11 18:50:21 +00:00
Suresh Srinivas bc000eea02 HDFS-4381. Merge 1432149 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1432153 13f79535-47bb-0310-9956-ffa450edef68
2013-01-11 17:03:09 +00:00
Thomas Graves 32d84f899f HDFS-2908. Add apache license header for StorageReport.java. (Brandon Li via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1431837 13f79535-47bb-0310-9956-ffa450edef68
2013-01-11 02:53:42 +00:00
Eli Collins 71163ca1ed HDFS-4377. Some trivial DN comment cleanup. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1431754 13f79535-47bb-0310-9956-ffa450edef68
2013-01-11 00:11:06 +00:00
Suresh Srinivas 4c3b67d0c9 HDFS-4367. Merge change 1429199 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1431462 13f79535-47bb-0310-9956-ffa450edef68
2013-01-10 16:10:58 +00:00
Eli Collins b8b1a264ac HDFS-4032. Specify the charset explicitly rather than rely on the default. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1431180 13f79535-47bb-0310-9956-ffa450edef68
2013-01-10 02:34:45 +00:00
Aaron Myers 913d2424a0 HADOOP-9155. FsPermission should have different default value, 777 for directory and 666 for file. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1431157 13f79535-47bb-0310-9956-ffa450edef68
2013-01-09 23:54:24 +00:00
Aaron Myers 5da072bd59 HDFS-4306. PBHelper.convertLocatedBlock miss convert BlockToken. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1431118 13f79535-47bb-0310-9956-ffa450edef68
2013-01-09 22:31:44 +00:00
Suresh Srinivas fa72c8f6eb HDFS-4363. Merge change r1431088 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1431101 13f79535-47bb-0310-9956-ffa450edef68
2013-01-09 21:37:01 +00:00
Eli Collins 1c08bb25a0 HDFS-4035. LightWeightGSet and LightWeightHashSet increment a volatile without synchronization. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1430619 13f79535-47bb-0310-9956-ffa450edef68
2013-01-08 22:57:39 +00:00
Suresh Srinivas 80a59a5fb1 HDFS-4362. Merging change r1430137 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1430594 13f79535-47bb-0310-9956-ffa450edef68
2013-01-08 22:43:28 +00:00
Eli Collins de8ec340ca HDFS-4034. Remove redundant null checks. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1430588 13f79535-47bb-0310-9956-ffa450edef68
2013-01-08 22:39:40 +00:00
Eli Collins 030fc9a0c3 HDFS-4033. Miscellaneous findbugs 2 fixes. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1430576 13f79535-47bb-0310-9956-ffa450edef68
2013-01-08 22:24:56 +00:00
Eli Collins 38135e3651 HDFS-4031. Update findbugsExcludeFile.xml to include findbugs 2 exclusions. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1430552 13f79535-47bb-0310-9956-ffa450edef68
2013-01-08 21:43:12 +00:00
Eli Collins 99a64115ce HDFS-4030. BlockManager excessBlocksCount and postponedMisreplicatedBlocksCount should be AtomicLongs. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1430549 13f79535-47bb-0310-9956-ffa450edef68
2013-01-08 21:37:46 +00:00
Eli Collins ecf8c442f4 HDFS-4100. Fix all findbug security warings. Contributed by Liang Xie
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1430545 13f79535-47bb-0310-9956-ffa450edef68
2013-01-08 21:13:48 +00:00
Aaron Myers 4e9f524ee3 HDFS-3970. Fix bug causing rollback of HDFS upgrade to result in bad VERSION file. Contributed by Vinay and Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1430038 13f79535-47bb-0310-9956-ffa450edef68
2013-01-07 21:50:28 +00:00
Tsz-wo Sze abf7e8dcc0 svn merge -c 1429653 from trunk for HDFS-4351. In BlockPlacementPolicyDefault.chooseTarget(..), numOfReplicas needs to be updated when avoiding stale nodes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1429654 13f79535-47bb-0310-9956-ffa450edef68
2013-01-07 03:12:15 +00:00
Suresh Srinivas b1fe072e04 HADOOP-9173. Merging changes r1428970 and r1428972 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1429030 13f79535-47bb-0310-9956-ffa450edef68
2013-01-04 18:54:12 +00:00
Tsz-wo Sze 3e68d15c1e svn merge -c 1428739 from trunk for HDFS-4270. Introduce soft and hard limits for max replication so that replications of the highest priority are allowed to choose a source datanode that has reached its soft limit but not the hard limit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1428743 13f79535-47bb-0310-9956-ffa450edef68
2013-01-04 08:13:52 +00:00
Todd Lipcon b4b26fc0a1 HDFS-4302. Fix fatal exception when starting NameNode with DEBUG logs. Contributed by Eugene Koontz.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1428591 13f79535-47bb-0310-9956-ffa450edef68
2013-01-03 20:55:09 +00:00
Konstantin Shvachko 485b5b4058 HDFS-4349. Add test for reading files from BackupNode. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1427291 13f79535-47bb-0310-9956-ffa450edef68
2013-01-01 03:40:27 +00:00
Konstantin Shvachko a3e393afaf HDFS-4347. Avoid infinite waiting checkpoint to complete in TestBackupNode. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1426706 13f79535-47bb-0310-9956-ffa450edef68
2012-12-29 04:28:38 +00:00
Konstantin Shvachko 6a4b1b881c HDFS-4308. addBlock() should persist file blocks once. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1426703 13f79535-47bb-0310-9956-ffa450edef68
2012-12-29 04:18:00 +00:00
Arun Murthy 6796f8d226 Merge -c 1425560 from trunk to branch-2 to fix HDFS-4326. bump up Tomcat version for HttpFS to 6.0.36. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1425562 13f79535-47bb-0310-9956-ffa450edef68
2012-12-24 00:16:23 +00:00
Alejandro Abdelnur 7194c52ec3 HADOOP-8427. Convert Forrest docs to APT, incremental. (adi2 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1425527 13f79535-47bb-0310-9956-ffa450edef68
2012-12-23 21:15:42 +00:00
Arun Murthy f68da35bb2 Reverting HDFS-4326 since it caused 'mvn package' to break.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1425400 13f79535-47bb-0310-9956-ffa450edef68
2012-12-23 03:52:42 +00:00
Alejandro Abdelnur e30516f017 HDFS-4326. bump up Tomcat version for HttpFS to 6.0.36. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1424064 13f79535-47bb-0310-9956-ffa450edef68
2012-12-19 20:00:47 +00:00
Aaron Myers 16d0c440de HDFS-4140. fuse-dfs handles open(O_TRUNC) poorly. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1423260 13f79535-47bb-0310-9956-ffa450edef68
2012-12-18 02:43:32 +00:00
Todd Lipcon 113c27a039 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1423241 13f79535-47bb-0310-9956-ffa450edef68
2012-12-18 01:15:28 +00:00
Aaron Myers 9c7a53cf3b HDFS-4315. DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1422780 13f79535-47bb-0310-9956-ffa450edef68
2012-12-17 07:53:35 +00:00
Aaron Myers b4022a08ed Move HDFS-2264 and HDFS-4294 to the correct section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1421604 13f79535-47bb-0310-9956-ffa450edef68
2012-12-13 22:56:42 +00:00
Aaron Myers eed48f54f5 HDFS-4307. SocketCache should use monotonic time. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1421573 13f79535-47bb-0310-9956-ffa450edef68
2012-12-13 22:13:07 +00:00
Aaron Myers 42f6c0fd63 HDFS-2264. NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419951 13f79535-47bb-0310-9956-ffa450edef68
2012-12-11 00:54:24 +00:00
Aaron Myers 29ad19e950 HDFS-4294. Backwards compatibility is not maintained for TestVolumeId. Contributed by Ivan A. Veselovsky and Robert Parker.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419877 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 23:49:48 +00:00
Todd Lipcon f38fdbf648 HDFS-4295. Using port 1023 should be valid when starting Secure DataNode. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419855 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 22:47:10 +00:00
Todd Lipcon f8f4269cd7 HDFS-4292. Sanity check not correct in RemoteBlockReader2.newBlockReader. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419676 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 19:13:09 +00:00
Todd Lipcon 8fa6d8a074 HDFS-4291. edit log unit tests leave stray test_edit_log_file around. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419664 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 18:55:06 +00:00
Uma Maheswara Rao G b5a959d39d HDFS-4130. BKJM: The reading for editlog at NN starting using bkjm is not efficient. Contributed by Han Xiao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419661 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 18:52:35 +00:00
Aaron Myers 2e12de45a4 HDFS-4279. NameNode does not initialize generic conf keys when started with -recover. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418560 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 23:54:31 +00:00
Suresh Srinivas 448882534b HDFS-4236. Merge change 1418356 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418363 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 15:40:24 +00:00
Todd Lipcon 6fe949979a HDFS-4282. TestEditLog.testFuzzSequences FAILED in all pre-commit test. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418212 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 08:17:38 +00:00
Aaron Myers 3607109ae1 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418115 13f79535-47bb-0310-9956-ffa450edef68
2012-12-06 22:30:07 +00:00
Konstantin Shvachko f87b3c68bf HDFS-4268. Remove redundant enum NNHAStatusHeartbeat.State. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417753 13f79535-47bb-0310-9956-ffa450edef68
2012-12-06 07:23:41 +00:00
Todd Lipcon 46f2591a9e HDFS-4238. Standby namenode should not do purging of shared storage edits. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417652 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 21:18:16 +00:00
Todd Lipcon 4d57c660df HDFS-3935. Add JournalNode to the start/stop scripts. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417599 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:28:02 +00:00
Todd Lipcon 0bac725e19 HDFS-4153. Add START_MSG/SHUTDOWN_MSG for JournalNode. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417598 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:26:39 +00:00
Todd Lipcon 9c19d236ef HDFS-4110. Refine a log printed in JNStorage. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417597 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:24:47 +00:00
Todd Lipcon fd032dd9e3 Merge HDFS-3077 (QuorumJournalManager) backport into branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417596 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:22:17 +00:00
Todd Lipcon 2f8a18ce95 HDFS-3571. Allow EditLogFileInputStream to read from a remote URL. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417589 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:15:53 +00:00
Todd Lipcon 857c428a90 HDFS-3049. During the normal NN startup process, fall back on a different edit log if we see one that is corrupt. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417588 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:13:29 +00:00
Aaron Myers d6a9d9f76c HDFS-4199. Provide test for HdfsVolumeId. Contributed by Ivan A. Veselovsky.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417264 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 01:48:12 +00:00
Konstantin Shvachko f0a1fb73ff HDFS-4231. BackupNode: Introduce BackupState. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1416289 13f79535-47bb-0310-9956-ffa450edef68
2012-12-02 23:18:17 +00:00
Tsz-wo Sze 76029e926c svn merge -c 1416064 from trunk for HDFS-4248. Renaming directories may incorrectly remove the paths in leases under the tree.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1416066 13f79535-47bb-0310-9956-ffa450edef68
2012-12-01 22:41:17 +00:00
Daryn Sharp 85a5ad4bf9 svn merge -c 1416034 FIXES: HDFS-4247. saveNamespace should be tolerant of dangling lease (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1416035 13f79535-47bb-0310-9956-ffa450edef68
2012-12-01 18:23:55 +00:00
Tsz-wo Sze 5c0153d833 svn merge -c 1415799 from trunk for HDFS-4213. Add an API to hsync for updating the last block length at the namenode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1415801 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 19:30:36 +00:00
Tsz-wo Sze 208cfa37a9 svn merge -c 1415480 from trunk for HDFS-4242. Map.Entry is incorrectly used in LeaseManager since the behavior of it is undefined after the iteration or modifications of the map.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1415481 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 02:52:03 +00:00
Aaron Myers e34575d076 HDFS-4214. OfflineEditsViewer should print out the offset at which it encountered an error. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1414505 13f79535-47bb-0310-9956-ffa450edef68
2012-11-28 01:41:28 +00:00
Tsz-wo Sze c14334d536 svn merge -c 1412237 from trunk for HDFS-4216. Do not ignore QuotaExceededException when adding symlinks.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1412244 13f79535-47bb-0310-9956-ffa450edef68
2012-11-21 19:33:46 +00:00
Thomas White 7a8bc99858 Merge -r 1412076:1412077 from trunk to branch-2. Fixes: HADOOP-9049. DelegationTokenRenewer needs to be Singleton and FileSystems should register/deregister to/from. Contributed by Karthik Kambatla.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1412079 13f79535-47bb-0310-9956-ffa450edef68
2012-11-21 12:37:42 +00:00
Eli Collins 5c7d4bd9f1 HADOOP-9042. Add a test for umask in FileSystemContractBaseTest. Contributed by Colin McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1411882 13f79535-47bb-0310-9956-ffa450edef68
2012-11-20 21:20:07 +00:00
Konstantin Shvachko 4688f839d2 HDFS-4179. BackupNode: allow reads, fix checkpointing, safeMode. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1411509 13f79535-47bb-0310-9956-ffa450edef68
2012-11-20 02:04:02 +00:00
Daryn Sharp 30b507934a svn merge -c 1411229 FIXES: HDFS-4178. Shell scripts should not close stderr (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1411231 13f79535-47bb-0310-9956-ffa450edef68
2012-11-19 15:05:59 +00:00
Alejandro Abdelnur edf729ebed HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410828 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 05:34:52 +00:00
Eli Collins 7c4324f6bd Amend HDFS-4156.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410827 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 05:25:13 +00:00
Eli Collins b4d01a0041 HDFS-4156. Seeking to a negative position should throw an IOE. Contributed by Eli Reisman
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410813 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 02:19:16 +00:00
Jitendra Nath Pandey e90d0ef396 Merged r1410691 from trunk for HDFS-4105.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410702 13f79535-47bb-0310-9956-ffa450edef68
2012-11-17 06:38:46 +00:00
Aaron Myers cd3e17fb0a HDFS-3507. DFS#isInSafeMode needs to execute only on Active NameNode. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410590 13f79535-47bb-0310-9956-ffa450edef68
2012-11-16 21:59:54 +00:00
Daryn Sharp 0cb4b2039d svn merge -c 1409988 FIXES: HDFS-4186 logSync() is called with the write lock held while releasing lease (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409992 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 20:35:16 +00:00
Uma Maheswara Rao G 210941550a Merge HDFS-3623. BKJM: zkLatchWaitTimeout hard coded to 6000. Make use of ZKSessionTimeout instead. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409907 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 18:28:29 +00:00
Daryn Sharp dc2fee69d5 svn merge -c 1409848 FIXES: HDFS-4104. dfs -test -d prints inappropriate error on nonexistent directory (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409850 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 15:55:36 +00:00
Robert Joseph Evans 9a5a5082c6 Updated CHANGES.txt in preparation for 0.23.5 release
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409821 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 14:59:27 +00:00
Robert Joseph Evans d0a66f405f svn merge -c 1409311 FIXES: HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409316 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 19:29:17 +00:00
Robert Joseph Evans eeced257c0 svn merge -r 1409090:1409089 reverting HDFS-4171 until test failures can be fixed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409268 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 17:35:42 +00:00
Eli Collins a32639ac33 HDFS-4139. fuse-dfs RO mode still allows file truncation. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409093 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 06:19:20 +00:00
Alejandro Abdelnur 502d6b940d HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409090 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 06:18:04 +00:00
Uma Maheswara Rao G 0ce462007e Merge HDFS-4038. Override toString() for BookKeeperEditLogInputStream. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409072 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 03:18:32 +00:00
Suresh Srinivas 09774b8005 HDFS-4106. Merging change r1403075 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409039 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 00:03:15 +00:00
Daryn Sharp 6ef30552db svn merge -c 1408779 FIXES: HDFS-4181. LeaseManager tries to double remove and prints extra messages (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408780 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 15:31:17 +00:00
Aaron Myers 067eabb820 HDFS-3921. NN will prematurely consider blocks missing when entering active state while still in safe mode. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408534 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 01:30:34 +00:00
Eli Collins 4321bc1d5c HDFS-1322. Document umask in DistributedFileSystem#mkdirs javadocs. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408533 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 01:29:51 +00:00
Eli Collins 748284170a HDFS-4164. fuse_dfs: add -lrt to the compiler command line on Linux. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408478 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 22:22:01 +00:00
Robert Joseph Evans cc384335f9 svn merge -c 1408401 FIXES: HDFS-4172. namenode does not URI-encode parameters when building URI for datanode request (Derek Dagit via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408403 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 18:54:57 +00:00
Thomas White d488a59497 Merge -r 1407657:1407658 from trunk to branch-2. Fixes: HADOOP-8860. Split MapReduce and YARN sections in documentation navigation.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408290 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 13:57:19 +00:00
Suresh Srinivas e9042a0db7 Moving HDFS-4080 to Incompatible Change section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407572 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 18:16:38 +00:00
Suresh Srinivas bcc35e1ac3 HDFS-4080. Merging change r1407566 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407571 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 18:15:14 +00:00
Suresh Srinivas f0c5611551 HDFS-4162. Merging 1407556 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407557 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 17:44:29 +00:00
Eli Collins 3d73261636 HDFS-4048. Use ERROR instead of INFO for volume failure logs. Contributed by Stephen Chu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407346 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 03:13:43 +00:00
Daryn Sharp 6b264008a9 svn merge -c 1407333 FIXES: HDFS-3990. NN's health report has severe performance problems (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407334 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 00:56:50 +00:00