Commit Graph

651 Commits

Author SHA1 Message Date
Jitendra Nath Pandey 041a1e0a52 Merged from trunk for HDFS-3819.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376360 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 04:05:12 +00:00
Aaron Myers 4e75deb4e7 HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376189 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 18:48:32 +00:00
Suresh Srinivas 8c28ebabcd HDFS-3832. Merging change 1376139 from trunk to branch-2. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376145 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 17:05:38 +00:00
Eli Collins 8340bb151e HDFS-3837. Fix DataNode.recoverBlock findbugs warning. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376130 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 16:28:22 +00:00
Eli Collins 095553e7a6 HDFS-3830. test_libhdfs_threaded: use forceNewInstance. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376122 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 16:19:43 +00:00
Suresh Srinivas 63810d26ae HDFS-2686. Merging change 1375800 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375806 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 21:33:17 +00:00
Eli Collins 08bd69a851 HDFS-2727. libhdfs should get the default block size from the server. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375384 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 03:49:28 +00:00
Eli Collins 566f3d5917 HDFS-3707. TestFSInputChecker: improper use of skip. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375338 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 00:01:43 +00:00
Suresh Srinivas b082909c32 HDFS-3816. Merging 1374645 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374648 13f79535-47bb-0310-9956-ffa450edef68
2012-08-18 19:57:36 +00:00
Aaron Myers 8ab1c7a47b HDFS-3672. Expose disk-location information for blocks to enable better scheduling. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374359 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 17:03:32 +00:00
Tsz-wo Sze aa9bf3b472 svn merge -c 1374127 from trunk for HDFS-2421. Improve the concurrency of SerialNumberMap in NameNode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374128 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 01:55:33 +00:00
Tsz-wo Sze c849ef9bea svn merge -c 1374122 from trunk for HDFS-3788. ByteRangeInputStream should not expect HTTP Content-Length header when chunked transfer-encoding is used.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374124 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 01:44:31 +00:00
Aaron Myers 2fc30022d0 HDFS-3808. fuse_dfs: postpone libhdfs intialization until after fork. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374107 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 23:48:23 +00:00
Eli Collins 841dda010b HDFS-2963. Console Output is confusing while executing metasave (dfsadmin command). Contributed by Andrew Wang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374042 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 20:37:32 +00:00
Eli Collins ac63450f02 HDFS-3194. DataNode block scanner is running too frequently. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373932 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 17:16:52 +00:00
Eli Collins 3f1998b7ba HDFS-3048. Small race in BlockManager#close. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373665 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 22:45:05 +00:00
Todd Lipcon e8eca906d4 HDFS-3796. Speed up edit log tests by avoiding fsync(). Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373558 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 18:36:15 +00:00
Tsz-wo Sze 2f7382cd07 svn merge -c 1373253 from trunk for HDFS-3802. StartupOption.name in HdfsServerConstants should be final.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373258 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 08:09:44 +00:00
Tsz-wo Sze 8b18a6f5be svn merge -c 1373193 from trunk for HDFS-3794. WebHDFS OPEN returns the incorrect Content-Length in the HTTP header when offset is specified and length is omitted.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373195 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 02:25:09 +00:00
Suresh Srinivas 34e596611f HDFS-3723. Merging change r1373173 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373185 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 01:03:11 +00:00
Suresh Srinivas c738a9964b HDFS-3803. Merging change 1373174 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373182 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 00:56:32 +00:00
Eli Collins 3cdd6a9a2d HDFS-3150. Add option for clients to contact DNs via hostname. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373143 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 22:15:57 +00:00
Daryn Sharp 2964cc0f59 svn merge -c 1373090 FIXES: HDFS-3718. Datanode won't shutdown because of runaway DataBlockScanner thread (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373095 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 21:01:34 +00:00
Todd Lipcon d0e5d7e971 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373060 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 20:11:31 +00:00
Tsz-wo Sze 4a84c9020d svn merge -c 1372707 from trunk for HDFS-3658. Fix bugs in TestDFSClientRetries and add more tests. (szetszwo)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372718 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 03:39:27 +00:00
Aaron Myers 080455d1cc HDFS-3790. test_fuse_dfs.c doesn't compile on centos 5. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372678 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 00:05:42 +00:00
Todd Lipcon b2511abfc8 HDFS-3276. initializeSharedEdits should have a -nonInteractive flag. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372627 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 21:26:12 +00:00
Todd Lipcon f4ad5b20ce HDFS-3190. Simple refactors in existing NN code to assist QuorumJournalManager extension. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372603 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 20:51:21 +00:00
Todd Lipcon 6697240114 HDFS-2330. In NNStorage.java, IOExceptions of stream closures can mask root exceptions. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372599 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 20:47:14 +00:00
Aaron Myers d3427c7d93 Revert HDFS-3719. See discussion there and HDFS-3770 for more info.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372545 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 18:44:49 +00:00
Eli Collins ae6b1ea89c HDFS-3758. TestFuseDFS test failing. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371556 13f79535-47bb-0310-9956-ffa450edef68
2012-08-10 03:47:12 +00:00
Aaron Myers 49e89472a9 HDFS-3721. hsync support broke wire compatibility. Contributed by Todd Lipcon and Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371496 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 21:33:20 +00:00
Aaron Myers cc33d7b2ce HDFS-3634. Add self-contained, mavenized fuse_dfs test. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371232 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 14:45:08 +00:00
Todd Lipcon ecc88a6dd7 HDFS-3755. Creating an already-open-for-write file with overwrite=true fails. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370936 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 20:15:31 +00:00
Aaron Myers 82ee5ce47e HDFS-3710. libhdfs misuses O_RDONLY/WRONLY/RDWR. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370906 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 19:33:03 +00:00
Aaron Myers 208da340c3 HDFS-3760. primitiveCreate is a write, not a read. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370650 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 02:54:59 +00:00
Eli Collins 84314d99e5 HDFS-3754. BlockSender doesn't shutdown ReadaheadPool threads. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370496 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 20:23:11 +00:00
Alejandro Abdelnur faf54e5b2a Merge -r 1370386:1370387 from trunk to branch. FIXES: HDFS-3291
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370392 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 17:46:24 +00:00
Aaron Myers 9c8485f099 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370360 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 16:46:03 +00:00
Aaron Myers 7f92566e21 HDFS-3579. libhdfs: fix exception handling. (Colin Patrick McCabe via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370016 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 21:03:57 +00:00
Aaron Myers b86332b8e1 HDFS-3719. Re-enable append-related tests in TestFileConcurrentReader. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1369851 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 14:03:52 +00:00
Alejandro Abdelnur 99050a6508 Merge -r 1368732:1368733 from trunk to branch. FIXES: HDFS-3756
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1368735 13f79535-47bb-0310-9956-ffa450edef68
2012-08-02 22:12:58 +00:00
Alejandro Abdelnur 6406fb59f7 Merge -r 1368303:1368304 from trunk to branch. FIXES: HDFS-3513
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1368305 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 23:10:26 +00:00
Aaron Myers af6d62a9c1 HDFS-3738. TestDFSClientRetries#testFailuresArePerOperation sets incorrect timeout config. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367845 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 02:22:30 +00:00
Tsz-wo Sze 15a9b9829a svn merge -c 1367841 from trunk for HDFS-3667. Add retry support to WebHdfsFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367842 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 01:44:03 +00:00
Tsz-wo Sze cfedcc9e27 svn merge -c -1366602 for reverting HDFS-3667.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367408 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 04:36:35 +00:00
Aaron Myers cb94513c1f HDFS-3732. fuse_dfs: incorrect configuration value checked for connection expiry timer period. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367201 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 18:07:53 +00:00
Tsz-wo Sze 9d30ba3753 svn merge -c 1366601 from trunk for HDFS-3667. Add retry support to WebHdfsFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1366602 13f79535-47bb-0310-9956-ffa450edef68
2012-07-28 06:07:22 +00:00
Suresh Srinivas 117c16edfe HDFS-3679. merging change 1366545 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1366546 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 21:53:13 +00:00
Daryn Sharp af0cc1c7c0 svn merge -c 1366471 FIXES: HDFS-3553. Hftp proxy tokens are broken (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1366501 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 19:08:10 +00:00