Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
3,033 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

740 Commits

Author SHA1 Message Date
Eli Collins 0e5d96e3ee HDFS-3731. Release upgrade must handle blocks being written from 1.0. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377548 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-27 01:07:04 +00:00
Eli Collins 804c45867a HDFS-3853. Port MiniDFSCluster enableManagedDfsDirsRedundancy. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377545 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-27 00:11:39 +00:00
Aaron Myers 6cac9aa7f9 HDFS-3683. Edit log replay progress indicator shows >100% complete. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377368 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-26 00:32:08 +00:00
Suresh Srinivas 5998a179b4 HDFS-3844. Merge change 1377168 from trunk. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377176 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-25 01:23:52 +00:00
Tsz-wo Sze a26cfc347f svn merge -c 1376928 from trunk for HDFS-3177. Update DFSClient and DataXceiver to handle different checkum types in file checksum computation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376937 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 14:24:59 +00:00
Eli Collins f068e8db4b Revert HDFS-3837. Fix DataNode.recoverBlock findbugs warning. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376702 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 21:09:23 +00:00
Eli Collins 7f16809a3b Amend previous commit to remove TestFileCreationNamenodeRestart. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376699 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 21:03:25 +00:00
Eli Collins 7138f2b44f HDFS-3715. Fix TestFileCreation#testFileCreationNamenodeRestart. Contributed by Andrew Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376692 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 20:52:30 +00:00
Jitendra Nath Pandey 041a1e0a52 Merged from trunk for HDFS-3819. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376360 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 04:05:12 +00:00
Aaron Myers 4e75deb4e7 HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376189 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 18:48:32 +00:00
Suresh Srinivas 8c28ebabcd HDFS-3832. Merging change 1376139 from trunk to branch-2. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376145 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 17:05:38 +00:00
Eli Collins 8340bb151e HDFS-3837. Fix DataNode.recoverBlock findbugs warning. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376130 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 16:28:22 +00:00
Eli Collins 095553e7a6 HDFS-3830. test_libhdfs_threaded: use forceNewInstance. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376122 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 16:19:43 +00:00
Suresh Srinivas 63810d26ae HDFS-2686. Merging change 1375800 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375806 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 21:33:17 +00:00
Tsz-wo Sze c0b9b996f9 svn merge -c 1375450 from trunk for HADOOP-8239. Add subclasses of MD5MD5CRC32FileChecksum to support file checksum with CRC32C. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375453 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 09:49:00 +00:00
Eli Collins 08bd69a851 HDFS-2727. libhdfs should get the default block size from the server. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375384 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 03:49:28 +00:00
Eli Collins 566f3d5917 HDFS-3707. TestFSInputChecker: improper use of skip. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375338 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 00:01:43 +00:00
Tsz-wo Sze fa76c71e62 svn merge -c 1374696 from trunk for HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374697 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-19 05:51:37 +00:00
Suresh Srinivas b082909c32 HDFS-3816. Merging 1374645 from trunk to branch-2 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374648 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-18 19:57:36 +00:00
Eli Collins 7da3b52623 HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374474 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 23:24:36 +00:00
Aaron Myers 8ab1c7a47b HDFS-3672. Expose disk-location information for blocks to enable better scheduling. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374359 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 17:03:32 +00:00
Daryn Sharp a8f10869a8 svn merge -c 1374271 FIXES: HADOOP-7967. Need generalized multi-token filesystem support (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374346 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 16:26:01 +00:00
Tsz-wo Sze aa9bf3b472 svn merge -c 1374127 from trunk for HDFS-2421. Improve the concurrency of SerialNumberMap in NameNode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374128 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 01:55:33 +00:00
Tsz-wo Sze c849ef9bea svn merge -c 1374122 from trunk for HDFS-3788. ByteRangeInputStream should not expect HTTP Content-Length header when chunked transfer-encoding is used. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374124 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 01:44:31 +00:00
Aaron Myers 2fc30022d0 HDFS-3808. fuse_dfs: postpone libhdfs intialization until after fork. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374107 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 23:48:23 +00:00
Eli Collins 841dda010b HDFS-2963. Console Output is confusing while executing metasave (dfsadmin command). Contributed by Andrew Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374042 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 20:37:32 +00:00
Eli Collins ac63450f02 HDFS-3194. DataNode block scanner is running too frequently. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373932 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 17:16:52 +00:00
Tsz-wo Sze 1294ad1df7 svn merge -c 1373683 from trunk for HADOOP-8700. Use enum to define the checksum constants in DataChecksum. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373686 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 01:42:16 +00:00
Eli Collins 3f1998b7ba HDFS-3048. Small race in BlockManager#close. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373665 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 22:45:05 +00:00
Thomas White 15b9897255 Merge -r 1373573:1373574 from trunk to branch-2. Fixes: HADOOP-8278 - Make sure components declare correct set of dependencies 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373594 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 19:28:51 +00:00
Todd Lipcon e8eca906d4 HDFS-3796. Speed up edit log tests by avoiding fsync(). Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373558 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 18:36:15 +00:00
Tsz-wo Sze 2f7382cd07 svn merge -c 1373253 from trunk for HDFS-3802. StartupOption.name in HdfsServerConstants should be final. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373258 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 08:09:44 +00:00
Tsz-wo Sze 8b18a6f5be svn merge -c 1373193 from trunk for HDFS-3794. WebHDFS OPEN returns the incorrect Content-Length in the HTTP header when offset is specified and length is omitted. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373195 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 02:25:09 +00:00
Suresh Srinivas 34e596611f HDFS-3723. Merging change r1373173 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373185 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 01:03:11 +00:00
Suresh Srinivas c738a9964b HDFS-3803. Merging change 1373174 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373182 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:56:32 +00:00
Eli Collins 997cd514c7 Amend HDFS-3150 to fix TestMiniDFSCluster.java. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373144 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 22:18:25 +00:00
Eli Collins 3cdd6a9a2d HDFS-3150. Add option for clients to contact DNs via hostname. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373143 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 22:15:57 +00:00
Daryn Sharp 2964cc0f59 svn merge -c 1373090 FIXES: HDFS-3718. Datanode won't shutdown because of runaway DataBlockScanner thread (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373095 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 21:01:34 +00:00
Todd Lipcon d0e5d7e971 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373060 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 20:11:31 +00:00
Tsz-wo Sze 4a84c9020d svn merge -c 1372707 from trunk for HDFS-3658. Fix bugs in TestDFSClientRetries and add more tests. (szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372718 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 03:39:27 +00:00
Aaron Myers 080455d1cc HDFS-3790. test_fuse_dfs.c doesn't compile on centos 5. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372678 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 00:05:42 +00:00
Alejandro Abdelnur b344870bdd HADOOP-8681. add support for HTTPS to the web UIs. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372642 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 21:56:31 +00:00
Todd Lipcon b2511abfc8 HDFS-3276. initializeSharedEdits should have a -nonInteractive flag. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372627 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 21:26:12 +00:00
Todd Lipcon f4ad5b20ce HDFS-3190. Simple refactors in existing NN code to assist QuorumJournalManager extension. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372603 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 20:51:21 +00:00
Todd Lipcon 6697240114 HDFS-2330. In NNStorage.java, IOExceptions of stream closures can mask root exceptions. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372599 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 20:47:14 +00:00
Aaron Myers d3427c7d93 Revert HDFS-3719. See discussion there and HDFS-3770 for more info. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372545 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 18:44:49 +00:00
Eli Collins ae6b1ea89c HDFS-3758. TestFuseDFS test failing. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371556 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-10 03:47:12 +00:00
Todd Lipcon ced2087998 HADOOP-8659. Native libraries must build with soft-float ABI for Oracle JVM on ARM. Contributed by Trevor Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371508 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 21:58:29 +00:00
Aaron Myers 49e89472a9 HDFS-3721. hsync support broke wire compatibility. Contributed by Todd Lipcon and Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371496 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 21:33:20 +00:00
Aaron Myers cc33d7b2ce HDFS-3634. Add self-contained, mavenized fuse_dfs test. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371232 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 14:45:08 +00:00