Commit Graph

586 Commits

Author SHA1 Message Date
Todd Lipcon fb87050e00 HDFS-3605. Block mistakenly marked corrupt during edit log catchup phase of failover. Contributed by Todd Lipcon and Brahma Reddy Battula.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363176 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 23:42:20 +00:00
Daryn Sharp 22022a8760 svn merge -c 1363170 FIXES: HDFS-3646. LeaseRenewer can hold reference to inactive DFSClient instances forever.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363172 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 23:27:21 +00:00
Eli Collins e8b0614072 HDFS-2966. TestNameNodeMetrics tests can fail under load. Contributed by Steve Loughran
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362985 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 15:42:19 +00:00
Tsz-wo Sze 7221b08042 svn merge -c 1362976 from trunk for HDFS-3577. In DatanodeWebHdfsMethods, use MessageBodyWriter instead of StreamingOutput, otherwise, it will fail to transfer large files.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362977 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 15:14:38 +00:00
Eli Collins ab129035bf Revert HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362765 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 05:16:50 +00:00
Eli Collins 3f4826881d Revert HDFS-3654. TestJspHelper#testGetUgi fails with NPE.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362764 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 05:16:09 +00:00
Eli Collins 9404bc7cad HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362274 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 21:30:42 +00:00
Eli Collins c56bbc7a00 HDFS-3665. Add a test for renaming across file systems via a symlink. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362179 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 18:34:09 +00:00
Eli Collins fa26901c01 HDFS-3537. Move libhdfs and fuse-dfs source to native subdirectories. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362127 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 16:54:49 +00:00
Harsh J 2c418eecf6 Backport of HDFS-3659 from trunk. Add missing @Override to methods across the hadoop-hdfs project. Contributed by Brandon Li. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361895 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 03:07:49 +00:00
Eli Collins 5685eb30bb HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361777 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 19:48:15 +00:00
Eli Collins 30d0104c0e HDFS-3610. fuse_dfs: Provide a way to use the default (configured) NN URI. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361566 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 17:19:26 +00:00
Eli Collins a9629c6fe7 HDFS-3654. TestJspHelper#testGetUgi fails with NPE. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361465 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 01:10:19 +00:00
Eli Collins 2e63754888 HDFS-3539. libhdfs code cleanups. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361461 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:53:07 +00:00
Eli Collins e8cc5cb4aa HDFS-3609. libhdfs: don't force the URI to look like hdfs://hostname:port. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361455 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:36:32 +00:00
Eli Collins 03e8648d17 HDFS-3492. fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361450 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:22:55 +00:00
Eli Collins bb00c0ce20 HDFS-470. libhdfs should handle 0-length reads from FSInputStream correctly. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361447 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:04:36 +00:00
Eli Collins 849dc6da07 HDFS-3606. libhdfs: create self-contained unit test. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361442 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 23:28:23 +00:00
Harsh J 0565cb3c03 HDFS-3612. Single namenode image directory config warning can be improved. Contributed by Andy Isaacson. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361060 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 07:21:18 +00:00
Eli Collins 0d9ef3c516 HDFS-3306. fuse_dfs: don't lock release operations. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361022 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 00:46:13 +00:00
Eli Collins 1a76841335 HDFS-799. libhdfs must call DetachCurrentThread when a thread is destroyed. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361009 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 00:10:26 +00:00
Eli Collins c1c388bbb6 HDFS-3633. libhdfs: hdfsDelete should pass JNI_FALSE or JNI_TRUE. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361006 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 23:53:12 +00:00
Eli Collins dce88a6dbc HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360896 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 19:59:20 +00:00
Eli Collins 790e970931 HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360867 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 19:23:39 +00:00
Eli Collins ef21cbf70a HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360331 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 18:04:23 +00:00
Aaron Myers 786aaca2ab HDFS-3615. Two BlockTokenSecretManager findbugs warnings. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360256 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 16:10:50 +00:00
Harsh J 6ff0e1fc3a Backport of HDFS-3611 from trunk. svn merge -c 1360001 ../../trunk (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360002 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 03:37:55 +00:00
Harsh J 0b91df4d1a Backport of HDFS-3613 from trunk. svn merge -c 1359999 ../../trunk (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360000 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 03:15:54 +00:00
Harsh J 6df36b322b Backport of HDFS-3629 from trunk. svn merge -c 1359905 ../../trunk (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359906 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 21:15:21 +00:00
Aaron Myers 1ed7052a82 HDFS-3568. fuse_dfs: add support for security. Contributed by Colin McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359826 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 18:31:25 +00:00
Harsh J 1bdd4f4d38 Backport of HDFS-3555 from trunk. svn merge -c 1359619 ../../trunk. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359621 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 11:53:39 +00:00
Aaron Myers d07d0f1a51 HDFS-3067. NPE in DFSInputStream.readBuffer if read is repeated on corrupted block. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359330 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 18:32:38 +00:00
Daryn Sharp 7212c3d638 svn merge -c 1296016 FIXES: HDFS-3037. TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359242 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 16:07:10 +00:00
Eli Collins 0628876901 HDFS-2391. Newly set BalancerBandwidth value is not displayed anywhere. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358850 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 22:06:25 +00:00
Eli Collins b4c8c50456 HDFS-3548. NamenodeFsck.copyBlock fails to create a Block Reader. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358824 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 19:42:30 +00:00
Eli Collins 9f79f45b8c HDFS-711. hdfsUtime does not handle atime = 0 or mtime = 0 correctly. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358811 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 18:29:17 +00:00
Eli Collins 7dcf9b6b8f Fixup CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358807 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 18:20:22 +00:00
Eli Collins ac8b210736 HDFS-3603. Decouple TestHDFSTrash from TestTrash. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358806 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 18:19:43 +00:00
Uma Maheswara Rao G 2f7ad820e8 Merge from trunk r:1358794 HDFS-3541. Deadlock between recovery, xceiver and packet responder. Contributed by Vinay.
Submitted by:Vivay	
Reviewed by:	Uma Maheswara Rao G, Kihwal Lee, Aaron


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358798 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 17:56:41 +00:00
Harsh J 215c8add4e Backport of HDFS-2988 from trunk. svn merge -c 1358683 from trunk. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358685 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 00:40:02 +00:00
Eli Collins 31c7f73f7b HDFS-3604. Add dfs.webhdfs.enabled to hdfs-default.xml. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358660 13f79535-47bb-0310-9956-ffa450edef68
2012-07-07 22:35:39 +00:00
Todd Lipcon 5f6a138ca0 HDFS-3170. Add more useful metrics for write latency. Contributed by Matthew Jacobs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1357969 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 22:18:16 +00:00
Eli Collins d222e91bfa HDFS-3581. FSPermissionChecker#checkPermission sticky bit check missing range check. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356972 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 21:43:48 +00:00
Todd Lipcon aec6b65fcb HDFS-3574. Fix small race and do some cleanup in GetImageServlet. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356937 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 20:55:10 +00:00
Todd Lipcon e60abcb8ab HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356930 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 20:46:42 +00:00
Alejandro Abdelnur 1142e13bd4 Merge -r 1356329:1356330 from trunk to branch. FIXES: HDFS-3575
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356332 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 16:42:28 +00:00
Tsz-wo Sze 2de013e0a8 svn merge -c 1356086 from trunk for HDFS-3157. Fix a bug in the case that the generation stamps of the stored block in a namenode and the reported block from a datanode do not match.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356095 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 07:39:02 +00:00
Alejandro Abdelnur b51d32719d Merge -r 1355592:1355593 from trunk to branch. FIXES: HDFS-3580
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355595 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 22:59:09 +00:00
Todd Lipcon 535fd7de15 HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355583 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 22:23:53 +00:00
Alejandro Abdelnur 30c8f2bc9c Merge -r 1355555:1355556 from trunk to branch. FIXES: HDFS-3491
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355558 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 21:05:43 +00:00