Commit Graph

3984 Commits

Author SHA1 Message Date
Arpit Agarwal 18360e71f1 HDFS-6768. Fix a few unit tests that use hard-coded port numbers. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614732 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 18:37:41 +00:00
Chris Nauroth 535fe14ded HDFS-6570. add api that enables checking if a user has certain permissions on a file. Contributed by Jitendra Pandey.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614723 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 17:49:09 +00:00
Steve Loughran f6436c0720 HDFS-4629. Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614663 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 14:05:59 +00:00
Andrew Wang c3fa0b5884 Merge from trunk to branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614553 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 06:09:33 +00:00
Andrew Wang 09e7ff05df HDFS-6778. The extended attributes javadoc should simply refer to the user docs. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614547 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 05:57:55 +00:00
Andrew Wang 12241908ad HDFS-6665. Add tests for XAttrs in combination with viewfs. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614545 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 05:53:20 +00:00
Charles Lamb 9ca2f34c8f HDFS-6730. Create a .RAW extended attribute namespace. (clamb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614535 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 01:35:04 +00:00
Andrew Wang 415223548d HDFS-6771. Require specification of an encryption key when creating an encryption zone. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614519 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 23:39:38 +00:00
Andrew Wang 3a90228c30 HDFS-6509 addendum, extra file
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614491 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 21:11:52 +00:00
Andrew Wang 407bb3d3e4 HDFS-6509. Create a special /.reserved/raw directory for raw access to encrypted data. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614490 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 21:11:26 +00:00
Tsz-wo Sze 10d6210322 Merge r1609845 through r1614231 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1614234 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 00:49:14 +00:00
Tsz-wo Sze 4f9ffc7455 HDFS-6739. Add getDatanodeStorageReport to ClientProtocol.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614215 13f79535-47bb-0310-9956-ffa450edef68
2014-07-28 23:43:39 +00:00
Brandon Li f49c2a1b62 HDFS-6717. JIRA HDFS-5804 breaks default nfs-gateway behavior for unsecured config. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614125 13f79535-47bb-0310-9956-ffa450edef68
2014-07-28 18:53:47 +00:00
Charles Lamb 1d3e9ec935 merge from trunk r1613787
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613788 13f79535-47bb-0310-9956-ffa450edef68
2014-07-27 13:32:51 +00:00
Chris Nauroth 9bce3eca42 HDFS-6749. FSNamesystem methods should call resolvePath. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613561 13f79535-47bb-0310-9956-ffa450edef68
2014-07-26 04:18:28 +00:00
Colin McCabe e85a3fecc6 HDFS-6750. The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as stale (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613537 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 23:56:47 +00:00
Colin McCabe 57d8f829d9 HDFS-6755. There is an unnecessary sleep in the code path where DFSOutputStream#close gives up its attempt to contact the namenode (mitdesai21 via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613522 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 22:12:37 +00:00
Andrew Wang 79d214121b Fix up HDFS CHANGES.txt for 2.5.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613494 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 19:02:19 +00:00
Andrew Wang b9e4be4523 HDFS-6724. Decrypt EDEK before creating CryptoInputStream/CryptoOutputStream. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613490 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 18:33:10 +00:00
Vinayakumar B cc0464f4fe HDFS-6752. Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit (vinayakumarb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613486 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 18:17:50 +00:00
Vinayakumar B 2bb650146d HDFS-5919. FileJournalManager doesn't purge empty and corrupt inprogress edits files (vinayakumarb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613355 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 07:02:53 +00:00
Andrew Wang e670641bbf Merge from trunk to branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613334 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 23:55:15 +00:00
Andrew Wang e171254d56 Name node cannot start if the path of a file under construction contains .snapshot. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613329 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 23:42:06 +00:00
Jing Zhao 8c6e172a0a HDFS-6715. Webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613237 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 18:28:00 +00:00
Haohui Mai a7855e1c33 HDFS-6723. New NN webUI no longer displays decommissioned state for dead node. Contributed by Ming Ma.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613220 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 17:59:45 +00:00
Haohui Mai ef9b6a45c4 HDFS-6657. Remove link to 'Legacy UI' in trunk's Namenode UI. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613195 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 17:28:31 +00:00
Todd Lipcon 2054453a39 HADOOP-10882. Move DirectBufferPool into common util. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613006 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 06:22:02 +00:00
Brandon Li 2a5f1029a5 HDFS-6455. NFS: Exception should be added in NFS log for invalid separator in nfs.exports.allowed.hosts. Contributed by Abhiraj Butala
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612947 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 21:22:50 +00:00
Colin McCabe a6b1d2a85c HDFS-6114. Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.curr (vinayakumarb via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612943 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 20:59:39 +00:00
Andrew Wang 22ba00de60 Merge from trunk to branch pt 2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612941 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 20:45:10 +00:00
Andrew Wang 552b4fb9f9 Merge from trunk to branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612928 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 19:26:29 +00:00
Uma Maheswara Rao G 5343b43fd9 HDFS-6422. getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist. (Charles Lamb via umamahesh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612922 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 19:05:11 +00:00
Tsz-wo Sze 48dc486672 Merge r1609845 through r1612880 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612883 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 17:30:06 +00:00
Tsz-wo Sze ac5e8aed7c HDFS-6686. Change BlockPlacementPolicy to use fallback when some storage types are unavailable.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612880 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 17:25:06 +00:00
Charles Lamb 512b756973 HDFS-6738. Remove unnecessary getEncryptionZoneForPath call in EZManager#createEncryptionZone. (clamb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612849 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 15:23:03 +00:00
Charles Lamb 687ce1a5fc HDFS-6733. Creating encryption zone results in NPE when KeyProvider is null. (clamb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612843 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 14:51:06 +00:00
Brandon Li 853ed29f2d HDFS-6731. Run 'hdfs zkfc -formatZK' on a server in a non-namenode will cause a null pointer exception. Contributed by Masatake Iwasaki
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612715 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 22:29:04 +00:00
Brandon Li c5686addb1 HDFS-6703. NFS: Files can be deleted from a read-only mount. Contributed by Srikanth Upputuri
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612702 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 20:53:50 +00:00
Arpit Agarwal fee737eced HDFS-6712. Document HDFS Multihoming Settings. (Contributed by Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612695 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 20:28:57 +00:00
Andrew Wang 69b75fca7a HDFS-6720. Remove KeyProvider in EncryptionZoneManager. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612632 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 17:57:06 +00:00
Andrew Wang c83c5b868e HDFS-6701. Make seed optional in NetworkTopology#sortByDistance. Contributed by Ashwin Shankar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612625 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 17:47:49 +00:00
Jing Zhao 0c72ca9e7a HDFS-6704. Fix the command to launch JournalNode in HDFS-HA document. Contributed by Akira AJISAKA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612613 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 17:10:43 +00:00
Yi Liu b52b80d7bd HADOOP-10853. Refactor get instance of CryptoCodec and support create via algorithm/mode/padding. (yliu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612513 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 08:38:38 +00:00
Tsz-wo Sze ee13f8bf3e Merge r1609845 through r1612502 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612505 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 08:23:34 +00:00
Tsz-wo Sze 25b0e8471e HDFS-6702. Change DFSClient to pass the StorageType from the namenode to datanodes and change datanode to write block replicas using the specified storage type.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612493 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 07:41:24 +00:00
Andrew Wang b57ec16567 HDFS-6718. Remove EncryptionZoneManager lock. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612439 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 00:55:20 +00:00
Andrew Wang 7b466b3b70 HDFS-6716. Update usage of KeyProviderCryptoExtension APIs on NameNode. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612438 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 00:27:51 +00:00
Tsz-wo Sze 3de6c61f86 Merge r1609845 through r1612431 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612432 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 23:37:54 +00:00
Tsz-wo Sze 44d9bb26d6 HDFS-6680. BlockPlacementPolicyDefault does not choose favored nodes correctly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612427 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 23:21:12 +00:00
Andrew Wang cb20bb6117 Merge from trunk to branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612403 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 21:44:50 +00:00
Tsz-wo Sze ee3a32784f Merge r1609845 through r1612268 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612270 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 13:48:02 +00:00
Tsz-wo Sze 0a736fbc17 HDFS-6679. Bump NameNodeLayoutVersion and update editsStored test files. Contributed by vinayakumarb
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612266 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 13:38:06 +00:00
Tsz-wo Sze 014be2510f HDFS-6710. Change BlockPlacementPolicy to consider block storage policy in replica deletion.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612265 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 13:34:10 +00:00
Alejandro Abdelnur 64ed72a047 HADOOP-10817. ProxyUsers configuration should support configurable prefixes. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611780 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 19:42:01 +00:00
Tsz-wo Sze 7c18f8d55b HDFS-6616. Add exclude-datanodes feature to WebHDFS redirection so that it will not redirect retries to the same datanode. Contributed by zhaoyunjiong
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611750 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 18:20:20 +00:00
Daryn Sharp 551024915d HDFS-6599. 2.4 addBlock is 10 to 20 times slower compared to 0.23 (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611737 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:58:07 +00:00
Tsz-wo Sze 2b07af0c59 Merge r1609845 through r1611734 from tunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611736 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:57:51 +00:00
Tsz-wo Sze 08466eaa00 HDFS-6700. BlockPlacementPolicy shoud choose storage but not datanode for deletion.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611731 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:40:03 +00:00
Colin McCabe 936895722e fix eol style on TestBootstrapStandbyWithBKJM
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611726 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:23:05 +00:00
Chris Nauroth 5f9e52f745 HDFS-6597. Add a new option to NN upgrade to terminate the process after upgrade on NN is completed. Contributed by Danilo Vunjak.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611723 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:14:22 +00:00
Charles Lamb 962ef6939e HDFS-6490. Fix the keyid format for generated keys in FSNamesystem.createEncryptionZone (clamb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1611722 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:13:55 +00:00
Vinayakumar B 9f75b97a09 HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Liang Xie and Rakesh R )
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611562 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 08:48:52 +00:00
Vinayakumar B 8f0c341934 reverted
HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Rakesh R )
........


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611560 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 08:46:27 +00:00
Vinayakumar B d2024f2e76 HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Rakesh R )
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611556 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 08:32:40 +00:00
Vinayakumar B 2c5ceee6ab HDFS-6655. Add 'header banner' to 'explorer.html' also in Namenode UI ( Contributed by Vinayakumar B )
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611538 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 04:27:09 +00:00
Tsz-wo Sze 04fd2012fd Merge r1609845 through r1611528 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611531 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 02:21:21 +00:00
Jing Zhao 7ba5913797 HDFS-6667. In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611508 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 23:11:27 +00:00
Vinayakumar B ce1659f070 HDFS-6693. TestDFSAdminWithHA fails on windows ( Contributed by Vinayakumar B )
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611441 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 19:17:51 +00:00
Jing Zhao f4151bbf4f HDFS-6478. RemoteException can't be retried properly for non-HA scenario. Contributed by Ming Ma.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611410 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 17:37:22 +00:00
Tsz-wo Sze 38af6101d8 HDFS-6671. Change BlockPlacementPolicy to consider block storage policy in replicaiton.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611334 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 11:56:22 +00:00
Andrew Wang ca52cb01c4 HDFS-6690. Deduplicate xattr names in memory. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611226 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 00:44:16 +00:00
Allen Wittenauer c477a166e1 HDFS-2538. option to disable fsck dots. Contributed by Mohammad Kamrul Islam.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611220 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 23:55:32 +00:00
Andrew Wang 77f0e2cca5 HDFS-6405. Test Crypto streams in HDFS. (yliu via wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1611140 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 19:04:06 +00:00
Brandon Li e896de98f2 HDFS-6689. NFS doesn't return correct lookup access for direcories. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611135 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 18:52:03 +00:00
Chris Nauroth 43fe48d9e2 HDFS-5624. Add HDFS tests for ACLs in combination with viewfs. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611068 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 16:27:38 +00:00
Andrew Wang 56c0bd4d37 Merge from trunk to branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1610853 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 21:10:24 +00:00
Andrew Wang b066be8115 HDFS-6619. Clean up encryption-related tests. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1610849 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 20:59:40 +00:00
Brandon Li fb1f5bc618 HDFS-6456. NFS should throw error for invalid entry in dfs.nfs.exports.allowed.hosts. Contributed by Abhiraj Butala
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610840 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 20:35:07 +00:00
Colin McCabe 7fe6ab7f91 HDFS-5809. BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610790 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 18:17:13 +00:00
Chris Nauroth 97b5fbc281 HDFS-6678. MiniDFSCluster may still be partially running after initialization fails. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610549 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 22:49:08 +00:00
Brandon Li 3d9bea277a HDFS-6378. NFS registration should timeout instead of hanging when portmap/rpcbind is not available. Contributed by Abhiraj Butala
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610543 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:48:44 +00:00
Tsz-wo Sze 395c763aef Merge r1609845 through r1610532 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610533 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:23:20 +00:00
Tsz-wo Sze 4f1fae88f8 HDFS-6670. Add block storage policy support with default HOT, WARM and COLD policies.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610529 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:11:22 +00:00
Tsz-wo Sze 6f41baa623 HDFS-6677. Change INodeFile and FSImage to support storage policy ID.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610525 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 20:57:15 +00:00
Chris Nauroth 3b54223c0f HDFS-2856. Fix block protocol so that Datanodes don't require root or jsvc. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610474 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 18:10:03 +00:00
Chris Nauroth 23e61a7a25 HDFS-3851. Move attribution to release 2.6.0 section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609858 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 22:22:16 +00:00
Chris Nauroth 1c6be51e5e HADOOP-8158. Move attribution to release 2.6.0 section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609854 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 22:09:33 +00:00
Chris Nauroth c9676bb07c HDFS-2976. Move attribution to release 2.6.0 section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609849 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 21:58:16 +00:00
Andrew Wang d79f27b429 HDFS-6474. Namenode needs to get the actual keys and iv from the KeyProvider. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1609833 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 20:54:47 +00:00
Vinayakumar B 952b0fb18c HDFS-6630. Unable to fetch the block information by Browsing the file system on Namenode UI through IE9 ( Contributed by Haohui Mai)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609629 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 05:15:18 +00:00
Chris Nauroth 81930b75bd HDFS-5202. Support Centralized Cache Management on Windows. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609618 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 03:06:11 +00:00
Jing Zhao b90dfe0b49 HDFS-6640. Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly in WebHdfs document (missed webhdfs/v1). Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609603 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 01:28:47 +00:00
Kihwal Lee 8f520386fb HDFS-6647. Edit log corruption when pipeline recovery occurs for deleted file present in snapshot. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609543 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 18:18:22 +00:00
Chris Nauroth cce02e3bef HDFS-6631. TestPread#testHedgedReadLoopTooManyTimes fails intermittently. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609534 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 18:03:32 +00:00
Yi Liu d90671137e HADOOP-10803. Update OpensslCipher#getInstance to accept CipherSuite#name format. (yliu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1609403 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 06:27:52 +00:00
Tsz-wo Sze e67b80ec3a HDFS-6643. Refactor INodeWithAdditionalFields.PermissionStatusFormat and INodeFile.HeaderFormat.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609401 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 06:16:34 +00:00
Jing Zhao 36492f084b HDFS-6645. Add test for successive Snapshots between XAttr modifications. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609388 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 05:01:41 +00:00
Colin McCabe d9c5f20333 HDFS-6622. Rename and AddBlock may race and produce invalid edits (kihwal via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609384 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 04:03:02 +00:00
Colin McCabe 8044a12ac0 HDFS-6618. FSNamesystem#delete drops the FSN lock between removing INodes from the tree and deleting them from the inode map (kihwal via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609380 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 03:49:30 +00:00
Vinayakumar B 3b0db60113 HDFS-6646. [ HDFS Rolling Upgrade - Shell ] shutdownDatanode and getDatanodeInfo usage is missed ( Contributed by Brahma Reddy Battula)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609020 13f79535-47bb-0310-9956-ffa450edef68
2014-07-09 06:05:44 +00:00
Chris Nauroth 709d5cbd71 HDFS-6627. Rename DataNode#checkWriteAccess to checkReadAccess. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608940 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 20:29:42 +00:00
Chris Nauroth f62e93d591 HDFS-6638. Shorten test run time with a smaller retry timeout setting. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608905 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 19:16:48 +00:00
Chris Nauroth 3470dd9a2f HDFS-6614. Addendum patch to shorten TestPread run time with smaller retry timeout setting. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608846 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 16:43:16 +00:00
Uma Maheswara Rao G cddd6184ad HDFS-5411. Update Bookkeeper dependency to 4.2.3. Contributed by Rakesh R.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608781 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:50:49 +00:00
Uma Maheswara Rao G 986c09f68e HDFS-4221. Remove the format limitation point from BKJM documentation as HDFS-3810 closed. Contributed by Rakesh R.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608776 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:31:37 +00:00
Uma Maheswara Rao G e6446b708d HDFS-4286. Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM. Contributed by Rakesh R.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608764 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:17:54 +00:00
Andrew Wang 7aa07912dc Move something down in CHANGES-fs-encryption.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608658 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 04:34:52 +00:00
Andrew Wang ceed0f6c46 HDFS-6635. Refactor encryption zone functionality into new EncryptionZoneManager class. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608657 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 04:34:04 +00:00
Haohui Mai 76a621ffd2 HDFS-6609. Use DirectorySnapshottableFeature to represent a snapshottable directory. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608631 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 00:08:18 +00:00
Andrew Wang dda85637df Merge trunk to branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608603 13f79535-47bb-0310-9956-ffa450edef68
2014-07-07 20:43:56 +00:00
Chris Nauroth 93c1bc8114 HDFS-6617. Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608522 13f79535-47bb-0310-9956-ffa450edef68
2014-07-07 17:37:04 +00:00
Charles Lamb 83702b0707 HDFS-6629. Not able to create symlinks after HDFS-6516 (umamaheswararao)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608389 13f79535-47bb-0310-9956-ffa450edef68
2014-07-07 09:51:49 +00:00
Charles Lamb c386652828 HDFS-6516. List of Encryption Zones should be based on inodes (clamb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607770 13f79535-47bb-0310-9956-ffa450edef68
2014-07-04 00:24:28 +00:00
Colin McCabe bfef9807a0 HADOOP-10693. Implementation of AES-CTR CryptoCodec using JNI to OpenSSL (hitliuyi via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607768 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 23:40:31 +00:00
Andrew Wang 151c5deaf1 HDFS-6511. BlockManager#computeInvalidateWork() could do nothing. Contributed by Juan Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607735 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 20:10:54 +00:00
Andrew Wang f881f0e923 HDFS-6493. Change dfs.namenode.startup.delay.block.deletion to second instead of millisecond. Contributed by Juan Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607732 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 20:02:14 +00:00
Andrew Wang 93e23a9915 HDFS-6613. Improve logging in caching classes. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607697 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 17:13:59 +00:00
Uma Maheswara Rao G 160c912ee6 HDFS-6620. Snapshot docs should specify about preserve options with cp command. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607685 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 16:08:44 +00:00
Steve Loughran b6fbaba8e9 HADOOP-9361: Strictly define FileSystem APIs - HDFS portion
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607597 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 12:09:45 +00:00
Karthik Kambatla 54dc17ce2f Preparing for release 2.6.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607538 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 05:55:05 +00:00
Charles Lamb 2a3bccddd9 HDFS-6625. Remove the Delete Encryption Zone function (clamb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607507 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 00:58:45 +00:00
Andrew Wang 51b97a1396 HDFS-6605.Client server negotiation of cipher suite. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607499 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 23:08:29 +00:00
Andrew Wang 9b5d551ad9 HDFS-6610. TestShortCircuitLocalRead tests sometimes timeout on slow machines. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607496 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 23:02:24 +00:00
Colin McCabe 297e3c72fb HDFS-6604. The short-circuit cache doesn't correctly time out replicas that haven't been used in a while (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607456 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 19:43:36 +00:00
Chris Nauroth 130182df1b HDFS-6614. shorten TestPread run time with a smaller retry timeout setting. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607447 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 18:57:25 +00:00
Andrew Wang 9dfe9cf400 HDFS-6612. MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID. Contributed by Juan Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607442 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 18:37:00 +00:00
Chris Nauroth c89bf0184d HDFS-6603. Add XAttr with ACL test. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607239 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 03:20:25 +00:00
Chris Nauroth 0ca41a8f35 HDFS-6591. while loop is executed tens of thousands of times in Hedged Read. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606927 13f79535-47bb-0310-9956-ffa450edef68
2014-06-30 20:46:44 +00:00
Kihwal Lee e8186a9dee HDFS-6558. Missing newline in the description of dfsadmin -rollingUpgrade. Contributed by Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606855 13f79535-47bb-0310-9956-ffa450edef68
2014-06-30 18:17:56 +00:00
Steve Loughran 2f75cd1190 HDFS-6418. Regression: DFS_NAMENODE_USER_NAME_KEY missing
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606536 13f79535-47bb-0310-9956-ffa450edef68
2014-06-29 16:27:24 +00:00
Kihwal Lee 94a1462bd5 HDFS-6601. Issues in finalizing rolling upgrade when there is a layout version change. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606371 13f79535-47bb-0310-9956-ffa450edef68
2014-06-28 15:21:46 +00:00
Uma Maheswara Rao G 78cafe34e6 HDFS-6556. Refine XAttr permissions. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606320 13f79535-47bb-0310-9956-ffa450edef68
2014-06-28 11:40:02 +00:00
Charles Lamb 31617733ac HDFS-6389. Rename restrictions for encryption zones. (clamb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1606253 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 21:45:18 +00:00
Andrew Wang 2efea95213 HDFS-6391. Get the Key/IV from the NameNode for encrypted files in DFSClient. Contributed by Charles Lamb and Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1606220 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 20:43:41 +00:00
Aaron Myers 5f880f79d2 HADOOP-10701. NFS should not validate the access premission only based on the user's primary group. Contributed by Harsh J.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606042 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 12:00:55 +00:00
Chris Nauroth 280bdb9a16 HDFS-6572. Add an option to the NameNode that prints the software and on-disk image versions. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605928 13f79535-47bb-0310-9956-ffa450edef68
2014-06-26 23:12:45 +00:00
Chris Nauroth c3e26735a6 HADOOP-9705. FsShell cp -p does not preserve directory attibutes. Contributed by Akira AJISAKA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605672 13f79535-47bb-0310-9956-ffa450edef68
2014-06-26 05:36:54 +00:00
Tsz-wo Sze e3612e4428 HDFS-6595. Allow the maximum threads for balancing on datanodes to be configurable. Contributed by Benoy Antony
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605565 13f79535-47bb-0310-9956-ffa450edef68
2014-06-25 19:27:29 +00:00
Charles Lamb 2676365799 HDFS-6387. HDFS CLI admin tool for creating & deleting an encryption zone. (clamb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1605518 13f79535-47bb-0310-9956-ffa450edef68
2014-06-25 17:42:03 +00:00
Tsz-wo Sze 988bc17bc3 HADOOP-10674. Improve PureJavaCrc32 performance and use java.util.zip.CRC32 for Java 7 and above.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605239 13f79535-47bb-0310-9956-ffa450edef68
2014-06-25 02:22:15 +00:00
Aaron Myers 55a1defa50 HDFS-6475. WebHdfs clients fail without retry because incorrect handling of StandbyException. Contributed by Yongjun Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605217 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 23:07:49 +00:00
Haohui Mai a92318c2ef HDFS-6587. Fix a typo in message issued from explorer.js. Contributed by Yongjun Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605184 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 20:48:32 +00:00
Haohui Mai bdf3de9f6b HDFS-6593. Move SnapshotDiffInfo out of INodeDirectorySnapshottable. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605169 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 19:59:34 +00:00
Haohui Mai fdbff67856 HADOOP-10717. HttpServer2 should load jsp DTD from local jars instead of going remote. Contributed by Dapeng Sun.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605146 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 17:51:21 +00:00
Alejandro Abdelnur 46162a213f HDFS-6430. HTTPFS - Implement XAttr support. (Yi Liu via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605118 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 15:59:50 +00:00
Uma Maheswara Rao G ff41321e2f HDFS-6486. Add user doc for XAttrs via WebHDFS. Contributed by Yi Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605062 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 12:13:43 +00:00
Haohui Mai 08986fdbed HDFS-6562. Refactor rename() in FSDirectory. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605016 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 06:56:27 +00:00
Arpit Agarwal 5ac06c8b38 HDFS-6578. add toString method to DatanodeStorage for easier debugging. (Contributed by Yongjun Zhang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604942 13f79535-47bb-0310-9956-ffa450edef68
2014-06-23 21:30:02 +00:00
Arpit Agarwal 9ddedbf3df HDFS-6587. Bug in TestBPOfferService can cause test failure. (Contributed by Zhilei Xu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604899 13f79535-47bb-0310-9956-ffa450edef68
2014-06-23 18:21:00 +00:00
Haohui Mai a90a8b26e9 HDFS-6580. FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper. Contributed bu Zhilei Xu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604704 13f79535-47bb-0310-9956-ffa450edef68
2014-06-23 07:20:49 +00:00
Vinayakumar B e8ca648005 HDFS-6507. Improve DFSAdmin to support HA cluster better. (Contributd by Zesheng Wu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604692 13f79535-47bb-0310-9956-ffa450edef68
2014-06-23 05:16:05 +00:00
Haohui Mai 1e89eba47d HDFS-6583. Remove clientNode in FileUnderConstructionFeature. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604541 13f79535-47bb-0310-9956-ffa450edef68
2014-06-22 07:39:36 +00:00
Jing Zhao 8a83bb7ad6 HDFS-4667. Capture renamed files/directories in snapshot diff report. Contributed by Jing Zhao and Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604488 13f79535-47bb-0310-9956-ffa450edef68
2014-06-21 22:59:34 +00:00
Chris Nauroth 0c51289695 HDFS-6222. Remove background token renewer from webhdfs. Contributed by Rushabh Shah and Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604300 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 23:58:23 +00:00
Haohui Mai 9ca79e8d32 HDFS-6557. Move the reference of fsimage to FSNamesystem. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604242 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 18:54:19 +00:00
Jing Zhao d9eb18bb2e HDFS-6535. HDFS quota update is wrong when file is appended. Contributed by George Wong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604226 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 18:25:09 +00:00
Aaron Myers af6c91a80c HDFS-6403. Add metrics for log warnings reported by JVM pauses. Contributed by Yongjun Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604074 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 02:38:00 +00:00
Alejandro Abdelnur 46dc32e125 HDFS-6312. WebHdfs HA failover is broken on secure clusters. (daryn via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604045 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 23:06:40 +00:00
Aaron Myers 9ff3836a36 HDFS-6549. Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604022 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 19:39:29 +00:00
Kihwal Lee 0da148dae7 HDFS-3848. A Bug in recoverLeaseInternal method of FSNameSystem class. Contributed by Hooman Peiro Sajjad and Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604011 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 19:05:25 +00:00
Andrew Wang 97583dbb0a Merge from trunk to branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1603993 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 18:32:13 +00:00
Andrew Wang a3908b89f7 Move HDFS-6375 down to 2.5 section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603974 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 17:42:04 +00:00
Andrew Wang d417e49ce4 HDFS-6492. Support create-time xattrs and atomically setting multiple xattrs. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603971 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 17:37:31 +00:00
Aaron Myers 3f82484218 HDFS-6563. NameNode cannot save fsimage in certain circumstances when snapshots are in use. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603712 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 05:17:58 +00:00
Haohui Mai a4e0ff5e05 HDFS-6480. Move waitForReady() from FSDirectory to FSNamesystem. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603705 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 04:13:56 +00:00
Brandon Li eb93f73ea8 HDFS-6553. Add missing DeprecationDeltas for NFS Kerberos configurations. Contributed by Stephen Chu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603677 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 23:51:49 +00:00
Andrew Wang 5e5e1a6202 Merge trunk r1603663 to branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1603664 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 23:15:04 +00:00
Charles Lamb 6ef3a9e746 HDFS-6386. HDFS Encryption Zones (clamb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1603658 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 22:33:50 +00:00
Arpit Agarwal 21ffcc348e HDFS-6559. Fix wrong option "dfsadmin -rollingUpgrade start" in the document. (Contributed by Akira Ajisaka)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603638 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 21:29:39 +00:00
Brandon Li 2ecab65e3e HDFS-6439. NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603622 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 20:45:53 +00:00
Haohui Mai 22cbcd16cb HADOOP-10717. Revert r1603571.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603620 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 20:37:25 +00:00
Jing Zhao 4cf94aaf80 HDFS-6551. Rename with OVERWRITE option may throw NPE when the target file/directory is a reference INode. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603612 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 19:57:00 +00:00
Arpit Agarwal 52d18aa217 HDFS-6552. add DN storage to a BlockInfo will not replace the different storage from same DN. (Contributed by Amir Langer)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603602 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 19:37:18 +00:00
Tsz-wo Sze 1af69553a1 HDFS-6530. Fix Balancer documentation.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603571 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 18:44:28 +00:00
Steve Loughran bae5837d3b HADOOP-10717. Missing JSP support in Jetty
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603534 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 17:08:45 +00:00
Jing Zhao 8e8a769e7f HDFS-6527. Edit log corruption due to defered INode removal. Contributed by Kihwal Lee and Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603340 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 01:00:32 +00:00
Kihwal Lee 2298f3d241 HDFS-6545. Finalizing rolling upgrade can make NN unavailable for a long duration. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603239 13f79535-47bb-0310-9956-ffa450edef68
2014-06-17 17:58:38 +00:00
Chris Nauroth 6e37dd331b HADOOP-10557. FsShell -cp -pa option for preserving extended ACLs. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603222 13f79535-47bb-0310-9956-ffa450edef68
2014-06-17 17:08:07 +00:00
Andrew Wang f4b1c44415 HDFS-6528. Add XAttrs to TestOfflineImageViewer. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603020 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 23:07:31 +00:00
Andrew Wang 45c52ef924 HDFS-6518. TestCacheDirectives#testExceedsCapacity should take FSN read lock when accessing pendingCached list. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603016 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 22:47:58 +00:00
Colin McCabe b98da7f3b5 HDFS-6539. test_native_mini_dfs is skipped in hadoop-hdfs pom.xml (decstery via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602998 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 20:35:45 +00:00
Charles Lamb c5b7236d9c merge from trunk r1602933
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1602947 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 18:13:57 +00:00
Arun Murthy 26936978be Preparing to release hadoop-2.4.1.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602886 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 15:07:00 +00:00
Uma Maheswara Rao G 2ad014a097 Moved CHANGES.txt entries of MAPREDUCE-5898, MAPREDUCE-5920, HDFS-6464, HDFS-6375 from trunk to 2.5 section on merging HDFS-2006 to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602699 13f79535-47bb-0310-9956-ffa450edef68
2014-06-15 14:54:36 +00:00
Aaron Myers d18af7edd4 HDFS-6499. Use NativeIO#renameTo instead of File#renameTo in FileJournalManager. Contributed by Yongjun Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602542 13f79535-47bb-0310-9956-ffa450edef68
2014-06-14 02:14:46 +00:00
Aaron Myers 3f5e04946d HDFS-6529. Trace logging for RemoteBlockReader2 to identify remote datanode and file being read. Contributed by Anubhav Dhoot.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602538 13f79535-47bb-0310-9956-ffa450edef68
2014-06-14 00:57:52 +00:00
Andrew Wang 70db2ec417 HDFS-6470. TestBPOfferService.testBPInitErrorHandling is flaky. Contributed by Ming Ma.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602490 13f79535-47bb-0310-9956-ffa450edef68
2014-06-13 19:00:03 +00:00
Haohui Mai 02f3ff3387 HDFS-6330. Move mkdirs() to FSNamesystem. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602484 13f79535-47bb-0310-9956-ffa450edef68
2014-06-13 18:04:45 +00:00
Andrew Wang be3fdd1c40 HADOOP-10691. Improve the readability of 'hadoop fs -help'. Contributed by Lei Xu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602329 13f79535-47bb-0310-9956-ffa450edef68
2014-06-13 06:39:57 +00:00
Andrew Wang 6aef8fec70 Fixup CHANGES.txt message for HDFS-3493
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602292 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 21:16:36 +00:00
Andrew Wang be01103af7 HDFS-3493. Invalidate corrupted blocks as long as minimum replication is satisfied. Contributed by Juan Yu and Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602291 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 21:06:31 +00:00
Andrew Wang befa4bb1ed HDFS-6395. Skip checking xattr limits for non-user-visible namespaces. Contributed by Yi Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602288 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 20:55:06 +00:00
Chris Nauroth 2368332138 HADOOP-10561. Copy command with preserve option should handle Xattrs. Contributed by Yi Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602225 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 16:34:02 +00:00
Konstantin Boudnik 2f4f261cda HDFS-6471. Make moveFromLocal CLI testcases to be non-disruptive (Contributed by Dasha Boudnik)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602064 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 05:48:26 +00:00
Arpit Agarwal 34e9173c00 HADOOP-10376. Refactor refresh*Protocols into a single generic refreshConfigProtocol. (Contributed by Chris Li)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602055 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 01:27:39 +00:00
Alejandro Abdelnur 8bfbec8cfb HDFS-6379. HTTPFS - Implement ACLs support. (yoderme via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602040 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 22:35:18 +00:00
Uma Maheswara Rao G 22ec67ea6f Moved the HDFS-2006 break down tasks list to 2.5 section in merging HDFS-2006 to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602003 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 19:51:36 +00:00
Haohui Mai e98529858e HDFS-6315. Decouple recording edit logs from FSDirectory. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601960 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 17:22:44 +00:00
Haohui Mai 49fecbd402 HDFS-6503. Fix typo of DFSAdmin restoreFailedStorage. Contributed by Zesheng Wu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601958 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 17:12:46 +00:00
Arpit Agarwal c802ca28fd HDFS-6364. Incorrect check for unknown datanode in Balancer. (Contributed by Benoy Antony)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601771 13f79535-47bb-0310-9956-ffa450edef68
2014-06-10 21:02:47 +00:00
Andrew Wang 123c563fe6 HDFS-6460. Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance. Contributed by Yongjun Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601535 13f79535-47bb-0310-9956-ffa450edef68
2014-06-10 00:39:20 +00:00
Andrew Wang a72f850e33 HDFS-6399. Add note about setfacl in HDFS permissions guide. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601476 13f79535-47bb-0310-9956-ffa450edef68
2014-06-09 18:42:17 +00:00
Colin McCabe 8b2b7ff0ae HDFS-6257. TestCacheDirectives#testExceedsCapacity fails occasionally (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601473 13f79535-47bb-0310-9956-ffa450edef68
2014-06-09 18:39:37 +00:00
Junping Du cc9bc8eef7 HDFS-6500. Snapshot shouldn't be removed silently after renaming to an existing snapshot. (Contributed by Nicholas SZE)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601199 13f79535-47bb-0310-9956-ffa450edef68
2014-06-08 07:06:35 +00:00
Konstantin Boudnik fb7ea6d8bc HDFS-6297. Add CLI testcases to reflect new features of dfs and dfsadmin (Contributed by Dasha Boudnik)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601059 13f79535-47bb-0310-9956-ffa450edef68
2014-06-07 05:22:34 +00:00
Colin McCabe 9528ed939d HDFS-6497. Make TestAvailableSpaceVolumeChoosingPolicy deterministic (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601035 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 23:40:39 +00:00
Andrew Wang 14394eed00 HDFS-6487. TestStandbyCheckpoint#testSBNCheckpoints is racy. Contributed by Mit Desai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601016 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 21:36:56 +00:00
Uma Maheswara Rao G 6a4f6d6b3e HDFS-6464. Support multiple xattr.name parameters for WebHDFS getXAttrs. Contributed by Yi Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600810 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 03:48:43 +00:00
Charles Lamb a93a37a8cd Various fixes to CHANGES-fs-encryption.txt. Various Jiras ended up in the hadoop-common CHANGES-fs-encryption.txt by accident. Moved them to HDFS CHANGES-fs-encryption.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600804 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 01:49:53 +00:00
Charles Lamb 3f892e9d53 HDFS-6473. Protocol and API for Encryption Zones (clamb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600803 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 01:42:18 +00:00
Colin McCabe e40524d759 HDFS-6369. Document that BlockReader#available() can return more bytes than are remaining in the block (Ted Yu via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600801 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 00:59:18 +00:00
Andrew Wang 1cbff8ff82 HDFS-6476. Print out the KeyProvider after finding KP successfully on startup. Contributed by Juan Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600799 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 00:55:14 +00:00
Charles Lamb bdee397e95 HADOOP-6392. Wire crypto streams for encrypted files in DFSClient. (clamb and yliu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600582 13f79535-47bb-0310-9956-ffa450edef68
2014-06-05 10:10:48 +00:00
Andrew Wang 02fcb6b6ba HDFS-6268. Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599734 13f79535-47bb-0310-9956-ffa450edef68
2014-06-03 18:33:09 +00:00
Jing Zhao a29d2d3371 HDFS-6424. blockReport doesn't need to invalidate blocks on SBN. Contributed by Ming Ma.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599397 13f79535-47bb-0310-9956-ffa450edef68
2014-06-03 00:47:11 +00:00
Michael Stack f15ff5e4f4 HDFS-6109 let sync_file_range() system call run in background (Liang Xie via stack)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599347 13f79535-47bb-0310-9956-ffa450edef68
2014-06-02 20:27:15 +00:00
Kihwal Lee 77805fb69b Fix merge error.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598873 13f79535-47bb-0310-9956-ffa450edef68
2014-05-31 14:32:21 +00:00
Andrew Wang 880a0c673c HDFS-6375. Listing extended attributes with the search permission. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598788 13f79535-47bb-0310-9956-ffa450edef68
2014-05-31 00:12:02 +00:00
Andrew Wang da5df3af0a Move HDFS-6110 down to 2.5.0 section of CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598787 13f79535-47bb-0310-9956-ffa450edef68
2014-05-31 00:07:46 +00:00
Charles Lamb 871616b993 merge from trunk r1598783
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1598785 13f79535-47bb-0310-9956-ffa450edef68
2014-05-31 00:01:20 +00:00
Charles Lamb 4054a40891 HDFS-6388. HDFS integration with KeyProvider. (clamb)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1598783 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 23:53:45 +00:00
Brandon Li 42391d260d HDFS-6056. Clean up NFS config settings. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598782 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 23:53:00 +00:00
Andrew Wang f7f651fc56 HDFS-6472. fix typo in webapps/hdfs/explorer.js. Contributed by Juan Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598746 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 20:43:58 +00:00
Alejandro Abdelnur e4c06854b4 HDFS-6404. HttpFS should use a 000 umask for mkdir and create operations. (yoderme via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598668 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 16:49:11 +00:00
Chris Nauroth 39f3d135d0 HDFS-6463. Clarify behavior of AclStorage#createFsPermissionForExtendedAcl in comments. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598437 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 22:56:58 +00:00
Charles Lamb 333562b767 merge from trunk r1598430
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1598435 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 22:27:25 +00:00
Andrew Wang f40a36758b HDFS-6447. balancer should timestamp the completion message. Contributed by Juan Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598411 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 21:38:39 +00:00
Andrew Wang 5dff070e51 HDFS-6356. Fix typo in DatanodeLayoutVersion. Contributed by Tulasi G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598408 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 21:32:44 +00:00
Brandon Li c55947343e HDFS-6462. NFS: fsstat request fails with the secure hdfs. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598405 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 21:16:04 +00:00
Andrew Wang 1d5e564998 HDFS-6461. Use Time#monotonicNow to compute duration in DataNode#shutDown. Contributed by James Thomas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598399 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 21:01:55 +00:00
Arpit Agarwal 4a4868e523 HADOOP-10448. Support pluggable mechanism to specify proxy user settings (Contributed by Benoy Antony)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598396 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 20:52:01 +00:00
Chris Nauroth 806f4d11f2 HADOOP-10602. Documentation has broken "Go Back" hyperlinks. Contributed by Akira AJISAKA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598337 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 17:26:50 +00:00
Andrew Wang 66c5bcfc6d HDFS-6453. Use Time#monotonicNow to avoid system clock reset. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598144 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 21:24:49 +00:00
Colin McCabe cfd8647d0f HDFS-6448. BlockReaderLocalLegacy should set socket timeout based on conf.socketTimeout (liangxie via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598079 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 17:44:14 +00:00
Arpit Agarwal e976652a6e HDFS-6442. Fix TestEditLogAutoroll and TestStandbyCheckpoints failure caused by port conficts. (Contributed by Zesheng Wu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598078 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 17:38:25 +00:00
Brandon Li 0ec6fc9e3c HDFS-6411. nfs-hdfs-gateway mount raises I/O error and hangs when a unauthorized user attempts to access it. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597895 13f79535-47bb-0310-9956-ffa450edef68
2014-05-27 22:58:55 +00:00
Brandon Li 1c867b1de8 HDFS-6416. Use Time#monotonicNow in OpenFileCtx and OpenFileCtxCatch to avoid system clock bugs. Contributed by Abhiraj Butala
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597868 13f79535-47bb-0310-9956-ffa450edef68
2014-05-27 20:21:33 +00:00
Jing Zhao 8d9e8cec9f HDFS-6227. ShortCircuitCache#unref should purge ShortCircuitReplicas whose streams have been closed by java interrupts. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597829 13f79535-47bb-0310-9956-ffa450edef68
2014-05-27 17:21:41 +00:00
Michael Stack 1228f8f6fb HBASE-6110 adding more slow action log in critical write path (Liang Xie via stack)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597633 13f79535-47bb-0310-9956-ffa450edef68
2014-05-26 19:38:05 +00:00
Arpit Agarwal 978e3a6813 HDFS-6443. Fix MiniQJMHACluster related test failures. (Contributed by Zesheng Wu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597238 13f79535-47bb-0310-9956-ffa450edef68
2014-05-24 05:09:04 +00:00
Andrew Wang 1ba203e3e0 HDFS-6435. Add support for specifying a static uid/gid mapping for the NFS gateway. (atm via wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596966 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 20:44:30 +00:00
Jing Zhao 3671a5e16f MAPREDUCE-5899. Support incremental data copy in DistCp. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596931 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 18:17:11 +00:00
Uma Maheswara Rao G 57d3daa7c9 Merge from trunk to fs-encryption branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1596873 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 13:54:53 +00:00
Jing Zhao 5b1e88b6d2 HDFS-6423. Diskspace quota usage should be updated when appending data to partial block. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596774 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 08:07:16 +00:00
Jing Zhao 752a9d84bb HDFS-6438. DeleteSnapshot should be a DELETE request in WebHdfs. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596772 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 07:30:18 +00:00
Chris Nauroth 6b2e615f5f HDFS-6433. Replace BytesMoved class with AtomicLong. Contributed by Benoy Antony.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596742 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 04:50:53 +00:00
Chris Nauroth b2f4e53e2b HDFS-6409. Fix typo in log message about NameNode layout version upgrade. Contributed by Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596739 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 04:38:20 +00:00
Andrew Wang 4dfedd81a4 HDFS-6396. Remove support for ACL feature from INodeSymlink. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596713 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 00:10:30 +00:00
Uma Maheswara Rao G ac23a55547 Merge HDFS-2006 HDFS XAttrs branch to Trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596575 13f79535-47bb-0310-9956-ffa450edef68
2014-05-21 13:57:33 +00:00
Kihwal Lee cb5682b859 HDFS-6419. TestBookKeeperHACheckpoints.TestSBNCheckpoints fails on trunk. Contributed by Akira AJISAKA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596344 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 18:13:01 +00:00
Jing Zhao 44e9d346e9 HDFS-6432. Add snapshot related APIs to webhdfs. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596334 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 17:33:31 +00:00
Colin McCabe 668f70db66 HDFS-6421. Fix vecsum.c compile on BSD and some other systems (Mit Desai via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596324 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 17:19:39 +00:00
Kihwal Lee 35058fc020 HDFS-6397. NN shows inconsistent value in deadnode count. Contributed by Mohammad Kamrul Islam.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595978 13f79535-47bb-0310-9956-ffa450edef68
2014-05-19 17:52:55 +00:00
Konstantin Boudnik 9a0ed1c4af HDFS-6325. Append should fail if the last block has insufficient number of replicas (Keith Pak via cos)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595744 13f79535-47bb-0310-9956-ffa450edef68
2014-05-19 05:24:24 +00:00
Colin McCabe f25c33b65f HDFS-4913. Deleting file through fuse-dfs when using trash fails, requiring root permissions (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595371 13f79535-47bb-0310-9956-ffa450edef68
2014-05-16 22:24:33 +00:00
Aaron Myers da3992b4e3 HDFS-6406. Add capability for NFS gateway to reject connections from unprivileged ports. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595351 13f79535-47bb-0310-9956-ffa450edef68
2014-05-16 21:23:03 +00:00
Andrew Wang 8384d57290 Add CHANGES-fs-encryption.txt to Common and HDFS
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1595304 13f79535-47bb-0310-9956-ffa450edef68
2014-05-16 18:53:08 +00:00
Chris Nauroth 11be7334c4 MAPREDUCE-5809. Enhance distcp to support preserving HDFS ACLs. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595283 13f79535-47bb-0310-9956-ffa450edef68
2014-05-16 18:25:23 +00:00
Junping Du 0fb47dbe4e HDFS-6250. Fix test failed in TestBalancerWithNodeGroup.testBalancerWithRackLocality (Contributed by Binglin Chang and Chen He)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595145 13f79535-47bb-0310-9956-ffa450edef68
2014-05-16 09:56:24 +00:00
Andrew Wang 8f48760663 HDFS-6345. DFS.listCacheDirectives() should allow filtering based on cache directive ID. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595086 13f79535-47bb-0310-9956-ffa450edef68
2014-05-16 01:18:03 +00:00
Chris Nauroth 68867fd1bc HDFS-6402. Suppress findbugs warning for failure to override equals and hashCode in FsAclPermission. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595070 13f79535-47bb-0310-9956-ffa450edef68
2014-05-15 23:12:12 +00:00
Arpit Agarwal 9a0fcae5bc HDFS-6362. InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595056 13f79535-47bb-0310-9956-ffa450edef68
2014-05-15 21:30:16 +00:00
Andrew Wang 1959afe113 HDFS-5683. Better audit log messages for caching operations. Contributed by Abhiraj Butala.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595054 13f79535-47bb-0310-9956-ffa450edef68
2014-05-15 21:29:19 +00:00
Brandon Li 1c0e7a318e HDFS-6361. TestIdUserGroup.testUserUpdateSetting failed due to out of range nfsnobody Id. Contributed by Yongjun Zhang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595050 13f79535-47bb-0310-9956-ffa450edef68
2014-05-15 21:23:38 +00:00
Kihwal Lee 046ad2e40e HDFS-6400. Cannot execute hdfs oiv_legacy. Contributed by Akira AJISAKA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594917 13f79535-47bb-0310-9956-ffa450edef68
2014-05-15 13:53:19 +00:00
Colin McCabe f2933f2535 HDFS-6287. Add vecsum test of libhdfs read access times (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594751 13f79535-47bb-0310-9956-ffa450edef68
2014-05-15 00:29:41 +00:00
Chris Nauroth 65158e478f HDFS-6326. WebHdfs ACL compatibility is broken. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594743 13f79535-47bb-0310-9956-ffa450edef68
2014-05-14 22:35:56 +00:00
Kihwal Lee 88e76f9c45 HDFS-2949. Add check to active state transition to prevent operator-induced split brain. Contributed by Rushabh S Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594709 13f79535-47bb-0310-9956-ffa450edef68
2014-05-14 20:45:07 +00:00
Jing Zhao cf7dddb603 HDFS-6381. Fix a typo in INodeReference.java. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594447 13f79535-47bb-0310-9956-ffa450edef68
2014-05-14 02:50:56 +00:00
Kihwal Lee 97f58955a6 HDFS-6293. Issues with OIV processing PB-based fsimages. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594439 13f79535-47bb-0310-9956-ffa450edef68
2014-05-14 01:15:16 +00:00
Chris Nauroth 4b54bd8320 HDFS-6370. Web UI fails to display in intranet under IE. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594362 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 20:09:38 +00:00
Colin McCabe dac9028ef9 HDFS-6355. Fix divide-by-zero, improper use of wall-clock time in BlockPoolSliceScanner (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594338 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 19:24:22 +00:00
Jing Zhao 8e5b5165c1 HDFS-6186. Pause deletion of blocks when the namenode starts up. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594314 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 18:22:33 +00:00
Brandon Li 29c5ed30c3 HADOOP-10572. Example NFS mount command must pass noacl as it isn't supported by the server yet. Contributed by Harsh J.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594289 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 17:07:46 +00:00
Suresh Srinivas 0077999972 HADOOP-10566. Refactor proxyservers out of ProxyUsers. Contributed by Benoy Antony.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594280 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 16:53:38 +00:00
Jonathan Turner Eagles e4ee1d111b HDFS-6305. WebHdfs response decoding may throw RuntimeExceptions (Daryn Sharp via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594273 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 16:40:15 +00:00
Kihwal Lee 33ade356b3 HDFS-6334. Client failover proxy provider for IP failover based NN HA. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594263 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 16:19:07 +00:00
Uma Maheswara Rao G 4f399bb4ba HDFS-6367. EnumSetParam$Domain#parse fails for parameter containing more than one enum. Contributed by Yi Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594150 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 07:34:32 +00:00
Kihwal Lee e9459baec5 HDFS-5522. Datanode disk error check may be incorrectly skipped. Contributed by Rushabh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594055 13f79535-47bb-0310-9956-ffa450edef68
2014-05-12 19:08:06 +00:00
Haohui Mai 09002d9341 HDFS-6230. Expose upgrade status through NameNode web UI. Contributed by Mit Desai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594040 13f79535-47bb-0310-9956-ffa450edef68
2014-05-12 18:02:24 +00:00
Andrew Wang e9c6840b24 Command hdfs dfs -rm -r can't remove empty directory. Contributed by Yongjun Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594036 13f79535-47bb-0310-9956-ffa450edef68
2014-05-12 17:54:35 +00:00
Haohui Mai ae9109b911 HDFS-6328. Clean up dead code in FSDirectory. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593755 13f79535-47bb-0310-9956-ffa450edef68
2014-05-11 05:06:22 +00:00
Colin McCabe f131dba8a3 HDFS-6294. Use INode IDs to avoid conflicts when a file open for write is renamed (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593634 13f79535-47bb-0310-9956-ffa450edef68
2014-05-09 22:36:04 +00:00
Haohui Mai ed6f32c540 HDFS-6240. WebImageViewer returns 404 if LISTSTATUS to an empty directory. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593591 13f79535-47bb-0310-9956-ffa450edef68
2014-05-09 18:43:46 +00:00
Kihwal Lee 5323d5e388 HDFS-6313. WebHdfs may use the wrong NN when configured for multiple HA NNs. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593475 13f79535-47bb-0310-9956-ffa450edef68
2014-05-09 02:01:37 +00:00
Kihwal Lee 87215cb9f6 Fix CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593473 13f79535-47bb-0310-9956-ffa450edef68
2014-05-09 01:52:35 +00:00
Kihwal Lee eac832f92d HDFS-6329. WebHdfs does not work if HA is enabled on NN but logical URI is not configured. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593470 13f79535-47bb-0310-9956-ffa450edef68
2014-05-09 01:46:42 +00:00
Arpit Agarwal 63fadf0abd HDFS-6340.DN can't finalize upgrade. (Contributed by Rahul Singhal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593436 13f79535-47bb-0310-9956-ffa450edef68
2014-05-08 22:20:37 +00:00
Kihwal Lee 47f03bc9fe HADOOP-10158. SPNEGO should work with multiple interfaces/SPNs. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593362 13f79535-47bb-0310-9956-ffa450edef68
2014-05-08 18:26:58 +00:00
Colin McCabe 280c764f54 HDFS-5381. ExtendedBlock#hashCode should use both blockId and block pool ID (Benoy Antony via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593346 13f79535-47bb-0310-9956-ffa450edef68
2014-05-08 17:49:52 +00:00
Haohui Mai 2d5362073c HADOOP-10471. Reduce the visibility of constants in ProxyUsers. Contributed by Benoy Antony.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592915 13f79535-47bb-0310-9956-ffa450edef68
2014-05-06 22:38:02 +00:00
Uma Maheswara Rao G 8b0acf4b1f HDFS-6337. Setfacl testcase is failing due to dash character in username in TestAclCLI. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592489 13f79535-47bb-0310-9956-ffa450edef68
2014-05-05 11:53:33 +00:00
Andrew Wang 9445859930 HDFS-6295. Add decommissioning state and node state filtering to dfsadmin. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592438 13f79535-47bb-0310-9956-ffa450edef68
2014-05-05 03:38:29 +00:00
Tsz-wo Sze b2f65c276d HDFS-5168. Add cross node dependency support to BlockPlacementPolicy. Contributed by Nikola Vujic
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592179 13f79535-47bb-0310-9956-ffa450edef68
2014-05-03 11:02:44 +00:00
Haohui Mai d777cb8996 HADOOP-10563. Remove the dependency of jsp in trunk. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592069 13f79535-47bb-0310-9956-ffa450edef68
2014-05-02 22:26:02 +00:00
Haohui Mai 6420249d47 HDFS-6252. Phase out the old web UI in HDFS. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591732 13f79535-47bb-0310-9956-ffa450edef68
2014-05-01 18:46:18 +00:00
Aaron Myers e5d6fba47d HDFS-6289. HA failover can fail if there are pending DN messages for DNs which no longer exist. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591413 13f79535-47bb-0310-9956-ffa450edef68
2014-04-30 17:46:15 +00:00
Haohui Mai 0689363343 HDFS-6304. Consolidate the logic of path resolution in FSDirectory. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591411 13f79535-47bb-0310-9956-ffa450edef68
2014-04-30 17:44:17 +00:00
Jonathan Turner Eagles 0532b8bad1 HDFS-6269. NameNode Audit Log should differentiate between webHDFS open and HDFS open. (Eric Payne via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591117 13f79535-47bb-0310-9956-ffa450edef68
2014-04-29 21:51:14 +00:00
Arpit Agarwal 19176f423a HADOOP-10547. Fix CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591098 13f79535-47bb-0310-9956-ffa450edef68
2014-04-29 20:42:08 +00:00
Arpit Agarwal 871d81060d HADOOP-10547. Give SaslPropertiesResolver.getDefaultProperties() public scope. (Contributed by Benoy Antony)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591095 13f79535-47bb-0310-9956-ffa450edef68
2014-04-29 20:38:36 +00:00
Vinayakumar B 9d21180c1a HDFS-2882. DN continues to start up, even if block pool fails to initialize (Contributed by Vinayakumar B)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590941 13f79535-47bb-0310-9956-ffa450edef68
2014-04-29 10:27:29 +00:00
Haohui Mai 02d28907be HADOOP-10508. RefreshCallQueue fails when authorization is enabled. Contributed by Chris Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590876 13f79535-47bb-0310-9956-ffa450edef68
2014-04-29 06:04:14 +00:00
Andrew Wang 71aa608b84 HDFS-6288. DFSInputStream Pread doesn't update ReadStatistics. Contributed by Juan Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590776 13f79535-47bb-0310-9956-ffa450edef68
2014-04-28 20:20:10 +00:00
Kihwal Lee 02d0f0ba54 HDFS-6218. Audit log should use true client IP for proxied webhdfs operations. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590640 13f79535-47bb-0310-9956-ffa450edef68
2014-04-28 14:00:32 +00:00
Haohui Mai b8a3e2bb20 HDFS-6270. Secondary namenode status page shows transaction count in bytes. Contributed by Benoy Antony.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590197 13f79535-47bb-0310-9956-ffa450edef68
2014-04-25 23:49:10 +00:00
Haohui Mai 445b742354 HDFS-5865. Update OfflineImageViewer document. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590100 13f79535-47bb-0310-9956-ffa450edef68
2014-04-25 18:43:41 +00:00
Haohui Mai bce5a92c54 HDFS-6210. Support GETACLSTATUS operation in WebImageViewer. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589933 13f79535-47bb-0310-9956-ffa450edef68
2014-04-25 05:55:11 +00:00
Uma Maheswara Rao G 0931bd94be HDFS-6246. Remove 'dfs.support.append' flag from trunk code. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589927 13f79535-47bb-0310-9956-ffa450edef68
2014-04-25 05:19:50 +00:00
Jing Zhao 10a037cccb HDFS-6266. Identify full path for a given INode. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589920 13f79535-47bb-0310-9956-ffa450edef68
2014-04-25 02:05:42 +00:00
Aaron Myers 7bad941152 HDFS-6281. Provide option to use the NFS Gateway without having to use the Hadoop portmapper. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589914 13f79535-47bb-0310-9956-ffa450edef68
2014-04-25 00:16:47 +00:00
Colin McCabe fbc0a8bef0 HDFS-6282. Re-add testIncludeByRegistrationName (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589907 13f79535-47bb-0310-9956-ffa450edef68
2014-04-24 23:08:37 +00:00
Arpit Agarwal 730e0675da HDFS-6273. Add file missed in previous checkin.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589808 13f79535-47bb-0310-9956-ffa450edef68
2014-04-24 18:04:45 +00:00
Arpit Agarwal cf4bc7fdd4 HDFS-6273. Config options to allow wildcard endpoints for namenode HTTP and HTTPS servers. (Contributed by Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589803 13f79535-47bb-0310-9956-ffa450edef68
2014-04-24 17:40:30 +00:00
Jing Zhao 24d1cf9ac6 HDFS-5693. Few NN metrics data points were collected via JMX when NN is under heavy load. Contributed by Ming Ma.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589620 13f79535-47bb-0310-9956-ffa450edef68
2014-04-24 07:24:51 +00:00
Haohui Mai a5bec2b871 HDFS-6279. Create new index page for JN / DN. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589618 13f79535-47bb-0310-9956-ffa450edef68
2014-04-24 07:18:40 +00:00
Haohui Mai 140f4542b6 HDFS-6278. Create HTML5-based UI for SNN. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589613 13f79535-47bb-0310-9956-ffa450edef68
2014-04-24 07:15:31 +00:00
Suresh Srinivas f36f0dde88 HDFS-6276. Remove unnecessary conditions and null check. Contributed by Suresh Srinivas
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589586 13f79535-47bb-0310-9956-ffa450edef68
2014-04-24 05:05:47 +00:00
Kihwal Lee 53cb787d48 HDFS-6217. Webhdfs PUT operations may not work via a http proxy. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589528 13f79535-47bb-0310-9956-ffa450edef68
2014-04-23 22:00:46 +00:00
Suresh Srinivas 7f635b8f53 HDFS-6275. Fix warnings - type arguments can be inferred and redudant local variable. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589510 13f79535-47bb-0310-9956-ffa450edef68
2014-04-23 20:20:16 +00:00
Suresh Srinivas 876fd8ab79 HDFS-6274. Cleanup javadoc warnings in HDFS code. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589506 13f79535-47bb-0310-9956-ffa450edef68
2014-04-23 20:13:32 +00:00
Andrew Wang ee8a152520 HDFS-5213. TestDataNodeConfig failing on Jenkins runs due to DN web port in use. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589474 13f79535-47bb-0310-9956-ffa450edef68
2014-04-23 18:06:21 +00:00
Jing Zhao 1be4ddef9e HDFS-6178. Decommission on standby NN couldn't finish. Contributed by Ming Ma.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589002 13f79535-47bb-0310-9956-ffa450edef68
2014-04-21 23:35:09 +00:00
Chris Nauroth a4475406f8 HDFS-6265. Prepare HDFS codebase for JUnit 4.11. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588995 13f79535-47bb-0310-9956-ffa450edef68
2014-04-21 22:49:08 +00:00
Arpit Agarwal 2d9f038e63 HDFS-6245. Datanode fails to start with a bad disk even when failed volumes is set. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588842 13f79535-47bb-0310-9956-ffa450edef68
2014-04-21 00:15:16 +00:00
Haohui Mai bc0b7c6145 HDFS-6256. Clean up ImageVisitor and SpotCheckImageVisitor. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588524 13f79535-47bb-0310-9956-ffa450edef68
2014-04-18 17:35:51 +00:00
Vinayakumar B eb1d4c39e0 HDFS-6153. Document "fileId" and "childrenNum" fields in the FileStatus Json schema
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588258 13f79535-47bb-0310-9956-ffa450edef68
2014-04-17 14:04:33 +00:00
Chris Nauroth dd7d032457 HADOOP-10499. Remove unused parameter from ProxyUsers.authorize(). Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588098 13f79535-47bb-0310-9956-ffa450edef68
2014-04-16 23:09:08 +00:00
Colin McCabe 9a0dec60ff HDFS-4909. Avoid protocol buffer RPC namespace clashes (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588091 13f79535-47bb-0310-9956-ffa450edef68
2014-04-16 22:58:40 +00:00
Kihwal Lee 5c8c84ddaa fix CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587965 13f79535-47bb-0310-9956-ffa450edef68
2014-04-16 16:28:01 +00:00
Kihwal Lee ef68759382 HDFS-6219. Proxy superuser configuration should use true client IP for address checks. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587962 13f79535-47bb-0310-9956-ffa450edef68
2014-04-16 16:22:36 +00:00
Daryn Sharp 5e47eeca9d HDFS-6214. Webhdfs has poor throughput for files >2GB (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587954 13f79535-47bb-0310-9956-ffa450edef68
2014-04-16 16:05:22 +00:00
Chris Nauroth 9887d7f250 HDFS-5409. TestOfflineEditsViewer#testStored fails on Windows due to CRLF line endings in editsStored.xml from git checkout. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587759 13f79535-47bb-0310-9956-ffa450edef68
2014-04-16 00:05:45 +00:00
Haohui Mai 5833efc6e4 HDFS-6194. Create new tests for ByteRangeInputStream. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587660 13f79535-47bb-0310-9956-ffa450edef68
2014-04-15 18:09:04 +00:00
Chris Nauroth 01af3a3177 HDFS-6243. HA NameNode transition to active or shutdown may leave lingering image transfer thread. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587410 13f79535-47bb-0310-9956-ffa450edef68
2014-04-15 04:49:09 +00:00
Chris Nauroth 8a9eff3919 HDFS-6238. TestDirectoryScanner leaks file descriptors. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587148 13f79535-47bb-0310-9956-ffa450edef68
2014-04-14 04:46:26 +00:00
Chris Nauroth 7aed74b3d0 HDFS-6237. TestDFSShell#testGet fails on Windows due to invalid file system path. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587146 13f79535-47bb-0310-9956-ffa450edef68
2014-04-14 04:38:46 +00:00
Chris Nauroth 193f11a7ab HDFS-6236. ImageServlet should use Time#monotonicNow to measure latency. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586902 13f79535-47bb-0310-9956-ffa450edef68
2014-04-12 21:38:35 +00:00
Colin McCabe 2f72888896 HDFS-6232. OfflineEditsViewer throws a NPE on edits containing ACL modifications (ajisakaa via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586790 13f79535-47bb-0310-9956-ffa450edef68
2014-04-11 22:42:48 +00:00
Jing Zhao 01ea648056 HDFS-6229. Race condition in failover can cause RetryCache fail to work. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586714 13f79535-47bb-0310-9956-ffa450edef68
2014-04-11 16:42:46 +00:00
Chris Nauroth 6d45bb54d2 HDFS-6235. TestFileJournalManager can fail on Windows due to file locking if tests run out of order. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586692 13f79535-47bb-0310-9956-ffa450edef68
2014-04-11 15:45:39 +00:00
Chris Nauroth 76ea55caeb HDFS-6234. TestDatanodeConfig#testMemlockLimit fails on Windows due to invalid file path. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586682 13f79535-47bb-0310-9956-ffa450edef68
2014-04-11 15:30:18 +00:00
Chris Nauroth f8904ad299 HDFS-6231. DFSClient hangs infinitely if using hedged reads and all eligible datanodes die. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586551 13f79535-47bb-0310-9956-ffa450edef68
2014-04-11 03:48:29 +00:00
Andrew Wang 3b008baf35 Undo accidental FSNamesystem change introduced in HDFS-6224 commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586515 13f79535-47bb-0310-9956-ffa450edef68
2014-04-11 00:21:39 +00:00
Andrew Wang fad8620a71 HDFS-6224. Add a unit test to TestAuditLogger for file permissions passed to logAuditEvent. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586490 13f79535-47bb-0310-9956-ffa450edef68
2014-04-10 22:35:07 +00:00
Uma Maheswara Rao G af0fe05a92 HDFS-5669. Storage#tryLock() should check for null before logging successfull message. Contributed by Vinayakumar B
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586392 13f79535-47bb-0310-9956-ffa450edef68
2014-04-10 18:11:28 +00:00
Uma Maheswara Rao G 897fe59b1c HDFS-6228. comments typo fix for FsDatasetImpl.java Contributed by zhaoyunjiong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586264 13f79535-47bb-0310-9956-ffa450edef68
2014-04-10 10:33:22 +00:00
Haohui Mai 7af48dd355 HDFS-6225. Remove the o.a.h.hdfs.server.common.UpgradeStatusReport. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586181 13f79535-47bb-0310-9956-ffa450edef68
2014-04-10 00:20:28 +00:00
Chris Nauroth 5c48f379ab HDFS-6208. DataNode caching can leak file descriptors. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586154 13f79535-47bb-0310-9956-ffa450edef68
2014-04-09 21:45:57 +00:00
Haohui Mai 8af0708580 HDFS-6170. Support GETFILESTATUS operation in WebImageViewer. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586152 13f79535-47bb-0310-9956-ffa450edef68
2014-04-09 21:29:55 +00:00
Tsz-wo Sze 5c18d45224 HDFS-6209. TestValidateConfigurationSettings should use random ports. Contributed by Arpit Agarwal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586079 13f79535-47bb-0310-9956-ffa450edef68
2014-04-09 18:50:05 +00:00
Tsz-wo Sze 0b977049cf HDFS-6204. Fix TestRBWBlockInvalidation: change the last sleep to a loop.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586039 13f79535-47bb-0310-9956-ffa450edef68
2014-04-09 17:01:08 +00:00
Tsz-wo Sze 06e4c84b7d HDFS-6206. Fix NullPointerException in DFSUtil.substituteForWildcardAddress.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586034 13f79535-47bb-0310-9956-ffa450edef68
2014-04-09 16:55:03 +00:00
Jonathan Turner Eagles 58d49cecd5 HDFS-6215. Wrong error message for upgrade. (Kihwal Lee via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586011 13f79535-47bb-0310-9956-ffa450edef68
2014-04-09 16:20:26 +00:00
Arpit Agarwal 6cc92bf8fc HDFS-6160. TestSafeMode occasionally fails. (Contributed by Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586007 13f79535-47bb-0310-9956-ffa450edef68
2014-04-09 16:13:40 +00:00
Steve Loughran b8f250a99d HADOOP-10104. Update jackson to 1.9.13 (Akira Ajisaka via stevel)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585932 13f79535-47bb-0310-9956-ffa450edef68
2014-04-09 11:11:20 +00:00
Haohui Mai 7915b36225 HDFS-6169. Move the address in WebImageViewer. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585802 13f79535-47bb-0310-9956-ffa450edef68
2014-04-08 18:14:19 +00:00
Haohui Mai bcf1f33acd HDFS-6143. WebHdfsFileSystem open should throw FileNotFoundException for non-existing paths. Contributed by Gera Shegalov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585639 13f79535-47bb-0310-9956-ffa450edef68
2014-04-08 01:39:23 +00:00
Chris Nauroth 5bbf271712 HDFS-6198. DataNode rolling upgrade does not correctly identify current block pool directory and replace with trash on Windows. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585627 13f79535-47bb-0310-9956-ffa450edef68
2014-04-08 00:00:33 +00:00
Haohui Mai 2002dc63c9 HDFS-6180. Dead node count / listing is very broken in JMX and old GUI. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585625 13f79535-47bb-0310-9956-ffa450edef68
2014-04-07 23:55:06 +00:00
Chris Nauroth 79bd50f91b HDFS-6197. Rolling upgrade rollback on Windows can fail attempting to rename edit log segment files to a destination that already exists. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585586 13f79535-47bb-0310-9956-ffa450edef68
2014-04-07 21:21:46 +00:00
Brandon Li a5b37c6ed1 HDFS-6181. Fix the wrong property names in NFS user guide. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585563 13f79535-47bb-0310-9956-ffa450edef68
2014-04-07 18:55:49 +00:00
Kihwal Lee fe328621d4 HDFS-6191. Disable quota checks when replaying edit log.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585544 13f79535-47bb-0310-9956-ffa450edef68
2014-04-07 18:25:12 +00:00
Kihwal Lee 4e979f5dea HDFS-6159. TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success. Contributed by Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584900 13f79535-47bb-0310-9956-ffa450edef68
2014-04-04 20:38:22 +00:00
Tsz-wo Sze 4147a52143 HDFS-6189. Multiple HDFS tests fail on Windows attempting to use a test root path containing a colon. Contributed by cnauroth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584763 13f79535-47bb-0310-9956-ffa450edef68
2014-04-04 15:50:46 +00:00
Haohui Mai 620809b9a0 HDFS-6190. Minor textual fixes in DFSClient. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584376 13f79535-47bb-0310-9956-ffa450edef68
2014-04-03 20:18:49 +00:00
Haohui Mai 5b3481a750 HDFS-5570. Addendum commit for r1584100.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584174 13f79535-47bb-0310-9956-ffa450edef68
2014-04-02 20:53:01 +00:00
Haohui Mai fb1d7fb596 HDFS-5570. Deprecate hftp / hsftp and replace them with webhdfs / swebhdfs. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584100 13f79535-47bb-0310-9956-ffa450edef68
2014-04-02 17:28:08 +00:00
Andrew Wang 64c50d9dfb HDFS-5591. Checkpointing should use monotonic time when calculating period. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583926 13f79535-47bb-0310-9956-ffa450edef68
2014-04-02 08:33:25 +00:00
Tsz-wo Sze f93d99990a HDFS-6167. Relocate the non-public API classes in the hdfs.client package.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583878 13f79535-47bb-0310-9956-ffa450edef68
2014-04-02 05:09:35 +00:00
Haohui Mai 71bae5cae4 HDFS-6173. Move the default processor from Ls to Web in OfflineImageViewer. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583384 13f79535-47bb-0310-9956-ffa450edef68
2014-03-31 18:05:23 +00:00
Arun Murthy fa9eed2ed6 Preparing for hadoop-2.4.0 release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583245 13f79535-47bb-0310-9956-ffa450edef68
2014-03-31 07:36:13 +00:00
Arun Murthy 004d0854b7 HDFS-4564. Ensure webhdfs returns correct HTTP response codes for denied operations. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583241 13f79535-47bb-0310-9956-ffa450edef68
2014-03-31 07:25:53 +00:00
Tsz-wo Sze b4c41f341b HDFS-6166. Change Balancer socket read timeout to 20 minutes and add 10 seconds delay after error. Contributed by Nathan Roberts
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583018 13f79535-47bb-0310-9956-ffa450edef68
2014-03-29 16:23:00 +00:00
Tsz-wo Sze 3f7aa79e58 HDFS-6168. Remove a deprecated constructor and the deprecated methods reportChecksumFailure, getDelegationToken(Text), renewDelegationToken and cancelDelegationToken from DistributedFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582856 13f79535-47bb-0310-9956-ffa450edef68
2014-03-28 18:29:31 +00:00
Haohui Mai 2e799e5984 HDFS-6156. Simplify the JMX API that provides snapshot information. Contributed by Shinichi Yamashita.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582847 13f79535-47bb-0310-9956-ffa450edef68
2014-03-28 18:10:21 +00:00
Haohui Mai 9d2d55e490 HDFS-6164. Remove lsr in OfflineImageViewer. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582533 13f79535-47bb-0310-9956-ffa450edef68
2014-03-27 23:11:02 +00:00
Haohui Mai 54c1daa580 HDFS-5978. Create a tool to take fsimage and expose read-only WebHDFS API. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582433 13f79535-47bb-0310-9956-ffa450edef68
2014-03-27 18:15:47 +00:00
Jing Zhao 51e353c091 HDFS-6163. Fix a minor bug in the HA upgrade document. Contributed by Fengdong Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582421 13f79535-47bb-0310-9956-ffa450edef68
2014-03-27 17:37:06 +00:00
Suresh Srinivas 21d225af4d HDFS-6162. Format strings should use platform independent line separator. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582181 13f79535-47bb-0310-9956-ffa450edef68
2014-03-27 04:25:09 +00:00
Haohui Mai fd3d5ab792 HDFS-6158. Clean up dead code for OfflineImageViewer. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582164 13f79535-47bb-0310-9956-ffa450edef68
2014-03-27 02:58:10 +00:00
Haohui Mai 82be0f935d HDFS-6157. Fix the entry point of OfflineImageViewer for hdfs.cmd. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582098 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 22:34:25 +00:00
Suresh Srinivas 78b9321539 HDFS-6119. FSNamesystem code cleanup. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582073 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 21:32:32 +00:00
Suresh Srinivas 14556cc5d8 HDFS-6155. Fix Boxing/unboxing to parse a primitive findbugs warnings. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582068 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 21:27:33 +00:00
Jing Zhao fe8c3dc2b8 HDFS-5672. TestHASafeMode#testSafeBlockTracking fails in trunk. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581994 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 18:36:08 +00:00
Tsz-wo Sze a206399afd HDFS-6115. Call flush() for every append on block scan verification log. Contributed by Vinayakumar B
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581936 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 17:03:05 +00:00
Suresh Srinivas c00703dd08 HDFS-6150. Add inode id information in the logs to make debugging easier. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581914 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 16:32:44 +00:00
Haohui Mai b5935fab44 HDFS-6130. NPE when upgrading namenode from fsimages older than -32. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581713 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 07:30:20 +00:00
Arpit Agarwal 1fbb04e367 HDFS-5910. Enhance DataTransferProtocol to allow per-connection choice of encryption/plain-text. (Contributed by Benoy Antony)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581688 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 04:11:18 +00:00
Haohui Mai 867e0f8ea9 HDFS-5196. Provide more snapshot information in WebUI. Contributed by Shinichi Yamashita.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581427 13f79535-47bb-0310-9956-ffa450edef68
2014-03-25 17:53:51 +00:00
Jing Zhao 56205ca7d7 HDFS-5840. Follow-up to HDFS-5138 to improve error handling during partial upgrade failures. Contributed by Aaron T. Myers, Suresh Srinivas, and Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581260 13f79535-47bb-0310-9956-ffa450edef68
2014-03-25 06:48:15 +00:00
Suresh Srinivas 3a61d25457 HDFS-6125. Cleanup unnecessary cast in HDFS code base. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581242 13f79535-47bb-0310-9956-ffa450edef68
2014-03-25 05:51:11 +00:00
Arpit Agarwal c2ef7e239e HDFS-6124. Add final modifier to class members. (Contributed by Suresh Srinivas)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581124 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 23:32:37 +00:00
Chris Nauroth 328fc86bdb HDFS-5846. Shuffle phase is slow in Windows - FadviseFileRegion::transferTo does not read disks efficiently. Contributed by Nikola Vujic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581091 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 22:16:48 +00:00
Jing Zhao 6376cd38a1 Move HDFS-5138 to 2.4.0 section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581074 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 21:32:43 +00:00
Jing Zhao 8076ff31eb HDFS-6135. In HDFS upgrade with HA setup, JournalNode cannot handle layout version bump when rolling back. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581070 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 21:24:31 +00:00
Brandon Li 3bfd18c6b0 HDFS-6050. NFS does not handle exceptions correctly in a few places. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581055 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 20:49:30 +00:00
Kihwal Lee 7a18c4a199 HDFS-3087. Decomissioning on NN restart can complete without blocks being replicated. Contributed by Rushabh S Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580886 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 15:39:00 +00:00
Chris Nauroth 00ceaade05 HDFS-6140. WebHDFS cannot create a file with spaces in the name after HA failover changes. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580173 13f79535-47bb-0310-9956-ffa450edef68
2014-03-22 05:32:24 +00:00
Arpit Agarwal fc53af9c4c HDFS-6120. Fix and improve safe mode log messages. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580047 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 20:57:13 +00:00
Tsz-wo Sze 2fbd94db3e HDFS-6138. Add a user guide for how to use viewfs with federation. Contributed by sanjay and szetszwo
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580013 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 18:47:30 +00:00
Jing Zhao 9dab514b22 HDFS-6038. Allow JournalNode to handle editlog produced by new release with future layoutversion. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579813 13f79535-47bb-0310-9956-ffa450edef68
2014-03-20 23:06:06 +00:00
Andrew Wang 4f6397b4ac HDFS-6089. Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579692 13f79535-47bb-0310-9956-ffa450edef68
2014-03-20 17:43:16 +00:00
Tsz-wo Sze 7ec4308f82 HDFS-6129. When a replica is not found for deletion, do not throw an exception.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579670 13f79535-47bb-0310-9956-ffa450edef68
2014-03-20 15:50:38 +00:00
Haohui Mai aa4a045925 HDFS-6127. WebHDFS tokens cannot be renewed in HA setup. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579546 13f79535-47bb-0310-9956-ffa450edef68
2014-03-20 06:47:58 +00:00
Haohui Mai 44deaa8241 HDFS-6105. NN web UI for DN list loads the same jmx page multiple times. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579468 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 23:56:43 +00:00
Tsz-wo Sze cfb468332e HDFS-6123. Do not log stack trace for ReplicaAlreadyExistsException and SocketTimeoutException.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579396 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 21:04:21 +00:00
Jing Zhao 7817245d88 HDFS-6100. DataNodeWebHdfsMethods does not failover in HA mode. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579301 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 17:29:23 +00:00
Chris Nauroth 2b03ae9421 HDFS-6099. HDFS file system limits not enforced on renames. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579122 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 03:46:52 +00:00
Suresh Srinivas d0f7985f5c HDFS-6117. Print file path information in FileNotFoundException on INode ID mismatch. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579104 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 00:59:45 +00:00
Aaron Myers ed02d0c0ce HDFS-6112. NFS Gateway docs are incorrect for allowed hosts configuration. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579097 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 00:30:29 +00:00
Tsz-wo Sze 534a5ee346 Add TestSnapshotNameWithInvalidCharacters.java for HDFS-6068.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579005 13f79535-47bb-0310-9956-ffa450edef68
2014-03-18 18:35:19 +00:00
Tsz-wo Sze 02b25ce4ef HDFS-6068. Disallow snapshot names that are also invalid directory names. Contributed by sathish
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579004 13f79535-47bb-0310-9956-ffa450edef68
2014-03-18 18:34:19 +00:00
Colin McCabe bd98fa152d HDFS-6007. Update documentation about short-circuit local reads (iwasakims via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578994 13f79535-47bb-0310-9956-ffa450edef68
2014-03-18 18:14:04 +00:00
Jing Zhao 0b3ee72af8 HDFS-6090. Use MiniDFSCluster.Builder instead of deprecated constructors. Contributed by Akira AJISAKA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578669 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 23:53:48 +00:00
Chris Nauroth 6318afe3b9 HDFS-5516. WebHDFS does not require user name when anonymous http requests are disallowed. Contributed by Miodrag Radulovic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578549 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 20:25:10 +00:00
Colin McCabe 7096c290ed HDFS-6107: fix comment (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578511 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 18:54:03 +00:00
Colin McCabe d265dd9eb0 HDFS-6107. When a block cannot be cached due to limited space on the DataNode, it becomes uncacheable (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578508 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 18:46:33 +00:00
Arpit Agarwal 809e8bf5b7 HDFS-6094. The same block can be counted twice towards safe mode threshold. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578478 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 17:37:55 +00:00
Colin McCabe 9a65a9aadc HDFS-6106. Reduce default for dfs.namenode.path.based.cache.refresh.interval.ms (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577798 13f79535-47bb-0310-9956-ffa450edef68
2014-03-15 07:52:19 +00:00
Andrew Wang d37c31a2db HDFS-6102. Lower the default maximum items per directory to fix PB fsimage loading. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577426 13f79535-47bb-0310-9956-ffa450edef68
2014-03-14 04:52:03 +00:00
Haohui Mai 38006007ea HDFS-6084. Namenode UI - Hadoop logo link shouldn't go to hadoop homepage. Contributed by Travis Thompson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577401 13f79535-47bb-0310-9956-ffa450edef68
2014-03-14 00:58:54 +00:00
Colin McCabe f730fa919e HDFS-6097. Zero-copy reads are incorrectly disabled on file offsets above 2GB (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577350 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 22:30:42 +00:00
Brandon Li 842aa2bc94 HDFS-6080. Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577319 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 21:03:59 +00:00
Suresh Srinivas 70aba7ffcf HDFS-5244. TestNNStorageRetentionManager#testPurgeMultipleDirs fails. Contributed bye Jinghui Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577254 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 17:21:09 +00:00
Arpit Agarwal f0fa038c7e HDFS-6096. TestWebHdfsTokens may timeout. (Contributed by szetszwo)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576999 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 23:24:32 +00:00
Arpit Agarwal 20ec0c0474 HDFS-5705. Update CHANGES.txt for merging the original fix (r1555190) to branch-2 and branch-2.4.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576989 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 23:13:32 +00:00
Andrew Wang b849dd5df9 HDFS-6079. Timeout for getFileBlockStorageLocations does not work. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576979 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 22:54:57 +00:00
Colin McCabe a3616c58dd HDFS-6086. Fix a case where zero-copy or no-checksum reads were not allowed even when the block was cached. (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576533 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 22:41:05 +00:00
Haohui Mai b027ef8858 HDFS-6072. Clean up dead code of FSImage. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576513 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 21:44:38 +00:00
Chris Nauroth 8d29768704 HDFS-5638. HDFS implementation of FileContext API for ACLs. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576405 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 16:13:43 +00:00
Colin McCabe bab90b2222 HDFS-6085. Improve CacheReplicationMonitor log messages a bit (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576194 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 06:24:52 +00:00
Andrew Wang 2e57b1fe86 Move HDFS-3405 to 2.4.0 section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576158 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 00:47:50 +00:00
Tsz-wo Sze 024f8e931f Move HDFS-5535 to Release 2.4.0 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576148 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 00:08:20 +00:00
Chris Nauroth 5bb794566e HDFS-6055. Change default configuration to limit file name length in HDFS. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576095 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 21:41:38 +00:00
Jing Zhao b674dfd480 HDFS-6077. running slive with webhdfs on secure HA cluster fails with unkown host exception. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576076 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 20:48:53 +00:00
Andrew Wang daaa8f03f4 HDFS-6070. Cleanup use of ReadStatistics in DFSInputStream.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576047 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 19:04:05 +00:00
Haohui Mai a06b21cf67 HDFS-5892. TestDeleteBlockPool fails in branch-2. Contributed by Ted Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576035 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 18:16:57 +00:00
Colin McCabe d59dbc9e38 HDFS-6071. BlockReaderLocal does not return -1 on EOF when doing a zero-length read on a short file. (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575797 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 02:41:45 +00:00
Andrew Wang 94a1632fcb HDFS-3405. Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575611 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 21:25:13 +00:00
Andrew Wang dbd22b23c2 Revert HDFS-3405 for recommit with correct renamed files
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575610 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 21:15:41 +00:00
Andrew Wang 98594ab787 Remove extra file from HDFS-3405.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575609 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 21:11:04 +00:00
Arpit Agarwal 596004ac73 HDFS-6078. TestIncrementalBlockReports is flaky. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575559 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 16:38:36 +00:00
Andrew Wang 0f595915a3 HDFS-3405. Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575457 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 00:39:23 +00:00
Tsz-wo Sze 1f6c2b09c6 HDFS-6076. DataNode with SimulatedDataSet should not create DatanodeRegistration with namenode layout version and namenode node type.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575452 13f79535-47bb-0310-9956-ffa450edef68
2014-03-07 23:47:43 +00:00
Andrew Wang 90b399c4bd HDFS-5064. Standby checkpoints should not block concurrent readers. Contributed by Aaron Twining Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575448 13f79535-47bb-0310-9956-ffa450edef68
2014-03-07 23:35:47 +00:00
Chris Nauroth b1f87bbabd HDFS-5986. Capture the number of blocks pending deletion on namenode webUI. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575384 13f79535-47bb-0310-9956-ffa450edef68
2014-03-07 19:37:15 +00:00
Chris Nauroth b55c1aab7b HDFS-6069. Quash stack traces when ACLs are disabled. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575184 13f79535-47bb-0310-9956-ffa450edef68
2014-03-07 06:06:12 +00:00
Chris Nauroth 12711177d3 HDFS-6063. TestAclCLI fails intermittently when running test 24: copyFromLocal. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575171 13f79535-47bb-0310-9956-ffa450edef68
2014-03-07 05:44:57 +00:00
Colin McCabe 173c115951 HDFS-6065. HDFS zero-copy reads should return null on EOF when doing ZCR (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575109 13f79535-47bb-0310-9956-ffa450edef68
2014-03-07 01:18:32 +00:00
Colin McCabe 591be56052 HDFS-6067. TestPread.testMaxOutHedgedReadPool is flaky (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575100 13f79535-47bb-0310-9956-ffa450edef68
2014-03-06 23:48:23 +00:00
Haohui Mai 90b1e25c7f HDFS-6084. DFSConfigKeys.DFS_BLOCKREPORT_INTERVAL_MSEC_DEFAULT is not updated with latest block report interval of 6 hrs. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575086 13f79535-47bb-0310-9956-ffa450edef68
2014-03-06 22:54:36 +00:00
Brandon Li 278d40f9ac Fix CHANGES.txt for HDFS-6060
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575023 13f79535-47bb-0310-9956-ffa450edef68
2014-03-06 19:52:02 +00:00
Brandon Li 8955f718f1 HDFS-6060. NameNode should not check DataNode layout version. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575021 13f79535-47bb-0310-9956-ffa450edef68
2014-03-06 19:29:11 +00:00
Colin McCabe 115e60b0dc HDFS-6059. TestBlockReaderLocal fails if native library not available (ajisakaa via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574998 13f79535-47bb-0310-9956-ffa450edef68
2014-03-06 18:52:22 +00:00
Haohui Mai e65084b616 HDFS-6062. TestRetryCacheWithHA#testConcat is flaky. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574997 13f79535-47bb-0310-9956-ffa450edef68
2014-03-06 18:51:04 +00:00
Colin McCabe 5a3f614794 HDFS-6061. Allow dfs.datanode.shared.file.descriptor.path to contain multiple entries and fall back when needed (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574796 13f79535-47bb-0310-9956-ffa450edef68
2014-03-06 08:21:16 +00:00
Haohui Mai 9192f8446d HDFS-6058. Fix TestHDFSCLI failures after HADOOP-8691 change. Contributed by Akira Ajisaka and Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574792 13f79535-47bb-0310-9956-ffa450edef68
2014-03-06 08:13:40 +00:00
Colin McCabe 95e0f616b9 HDFS-6057. DomainSocketWatcher.watcherThread should be marked as a daemon thread (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574787 13f79535-47bb-0310-9956-ffa450edef68
2014-03-06 07:57:19 +00:00
Haohui Mai ad61eec072 HADOOP-10386. Log proxy hostname in various exceptions being thrown in a HA setup. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574716 13f79535-47bb-0310-9956-ffa450edef68
2014-03-05 23:09:47 +00:00
Aaron Myers 6adf7a0ecb HDFS-5898. Allow NFS gateway to login/relogin from its kerberos keytab. Contributed by Abin Shahab.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574693 13f79535-47bb-0310-9956-ffa450edef68
2014-03-05 22:20:39 +00:00
Haohui Mai b46fbd0275 HDFS-5857. TestWebHDFS#testNamenodeRestart fails intermittently with NPE. Contributed By Mit Desai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574683 13f79535-47bb-0310-9956-ffa450edef68
2014-03-05 21:51:24 +00:00
Brandon Li 206e2b0cd2 HDFS-6044. Add property for setting the NFS look up time for users. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574622 13f79535-47bb-0310-9956-ffa450edef68
2014-03-05 19:01:05 +00:00
Brandon Li 8e84dedd4c HDFS-6043. Give HDFS daemons NFS3 and Portmap their own OPTS. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574616 13f79535-47bb-0310-9956-ffa450edef68
2014-03-05 18:50:45 +00:00
Jing Zhao e1162ebb1f HDFS-5167. Add metrics about the NameNode retry cache. Contributed by Tsuyoshi OZAWA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574603 13f79535-47bb-0310-9956-ffa450edef68
2014-03-05 18:22:04 +00:00
Haohui Mai e90687f90e HDFS-5321. Clean up the HTTP-related configuration in HDFS. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574270 13f79535-47bb-0310-9956-ffa450edef68
2014-03-05 00:28:21 +00:00
Tsz-wo Sze 291dbc3d27 svn merge --reintegrate https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535 back to trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574259 13f79535-47bb-0310-9956-ffa450edef68
2014-03-04 23:53:26 +00:00
Colin McCabe 1da076fd13 HDFS-6051. HDFS cannot run on Windows since short-circuit memory segment changes (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574246 13f79535-47bb-0310-9956-ffa450edef68
2014-03-04 23:33:29 +00:00
Michael Stack c0a903da22 HDFS-6047 TestPread NPE inside in DFSInputStream hedgedFetchBlockByteRange (stack)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574205 13f79535-47bb-0310-9956-ffa450edef68
2014-03-04 21:07:03 +00:00
Jing Zhao f9ebdea446 Merging r1573814 through r1574170 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1574171 13f79535-47bb-0310-9956-ffa450edef68
2014-03-04 18:22:26 +00:00
Colin McCabe c94e43c6df HDFS-6046. add dfs.client.mmap.enabled (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573887 13f79535-47bb-0310-9956-ffa450edef68
2014-03-04 06:46:08 +00:00
Colin McCabe 33500fd304 HDFS-6040. fix DFSClient issue without libhadoop.so and some other ShortCircuitShm cleanups (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573883 13f79535-47bb-0310-9956-ffa450edef68
2014-03-04 06:31:43 +00:00
Chris Nauroth 2cfe554980 HDFS-6039. Uploading a File under a Dir with default acls throws "Duplicated ACLFeature". Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573879 13f79535-47bb-0310-9956-ffa450edef68
2014-03-04 06:08:25 +00:00
Jing Zhao 5d29338017 HDFS-6041. Downgrade/Finalize should rename the rollback image instead of purging it. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1573851 13f79535-47bb-0310-9956-ffa450edef68
2014-03-04 04:42:58 +00:00
Tsz-wo Sze 9ad8dd1e8a Merge r1569890 through r1573813 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1573821 13f79535-47bb-0310-9956-ffa450edef68
2014-03-03 23:51:58 +00:00
Arpit Agarwal 98983b2788 HDFS-6042. Fix rolling upgrade documentation and error messages. (Contributed by szetszwo)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1573785 13f79535-47bb-0310-9956-ffa450edef68
2014-03-03 22:31:17 +00:00
Haohui Mai aa8a6e498a HDFS-6013. add rollingUpgrade information to latest UI. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1573700 13f79535-47bb-0310-9956-ffa450edef68
2014-03-03 19:51:33 +00:00
Haohui Mai 146bf6c01e HDFS-5866. '-maxSize' and '-step' option fail in OfflineImageViewer. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573694 13f79535-47bb-0310-9956-ffa450edef68
2014-03-03 19:40:45 +00:00
Colin McCabe 6465b0b55f add missing file for HDFS-5950
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573434 13f79535-47bb-0310-9956-ffa450edef68
2014-03-03 04:01:26 +00:00
Colin McCabe dd049a2f60 HDFS-5950. The DFSClient and DataNode should use shared memory segments to communicate short-circuit information (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573433 13f79535-47bb-0310-9956-ffa450edef68
2014-03-03 03:58:37 +00:00
Tsz-wo Sze 0a7db7f179 Merge r1569890 through r1573119 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1573120 13f79535-47bb-0310-9956-ffa450edef68
2014-03-01 01:14:38 +00:00
Tsz-wo Sze c69cc31adc HDFS-6034. Use DataNodeLayoutVersion for DN registration check and do not verify layout version if there is a rolling upgrade in progress.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1573119 13f79535-47bb-0310-9956-ffa450edef68
2014-03-01 01:14:02 +00:00
Haohui Mai fec1e2eed9 HDFS-5956. A file size is multiplied by the replication factor in 'hdfs oiv -p FileDistribution' option. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573078 13f79535-47bb-0310-9956-ffa450edef68
2014-02-28 21:07:03 +00:00
Arpit Agarwal 44c5c778f0 HDFS-5821. TestHDFSCLI fails for user names with the dash character. (Contributed by Gera Shegalov)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573076 13f79535-47bb-0310-9956-ffa450edef68
2014-02-28 21:05:16 +00:00
Arpit Agarwal d00605f8f0 HADOOP-10285. Admin interface to swap callqueue at runtime. (Contributed by Chris Li)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573052 13f79535-47bb-0310-9956-ffa450edef68
2014-02-28 19:48:31 +00:00
Aaron Myers 8e809b8c81 HDFS-6033. PBImageXmlWriter incorrectly handles processing cache directives. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573050 13f79535-47bb-0310-9956-ffa450edef68
2014-02-28 19:45:37 +00:00
Jing Zhao 3965d65200 Move HDFS-4200 to branch-2.4.0 section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573046 13f79535-47bb-0310-9956-ffa450edef68
2014-02-28 19:42:35 +00:00
Tsz-wo Sze ee663fad14 Merge r1569890 through r1573042 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1573043 13f79535-47bb-0310-9956-ffa450edef68
2014-02-28 19:37:47 +00:00
Tsz-wo Sze 1bab14bb49 HDFS-6031. Add back the "-rollingUpgrade started" namenode startup option; otherwise, namenode cannot start when the layout version is changed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1573040 13f79535-47bb-0310-9956-ffa450edef68
2014-02-28 19:33:08 +00:00
Colin McCabe 2333388e47 HDFS-6030. Remove an unused constructor in INode.java (yzhang via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573031 13f79535-47bb-0310-9956-ffa450edef68
2014-02-28 18:47:31 +00:00
Jing Zhao 5c381ade4e HDFS-5339. WebHDFS URI does not accept logical nameservices when security is enabled. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573026 13f79535-47bb-0310-9956-ffa450edef68
2014-02-28 18:39:01 +00:00
Jing Zhao 5409908026 HDFS-6032. -rollingUpgrade query hits NPE after the NN restarts. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572801 13f79535-47bb-0310-9956-ffa450edef68
2014-02-28 01:23:52 +00:00
Jing Zhao e9a17c8ce0 HDFS-6029. Secondary NN fails to checkpoint after -rollingUpgrade prepare. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572800 13f79535-47bb-0310-9956-ffa450edef68
2014-02-28 01:21:53 +00:00
Chris Nauroth 1fe2bd5534 HDFS-6028. Print clearer error message when user attempts to delete required mask entry from ACL. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572753 13f79535-47bb-0310-9956-ffa450edef68
2014-02-27 22:12:34 +00:00
Tsz-wo Sze 9b81883952 Merge r1569890 through r1572722 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572723 13f79535-47bb-0310-9956-ffa450edef68
2014-02-27 20:39:34 +00:00
Chris Nauroth e5ccaa5d03 HADOOP-10353. FsUrlStreamHandlerFactory is not thread safe. Contributed by Tudor Scurtu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572679 13f79535-47bb-0310-9956-ffa450edef68
2014-02-27 18:53:54 +00:00
Tsz-wo Sze 0369e56989 HDFS-6025. Update findbugsExcludeFile.xml.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572488 13f79535-47bb-0310-9956-ffa450edef68
2014-02-27 09:58:59 +00:00
Jing Zhao e1084736b2 Add TestRollingUpgradeDowngrade.java for HDFS-6024
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572434 13f79535-47bb-0310-9956-ffa450edef68
2014-02-27 05:04:13 +00:00
Tsz-wo Sze 58bccdbc04 Merge r1569890 through r1572417 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572418 13f79535-47bb-0310-9956-ffa450edef68
2014-02-27 03:11:07 +00:00
Tsz-wo Sze 9a114bebd8 HDFS-6026. Fix TestDFSUpgrade and TestDataNodeRollingUpgrade. Contributed by jing9
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572417 13f79535-47bb-0310-9956-ffa450edef68
2014-02-27 03:10:25 +00:00
Jing Zhao aee7b449e2 HDFS-6024. Test whether the NN will reject the downgrade if it has a fsimage from a newer release. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572338 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 23:20:42 +00:00
Jing Zhao ccf0744243 HDFS-6023. Test whether the standby NN continues to checkpoint after the prepare stage. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572337 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 23:17:53 +00:00
Andrew Wang c080fec82b HDFS-3969. Small bug fixes and improvements for disk locations API. Contributed by Todd Lipcon and Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572284 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 21:55:47 +00:00
Tsz-wo Sze 9cc0d5d497 Merge r1569890 through r1572250 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572251 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 20:55:50 +00:00
Chris Nauroth 8542c1f28f HDFS-4685. Move to 2.4.0 in CHANGES.txt in preparation for merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572189 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 18:40:01 +00:00
Jing Zhao 4ba2bdf340 HDFS-6018. Exception recorded in LOG when IPCLoggerChannel#close is called. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572183 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 18:23:10 +00:00
Jing Zhao dedcc09e71 HDFS-6019. Standby NN might not checkpoint when processing the rolling upgrade marker. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572182 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 18:20:53 +00:00
Kihwal Lee c8182ea764 HDFS-6020. Fix the five findbugs warnings. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572165 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 17:07:56 +00:00
Chris Nauroth 5f9cdbd24f HDFS-5936. MiniDFSCluster does not clean data left behind by SecondaryNameNode. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572150 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 16:30:58 +00:00
Chris Nauroth 7be2c002b3 HDFS-5908. Change AclFeature to capture list of ACL entries in an ImmutableList. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572142 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 16:22:56 +00:00
Chris Nauroth 4449247410 HDFS-6008. Namenode dead node link is giving HTTP error 500. Contributed by Benoy Antony.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571881 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 00:25:29 +00:00
Arpit Agarwal 9df1c533dc HDFS-6017. Query the status of rolling upgrade in the preparation stage in TestRollingUpgrade and TestRollingUpgradeRollback. (Contributed by Haohui Mai)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571875 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 00:13:53 +00:00
Jing Zhao e3d2e4c156 HDFS-6000. Avoid saving namespace when starting rolling upgrade. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571840 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 21:58:53 +00:00
Tsz-wo Sze abc9a6dad5 Merge r1569890 through r1571813 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571814 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 20:24:57 +00:00
Chris Nauroth 39c09c43bd HDFS-6006. Remove duplicate code in FSNameSystem#getFileInfo. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571813 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 20:20:21 +00:00
Kihwal Lee fa6e59891c HDFS-5498. Improve datanode startup time. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571797 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 19:27:53 +00:00
Kihwal Lee 57b28693ee HDFS-5924. Utilize OOB upgrade message processing for writes. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571792 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 19:24:15 +00:00
Kihwal Lee 6780b086d8 HDFS-6015. Fix TestBlockRecovery#testRaceBetweenReplicaRecoveryAndFinalizeBlock. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571785 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 18:51:14 +00:00
Kihwal Lee f52fe68a2b HDFS-6014. Fix findbug warnings introduced by HDFS-5583. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571784 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 18:48:30 +00:00
Jing Zhao df6e1ab491 HDFS-5939. WebHdfs returns misleading error code and logs nothing if trying to create a file with no DNs in cluster. Contributed by Yongjun Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571781 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 18:36:46 +00:00
Chris Nauroth 6c9c3144dd HDFS-5623. NameNode: add tests for skipping ACL enforcement when permission checks are disabled, user is superuser or user is member of supergroup. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571745 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 17:02:59 +00:00
Tsz-wo Sze 2c8a6f5712 HDFS-6003. Add the new -rollingUpgrade startup option to the namenode usage message. Contributed by Vinayakumar B
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571596 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 07:50:38 +00:00
Chris Nauroth d5639c85fb HADOOP-10361. Correct alignment in CLI output for ACLs. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571573 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 05:54:51 +00:00
Tsz-wo Sze 98db64dd49 Merge r1569890 through r1571553 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571554 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 03:30:24 +00:00
Arpit Agarwal 440c3cd105 HDFS-5922. DN heartbeat thread can get stuck in tight loop. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571542 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 02:16:29 +00:00
Tsz-wo Sze 0809f32f4b Merge r1569890 through r1571508 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571509 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 01:16:30 +00:00
Tsz-wo Sze 8c4d8058d8 HDFS-5778. Add rolling upgrade user document.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571508 13f79535-47bb-0310-9956-ffa450edef68
2014-02-25 01:14:12 +00:00
Kihwal Lee 1c6b5d2b58 HDFS-5583. Make DN send an OOB Ack on shutdown before restarting. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571491 13f79535-47bb-0310-9956-ffa450edef68
2014-02-24 23:38:04 +00:00
Michael Stack 036af54387 HDFS-5776 Support 'hedged' reads in DFSClient
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571467 13f79535-47bb-0310-9956-ffa450edef68
2014-02-24 22:34:55 +00:00
Michael Stack 17db74a1c1 HDFS-5776 Support 'hedged' reads in DFSClient
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571466 13f79535-47bb-0310-9956-ffa450edef68
2014-02-24 22:34:41 +00:00
Arpit Agarwal c066cef587 HDFS-6004. Change DFSAdmin for rolling upgrade commands. (Contributed by szetszwo)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571463 13f79535-47bb-0310-9956-ffa450edef68
2014-02-24 22:05:07 +00:00
Arpit Agarwal dbf14320c0 HDFS-6005. Simplify Datanode rollback and downgrade. (Contributed by Suresh Srinivas)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571431 13f79535-47bb-0310-9956-ffa450edef68
2014-02-24 20:46:35 +00:00
Jing Zhao 8e7a2b8d5d HDFS-5999. Do not create rollback fsimage when it already exists. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571096 13f79535-47bb-0310-9956-ffa450edef68
2014-02-23 21:35:07 +00:00
Tsz-wo Sze 3f7852bd27 HDFS-5994. Fix TestDataNodeRollingUpgrade. Contributed by Arpit Agarwal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570734 13f79535-47bb-0310-9956-ffa450edef68
2014-02-21 22:40:06 +00:00
Tsz-wo Sze 78325b08c5 Merge r1569890 through r1570692 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570694 13f79535-47bb-0310-9956-ffa450edef68
2014-02-21 20:08:08 +00:00
Tsz-wo Sze 0ad6cdd031 HDFS-5992. Fix NPE in MD5FileUtils and update editsStored for TestOfflineEditsViewer.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570690 13f79535-47bb-0310-9956-ffa450edef68
2014-02-21 20:02:27 +00:00
Jing Zhao c324f3096f HDFS-5935. New Namenode UI FS browser should throw smarter error messages. Cotributed by Travis Thompson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570663 13f79535-47bb-0310-9956-ffa450edef68
2014-02-21 18:57:06 +00:00
Chris Nauroth 4f8a487fcd HDFS-5981. loadGenerator exit code is not reliable. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570468 13f79535-47bb-0310-9956-ffa450edef68
2014-02-21 06:39:08 +00:00
Chris Nauroth 327d2ceca2 HADOOP-10352. Recursive setfacl erroneously attempts to apply default ACL to files. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570466 13f79535-47bb-0310-9956-ffa450edef68
2014-02-21 06:29:52 +00:00
Andrew Wang b00817b54a HDFS-5988. Bad fsimage always generated after upgrade. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570429 13f79535-47bb-0310-9956-ffa450edef68
2014-02-21 02:48:40 +00:00
Jing Zhao 4da6de1ca3 HDFS-5982. Need to update snapshot manager when applying editlog for deleting a snapshottable directory. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570395 13f79535-47bb-0310-9956-ffa450edef68
2014-02-21 00:15:11 +00:00
Tsz-wo Sze 37afb4d683 Merge r1569890 through r1570391 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570392 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 23:47:58 +00:00
Arpit Agarwal 329c705181 HDFS-5987. Fix findbugs warnings in Rolling Upgrade branch. (Contributed by szetszwo)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570389 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 23:21:11 +00:00
Brandon Li 7568e2f193 HDFS-5944. LeaseManager:findLeaseWithPrefixPath can't handle path like /a/b/ and cause SecondaryNameNode failed do checkpoint. Contributed by Yunjiong Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570366 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 22:27:13 +00:00
Kihwal Lee 0b51bdd94f HDFS-5985. SimulatedFSDataset#disableAndPurgeTrashStorage should not throw UnsupportedOperationException. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570363 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 21:57:52 +00:00
Tsz-wo Sze 016d3b8171 HDFS-5984. Fix TestEditLog and TestStandbyCheckpoints. Contributed by jing9
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570361 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 21:42:10 +00:00
Jing Zhao 5a3460cf78 Move HDFS-5768 and HDFS-5775 to Section 2.4.0 in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570302 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 18:54:36 +00:00
Jing Zhao 8b196816d8 HADOOP-10348. Deprecate hadoop.ssl.configuration in branch-2, and remove it in trunk. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570295 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 18:34:24 +00:00
Kihwal Lee b23f6cc1f2 HDFS-5962. Mtime and atime are not persisted for symbolic links. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570252 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 16:09:20 +00:00
Tsz-wo Sze 55aec006f4 Merge r1569890 through r1570083 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570084 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 04:38:30 +00:00
Tsz-wo Sze 2088584864 HDFS-5980. Rollback does not need to load edits. Contributed by jing9
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570078 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 03:57:59 +00:00
Andrew Wang 077adb25b7 HDFS-5979. Typo and logger fix for fsimage PB code. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570070 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 03:25:08 +00:00
Arpit Agarwal e2c0af8e7b HDFS-5742. DatanodeCluster (mini cluster of DNs) fails to start. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570067 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 03:20:29 +00:00
Arpit Agarwal b95294416c HDFS-5483. NN should gracefully handle multiple block replicas on same DN. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570040 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 01:43:12 +00:00
Arpit Agarwal 50a0bedead HDFS-5976. Create unit tests for downgrade and finalize rolling upgrade. (Contributed by Haohui Mai)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570019 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 00:47:15 +00:00
Arpit Agarwal 0cd98fd482 HDFS-5963. Remove empty file TestEditLogUpgradeMarker.java
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569996 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 00:01:03 +00:00
Arpit Agarwal e891c55f8b HDFS-5963. TestRollingUpgrade#testSecondaryNameNode causes subsequent tests to fail. (Contributed by szetszwo)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569993 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 23:56:02 +00:00
Arpit Agarwal 0369aff403 HDFS-5868. Make hsync implementation pluggable. (Contributed by Buddy Taylor)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569978 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 23:38:46 +00:00
Arpit Agarwal 2f341414dd HDFS-5318. Support read-only and read-write paths to shared replicas. (Contributed by Eric Sirianni)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569951 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 22:59:37 +00:00
Colin McCabe 06b504f4a6 HDFS-5973. add DomainSocket#shutdown method. (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569950 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 22:57:32 +00:00
Tsz-wo Sze d69985d90b HDFS-5974. Fix compilation error, NameNodeLayoutVersion and DataNodeLayoutVersion after merge from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569931 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 21:40:42 +00:00
Tsz-wo Sze 72c214c89b Merge r1555021 through r1569889 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569890 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 19:57:36 +00:00
Tsz-wo Sze 377424e36a HDFS-5966. Fix rollback of rolling upgrade in NameNode HA setup. Contributed by jing9
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569885 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 19:41:22 +00:00
Chris Nauroth b2832e8d94 HDFS-4685. Correct minor whitespace difference in FSImageSerialization.java in preparation for trunk merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1569860 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 18:05:27 +00:00
Chris Nauroth 3cee918a36 HDFS-4685. Move attribution to correct section of CHANGES.txt files.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1569854 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 17:49:30 +00:00
Chris Nauroth e472ffd515 HDFS-4685. Move attribution from CHANGES-HDFS-4685.txt to CHANGES.txt in hadoop-common and hadoop-hdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1569841 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 17:33:59 +00:00
Chris Nauroth 909eb7e4f1 Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1569833 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 17:24:02 +00:00
Kihwal Lee 7e8d85ebb3 HDFS-5961. OIV cannot load fsimages containing a symbolic link. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569789 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 15:28:57 +00:00
Colin McCabe e408966ea7 Update change description for HDFS-5953
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569579 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 01:05:38 +00:00
Tsz-wo Sze 99b4caa888 Merge r1555021 through r1569522 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569524 13f79535-47bb-0310-9956-ffa450edef68
2014-02-18 20:42:26 +00:00
Tsz-wo Sze bc962d6df4 HDFS-5945. Add rolling upgrade information to fsimage; and disallow upgrade and rolling upgrade to be started simultaneously. Contributed by szetszwo & jing9
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569515 13f79535-47bb-0310-9956-ffa450edef68
2014-02-18 20:12:17 +00:00
Jing Zhao a845a18c67 HDFS-5893. HftpFileSystem.RangeHeaderUrlOpener uses the default URLConnectionFactory which does not import SSL certificates. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569477 13f79535-47bb-0310-9956-ffa450edef68
2014-02-18 19:06:31 +00:00
Kihwal Lee 62b023c241 HDFS-5803. TestBalancer.testBalancer0 fails. Contributed by Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569391 13f79535-47bb-0310-9956-ffa450edef68
2014-02-18 15:39:59 +00:00
Kihwal Lee 4aa664f677 HDFS-5780. TestRBWBlockInvalidation times out intemittently. Contributed by Mit Desai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569368 13f79535-47bb-0310-9956-ffa450edef68
2014-02-18 14:53:05 +00:00
Arun Murthy 1417803326 Branching for hadoop-2.5 releases.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569185 13f79535-47bb-0310-9956-ffa450edef68
2014-02-18 04:38:51 +00:00
Suresh Srinivas bf5971b86a HDFS-5959. Fix typo at section name in FSImageFormatProtobuf.java. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569156 13f79535-47bb-0310-9956-ffa450edef68
2014-02-18 01:06:44 +00:00
Chris Nauroth beb17701d7 HDFS-4685. Copying HDFS CHANGES.txt from trunk to remove erroneous double entry of HDFS-5698 changes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1569146 13f79535-47bb-0310-9956-ffa450edef68
2014-02-17 23:48:39 +00:00
Chris Nauroth e288316acf Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1569142 13f79535-47bb-0310-9956-ffa450edef68
2014-02-17 23:22:32 +00:00
Chris Nauroth 2c7dfa29bd Fix javadoc in OfflineImageViewer. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569124 13f79535-47bb-0310-9956-ffa450edef68
2014-02-17 22:28:57 +00:00
Arpit Agarwal a04cb17540 HDFS-5698. Update CHANGES.txt to move breakdown of tasks to correct release
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568582 13f79535-47bb-0310-9956-ffa450edef68
2014-02-15 01:29:52 +00:00
Arpit Agarwal 8b63c41891 HDFS-5749. Web UI does not show up during the period of loading FSImage. (Contributed by Haohui Mai)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568578 13f79535-47bb-0310-9956-ffa450edef68
2014-02-15 01:20:19 +00:00
Andrew Wang 3f6a6c88bb HDFS-5953. TestBlockReaderFactory fails in trunk. (Akira Ajisaka via wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568568 13f79535-47bb-0310-9956-ffa450edef68
2014-02-15 00:52:47 +00:00
Jing Zhao 470d4253b2 HDFS-5920. Support rollback of rolling upgrade in NameNode and JournalNodes. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568563 13f79535-47bb-0310-9956-ffa450edef68
2014-02-15 00:28:21 +00:00
Brandon Li ef90940594 HDFS-5716. Allow WebHDFS to use pluggable authentication filter. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568547 13f79535-47bb-0310-9956-ffa450edef68
2014-02-15 00:04:44 +00:00
Brandon Li a0a5edb6f3 HDFS-5949. New Namenode UI when trying to download a file, the browser doesn't know the file name.Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568536 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 22:15:21 +00:00
Arpit Agarwal a57550914f HDFS-5948. TestBackupNode flakes with port in use error. (Contributed by Haohui Mai)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568532 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 21:57:26 +00:00
Arpit Agarwal 8741c3b951 HDFS-5907. Add test cases missed in previous checkin
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568529 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 21:37:16 +00:00
Andrew Wang 04888258b7 HDFS-3128. Unit tests should not use a test root in /tmp. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568526 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 21:29:27 +00:00
Kihwal Lee 9830ef0d32 HDFS-5585. Provide admin commands for data node upgrade. Contributed by Kihwal Lee. (missing file)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568524 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 21:20:34 +00:00
Kihwal Lee 1a68f13521 HDFS-5585. Provide admin commands for data node upgrade. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568523 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 21:20:02 +00:00
Arpit Agarwal a795bc42d0 HDFS-5494. Merge Protobuf-based-FSImage code from trunk - fix build break after merge. (Contributed by Jing Zhao)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568517 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 20:56:24 +00:00
Chris Nauroth d8fd23fc46 Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1568497 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 19:30:52 +00:00
Jing Zhao ba4b10354c Merging r1566359 through r1568420 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568437 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 18:32:37 +00:00
Suresh Srinivas 72f63c8957 HDFS-5943. 'dfs.namenode.https-address' property is not loaded from configuration in federation setup. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568412 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 18:07:04 +00:00
Arpit Agarwal 5df82fa01d HDFS-5907. BlockPoolSliceStorage trash to handle block deletions during rolling upgrade. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568346 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 16:37:42 +00:00
Jing Zhao 84ae8a3ca8 Move Flatten INode hierarchy jiras (HDFS-5531, HDFS-5285, HDFS-5286, HDFS-5537, HDFS-5554, HDFS-5647, HDFS-5632, HDFS-5715, HDFS-5726) to 2.4.0 section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568218 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 08:32:55 +00:00
Brandon Li f4c339a1c5 HDFS-5901
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568168 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 23:53:14 +00:00
Brandon Li 2ccc1daacf HDFS-5934. New Namenode UI back button doesn't work as expected. Contributed by Travis Thompson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568165 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 23:47:11 +00:00
Brandon Li 983f11ba2d HDFS-5913. Nfs3Utils#getWccAttr() should check attr parameter against null. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568076 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 22:41:29 +00:00
Chris Nauroth 934011c2ab Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1568029 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 20:19:53 +00:00
Chris Nauroth 17e48139c2 HADOOP-10344. Fix TestAclCommands after merging HADOOP-10338 patch. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1568026 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 20:17:00 +00:00
Chris Nauroth 8ffd3a91a5 HDFS-5941. add dfs.namenode.secondary.https-address and dfs.namenode.secondary.https-address in hdfs-default.xml. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568019 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 19:53:20 +00:00
Chris Nauroth a49dee06fb Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567994 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 18:21:46 +00:00
Chris Nauroth c17dc01b2e HDFS-5937. Update CHANGES-HDFS-4685.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567992 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 18:12:40 +00:00
Chris Nauroth e291c7905f HDFS-5937. Fix TestOfflineEditsViewer on HDFS-4685 branch. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567986 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 17:52:26 +00:00
Kihwal Lee b0456745f9 HDFS-5904. TestFileStatus fails intermittently. Contributed by Mit Desai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567946 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 15:06:17 +00:00
Tsz-wo Sze a4f152db96 Merge r1555021 through r1566358 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1567874 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 09:53:52 +00:00
Tsz-wo Sze 4f9bbaa301 HDFS-5889. When starting rolling upgrade, create a fs image for rollback so that the standby namenode can create checkpoints during upgrade. Contributed by szetszwo & jing9
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1567861 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 08:04:58 +00:00
Haohui Mai 9ee7c2a077 HDFS-5932. Ls should display the ACL bit. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567850 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 05:51:28 +00:00
Colin McCabe f0d64a078d HDFS-5940. Minor cleanups to ShortCircuitReplica, FsDatasetCache, and DomainSocketWatcher (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567835 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 03:10:48 +00:00
Jing Zhao 2624b20291 HDFS-5847. Consolidate INodeReference into a separate section. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567812 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 00:00:42 +00:00
Brandon Li 256adb2106 HDFS-5891. webhdfs should not try connecting the DN during redirection. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567810 13f79535-47bb-0310-9956-ffa450edef68
2014-02-12 23:57:35 +00:00
Chris Nauroth ea0b21af15 HDFS-5933. Optimize the FSImage layout for ACLs. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567785 13f79535-47bb-0310-9956-ffa450edef68
2014-02-12 22:56:32 +00:00
Chris Nauroth fc14360b03 HDFS-5923. Do not persist the ACL bit in the FsPermission. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567784 13f79535-47bb-0310-9956-ffa450edef68
2014-02-12 22:54:49 +00:00
Colin McCabe b3af8edc26 HDFS-5938. Make BlockReaderFactory#BlockReaderPeer a static class to avoid a findbugs warning (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567767 13f79535-47bb-0310-9956-ffa450edef68
2014-02-12 22:01:53 +00:00
Colin McCabe beb0d25d2a HDFS-5810. Unify mmap cache and short-circuit file descriptor cache (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567720 13f79535-47bb-0310-9956-ffa450edef68
2014-02-12 19:08:52 +00:00
Suresh Srinivas 5efc9978dd HDFS-5879. Some TestHftpFileSystem tests do not close streams. Contributed by Gera Shegalov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567704 13f79535-47bb-0310-9956-ffa450edef68
2014-02-12 18:02:21 +00:00
Konstantin Shvachko fa78a7a99a HDFS-4858. HDFS DataNode to NameNode RPC should timeout. Contributed by Henry Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567535 13f79535-47bb-0310-9956-ffa450edef68
2014-02-12 07:01:29 +00:00
Colin McCabe 53fed66d91 HADOOP-10338. Cannot get the FileStatus of the root inode from the new Globber (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567497 13f79535-47bb-0310-9956-ffa450edef68
2014-02-12 02:12:11 +00:00
Chris Nauroth 6d2a0aa1db HDFS-5925. ACL configuration flag must only reject ACL API calls, not ACLs present in fsimage or edits. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567450 13f79535-47bb-0310-9956-ffa450edef68
2014-02-11 23:13:48 +00:00
Chris Nauroth b0ab36ac01 HDFS-5625. Write end user documentation for HDFS ACLs. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567421 13f79535-47bb-0310-9956-ffa450edef68
2014-02-11 22:18:08 +00:00
Suresh Srinivas 93eafc8590 HDFS-5929. Add blockpool % usage to HDFS federated nn page. Contributed by Siqi Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567411 13f79535-47bb-0310-9956-ffa450edef68
2014-02-11 22:04:15 +00:00
Chris Nauroth dd03cd1336 Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567238 13f79535-47bb-0310-9956-ffa450edef68
2014-02-11 17:55:07 +00:00
Arun Murthy c43c9dd7b5 Preparing to release hadoop-2.3.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567111 13f79535-47bb-0310-9956-ffa450edef68
2014-02-11 13:25:30 +00:00
Chris Nauroth d03acc7560 HDFS-5914. Incorporate ACLs with the changes from HDFS-5698. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566991 13f79535-47bb-0310-9956-ffa450edef68
2014-02-11 06:25:13 +00:00
Chris Nauroth 3bf2f04bac Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566988 13f79535-47bb-0310-9956-ffa450edef68
2014-02-11 06:00:56 +00:00
Aaron Myers 666684eb90 HDFS-5921. Cannot browse file system via NN web UI if any directory has the sticky bit set. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566916 13f79535-47bb-0310-9956-ffa450edef68
2014-02-11 00:46:45 +00:00
Chris Nauroth 5c978a43c3 HDFS-5915. Refactor FSImageFormatProtobuf to simplify cross section reads. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566824 13f79535-47bb-0310-9956-ffa450edef68
2014-02-10 23:13:06 +00:00
Brandon Li c7e265bf26 HDFS-5886. Potential null pointer deference in RpcProgramNfs3#readlink(). Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566468 13f79535-47bb-0310-9956-ffa450edef68
2014-02-09 23:15:48 +00:00
Konstantin Shvachko ff24753aa7 HDFS-4370. Fix typo Blanacer in DataNode. Contributed by Chu Tong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566422 13f79535-47bb-0310-9956-ffa450edef68
2014-02-09 21:07:28 +00:00
Konstantin Shvachko 204704a92d HDFS-5837. dfs.namenode.replication.considerLoad should consider decommissioned nodes. Contributed by Tao Luo.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566410 13f79535-47bb-0310-9956-ffa450edef68
2014-02-09 20:49:18 +00:00
Haohui Mai 2ed075e1bb Merging r1566042 through r1566364 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566375 13f79535-47bb-0310-9956-ffa450edef68
2014-02-09 19:45:00 +00:00
Jing Zhao a2edb11b68 HDFS-5698. Use protobuf to serialize / deserialize FSImage. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566359 13f79535-47bb-0310-9956-ffa450edef68
2014-02-09 19:18:51 +00:00
Chris Nauroth c6505f0499 Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566100 13f79535-47bb-0310-9956-ffa450edef68
2014-02-08 19:05:12 +00:00
Chris Nauroth dd2eb97ddd HDFS-5899. Add configuration flag to disable/enable support for ACLs. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566041 13f79535-47bb-0310-9956-ffa450edef68
2014-02-08 16:20:29 +00:00
Chris Nauroth c89c516b95 HDFS-5616. NameNode: implement default ACL handling. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1565845 13f79535-47bb-0310-9956-ffa450edef68
2014-02-07 23:11:27 +00:00
Andrew Wang 60eca33e83 HDFS-5900. Cannot set cache pool limit of unlimited via CacheAdmin. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565841 13f79535-47bb-0310-9956-ffa450edef68
2014-02-07 22:58:23 +00:00
Colin McCabe d01158a498 HDFS-5882. TestAuditLogs is flaky (jxiang via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565840 13f79535-47bb-0310-9956-ffa450edef68
2014-02-07 22:55:27 +00:00
Brandon Li 300e4906af HDFS-5874. Should not compare DataNode current layout version with that of NameNode in DataStrorage.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1565750 13f79535-47bb-0310-9956-ffa450edef68
2014-02-07 18:25:41 +00:00
Tsz-wo Sze ccf08d9dc8 Merge r1555021 through r1565516 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1565519 13f79535-47bb-0310-9956-ffa450edef68
2014-02-07 02:43:04 +00:00
Tsz-wo Sze c780454413 HDFS-5869. When starting rolling upgrade or NN restarts, NN should create a checkpoint right before the upgrade marker.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1565516 13f79535-47bb-0310-9956-ffa450edef68
2014-02-07 02:08:05 +00:00
Kihwal Lee fe2fb24a61 HDFS-5807. TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails intermittently. Contributed by Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565505 13f79535-47bb-0310-9956-ffa450edef68
2014-02-07 00:43:45 +00:00
Chris Nauroth 12c2582c1f HDFS-5895. HDFS cacheadmin -listPools has exit_code of 1 when the command returns 0 result. Contributed by Tassapol Athiapinya.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565440 13f79535-47bb-0310-9956-ffa450edef68
2014-02-06 21:16:01 +00:00
Colin McCabe e0cda48959 HDFS-4911. Reduce PeerCache timeout to be commensurate with dfs.datanode.socket.reuse.keepalive (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565435 13f79535-47bb-0310-9956-ffa450edef68
2014-02-06 21:08:09 +00:00
Kihwal Lee ab96a0838d HDFS-5881. Fix skip() of the short-circuit local reader(legacy). Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565310 13f79535-47bb-0310-9956-ffa450edef68
2014-02-06 15:45:47 +00:00
Brandon Li b2ce764093 HDFS-5890. Avoid NPE in Datanode heartbeat. Contributed by Vinay
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1565023 13f79535-47bb-0310-9956-ffa450edef68
2014-02-06 00:40:24 +00:00
Jing Zhao d598b6ef9f HDFS-5873. dfs.http.policy should have higher precedence over dfs.https.enable. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564973 13f79535-47bb-0310-9956-ffa450edef68
2014-02-05 22:48:06 +00:00
Jing Zhao 69dbf0b225 HDFS-5876. SecureDataNodeStarter does not pick up configuration in hdfs-site.xml. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564897 13f79535-47bb-0310-9956-ffa450edef68
2014-02-05 19:43:56 +00:00
Andrew Wang dcaaeefeaf Addendum patch for HDFS-5709, add missing license header.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564885 13f79535-47bb-0310-9956-ffa450edef68
2014-02-05 19:17:20 +00:00
Aaron Myers d6bd920bba HDFS-5709. Improve NameNode upgrade with existing reserved paths and path components. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564645 13f79535-47bb-0310-9956-ffa450edef68
2014-02-05 06:48:00 +00:00
Todd Lipcon 747cce814c Correct CHANGES.txt entry for HDFS-5399 (contributed by Jing, not Haohui)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564632 13f79535-47bb-0310-9956-ffa450edef68
2014-02-05 04:20:48 +00:00
Todd Lipcon 0aa09f6d5a HDFS-5399. Revisit SafeModeException and corresponding retry policies. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564629 13f79535-47bb-0310-9956-ffa450edef68
2014-02-05 04:18:31 +00:00
Brandon Li cd1e8d2e34 HDFS-5791. TestHttpsFileSystem should use a random port to avoid binding error during testing. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564198 13f79535-47bb-0310-9956-ffa450edef68
2014-02-04 05:11:11 +00:00
Brandon Li 6439cd0f69 HDFS-5767. NFS implementation assumes userName userId mapping to be unique, which is not true sometimes. Contributed by Yongjun Zhang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564141 13f79535-47bb-0310-9956-ffa450edef68
2014-02-04 00:27:25 +00:00
Junping Du 94b512bc51 HDFS-5828. BlockPlacementPolicyWithNodeGroup can place multiple replicas on the same node group when dfs.namenode.avoid.write.stale.datanode is true. (Buddy via junping_du)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563640 13f79535-47bb-0310-9956-ffa450edef68
2014-02-02 15:39:02 +00:00
Tsz-wo Sze 35e59eeaa2 Merge r1555021 through r1563384 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1563385 13f79535-47bb-0310-9956-ffa450edef68
2014-02-01 09:01:41 +00:00
Tsz-wo Sze 4f92eb2f61 HDFS-5848. Add rolling upgrade status to heartbeat response.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1563384 13f79535-47bb-0310-9956-ffa450edef68
2014-02-01 08:58:55 +00:00
Chris Nauroth 0abf8e58b7 HDFS-5861. Add CLI test for Ls output for extended ACL marker. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563375 13f79535-47bb-0310-9956-ffa450edef68
2014-02-01 05:58:31 +00:00
Chris Nauroth 3fd9f29d56 HDFS-5860. Refactor INodeDirectory getDirectoryXFeature methods to use common getFeature helper method. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563374 13f79535-47bb-0310-9956-ffa450edef68
2014-02-01 05:55:20 +00:00
Colin McCabe 140246bad8 HDFS-5746. Add ShortCircuitSharedMemorySegment (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563362 13f79535-47bb-0310-9956-ffa450edef68
2014-02-01 02:25:33 +00:00
Colin McCabe f6bfe98639 HDFS-5859. DataNode#checkBlockToken should check block tokens even if security is not enabled (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563328 13f79535-47bb-0310-9956-ffa450edef68
2014-01-31 23:08:23 +00:00
Chris Nauroth 9e8cabf8ce Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563327 13f79535-47bb-0310-9956-ffa450edef68
2014-01-31 23:05:23 +00:00
Chris Nauroth fa99a8471d HDFS-5858. Refactor common ACL test cases to be run through multiple FileSystem implementations. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563325 13f79535-47bb-0310-9956-ffa450edef68
2014-01-31 23:02:45 +00:00
Jing Zhao 1f7dd7811a HDFS-5804. HDFS NFS Gateway fails to mount and proxy when using Kerberos. Contributed by Abin Shahab.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563323 13f79535-47bb-0310-9956-ffa450edef68
2014-01-31 23:00:34 +00:00
Chris Nauroth 14f1f76bf6 HDFS-5614. NameNode: implement handling of ACLs in combination with snapshots. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563304 13f79535-47bb-0310-9956-ffa450edef68
2014-01-31 22:21:19 +00:00
Arpit Agarwal 5beeb30169 HDFS-5153. Datanode should send block reports for each storage in a separate message. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563254 13f79535-47bb-0310-9956-ffa450edef68
2014-01-31 21:00:33 +00:00
Chris Nauroth d5f4f76a23 HADOOP-10270. getfacl does not display effective permissions of masked. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563219 13f79535-47bb-0310-9956-ffa450edef68
2014-01-31 18:59:16 +00:00
Chris Nauroth c654c2e8b9 HDFS-5849. Removing ACL from an inode fails if it has only a default ACL. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563205 13f79535-47bb-0310-9956-ffa450edef68
2014-01-31 18:33:56 +00:00
Suresh Srinivas 7039b776c6 HDFS-5856. DataNode.checkDiskError might throw NPE. Contributed by Josh Elser.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563064 13f79535-47bb-0310-9956-ffa450edef68
2014-01-31 05:35:30 +00:00
Tsz-wo Sze f2972402b7 Merge r1555021 through r1563041 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1563042 13f79535-47bb-0310-9956-ffa450edef68
2014-01-31 03:24:24 +00:00
Tsz-wo Sze 00067895a0 HDFS-5754. Split LayoutVerion into NameNodeLayoutVersion and DataNodeLayoutVersion. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1563041 13f79535-47bb-0310-9956-ffa450edef68
2014-01-31 03:21:45 +00:00
Chris Nauroth 7a03dc0482 HDFS-5608. WebHDFS: implement ACL APIs. Contributed by Sachin Jose and Renil Joseph.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563013 13f79535-47bb-0310-9956-ffa450edef68
2014-01-30 23:13:24 +00:00
Todd Lipcon fd2ba4911b HDFS-5790. LeaseManager.findPath is very slow when many leases need recovery. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562970 13f79535-47bb-0310-9956-ffa450edef68
2014-01-30 21:21:15 +00:00
Jing Zhao 3d9ad8e3b6 HDFS-5843. DFSClient.getFileChecksum() throws IOException if checksum is disabled. Contributed by Laurent Goujon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562927 13f79535-47bb-0310-9956-ffa450edef68
2014-01-30 19:15:13 +00:00
Arpit Agarwal 0f3461e489 HDFS-5492. Port HDFS-2069 (Incorrect default trash interval in the docs) to trunk. (Contributed by Akira Ajisaka)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562683 13f79535-47bb-0310-9956-ffa450edef68
2014-01-30 03:26:46 +00:00
Chris Nauroth 10ef8a4b56 Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1562670 13f79535-47bb-0310-9956-ffa450edef68
2014-01-30 01:55:14 +00:00
Chris Nauroth 4b4241c06d HDFS-5702. FsShell Cli: Add XML based End-to-End test for getfacl and setfacl commands. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1562668 13f79535-47bb-0310-9956-ffa450edef68
2014-01-30 01:46:19 +00:00
Andrew Wang 504b0d6f54 Update CHANGES.txt to move HDFS-5842 to 2.3.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562656 13f79535-47bb-0310-9956-ffa450edef68
2014-01-30 00:31:56 +00:00
Andrew Wang 799ad3d670 HDFS-5841. Update HDFS caching documentation with new changes. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562649 13f79535-47bb-0310-9956-ffa450edef68
2014-01-30 00:17:16 +00:00
Andrew Wang c96d078033 HDFS-5845. SecondaryNameNode dies when checkpointing with cache pools.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562644 13f79535-47bb-0310-9956-ffa450edef68
2014-01-29 23:59:21 +00:00
Andrew Wang ed551ff3c6 Update HDFS and Common CHANGES.txt post branch-2.3 reswizzle.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562632 13f79535-47bb-0310-9956-ffa450edef68
2014-01-29 23:17:07 +00:00
Jing Zhao 8c505adddb HDFS-5842. Cannot create hftp filesystem when using a proxy user ugi and a doAs on a secure cluster. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562603 13f79535-47bb-0310-9956-ffa450edef68
2014-01-29 21:53:32 +00:00
Arpit Agarwal d9d8027eb3 HDFS-5844. Fix broken link in WebHDFS.apt.vm (Contributed by Akira Ajisaka)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562357 13f79535-47bb-0310-9956-ffa450edef68
2014-01-29 04:58:13 +00:00
Suresh Srinivas 33a47743a5 HADOOP-10255. Rename HttpServer to HttpServer2 to retain older HttpServer in branch-2 for compatibility. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561959 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 07:32:52 +00:00
Tsz-wo Sze efcdf81ca9 Merge r1555021 through r1561943 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1561944 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 05:37:13 +00:00
Tsz-wo Sze 917502ef31 HDFS-5835. Add a new option for starting Namenode when rolling upgrade is in progress.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1561943 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 05:35:47 +00:00
Arpit Agarwal b8776ee65b HDFS-5833. Fix incorrect javadoc in SecondaryNameNode. (Contributed by Bangtao Zhou)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561938 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 05:09:57 +00:00
Colin McCabe 07c004db06 HDFS-5830. WebHdfsFileSystem.getFileBlockLocations throws IllegalArgumentException when accessing another cluster. (Yongjun Zhang via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561885 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 22:19:30 +00:00
Arpit Agarwal c5286c7737 HDFS-5297. Fix dead links in HDFS site documents. (Contributed by Akira Ajisaka)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561849 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 21:11:53 +00:00
Arpit Agarwal 55407fea25 Fix correct CHANGES.txt for HADOOP-10086 and HADOOP-9982.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561819 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 20:00:38 +00:00
Arpit Agarwal e9f7f3624a HADOOP-9982. Fix dead links in hadoop site docs. (Contributed by Akira Ajisaka)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561813 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 19:51:08 +00:00
Arpit Agarwal 70165d84eb HDFS-5825. Use FileUtils.copyFile() to implement DFSTestUtils.copyFile(). (Contributed by Haohui Mai)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561792 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 19:01:19 +00:00
Jing Zhao 4b61ff2283 HDFS-5781. Use an array to record the mapping between FSEditLogOpCode and the corresponding byte value. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561788 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 18:53:39 +00:00
Arpit Agarwal 0be0174669 HADOOP-10086. User document for authentication in secure cluster. (Contributed by Masatake Iwasaki)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561776 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 18:32:52 +00:00
Chris Nauroth ad240d6b3a Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1561771 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 18:09:22 +00:00
Chris Nauroth b98b344b9a HADOOP-10277. setfacl -x fails to parse ACL spec if trying to remove the mask entry. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1561769 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 18:03:30 +00:00
Tsz-wo Sze a9110e1788 Merge r1555021 through r1561510 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1561516 13f79535-47bb-0310-9956-ffa450edef68
2014-01-26 16:34:30 +00:00
Todd Lipcon edb6dc5f30 HDFS-5138. Support HDFS upgrade in HA. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561381 13f79535-47bb-0310-9956-ffa450edef68
2014-01-25 20:01:26 +00:00
Uma Maheswara Rao G befb254e61 HDFS-5343. When cat command is issued on snapshot files, getting unexpected result. Contributed by Sathish.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561325 13f79535-47bb-0310-9956-ffa450edef68
2014-01-25 15:50:42 +00:00
Kihwal Lee dd1bc7e1c7 HDFS-5728. Block recovery will fail if the metafile does not have crc for all chunks of the block. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561223 13f79535-47bb-0310-9956-ffa450edef68
2014-01-24 22:56:05 +00:00
Chris Nauroth 738b076cc6 Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1560768 13f79535-47bb-0310-9956-ffa450edef68
2014-01-23 17:49:24 +00:00
Chris Nauroth cd7cd94e3f HDFS-5799. Make audit logging consistent across ACL APIs. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1560766 13f79535-47bb-0310-9956-ffa450edef68
2014-01-23 17:41:53 +00:00
Daryn Sharp a4e66e09e9 HDFS-5241. Provide alternate queuing audit logger to reduce logging contention (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560761 13f79535-47bb-0310-9956-ffa450edef68
2014-01-23 17:15:27 +00:00
Kihwal Lee ff43021946 HDFS-5788. listLocatedStatus response can be very large. Contributed by Nathan Roberts.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560750 13f79535-47bb-0310-9956-ffa450edef68
2014-01-23 17:01:30 +00:00
Uma Maheswara Rao G 824dcdbd42 HDFS-5789. Some of snapshot APIs missing checkOperation double check in fsn. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560731 13f79535-47bb-0310-9956-ffa450edef68
2014-01-23 16:35:05 +00:00
Andrew Wang 1c602f7198 HDFS-5806. Balancer should set soTimeout to avoid indefinite hangs. Contributed by Nathan Roberts.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560548 13f79535-47bb-0310-9956-ffa450edef68
2014-01-22 22:33:00 +00:00
Andrew Wang 2de391de9f Move HDFS-4949 subtasks in CHANGES.txt to a new section under 2.4.0 release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560528 13f79535-47bb-0310-9956-ffa450edef68
2014-01-22 21:52:56 +00:00
Alejandro Abdelnur 5e09ae1633 HDFS-5703. Add support for HTTPS and swebhdfs to HttpFS. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560504 13f79535-47bb-0310-9956-ffa450edef68
2014-01-22 20:38:24 +00:00
Arpit Agarwal 83280a45de HDFS-5434. Change block placement policy constructors from package private to protected. (Buddy Taylor via Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560217 13f79535-47bb-0310-9956-ffa450edef68
2014-01-21 23:11:15 +00:00
Brandon Li cc7cc5a4d9 HDFS-5748. Too much information shown in the dfs health page. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560215 13f79535-47bb-0310-9956-ffa450edef68
2014-01-21 22:55:35 +00:00
Haohui Mai 21a5bc7f2c HADOOP-10241. Clean up output of FsShell getfacl. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1560194 13f79535-47bb-0310-9956-ffa450edef68
2014-01-21 21:20:39 +00:00
Haohui Mai 2af05fb1cf HDFS-5615. NameNode: implement handling of ACLs in combination with sticky bit. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1560131 13f79535-47bb-0310-9956-ffa450edef68
2014-01-21 18:33:02 +00:00
Tsz-wo Sze d8bc523754 HDFS-5753. Add new NN startup options for downgrade and rollback using upgrade marker.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1559907 13f79535-47bb-0310-9956-ffa450edef68
2014-01-21 02:38:46 +00:00
Haohui Mai 9df33876ff HDFS-5613. NameNode: implement handling of ACLs in combination with symlinks. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559804 13f79535-47bb-0310-9956-ffa450edef68
2014-01-20 18:47:30 +00:00
Chris Nauroth 2fbe8235dc Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559794 13f79535-47bb-0310-9956-ffa450edef68
2014-01-20 18:02:27 +00:00
Chris Nauroth cae96dfe6e HADOOP-10213. Fix bugs parsing ACL spec in FsShell setfacl. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559793 13f79535-47bb-0310-9956-ffa450edef68
2014-01-20 18:00:06 +00:00
Tsz-wo Sze 602f71a8da HDFS-5800. Fix a typo in DFSClient.renewLease(). Contributed by Kousuke Saruta
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1559701 13f79535-47bb-0310-9956-ffa450edef68
2014-01-20 14:08:00 +00:00
Chris Nauroth 8a9a6dbd7e Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559324 13f79535-47bb-0310-9956-ffa450edef68
2014-01-18 06:50:19 +00:00
Tsz-wo Sze 1025121874 Merge r1555021 through r1559304 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1559305 13f79535-47bb-0310-9956-ffa450edef68
2014-01-18 02:24:38 +00:00
Tsz-wo Sze 09b8ce5b44 HDFS-5786. Support QUERY and FINALIZE actions of rolling upgrade.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1559304 13f79535-47bb-0310-9956-ffa450edef68
2014-01-18 02:07:09 +00:00
Haohui Mai 6a52febfbd HDFS-5612. NameNode: change all permission checks to enforce ACLs in addition to permissions. Contributued by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559281 13f79535-47bb-0310-9956-ffa450edef68
2014-01-17 23:28:45 +00:00
Haohui Mai 5300294fbe HDFS-5758. NameNode: complete implementation of inode modifications for ACLs. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559267 13f79535-47bb-0310-9956-ffa450edef68
2014-01-17 22:05:47 +00:00
Jing Zhao ebb9a704bd Move HDFS-5704 and HDFS-5777 to the correct section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1559210 13f79535-47bb-0310-9956-ffa450edef68
2014-01-17 18:29:38 +00:00
Jing Zhao fb01200153 HDFS-5794. Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1559209 13f79535-47bb-0310-9956-ffa450edef68
2014-01-17 18:18:36 +00:00
Colin McCabe a7ec44d41b HDFS-5784. Reserve space in edit log header and fsimage header for feature flag section (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558974 13f79535-47bb-0310-9956-ffa450edef68
2014-01-17 01:32:05 +00:00
Jing Zhao e02ded811f HDFS-5777. Update LayoutVersion for the new editlog op OP_ADD_BLOCK. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558675 13f79535-47bb-0310-9956-ffa450edef68
2014-01-16 02:28:10 +00:00
Brandon Li a506df8e48 HDFS-5775. Consolidate the code for serialization in CacheManager. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558599 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 23:15:24 +00:00
Brandon Li ca5d73d1ab HDFS-5768. Consolidate the serialization code in DelegationTokenSecretManager. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558598 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 23:11:01 +00:00
Colin McCabe c3b236ce5d HDFS-5766. In DFSInputStream, do not add datanode to deadNodes after InvalidEncryptionKeyException in fetchBlockByteRange (Liang Xie via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558536 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 19:23:31 +00:00
Colin McCabe 037a89abc5 HDFS-5762. BlockReaderLocal does not return -1 on EOF when doing zero-length reads (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558526 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 19:17:50 +00:00
Tsz-wo Sze 4a1abe5a3d Merge r1555021 through r1558254 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1558303 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 06:06:31 +00:00
Tsz-wo Sze 5fe73a986e HDFS-5752. Add a new DFSAdmin command to query, start and finalize rolling upgrade.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1558299 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 05:56:17 +00:00
Jing Zhao 578dae9ef3 HDFS-5704. Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558255 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 01:06:53 +00:00
Konstantin Boudnik 4b16c2b65e HDFS-5677. Need error checking for HA cluster configuration. Contributed by Vincent Sheffer.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558217 13f79535-47bb-0310-9956-ffa450edef68
2014-01-14 21:59:51 +00:00
Konstantin Boudnik 0b6a236258 Adding 2.0.6-alpha release to the CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558215 13f79535-47bb-0310-9956-ffa450edef68
2014-01-14 21:49:59 +00:00
Jing Zhao e210519d32 HDFS-5579. Under construction files make DataNode decommission take very long hours. Contributed by zhaoyunjiong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557904 13f79535-47bb-0310-9956-ffa450edef68
2014-01-14 02:02:15 +00:00
Jing Zhao e06ae2d567 HDFS-5710. FSDirectory#getFullPathName should check inodes against null. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557803 13f79535-47bb-0310-9956-ffa450edef68
2014-01-13 18:37:56 +00:00
Chris Nauroth c90211af7a Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1557294 13f79535-47bb-0310-9956-ffa450edef68
2014-01-11 00:37:23 +00:00
Chris Nauroth f065f58292 HADOOP-10220. Add ACL indicator bit to FsPermission. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1557293 13f79535-47bb-0310-9956-ffa450edef68
2014-01-11 00:36:00 +00:00
Arpit Agarwal 9d382a4174 HDFS-5747. Fix NPEs in BlockManager. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557289 13f79535-47bb-0310-9956-ffa450edef68
2014-01-11 00:05:55 +00:00
Andrew Wang 7354547a02 HDFS-5756. hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557244 13f79535-47bb-0310-9956-ffa450edef68
2014-01-10 20:10:44 +00:00
Tsz-wo Sze 1c7aa44d62 Merge r1555021 through r1557038 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1557039 13f79535-47bb-0310-9956-ffa450edef68
2014-01-10 06:07:24 +00:00
Tsz-wo Sze 4563ba08e7 HDFS-5645. Support upgrade marker in editlog streams.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1557038 13f79535-47bb-0310-9956-ffa450edef68
2014-01-10 06:06:10 +00:00
Kihwal Lee b4d6c5823b HDFS-5449. WebHdfs compatibility broken between 2.2 and 1.x / 23.x. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556927 13f79535-47bb-0310-9956-ffa450edef68
2014-01-09 19:24:07 +00:00
Junping Du 7186000367 HDFS-5721. sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns. (Ted Yu via junping_du)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556803 13f79535-47bb-0310-9956-ffa450edef68
2014-01-09 13:33:08 +00:00
Chris Nauroth 17ab35314f Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556665 13f79535-47bb-0310-9956-ffa450edef68
2014-01-08 23:10:02 +00:00
Chris Nauroth 21d4167179 HDFS-5739. ACL RPC must allow null name or unspecified permissions in ACL entries. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556663 13f79535-47bb-0310-9956-ffa450edef68
2014-01-08 22:47:57 +00:00
Chris Nauroth 023c11ec7e HDFS-5737. Replacing only the default ACL can fail to copy unspecified base entries from the access ACL. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556652 13f79535-47bb-0310-9956-ffa450edef68
2014-01-08 22:02:53 +00:00
Tsz-wo Sze f3ee35ab28 Merge r1555021 through r1556550 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1556552 13f79535-47bb-0310-9956-ffa450edef68
2014-01-08 14:36:09 +00:00
Jing Zhao 076ecf79ca HDFS-5726. Fix compilation error in AbstractINodeDiff for JDK7. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556433 13f79535-47bb-0310-9956-ffa450edef68
2014-01-08 03:19:41 +00:00
Brandon Li 1be8ee2424 HDFS-5649. Unregister NFS and Mount service when NFS gateway is shutting down. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556405 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 23:43:04 +00:00
Colin McCabe 53b27fc60b HDFS-5724. modifyCacheDirective logging audit log command wrongly as addCacheDirective (Uma Maheswara Rao G via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556386 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 22:27:06 +00:00
Jing Zhao 70cff9e2f0 HDFS-5715. Use Snapshot ID to indicate the corresponding Snapshot for a FileDiff/DirectoryDiff. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556353 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 20:52:48 +00:00
Chris Nauroth 2fbb3d694e Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556097 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 01:07:33 +00:00
Chris Nauroth c658567571 HDFS-5673. Implement logic for modification of ACLs. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556090 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 00:47:49 +00:00
Arpit Agarwal 5241aa4cdd HDFS-2832. Update CHANGES.txt to reflect merge to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556088 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 00:40:59 +00:00
Brandon Li bfd227bf09 HDFS-5719. FSImage#doRollback() should close prevState before return. Contributed by Ted Yu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556057 13f79535-47bb-0310-9956-ffa450edef68
2014-01-06 22:58:18 +00:00
Colin McCabe 8deb7a6057 HDFS-5589. Namenode loops caching and uncaching when data should be uncached. (awang via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555996 13f79535-47bb-0310-9956-ffa450edef68
2014-01-06 19:45:02 +00:00
Colin McCabe 2a1ecd00da HDFS-5220. Expose group resolution time as metric (jxiang via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555976 13f79535-47bb-0310-9956-ffa450edef68
2014-01-06 18:59:10 +00:00
Arpit Agarwal 410f3a9f60 HDFS-5667. Add test missed in previous checkin
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555956 13f79535-47bb-0310-9956-ffa450edef68
2014-01-06 18:14:05 +00:00
Arpit Agarwal f8a9329f2b HDFS-5667. Include DatanodeStorage in StorageReport. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555929 13f79535-47bb-0310-9956-ffa450edef68
2014-01-06 17:28:23 +00:00
Brandon Li b80343a55f HDFS-5705. TestSecondaryNameNodeUpgrade#testChangeNsIDFails may fail due to ConcurrentModificationException. Contributed by Ted Yu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555190 13f79535-47bb-0310-9956-ffa450edef68
2014-01-03 18:29:44 +00:00
Jing Zhao 71e6ea4be1 HDFS-5695. Clean up TestOfflineEditsViewer and OfflineEditsViewerHelper. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555164 13f79535-47bb-0310-9956-ffa450edef68
2014-01-03 17:36:16 +00:00
Tsz-wo Sze 551034d238 add CHANGES_HDFS-5535.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1555023 13f79535-47bb-0310-9956-ffa450edef68
2014-01-03 07:34:41 +00:00
Tsz-wo Sze 498f9674ff Merge r1550130 through r1555020 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1555021 13f79535-47bb-0310-9956-ffa450edef68
2014-01-03 07:26:52 +00:00
Andrew Wang d85c017d04 HDFS-5651. Remove dfs.namenode.caching.enabled and improve CRM locking. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555002 13f79535-47bb-0310-9956-ffa450edef68
2014-01-03 02:45:53 +00:00
Andrew Wang b4eb963c3c HDFS-5659. dfsadmin -report doesn't output cache information properly. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554893 13f79535-47bb-0310-9956-ffa450edef68
2014-01-02 20:11:41 +00:00
Andrew Wang 07e4fb1455 HDFS-5708. The CacheManager throws a NPE in the DataNode logs when processing cache reports that refer to a block not known to the BlockManager. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554594 13f79535-47bb-0310-9956-ffa450edef68
2014-01-01 00:01:12 +00:00
Uma Maheswara Rao G 97e881b955 HDFS-5671. Fix socket leak in DFSInputStream#getBlockReader. Contributed by JamesLi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554553 13f79535-47bb-0310-9956-ffa450edef68
2013-12-31 16:24:02 +00:00
Andrew Wang 7f86c8114e HDFS-5701. Fix the CacheAdmin -addPool -maxTtl option name. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554305 13f79535-47bb-0310-9956-ffa450edef68
2013-12-30 20:02:36 +00:00
Colin McCabe e596f17734 HDFS-5582. hdfs getconf -excludeFile or -includeFile always failed (satish via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554295 13f79535-47bb-0310-9956-ffa450edef68
2013-12-30 19:35:43 +00:00
Andrew Wang c179d58eee Add updated editsStored files missing from initial HDFS-5636 commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554293 13f79535-47bb-0310-9956-ffa450edef68
2013-12-30 19:02:08 +00:00
Konstantin Shvachko 5a54b91df9 HDFS-5675. Add Mkdirs operation to NNThroughputBenchmark. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554071 13f79535-47bb-0310-9956-ffa450edef68
2013-12-29 21:22:04 +00:00
Chris Nauroth 29dac1d629 HADOOP-10192. FileSystem#getAclStatus has incorrect JavaDocs. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1553737 13f79535-47bb-0310-9956-ffa450edef68
2013-12-27 21:00:21 +00:00
Chris Nauroth abe13d6ffb HADOOP-10187. add getfacl and setfacl with minimal support for getting and setting ACLs. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1553735 13f79535-47bb-0310-9956-ffa450edef68
2013-12-27 20:41:16 +00:00
Chris Nauroth 839512aab7 Update CHANGES-HDFS-4685.txt for several issues that have been converted to Hadoop Common sub-tasks of HADOOP-10184.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1553602 13f79535-47bb-0310-9956-ffa450edef68
2013-12-26 23:09:17 +00:00
Chris Nauroth eaa5321619 Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1553226 13f79535-47bb-0310-9956-ffa450edef68
2013-12-23 22:19:12 +00:00
Chris Nauroth c3b56ed1c8 HDFS-5619. NameNode: record ACL modifications to edit log. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1553224 13f79535-47bb-0310-9956-ffa450edef68
2013-12-23 22:12:45 +00:00
Chris Nauroth 25e9d2e895 HDFS-5618. NameNode: persist ACLs in fsimage. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1553221 13f79535-47bb-0310-9956-ffa450edef68
2013-12-23 21:45:03 +00:00
Jing Zhao e8de319789 HDFS-5690. DataNode fails to start in secure mode when dfs.http.policy equals to HTTP_ONLY. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1553167 13f79535-47bb-0310-9956-ffa450edef68
2013-12-23 18:23:43 +00:00
Colin McCabe b9ae3087c0 HDFS-5636. Enforce a max TTL per cache pool (awang via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552841 13f79535-47bb-0310-9956-ffa450edef68
2013-12-20 23:27:20 +00:00
Arpit Agarwal 86e5db39ba HDFS-2933. Fix incorrect target version in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552837 13f79535-47bb-0310-9956-ffa450edef68
2013-12-20 23:02:04 +00:00
Suresh Srinivas 17a3d72d3b HDFS-5691. Fix typo in ShortCircuitLocalRead document. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552802 13f79535-47bb-0310-9956-ffa450edef68
2013-12-20 20:07:46 +00:00
Kihwal Lee 04d139e2a0 HDFS-5681. renewLease should not hold fsn write lock. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552711 13f79535-47bb-0310-9956-ffa450edef68
2013-12-20 16:05:03 +00:00
Chris Nauroth 72b0b1881f Merge trunk to HDFS-4685.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1552467 13f79535-47bb-0310-9956-ffa450edef68
2013-12-20 01:01:18 +00:00
Chris Nauroth c552d5d72e HDFS-5685. Implement ACL as a INode feature. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1552465 13f79535-47bb-0310-9956-ffa450edef68
2013-12-20 00:48:24 +00:00
Andrew Wang c7153e182a HDFS-5679. TestCacheDirectives should handle the case where native code is not available. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552461 13f79535-47bb-0310-9956-ffa450edef68
2013-12-20 00:00:45 +00:00
Junping Du 42e7446add HDFS-5540. Fix intermittent failure in TestBlocksWithNotEnoughRacks. (Binglin Chang via junping_du)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552256 13f79535-47bb-0310-9956-ffa450edef68
2013-12-19 09:21:19 +00:00
Michael Stack d4e1081566 HDFS-5663 make the retry time and interval value configurable in openInfo()
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552237 13f79535-47bb-0310-9956-ffa450edef68
2013-12-19 06:15:09 +00:00
Michael Stack b0947f9305 HDFS-5663 make the retry time and interval value configurable in openInfo()
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552232 13f79535-47bb-0310-9956-ffa450edef68
2013-12-19 05:21:46 +00:00
Jing Zhao a9d80ae59d HDFS-5661. Browsing FileSystem via web ui, should use datanode's fqdn instead of ip address. Contributed by Benoy Antony.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552177 13f79535-47bb-0310-9956-ffa450edef68
2013-12-19 00:27:16 +00:00
Colin McCabe 90122f25e1 HDFS-5676. fix inconsistent synchronization of CachingStrategy (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552162 13f79535-47bb-0310-9956-ffa450edef68
2013-12-18 23:29:05 +00:00
Brandon Li fc966461e0 HDFS-5662. Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552131 13f79535-47bb-0310-9956-ffa450edef68
2013-12-18 22:26:33 +00:00
Jing Zhao 788fca4124 HDFS-5496. Make replication queue initialization asynchronous. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1552109 13f79535-47bb-0310-9956-ffa450edef68
2013-12-18 21:30:37 +00:00
Tsz-wo Sze 504bd0bca3 HDFS-5674. Editlog code cleanup: remove @SuppressWarnings("deprecation") in FSEditLogOp; change FSEditLogOpCodes.fromByte(..) to be more efficient; and change Some fields in FSEditLog to final.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551812 13f79535-47bb-0310-9956-ffa450edef68
2013-12-18 02:46:00 +00:00
Jing Zhao 7f53e90fd1 Move HDFS-5538, HDFS-5545, HDFS-5536, HDFS-5312, and HDFS-5629 from trunk to 2.4.0 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551724 13f79535-47bb-0310-9956-ffa450edef68
2013-12-17 21:36:30 +00:00
Colin McCabe 124e507674 HDFS-5634. Allow BlockReaderLocal to switch between checksumming and not (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551701 13f79535-47bb-0310-9956-ffa450edef68
2013-12-17 20:57:00 +00:00
Brandon Li 5792d59da3 HDFS-5657. race condition causes writeback state error in NFS gateway. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551691 13f79535-47bb-0310-9956-ffa450edef68
2013-12-17 20:40:15 +00:00
Colin McCabe 991c453ca3 HDFS-5431. Support cachepool-based limit management in path-based caching. (awang via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551651 13f79535-47bb-0310-9956-ffa450edef68
2013-12-17 18:47:04 +00:00
Andrew Wang 0fc2929d13 HDFS-5350. Name Node should report fsimage transfer time as a metric. Contributed by Jimmy Xiang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551415 13f79535-47bb-0310-9956-ffa450edef68
2013-12-17 00:30:06 +00:00