6554994fab
Reverted
...
Merged revision(s) 1617784 from hadoop/common/trunk:
HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.)
........
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617794 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 18:36:51 +00:00
471b1368e2
HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617784 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 18:06:33 +00:00
03d8ff496a
HDFS-6567. Normalize the order of public final in HdfsFileStatus. Contributed by Tassapol Athiapinya.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617779 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 17:45:47 +00:00
a72fba5853
HDFS-6836. HDFS INFO logging is verbose & uses file appenders. (Contributed by Xiaoyu Yao)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617603 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 21:49:48 +00:00
662c5bb3af
HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617598 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 21:42:21 +00:00
04884cd530
Merging r1616894 through r1617376 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1617377 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 22:27:50 +00:00
b760f20af1
HDFS-6582. Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler). Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617366 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 21:34:02 +00:00
80691b073f
HDFS-6838. Code cleanup for unnecessary INode replacement. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617361 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 21:28:33 +00:00
e60673697d
HDFS-6837. Code cleanup for Balancer and Dispatcher. Contributed by Tsz Wo Nicholas Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617337 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 18:01:14 +00:00
9d5f8fa68d
Merging r1616428 through r1616893 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1616897 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 22:21:35 +00:00
c3cf331dc9
HDFS-6828. Separate block replica dispatching from Balancer. Contributed by Tsz Wo Nicholas Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616889 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 21:33:57 +00:00
05d1bf4157
HDFS-6830. Revert accidental checkin
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616884 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 21:22:48 +00:00
a70c9de3f1
HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616883 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 21:20:19 +00:00
a42231d19b
HDFS-6823. dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616846 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 18:24:10 +00:00
70d453602c
HDFS-573. Porting libhdfs to Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616814 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 16:26:45 +00:00
d3a2fe2807
HDFS-6772. Get DN storages out of blockContentsStale state faster after NN restarts. (Contributed by Ming Ma)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616680 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 05:41:38 +00:00
2ac640ec75
HDFS-6722. Display readable last contact time for dead nodes on NN webUI. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616669 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 04:27:47 +00:00
d758be1f35
HDFS-6740. Make FSDataset support adding data volumes dynamically. Contributed by Lei Xu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616623 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 22:59:59 +00:00
eca80dca3e
HDFS-6728. Dynamically add new volumes to DataStorage, formatted if necessary. Contributed by Lei Xu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616615 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 22:46:51 +00:00
b98400df7b
HDFS-6781. Separate HDFS commands from CommandsManual.apt.vm. (Contributed by Akira Ajisaka)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616575 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 19:42:09 +00:00
b50cb5e056
Merge r1609845 through r1616427 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1616428 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 07:38:23 +00:00
0ed8732fee
HDFS-6812. Remove addBlock and replaceBlock from DatanodeDescriptor.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616426 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 07:30:53 +00:00
83b9933db3
HDFS-6809. Move Balancer's inner classes MovedBlocks and Matcher as to standalone classes and separates KeyManager from NameNodeConnector.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616422 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 07:18:48 +00:00
efc73a0f13
HDFS-6791. A block could remain under replicated if all of its replicas are on decommissioned nodes. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616306 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 19:03:07 +00:00
d7a57c27c6
HDFS-6517. Remove hadoop-metrics2.properties from hdfs project (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616261 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 16:06:13 +00:00
812ac91add
HDFS-6790. DFSUtil Should Use configuration.getPassword for SSL passwords. Contributed by Larry McCay
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616058 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 00:50:07 +00:00
4869fa2cfa
Edit CHANGES.txt files to move HADOOP-10759 and HDFS-6717 from 2.5.0 to 2.6.0
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616036 13f79535-47bb-0310-9956-ffa450edef68
2014-08-05 22:47:46 +00:00
c9aa747437
HDFS-6451. NFS should not return NFS3ERR_IO for AccessControlException. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615702 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 17:40:02 +00:00
431857d09d
HDFS-6787. Remove duplicate code in FSDirectory#unprotectedConcat. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615622 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 15:44:44 +00:00
33518e5613
HDFS-5185. DN fails to startup if one of the data dir is full. Contributed by Vinayakumar B.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615504 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 08:43:51 +00:00
30a9ec26f7
HDFS-5723. Append failed FINALIZED replica should not be accepted as valid when that block is underconstruction. Contributed by Vinayakumar B.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615491 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 06:44:06 +00:00
bcf7ab1d0f
HDFS-6810. StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports. (Contributed by szetszwo)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615381 13f79535-47bb-0310-9956-ffa450edef68
2014-08-03 02:08:32 +00:00
1ba3f89714
HDFS-6482. Use block ID-based block layout on datanodes (James Thomas via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615223 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 20:41:05 +00:00
07860b1c9e
HDFS-6788. Improve synchronization in BPOfferService with read write lock. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615190 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 18:56:06 +00:00
da2ce46fbe
HDFS-6802. Some tests in TestDFSClientFailover are missing @Test annotation. Contributed by Akira Ajisaka.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615183 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 17:58:14 +00:00
45db4d204b
HDFS-6794. Update BlockManager methods to use DatanodeStorageInfo where possible. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615169 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 16:58:06 +00:00
7e12b1912f
HDFS-6796. Improve the argument check during balancer command line parsing. Contributed by Benoy Antony
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615107 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 14:12:35 +00:00
397c882362
HDFS-6798. Add test case for incorrect data node condition during balancing. (Contributed by Benoy Antony)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615044 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 07:12:39 +00:00
dc7744d2e5
Merge r1609845 through r1615019 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1615020 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 01:29:49 +00:00
8bca3c689a
HDFS-3482. Update CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615019 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 01:16:06 +00:00
b5b862e3af
HDFS-6797. DataNode logs wrong layoutversion during upgrade. (Contributed by Benoy Antony)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615017 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 01:13:42 +00:00
b8597e6a10
HDFS-6685. Balancer should preserve storage type of replicas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615015 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 01:05:33 +00:00
b8b8f3f5e7
HDFS-6441. Add ability to exclude/include specific datanodes while balancing. (Contributed by Benoy Antony and Yu Li)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614812 13f79535-47bb-0310-9956-ffa450edef68
2014-07-31 06:02:46 +00:00
18360e71f1
HDFS-6768. Fix a few unit tests that use hard-coded port numbers. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614732 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 18:37:41 +00:00
535fe14ded
HDFS-6570. add api that enables checking if a user has certain permissions on a file. Contributed by Jitendra Pandey.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614723 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 17:49:09 +00:00
f6436c0720
HDFS-4629. Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614663 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 14:05:59 +00:00
09e7ff05df
HDFS-6778. The extended attributes javadoc should simply refer to the user docs. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614547 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 05:57:55 +00:00
12241908ad
HDFS-6665. Add tests for XAttrs in combination with viewfs. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614545 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 05:53:20 +00:00
10d6210322
Merge r1609845 through r1614231 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1614234 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 00:49:14 +00:00
4f9ffc7455
HDFS-6739. Add getDatanodeStorageReport to ClientProtocol.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614215 13f79535-47bb-0310-9956-ffa450edef68
2014-07-28 23:43:39 +00:00
f49c2a1b62
HDFS-6717. JIRA HDFS-5804 breaks default nfs-gateway behavior for unsecured config. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614125 13f79535-47bb-0310-9956-ffa450edef68
2014-07-28 18:53:47 +00:00
9bce3eca42
HDFS-6749. FSNamesystem methods should call resolvePath. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613561 13f79535-47bb-0310-9956-ffa450edef68
2014-07-26 04:18:28 +00:00
e85a3fecc6
HDFS-6750. The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as stale (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613537 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 23:56:47 +00:00
57d8f829d9
HDFS-6755. There is an unnecessary sleep in the code path where DFSOutputStream#close gives up its attempt to contact the namenode (mitdesai21 via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613522 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 22:12:37 +00:00
79d214121b
Fix up HDFS CHANGES.txt for 2.5.0
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613494 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 19:02:19 +00:00
cc0464f4fe
HDFS-6752. Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit (vinayakumarb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613486 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 18:17:50 +00:00
2bb650146d
HDFS-5919. FileJournalManager doesn't purge empty and corrupt inprogress edits files (vinayakumarb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613355 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 07:02:53 +00:00
e171254d56
Name node cannot start if the path of a file under construction contains .snapshot. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613329 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 23:42:06 +00:00
8c6e172a0a
HDFS-6715. Webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613237 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 18:28:00 +00:00
a7855e1c33
HDFS-6723. New NN webUI no longer displays decommissioned state for dead node. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613220 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 17:59:45 +00:00
ef9b6a45c4
HDFS-6657. Remove link to 'Legacy UI' in trunk's Namenode UI. Contributed by Vinayakumar B.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613195 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 17:28:31 +00:00
2a5f1029a5
HDFS-6455. NFS: Exception should be added in NFS log for invalid separator in nfs.exports.allowed.hosts. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612947 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 21:22:50 +00:00
a6b1d2a85c
HDFS-6114. Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.curr (vinayakumarb via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612943 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 20:59:39 +00:00
5343b43fd9
HDFS-6422. getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist. (Charles Lamb via umamahesh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612922 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 19:05:11 +00:00
48dc486672
Merge r1609845 through r1612880 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612883 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 17:30:06 +00:00
ac5e8aed7c
HDFS-6686. Change BlockPlacementPolicy to use fallback when some storage types are unavailable.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612880 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 17:25:06 +00:00
853ed29f2d
HDFS-6731. Run 'hdfs zkfc -formatZK' on a server in a non-namenode will cause a null pointer exception. Contributed by Masatake Iwasaki
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612715 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 22:29:04 +00:00
c5686addb1
HDFS-6703. NFS: Files can be deleted from a read-only mount. Contributed by Srikanth Upputuri
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612702 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 20:53:50 +00:00
fee737eced
HDFS-6712. Document HDFS Multihoming Settings. (Contributed by Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612695 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 20:28:57 +00:00
c83c5b868e
HDFS-6701. Make seed optional in NetworkTopology#sortByDistance. Contributed by Ashwin Shankar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612625 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 17:47:49 +00:00
0c72ca9e7a
HDFS-6704. Fix the command to launch JournalNode in HDFS-HA document. Contributed by Akira AJISAKA.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612613 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 17:10:43 +00:00
ee13f8bf3e
Merge r1609845 through r1612502 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612505 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 08:23:34 +00:00
25b0e8471e
HDFS-6702. Change DFSClient to pass the StorageType from the namenode to datanodes and change datanode to write block replicas using the specified storage type.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612493 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 07:41:24 +00:00
3de6c61f86
Merge r1609845 through r1612431 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612432 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 23:37:54 +00:00
44d9bb26d6
HDFS-6680. BlockPlacementPolicyDefault does not choose favored nodes correctly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612427 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 23:21:12 +00:00
ee3a32784f
Merge r1609845 through r1612268 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612270 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 13:48:02 +00:00
0a736fbc17
HDFS-6679. Bump NameNodeLayoutVersion and update editsStored test files. Contributed by vinayakumarb
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612266 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 13:38:06 +00:00
014be2510f
HDFS-6710. Change BlockPlacementPolicy to consider block storage policy in replica deletion.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612265 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 13:34:10 +00:00
7c18f8d55b
HDFS-6616. Add exclude-datanodes feature to WebHDFS redirection so that it will not redirect retries to the same datanode. Contributed by zhaoyunjiong
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611750 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 18:20:20 +00:00
551024915d
HDFS-6599. 2.4 addBlock is 10 to 20 times slower compared to 0.23 (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611737 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:58:07 +00:00
2b07af0c59
Merge r1609845 through r1611734 from tunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611736 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:57:51 +00:00
08466eaa00
HDFS-6700. BlockPlacementPolicy shoud choose storage but not datanode for deletion.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611731 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:40:03 +00:00
5f9e52f745
HDFS-6597. Add a new option to NN upgrade to terminate the process after upgrade on NN is completed. Contributed by Danilo Vunjak.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611723 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:14:22 +00:00
9f75b97a09
HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Liang Xie and Rakesh R )
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611562 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 08:48:52 +00:00
8f0c341934
reverted
...
HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Rakesh R )
........
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611560 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 08:46:27 +00:00
d2024f2e76
HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Rakesh R )
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611556 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 08:32:40 +00:00
2c5ceee6ab
HDFS-6655. Add 'header banner' to 'explorer.html' also in Namenode UI ( Contributed by Vinayakumar B )
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611538 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 04:27:09 +00:00
04fd2012fd
Merge r1609845 through r1611528 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611531 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 02:21:21 +00:00
7ba5913797
HDFS-6667. In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611508 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 23:11:27 +00:00
ce1659f070
HDFS-6693. TestDFSAdminWithHA fails on windows ( Contributed by Vinayakumar B )
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611441 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 19:17:51 +00:00
f4151bbf4f
HDFS-6478. RemoteException can't be retried properly for non-HA scenario. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611410 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 17:37:22 +00:00
38af6101d8
HDFS-6671. Change BlockPlacementPolicy to consider block storage policy in replicaiton.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611334 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 11:56:22 +00:00
ca52cb01c4
HDFS-6690. Deduplicate xattr names in memory. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611226 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 00:44:16 +00:00
c477a166e1
HDFS-2538. option to disable fsck dots. Contributed by Mohammad Kamrul Islam.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611220 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 23:55:32 +00:00
e896de98f2
HDFS-6689. NFS doesn't return correct lookup access for direcories. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611135 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 18:52:03 +00:00
43fe48d9e2
HDFS-5624. Add HDFS tests for ACLs in combination with viewfs. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611068 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 16:27:38 +00:00
fb1f5bc618
HDFS-6456. NFS should throw error for invalid entry in dfs.nfs.exports.allowed.hosts. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610840 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 20:35:07 +00:00
7fe6ab7f91
HDFS-5809. BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610790 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 18:17:13 +00:00
97b5fbc281
HDFS-6678. MiniDFSCluster may still be partially running after initialization fails. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610549 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 22:49:08 +00:00
3d9bea277a
HDFS-6378. NFS registration should timeout instead of hanging when portmap/rpcbind is not available. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610543 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:48:44 +00:00
395c763aef
Merge r1609845 through r1610532 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610533 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:23:20 +00:00
4f1fae88f8
HDFS-6670. Add block storage policy support with default HOT, WARM and COLD policies.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610529 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:11:22 +00:00
6f41baa623
HDFS-6677. Change INodeFile and FSImage to support storage policy ID.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610525 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 20:57:15 +00:00
3b54223c0f
HDFS-2856. Fix block protocol so that Datanodes don't require root or jsvc. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610474 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 18:10:03 +00:00
23e61a7a25
HDFS-3851. Move attribution to release 2.6.0 section in CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609858 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 22:22:16 +00:00
1c6be51e5e
HADOOP-8158. Move attribution to release 2.6.0 section in CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609854 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 22:09:33 +00:00
c9676bb07c
HDFS-2976. Move attribution to release 2.6.0 section in CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609849 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 21:58:16 +00:00
952b0fb18c
HDFS-6630. Unable to fetch the block information by Browsing the file system on Namenode UI through IE9 ( Contributed by Haohui Mai)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609629 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 05:15:18 +00:00
81930b75bd
HDFS-5202. Support Centralized Cache Management on Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609618 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 03:06:11 +00:00
b90dfe0b49
HDFS-6640. Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly in WebHdfs document (missed webhdfs/v1). Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609603 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 01:28:47 +00:00
8f520386fb
HDFS-6647. Edit log corruption when pipeline recovery occurs for deleted file present in snapshot. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609543 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 18:18:22 +00:00
cce02e3bef
HDFS-6631. TestPread#testHedgedReadLoopTooManyTimes fails intermittently. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609534 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 18:03:32 +00:00
e67b80ec3a
HDFS-6643. Refactor INodeWithAdditionalFields.PermissionStatusFormat and INodeFile.HeaderFormat.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609401 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 06:16:34 +00:00
36492f084b
HDFS-6645. Add test for successive Snapshots between XAttr modifications. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609388 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 05:01:41 +00:00
d9c5f20333
HDFS-6622. Rename and AddBlock may race and produce invalid edits (kihwal via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609384 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 04:03:02 +00:00
8044a12ac0
HDFS-6618. FSNamesystem#delete drops the FSN lock between removing INodes from the tree and deleting them from the inode map (kihwal via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609380 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 03:49:30 +00:00
3b0db60113
HDFS-6646. [ HDFS Rolling Upgrade - Shell ] shutdownDatanode and getDatanodeInfo usage is missed ( Contributed by Brahma Reddy Battula)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609020 13f79535-47bb-0310-9956-ffa450edef68
2014-07-09 06:05:44 +00:00
709d5cbd71
HDFS-6627. Rename DataNode#checkWriteAccess to checkReadAccess. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608940 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 20:29:42 +00:00
f62e93d591
HDFS-6638. Shorten test run time with a smaller retry timeout setting. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608905 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 19:16:48 +00:00
cddd6184ad
HDFS-5411. Update Bookkeeper dependency to 4.2.3. Contributed by Rakesh R.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608781 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:50:49 +00:00
986c09f68e
HDFS-4221. Remove the format limitation point from BKJM documentation as HDFS-3810 closed. Contributed by Rakesh R.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608776 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:31:37 +00:00
e6446b708d
HDFS-4286. Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM. Contributed by Rakesh R.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608764 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:17:54 +00:00
76a621ffd2
HDFS-6609. Use DirectorySnapshottableFeature to represent a snapshottable directory. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608631 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 00:08:18 +00:00
93c1bc8114
HDFS-6617. Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608522 13f79535-47bb-0310-9956-ffa450edef68
2014-07-07 17:37:04 +00:00
151c5deaf1
HDFS-6511. BlockManager#computeInvalidateWork() could do nothing. Contributed by Juan Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607735 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 20:10:54 +00:00
f881f0e923
HDFS-6493. Change dfs.namenode.startup.delay.block.deletion to second instead of millisecond. Contributed by Juan Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607732 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 20:02:14 +00:00
93e23a9915
HDFS-6613. Improve logging in caching classes. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607697 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 17:13:59 +00:00
160c912ee6
HDFS-6620. Snapshot docs should specify about preserve options with cp command. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607685 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 16:08:44 +00:00
54dc17ce2f
Preparing for release 2.6.0
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607538 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 05:55:05 +00:00
9b5d551ad9
HDFS-6610. TestShortCircuitLocalRead tests sometimes timeout on slow machines. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607496 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 23:02:24 +00:00
297e3c72fb
HDFS-6604. The short-circuit cache doesn't correctly time out replicas that haven't been used in a while (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607456 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 19:43:36 +00:00
130182df1b
HDFS-6614. shorten TestPread run time with a smaller retry timeout setting. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607447 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 18:57:25 +00:00
9dfe9cf400
HDFS-6612. MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID. Contributed by Juan Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607442 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 18:37:00 +00:00
c89bf0184d
HDFS-6603. Add XAttr with ACL test. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607239 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 03:20:25 +00:00
0ca41a8f35
HDFS-6591. while loop is executed tens of thousands of times in Hedged Read. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606927 13f79535-47bb-0310-9956-ffa450edef68
2014-06-30 20:46:44 +00:00
e8186a9dee
HDFS-6558. Missing newline in the description of dfsadmin -rollingUpgrade. Contributed by Chen He.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606855 13f79535-47bb-0310-9956-ffa450edef68
2014-06-30 18:17:56 +00:00
2f75cd1190
HDFS-6418. Regression: DFS_NAMENODE_USER_NAME_KEY missing
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606536 13f79535-47bb-0310-9956-ffa450edef68
2014-06-29 16:27:24 +00:00
94a1462bd5
HDFS-6601. Issues in finalizing rolling upgrade when there is a layout version change. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606371 13f79535-47bb-0310-9956-ffa450edef68
2014-06-28 15:21:46 +00:00
78cafe34e6
HDFS-6556. Refine XAttr permissions. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606320 13f79535-47bb-0310-9956-ffa450edef68
2014-06-28 11:40:02 +00:00
5f880f79d2
HADOOP-10701. NFS should not validate the access premission only based on the user's primary group. Contributed by Harsh J.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606042 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 12:00:55 +00:00
280bdb9a16
HDFS-6572. Add an option to the NameNode that prints the software and on-disk image versions. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605928 13f79535-47bb-0310-9956-ffa450edef68
2014-06-26 23:12:45 +00:00
e3612e4428
HDFS-6595. Allow the maximum threads for balancing on datanodes to be configurable. Contributed by Benoy Antony
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605565 13f79535-47bb-0310-9956-ffa450edef68
2014-06-25 19:27:29 +00:00
55a1defa50
HDFS-6475. WebHdfs clients fail without retry because incorrect handling of StandbyException. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605217 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 23:07:49 +00:00
a92318c2ef
HDFS-6587. Fix a typo in message issued from explorer.js. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605184 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 20:48:32 +00:00
bdf3de9f6b
HDFS-6593. Move SnapshotDiffInfo out of INodeDirectorySnapshottable. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605169 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 19:59:34 +00:00
46162a213f
HDFS-6430. HTTPFS - Implement XAttr support. (Yi Liu via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605118 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 15:59:50 +00:00
ff41321e2f
HDFS-6486. Add user doc for XAttrs via WebHDFS. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605062 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 12:13:43 +00:00
08986fdbed
HDFS-6562. Refactor rename() in FSDirectory. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605016 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 06:56:27 +00:00
5ac06c8b38
HDFS-6578. add toString method to DatanodeStorage for easier debugging. (Contributed by Yongjun Zhang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604942 13f79535-47bb-0310-9956-ffa450edef68
2014-06-23 21:30:02 +00:00
9ddedbf3df
HDFS-6587. Bug in TestBPOfferService can cause test failure. (Contributed by Zhilei Xu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604899 13f79535-47bb-0310-9956-ffa450edef68
2014-06-23 18:21:00 +00:00
a90a8b26e9
HDFS-6580. FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper. Contributed bu Zhilei Xu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604704 13f79535-47bb-0310-9956-ffa450edef68
2014-06-23 07:20:49 +00:00
e8ca648005
HDFS-6507. Improve DFSAdmin to support HA cluster better. (Contributd by Zesheng Wu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604692 13f79535-47bb-0310-9956-ffa450edef68
2014-06-23 05:16:05 +00:00
1e89eba47d
HDFS-6583. Remove clientNode in FileUnderConstructionFeature. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604541 13f79535-47bb-0310-9956-ffa450edef68
2014-06-22 07:39:36 +00:00
8a83bb7ad6
HDFS-4667. Capture renamed files/directories in snapshot diff report. Contributed by Jing Zhao and Binglin Chang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604488 13f79535-47bb-0310-9956-ffa450edef68
2014-06-21 22:59:34 +00:00
0c51289695
HDFS-6222. Remove background token renewer from webhdfs. Contributed by Rushabh Shah and Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604300 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 23:58:23 +00:00
9ca79e8d32
HDFS-6557. Move the reference of fsimage to FSNamesystem. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604242 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 18:54:19 +00:00
d9eb18bb2e
HDFS-6535. HDFS quota update is wrong when file is appended. Contributed by George Wong.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604226 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 18:25:09 +00:00
af6c91a80c
HDFS-6403. Add metrics for log warnings reported by JVM pauses. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604074 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 02:38:00 +00:00
46dc32e125
HDFS-6312. WebHdfs HA failover is broken on secure clusters. (daryn via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604045 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 23:06:40 +00:00
9ff3836a36
HDFS-6549. Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604022 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 19:39:29 +00:00
0da148dae7
HDFS-3848. A Bug in recoverLeaseInternal method of FSNameSystem class. Contributed by Hooman Peiro Sajjad and Chen He.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604011 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 19:05:25 +00:00
a3908b89f7
Move HDFS-6375 down to 2.5 section in CHANGES.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603974 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 17:42:04 +00:00
d417e49ce4
HDFS-6492. Support create-time xattrs and atomically setting multiple xattrs. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603971 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 17:37:31 +00:00
3f82484218
HDFS-6563. NameNode cannot save fsimage in certain circumstances when snapshots are in use. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603712 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 05:17:58 +00:00
a4e0ff5e05
HDFS-6480. Move waitForReady() from FSDirectory to FSNamesystem. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603705 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 04:13:56 +00:00
eb93f73ea8
HDFS-6553. Add missing DeprecationDeltas for NFS Kerberos configurations. Contributed by Stephen Chu
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603677 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 23:51:49 +00:00
21ffcc348e
HDFS-6559. Fix wrong option "dfsadmin -rollingUpgrade start" in the document. (Contributed by Akira Ajisaka)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603638 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 21:29:39 +00:00
2ecab65e3e
HDFS-6439. NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603622 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 20:45:53 +00:00
4cf94aaf80
HDFS-6551. Rename with OVERWRITE option may throw NPE when the target file/directory is a reference INode. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603612 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 19:57:00 +00:00
52d18aa217
HDFS-6552. add DN storage to a BlockInfo will not replace the different storage from same DN. (Contributed by Amir Langer)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603602 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 19:37:18 +00:00
1af69553a1
HDFS-6530. Fix Balancer documentation.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603571 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 18:44:28 +00:00
8e8a769e7f
HDFS-6527. Edit log corruption due to defered INode removal. Contributed by Kihwal Lee and Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603340 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 01:00:32 +00:00
2298f3d241
HDFS-6545. Finalizing rolling upgrade can make NN unavailable for a long duration. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603239 13f79535-47bb-0310-9956-ffa450edef68
2014-06-17 17:58:38 +00:00
f4b1c44415
HDFS-6528. Add XAttrs to TestOfflineImageViewer. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603020 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 23:07:31 +00:00
45c52ef924
HDFS-6518. TestCacheDirectives#testExceedsCapacity should take FSN read lock when accessing pendingCached list. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603016 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 22:47:58 +00:00
b98da7f3b5
HDFS-6539. test_native_mini_dfs is skipped in hadoop-hdfs pom.xml (decstery via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602998 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 20:35:45 +00:00
26936978be
Preparing to release hadoop-2.4.1.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602886 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 15:07:00 +00:00
2ad014a097
Moved CHANGES.txt entries of MAPREDUCE-5898, MAPREDUCE-5920, HDFS-6464, HDFS-6375 from trunk to 2.5 section on merging HDFS-2006 to branch-2
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602699 13f79535-47bb-0310-9956-ffa450edef68
2014-06-15 14:54:36 +00:00
d18af7edd4
HDFS-6499. Use NativeIO#renameTo instead of File#renameTo in FileJournalManager. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602542 13f79535-47bb-0310-9956-ffa450edef68
2014-06-14 02:14:46 +00:00
3f5e04946d
HDFS-6529. Trace logging for RemoteBlockReader2 to identify remote datanode and file being read. Contributed by Anubhav Dhoot.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602538 13f79535-47bb-0310-9956-ffa450edef68
2014-06-14 00:57:52 +00:00
70db2ec417
HDFS-6470. TestBPOfferService.testBPInitErrorHandling is flaky. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602490 13f79535-47bb-0310-9956-ffa450edef68
2014-06-13 19:00:03 +00:00
02f3ff3387
HDFS-6330. Move mkdirs() to FSNamesystem. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602484 13f79535-47bb-0310-9956-ffa450edef68
2014-06-13 18:04:45 +00:00
6aef8fec70
Fixup CHANGES.txt message for HDFS-3493
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602292 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 21:16:36 +00:00
be01103af7
HDFS-3493. Invalidate corrupted blocks as long as minimum replication is satisfied. Contributed by Juan Yu and Vinayakumar B.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602291 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 21:06:31 +00:00
befa4bb1ed
HDFS-6395. Skip checking xattr limits for non-user-visible namespaces. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602288 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 20:55:06 +00:00
2f4f261cda
HDFS-6471. Make moveFromLocal CLI testcases to be non-disruptive (Contributed by Dasha Boudnik)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602064 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 05:48:26 +00:00
8bfbec8cfb
HDFS-6379. HTTPFS - Implement ACLs support. (yoderme via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602040 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 22:35:18 +00:00
22ec67ea6f
Moved the HDFS-2006 break down tasks list to 2.5 section in merging HDFS-2006 to branch-2
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602003 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 19:51:36 +00:00
e98529858e
HDFS-6315. Decouple recording edit logs from FSDirectory. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601960 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 17:22:44 +00:00
49fecbd402
HDFS-6503. Fix typo of DFSAdmin restoreFailedStorage. Contributed by Zesheng Wu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601958 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 17:12:46 +00:00
c802ca28fd
HDFS-6364. Incorrect check for unknown datanode in Balancer. (Contributed by Benoy Antony)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601771 13f79535-47bb-0310-9956-ffa450edef68
2014-06-10 21:02:47 +00:00
123c563fe6
HDFS-6460. Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601535 13f79535-47bb-0310-9956-ffa450edef68
2014-06-10 00:39:20 +00:00
a72f850e33
HDFS-6399. Add note about setfacl in HDFS permissions guide. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601476 13f79535-47bb-0310-9956-ffa450edef68
2014-06-09 18:42:17 +00:00
8b2b7ff0ae
HDFS-6257. TestCacheDirectives#testExceedsCapacity fails occasionally (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601473 13f79535-47bb-0310-9956-ffa450edef68
2014-06-09 18:39:37 +00:00
cc9bc8eef7
HDFS-6500. Snapshot shouldn't be removed silently after renaming to an existing snapshot. (Contributed by Nicholas SZE)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601199 13f79535-47bb-0310-9956-ffa450edef68
2014-06-08 07:06:35 +00:00
fb7ea6d8bc
HDFS-6297. Add CLI testcases to reflect new features of dfs and dfsadmin (Contributed by Dasha Boudnik)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601059 13f79535-47bb-0310-9956-ffa450edef68
2014-06-07 05:22:34 +00:00
9528ed939d
HDFS-6497. Make TestAvailableSpaceVolumeChoosingPolicy deterministic (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601035 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 23:40:39 +00:00
14394eed00
HDFS-6487. TestStandbyCheckpoint#testSBNCheckpoints is racy. Contributed by Mit Desai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601016 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 21:36:56 +00:00
6a4f6d6b3e
HDFS-6464. Support multiple xattr.name parameters for WebHDFS getXAttrs. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600810 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 03:48:43 +00:00
e40524d759
HDFS-6369. Document that BlockReader#available() can return more bytes than are remaining in the block (Ted Yu via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600801 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 00:59:18 +00:00
Vinayakumar B
Haohui Mai
Arpit Agarwal
Jing Zhao
Brandon Li
Ravi Prakash
Chris Nauroth
Aaron Myers
Tsz-wo Sze
Allen Wittenauer
Karthik Kambatla
Uma Maheswara Rao G
Colin McCabe
Andrew Wang
Steve Loughran
Daryn Sharp
Kihwal Lee
Alejandro Abdelnur
Arun Murthy
Konstantin Boudnik
Junping Du