eb8284d50e
Merge trunk into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDirectoryScanner.java
2014-09-07 14:46:46 -07:00
a23144fd8a
HDFS Credential Provider related Unit Test Failure. Contributed by Xiaoyu Yao.
2014-09-07 08:39:20 -07:00
d1fa58292e
HDFS-6898. DN must reserve space for a full block when an RBW block is created. (Contributed by Arpit Agarwal)
2014-09-06 21:04:29 -07:00
22a41dce4a
HDFS-6997: add more tests for data migration and replicaion.
2014-09-07 07:44:28 +08:00
31bbeaf383
Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
2014-09-06 12:28:22 -07:00
88209ce181
HDFS-6940. Refactoring to allow ConsensusNode implementation.
...
Contributed by Konstantin Shvachko.
2014-09-06 12:07:52 -07:00
3b35f81603
HDFS-6986. DistributedFileSystem must get delegation tokens from configured KeyProvider. (zhz via tucu)
2014-09-05 22:33:48 -07:00
339d21f273
Merge trunk into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
2014-09-05 21:36:25 -07:00
21c0cdeec1
HADOOP-11067 [HDFS-6998]. Fix CHANGES.txt
2014-09-05 14:29:57 -07:00
a149afd9e6
HADOOP-11052. hadoop_verify_secure_prereq's results aren't checked in bin/hdfs (aw)
2014-09-05 13:50:42 -07:00
fc68337049
HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao)
2014-09-05 13:50:42 -07:00
c5ef9c9e69
HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao)
2014-09-05 13:50:42 -07:00
c828b8aa91
HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth.
2014-09-05 13:50:42 -07:00
2cd5b4f20d
HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth.
2014-09-05 13:50:42 -07:00
54767d3ff4
Fix TestOfflineEditsViewer after merging.
2014-09-05 12:05:22 -07:00
300cb12bef
Merge trunk into HDFS-6584
2014-09-05 11:37:22 -07:00
7a62515c86
HADOOP-11052. hadoop_verify_secure_prereq's results aren't checked in bin/hdfs (aw)
2014-09-05 11:31:49 -07:00
71269f7097
HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao)
2014-09-05 11:14:10 -07:00
9609b7303a
HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao)
2014-09-05 11:10:58 -07:00
b051327ab6
HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth.
2014-09-05 11:07:41 -07:00
fab9bc58ec
HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth.
2014-09-05 11:03:58 -07:00
9e941d9f99
HDFS-6831. Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'. (Contributed by Xiaoyu Yao)
2014-09-05 10:45:54 -07:00
c6107f566f
HDFS-6376. Distcp data between two HA clusters requires another configuration. Contributed by Dave Marion and Haohui Mai.
2014-09-05 10:40:02 -07:00
772d1fb01e
HDFS-6714. TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster (vinayakumarb)
2014-09-05 10:25:09 +05:30
185200e709
HDFS-6876. Archival Storage: support set/get storage policy in DFSAdmin. Contributed by Jing Zhao.
2014-09-04 20:14:46 -07:00
6104520369
HDFS-6886. Use single editlog record for creating file + overwrite. Contributed by Yi Liu.
2014-09-04 18:54:38 -07:00
f7df24bb1b
HDFS-6996. SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file. Contributed by Jing Zhao.
2014-09-04 16:12:44 -07:00
e08701ec71
HDFS-6961. Archival Storage: BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round.
2014-09-04 14:19:32 -07:00
1a09536141
Fixing HDFS CHANGES.txt, missing HDFS-6905 entry
2014-09-04 11:07:08 -07:00
70b218748b
HADOOP-11015. Http server/client utils to propagate and recreate Exceptions from server to client. (tucu)
2014-09-04 09:11:10 -07:00
f4caedfcbf
HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang
2014-09-03 19:30:30 -07:00
3a0142bd77
HDFS-6848. Lack of synchronization on access to datanodeUuid in DataStorage#format. (Contributed by Xiaoyu Yao)
2014-09-03 17:17:06 -07:00
45d5b13256
Merge changes from trunk
2014-09-03 15:36:47 -07:00
cb9b485075
HDFS-6930. Improve replica eviction from RAM disk. (Arpit Agarwal)
2014-09-03 13:53:01 -07:00
08a8f2be81
Merge trunk into HDFS-6581
2014-09-03 10:53:37 -07:00
762b04e994
HDFS-6950. Add Additional unit tests for HDFS-6581. (Contributed by Xiaoyu Yao)
2014-09-03 10:51:26 -07:00
ce0462129f
HADOOP-10956. Fix create-release script to include docs and necessary txt files. (kasha)
2014-09-03 09:39:02 -07:00
3425ae5d7e
HDFS-2975. Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). (Yi Liu via umamahesh)
2014-09-03 18:53:51 +05:30
a6b32a3e78
Merge trunk into HDFS-6581
2014-09-02 16:25:32 -07:00
08a9ac7098
HDFS-6942. Fix typos in log messages. Contributed by Ray Chiang.
2014-09-02 16:22:18 -07:00
727331becc
HDFS-4257. The ReplaceDatanodeOnFailure policies could have a forgiving option. Contributed by szetszwo.
2014-09-02 15:14:33 -07:00
a0ccf83dfd
HDFS-6954. With crypto, no native lib systems are too verbose. Contributed by Charles Lamb.
2014-09-02 14:22:20 -07:00
faa4455be5
HDFS-6634. inotify in HDFS. Contributed by James Thomas.
2014-09-02 14:02:29 -07:00
3e2a0b5446
HDFS-6969. Archival Storage: INode#getStoragePolicyID should always return the latest storage policy. Contributed by Jing Zhao.
2014-09-01 17:56:04 -07:00
217dea7794
Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
2014-09-01 11:52:59 -07:00
6066b1a455
HDFS-6972. TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration doesn't decode url correctly. Contributed by Yongjun Zhang.
2014-08-29 15:47:01 -07:00
f65183eba3
Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
2014-08-29 13:37:17 -07:00
7eab2a29a5
HDFS-6774. Make FsDataset and DataStore support removing volumes. Contributed by Lei Xu.
2014-08-29 13:00:17 -07:00
b1dce2aa21
HADOOP-10814. Update Tomcat version used by HttpFS and KMS to latest 6.x version. (rkanter via tucu)
2014-08-29 11:53:22 -07:00
4ae8178c56
HDFS-6800. Support Datanode layout changes with rolling upgrade. (Contributed by James Thomas)
2014-08-29 00:26:13 -07:00
c92837aeab
HDFS-6931. Move lazily persisted replicas to finalized directory on DN startup. (Arpit Agarwal)
2014-08-28 23:13:46 -07:00
4cf9afacbe
HDFS-6960. Bugfix in LazyWriter, fix test case and some refactoring. (Arpit Agarwal)
2014-08-28 23:05:32 -07:00
7e32be8768
Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
...
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2014-08-28 19:06:46 -07:00
2ca93d1fbf
Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2
...
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-mapreduce-project/CHANGES.txt
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-08-28 19:05:57 -07:00
d8774cc577
HADOOP-11013. CLASSPATH handling should be consolidated, debuggable (aw)
2014-08-28 18:09:25 -07:00
ab638e77b8
HDFS-6865. Byte array native checksumming on client side. Contributed by James Thomas.
2014-08-28 16:44:09 -07:00
bbaa7dc28d
HDFS-6928. 'hdfs put' command should accept lazyPersist flag for testing. (Arpit Agarwal)
2014-08-28 15:53:12 -07:00
d9a7404c38
Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2
...
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-mapreduce-project/CHANGES.txt
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-08-28 15:10:59 -07:00
2e987148e0
HDFS-6929. NN periodically unlinks lazy persist files with missing replicas from namespace. (Arpit Agarwal)
2014-08-27 21:47:19 -07:00
3f64c4aaf0
HDFS-6927. Initial unit tests for Lazy Persist files. (Arpit Agarwal)
2014-08-27 21:47:19 -07:00
eb448e1439
HDFS-6926. DN support for saving replicas to persistent storage and evicting in-memory replicas. (Arpit Agarwal)
2014-08-27 21:47:19 -07:00
a317bd7b02
HDFS-6925. DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received. (Arpit Agarwal)
2014-08-27 21:47:19 -07:00
c2354a7f81
HDFS-6923. Propagate LazyPersist flag to DNs via DataTransferProtocol. (Arpit Agarwal)
2014-08-27 21:47:18 -07:00
042b33f20b
HDFS-6922. Add LazyPersist flag to INodeFile, save it in FsImage and edit logs. (Arpit Agarwal)
2014-08-27 21:47:18 -07:00
7f49537ba1
HDFS-6924. Add new RAM_DISK storage type. (Arpit Agarwal)
2014-08-27 21:47:18 -07:00
a7bcc95358
HDFS-6921. Add LazyPersist flag to FileStatus. (Arpit Agarwal)
2014-08-27 21:47:18 -07:00
7a16731191
HADOOP-10957. The globber will sometimes erroneously return a permission denied exception when there is a non-terminal wildcard.
2014-08-27 19:47:10 -07:00
a26aa6bd07
HDFS-6944. Archival Storage: add retry and termination logic for Mover. Contributed by Jing Zhao.
2014-08-27 14:20:54 -07:00
37549576e7
Add HDFS-6879 to CHANGES.txt
2014-08-27 14:18:18 -07:00
6962510f72
HDFS-6879. Adding tracing to Hadoop RPC. Contributed by Masatake Iwasaki.
2014-08-27 14:12:05 -07:00
b7ded466b0
HDFS-6920. Archival Storage: check the storage type of delNodeHintStorage when deleting a replica. Contributed by Tsz Wo Nicholas Sze.
2014-08-27 14:08:02 -07:00
b6b95ff667
HDFS-6902. FileWriter should be closed in finally block in BlockReceiver#receiveBlock() (Tsuyoshi OZAWA via Colin Patrick McCabe)
2014-08-27 13:49:31 -07:00
225569ece2
HDFS-4486. Add log category for long-running DFSClient notices. Contributed by Zhe Zhang.
2014-08-27 13:39:40 -07:00
d805cc27a9
HDFS-6773. MiniDFSCluster should skip edit log fsync by default. Contributed by Stephen Chu.
2014-08-27 13:33:02 -07:00
26ebdd849b
HDFS-6938. Cleanup javac warnings in FSNamesystem. Contributed by Charles Lamb.
2014-08-27 11:14:39 -07:00
cd9182d8b5
HDFS-6892. Add XDR packaging method for each NFS request. Contributed by Brandon Li
2014-08-27 11:06:01 -07:00
8ea20b53a8
HDFS-6911. Archival Storage: check if a block is already scheduled in Mover. Contributed by Tsz Wo Nicholas Sze.
2014-08-27 10:38:10 -07:00
555900a9dc
Merge branch 'trunk' into HDFS-6584
2014-08-27 10:32:30 -07:00
6b441d227a
HDFS-6908. Incorrect snapshot directory diff generated by snapshot deletion. Contributed by Juan Yu and Jing Zhao.
2014-08-27 10:26:22 -07:00
c5d9a4a91e
HDFS-6694. TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms - debugging patch (Contributed by Yongjun Zhang)
2014-08-27 09:52:33 -07:00
9ec4a930f5
HADOOP-10996. Stop violence in the *_HOME (aw)
2014-08-27 07:00:31 -07:00
dc154ab86d
Add a section for 2.5.1 in CHANGES.txt
2014-08-27 00:55:19 -07:00
e871955765
HDFS-6899. Allow changing MiniDFSCluster volumes per DN and capacity per volume. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619970 13f79535-47bb-0310-9956-ffa450edef68
2014-08-23 06:01:17 +00:00
a83d055f25
HDFS-4852. libhdfs documentation is out of date. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619967 13f79535-47bb-0310-9956-ffa450edef68
2014-08-23 05:30:21 +00:00
e6c3650070
HDFS-6829. DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster. (Contributed by zhaoyunjiong)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619882 13f79535-47bb-0310-9956-ffa450edef68
2014-08-22 18:14:55 +00:00
3aa3b0abc2
HDF-6905. fs-encryption merge triggered release audit failures. (clamb via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619667 13f79535-47bb-0310-9956-ffa450edef68
2014-08-22 05:17:22 +00:00
e69954d22c
HDFS-6906. Archival Storage: Add more tests for BlockStoragePolicy. Contributed by Tsz Wo Nicholas Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619628 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 23:42:33 +00:00
603cbe5eea
HDFS-6863. Archival Storage: Support migration for snapshot paths. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619627 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 23:41:10 +00:00
7b28f363b1
HDFS-6890. NFS readdirplus doesn't return dotdot attributes. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619500 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 17:53:54 +00:00
c92d869d02
Merge r1609845 through r1619277 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619293 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 05:22:10 +00:00
6824abc19e
HDFS-6758. Block writer should pass the expected block size to DataXceiverServer (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619275 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 01:13:49 +00:00
8f00897a4b
HDFS-6878. Change MiniDFSCluster to support StorageType configuration for individual directories. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619271 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 00:42:27 +00:00
8304001861
HDFS-6858. Allow dfs.data.transfer.saslproperties.resolver.class default to hadoop.security.saslproperties.resolver.class. Contributed by Benoy Antony.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619256 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 22:46:35 +00:00
9b8250c742
Set the release date for 2.5.0 in CHANGES.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619237 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 21:33:19 +00:00
b0f0ef17f0
Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619203 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 18:56:56 +00:00
834fccf02b
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1619194 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 18:19:13 +00:00
f20d363126
HDFS-6870. Blocks and INodes could leak for Rename with overwrite flag. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619192 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 18:13:03 +00:00
d2a39b61aa
Merge from trunk to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1619018 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 01:22:42 +00:00
fbc1ee4d6f
HDFS-6868. portmap and nfs3 are documented as hadoop commands instead of hdfs. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619001 13f79535-47bb-0310-9956-ffa450edef68
2014-08-19 22:31:57 +00:00
31467453ec
HADOOP-9902. Shell script rewrite (aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618847 13f79535-47bb-0310-9956-ffa450edef68
2014-08-19 12:11:17 +00:00
4e324bcd3d
Merge r1609845 through r1618763 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618764 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 23:41:53 +00:00
2fb04d2a30
HDFS-6569. OOB message can't be sent to the client when DataNode shuts down for upgrade. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618742 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 21:23:08 +00:00
1b5139b29a
HDFS-6188. An ip whitelist based implementation of TrustedChannelResolver. (Contributed by Benoy Antony)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618727 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 20:50:06 +00:00
0cc08f6da4
Merge from trunk to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1618700 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 18:41:31 +00:00
bd616552cc
HDFS-6825. Edit log corruption due to delayed block removal. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618684 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 18:08:42 +00:00
5d5aae0694
HDFS-6801. Archival Storage: Add a new data migration tool. Contributed by Tsz Wo Nicholas Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618675 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 17:51:18 +00:00
1c77c80410
HDFS-6783. Addendum patch to fix test failures. (Contributed by Yi Liu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618635 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 15:34:58 +00:00
cb75b6b07d
Merge r1609845 through r1618416 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618417 13f79535-47bb-0310-9956-ffa450edef68
2014-08-16 21:02:21 +00:00
9b250d74f0
HDFS-6847. Support storage policy on directories and include storage policy in HdfsFileStatus. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618416 13f79535-47bb-0310-9956-ffa450edef68
2014-08-16 20:58:20 +00:00
31e478905a
Wrong categorization for a variety of commits in the CHANGES.txt files
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618233 13f79535-47bb-0310-9956-ffa450edef68
2014-08-15 16:47:34 +00:00
894b4e427f
HDFS-6850. Move NFS out of order write unit tests into TestWrites class. Contributed by Zhe Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618091 13f79535-47bb-0310-9956-ffa450edef68
2014-08-15 02:33:24 +00:00
20dcb841ce
HDFS-6546. Add non-superuser capability to get the encryption zone for a specific path. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1618022 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 19:11:06 +00:00
13ad623b9d
Updated contributors name in CHANGES.txt for HDFS-6783
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617880 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 04:57:47 +00:00
44864c68b5
HDFS-6783. Fix HDFS CacheReplicationMonitor rescan logic. Contributed by Yi Liu and Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617872 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 04:20:00 +00:00
065d9ec5d9
HDFS-6849. Replace HttpFS custom proxyuser handling with common implementation. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617831 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 20:27:50 +00:00
195961a7c1
HDFS-6247. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (vinayakumarb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617799 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 18:43:05 +00:00
6554994fab
Reverted
...
Merged revision(s) 1617784 from hadoop/common/trunk:
HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.)
........
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617794 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 18:36:51 +00:00
471b1368e2
HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617784 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 18:06:33 +00:00
03d8ff496a
HDFS-6567. Normalize the order of public final in HdfsFileStatus. Contributed by Tassapol Athiapinya.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617779 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 17:45:47 +00:00
a34dafe325
HADOOP-8944. Shell command fs -count should include human readable option (Jonathan Allen via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617775 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 17:30:26 +00:00
a72fba5853
HDFS-6836. HDFS INFO logging is verbose & uses file appenders. (Contributed by Xiaoyu Yao)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617603 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 21:49:48 +00:00
662c5bb3af
HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617598 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 21:42:21 +00:00
37207b75d4
HDFS-6835. Archival Storage: Add a new API to set storage policy. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1617568 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 19:32:09 +00:00
74f7be0887
merge from trunk r1617527
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1617532 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 17:02:07 +00:00
acc3d73a45
HDFS-6839. Fix TestCLI to expect new output. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1617526 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 16:50:18 +00:00
04884cd530
Merging r1616894 through r1617376 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1617377 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 22:27:50 +00:00
b760f20af1
HDFS-6582. Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler). Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617366 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 21:34:02 +00:00
80691b073f
HDFS-6838. Code cleanup for unnecessary INode replacement. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617361 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 21:28:33 +00:00
e60673697d
HDFS-6837. Code cleanup for Balancer and Dispatcher. Contributed by Tsz Wo Nicholas Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617337 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 18:01:14 +00:00
9d5f8fa68d
Merging r1616428 through r1616893 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1616897 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 22:21:35 +00:00
c3cf331dc9
HDFS-6828. Separate block replica dispatching from Balancer. Contributed by Tsz Wo Nicholas Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616889 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 21:33:57 +00:00
05d1bf4157
HDFS-6830. Revert accidental checkin
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616884 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 21:22:48 +00:00
a70c9de3f1
HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616883 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 21:20:19 +00:00
a42231d19b
HDFS-6823. dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616846 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 18:24:10 +00:00
6da830cfdf
HDFS-6823. dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616845 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 18:21:18 +00:00
e6bdb33784
HADOOP-10919. Copy command should preserve raw.* namespace extended attributes. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616840 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 17:58:01 +00:00
70d453602c
HDFS-573. Porting libhdfs to Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616814 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 16:26:45 +00:00
1fa2d6c4ba
HDFS-6834. Improve the configuration guidance in DFSClient when there are no Codec classes found in configs. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616721 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 11:35:16 +00:00
d3a2fe2807
HDFS-6772. Get DN storages out of blockContentsStale state faster after NN restarts. (Contributed by Ming Ma)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616680 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 05:41:38 +00:00
be9c67930b
HADOOP-10771. Refactor HTTP delegation support out of httpfs to common, PART 2. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616672 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 04:58:58 +00:00
4e7c4a6e1f
HADOOP-10771. Refactor HTTP delegation support out of httpfs to common, PART 1. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616671 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 04:55:38 +00:00
2ac640ec75
HDFS-6722. Display readable last contact time for dead nodes on NN webUI. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616669 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 04:27:47 +00:00
d758be1f35
HDFS-6740. Make FSDataset support adding data volumes dynamically. Contributed by Lei Xu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616623 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 22:59:59 +00:00
eca80dca3e
HDFS-6728. Dynamically add new volumes to DataStorage, formatted if necessary. Contributed by Lei Xu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616615 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 22:46:51 +00:00
311d2f0773
Merge from trunk to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616589 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 20:26:52 +00:00
b98400df7b
HDFS-6781. Separate HDFS commands from CommandsManual.apt.vm. (Contributed by Akira Ajisaka)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616575 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 19:42:09 +00:00
b50cb5e056
Merge r1609845 through r1616427 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1616428 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 07:38:23 +00:00
0ed8732fee
HDFS-6812. Remove addBlock and replaceBlock from DatanodeDescriptor.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616426 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 07:30:53 +00:00
83b9933db3
HDFS-6809. Move Balancer's inner classes MovedBlocks and Matcher as to standalone classes and separates KeyManager from NameNodeConnector.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616422 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 07:18:48 +00:00
efc73a0f13
HDFS-6791. A block could remain under replicated if all of its replicas are on decommissioned nodes. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616306 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 19:03:07 +00:00
6fa66f2357
HDFS-6517. Remove hadoop-metrics2.properties from hdfs project (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616262 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 16:07:52 +00:00
d7a57c27c6
HDFS-6517. Remove hadoop-metrics2.properties from hdfs project (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616261 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 16:06:13 +00:00
2b5e044424
HDFS-6817. Fix findbugs and other warnings. (yliu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616092 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 04:43:58 +00:00
812ac91add
HDFS-6790. DFSUtil Should Use configuration.getPassword for SSL passwords. Contributed by Larry McCay
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616058 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 00:50:07 +00:00
4869fa2cfa
Edit CHANGES.txt files to move HADOOP-10759 and HDFS-6717 from 2.5.0 to 2.6.0
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616036 13f79535-47bb-0310-9956-ffa450edef68
2014-08-05 22:47:46 +00:00
ac47ad11de
HDFS-6394. HDFS encryption documentation. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616016 13f79535-47bb-0310-9956-ffa450edef68
2014-08-05 21:49:31 +00:00
2d7dcff6f4
HADOOP-10791. AuthenticationFilter should support externalizing the secret for signing and provide rotation support. (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616005 13f79535-47bb-0310-9956-ffa450edef68
2014-08-05 21:21:03 +00:00
ac73d416f3
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615844 13f79535-47bb-0310-9956-ffa450edef68
2014-08-05 02:30:54 +00:00
e2cb6e3c70
commit the additional doc change for HDFS-6717
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615801 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 21:30:42 +00:00
c9aa747437
HDFS-6451. NFS should not return NFS3ERR_IO for AccessControlException. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615702 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 17:40:02 +00:00
431857d09d
HDFS-6787. Remove duplicate code in FSDirectory#unprotectedConcat. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615622 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 15:44:44 +00:00
6e421f78b3
HDFS-6814. Mistakenly dfs.namenode.list.encryption.zones.num.responses configured as boolean. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615525 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 10:04:33 +00:00
10db613389
HADOOP-10886. CryptoCodec#getCodecclasses throws NPE when configurations not loaded. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615523 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 09:56:57 +00:00
33518e5613
HDFS-5185. DN fails to startup if one of the data dir is full. Contributed by Vinayakumar B.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615504 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 08:43:51 +00:00
30a9ec26f7
HDFS-5723. Append failed FINALIZED replica should not be accepted as valid when that block is underconstruction. Contributed by Vinayakumar B.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615491 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 06:44:06 +00:00
bcf7ab1d0f
HDFS-6810. StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports. (Contributed by szetszwo)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615381 13f79535-47bb-0310-9956-ffa450edef68
2014-08-03 02:08:32 +00:00
1ba3f89714
HDFS-6482. Use block ID-based block layout on datanodes (James Thomas via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615223 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 20:41:05 +00:00
07860b1c9e
HDFS-6788. Improve synchronization in BPOfferService with read write lock. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615190 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 18:56:06 +00:00
70c99278a9
HDFS-6780. Batch the encryption zones listing API. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615189 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 18:47:01 +00:00
3d9e39e51f
HDFS-6807. Fix TestReservedRawPaths. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615188 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 18:36:32 +00:00
da2ce46fbe
HDFS-6802. Some tests in TestDFSClientFailover are missing @Test annotation. Contributed by Akira Ajisaka.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615183 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 17:58:14 +00:00
45db4d204b
HDFS-6794. Update BlockManager methods to use DatanodeStorageInfo where possible. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615169 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 16:58:06 +00:00
7e12b1912f
HDFS-6796. Improve the argument check during balancer command line parsing. Contributed by Benoy Antony
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615107 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 14:12:35 +00:00
397c882362
HDFS-6798. Add test case for incorrect data node condition during balancing. (Contributed by Benoy Antony)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615044 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 07:12:39 +00:00
dc7744d2e5
Merge r1609845 through r1615019 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1615020 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 01:29:49 +00:00
8bca3c689a
HDFS-3482. Update CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615019 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 01:16:06 +00:00
b5b862e3af
HDFS-6797. DataNode logs wrong layoutversion during upgrade. (Contributed by Benoy Antony)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615017 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 01:13:42 +00:00
b8597e6a10
HDFS-6685. Balancer should preserve storage type of replicas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615015 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 01:05:33 +00:00
beebb36595
Fix some merge errors that slipped through.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615013 13f79535-47bb-0310-9956-ffa450edef68
2014-07-31 22:45:08 +00:00
b8b8f3f5e7
HDFS-6441. Add ability to exclude/include specific datanodes while balancing. (Contributed by Benoy Antony and Yu Li)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614812 13f79535-47bb-0310-9956-ffa450edef68
2014-07-31 06:02:46 +00:00
ab47b666d0
HDFS-6785. Should not be able to create encryption zone using path to a non-directory file. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614755 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 20:00:24 +00:00
7405953692
HDFS-6692. Add more HDFS encryption tests. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614735 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 18:39:48 +00:00
18360e71f1
HDFS-6768. Fix a few unit tests that use hard-coded port numbers. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614732 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 18:37:41 +00:00
535fe14ded
HDFS-6570. add api that enables checking if a user has certain permissions on a file. Contributed by Jitendra Pandey.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614723 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 17:49:09 +00:00
f6436c0720
HDFS-4629. Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614663 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 14:05:59 +00:00
c3fa0b5884
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614553 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 06:09:33 +00:00
09e7ff05df
HDFS-6778. The extended attributes javadoc should simply refer to the user docs. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614547 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 05:57:55 +00:00
12241908ad
HDFS-6665. Add tests for XAttrs in combination with viewfs. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614545 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 05:53:20 +00:00
9ca2f34c8f
HDFS-6730. Create a .RAW extended attribute namespace. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614535 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 01:35:04 +00:00
415223548d
HDFS-6771. Require specification of an encryption key when creating an encryption zone. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614519 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 23:39:38 +00:00
3a90228c30
HDFS-6509 addendum, extra file
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614491 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 21:11:52 +00:00
407bb3d3e4
HDFS-6509. Create a special /.reserved/raw directory for raw access to encrypted data. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614490 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 21:11:26 +00:00
10d6210322
Merge r1609845 through r1614231 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1614234 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 00:49:14 +00:00
4f9ffc7455
HDFS-6739. Add getDatanodeStorageReport to ClientProtocol.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614215 13f79535-47bb-0310-9956-ffa450edef68
2014-07-28 23:43:39 +00:00
f49c2a1b62
HDFS-6717. JIRA HDFS-5804 breaks default nfs-gateway behavior for unsecured config. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614125 13f79535-47bb-0310-9956-ffa450edef68
2014-07-28 18:53:47 +00:00
1d3e9ec935
merge from trunk r1613787
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613788 13f79535-47bb-0310-9956-ffa450edef68
2014-07-27 13:32:51 +00:00
9bce3eca42
HDFS-6749. FSNamesystem methods should call resolvePath. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613561 13f79535-47bb-0310-9956-ffa450edef68
2014-07-26 04:18:28 +00:00
e85a3fecc6
HDFS-6750. The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as stale (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613537 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 23:56:47 +00:00
57d8f829d9
HDFS-6755. There is an unnecessary sleep in the code path where DFSOutputStream#close gives up its attempt to contact the namenode (mitdesai21 via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613522 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 22:12:37 +00:00
79d214121b
Fix up HDFS CHANGES.txt for 2.5.0
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613494 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 19:02:19 +00:00
b9e4be4523
HDFS-6724. Decrypt EDEK before creating CryptoInputStream/CryptoOutputStream. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613490 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 18:33:10 +00:00
cc0464f4fe
HDFS-6752. Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit (vinayakumarb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613486 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 18:17:50 +00:00
2bb650146d
HDFS-5919. FileJournalManager doesn't purge empty and corrupt inprogress edits files (vinayakumarb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613355 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 07:02:53 +00:00
e670641bbf
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613334 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 23:55:15 +00:00
e171254d56
Name node cannot start if the path of a file under construction contains .snapshot. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613329 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 23:42:06 +00:00
8c6e172a0a
HDFS-6715. Webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613237 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 18:28:00 +00:00
a7855e1c33
HDFS-6723. New NN webUI no longer displays decommissioned state for dead node. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613220 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 17:59:45 +00:00
ef9b6a45c4
HDFS-6657. Remove link to 'Legacy UI' in trunk's Namenode UI. Contributed by Vinayakumar B.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613195 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 17:28:31 +00:00
2054453a39
HADOOP-10882. Move DirectBufferPool into common util. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613006 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 06:22:02 +00:00
2a5f1029a5
HDFS-6455. NFS: Exception should be added in NFS log for invalid separator in nfs.exports.allowed.hosts. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612947 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 21:22:50 +00:00
a6b1d2a85c
HDFS-6114. Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.curr (vinayakumarb via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612943 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 20:59:39 +00:00
22ba00de60
Merge from trunk to branch pt 2
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612941 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 20:45:10 +00:00
552b4fb9f9
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612928 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 19:26:29 +00:00
5343b43fd9
HDFS-6422. getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist. (Charles Lamb via umamahesh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612922 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 19:05:11 +00:00
48dc486672
Merge r1609845 through r1612880 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612883 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 17:30:06 +00:00
ac5e8aed7c
HDFS-6686. Change BlockPlacementPolicy to use fallback when some storage types are unavailable.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612880 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 17:25:06 +00:00
512b756973
HDFS-6738. Remove unnecessary getEncryptionZoneForPath call in EZManager#createEncryptionZone. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612849 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 15:23:03 +00:00
687ce1a5fc
HDFS-6733. Creating encryption zone results in NPE when KeyProvider is null. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612843 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 14:51:06 +00:00
853ed29f2d
HDFS-6731. Run 'hdfs zkfc -formatZK' on a server in a non-namenode will cause a null pointer exception. Contributed by Masatake Iwasaki
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612715 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 22:29:04 +00:00
c5686addb1
HDFS-6703. NFS: Files can be deleted from a read-only mount. Contributed by Srikanth Upputuri
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612702 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 20:53:50 +00:00
fee737eced
HDFS-6712. Document HDFS Multihoming Settings. (Contributed by Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612695 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 20:28:57 +00:00
69b75fca7a
HDFS-6720. Remove KeyProvider in EncryptionZoneManager. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612632 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 17:57:06 +00:00
c83c5b868e
HDFS-6701. Make seed optional in NetworkTopology#sortByDistance. Contributed by Ashwin Shankar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612625 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 17:47:49 +00:00
0c72ca9e7a
HDFS-6704. Fix the command to launch JournalNode in HDFS-HA document. Contributed by Akira AJISAKA.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612613 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 17:10:43 +00:00
b52b80d7bd
HADOOP-10853. Refactor get instance of CryptoCodec and support create via algorithm/mode/padding. (yliu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612513 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 08:38:38 +00:00
ee13f8bf3e
Merge r1609845 through r1612502 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612505 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 08:23:34 +00:00
25b0e8471e
HDFS-6702. Change DFSClient to pass the StorageType from the namenode to datanodes and change datanode to write block replicas using the specified storage type.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612493 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 07:41:24 +00:00
b57ec16567
HDFS-6718. Remove EncryptionZoneManager lock. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612439 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 00:55:20 +00:00
7b466b3b70
HDFS-6716. Update usage of KeyProviderCryptoExtension APIs on NameNode. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612438 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 00:27:51 +00:00
3de6c61f86
Merge r1609845 through r1612431 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612432 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 23:37:54 +00:00
44d9bb26d6
HDFS-6680. BlockPlacementPolicyDefault does not choose favored nodes correctly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612427 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 23:21:12 +00:00
cb20bb6117
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612403 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 21:44:50 +00:00
ee3a32784f
Merge r1609845 through r1612268 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612270 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 13:48:02 +00:00
0a736fbc17
HDFS-6679. Bump NameNodeLayoutVersion and update editsStored test files. Contributed by vinayakumarb
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612266 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 13:38:06 +00:00
014be2510f
HDFS-6710. Change BlockPlacementPolicy to consider block storage policy in replica deletion.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612265 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 13:34:10 +00:00
64ed72a047
HADOOP-10817. ProxyUsers configuration should support configurable prefixes. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611780 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 19:42:01 +00:00
7c18f8d55b
HDFS-6616. Add exclude-datanodes feature to WebHDFS redirection so that it will not redirect retries to the same datanode. Contributed by zhaoyunjiong
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611750 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 18:20:20 +00:00
551024915d
HDFS-6599. 2.4 addBlock is 10 to 20 times slower compared to 0.23 (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611737 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:58:07 +00:00
2b07af0c59
Merge r1609845 through r1611734 from tunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611736 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:57:51 +00:00
08466eaa00
HDFS-6700. BlockPlacementPolicy shoud choose storage but not datanode for deletion.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611731 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:40:03 +00:00
936895722e
fix eol style on TestBootstrapStandbyWithBKJM
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611726 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:23:05 +00:00
5f9e52f745
HDFS-6597. Add a new option to NN upgrade to terminate the process after upgrade on NN is completed. Contributed by Danilo Vunjak.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611723 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:14:22 +00:00
962ef6939e
HDFS-6490. Fix the keyid format for generated keys in FSNamesystem.createEncryptionZone (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1611722 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:13:55 +00:00
9f75b97a09
HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Liang Xie and Rakesh R )
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611562 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 08:48:52 +00:00
8f0c341934
reverted
...
HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Rakesh R )
........
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611560 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 08:46:27 +00:00
d2024f2e76
HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Rakesh R )
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611556 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 08:32:40 +00:00
2c5ceee6ab
HDFS-6655. Add 'header banner' to 'explorer.html' also in Namenode UI ( Contributed by Vinayakumar B )
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611538 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 04:27:09 +00:00
04fd2012fd
Merge r1609845 through r1611528 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611531 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 02:21:21 +00:00
7ba5913797
HDFS-6667. In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611508 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 23:11:27 +00:00
ce1659f070
HDFS-6693. TestDFSAdminWithHA fails on windows ( Contributed by Vinayakumar B )
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611441 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 19:17:51 +00:00
f4151bbf4f
HDFS-6478. RemoteException can't be retried properly for non-HA scenario. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611410 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 17:37:22 +00:00
38af6101d8
HDFS-6671. Change BlockPlacementPolicy to consider block storage policy in replicaiton.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611334 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 11:56:22 +00:00
ca52cb01c4
HDFS-6690. Deduplicate xattr names in memory. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611226 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 00:44:16 +00:00
c477a166e1
HDFS-2538. option to disable fsck dots. Contributed by Mohammad Kamrul Islam.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611220 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 23:55:32 +00:00
77f0e2cca5
HDFS-6405. Test Crypto streams in HDFS. (yliu via wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1611140 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 19:04:06 +00:00
e896de98f2
HDFS-6689. NFS doesn't return correct lookup access for direcories. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611135 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 18:52:03 +00:00
43fe48d9e2
HDFS-5624. Add HDFS tests for ACLs in combination with viewfs. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611068 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 16:27:38 +00:00
56c0bd4d37
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1610853 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 21:10:24 +00:00
b066be8115
HDFS-6619. Clean up encryption-related tests. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1610849 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 20:59:40 +00:00
fb1f5bc618
HDFS-6456. NFS should throw error for invalid entry in dfs.nfs.exports.allowed.hosts. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610840 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 20:35:07 +00:00
7fe6ab7f91
HDFS-5809. BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610790 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 18:17:13 +00:00
97b5fbc281
HDFS-6678. MiniDFSCluster may still be partially running after initialization fails. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610549 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 22:49:08 +00:00
3d9bea277a
HDFS-6378. NFS registration should timeout instead of hanging when portmap/rpcbind is not available. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610543 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:48:44 +00:00
395c763aef
Merge r1609845 through r1610532 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610533 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:23:20 +00:00
4f1fae88f8
HDFS-6670. Add block storage policy support with default HOT, WARM and COLD policies.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610529 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:11:22 +00:00
6f41baa623
HDFS-6677. Change INodeFile and FSImage to support storage policy ID.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610525 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 20:57:15 +00:00
3b54223c0f
HDFS-2856. Fix block protocol so that Datanodes don't require root or jsvc. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610474 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 18:10:03 +00:00
23e61a7a25
HDFS-3851. Move attribution to release 2.6.0 section in CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609858 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 22:22:16 +00:00
1c6be51e5e
HADOOP-8158. Move attribution to release 2.6.0 section in CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609854 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 22:09:33 +00:00
c9676bb07c
HDFS-2976. Move attribution to release 2.6.0 section in CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609849 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 21:58:16 +00:00
d79f27b429
HDFS-6474. Namenode needs to get the actual keys and iv from the KeyProvider. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1609833 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 20:54:47 +00:00
952b0fb18c
HDFS-6630. Unable to fetch the block information by Browsing the file system on Namenode UI through IE9 ( Contributed by Haohui Mai)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609629 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 05:15:18 +00:00
81930b75bd
HDFS-5202. Support Centralized Cache Management on Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609618 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 03:06:11 +00:00
b90dfe0b49
HDFS-6640. Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly in WebHdfs document (missed webhdfs/v1). Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609603 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 01:28:47 +00:00
8f520386fb
HDFS-6647. Edit log corruption when pipeline recovery occurs for deleted file present in snapshot. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609543 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 18:18:22 +00:00
cce02e3bef
HDFS-6631. TestPread#testHedgedReadLoopTooManyTimes fails intermittently. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609534 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 18:03:32 +00:00
d90671137e
HADOOP-10803. Update OpensslCipher#getInstance to accept CipherSuite#name format. (yliu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1609403 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 06:27:52 +00:00
e67b80ec3a
HDFS-6643. Refactor INodeWithAdditionalFields.PermissionStatusFormat and INodeFile.HeaderFormat.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609401 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 06:16:34 +00:00
36492f084b
HDFS-6645. Add test for successive Snapshots between XAttr modifications. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609388 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 05:01:41 +00:00
d9c5f20333
HDFS-6622. Rename and AddBlock may race and produce invalid edits (kihwal via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609384 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 04:03:02 +00:00
8044a12ac0
HDFS-6618. FSNamesystem#delete drops the FSN lock between removing INodes from the tree and deleting them from the inode map (kihwal via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609380 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 03:49:30 +00:00
3b0db60113
HDFS-6646. [ HDFS Rolling Upgrade - Shell ] shutdownDatanode and getDatanodeInfo usage is missed ( Contributed by Brahma Reddy Battula)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609020 13f79535-47bb-0310-9956-ffa450edef68
2014-07-09 06:05:44 +00:00
709d5cbd71
HDFS-6627. Rename DataNode#checkWriteAccess to checkReadAccess. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608940 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 20:29:42 +00:00
f62e93d591
HDFS-6638. Shorten test run time with a smaller retry timeout setting. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608905 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 19:16:48 +00:00
3470dd9a2f
HDFS-6614. Addendum patch to shorten TestPread run time with smaller retry timeout setting. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608846 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 16:43:16 +00:00
cddd6184ad
HDFS-5411. Update Bookkeeper dependency to 4.2.3. Contributed by Rakesh R.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608781 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:50:49 +00:00
986c09f68e
HDFS-4221. Remove the format limitation point from BKJM documentation as HDFS-3810 closed. Contributed by Rakesh R.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608776 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:31:37 +00:00
e6446b708d
HDFS-4286. Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM. Contributed by Rakesh R.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608764 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:17:54 +00:00
7aa07912dc
Move something down in CHANGES-fs-encryption.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608658 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 04:34:52 +00:00
ceed0f6c46
HDFS-6635. Refactor encryption zone functionality into new EncryptionZoneManager class. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608657 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 04:34:04 +00:00
76a621ffd2
HDFS-6609. Use DirectorySnapshottableFeature to represent a snapshottable directory. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608631 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 00:08:18 +00:00
dda85637df
Merge trunk to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608603 13f79535-47bb-0310-9956-ffa450edef68
2014-07-07 20:43:56 +00:00
93c1bc8114
HDFS-6617. Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608522 13f79535-47bb-0310-9956-ffa450edef68
2014-07-07 17:37:04 +00:00
83702b0707
HDFS-6629. Not able to create symlinks after HDFS-6516 (umamaheswararao)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608389 13f79535-47bb-0310-9956-ffa450edef68
2014-07-07 09:51:49 +00:00
c386652828
HDFS-6516. List of Encryption Zones should be based on inodes (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607770 13f79535-47bb-0310-9956-ffa450edef68
2014-07-04 00:24:28 +00:00
bfef9807a0
HADOOP-10693. Implementation of AES-CTR CryptoCodec using JNI to OpenSSL (hitliuyi via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607768 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 23:40:31 +00:00
151c5deaf1
HDFS-6511. BlockManager#computeInvalidateWork() could do nothing. Contributed by Juan Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607735 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 20:10:54 +00:00
f881f0e923
HDFS-6493. Change dfs.namenode.startup.delay.block.deletion to second instead of millisecond. Contributed by Juan Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607732 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 20:02:14 +00:00
93e23a9915
HDFS-6613. Improve logging in caching classes. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607697 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 17:13:59 +00:00
160c912ee6
HDFS-6620. Snapshot docs should specify about preserve options with cp command. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607685 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 16:08:44 +00:00
arp
cnauroth
Tsz-Wo Nicholas Sze
Konstantin V Shvachko
Alejandro Abdelnur
Allen Wittenauer
Jing Zhao
Jing Zhao
Vinayakumar B
Colin Patrick Mccabe
Karthik Kambatla
Uma Maheswara Rao G
Haohui Mai
Andrew Wang
Aaron T. Myers
Alejandro Abdelnur
Todd Lipcon
brandonli
Brandon Li
Tsz-wo Sze
Charles Lamb
Ravi Prakash
Yi Liu
Colin McCabe
Steve Loughran
Daryn Sharp
Kihwal Lee