22295b4783
Merge branch 'trunk' into HDFS-6581
2014-09-18 15:59:37 -07:00
70be56d093
HDFS-7003. Add NFS Gateway support for reading and writing to encryption zones. (clamb via wang)
2014-09-18 14:57:25 -07:00
0b10e5a0f7
Merge branch 'trunk' into HDFS-6581
2014-09-18 12:10:45 -07:00
570b8b468e
HDFS-7047. Expose FileStatus#isEncrypted in libhdfs (cmccabe)
2014-09-18 11:42:23 -07:00
5e4627d0fb
HDFS-7084. FsDatasetImpl#copyBlockFiles debug log can be improved. (Contributed by Xiaoyu Yao)
2014-09-18 11:13:53 -07:00
849ccfa699
Merge branch 'trunk' into HDFS-6581
2014-09-18 11:06:40 -07:00
76ccb80fad
HDFS-7088. Archival Storage: fix TestBalancer and TestBalancerWithMultipleNameNodes. Contributed by Tsz Wo Nicholas Sze.
2014-09-18 10:54:01 -07:00
2d2b0009e6
Merge branch 'trunk' into HDFS-6584
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
2014-09-18 13:00:29 +08:00
0ecefe6017
HDFS-7078. Fix listEZs to work correctly with snapshots. (wang)
2014-09-17 21:28:05 -07:00
10e8602f32
HDFS-7004. Update KeyProvider instantiation to create by URI. (wang)
2014-09-17 20:14:40 -07:00
bf38793ce1
Move some HDFS JIRAs to the correct CHANGES.txt
2014-09-17 18:08:34 -07:00
4eab083b1b
HDFS-7080. Fix finalize and upgrade unit test failures. (Arpit Agarwal)
2014-09-17 15:25:04 -07:00
a186d514bd
Merge branch 'trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
2014-09-17 15:03:55 -07:00
911979c8ab
Merge changes from trunk
2014-09-17 13:12:45 -07:00
e3803d002c
HDFS-6843. Create FileStatus isEncrypted() method (clamb via cmccabe)
2014-09-17 12:55:35 -07:00
24f8156886
Merge branch 'trunk' into HDFS-6581
2014-09-17 12:10:50 -07:00
ea4e2e843e
HDFS-6705. Create an XAttr that disallows the HDFS admin from accessing a file. (clamb via wang)
2014-09-17 11:23:47 -07:00
b014e83bc5
HDFS-6864. Archival Storage: add user documentation. Contributed by Tsz Wo Nicholas Sze.
2014-09-17 09:40:17 -07:00
c0c7e6fabd
HADOOP-11062. CryptoCodec testcases requiring OpenSSL should be run only if -Pnative is used. (asuresh via tucu)
2014-09-16 23:36:36 -07:00
e14e71d5fe
HADOOP-11096. KMS: KeyAuthorizationKeyProvider should verify the keyversion belongs to the keyname on decrypt. (tucu)
2014-09-16 23:20:35 -07:00
91f6ddeb34
Fix hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt .
2014-09-17 14:09:08 +08:00
bd2e409de1
HDFS-7072. Fix TestBlockManager and TestStorageMover. Contributed by Jing Zhao
2014-09-17 13:48:32 +08:00
dcbc467301
HDFS-7079. Few more unit test fixes for HDFS-6581. (Arpit Agarwal)
2014-09-16 18:19:57 -07:00
a24a9331d4
Merge branch 'trunk' into HDFS-6581
2014-09-16 18:18:09 -07:00
432b863719
Merge changes from trunk
2014-09-16 17:58:39 -07:00
2e4033e872
HDFS-7052. Archival Storage: Add Mover into hdfs script. Contributed by Jing Zhao.
2014-09-16 17:52:28 -07:00
a044407b5c
HDFS-6789. TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7. Contributed by Akira Ajisaka.
2014-09-16 17:02:06 -07:00
33ce887c20
HDFS-6851. Refactor EncryptionZoneWithId and EncryptionZone. (clamb via wang)
2014-09-16 16:41:09 -07:00
02adf7185d
HDFS-6799. The invalidate method in SimulatedFSDataset failed to remove (invalidate) blocks from the file system. Contributed by Megasthenis Asteris.
2014-09-16 16:24:23 -07:00
7971c97ec1
HADOOP-11022. User replaced functions get lost 2-3 levels deep (e.g., sbin) (aw)
2014-09-16 16:06:23 -07:00
4603e4481f
HDFS-7064. Fix unit test failures in HDFS-6581 branch. (Contributed by Xiaoyu Yao)
2014-09-16 15:45:07 -07:00
3e85f5b605
HDFS-7006. Test encryption zones with KMS. (Anthony Young-Garner and tucu)
2014-09-16 14:36:07 -07:00
e0d7fb48fb
Merge branch 'trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/datatransfer/Receiver.java
2014-09-16 14:32:57 -07:00
56119fec96
HDFS-6880. Adding tracing to DataNode data transfer protocol (iwasakims via cmccabe)
2014-09-16 13:59:32 -07:00
0c26412be4
HDFS-6965. NN continues to issue block locations for DNs with full
...
disks. Contributed by Rushabh Shah.
2014-09-16 09:04:54 -05:00
a7814e1aa4
Merge branch 'trunk' into HDFS-6581
2014-09-15 15:30:19 -07:00
a4dcbaa332
HDFS-7066. LazyWriter#evictBlocks misses a null check for replicaState. (Contributed by Xiaoyu Yao)
2014-09-15 15:28:17 -07:00
2f847b3357
HDFS-7059. HAadmin transtionToActive with forceActive option can show
...
confusing message. Contributed by Rushabh Shah.
2014-09-15 16:27:22 -05:00
ece3ecabdf
Merge remote-tracking branch 'origin/trunk' into HDFS-6584
2014-09-15 10:45:45 -07:00
43b0303008
HDFS-7032. Add WebHDFS support for reading and writing to encryption zones. Contributed by Charles Lamb.
2014-09-15 10:23:57 -07:00
2689b6ca72
HDFS-7062. Archival Storage: skip under construction block for migration. Contributed by Jing Zhao.
2014-09-15 10:16:56 -07:00
fc741b5d78
HDFS-7061. Add test to verify encryption zone creation after NameNode restart without saving namespace. Contributed by Stephen Chu.
2014-09-14 23:49:01 -07:00
dba52ce0bb
Merge branch 'trunk' into HDFS-6584
2014-09-13 14:56:48 +08:00
9f22fb8c9a
HDFS-6978. Directory scanner should correctly reconcile blocks on RAM disk. (Arpit Agarwal)
2014-09-12 22:13:18 -07:00
7aeda47bd9
Merge branch 'trunk' into HDFS-6581
2014-09-12 11:45:11 -07:00
d6ce26986e
HDFS-7051. TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file path separator. Contributed by Chris Nauroth.
2014-09-11 20:58:15 -07:00
17ffbe0864
Update CHANGES.txt to set the release date for 2.5.1
2014-09-11 17:35:35 -07:00
dc27ee9ae9
HDFS-7039. Archival Storage: fix Balancer tests. Contributed by Tsz Wo Nicholas Sze.
2014-09-11 14:19:18 -07:00
8de20a1987
Merge trunk into HDFS-6584
2014-09-11 13:04:35 -07:00
0d85f7e591
HDFS-7034. Archival Storage: Fix TestBlockPlacement and TestStorageMover. Contributed by Jing Zhao.
2014-09-11 13:00:43 -07:00
80ac6aabce
HDFS-7042. Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode. Contributed by Chris Nauroth.
2014-09-11 12:16:19 -07:00
1e684995d7
HDFS-7045. Fix NameNode deadlock when opening file under /.reserved path. Contributed by Yi Liu.
2014-09-11 10:59:09 -07:00
d1dab6cc63
HDFS-6621. Hadoop Balancer prematurely exits iterations. Contributed by Rafal Wodjdyla and Benjamin Bowman.
2014-09-11 10:32:20 -07:00
bf64fce78c
HDFS-6966. Add additional unit tests for encryption zones. Contributed by Stephen Chu.
2014-09-11 10:26:13 -07:00
70dfe9cfab
Merge branch 'trunk' into HDFS-6584
2014-09-11 15:23:38 +08:00
db41a1b7b9
Merge changes from trunk
2014-09-09 22:47:50 -07:00
bbff44cb03
HDFS-6776. Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work. (yzhangal via tucu)
2014-09-09 22:16:42 -07:00
4124905aa5
HDFS-7028: FSDirectory should not get storage policy id from symlinks
2014-09-10 12:34:15 +08:00
0de563a18e
HDFS-6482. Fix CHANGES.txt in trunk.
2014-09-09 18:09:10 -07:00
0d2f6b4600
Merge branch 'trunk' into HDFS-6581
2014-09-09 18:07:18 -07:00
05af0ff4be
Revert HDFS-6940.
2014-09-09 17:30:10 -07:00
be30c86cc9
HDFS-6482. Fix CHANGES.txt in trunk
2014-09-09 13:32:08 -07:00
2749fc677c
Newly moved block replica been invalidated and deleted in TestBalancer. Contributed by Binglin Chang.
2014-09-09 11:32:54 -07:00
61ccd50362
Merge branch 'trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
2014-09-08 22:44:04 -07:00
90c8ece188
HDFS-6981. Fix CHANGES.txt
2014-09-08 21:41:56 -07:00
f949f6b548
HDFS-6981. Fix DN upgrade with layout version change. (Arpit Agarwal)
2014-09-08 21:20:55 -07:00
7498dd790e
Update CHANGES.txt for HDFS-6951
2014-09-08 17:01:25 -07:00
04915a0814
HDFS-6951. Correctly persist raw namespace xattrs to edit log and fsimage. Contributed by Charles Lamb.
2014-09-08 16:59:30 -07:00
6997c1c658
Merge remote-tracking branch 'origin/trunk' into HDFS-6584
2014-09-08 15:15:34 -07:00
4ff128af12
Merge branch 'trunk' into HDFS-6581
2014-09-08 15:00:01 -07:00
867f0f141c
HDFS-7029. Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem. Contributed by Tsz Wo Nicholas Sze.
2014-09-08 14:57:27 -07:00
a18caf7753
HDFS-6991. Notify NN of evicted block before deleting it from RAM disk. (Arpit Agarwal)
2014-09-08 14:29:30 -07:00
74a7e227c8
HDFS-7027. Archival Storage: Mover does not terminate when some storage type is out of space. Contributed by Tsz Wo Nicholas Sze.
2014-09-08 14:21:26 -07:00
2b5c528a73
HDFS-6875. Archival Storage: support migration for a list of specified paths. Contributed by Jing Zhao.
2014-09-08 14:10:00 -07:00
d989ac0444
MAPREDUCE-5972. Fix typo 'programatically' in job.xml (and a few other places) (Akira AJISAKA via aw)
2014-09-08 13:15:46 -07:00
6c790a7ab0
HDFS-6893. crypto subcommand is not sorted properly in hdfs\'s hadoop_usage (David Luo via aw)
2014-09-08 13:10:53 -07:00
cad14aa916
HDFS-6036. Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long. (cmccabe)
2014-09-08 12:51:56 -07:00
6a84f88c11
HDFS-7005. DFS input streams do not timeout. Contributed by Daryn Sharp.
2014-09-08 14:41:44 -05:00
c1f8323234
HDFS-6943. Improve NN allocateBlock log to include replicas' datanode IPs. Contributed by Ming Ma.
2014-09-08 11:07:23 -07:00
ccdf0054a3
HDFS-6977. Delete all copies when a block is deleted from the block space. (Arpit Agarwal)
2014-09-08 10:35:54 -07:00
f1432e2424
Merge branch 'trunk' into HDFS-6584
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
2014-09-08 10:54:48 +08:00
eb8284d50e
Merge trunk into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDirectoryScanner.java
2014-09-07 14:46:46 -07:00
a23144fd8a
HDFS Credential Provider related Unit Test Failure. Contributed by Xiaoyu Yao.
2014-09-07 08:39:20 -07:00
d1fa58292e
HDFS-6898. DN must reserve space for a full block when an RBW block is created. (Contributed by Arpit Agarwal)
2014-09-06 21:04:29 -07:00
22a41dce4a
HDFS-6997: add more tests for data migration and replicaion.
2014-09-07 07:44:28 +08:00
31bbeaf383
Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
2014-09-06 12:28:22 -07:00
88209ce181
HDFS-6940. Refactoring to allow ConsensusNode implementation.
...
Contributed by Konstantin Shvachko.
2014-09-06 12:07:52 -07:00
3b35f81603
HDFS-6986. DistributedFileSystem must get delegation tokens from configured KeyProvider. (zhz via tucu)
2014-09-05 22:33:48 -07:00
339d21f273
Merge trunk into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
2014-09-05 21:36:25 -07:00
21c0cdeec1
HADOOP-11067 [HDFS-6998]. Fix CHANGES.txt
2014-09-05 14:29:57 -07:00
a149afd9e6
HADOOP-11052. hadoop_verify_secure_prereq's results aren't checked in bin/hdfs (aw)
2014-09-05 13:50:42 -07:00
fc68337049
HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao)
2014-09-05 13:50:42 -07:00
c5ef9c9e69
HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao)
2014-09-05 13:50:42 -07:00
c828b8aa91
HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth.
2014-09-05 13:50:42 -07:00
2cd5b4f20d
HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth.
2014-09-05 13:50:42 -07:00
54767d3ff4
Fix TestOfflineEditsViewer after merging.
2014-09-05 12:05:22 -07:00
300cb12bef
Merge trunk into HDFS-6584
2014-09-05 11:37:22 -07:00
7a62515c86
HADOOP-11052. hadoop_verify_secure_prereq's results aren't checked in bin/hdfs (aw)
2014-09-05 11:31:49 -07:00
71269f7097
HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao)
2014-09-05 11:14:10 -07:00
9609b7303a
HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao)
2014-09-05 11:10:58 -07:00
b051327ab6
HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth.
2014-09-05 11:07:41 -07:00
fab9bc58ec
HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth.
2014-09-05 11:03:58 -07:00
9e941d9f99
HDFS-6831. Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'. (Contributed by Xiaoyu Yao)
2014-09-05 10:45:54 -07:00
c6107f566f
HDFS-6376. Distcp data between two HA clusters requires another configuration. Contributed by Dave Marion and Haohui Mai.
2014-09-05 10:40:02 -07:00
772d1fb01e
HDFS-6714. TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster (vinayakumarb)
2014-09-05 10:25:09 +05:30
185200e709
HDFS-6876. Archival Storage: support set/get storage policy in DFSAdmin. Contributed by Jing Zhao.
2014-09-04 20:14:46 -07:00
6104520369
HDFS-6886. Use single editlog record for creating file + overwrite. Contributed by Yi Liu.
2014-09-04 18:54:38 -07:00
f7df24bb1b
HDFS-6996. SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file. Contributed by Jing Zhao.
2014-09-04 16:12:44 -07:00
e08701ec71
HDFS-6961. Archival Storage: BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round.
2014-09-04 14:19:32 -07:00
1a09536141
Fixing HDFS CHANGES.txt, missing HDFS-6905 entry
2014-09-04 11:07:08 -07:00
f4caedfcbf
HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang
2014-09-03 19:30:30 -07:00
3a0142bd77
HDFS-6848. Lack of synchronization on access to datanodeUuid in DataStorage#format. (Contributed by Xiaoyu Yao)
2014-09-03 17:17:06 -07:00
45d5b13256
Merge changes from trunk
2014-09-03 15:36:47 -07:00
cb9b485075
HDFS-6930. Improve replica eviction from RAM disk. (Arpit Agarwal)
2014-09-03 13:53:01 -07:00
08a8f2be81
Merge trunk into HDFS-6581
2014-09-03 10:53:37 -07:00
762b04e994
HDFS-6950. Add Additional unit tests for HDFS-6581. (Contributed by Xiaoyu Yao)
2014-09-03 10:51:26 -07:00
ce0462129f
HADOOP-10956. Fix create-release script to include docs and necessary txt files. (kasha)
2014-09-03 09:39:02 -07:00
3425ae5d7e
HDFS-2975. Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). (Yi Liu via umamahesh)
2014-09-03 18:53:51 +05:30
a6b32a3e78
Merge trunk into HDFS-6581
2014-09-02 16:25:32 -07:00
08a9ac7098
HDFS-6942. Fix typos in log messages. Contributed by Ray Chiang.
2014-09-02 16:22:18 -07:00
727331becc
HDFS-4257. The ReplaceDatanodeOnFailure policies could have a forgiving option. Contributed by szetszwo.
2014-09-02 15:14:33 -07:00
a0ccf83dfd
HDFS-6954. With crypto, no native lib systems are too verbose. Contributed by Charles Lamb.
2014-09-02 14:22:20 -07:00
faa4455be5
HDFS-6634. inotify in HDFS. Contributed by James Thomas.
2014-09-02 14:02:29 -07:00
3e2a0b5446
HDFS-6969. Archival Storage: INode#getStoragePolicyID should always return the latest storage policy. Contributed by Jing Zhao.
2014-09-01 17:56:04 -07:00
217dea7794
Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
2014-09-01 11:52:59 -07:00
6066b1a455
HDFS-6972. TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration doesn't decode url correctly. Contributed by Yongjun Zhang.
2014-08-29 15:47:01 -07:00
f65183eba3
Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
2014-08-29 13:37:17 -07:00
7eab2a29a5
HDFS-6774. Make FsDataset and DataStore support removing volumes. Contributed by Lei Xu.
2014-08-29 13:00:17 -07:00
4ae8178c56
HDFS-6800. Support Datanode layout changes with rolling upgrade. (Contributed by James Thomas)
2014-08-29 00:26:13 -07:00
c92837aeab
HDFS-6931. Move lazily persisted replicas to finalized directory on DN startup. (Arpit Agarwal)
2014-08-28 23:13:46 -07:00
4cf9afacbe
HDFS-6960. Bugfix in LazyWriter, fix test case and some refactoring. (Arpit Agarwal)
2014-08-28 23:05:32 -07:00
7e32be8768
Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
...
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2014-08-28 19:06:46 -07:00
2ca93d1fbf
Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2
...
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-mapreduce-project/CHANGES.txt
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-08-28 19:05:57 -07:00
d8774cc577
HADOOP-11013. CLASSPATH handling should be consolidated, debuggable (aw)
2014-08-28 18:09:25 -07:00
ab638e77b8
HDFS-6865. Byte array native checksumming on client side. Contributed by James Thomas.
2014-08-28 16:44:09 -07:00
bbaa7dc28d
HDFS-6928. 'hdfs put' command should accept lazyPersist flag for testing. (Arpit Agarwal)
2014-08-28 15:53:12 -07:00
d9a7404c38
Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2
...
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-mapreduce-project/CHANGES.txt
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-08-28 15:10:59 -07:00
2e987148e0
HDFS-6929. NN periodically unlinks lazy persist files with missing replicas from namespace. (Arpit Agarwal)
2014-08-27 21:47:19 -07:00
3f64c4aaf0
HDFS-6927. Initial unit tests for Lazy Persist files. (Arpit Agarwal)
2014-08-27 21:47:19 -07:00
eb448e1439
HDFS-6926. DN support for saving replicas to persistent storage and evicting in-memory replicas. (Arpit Agarwal)
2014-08-27 21:47:19 -07:00
a317bd7b02
HDFS-6925. DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received. (Arpit Agarwal)
2014-08-27 21:47:19 -07:00
c2354a7f81
HDFS-6923. Propagate LazyPersist flag to DNs via DataTransferProtocol. (Arpit Agarwal)
2014-08-27 21:47:18 -07:00
042b33f20b
HDFS-6922. Add LazyPersist flag to INodeFile, save it in FsImage and edit logs. (Arpit Agarwal)
2014-08-27 21:47:18 -07:00
7f49537ba1
HDFS-6924. Add new RAM_DISK storage type. (Arpit Agarwal)
2014-08-27 21:47:18 -07:00
a7bcc95358
HDFS-6921. Add LazyPersist flag to FileStatus. (Arpit Agarwal)
2014-08-27 21:47:18 -07:00
7a16731191
HADOOP-10957. The globber will sometimes erroneously return a permission denied exception when there is a non-terminal wildcard.
2014-08-27 19:47:10 -07:00
a26aa6bd07
HDFS-6944. Archival Storage: add retry and termination logic for Mover. Contributed by Jing Zhao.
2014-08-27 14:20:54 -07:00
37549576e7
Add HDFS-6879 to CHANGES.txt
2014-08-27 14:18:18 -07:00
6962510f72
HDFS-6879. Adding tracing to Hadoop RPC. Contributed by Masatake Iwasaki.
2014-08-27 14:12:05 -07:00
b7ded466b0
HDFS-6920. Archival Storage: check the storage type of delNodeHintStorage when deleting a replica. Contributed by Tsz Wo Nicholas Sze.
2014-08-27 14:08:02 -07:00
b6b95ff667
HDFS-6902. FileWriter should be closed in finally block in BlockReceiver#receiveBlock() (Tsuyoshi OZAWA via Colin Patrick McCabe)
2014-08-27 13:49:31 -07:00
225569ece2
HDFS-4486. Add log category for long-running DFSClient notices. Contributed by Zhe Zhang.
2014-08-27 13:39:40 -07:00
d805cc27a9
HDFS-6773. MiniDFSCluster should skip edit log fsync by default. Contributed by Stephen Chu.
2014-08-27 13:33:02 -07:00
26ebdd849b
HDFS-6938. Cleanup javac warnings in FSNamesystem. Contributed by Charles Lamb.
2014-08-27 11:14:39 -07:00
cd9182d8b5
HDFS-6892. Add XDR packaging method for each NFS request. Contributed by Brandon Li
2014-08-27 11:06:01 -07:00
8ea20b53a8
HDFS-6911. Archival Storage: check if a block is already scheduled in Mover. Contributed by Tsz Wo Nicholas Sze.
2014-08-27 10:38:10 -07:00
555900a9dc
Merge branch 'trunk' into HDFS-6584
2014-08-27 10:32:30 -07:00
6b441d227a
HDFS-6908. Incorrect snapshot directory diff generated by snapshot deletion. Contributed by Juan Yu and Jing Zhao.
2014-08-27 10:26:22 -07:00
c5d9a4a91e
HDFS-6694. TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms - debugging patch (Contributed by Yongjun Zhang)
2014-08-27 09:52:33 -07:00
9ec4a930f5
HADOOP-10996. Stop violence in the *_HOME (aw)
2014-08-27 07:00:31 -07:00
dc154ab86d
Add a section for 2.5.1 in CHANGES.txt
2014-08-27 00:55:19 -07:00
e871955765
HDFS-6899. Allow changing MiniDFSCluster volumes per DN and capacity per volume. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619970 13f79535-47bb-0310-9956-ffa450edef68
2014-08-23 06:01:17 +00:00
a83d055f25
HDFS-4852. libhdfs documentation is out of date. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619967 13f79535-47bb-0310-9956-ffa450edef68
2014-08-23 05:30:21 +00:00
e6c3650070
HDFS-6829. DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster. (Contributed by zhaoyunjiong)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619882 13f79535-47bb-0310-9956-ffa450edef68
2014-08-22 18:14:55 +00:00
3aa3b0abc2
HDF-6905. fs-encryption merge triggered release audit failures. (clamb via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619667 13f79535-47bb-0310-9956-ffa450edef68
2014-08-22 05:17:22 +00:00
e69954d22c
HDFS-6906. Archival Storage: Add more tests for BlockStoragePolicy. Contributed by Tsz Wo Nicholas Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619628 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 23:42:33 +00:00
603cbe5eea
HDFS-6863. Archival Storage: Support migration for snapshot paths. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619627 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 23:41:10 +00:00
7b28f363b1
HDFS-6890. NFS readdirplus doesn't return dotdot attributes. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619500 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 17:53:54 +00:00
c92d869d02
Merge r1609845 through r1619277 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619293 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 05:22:10 +00:00
6824abc19e
HDFS-6758. Block writer should pass the expected block size to DataXceiverServer (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619275 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 01:13:49 +00:00
8f00897a4b
HDFS-6878. Change MiniDFSCluster to support StorageType configuration for individual directories. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619271 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 00:42:27 +00:00
8304001861
HDFS-6858. Allow dfs.data.transfer.saslproperties.resolver.class default to hadoop.security.saslproperties.resolver.class. Contributed by Benoy Antony.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619256 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 22:46:35 +00:00
9b8250c742
Set the release date for 2.5.0 in CHANGES.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619237 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 21:33:19 +00:00
b0f0ef17f0
Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619203 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 18:56:56 +00:00
834fccf02b
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1619194 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 18:19:13 +00:00
f20d363126
HDFS-6870. Blocks and INodes could leak for Rename with overwrite flag. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619192 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 18:13:03 +00:00
d2a39b61aa
Merge from trunk to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1619018 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 01:22:42 +00:00
fbc1ee4d6f
HDFS-6868. portmap and nfs3 are documented as hadoop commands instead of hdfs. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619001 13f79535-47bb-0310-9956-ffa450edef68
2014-08-19 22:31:57 +00:00
31467453ec
HADOOP-9902. Shell script rewrite (aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618847 13f79535-47bb-0310-9956-ffa450edef68
2014-08-19 12:11:17 +00:00
4e324bcd3d
Merge r1609845 through r1618763 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618764 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 23:41:53 +00:00
2fb04d2a30
HDFS-6569. OOB message can't be sent to the client when DataNode shuts down for upgrade. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618742 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 21:23:08 +00:00
1b5139b29a
HDFS-6188. An ip whitelist based implementation of TrustedChannelResolver. (Contributed by Benoy Antony)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618727 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 20:50:06 +00:00
0cc08f6da4
Merge from trunk to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1618700 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 18:41:31 +00:00
bd616552cc
HDFS-6825. Edit log corruption due to delayed block removal. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618684 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 18:08:42 +00:00
5d5aae0694
HDFS-6801. Archival Storage: Add a new data migration tool. Contributed by Tsz Wo Nicholas Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618675 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 17:51:18 +00:00
1c77c80410
HDFS-6783. Addendum patch to fix test failures. (Contributed by Yi Liu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618635 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 15:34:58 +00:00
cb75b6b07d
Merge r1609845 through r1618416 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618417 13f79535-47bb-0310-9956-ffa450edef68
2014-08-16 21:02:21 +00:00
9b250d74f0
HDFS-6847. Support storage policy on directories and include storage policy in HdfsFileStatus. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618416 13f79535-47bb-0310-9956-ffa450edef68
2014-08-16 20:58:20 +00:00
31e478905a
Wrong categorization for a variety of commits in the CHANGES.txt files
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618233 13f79535-47bb-0310-9956-ffa450edef68
2014-08-15 16:47:34 +00:00
894b4e427f
HDFS-6850. Move NFS out of order write unit tests into TestWrites class. Contributed by Zhe Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618091 13f79535-47bb-0310-9956-ffa450edef68
2014-08-15 02:33:24 +00:00
20dcb841ce
HDFS-6546. Add non-superuser capability to get the encryption zone for a specific path. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1618022 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 19:11:06 +00:00
13ad623b9d
Updated contributors name in CHANGES.txt for HDFS-6783
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617880 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 04:57:47 +00:00
44864c68b5
HDFS-6783. Fix HDFS CacheReplicationMonitor rescan logic. Contributed by Yi Liu and Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617872 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 04:20:00 +00:00
065d9ec5d9
HDFS-6849. Replace HttpFS custom proxyuser handling with common implementation. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617831 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 20:27:50 +00:00
195961a7c1
HDFS-6247. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (vinayakumarb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617799 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 18:43:05 +00:00
6554994fab
Reverted
...
Merged revision(s) 1617784 from hadoop/common/trunk:
HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.)
........
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617794 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 18:36:51 +00:00
471b1368e2
HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617784 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 18:06:33 +00:00
03d8ff496a
HDFS-6567. Normalize the order of public final in HdfsFileStatus. Contributed by Tassapol Athiapinya.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617779 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 17:45:47 +00:00
a34dafe325
HADOOP-8944. Shell command fs -count should include human readable option (Jonathan Allen via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617775 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 17:30:26 +00:00
a72fba5853
HDFS-6836. HDFS INFO logging is verbose & uses file appenders. (Contributed by Xiaoyu Yao)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617603 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 21:49:48 +00:00
arp
Andrew Wang
Colin Patrick Mccabe
Jing Zhao
Tsz-Wo Nicholas Sze
Alejandro Abdelnur
Benoy Antony
Allen Wittenauer
Kihwal Lee
Jing Zhao
cnauroth
Karthik Kambatla
Konstantin V Shvachko
Haohui Mai
Vinayakumar B
Uma Maheswara Rao G
Aaron T. Myers
Alejandro Abdelnur
Todd Lipcon
brandonli
Brandon Li
Tsz-wo Sze
Charles Lamb