Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,865 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

2246 Commits

Author SHA1 Message Date
cnauroth c03cca7e23 HDFS-7128. Decommission slows way down when it gets towards the end. Contributed by Ming Ma. 
(cherry picked from commit 80cb472620f0a7889e311ca32212a42b95c6794e)
(cherry picked from commit 7e949744b1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeDescriptor.java
 2014-10-27 16:41:55 -07:00
cnauroth a9f31af29c HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth. 
(cherry picked from commit 463aec1171)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java

(cherry picked from commit 3d67da502a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/BlockReaderLocal.java
 2014-10-27 12:01:47 -07:00
Colin Patrick Mccabe 62f23d0b7d HDFS-6988. Improve HDFS-6581 eviction configuration (Xiaoyu Yao via Colin P. McCabe) 
(cherry picked from commit a52eb4bc5f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
(cherry picked from commit 2bcda17ee7)
 2014-10-24 13:22:26 -07:00
Jitendra Pandey 327db15362 HDFS-6904. YARN unable to renew delegation token fetched via webhdfs due to incorrect service port. 2014-10-24 11:44:22 -07:00
yliu 82ac5c901e HDFS-7243. HDFS concat operation should not be allowed in Encryption Zone. (clamb via yliu) 2014-10-24 11:35:13 +08:00
Brandon Li e1baa3a503 HDFS-7180. NFSv3 gateway frequently gets stuck due to GC. Contributed by Brandon Li 
(cherry picked from commit d71d40a63d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit d27cd5ad77)
 2014-10-22 21:35:09 -07:00
Colin Patrick Mccabe 1ec2dbf093 HDFS-7154. Fix returning value of starting reconfiguration task (Lei Xu via Colin P. McCabe) 
(cherry picked from commit 7aab5fa1bd)
(cherry picked from commit 8c3b007236)
 2014-10-21 15:42:39 -07:00
Brandon Li 20108263fb HDFS-7215.Add JvmPauseMonitor to NFS gateway. Contributed by Brandon Li 
(cherry picked from commit 4e134a02a4)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit c800e058ea)
 2014-10-21 11:56:26 -07:00
Brandon Li 3fa1ee2923 HDFS-7259. Unresponseive NFS mount point due to deferred COMMIT response. Contributed by Brandon Li 
(cherry picked from commit 33e020cb19)
 2014-10-21 11:05:50 -07:00
Tsz-Wo Nicholas Sze 0ee6ddb782 HDFS-7260. Change DFSOutputStream.MAX_PACKETS to be configurable. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
 2014-10-17 18:34:23 -07:00
cnauroth 2e98379bcb HDFS-7090. Use unbuffered writes when persisting in-memory replicas. Contributed by Xiaoyu Yao. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-17 16:00:53 -07:00
cnauroth 1b6d115ccf HDFS-7112. LazyWriter should use either async IO or one thread per physical disk. Contributed by Xiaoyu Yao. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-17 16:00:53 -07:00
Tsz-Wo Nicholas Sze fd036896a8 HDFS-5089. When a LayoutVersion support SNAPSHOT, it must support FSIMAGE_NAME_OPTIMIZATION. 2014-10-15 20:59:38 -07:00
Tsz-Wo Nicholas Sze 253e3eb31c HDFS-7208. NN doesn't schedule replication when a DN storage fails. Contributed by Ming Ma 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeDescriptor.java
 2014-10-15 20:49:18 -07:00
Jing Zhao 439560dcf2 HDFS-7185. The active NameNode will not accept an fsimage sent from the standby during rolling upgrade. Contributed by Jing Zhao. 2014-10-15 10:28:40 -07:00
Jing Zhao 3d2d501abb HDFS-7228. Add an SSD policy into the default BlockStoragePolicySuite. Contributed by Jing Zhao. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockStoragePolicySuite.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestBlockStoragePolicy.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestStorageMover.java
 2014-10-14 10:43:12 -07:00
Tsz-Wo Nicholas Sze 20fc34edac HDFS-7237. The command "hdfs namenode -rollingUpgrade" throws ArrayIndexOutOfBoundsException. 2014-10-13 18:37:34 -07:00
Haohui Mai 4fb157655a HDFS-6544. Broken Link for GFS in package.html. Contributed by Suraj Nayak M. 2014-10-13 10:35:48 -07:00
Jing Zhao 369ef7c4b7 HDFS-7236. Fix TestOpenFilesWithSnapshot#testOpenFilesWithMultipleSnapshots. Contributed by Yongjun Zhang. 2014-10-13 10:30:44 -07:00
cnauroth 754718aed5 HDFS-7195. Update user doc of secure mode about Datanodes don't require root or jsvc. Contributed by Chris Nauroth. 
(cherry picked from commit 4e544c84e9)
 2014-10-09 11:57:00 -07:00
Kihwal Lee 0280e9aee0 HDFS-7217. Better batching of IBRs. Contributed by Kihwal Lee. 
(cherry picked from commit db71bb54bc)
 2014-10-09 12:11:42 -05:00
Kihwal Lee 522b6505f4 HDFS-7203. Concurrent appending to the same file can cause data 
corruption. Contributed by Kihwal Lee.
(cherry picked from commit 853cb704ed)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-08 15:10:03 -05:00
Haohui Mai f567f3c833 HDFS-7172. Test data files may be checked out of git with incorrect line endings, causing test failures in TestHDFSCLI. Contributed by Chris Nauroth. 
(cherry picked from commit 5db04a5a1a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-06 09:15:41 -07:00
Colin Patrick Mccabe cf025cc39b HDFS-7176. The namenode usage message doesn't include "-rollingupgrade started" (cmccabe) 
(cherry picked from commit dd1b8f2ed8)
(cherry picked from commit 1725d56132)
 2014-10-02 14:08:15 -07:00
Colin Patrick Mccabe 94277a7d21 HDFS-7162. Wrong path when deleting through fuse-dfs a file which already exists in trash (cmccabe) 
(cherry picked from commit 03db9cc839)
(cherry picked from commit ab1afc4e1c)
 2014-10-02 14:07:44 -07:00
Andrew Wang dea3f133ff HDFS-7181. Remove incorrect precondition check on key length in FileEncryptionInfo. (wang) 
(cherry picked from commit 6ac10516e7)
(cherry picked from commit 6dbba19469)
 2014-10-02 14:01:30 -07:00
Andrew Wang 59e9858181 HDFS-7179. DFSClient should instantiate a KeyProvider, not a KeyProviderCryptoExtension. (wang) 
(cherry picked from commit d2d5a0ea03)
(cherry picked from commit 6ddd9eff78)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-02 14:01:20 -07:00
arp 39bad4a4c8 HDFS-7178. Additional unit test for replica write with full disk. (Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-02 09:29:44 -07:00
Haohui Mai 5d2f325483 HDFS-6894. Add XDR parser method for each NFS response. Contributed by Brandon Li. 2014-10-01 13:22:12 -07:00
Haohui Mai 0eec4c187c HDFS-7158. Reduce the memory usage of WebImageViewer. Contributed by Haohui Mai. 2014-10-01 13:22:07 -07:00
Kihwal Lee bd69f86668 HDFS-6754. TestNamenodeCapacityReport.testXceiverCount may sometimes fail due to lack of retry. Contributed by Mit Desai. 
(cherry picked from commit 3f25d916d5)
 2014-10-01 14:44:30 -05:00
arp 0abbfcf2d0 HDFS-7153. Add storagePolicy to NN edit log during file creation. (Arpit Agarwal) 2014-09-30 23:34:11 -07:00
Jing Zhao 62d47e3965 HDFS-7167. NPE while running Mover if the given path is for a file. Contributed by Jing Zhao. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-30 11:23:45 -07:00
Arun C. Murthy d3e61c96b5 Branching for hadoop-2.6 2014-09-30 10:38:47 -07:00
Arun C. Murthy 6a60fa279a Preparing to branch hadoop-2.6 2014-09-30 10:37:03 -07:00
Haohui Mai eea383ff2e HDFS-6779. Add missing version subcommand for hdfs. Contributed by Sasaki Toru. 2014-09-29 18:20:44 -07:00
Andrew Wang 47ddaee1db HDFS-7122. Use of ThreadLocal<Random> results in poor block placement. (wang) 
(cherry picked from commit d7086c563ff2847c415913ac625b2a557eeccbdd)
 2014-09-29 15:00:28 -07:00
Andrew Wang 38f3b11c29 HDFS-7124. Remove EncryptionZoneManager.NULL_EZ. (clamb via wang) 
(cherry picked from commit 7f0efe96f8)
 2014-09-29 14:14:49 -07:00
Andrew Wang d551a95fc4 Move HDFS-7157 to HDFS CHANGES.txt 
(cherry picked from commit a45b331cc9)
 2014-09-29 13:17:28 -07:00
Andrew Wang 58bdba9dc0 HDFS-7104. Fix and clarify INodeInPath getter functions. Contributed by Zhe Zhang. 
(cherry picked from commit f0293f11a8)
 2014-09-29 12:58:45 -07:00
Suresh Srinivas c7cf212b2a HDFS-4165. Faulty sanity check in FsDirectory.unprotectedSetQuota. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407245 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0f7a4337ac)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-29 11:06:17 -07:00
Allen Wittenauer dacf2b5515 HDFS-4227. Document dfs.namenode.resource.* (Daisuke Kobayashi via aw) 2014-09-29 09:01:59 -07:00
Allen Wittenauer 96fc90a9c4 HDFS-6519. Document oiv_legacy command (Akira AJISAKA via aw) 2014-09-29 08:51:55 -07:00
arp 8ebea28b40 HDFS-7093. Add config key to restrict setStoragePolicy. (Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-28 19:34:25 -07:00
Konstantin V Shvachko 3472221989 HDFS-7156. Update fsck documentation. Contributed by Masahiro Yamaguch. 2014-09-27 21:26:38 -07:00
Allen Wittenauer 3c86c68078 HDFS-6664. HDFS permissions guide documentation states incorrect default group mapping class. (Ray Chiang via aw) 2014-09-26 12:21:37 -07:00
Colin Patrick Mccabe b5b4cb4d64 HDFS-6956. Allow dynamically changing the tracing level in Hadoop servers (cmccabe) 
(cherry picked from commit 55302ccfba)
 2014-09-26 10:34:42 -07:00
Andrew Wang 09c324a4a8 HDFS-7148. TestEncryptionZones#testIsEncryptedMethod fails on branch-2 after archival storage merge. (wang) 2014-09-25 21:50:12 -07:00
Andrew Wang 3f71a15813 HDFS-7077. Separate CipherSuite from crypto protocol version. (wang) 
(cherry picked from commit e96ce6f3e3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-25 18:42:17 -07:00
Jing Zhao 9ad9e51cd9 HDFS-7131. During HA upgrade, JournalNode should create a new committedTxnId file in the current directory. Contributed by Jing Zhao. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-25 17:18:02 -07:00
Jing Zhao 87f07e67b1 HDFS-7140. Add a tool to list all the existing block storage policies. Contributed by Jing Zhao. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
 2014-09-26 05:16:44 +08:00
Jing Zhao f83096d49c HDFS-7081. Add new DistributedFileSystem API for getting all the existing storage policies. Contributed by Jing Zhao. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-26 05:08:32 +08:00
Jing Zhao ba3182c60c HDFS-7095. Archival Storage: TestStorageMover often fails in Jenkins. Contributed by Jing Zhao. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-26 05:02:21 +08:00
Tsz-Wo Nicholas Sze 788ba5e4c4 Revise the HDFS-6584 entry CHANGES.txt. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-26 04:59:00 +08:00
Tsz-Wo Nicholas Sze 80bd4d88eb Fix hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt for HDFS-6584 after 
merge.

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-26 04:57:45 +08:00
Tsz-Wo Nicholas Sze 022474c807 Merge branch 'HDFS-6584' into trunk 
Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicyConsiderLoad.java
 2014-09-26 04:47:25 +08:00
cnauroth fd3aa38231 HDFS-7119. Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics. Contributed by Chris Nauroth. 
(cherry picked from commit 9f9a2222a2)
 2014-09-25 13:35:40 -07:00
Colin Patrick Mccabe cb9283549f HDFS-6808. Add command line option to ask DataNode reload configuration. (Lei Xu via Colin McCabe) 
(cherry picked from commit 1861b32eb5)
 2014-09-25 13:22:35 -07:00
cnauroth 6bace90b29 HDFS-7127. TestLeaseRecovery leaks MiniDFSCluster instances. Contributed by Chris Nauroth. 
(cherry picked from commit b607c3c363)
 2014-09-25 11:29:15 -07:00
cnauroth 94517982a9 HDFS-7111. TestSafeMode assumes Unix line endings in safe mode tip. Contributed by Chris Nauroth. 
(cherry picked from commit dc2ebf88a8)
 2014-09-25 11:21:07 -07:00
cnauroth 707a7dbd24 HDFS-7118. Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename. Contributed by Chris Nauroth. 
(cherry picked from commit e0b1dc514f)
 2014-09-25 10:06:09 -07:00
Andrew Wang 835ade7064 HDFS-7138. Fix hftp to work with encryption. (clamb via wang) 2014-09-24 16:45:29 -07:00
Andrew Wang a17544e5e3 HDFS-7139. Unit test for creating encryption zone on root path. (Zhe Zhang via wang) 
(cherry picked from commit 63198bfba7)
 2014-09-24 16:40:40 -07:00
Andrew Wang 3cf28210ec HDFS-6987. Move CipherSuite xattr information up to the encryption zone root. (Zhe Zhang via wang) 2014-09-24 12:11:45 -07:00
Haohui Mai 53c2288dc6 HDFS-7049. TestByteRangeInputStream.testPropagatedClose fails and throw NPE on branch-2. Contributed by Juan Yu. 2014-09-24 12:07:26 -07:00
Allen Wittenauer 151281bfca HDFS-6534. Fix build on macosx: HDFS parts (Binglin Chang via aw) 2014-09-24 08:35:31 -07:00
cnauroth fd3003d63b HDFS-7130. TestDataTransferKeepalive fails intermittently on Windows. Contributed by Chris Nauroth. 
(cherry picked from commit b93d9603a2)
 2014-09-23 14:44:26 -07:00
Andrew Wang 0d116b18de HDFS-7132. hdfs namenode -metadataVersion command does not honor configured name dirs. Contributed by Charles Lamb. 
(cherry picked from commit f48686a1ad)
 2014-09-23 14:10:40 -07:00
cnauroth ac3b62dae7 HDFS-7126. TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao. 
(cherry picked from commit a1fd804a31)
 2014-09-23 08:22:04 -07:00
Colin Patrick Mccabe cac7063b31 HDFS-7001. Tests in TestTracing should not depend on the order of execution. (iwasakims via cmccabe) 
(cherry picked from commit 7b8df93ce1)
 2014-09-22 17:22:42 -07:00
Colin Patrick Mccabe d7b0e9382d HDFS-7106. Reconfiguring DataNode volumes does not release the lock files in removed volumes. (cnauroth via cmccabe) 
(cherry picked from commit 912ad32b03)
 2014-09-22 11:52:01 -07:00
cnauroth 39bcc57c3e HDFS-7115. TestEncryptionZones assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao. 
(cherry picked from commit 26cba7f35f)
 2014-09-22 09:07:41 -07:00
cnauroth 4a77729a1c HDFS-7110. Skip tests related to short-circuit read on platforms that do not currently implement short-circuit read. Contributed by Chris Nauroth. 
(cherry picked from commit b6fd5ccbce)
 2014-09-21 12:37:37 -07:00
cnauroth 465ba7fe31 HDFS-7109. TestDataStorage does not release file locks between tests. Contributed by Chris Nauroth. 
(cherry picked from commit 0795fe3721)
 2014-09-20 21:01:52 -07:00
cnauroth 3ad3f034bb HDFS-7107. Avoid Findbugs warning for synchronization on AbstractNNFailoverProxyProvider#fallbackToSimpleAuth. Contributed by Chris Nauroth. 
(cherry picked from commit 47491f9a11)
 2014-09-20 20:53:38 -07:00
cnauroth cadba3067f HDFS-7073. Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases. Contributed by Chris Nauroth. 
(cherry picked from commit f85cc14eb4)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
 2014-09-19 22:04:13 -07:00
cnauroth 9ee5e26cbb HDFS-7105. Fix TestJournalNode#testFailToStartWithBadConfig to match log output change. Contributed by Ray Chiang. 
(cherry picked from commit 332e2e23ba)
 2014-09-19 21:06:04 -07:00
Kihwal Lee b55aa50ec6 HDFS-7046. HA NN can NPE upon transition to active. Contributed by 
Kihwal Lee.
(cherry picked from commit 9e35571965)
 2014-09-19 17:08:30 -05:00
Colin Patrick Mccabe 5520ca6ec3 HDFS-7096. Fix TestRpcProgramNfs3 to use DFS_ENCRYPTION_KEY_PROVIDER_URI (clamb via cmccabe) 
(cherry picked from commit 25fd69a8f9)
 2014-09-19 09:20:55 -07:00
Kihwal Lee 35fccfda3e HDFS-7065. Pipeline close recovery race can cause block corruption. 
Contributed by Kihwal Lee.
(cherry picked from commit bf27b9ca57)
 2014-09-19 09:01:27 -05:00
Kihwal Lee 2a6c9f0725 HDFS-6948. DN rejects blocks if it has older UC block. Contributed by 
Eric Payne.
(cherry picked from commit f02d934fed)
 2014-09-19 08:52:16 -05:00
Andrew Wang 58d9cc0914 HDFS-6840. Clients are always sent to the same datanode when read is off rack. (wang) 
(cherry picked from commit 8e73084491)
 2014-09-18 18:14:10 -07:00
Andrew Wang ef693b541c HDFS-6970. Move startFile EDEK retries to the DFSClient. (wang) 
(cherry picked from commit 20a076bafc)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-18 17:41:22 -07:00
Colin Patrick Mccabe d329237990 HDFS-6727. Refresh data volumes on DataNode based on configuration changes (Lei Xu via Colin Patrick McCabe) 
(cherry picked from commit fe38d2e9b5)
 2014-09-18 16:53:07 -07:00
Andrew Wang 47c9dcfe8e HDFS-7003. Add NFS Gateway support for reading and writing to encryption zones. (clamb via wang) 
(cherry picked from commit 70be56d093)
 2014-09-18 14:57:33 -07:00
Colin Patrick Mccabe 2b1c9c6210 HDFS-7047. Expose FileStatus#isEncrypted in libhdfs (cmccabe) 
(cherry picked from commit 570b8b468e)
 2014-09-18 11:42:53 -07:00
Andrew Wang 008e2f68f1 HDFS-7078. Fix listEZs to work correctly with snapshots. (wang) 
(cherry picked from commit 0ecefe6017)
 2014-09-17 21:28:15 -07:00
Andrew Wang b477d30e63 HDFS-7004. Update KeyProvider instantiation to create by URI. (wang) 
(cherry picked from commit 10e8602f32)
 2014-09-17 20:15:42 -07:00
Andrew Wang b05da10d0d Move some HDFS JIRAs to the correct CHANGES.txt 2014-09-17 18:08:24 -07:00
Andrew Wang 5e54aae62b HDFS-6705. Create an XAttr that disallows the HDFS admin from accessing a file. (clamb via wang) 
(cherry picked from commit ea4e2e843e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-17 11:26:17 -07:00
Andrew Wang fcd181bde1 HDFS-6789. TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7. Contributed by Akira Ajisaka. 
(cherry picked from commit a044407b5c)
 2014-09-16 17:03:52 -07:00
Andrew Wang 23f34b75e4 HDFS-6851. Refactor EncryptionZoneWithId and EncryptionZone. (clamb via wang) 
(cherry picked from commit 33ce887c20)
 2014-09-16 16:57:06 -07:00
Alejandro Abdelnur 5d897026e4 HDFS-7006. Test encryption zones with KMS. (Anthony Young-Garner and tucu) 2014-09-16 14:37:04 -07:00
Colin Patrick Mccabe 9be338911b HDFS-6880. Adding tracing to DataNode data transfer protocol (iwasakims via cmccabe) 
(cherry picked from commit 56119fec96)
 2014-09-16 13:59:58 -07:00
Kihwal Lee 08abb320a7 HDFS-6965. NN continues to issue block locations for DNs with full 
disks. Contributed by Rushabh Shah.
(cherry picked from commit 0c26412be4)
 2014-09-16 09:06:43 -05:00
Kihwal Lee e6e31fbbba HDFS-7059. HAadmin transtionToActive with forceActive option can show 
confusing message. Contributed by Rushabh Shah.
(cherry picked from commit 2f847b3357)
 2014-09-15 16:30:22 -05:00
Andrew Wang d595557859 HDFS-7032. Add WebHDFS support for reading and writing to encryption zones. Contributed by Charles Lamb. 
(cherry picked from commit 43b0303008)
 2014-09-15 10:24:38 -07:00
Andrew Wang dd3e28d434 HDFS-7061. Add test to verify encryption zone creation after NameNode restart without saving namespace. Contributed by Stephen Chu. 
(cherry picked from commit fc741b5d78)
 2014-09-14 23:49:26 -07:00
cnauroth 993ede4db3 HDFS-7051. TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file path separator. Contributed by Chris Nauroth. 
(cherry picked from commit d6ce26986e)
 2014-09-11 20:58:54 -07:00
Karthik Kambatla d22cd065ed Update CHANGES.txt to set the release date for 2.5.1 
(cherry picked from commit 17ffbe0864)
 2014-09-11 17:36:06 -07:00
cnauroth ac296f9522 HDFS-7042. Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode. Contributed by Chris Nauroth. 
(cherry picked from commit 80ac6aabce)
 2014-09-11 12:17:19 -07:00
Andrew Wang 6151c2bea7 HDFS-7045. Fix NameNode deadlock when opening file under /.reserved path. Contributed by Yi Liu. 
(cherry picked from commit 1e684995d7)
 2014-09-11 10:59:24 -07:00
Andrew Wang c90e15c559 HDFS-6621. Hadoop Balancer prematurely exits iterations. Contributed by Rafal Wodjdyla and Benjamin Bowman. 
(cherry picked from commit d1dab6cc63)
 2014-09-11 10:32:57 -07:00
Andrew Wang 0fae8a0e14 HDFS-6966. Add additional unit tests for encryption zones. Contributed by Stephen Chu. 
(cherry picked from commit bf64fce78c)
 2014-09-11 10:26:21 -07:00
Alejandro Abdelnur 16a4558fda HDFS-6776. Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work. (yzhangal via tucu) 2014-09-09 22:20:36 -07:00
Konstantin V Shvachko c1df6f3b40 Revert HDFS-6940. 2014-09-09 17:34:25 -07:00
cnauroth c6fabbb9e9 Newly moved block replica been invalidated and deleted in TestBalancer. Contributed by Binglin Chang. 
(cherry picked from commit 2749fc677c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-09 11:43:21 -07:00
arp e736018601 HDFS-6981. Fix DN upgrade with layout version change. (Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-08 22:06:51 -07:00
arp 3259e8954f HDFS-6800. Support Datanode layout changes with rolling upgrade. (Contributed by James Thomas) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-08 22:06:12 -07:00
Colin McCabe da118bb113 HDFS-6482. Use block ID-based block layout on datanodes (James Thomas via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615223 13f79535-47bb-0310-9956-ffa450edef68

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
 2014-09-08 22:00:51 -07:00
Andrew Wang 176b07b480 Update CHANGES.txt for HDFS-6951 
(cherry picked from commit 7498dd790e)
 2014-09-08 17:01:53 -07:00
Colin Patrick Mccabe bdcf5e940f HDFS-6036. Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long. (cmccabe) 
(cherry picked from commit cad14aa916)
 2014-09-08 13:02:54 -07:00
Kihwal Lee d20047edda HDFS-7005. DFS input streams do not timeout. Contributed by Daryn Sharp. 
(cherry picked from commit 6a84f88c11)
 2014-09-08 14:44:47 -05:00
Haohui Mai 876062ac20 HDFS-6943. Improve NN allocateBlock log to include replicas' datanode IPs. Contributed by Ming Ma. 2014-09-08 11:07:56 -07:00
cnauroth b87d1d7d0a HDFS Credential Provider related Unit Test Failure. Contributed by Xiaoyu Yao. 
(cherry picked from commit a23144fd8a)
 2014-09-07 08:41:08 -07:00
arp eba06e61ce HDFS-6898. DN must reserve space for a full block when an RBW block is created. (Contributed by Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
 2014-09-06 21:04:21 -07:00
Konstantin V Shvachko 1ea3883553 HDFS-6940. Refactoring to allow ConsensusNode implementation. 
Contributed by Konstantin Shvachko.
 2014-09-06 12:04:49 -07:00
Alejandro Abdelnur 035112f251 HDFS-6986. DistributedFileSystem must get delegation tokens from configured KeyProvider. (zhz via tucu) 2014-09-05 22:33:58 -07:00
arp 27c53a1d67 HADOOP-11067 [HDFS-6998]. Fix CHANGES.txt 2014-09-05 11:18:30 -07:00
arp 624e793ad6 HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao) 2014-09-05 11:14:24 -07:00
arp 34a3faf180 HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao) 2014-09-05 11:09:47 -07:00
cnauroth df2ab4c76f HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth. 
(cherry picked from commit b051327ab6)
 2014-09-05 11:08:16 -07:00
cnauroth ac218d4dac HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth. 
(cherry picked from commit fab9bc58ec)
 2014-09-05 11:04:57 -07:00
arp be7e5837a9 HDFS-6831. Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'. (Contributed by Xiaoyu Yao) 2014-09-05 10:46:33 -07:00
Jing Zhao a074342b4c HDFS-6376. Distcp data between two HA clusters requires another configuration. Contributed by Dave Marion and Haohui Mai. 2014-09-05 10:40:50 -07:00
Vinayakumar B 0bd0423ff5 HDFS-6714. TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster (vinayakumarb) 
(cherry picked from commit 772d1fb01e)
 2014-09-05 10:26:51 +05:30
Jing Zhao b675f3f150 HDFS-6886. Use single editlog record for creating file + overwrite. Contributed by Yi Liu. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-04 18:56:51 -07:00
Jing Zhao 2363bad793 HDFS-6996. SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file. Contributed by Jing Zhao. 2014-09-04 16:40:51 -07:00
arp 0bbeb80931 HDFS-6848. Lack of synchronization on access to datanodeUuid in DataStorage#format. (Contributed by Xiaoyu Yao) 2014-09-04 16:19:52 -07:00
Alejandro Abdelnur 5dc45d529b HDFS-6905. fs-encryption merge triggered release audit failures. (clamb via tucu) 2014-09-04 11:06:58 -07:00
Haohui Mai b68818c4f0 HDFS-6609. Use DirectorySnapshottableFeature to represent a snapshottable directory. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608631 13f79535-47bb-0310-9956-ffa450edef68
 2014-09-03 23:11:31 -07:00
Colin Patrick Mccabe 23c41897cb HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang 
(cherry picked from commit f4caedfcbf)
 2014-09-03 19:33:30 -07:00
Uma Maheswara Rao G 3f9c31c873 HDFS-2975. Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). (Yi Liu via umamahesh) 
(cherry picked from commit 3425ae5d7e)
 2014-09-03 19:02:11 +05:30
Haohui Mai 786b43c7a3 HDFS-6942. Fix typos in log messages. Contributed by Ray Chiang. 2014-09-02 16:24:11 -07:00
Colin Patrick Mccabe 4c17d4d975 HDFS-4257. The ReplaceDatanodeOnFailure policies could have a forgiving option. Contributed by szetszwo. 
(cherry picked from commit 727331becc)
 2014-09-02 15:20:50 -07:00
Andrew Wang 9daf035fbc HDFS-6954. With crypto, no native lib systems are too verbose. Contributed by Charles Lamb. 
(cherry picked from commit a0ccf83dfd)
 2014-09-02 14:22:46 -07:00
Andrew Wang 958c9b5080 HDFS-6634. inotify in HDFS. Contributed by James Thomas. 
(cherry picked from commit faa4455be5)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/client/IPCLoggerChannel.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java
 2014-09-02 14:17:51 -07:00
Andrew Wang f6319b5131 HDFS-6972. TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration doesn't decode url correctly. Contributed by Yongjun Zhang. 
(cherry picked from commit 6066b1a455)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-08-29 15:49:06 -07:00
Aaron T. Myers 135315b66f HDFS-6774. Make FsDataset and DataStore support removing volumes. Contributed by Lei Xu. 
(cherry picked from commit 7eab2a29a5)
 2014-08-29 13:00:36 -07:00
Todd Lipcon ed2a997f49 HDFS-6865. Byte array native checksumming on client side. Contributed by James Thomas. 
(cherry picked from commit ab638e77b8)
 2014-08-28 16:49:32 -07:00
Alejandro Abdelnur 5c37f02e27 Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-08-28 15:05:07 -07:00
Colin Patrick Mccabe 66ba7b2e7c HADOOP-10957. The globber will sometimes erroneously return a permission denied exception when there is a non-terminal wildcard. 
(cherry picked from commit 7a16731191)
 2014-08-27 19:52:23 -07:00
Colin Patrick Mccabe f1ee8cec61 HDFS-6879. Adding tracing to Hadoop RPC. Contributed by Masatake Iwasaki. 
(cherry picked from commit 6962510f72)
 2014-08-27 14:17:29 -07:00
Colin Patrick Mccabe 4afd04a09f fix extra line added to CHANGES.txt in HDFS-6902 cherry-pick 2014-08-27 13:51:54 -07:00
Colin Patrick Mccabe 01b2c9b15f HDFS-6902. FileWriter should be closed in finally block in BlockReceiver#receiveBlock() (Tsuyoshi OZAWA via Colin Patrick McCabe) 
(cherry picked from commit b6b95ff667)
 2014-08-27 13:51:10 -07:00
Colin Patrick Mccabe fdc15db2e1 HDFS-4486. Add log category for long-running DFSClient notices. Contributed by Zhe Zhang. 
(cherry picked from commit 225569ece2)
 2014-08-27 13:45:10 -07:00
Colin Patrick Mccabe ddb9d565c8 HDFS-6773. MiniDFSCluster should skip edit log fsync by default. Contributed by Stephen Chu. 
(cherry picked from commit d805cc27a9)
 2014-08-27 13:37:48 -07:00
brandonli 99d8434511 HDFS-6892. Add XDR packaging method for each NFS request. Contributed by Brandon Li 
(cherry picked from commit cd9182d8b5)
 2014-08-27 11:15:13 -07:00
Jing Zhao c8b254d70e HDFS-6908. Incorrect snapshot directory diff generated by snapshot deletion. Contributed by Juan Yu and Jing Zhao. 
(cherry picked from commit 6b441d227a)
 2014-08-27 10:28:37 -07:00
Karthik Kambatla 2a3c8331fe Add a section for 2.5.1 in CHANGES.txt 
(cherry picked from commit dc154ab86d)
 2014-08-27 00:56:17 -07:00