Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,466 Commits 326 Branches 371 Tags
Commit Graph

2414 Commits

Author SHA1 Message Date
Kihwal Lee
2a6c9f0725 HDFS-6948. DN rejects blocks if it has older UC block. Contributed by 
Eric Payne.
(cherry picked from commit f02d934fedf00f0ce43d6f3f9b06d89ccc6851a5)
 2014-09-19 08:52:16 -05:00
Andrew Wang
58d9cc0914 HDFS-6840. Clients are always sent to the same datanode when read is off rack. (wang) 
(cherry picked from commit 8e73084491c9f317bc8cc3590f93ca67a63687a8)
 2014-09-18 18:14:10 -07:00
Andrew Wang
ef693b541c HDFS-6970. Move startFile EDEK retries to the DFSClient. (wang) 
(cherry picked from commit 20a076bafce548298729bab4fb81d12f829e8f7e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-18 17:41:22 -07:00
Colin Patrick Mccabe
d329237990 HDFS-6727. Refresh data volumes on DataNode based on configuration changes (Lei Xu via Colin Patrick McCabe) 
(cherry picked from commit fe38d2e9b5ac7e13f97cd2d3d2a984ab6bbaaf77)
 2014-09-18 16:53:07 -07:00
Andrew Wang
47c9dcfe8e HDFS-7003. Add NFS Gateway support for reading and writing to encryption zones. (clamb via wang) 
(cherry picked from commit 70be56d093022de9953e14a92dfa1a146bd9a290)
 2014-09-18 14:57:33 -07:00
Colin Patrick Mccabe
2b1c9c6210 HDFS-7047. Expose FileStatus#isEncrypted in libhdfs (cmccabe) 
(cherry picked from commit 570b8b468e1a75ad29c674699f0f4fe34d919ed9)
 2014-09-18 11:42:53 -07:00
Andrew Wang
008e2f68f1 HDFS-7078. Fix listEZs to work correctly with snapshots. (wang) 
(cherry picked from commit 0ecefe60179968984b1892a14411566b7a0c8df3)
 2014-09-17 21:28:15 -07:00
Andrew Wang
b477d30e63 HDFS-7004. Update KeyProvider instantiation to create by URI. (wang) 
(cherry picked from commit 10e8602f32b553a1424f1a9b5f9f74f7b68a49d1)
 2014-09-17 20:15:42 -07:00
Andrew Wang
b05da10d0d Move some HDFS JIRAs to the correct CHANGES.txt 2014-09-17 18:08:24 -07:00
Colin Patrick Mccabe
6cb8ed0d22 HDFS-6843. Create FileStatus isEncrypted() method (clamb via cmccabe) 
(cherry picked from commit e3803d002c660f18a5c2ecf32344fd6f3f491a5b)
 2014-09-17 13:36:41 -07:00
Andrew Wang
5e54aae62b HDFS-6705. Create an XAttr that disallows the HDFS admin from accessing a file. (clamb via wang) 
(cherry picked from commit ea4e2e843ecadd8019ea35413f4a34b97a424923)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-17 11:26:17 -07:00
Alejandro Abdelnur
1c847fdd61 HADOOP-11062. CryptoCodec testcases requiring OpenSSL should be run only if -Pnative is used. (asuresh via tucu) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
 2014-09-16 23:37:21 -07:00
Alejandro Abdelnur
94a1e68aa5 HADOOP-11096. KMS: KeyAuthorizationKeyProvider should verify the keyversion belongs to the keyname on decrypt. (tucu) 2014-09-16 23:21:17 -07:00
Andrew Wang
fcd181bde1 HDFS-6789. TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7. Contributed by Akira Ajisaka. 
(cherry picked from commit a044407b5c3a2914a055812cb570218f69edae9b)
 2014-09-16 17:03:52 -07:00
Andrew Wang
23f34b75e4 HDFS-6851. Refactor EncryptionZoneWithId and EncryptionZone. (clamb via wang) 
(cherry picked from commit 33ce887c20ec806ace02063e42599c3db76b536a)
 2014-09-16 16:57:06 -07:00
Benoy Antony
215216abeb HDFS-6799. The invalidate method in SimulatedFSDataset failed to remove (invalidate) blocks from the file system. Contributed by Megasthenis Asteris. 2014-09-16 16:27:25 -07:00
Alejandro Abdelnur
5d897026e4 HDFS-7006. Test encryption zones with KMS. (Anthony Young-Garner and tucu) 2014-09-16 14:37:04 -07:00
Colin Patrick Mccabe
9be338911b HDFS-6880. Adding tracing to DataNode data transfer protocol (iwasakims via cmccabe) 
(cherry picked from commit 56119fec96abbcc44c5dd82fdb694d2c3b53feb3)
 2014-09-16 13:59:58 -07:00
Kihwal Lee
08abb320a7 HDFS-6965. NN continues to issue block locations for DNs with full 
disks. Contributed by Rushabh Shah.
(cherry picked from commit 0c26412be4b3ec40130b7200506c957f0402ecbc)
 2014-09-16 09:06:43 -05:00
Alejandro Abdelnur
e59f6771e8 HADOOP-10868. AuthenticationFilter should support externalizing the secret for signing and provide rotation support. (rkanter via tucu) 2014-09-15 17:10:43 -07:00
Kihwal Lee
e6e31fbbba HDFS-7059. HAadmin transtionToActive with forceActive option can show 
confusing message. Contributed by Rushabh Shah.
(cherry picked from commit 2f847b3357448184aaec935052f34d116ad3a42c)
 2014-09-15 16:30:22 -05:00
Andrew Wang
d595557859 HDFS-7032. Add WebHDFS support for reading and writing to encryption zones. Contributed by Charles Lamb. 
(cherry picked from commit 43b03030084839db041d0337013806aaeef12aaa)
 2014-09-15 10:24:38 -07:00
Aaron T. Myers
a0c54aeb00 HADOOP-10400. Incorporate new S3A FileSystem implementation. Contributed by Jordan Mendelson and Dave Wang. 2014-09-15 08:30:42 -07:00
Andrew Wang
dd3e28d434 HDFS-7061. Add test to verify encryption zone creation after NameNode restart without saving namespace. Contributed by Stephen Chu. 
(cherry picked from commit fc741b5d78e7e006355e17b1b5839f502e37261b)
 2014-09-14 23:49:26 -07:00
cnauroth
993ede4db3 HDFS-7051. TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file path separator. Contributed by Chris Nauroth. 
(cherry picked from commit d6ce26986e79d770bc7588649373f2ae3bf15f94)
 2014-09-11 20:58:54 -07:00
Karthik Kambatla
d22cd065ed Update CHANGES.txt to set the release date for 2.5.1 
(cherry picked from commit 17ffbe08642c622f099dd1cd9cb9e008ba98ea52)
 2014-09-11 17:36:06 -07:00
cnauroth
ac296f9522 HDFS-7042. Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode. Contributed by Chris Nauroth. 
(cherry picked from commit 80ac6aabcea9f808fd55504cdaef2da7b50da7f1)
 2014-09-11 12:17:19 -07:00
Andrew Wang
6151c2bea7 HDFS-7045. Fix NameNode deadlock when opening file under /.reserved path. Contributed by Yi Liu. 
(cherry picked from commit 1e684995d7ac20d1c27ca1c1bef37dd2ee00e630)
 2014-09-11 10:59:24 -07:00
Andrew Wang
c90e15c559 HDFS-6621. Hadoop Balancer prematurely exits iterations. Contributed by Rafal Wodjdyla and Benjamin Bowman. 
(cherry picked from commit d1dab6cc63abf5d44533ad9b39e32c582327627b)
 2014-09-11 10:32:57 -07:00
Andrew Wang
0fae8a0e14 HDFS-6966. Add additional unit tests for encryption zones. Contributed by Stephen Chu. 
(cherry picked from commit bf64fce78c5474f4d6ead839c4de18c8401a54d6)
 2014-09-11 10:26:21 -07:00
Alejandro Abdelnur
16a4558fda HDFS-6776. Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work. (yzhangal via tucu) 2014-09-09 22:20:36 -07:00
Konstantin V Shvachko
c1df6f3b40 Revert HDFS-6940. 2014-09-09 17:34:25 -07:00
cnauroth
c6fabbb9e9 Newly moved block replica been invalidated and deleted in TestBalancer. Contributed by Binglin Chang. 
(cherry picked from commit 2749fc677c295e4ac5f4b1ebd5dbd6092370a857)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-09 11:43:21 -07:00
arp
e736018601 HDFS-6981. Fix DN upgrade with layout version change. (Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-08 22:06:51 -07:00
arp
3259e8954f HDFS-6800. Support Datanode layout changes with rolling upgrade. (Contributed by James Thomas) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-08 22:06:12 -07:00
Colin McCabe
da118bb113 HDFS-6482. Use block ID-based block layout on datanodes (James Thomas via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615223 13f79535-47bb-0310-9956-ffa450edef68

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
 2014-09-08 22:00:51 -07:00
Andrew Wang
176b07b480 Update CHANGES.txt for HDFS-6951 
(cherry picked from commit 7498dd790eca39c142229a75c2801b5bf4b94983)
 2014-09-08 17:01:53 -07:00
Andrew Wang
dc4da242f2 HDFS-6951. Correctly persist raw namespace xattrs to edit log and fsimage. Contributed by Charles Lamb. 
(cherry picked from commit 04915a08141bbe71bdef26e3f539aa8b76f89ac7)
 2014-09-08 17:01:47 -07:00
Colin Patrick Mccabe
bdcf5e940f HDFS-6036. Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long. (cmccabe) 
(cherry picked from commit cad14aa9168112ef1ceae80b94d9aae3ba293578)
 2014-09-08 13:02:54 -07:00
Kihwal Lee
d20047edda HDFS-7005. DFS input streams do not timeout. Contributed by Daryn Sharp. 
(cherry picked from commit 6a84f88c1190a8fecadd81deb6e7b8a69675fa91)
 2014-09-08 14:44:47 -05:00
Haohui Mai
876062ac20 HDFS-6943. Improve NN allocateBlock log to include replicas' datanode IPs. Contributed by Ming Ma. 2014-09-08 11:07:56 -07:00
cnauroth
b87d1d7d0a HDFS Credential Provider related Unit Test Failure. Contributed by Xiaoyu Yao. 
(cherry picked from commit a23144fd8a1e399e431f2f272388ec109df37ab1)
 2014-09-07 08:41:08 -07:00
arp
eba06e61ce HDFS-6898. DN must reserve space for a full block when an RBW block is created. (Contributed by Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
 2014-09-06 21:04:21 -07:00
Konstantin V Shvachko
1ea3883553 HDFS-6940. Refactoring to allow ConsensusNode implementation. 
Contributed by Konstantin Shvachko.
 2014-09-06 12:04:49 -07:00
Alejandro Abdelnur
035112f251 HDFS-6986. DistributedFileSystem must get delegation tokens from configured KeyProvider. (zhz via tucu) 2014-09-05 22:33:58 -07:00
arp
27c53a1d67 HADOOP-11067 [HDFS-6998]. Fix CHANGES.txt 2014-09-05 11:18:30 -07:00
arp
624e793ad6 HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao) 2014-09-05 11:14:24 -07:00
arp
34a3faf180 HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao) 2014-09-05 11:09:47 -07:00
cnauroth
df2ab4c76f HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth. 
(cherry picked from commit b051327ab6a01774e1dad59e1e547dd16f603789)
 2014-09-05 11:08:16 -07:00
cnauroth
ac218d4dac HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth. 
(cherry picked from commit fab9bc58ec03ea81cd5ce8a8746a4ee588f7bb08)
 2014-09-05 11:04:57 -07:00