Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,402 Commits 326 Branches 371 Tags
Commit Graph

2382 Commits

Author SHA1 Message Date
cnauroth
c6fabbb9e9 Newly moved block replica been invalidated and deleted in TestBalancer. Contributed by Binglin Chang. 
(cherry picked from commit 2749fc677c295e4ac5f4b1ebd5dbd6092370a857)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-09 11:43:21 -07:00
arp
e736018601 HDFS-6981. Fix DN upgrade with layout version change. (Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-08 22:06:51 -07:00
arp
3259e8954f HDFS-6800. Support Datanode layout changes with rolling upgrade. (Contributed by James Thomas) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-08 22:06:12 -07:00
Colin McCabe
da118bb113 HDFS-6482. Use block ID-based block layout on datanodes (James Thomas via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615223 13f79535-47bb-0310-9956-ffa450edef68

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
 2014-09-08 22:00:51 -07:00
Andrew Wang
176b07b480 Update CHANGES.txt for HDFS-6951 
(cherry picked from commit 7498dd790eca39c142229a75c2801b5bf4b94983)
 2014-09-08 17:01:53 -07:00
Andrew Wang
dc4da242f2 HDFS-6951. Correctly persist raw namespace xattrs to edit log and fsimage. Contributed by Charles Lamb. 
(cherry picked from commit 04915a08141bbe71bdef26e3f539aa8b76f89ac7)
 2014-09-08 17:01:47 -07:00
Colin Patrick Mccabe
bdcf5e940f HDFS-6036. Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long. (cmccabe) 
(cherry picked from commit cad14aa9168112ef1ceae80b94d9aae3ba293578)
 2014-09-08 13:02:54 -07:00
Kihwal Lee
d20047edda HDFS-7005. DFS input streams do not timeout. Contributed by Daryn Sharp. 
(cherry picked from commit 6a84f88c1190a8fecadd81deb6e7b8a69675fa91)
 2014-09-08 14:44:47 -05:00
Haohui Mai
876062ac20 HDFS-6943. Improve NN allocateBlock log to include replicas' datanode IPs. Contributed by Ming Ma. 2014-09-08 11:07:56 -07:00
cnauroth
b87d1d7d0a HDFS Credential Provider related Unit Test Failure. Contributed by Xiaoyu Yao. 
(cherry picked from commit a23144fd8a1e399e431f2f272388ec109df37ab1)
 2014-09-07 08:41:08 -07:00
arp
eba06e61ce HDFS-6898. DN must reserve space for a full block when an RBW block is created. (Contributed by Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
 2014-09-06 21:04:21 -07:00
Konstantin V Shvachko
1ea3883553 HDFS-6940. Refactoring to allow ConsensusNode implementation. 
Contributed by Konstantin Shvachko.
 2014-09-06 12:04:49 -07:00
Alejandro Abdelnur
035112f251 HDFS-6986. DistributedFileSystem must get delegation tokens from configured KeyProvider. (zhz via tucu) 2014-09-05 22:33:58 -07:00
arp
27c53a1d67 HADOOP-11067 [HDFS-6998]. Fix CHANGES.txt 2014-09-05 11:18:30 -07:00
arp
624e793ad6 HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao) 2014-09-05 11:14:24 -07:00
arp
34a3faf180 HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao) 2014-09-05 11:09:47 -07:00
cnauroth
df2ab4c76f HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth. 
(cherry picked from commit b051327ab6a01774e1dad59e1e547dd16f603789)
 2014-09-05 11:08:16 -07:00
cnauroth
ac218d4dac HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth. 
(cherry picked from commit fab9bc58ec03ea81cd5ce8a8746a4ee588f7bb08)
 2014-09-05 11:04:57 -07:00
arp
be7e5837a9 HDFS-6831. Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'. (Contributed by Xiaoyu Yao) 2014-09-05 10:46:33 -07:00
Jing Zhao
a074342b4c HDFS-6376. Distcp data between two HA clusters requires another configuration. Contributed by Dave Marion and Haohui Mai. 2014-09-05 10:40:50 -07:00
Vinayakumar B
0bd0423ff5 HDFS-6714. TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster (vinayakumarb) 
(cherry picked from commit 772d1fb01e65ca42ef4365d2a9307da6c2448c3f)
 2014-09-05 10:26:51 +05:30
Jing Zhao
b675f3f150 HDFS-6886. Use single editlog record for creating file + overwrite. Contributed by Yi Liu. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-04 18:56:51 -07:00
Jing Zhao
2363bad793 HDFS-6996. SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file. Contributed by Jing Zhao. 2014-09-04 16:40:51 -07:00
arp
0bbeb80931 HDFS-6848. Lack of synchronization on access to datanodeUuid in DataStorage#format. (Contributed by Xiaoyu Yao) 2014-09-04 16:19:52 -07:00
Alejandro Abdelnur
5dc45d529b HDFS-6905. fs-encryption merge triggered release audit failures. (clamb via tucu) 2014-09-04 11:06:58 -07:00
Alejandro Abdelnur
dc2e38780b HADOOP-11015. Http server/client utils to propagate and recreate Exceptions from server to client. (tucu) 2014-09-04 09:14:07 -07:00
Haohui Mai
b68818c4f0 HDFS-6609. Use DirectorySnapshottableFeature to represent a snapshottable directory. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608631 13f79535-47bb-0310-9956-ffa450edef68
 2014-09-03 23:11:31 -07:00
Colin Patrick Mccabe
23c41897cb HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang 
(cherry picked from commit f4caedfcbfeae7e2fe7c0e812ddbb087608a5ffd)
 2014-09-03 19:33:30 -07:00
Karthik Kambatla
9855e884cb HADOOP-10956. Fix create-release script to include docs and necessary txt files. (kasha) 
(cherry picked from commit ce0462129fe09898fd9b169cae0564cb6d9bc419)
 2014-09-03 09:39:32 -07:00
Uma Maheswara Rao G
3f9c31c873 HDFS-2975. Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). (Yi Liu via umamahesh) 
(cherry picked from commit 3425ae5d7eaa27b2526d0e0c07bdfea9440359f8)
 2014-09-03 19:02:11 +05:30
Haohui Mai
786b43c7a3 HDFS-6942. Fix typos in log messages. Contributed by Ray Chiang. 2014-09-02 16:24:11 -07:00
Colin Patrick Mccabe
4c17d4d975 HDFS-4257. The ReplaceDatanodeOnFailure policies could have a forgiving option. Contributed by szetszwo. 
(cherry picked from commit 727331becc3902cb4e60ee04741e79703238e782)
 2014-09-02 15:20:50 -07:00
Andrew Wang
9daf035fbc HDFS-6954. With crypto, no native lib systems are too verbose. Contributed by Charles Lamb. 
(cherry picked from commit a0ccf83dfd6bff81944d6855652eae7f7f7b0ba9)
 2014-09-02 14:22:46 -07:00
Andrew Wang
958c9b5080 HDFS-6634. inotify in HDFS. Contributed by James Thomas. 
(cherry picked from commit faa4455be512e070fa420084be8d1be5c72f3b08)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/client/IPCLoggerChannel.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java
 2014-09-02 14:17:51 -07:00
Andrew Wang
f6319b5131 HDFS-6972. TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration doesn't decode url correctly. Contributed by Yongjun Zhang. 
(cherry picked from commit 6066b1a4551bb70bba2789ac05bf9ddbe72c10e8)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-08-29 15:49:06 -07:00
Aaron T. Myers
135315b66f HDFS-6774. Make FsDataset and DataStore support removing volumes. Contributed by Lei Xu. 
(cherry picked from commit 7eab2a29a5706ce10912c12fa225ef6b27a82cbe)
 2014-08-29 13:00:36 -07:00
Alejandro Abdelnur
09a0ad328f HADOOP-10814. Update Tomcat version used by HttpFS and KMS to latest 6.x version. (rkanter via tucu) 
(cherry picked from commit 189abddf0b68ab43978dacaf3a9bf6ee7169cf78)
 2014-08-29 11:53:13 -07:00
Todd Lipcon
ed2a997f49 HDFS-6865. Byte array native checksumming on client side. Contributed by James Thomas. 
(cherry picked from commit ab638e77b811d9592470f7d342cd11a66efbbf0d)
 2014-08-28 16:49:32 -07:00
Alejandro Abdelnur
1a65717ffa Removing CHANGES-fs-encryption.txt files 2014-08-28 15:13:24 -07:00
Alejandro Abdelnur
5c37f02e27 Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-08-28 15:05:07 -07:00
Alejandro Abdelnur
c77bd85b62 HDFS-6134 and HADOOP-10150 subtasks. 2014-08-28 15:03:08 -07:00
Colin Patrick Mccabe
66ba7b2e7c HADOOP-10957. The globber will sometimes erroneously return a permission denied exception when there is a non-terminal wildcard. 
(cherry picked from commit 7a167311918300b1f00868a83d2f71a1ca88e918)
 2014-08-27 19:52:23 -07:00
Colin Patrick Mccabe
f1ee8cec61 HDFS-6879. Adding tracing to Hadoop RPC. Contributed by Masatake Iwasaki. 
(cherry picked from commit 6962510f729717f776929708813f99a28e582f34)
 2014-08-27 14:17:29 -07:00
Colin Patrick Mccabe
4afd04a09f fix extra line added to CHANGES.txt in HDFS-6902 cherry-pick 2014-08-27 13:51:54 -07:00
Colin Patrick Mccabe
01b2c9b15f HDFS-6902. FileWriter should be closed in finally block in BlockReceiver#receiveBlock() (Tsuyoshi OZAWA via Colin Patrick McCabe) 
(cherry picked from commit b6b95ff66700e4db1d8d59a31c3048cb10504262)
 2014-08-27 13:51:10 -07:00
Colin Patrick Mccabe
fdc15db2e1 HDFS-4486. Add log category for long-running DFSClient notices. Contributed by Zhe Zhang. 
(cherry picked from commit 225569ece229cec32f852f831fd337a139c44b1e)
 2014-08-27 13:45:10 -07:00
Colin Patrick Mccabe
ddb9d565c8 HDFS-6773. MiniDFSCluster should skip edit log fsync by default. Contributed by Stephen Chu. 
(cherry picked from commit d805cc27a98abbdf14a20ef3127a2c7cb212c765)
 2014-08-27 13:37:48 -07:00
brandonli
99d8434511 HDFS-6892. Add XDR packaging method for each NFS request. Contributed by Brandon Li 
(cherry picked from commit cd9182d8b5f60428f6c91b0eb0b2e61d52a07020)
 2014-08-27 11:15:13 -07:00
Jing Zhao
c8b254d70e HDFS-6908. Incorrect snapshot directory diff generated by snapshot deletion. Contributed by Juan Yu and Jing Zhao. 
(cherry picked from commit 6b441d227a8806e87224106a81361bd61f0b3d0b)
 2014-08-27 10:28:37 -07:00
Karthik Kambatla
2a3c8331fe Add a section for 2.5.1 in CHANGES.txt 
(cherry picked from commit dc154ab86d694e68f54c635043eb55d501d0e242)
 2014-08-27 00:56:17 -07:00