Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,811 Commits 326 Branches 371 Tags
Commit Graph

2916 Commits

Author SHA1 Message Date
Colin Patrick Mccabe
2ca76df21a HDFS-7771. fuse_dfs should permit FILE: on the front of KRB5CCNAME (cmccabe) 
(cherry picked from commit 50625e660ac0f76e7fe46d55df3d15cbbf058753)
 2015-02-11 12:14:56 -08:00
Haohui Mai
744db47872 HDFS-7736. Fix typos in dfsadmin/fsck/snapshotDiff usage messages. Contributed by Brahma Reddy Battula. 2015-02-11 11:24:44 -08:00
Tsz-Wo Nicholas Sze
b49eeddbaf HDFS-7751. Fix TestHDFSCLI for quota with storage type. Contributed by Xiaoyu Yao 2015-02-11 11:10:05 -08:00
Arpit Agarwal
8fa0fc9574 HDFS-7720. Quota by Storage Type API, tools and ClientNameNode Protocol changes. (Contributed by Xiaoyu Yao) 2015-02-11 11:07:53 -08:00
Konstantin V Shvachko
04789db74c HDFS-7760. Document truncate for WebHDFS. Contributed by Konstantin Shvachko. 2015-02-11 10:05:53 -08:00
Konstantin V Shvachko
7f18176cd7 HDFS-7753. Fix Multithreaded correctness Warnings in BackupImage. Contributed by Rakesh R and Konstantin Shvachko. 2015-02-11 00:52:12 -08:00
Tsz-Wo Nicholas Sze
acc172e371 HDFS-7769. TestHDFSCLI should not create files in hdfs project root dir. 2015-02-10 17:50:00 -08:00
Konstantin V Shvachko
2b722b904e HDFS-7058. Tests for truncate CLI. Contributed by Dasha Boudnik. 2015-02-09 21:31:02 -08:00
Vinayakumar B
a1bf7aecf7 HDFS-7714. Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode.(Contributed by Vinayakumar B) 
(cherry picked from commit 3d15728ff5301296801e541d9b23bd1687c4adad)
 2015-02-10 10:45:14 +05:30
Colin Patrick Mccabe
643a8892d1 HDFS-7718. Store KeyProvider in ClientContext to avoid leaking key provider threads when using FileContext (Arun Suresh via Colin P. McCabe) 
(cherry picked from commit 02340a24f211212b91dc7380c1e5b54ddb5e82eb)
 2015-02-09 20:25:31 -08:00
Colin Patrick Mccabe
1465393d14 HDFS-7744. Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called (cmccabe) 
(cherry picked from commit a9dc5cd7069f721e8c55794b877026ba02537167)
 2015-02-09 20:19:48 -08:00
yliu
cc0668ebe6 HDFS-7756. Restore method signature for LocatedBlock#getLocations(). (Ted Yu via yliu) 2015-02-10 02:00:32 +08:00
yliu
ae316705bb HADOOP-11510. Expose truncate API via FileContext. (yliu) 2015-02-10 01:43:08 +08:00
Arpit Agarwal
ff900eb64a HDFS-7647. DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs. (Contributed by Milan Desai) 2015-02-09 12:17:53 -08:00
Jing Zhao
1e49b40f1f HDFS-7743. Code cleanup of BlockInfo and rename BlockInfo to BlockInfoContiguous. Contributed by Jing Zhao. 
(cherry picked from commit 1382ae525c67bf95d8f3a436b547dbc72cfbb177)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockCollection.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/CreateEditsLog.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestEditLog.java
 2015-02-08 12:16:09 -08:00
Tsz-Wo Nicholas Sze
c5f18ba65b HDFS-7738. Revise the exception message for recover lease; add more truncate tests such as truncate with HA setup, negative tests, truncate with other operations and multiple truncates. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java
 2015-02-07 15:26:06 -08:00
Akira Ajisaka
964a3b0c3e HDFS-7710. Remove dead code in BackupImage.java. Contributed by Xiaoyu Yao. 
(cherry picked from commit cfb829ecd5b91fc9adcf5406e788184cfd75300f)
 2015-02-06 19:00:58 -08:00
Akira Ajisaka
2ec796ba80 HDFS-7732. Fix the order of the parameters in DFSConfigKeys. Contributed by Brahma Reddy Battula. 
(cherry picked from commit eaab959a3e7f986a3ee29369d4fd59f882e61e97)
 2015-02-06 11:28:18 -08:00
yliu
e2803f5a51 HDFS-7741. Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream. (yliu) 2015-02-06 06:29:52 +08:00
yliu
44d800b353 HDFS-7698. Fix locking on HDFS read statistics and add a method for clearing them. (Colin P. McCabe via yliu) 2015-02-05 23:57:36 +08:00
yliu
3ffe5a1ed2 HDFS-7655. Expose truncate API for Web HDFS. (yliu) 2015-02-05 23:48:55 +08:00
Haohui Mai
67002a5fc0 HDFS-7270. Add congestion signaling capability to DataNode write protocol. Contributed by Haohui Mai. 2015-02-05 11:03:43 -08:00
Tsuyoshi Ozawa
970fdc3ad9 HDFS-7709. Fix findbug warnings in httpfs. Contributed by Rakesh R. 
(cherry picked from commit 20660b7a67b7f2815b1e27b98dce2b2682399505)
 2015-02-05 19:57:40 +09:00
Arpit Agarwal
5807afed0a HDFS-7733. NFS: readdir/readdirplus return null directory attribute on failure. (Contributed by Arpit Agarwal) 2015-02-04 16:25:40 -08:00
Colin Patrick Mccabe
76c0757c6e HDFS-7719. BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes. (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit 40a415799b1ff3602fbb461765f8b36f1133bda2)
 2015-02-04 12:46:39 -08:00
Andrew Wang
696266e99c HDFS-7734. Class cast exception in NameNode#main. Contributed by Yi Liu. 
(cherry picked from commit 9175105eeaecf0a1d60b57989b73ce45cee4689b)
 2015-02-04 11:31:49 -08:00
Tsuyoshi Ozawa
f92d4fa20f HADOOP-11546. Checkstyle failing: Unable to instantiate DoubleCheckedLockingCheck. (ozawa) 
(cherry picked from commit ba58da29f49da15f7eb6300f996e0ae7ba9d0d1e)
 2015-02-05 00:51:40 +09:00
Andrew Wang
debd63f0b0 HDFS-7712. Switch blockStateChangeLog to use slf4j. 
(cherry picked from commit 3ae38ec7dfa1aaf451cf889cec6cf862379af32a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileAppend3.java
 2015-02-03 15:04:16 -08:00
Kihwal Lee
c428d303f6 HDFS-7707. Edit log corruption due to delayed block removal again. Contributed by Yongjun Zhang 
(cherry picked from commit 843806d03ab1a24f191782f42eb817505228eb9f)
 2015-02-03 14:46:24 -06:00
Haohui Mai
7cb70d3447 HDFS-6651. Deletion failure can leak inodes permanently. Contributed by Jing Zhao. 2015-02-02 16:32:56 -08:00
Tsz-Wo Nicholas Sze
8426c7d806 HDFS-7696. In FsDatasetImpl, the getBlockInputStream(..) and getTmpInputStreams(..) methods may leak file descriptors. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
 2015-02-02 13:42:15 -08:00
Tsz-Wo Nicholas Sze
a5568a276d HDFS-7681. Change ReplicaInputStreams constructor to take InputStream(s) instead of FileDescriptor(s). Contributed by Joe Pallas 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-02-02 13:30:07 -08:00
Tsz-Wo Nicholas Sze
2ecfd018f4 HDFS-5782. Change BlockListAsLongs constructor to take Replica as parameter type instead of concrete classes Block and ReplicaInfo. Contributed by David Powell and Joe Pallas 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-02-02 13:24:02 -08:00
Tsz-Wo Nicholas Sze
e43b1428b4 HDFS-5631. Change BlockMetadataHeader.readHeader(..), ChunkChecksum class and constructor to public; and fix FsDatasetSpi to use generic type instead of FsVolumeImpl. Contributed by David Powell and Joe Pallas 2015-02-02 12:59:22 -08:00
Colin Patrick Mccabe
4bf14876b3 HADOOP-11498 addendum. Fix extra "import" statements in branch-2.7 patch backport 2015-01-30 16:07:12 -08:00
Colin Patrick Mccabe
80381b62aa HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 09ad9a868a89922e9b55b3e7c5b9f41fa54d3770)
 2015-01-30 16:02:36 -08:00
Andrew Wang
fcd23b61e3 HDFS-7706. Switch BlockManager logging to use slf4j. 
(cherry picked from commit 951b3608a8cb1d9063b9be9c740b524c137b816f)
 2015-01-30 11:36:02 -08:00
Colin Patrick Mccabe
e8d154baea HADOOP-11403. Avoid using sys_errlist on Solaris, which lacks support for it (Malcolm Kavalsky via Colin P. McCabe) 
(cherry picked from commit e36ef3b4022a8527cdfa937c4ffc9d46e71cfe28)
 2015-01-29 15:48:59 -08:00
Kihwal Lee
3b030731a0 HDFS-7603. The background replication queue initialization may not let others run. Contributed by Kihwal Lee. 
(cherry picked from commit 89b07490f8354bb83a67b7ffc917bfe99708e615)
 2015-01-29 12:37:34 -06:00
yliu
dc7950ef18 HDFS-7423. various typos and message formatting fixes in nfs daemon and doc. (Charles Lamb via yliu) 2015-01-29 04:20:14 +08:00
Jing Zhao
e8300957a7 HDFS-7611. deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart. Contributed by Jing Zhao and Byron Wong. 
(cherry picked from commit d244574d03903b0514b0308da85d2f06c2384524)
 2015-01-28 15:25:42 -08:00
Andrew Wang
55bb4eca73 HDFS-6673. Add delimited format support to PB OIV tool. Contributed by Eddy Xu. 
(cherry picked from commit caf7298e49f646a40023af999f62d61846fde5e2)
 2015-01-28 12:36:44 -08:00
Colin Patrick Mccabe
ad865b1cd0 HDFS-7675. Remove unused member DFSClient.spanReceiverHost (cmccabe) 
(cherry picked from commit d12dd47f4516fe125221ae073f1bc88b702b122f)
 2015-01-27 20:52:53 -08:00
yliu
d483ba25d7 HDFS-7677. DistributedFileSystem#truncate should resolve symlinks. (yliu) 2015-01-27 23:47:52 +08:00
Allen Wittenauer
874e38d81f HDFS-7566. Remove obsolete entries from hdfs-default.xml (Ray Chiang via aw) 2015-01-27 14:32:21 -08:00
Haohui Mai
b3a63fa8a2 HDFS-7683. Combine usages and percent stats in NameNode UI. Contributed by Vinayakumar B. 2015-01-27 11:09:42 -08:00
Steve Loughran
aa16173a0d HDFS-49. MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found. (stevel) 2015-01-27 11:10:46 +00:00
Kihwal Lee
c081fa6ae8 HDFS-7224. Allow reuse of NN connections via webhdfs. Contributed by Eric Payne 
(cherry picked from commit 2b0fa20f69417326a92beac10ffa072db2616e73)
 2015-01-26 08:15:37 -06:00
Konstantin V Shvachko
24f0d56afb HDFS-7676. Fix TestFileTruncate to avoid bug of HDFS-7611. Contributed by Konstantin Shvachko. 2015-01-24 18:07:56 -08:00
yliu
5f70b7ecf0 HDFS-7659. truncate should check negative value of the new length. Contributed by Yi Liu. 2015-01-24 17:28:36 -08:00