Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,166 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

3069 Commits

Author SHA1 Message Date
Kihwal Lee 25b3531eb4 HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla. 2016-02-26 09:45:52 -06:00
Vinayakumar B 33b961ee88 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 
Addendum to fix compilation
 2016-02-23 14:39:24 +05:30
Tsz-Wo Nicholas Sze 1b139593c5 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 2016-02-22 15:18:46 -08:00
Zhe Zhang 79027309c9 HDFS-9688. Test the effect of nested encryption zones in HDFS downgrade. 
Change-Id: I2a802325a2bc82c97012d2c9fb388b292fe3af8f
 2016-02-22 15:10:31 -08:00
Kihwal Lee 019770c769 HDFS-4946. Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable. Contributed by James Kinley and Nathan Roberts. 
(cherry picked from commit ba6d5ed955)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockPlacementPolicyDefault.java
 2016-02-18 14:10:43 -06:00
Kihwal Lee a4492dc6ac HDFS-8845. DiskChecker should not traverse the entire tree (Chang Li via Colin P. McCabe) 
(cherry picked from commit ec183faadc)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-17 09:18:55 -06:00
Akira Ajisaka 8377683b63 HDFS-9765. TestBlockScanner#testVolumeIteratorWithCaching fails intermittently. (aajisaka) 
(cherry picked from commit 8ed07bd3e6)
(cherry picked from commit 8dec72bfd7)
 2016-02-15 19:10:03 +09:00
Junping Du 63069389ee Set the release date for 2.6.4. 
(cherry picked from commit ec12ce8f48)
(cherry picked from commit a28be9edc7)
 2016-02-13 01:50:30 -08:00
Kihwal Lee a30043ca26 HDFS-9779 . TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value. Contributed by Kuhu Shukla. 
(cherry picked from commit a7fce9ab41)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-11 08:15:35 -06:00
Akira Ajisaka 948dd27960 HDFS-9752. Permanent write failures may happen to slow writers during datanode rolling upgrades. (Contributed by Walter Su) 2016-02-10 03:52:42 +09:00
Akira Ajisaka 2a46d9c6c4 HDFS-9784. Example usage is not correct in Transparent Encryption document. Contributed by Ohnishi Takashi. 
(cherry picked from commit 60d2011b7c)
(cherry picked from commit cb53dfcc95)
 2016-02-10 03:33:31 +09:00
Zhe Zhang ef05096f95 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
(cherry picked from commit ef3f3f6bb1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-09 10:42:21 +08:00
Haohui Mai cb3aa41f53 HDFS-9724. Degraded performance in WebHDFS listing as it does not reuse ObjectMapper. Contributed by Akira Ajisaka. 2016-02-04 11:36:12 -08:00
Kihwal Lee c10bf788eb HDFS-9730. Storage ID update does not happen when there is a layout change. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 496f33de0c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataStorage.java
 2016-02-04 13:32:11 -06:00
Vinayakumar B bef53683b6 HDFS-9629. Update the footer of Web UI to show year 2016 (Contributed by Xiao Chen and Vinayakumar B) 
(cherry picked from commit ddcd6954d03d3caadc8b69f7b886a3a17c3c9d0c)
(cherry picked from commit 8cdfdbf815bf89eee3184ec7cd00e1924c1ea316)
 2016-02-04 13:20:27 +05:30
Kihwal Lee dd11c8274d HDFS-9743. Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7. Contributed by Kihwal Lee. 2016-02-03 12:51:01 -06:00
Vinayakumar B af9de19cfd HDFS-9740. Use a reasonable limit in DFSTestUtil.waitForMetric() (Contributed by Chang Li) 
(cherry picked from commit eb2fb943fd)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

(cherry picked from commit 6941e2ccbf)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
 2016-02-03 11:24:26 +05:30
Junping Du bfee573baf Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:19:08 -08:00
Colin Patrick Mccabe 449d2ad85c HDFS-9669. TcpPeerServer should respect ipc.server.listen.queue.size (Elliot Clark via cmccabe) 
(cherry picked from commit 2da03b48eb)
(cherry picked from commit 60d3a3c30b)
(cherry picked from commit c4c94e1cf2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
 2016-02-02 11:17:28 -08:00
Kihwal Lee 2f031830e8 HDFS-9072. Fix random failures in TestJMXGet. Contributed by J.Andreina. 2016-02-02 11:07:48 -06:00
Yongjun Zhang 3d88293dda HDFS-9406. FSImage may get corrupted after deleting snapshot. (Contributed by Jing Zhao, Stanislav Antic, Vinayakumar B, Yongjun Zhang) 
(cherry picked from commit 34ab50ea92)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java

(cherry picked from commit fc8d9cc758)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/DirectoryWithSnapshotFeature.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/snapshot/TestSnapshotDeletion.java
 2016-02-01 15:29:03 -08:00
Tsz-Wo Nicholas Sze 672481e28c HDFS-9654. Code refactoring for HDFS-8578. 2016-01-28 11:09:05 +08:00
Vinayakumar B 07704aab84 HDFS-9690. ClientProtocol.addBlock is not idempotent after HDFS-8071.(Contributed by Tsz Wo Nicholas Sze) 2016-01-26 21:34:07 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 34c9289f6c Release process for 2.7.2: Set the release date for 2.7.2 
(cherry picked from commit ec4d2d9f40)
 2016-01-25 15:48:18 -08:00
Kihwal Lee e160ddfb8d HDFS-9634. webhdfs client side exceptions don't provide enough details. Contributed by Eric Payne. 
(cherry picked from commit 7b70500484574a565dd8cd5c7d8b5bc7c6d91154)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-01-21 09:34:29 -06:00
Vinayakumar B ca29933405 HDFS-9625. set replication for empty file failed when set storage policy (Contributed by DENG FEI) 
(cherry picked from commit b7372b7166)
(cherry picked from commit 845acfd96c)
 2016-01-21 19:21:00 +05:30
Vinayakumar B eb3dcc0739 HDFS-9661. Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw (Contributed by ade) 
(cherry picked from commit 1425578690)
 2016-01-20 21:11:39 +05:30
Tsz-Wo Nicholas Sze 2131b9820d In CHANGES.txt, move HDFS-9294 to Release 2.6.4. 2016-01-16 23:48:03 +08:00
Arpit Agarwal 6cd5fcb634 HDFS-9415. Document dfs.cluster.administrators and dfs.permissions.superusergroup. (Contributed by Xiaobing Zhou) 2016-01-14 14:19:51 -08:00
Yongjun Zhang 7a550db931 HDFS-9648. TestStartup.testImageChecksum is broken by HDFS-9569's message change. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 817cc1f02a)
 2016-01-14 12:45:42 -08:00
Kihwal Lee a90dcb0865 Fix up CHANGES.txt 2016-01-14 09:58:35 -06:00
Junping Du c2d1d69525 Fix yarn CHANGES.txt entry for 2.7.2 2016-01-14 06:17:42 -08:00
Junping Du 0e0272f120 Add missing CHANGES.txt entry for HDFS-8767. 
(cherry picked from commit e50dd19a9c)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
(cherry picked from commit 62eabec549)
 2016-01-14 06:14:56 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) faebc20e26 HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa) 
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753da)
 2016-01-13 14:56:58 -08:00
Kihwal Lee 83a4791243 HDFS-9047. Retire libwebhdfs. 2016-01-13 11:01:35 -06:00
Yongjun Zhang 4c09a75f3e HDFS-9569. Log the name of the fsimage being loaded for better supportability. (Yongjun Zhang) 
(cherry picked from commit 25051c3bd0)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java
 2016-01-12 09:40:56 -08:00
Kihwal Lee b06e39de4f HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee. 2016-01-08 11:31:49 -06:00
Vinayakumar B 5dc5bb2812 HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang) 
(cherry picked from commit 34cd7cd765)
(cherry picked from commit aa710bd461)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DecommissionManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockManager.java
 2016-01-07 11:50:12 +05:30
Akira Ajisaka 68c68e187f Set release date for 2.6.3 
(cherry picked from commit db99e30f67)
(cherry picked from commit 247ab92464)
 2016-01-04 16:14:30 +09:00
Akira Ajisaka 3a1c98bba3 HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki. 
(cherry picked from commit 64ae85fd2e)
(cherry picked from commit d98cfe611f)
 2016-01-04 14:35:54 +09:00
Kihwal Lee cdf9f1c662 HDFS-7163. WebHdfsFileSystem should retry reads according to the configured retry policy. Contributed by Eric Payne. 2015-12-28 10:57:31 -06:00
Haohui Mai e0e5a0fa82 HDFS-8914. Document HA support in the HDFS HdfsDesign.md. Contributed by Lars Francke. 
(cherry picked from commit 049ccf71ce)
 2015-12-21 21:44:46 +09:00
Akira Ajisaka 5ffad1551b HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki. 
(cherry picked from commit fa544020f6)
(cherry picked from commit 7526a2a005)
 2015-12-21 21:27:28 +09:00
Junping Du 803fdc9f5e Creating 2.6.4 entries in CHANGES.txt files. 
(cherry picked from commit 028894281b)

(cherry picked from commit 092c469059)
 2015-12-18 14:24:51 +09:00
Kihwal Lee 03292b234e HDFS-9533. seen_txid in the shared edits directory is modified during bootstrapping. Contributed by Kihwal Lee. 
(cherry picked from commit 5cb1e0118b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/BootstrapStandby.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestBootstrapStandby.java
(cherry picked from commit 3c0ae5914c)
 2015-12-17 17:28:24 -06:00
cnauroth 56882e7b1c Revert "HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang." 
This reverts commit 4d2ee51c52.
 2015-12-17 13:49:47 -08:00
Kihwal Lee 4d2ee51c52 HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang. 
(cherry picked from commit eb6939cea0)
 2015-12-17 10:33:15 -06:00
Plamen Jeliazkov d97696e4c4 HDFS-9516. Truncate file fails with data dirs on multiple disks. Contributed by Plamen Jeliazkov. 2015-12-17 00:09:48 -08:00
Tom Zeng 6c62d422d6 HADOOP-12415. Add io.netty dependency to hadoop-nfs and to hadoop-hdfs, needed to build Bigtop successfuly, see BIGTOP-2049 
Signed-off-by: Konstantin Boudnik <cos@boudnik.org>
(cherry picked from commit b4c6b511e7)
 2015-12-16 14:27:30 -08:00
Kihwal Lee a02312546a HDFS-9445. Datanode may deadlock while handling a bad volume. Contributed by Walter Su. 
(cherry picked from commit a48301791e)
 2015-12-11 08:47:22 -06:00