Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,613 Commits 326 Branches 371 Tags
Commit Graph

3222 Commits

Author SHA1 Message Date
Haohui Mai
4283831348 HDFS-7483. Display information per tier on the Namenode UI. Contributed by Benoy Antony and Haohui Mai. 2015-07-20 20:13:16 -07:00
Akira Ajisaka
e78ee18642 Move HDFS-6945 to 2.7.2 section in CHANGES.txt. 
(cherry picked from commit a628f675900d2533ddf86fb3d3e601238ecd68c3)
 2015-07-21 11:45:53 +09:00
yliu
cadd02ad1d HDFS-8794. Improve CorruptReplicasMap#corruptReplicasMap. (yliu) 2015-07-21 09:18:43 +08:00
Ravi Prakash
3d58c7a700 HDFS-8344. NameNode doesn't recover lease for files with missing blocks (raviprak) 
(cherry picked from commit e4f756260f16156179ba4adad974ec92279c2fac)
 2015-07-20 14:04:28 -07:00
Ming Ma
516bbf1c20 HDFS-7314. When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient. (mingma) 
(cherry picked from commit fbd88f1062f3c4b208724d208e3f501eb196dfab)
 2015-07-16 12:55:29 -07:00
Arpit Agarwal
dc211ca658 HDFS-8778. TestBlockReportRateLimiting#testLeaseExpiration can deadlock. (Contributed by Arpit Agarwal) 2015-07-15 14:09:06 -07:00
Akira Ajisaka
bad5d288ac HDFS-8742. Inotify: Support event for OP_TRUNCATE. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 979c9ca2ca89e99dc7165abfa29c78d66de43d9a)
 2015-07-15 04:43:03 +09:00
Kihwal Lee
b0a2dc9c84 HDFS-8722. Optimize datanode writes for small writes and flushes. Contributed by Kihwal Lee 
(cherry picked from commit 59388a801514d6af64ef27fbf246d8054f1dcc74)
 2015-07-14 14:07:38 -05:00
Colin Patrick Mccabe
471037883f HDFS-7608: hdfs dfsclient newConnectedPeer has no write timeout (Xiaoyu Yao via Colin P. McCabe) 
(cherry picked from commit 1d74ccececaefffaa90c0c18b40a3645dbc819d9)
 2015-07-14 11:00:45 -07:00
Tsz-Wo Nicholas Sze
d8d6d69b09 HDFS-8541. Mover should exit with NO_MOVE_PROGRESS if there is no move progress. Contributed by Surendra Singh Lilhore 2015-07-13 15:13:14 -07:00
Tsz-Wo Nicholas Sze
2e455d4d8b Add HDFS-8143 to CHANGES.txt. 2015-07-13 15:07:28 -07:00
Jing Zhao
0e8c335e7c HDFS-8751. Remove setBlocks API from INodeFile and misc code cleanup. Contributed by Zhe Zhang 
(cherry picked from commit 47f4c54106ebb234a7d3dc71320aa584ecba161a)
 2015-07-10 14:18:09 -07:00
Vinayakumar B
c1447e654d HDFS-2956. calling fetchdt without a --renewer argument throws NPE (Contributed by Vinayakumar B)HDFS-2956. calling fetchdt without a --renewer argument throws NPE (Contributed by Vinayakumar B) 
(cherry picked from commit b48908033fcac7a4bd4313c1fd1457999fba08e1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDelegationTokenFetcher.java
 2015-07-10 15:52:35 +05:30
Akira Ajisaka
3a0318ea93 HDFS-8749. Fix findbugs warnings in BlockManager.java. Contributed by Brahma Reddy Battula. 
(cherry picked from commit d66302ed9b2c25b560d8319d6d755aee7cfa4d67)
 2015-07-10 15:04:44 +09:00
Jing Zhao
ae0d5d6917 HDFS-8729. Fix TestFileTruncate#testTruncateWithDataNodesRestartImmediately which occasionally failed. Contributed by Walter Su. 
(cherry picked from commit f4ca530c1cc9ece25c5ef01f99a94eb9e678e890)
 2015-07-09 13:18:35 -07:00
Haohui Mai
981fe4cfaa HDFS-8726. Move protobuf files that define the client-sever protocols to hdfs-client. Contributed by Haohui Mai. 2015-07-08 10:37:31 -07:00
Arpit Agarwal
e519df47b2 HDFS-8642. Make TestFileTruncate more reliable. (Contributed by Rakesh R) 2015-07-08 09:31:17 -07:00
Vinayakumar B
6fe2e7c3f3 HDFS-8712. Remove 'public' and 'abstract' modifiers in FsVolumeSpi and FsDatasetSpi (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit bd4e10900cc53a2768c31cc29fdb3698684bc2a0)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsDatasetSpi.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
 2015-07-08 17:03:18 +05:30
Vinayakumar B
01e12b7d69 Revert "HDFS-8712. Remove 'public' and 'abstract' modifiers in FsVolumeSpi and FsDatasetSpi (Contributed by Lei (Eddy) Xu)" 
This reverts commit 38ee9247cd3d01ffba88018ad1fd37f40e5969f5.
 2015-07-08 16:59:22 +05:30
Vinayakumar B
38ee9247cd HDFS-8712. Remove 'public' and 'abstract' modifiers in FsVolumeSpi and FsDatasetSpi (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit bd4e10900cc53a2768c31cc29fdb3698684bc2a0)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsDatasetSpi.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
 2015-07-08 16:36:12 +05:30
Xiaoyu Yao
907abdca73 HDFS-8711. setSpaceQuota command should print the available storage type when input storage type is wrong. Contributed by Brahma Reddy Battula. 
(cherry picked from commit b68701b7b2a9597b4183e0ba19b1551680d543a1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java
 2015-07-08 16:25:47 +05:30
Haohui Mai
b181c13cbf HDFS-8620. Clean up the checkstyle warinings about ClientProtocol. Contributed by Takanobu Asanuma. 2015-07-07 14:04:12 -07:00
Jing Zhao
bed74b620a Revert "HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao." 
This reverts commit d62b63d297bff12d93de560dd50ddd48743b851d.

(cherry picked from commit bc99aaffe7b0ed13b1efc37b6a32cdbd344c2d75)
 2015-07-07 10:14:17 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
a8bf34cad8 Release process for 2.7.1: Set the release date for 2.7.1. 
(cherry picked from commit bf89ddb9b8ca27a34074b415f85599dd48b8fc50)
 2015-07-06 16:41:00 -07:00
Jing Zhao
3d73d2027f HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao. 
(cherry picked from commit d62b63d297bff12d93de560dd50ddd48743b851d)
 2015-07-06 15:55:03 -07:00
Vinayakumar B
9a774dfae5 HDFS-8686. WebHdfsFileSystem#getXAttr(Path p, final String name) doesn't work if namespace is in capitals (Contributed by kanaka kumar avvaru) 
(cherry picked from commit fc92d3e6515a391847cb6170244b3d911712d96a)
 2015-07-06 16:09:42 +05:30
Vinayakumar B
b963ca84bc HDFS-8577. Avoid retrying to recover lease on a file which does not exist (Contributed by J.Andreina) 
(cherry picked from commit 2eae130ab9edd318c82503c2306f610f2b5a3e51)
 2015-07-03 13:36:07 +05:30
Andrew Wang
efe9ae9fc6 HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. 
(cherry picked from commit 5fddc5177ddad07a735d49c15a63cfc5f74d0891)
 2015-07-02 10:26:43 -07:00
Vinayakumar B
55bf014a07 HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) 
(cherry picked from commit bff5999d07e9416a22846c849487e509ede55040)
 2015-07-02 16:12:13 +05:30
Colin Patrick Mccabe
490bef0856 HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe) 
(cherry picked from commit a78d5074fb3da4779a6b5fd9947e60b9d755ee14)
 2015-07-01 17:57:33 -07:00
Jing Zhao
ff7562cc99 HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. 
(cherry picked from commit 152e5df3b65394c2939d6de3c4a649a207bb58d3)
 2015-07-01 15:00:16 -07:00
Arpit Agarwal
d38f377cd3 HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html. (Controibuted by Brahma Reddy Battula) 2015-07-01 10:36:10 -07:00
cnauroth
f7ba3c0045 HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu. 2015-06-30 16:55:10 -07:00
Colin Patrick Mccabe
7c698bc350 HADOOP-10798. globStatus() should always return a sorted list of files (cmccabe) 
(cherry picked from commit 68e588cbee660d55dba518892d064bee3795a002)
 2015-06-30 16:42:36 -07:00
Colin Patrick Mccabe
604d1bbdb7 HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 29df73dc0572cf8e450568f1d0301e8d55d64b48)
 2015-06-30 16:01:48 -07:00
Vinayakumar B
bc06d5b041 HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' (Contributed by J.Andreina) 
(cherry picked from commit 6d99017f38f5a158b5cb65c74688b4c833e4e35f)
 2015-06-30 15:25:58 +05:30
Vinayakumar B
3c632c80a2 HDFS-8579. Update HDFS usage with missing options (Contributed by J.Andreina) 
(cherry picked from commit 77588e1d32cc465e6b0699bb3564a4c7c6df16fa)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
 2015-06-30 15:02:46 +05:30
Haohui Mai
eccd4f273e HDFS-8493. Consolidate truncate() related implementation in a single class. Contributed by Rakesh R. 2015-06-29 16:44:58 -07:00
Arpit Agarwal
ff78e611c0 HDFS-8687. Remove the duplicate usage message from Dfsck.java. (Contributed by Brahma Reddy Battula) 2015-06-29 14:56:49 -07:00
Yongjun Zhang
11bdcb754a HDFS-8659. Block scanner INFO message is spamming logs. Contributed by Yongjun Zhang. 
(cherry picked from commit 43a1288fff5e323895fde66b9e3eb31a7412fcc2)
 2015-06-29 14:48:17 -07:00
Andrew Wang
ada7f66e12 HDFS-8653. Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfo. Contributed by Zhe Zhang. 
(cherry picked from commit 2ffd84273ac490724fe7e7825664bb6d09ef0e99)
 2015-06-29 12:12:54 -07:00
Benoy Antony
e40e9fc7f4 HDFS-7390. Provide JMX metrics per storage type. (Benoy Antony) 
(cherry picked from commit d3fed8e653ed9e18d3a29a11c4b24a628ac770bb)
 2015-06-29 11:02:43 -07:00
Vinayakumar B
438bb25d43 HDFS-8628. Update missing command option for fetchdt (Contributed by J.Andreina) 
(cherry picked from commit fde20ffcef6dcd477f501b5f80c86665296711c5)
 2015-06-29 16:51:15 +05:30
Vinayakumar B
beab746177 HDFS-8586. Dead Datanode is allocated for write when client is from deadnode (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 88ceb382ef45bd09cf004cf44aedbabaf3976759)
 2015-06-29 15:25:54 +05:30
Vinod Kumar Vavilapalli
4155bb565e Adding release 2.7.2 to CHANGES.txt. 
(cherry picked from commit aad6a7d5dba5858d6e9845f18c4baec16c91911d)
 2015-06-28 16:30:27 -07:00
Arpit Agarwal
0fd47fa809 HDFS-8681. BlockScanner is incorrectly disabled by default. (Contributed by Arpit Agarwal) 2015-06-28 14:51:30 -07:00
Andrew Wang
dd7776b2fe HDFS-8656. Preserve compatibility of ClientProtocol#rollingUpgrade after finalization. 
(cherry picked from commit 60b858bfa65e0feb665e1a84784a3d45e9091c66)
 2015-06-26 11:33:40 -07:00
Jing Zhao
83d76151e2 HDFS-8623. Refactor NameNode handling of invalid, corrupt, and under-recovery blocks. Contributed by Zhe Zhang. 
(cherry picked from commit de480d6c8945bd8b5b00e8657b7a72ce8dd9b6b5)
 2015-06-26 11:04:05 -07:00
Colin Patrick Mccabe
8552af91f4 HDFS-8651. Make hadoop-hdfs-project Native code -Wall-clean (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 1b764a01fd8010cf9660eb378977a1b2b81f330a)
 2015-06-26 10:28:14 -07:00
Andrew Wang
84fdd4a3a0 HDFS-8546. Use try with resources in DataStorage and Storage. 
(cherry picked from commit 1403b84b122fb76ef2b085a728b5402c32499c1f)
 2015-06-25 17:50:39 -07:00