Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,536 Commits 326 Branches 371 Tags
Commit Graph

3223 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
a8bf34cad8 Release process for 2.7.1: Set the release date for 2.7.1. 
(cherry picked from commit bf89ddb9b8ca27a34074b415f85599dd48b8fc50)
 2015-07-06 16:41:00 -07:00
Jing Zhao
3d73d2027f HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao. 
(cherry picked from commit d62b63d297bff12d93de560dd50ddd48743b851d)
 2015-07-06 15:55:03 -07:00
Vinayakumar B
9a774dfae5 HDFS-8686. WebHdfsFileSystem#getXAttr(Path p, final String name) doesn't work if namespace is in capitals (Contributed by kanaka kumar avvaru) 
(cherry picked from commit fc92d3e6515a391847cb6170244b3d911712d96a)
 2015-07-06 16:09:42 +05:30
Vinayakumar B
b963ca84bc HDFS-8577. Avoid retrying to recover lease on a file which does not exist (Contributed by J.Andreina) 
(cherry picked from commit 2eae130ab9edd318c82503c2306f610f2b5a3e51)
 2015-07-03 13:36:07 +05:30
Andrew Wang
efe9ae9fc6 HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. 
(cherry picked from commit 5fddc5177ddad07a735d49c15a63cfc5f74d0891)
 2015-07-02 10:26:43 -07:00
Vinayakumar B
55bf014a07 HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) 
(cherry picked from commit bff5999d07e9416a22846c849487e509ede55040)
 2015-07-02 16:12:13 +05:30
Colin Patrick Mccabe
490bef0856 HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe) 
(cherry picked from commit a78d5074fb3da4779a6b5fd9947e60b9d755ee14)
 2015-07-01 17:57:33 -07:00
Jing Zhao
ff7562cc99 HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. 
(cherry picked from commit 152e5df3b65394c2939d6de3c4a649a207bb58d3)
 2015-07-01 15:00:16 -07:00
Arpit Agarwal
d38f377cd3 HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html. (Controibuted by Brahma Reddy Battula) 2015-07-01 10:36:10 -07:00
cnauroth
f7ba3c0045 HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu. 2015-06-30 16:55:10 -07:00
Colin Patrick Mccabe
7c698bc350 HADOOP-10798. globStatus() should always return a sorted list of files (cmccabe) 
(cherry picked from commit 68e588cbee660d55dba518892d064bee3795a002)
 2015-06-30 16:42:36 -07:00
Colin Patrick Mccabe
604d1bbdb7 HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 29df73dc0572cf8e450568f1d0301e8d55d64b48)
 2015-06-30 16:01:48 -07:00
Vinayakumar B
bc06d5b041 HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' (Contributed by J.Andreina) 
(cherry picked from commit 6d99017f38f5a158b5cb65c74688b4c833e4e35f)
 2015-06-30 15:25:58 +05:30
Vinayakumar B
3c632c80a2 HDFS-8579. Update HDFS usage with missing options (Contributed by J.Andreina) 
(cherry picked from commit 77588e1d32cc465e6b0699bb3564a4c7c6df16fa)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
 2015-06-30 15:02:46 +05:30
Haohui Mai
eccd4f273e HDFS-8493. Consolidate truncate() related implementation in a single class. Contributed by Rakesh R. 2015-06-29 16:44:58 -07:00
Arpit Agarwal
ff78e611c0 HDFS-8687. Remove the duplicate usage message from Dfsck.java. (Contributed by Brahma Reddy Battula) 2015-06-29 14:56:49 -07:00
Yongjun Zhang
11bdcb754a HDFS-8659. Block scanner INFO message is spamming logs. Contributed by Yongjun Zhang. 
(cherry picked from commit 43a1288fff5e323895fde66b9e3eb31a7412fcc2)
 2015-06-29 14:48:17 -07:00
Andrew Wang
ada7f66e12 HDFS-8653. Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfo. Contributed by Zhe Zhang. 
(cherry picked from commit 2ffd84273ac490724fe7e7825664bb6d09ef0e99)
 2015-06-29 12:12:54 -07:00
Benoy Antony
e40e9fc7f4 HDFS-7390. Provide JMX metrics per storage type. (Benoy Antony) 
(cherry picked from commit d3fed8e653ed9e18d3a29a11c4b24a628ac770bb)
 2015-06-29 11:02:43 -07:00
Vinayakumar B
438bb25d43 HDFS-8628. Update missing command option for fetchdt (Contributed by J.Andreina) 
(cherry picked from commit fde20ffcef6dcd477f501b5f80c86665296711c5)
 2015-06-29 16:51:15 +05:30
Vinayakumar B
beab746177 HDFS-8586. Dead Datanode is allocated for write when client is from deadnode (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 88ceb382ef45bd09cf004cf44aedbabaf3976759)
 2015-06-29 15:25:54 +05:30
Vinod Kumar Vavilapalli
4155bb565e Adding release 2.7.2 to CHANGES.txt. 
(cherry picked from commit aad6a7d5dba5858d6e9845f18c4baec16c91911d)
 2015-06-28 16:30:27 -07:00
Arpit Agarwal
0fd47fa809 HDFS-8681. BlockScanner is incorrectly disabled by default. (Contributed by Arpit Agarwal) 2015-06-28 14:51:30 -07:00
Andrew Wang
dd7776b2fe HDFS-8656. Preserve compatibility of ClientProtocol#rollingUpgrade after finalization. 
(cherry picked from commit 60b858bfa65e0feb665e1a84784a3d45e9091c66)
 2015-06-26 11:33:40 -07:00
Jing Zhao
83d76151e2 HDFS-8623. Refactor NameNode handling of invalid, corrupt, and under-recovery blocks. Contributed by Zhe Zhang. 
(cherry picked from commit de480d6c8945bd8b5b00e8657b7a72ce8dd9b6b5)
 2015-06-26 11:04:05 -07:00
Colin Patrick Mccabe
8552af91f4 HDFS-8651. Make hadoop-hdfs-project Native code -Wall-clean (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 1b764a01fd8010cf9660eb378977a1b2b81f330a)
 2015-06-26 10:28:14 -07:00
Andrew Wang
84fdd4a3a0 HDFS-8546. Use try with resources in DataStorage and Storage. 
(cherry picked from commit 1403b84b122fb76ef2b085a728b5402c32499c1f)
 2015-06-25 17:50:39 -07:00
Andrew Wang
ba406b723d HDFS-8665. Fix replication check in DFSTestUtils#waitForReplication. 
(cherry picked from commit ff0e5e572f5dcf7b49381cbe901360f6e171d423)
 2015-06-25 17:29:30 -07:00
Arpit Agarwal
05e9ffdd62 HDFS-8640. Make reserved RBW space visible through JMX. (Contributed by kanaka kumar avvaru) 2015-06-25 10:13:31 -07:00
Akira Ajisaka
44dbddb022 HDFS-8462. Implement GETXATTRS and LISTXATTRS operations for WebImageViewer. Contributed by Jagadesh Kiran N. 
(cherry picked from commit bc433908d35758ff0a7225cd6f5662959ef4d294)
 2015-06-26 00:22:30 +09:00
Andrew Wang
4b8593caf8 HDFS-8645. Resolve inconsistent code in TestReplicationPolicy between trunk and branch-2. Contributed by Zhe Zhang. 2015-06-24 18:26:14 -07:00
Andrew Wang
431f685300 HDFS-8646. Prune cached replicas from DatanodeDescriptor state on replica invalidation. 
(cherry picked from commit afe9ea3c12e1f5a71922400eadb642960bc87ca1)
 2015-06-24 14:46:13 -07:00
Haohui Mai
0cd7603bd6 Addendum patch for HDFS-6564. 2015-06-23 22:30:27 -07:00
Jing Zhao
77609e6465 HDFS-8639. Add Option for NameNode HTTP port in MiniDFSClusterManager. Contributed by Kai Sasaki. 
(cherry picked from commit 2ba646572185b91d6db1b09837abdcbadbfbeb49)
 2015-06-23 22:21:01 -07:00
Haohui Mai
3fb192bfb7 HDFS-6564. Use slf4j instead of common-logging in hdfs-client. Contributed by Rakesh R. 2015-06-23 11:41:32 -07:00
Jakob Homan
f6157a4a08 HDFS-8542. WebHDFS getHomeDirectory behavior does not match specification. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit fac4e04dd359a7ff31f286d664fb06f019ec0b58)
 2015-06-22 16:38:07 -07:00
Colin Patrick Mccabe
cbd11681ce HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs, instead of copying them. (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 7b424f938c3c306795d574792b086d84e4f06425)
 2015-06-22 14:37:35 -07:00
Andrew Wang
c71f57b2a0 HDFS-8608. Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks). Contributed by Zhe Zhang. 
(cherry picked from commit 6e3fcffe291faec40fa9214f4880a35a952836c4)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/UnderReplicatedBlocks.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
 2015-06-22 14:22:48 -07:00
Andrew Wang
cd1e0930dc HDFS-4366. Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks. (Derek Dagit and Zhe Zhang via wang) 2015-06-22 14:18:33 -07:00
Arpit Agarwal
175c5829f0 HDFS-8192. Eviction should key off used locked memory instead of ram disk free space. (Contributed by Arpit Agarwal) 2015-06-20 13:27:58 -07:00
Arpit Agarwal
5dcda16859 HDFS-7164. Update CHANGES.txt 2015-06-20 13:09:21 -07:00
Yongjun Zhang
5774b1ff02 Move HDFS-7546 to release 2.7.1 in CHANGES.txt. 
(cherry picked from commit bcb3c40bed572a2dd95ce7201d893d7bf59240d5)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-06-20 00:49:17 -07:00
Allen Wittenauer
92cff5663e HDFS-7546. Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern (Harsh J via aw) 
(cherry picked from commit 63613c79c1042ea3d7706ed6f7eccc8cf48ff6ea)
 2015-06-20 00:40:44 -07:00
Yongjun Zhang
87c3d3739f Move HDFS-8337 to branch 2.8 in CHANGES.txt. 
(cherry picked from commit 20c03c96066752f0a7158846de4d7bc4253e83f6)
 2015-06-20 00:28:48 -07:00
Yongjun Zhang
d657e378ad HDFS-8337. Accessing httpfs via webhdfs doesn't work from a jar with kerberos. Contributed by Yongjun Zhang. 
(cherry picked from commit 971dc838ecf8bf55a9bd64128ce2447e4613ea76)
 2015-06-19 23:44:48 -07:00
Colin Patrick Mccabe
c94579f845 HDFS-8582. Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit d112d183242f447d4b742139f3a4ea531a997f45)
 2015-06-19 19:14:38 -07:00
Arpit Agarwal
fcd1824b61 HDFS-8626. Reserved RBW space is not released if creation of RBW File fails. (Contributed by kanaka kumar avvaru) 2015-06-19 18:23:44 -07:00
Yongjun Zhang
2e13e5b253 HDFS-8633. Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys. Contributed by Ray Chiang. 
(cherry picked from commit b42f1ec13d0a837f188cf424a8dd177720478cc9)
 2015-06-19 09:50:14 -07:00
Andrew Wang
7f62e41b2e HDFS-8605. Merge Refactor of DFSOutputStream from HDFS-7285 branch. (vinayakumarb) 
(cherry picked from commit 1c13519e1e7588c3e2974138d37bf3449ca8b3df)
 2015-06-18 08:48:23 -07:00
Akira Ajisaka
998027652f HDFS-6249. Output AclEntry in PBImageXmlWriter. Contributed by surendra singh lilhore. 
(cherry picked from commit cc432885adb0182c2c5b3bf92edde12231fd567c)
 2015-06-17 17:41:55 -07:00