Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,479 Commits 326 Branches 371 Tags
Commit Graph

3201 Commits

Author SHA1 Message Date
Arpit Agarwal
0fd47fa809 HDFS-8681. BlockScanner is incorrectly disabled by default. (Contributed by Arpit Agarwal) 2015-06-28 14:51:30 -07:00
Andrew Wang
dd7776b2fe HDFS-8656. Preserve compatibility of ClientProtocol#rollingUpgrade after finalization. 
(cherry picked from commit 60b858bfa65e0feb665e1a84784a3d45e9091c66)
 2015-06-26 11:33:40 -07:00
Jing Zhao
83d76151e2 HDFS-8623. Refactor NameNode handling of invalid, corrupt, and under-recovery blocks. Contributed by Zhe Zhang. 
(cherry picked from commit de480d6c8945bd8b5b00e8657b7a72ce8dd9b6b5)
 2015-06-26 11:04:05 -07:00
Colin Patrick Mccabe
8552af91f4 HDFS-8651. Make hadoop-hdfs-project Native code -Wall-clean (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 1b764a01fd8010cf9660eb378977a1b2b81f330a)
 2015-06-26 10:28:14 -07:00
Andrew Wang
84fdd4a3a0 HDFS-8546. Use try with resources in DataStorage and Storage. 
(cherry picked from commit 1403b84b122fb76ef2b085a728b5402c32499c1f)
 2015-06-25 17:50:39 -07:00
Andrew Wang
ba406b723d HDFS-8665. Fix replication check in DFSTestUtils#waitForReplication. 
(cherry picked from commit ff0e5e572f5dcf7b49381cbe901360f6e171d423)
 2015-06-25 17:29:30 -07:00
Arpit Agarwal
05e9ffdd62 HDFS-8640. Make reserved RBW space visible through JMX. (Contributed by kanaka kumar avvaru) 2015-06-25 10:13:31 -07:00
Akira Ajisaka
44dbddb022 HDFS-8462. Implement GETXATTRS and LISTXATTRS operations for WebImageViewer. Contributed by Jagadesh Kiran N. 
(cherry picked from commit bc433908d35758ff0a7225cd6f5662959ef4d294)
 2015-06-26 00:22:30 +09:00
Andrew Wang
4b8593caf8 HDFS-8645. Resolve inconsistent code in TestReplicationPolicy between trunk and branch-2. Contributed by Zhe Zhang. 2015-06-24 18:26:14 -07:00
Andrew Wang
431f685300 HDFS-8646. Prune cached replicas from DatanodeDescriptor state on replica invalidation. 
(cherry picked from commit afe9ea3c12e1f5a71922400eadb642960bc87ca1)
 2015-06-24 14:46:13 -07:00
Haohui Mai
0cd7603bd6 Addendum patch for HDFS-6564. 2015-06-23 22:30:27 -07:00
Jing Zhao
77609e6465 HDFS-8639. Add Option for NameNode HTTP port in MiniDFSClusterManager. Contributed by Kai Sasaki. 
(cherry picked from commit 2ba646572185b91d6db1b09837abdcbadbfbeb49)
 2015-06-23 22:21:01 -07:00
Haohui Mai
3fb192bfb7 HDFS-6564. Use slf4j instead of common-logging in hdfs-client. Contributed by Rakesh R. 2015-06-23 11:41:32 -07:00
Jakob Homan
f6157a4a08 HDFS-8542. WebHDFS getHomeDirectory behavior does not match specification. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit fac4e04dd359a7ff31f286d664fb06f019ec0b58)
 2015-06-22 16:38:07 -07:00
Colin Patrick Mccabe
cbd11681ce HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs, instead of copying them. (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 7b424f938c3c306795d574792b086d84e4f06425)
 2015-06-22 14:37:35 -07:00
Andrew Wang
c71f57b2a0 HDFS-8608. Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks). Contributed by Zhe Zhang. 
(cherry picked from commit 6e3fcffe291faec40fa9214f4880a35a952836c4)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/UnderReplicatedBlocks.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
 2015-06-22 14:22:48 -07:00
Andrew Wang
cd1e0930dc HDFS-4366. Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks. (Derek Dagit and Zhe Zhang via wang) 2015-06-22 14:18:33 -07:00
Arpit Agarwal
175c5829f0 HDFS-8192. Eviction should key off used locked memory instead of ram disk free space. (Contributed by Arpit Agarwal) 2015-06-20 13:27:58 -07:00
Arpit Agarwal
5dcda16859 HDFS-7164. Update CHANGES.txt 2015-06-20 13:09:21 -07:00
Yongjun Zhang
5774b1ff02 Move HDFS-7546 to release 2.7.1 in CHANGES.txt. 
(cherry picked from commit bcb3c40bed572a2dd95ce7201d893d7bf59240d5)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-06-20 00:49:17 -07:00
Allen Wittenauer
92cff5663e HDFS-7546. Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern (Harsh J via aw) 
(cherry picked from commit 63613c79c1042ea3d7706ed6f7eccc8cf48ff6ea)
 2015-06-20 00:40:44 -07:00
Yongjun Zhang
87c3d3739f Move HDFS-8337 to branch 2.8 in CHANGES.txt. 
(cherry picked from commit 20c03c96066752f0a7158846de4d7bc4253e83f6)
 2015-06-20 00:28:48 -07:00
Yongjun Zhang
d657e378ad HDFS-8337. Accessing httpfs via webhdfs doesn't work from a jar with kerberos. Contributed by Yongjun Zhang. 
(cherry picked from commit 971dc838ecf8bf55a9bd64128ce2447e4613ea76)
 2015-06-19 23:44:48 -07:00
Colin Patrick Mccabe
c94579f845 HDFS-8582. Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit d112d183242f447d4b742139f3a4ea531a997f45)
 2015-06-19 19:14:38 -07:00
Arpit Agarwal
fcd1824b61 HDFS-8626. Reserved RBW space is not released if creation of RBW File fails. (Contributed by kanaka kumar avvaru) 2015-06-19 18:23:44 -07:00
Yongjun Zhang
2e13e5b253 HDFS-8633. Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys. Contributed by Ray Chiang. 
(cherry picked from commit b42f1ec13d0a837f188cf424a8dd177720478cc9)
 2015-06-19 09:50:14 -07:00
Andrew Wang
7f62e41b2e HDFS-8605. Merge Refactor of DFSOutputStream from HDFS-7285 branch. (vinayakumarb) 
(cherry picked from commit 1c13519e1e7588c3e2974138d37bf3449ca8b3df)
 2015-06-18 08:48:23 -07:00
Akira Ajisaka
998027652f HDFS-6249. Output AclEntry in PBImageXmlWriter. Contributed by surendra singh lilhore. 
(cherry picked from commit cc432885adb0182c2c5b3bf92edde12231fd567c)
 2015-06-17 17:41:55 -07:00
Akira Ajisaka
9f9315008e HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1a169a26bcc4e4bab7697965906cb9ca7ef8329e)
 2015-06-17 17:13:32 -07:00
Colin Patrick Mccabe
8939e3cc2d HDFS-8589. Fix unused imports in BPServiceActor and BlockReportLeaseManager (cmccabe) 
(cherry picked from commit 45ced38f10fcb9f831218b890786aaeb7987fed4)
 2015-06-17 17:02:08 -07:00
Haohui Mai
38a16e1a45 HDFS-8446. Separate safemode related operations in GetBlockLocations(). Contributed by Haohui Mai. 2015-06-17 16:38:19 -07:00
Haohui Mai
1270cb47e1 Update CHANGES.txt for HDFS-8238. 2015-06-17 16:20:40 -07:00
Haohui Mai
09941e6f8d HDFS-8238. Move ClientProtocol to the hdfs-client. Contributed by Takanobu Asanuma. 2015-06-17 16:16:55 -07:00
Arpit Agarwal
acc90ca175 HDFS-7164. Feature documentation for HDFS-6581. (Contributed by Arpit Agarwal) 2015-06-16 19:06:39 -07:00
Tsz-Wo Nicholas Sze
64389f727c HDFS-8606. Cleanup DFSOutputStream by removing unwanted changes from HDFS-8386. Contributed by Rakesh R 2015-06-16 18:09:30 -07:00
Xiaoyu Yao
4bfbc6b1d4 HDFS-8551. Fix hdfs datanode CLI usage message. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 9cd5ad9d84e46295249877ade50cd49c34b9bf12)
 2015-06-16 14:17:51 -07:00
Xiaoyu Yao
8ab23d9ec1 HDFS-8548. Minicluster throws NPE on shutdown. Contributed by surendra singh lilhore. 
(cherry picked from commit 6a76250b39f33466bdc8dabab33070c90aa1a389)
 2015-06-16 14:00:33 -07:00
Kihwal Lee
d2d038b0a0 HDFS-4660. Block corruption can happen during pipeline recovery. Contributed by Kihwal Lee. 
(cherry picked from commit c74517c46bf00af408ed866b6577623cdec02de1)
 2015-06-16 15:42:00 -05:00
Xiaoyu Yao
d7c8a6feaa HDFS-8597. Fix TestFSImage#testZeroBlockSize on Windows. Contributed by Xiaoyu Yao. 
(cherry picked from commit 4e88ff5b27cc33d311ab7a7248c3cf6303997ddd)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-06-16 12:47:05 -07:00
Haohui Mai
be8e4ed1e1 HDFS-8592. SafeModeException never get unwrapped. Contributed by Haohui Mai. 2015-06-15 22:07:42 -07:00
Yongjun Zhang
b1d3ed02c1 HDFS-8544. Incorrect port specified in HFTP Guide document in branch-2. (Contributed by Brahma Reddy Battula) 2015-06-15 21:45:30 -07:00
Tsz-Wo Nicholas Sze
10b97f6655 HDFS-8361. Choose SSD over DISK in block placement. 2015-06-15 17:18:09 -07:00
Tsz-Wo Nicholas Sze
95483513ed Move HDFS-8540 to 2.8 in CHANGES.txt. 2015-06-15 17:02:45 -07:00
Tsz-Wo Nicholas Sze
9ba29f081b HDFS-8540. Mover should exit with NO_MOVE_BLOCK if no block can be moved. Contributed by surendra singh lilhore 2015-06-15 16:28:37 -07:00
Tsz-Wo Nicholas Sze
5c111a5192 HDFS-8576. Lease recovery should return true if the lease can be released and the file can be closed. Contributed by J.Andreina 2015-06-15 16:09:32 -07:00
Arpit Agarwal
ea9a9b3d7e HDFS-8607. TestFileCorruption doesn't work as expected. (Contributed by Walter Su) 2015-06-15 10:12:07 -07:00
Arpit Agarwal
d07f3804b0 HDFS-8595. TestCommitBlockSynchronization fails in branch-2.7. (Patch applies to all branches). (Contributed by Arpit Agarwal) 2015-06-14 16:24:36 -07:00
Yongjun Zhang
cd578fa289 HDFS-8596. TestDistributedFileSystem et al tests are broken in branch-2 due to incorrect setting of "datanode" attribute. Contributed by Yongjun Zhang. 
(cherry picked from commit b0dc291961410b6ac2b275cdcff4b95d75727e8d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
 2015-06-14 12:01:28 -07:00
cnauroth
92144ca75c HDFS-8593. Calculation of effective layout version mishandles comparison to current layout version in storage. Contributed by Chris Nauroth. 
(cherry picked from commit b8341f1cd89791c51b396ad531ec7fcc631be149)
 2015-06-13 10:38:03 -07:00
Andrew Wang
2776255ed6 HDFS-8499. Refactor BlockInfo class hierarchy with static helper class. Contributed by Zhe Zhang. 
(cherry picked from commit 355e98ab7c7dd997378a8624f642199713467fb8)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
 2015-06-12 11:39:02 -07:00