Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,350 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

2785 Commits

Author SHA1 Message Date
Xiaoyu Yao 1a6cdf97bb HDFS-8522. Change heavily recorded NN logs from INFO to DEBUG level. Contributed by xyao. 2015-06-05 17:33:06 -07:00
Andrew Wang 320e4cc0e7 HDFS-8535. Clarify that dfs usage in dfsadmin -report output includes all block replicas. Contributed by Eddy Xu. 
(cherry picked from commit b2540f486e)
 2015-06-04 15:35:12 -07:00
Andrew Wang ccc834395b HDFS-8532. Make the visibility of DFSOutputStream#streamer member variable to private. Contributed by Rakesh R. 
(cherry picked from commit 5149dc7b97)
 2015-06-04 11:09:28 -07:00
Kihwal Lee f0f277ddd0 HDFS-8463. Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException. Contributed by Masatake Iwasaki. 
(cherry picked from commit ade6d9a61e)
 2015-06-04 12:52:49 -05:00
Vinayakumar B 539ff92c2a HDFS-3716. Purger should remove stale fsimage ckpt files (Contributed by J.Andreina) 
(cherry picked from commit c59e745630)
 2015-06-03 15:31:01 +05:30
Vinayakumar B 0ed9c2d8fe HDFS-8523. Remove usage information on unsupported operation 'fsck -showprogress' from branch-2 (Contributed by J.Andreina) 2015-06-03 15:15:44 +05:30
Vinayakumar B 4bb725b4dd HDFS-8470. fsimage loading progress should update inode, delegation token and cache pool count. (Contributed by surendra singh lilhore) 
(cherry picked from commit e965dcec37)
 2015-06-03 14:25:12 +05:30
Vinayakumar B 066e45bcb6 HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina) 
(cherry picked from commit 54f83d9bd9)
 2015-06-03 12:12:22 +05:30
Colin Patrick Mccabe 12497b0543 HDFS-8521. Add VisibleForTesting annotation to BlockPoolSlice#selectReplicaToDelete. (cmccabe) 
(cherry picked from commit 806e407ac8)
 2015-06-02 20:06:53 -07:00
Andrew Wang a80a68c298 HDFS-8513. Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant. (wang) 
(cherry picked from commit c1d50a91f7)
 2015-06-02 15:48:31 -07:00
Andrew Wang 379ece15fe HDFS-8386. Improve synchronization of 'streamer' reference in DFSOutputStream. Contributed by Rakesh R. 
(cherry picked from commit efc510a570)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
 2015-06-02 15:42:27 -07:00
Colin Patrick Mccabe 17e369511d HDFS-8486. DN startup may cause severe data loss (Daryn Sharp via Colin P. McCabe) 
(cherry picked from commit 03fb5c6425)
 2015-06-02 11:42:08 -07:00
Vinayakumar B d1da842f86 HDFS-8256. '-storagepolicies , -blockId ,-replicaDetails ' options are missed out in usage and from documentation (Contributed by J.Andreina) 
(cherry picked from commit a2bd6217eb)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DFSck.java
 2015-06-02 16:25:53 +05:30
Jing Zhao 640ea994ed HDFS-8489. Subclass BlockInfo to represent contiguous blocks. Contributed by Zhe Zhang. 
(cherry picked from commit cdc13efb1a)
 2015-06-01 11:45:04 -07:00
Tsuyoshi Ozawa b91cadcafd HDFS-8490. Typo in trace enabled log in ExceptionHandler of WebHDFS. Contributed by Archana T. 
(cherry picked from commit c2356cb0bc)
 2015-06-01 00:42:11 +09:00
Jing Zhao 17fb442a4c HDFS-7609. Avoid retry cache collision when Standby NameNode loading edits. Contributed by Ming Ma. 
(cherry picked from commit 7817674a3a)
 2015-05-29 11:11:01 -07:00
Vinayakumar B 983c1d3969 HDFS-7401. Add block info to DFSInputStream' WARN message when it adds node to deadNodes (Contributed by Arshad Mohammad) 
(cherry picked from commit b75df697e0)
 2015-05-29 16:36:39 +05:30
Akira Ajisaka e7b81710dd HDFS-8443. Document dfs.namenode.service.handler.count in hdfs-site.xml. Contributed by J.Andreina. 
(cherry picked from commit d725dd8af6)
 2015-05-29 11:36:59 +09:00
Colin Patrick Mccabe b9752f24a6 HDFS-8407. libhdfs hdfsListDirectory must set errno to 0 on success (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit d2d95bfe88)
 2015-05-28 11:38:44 -07:00
cnauroth 25db341278 HDFS-8431. hdfs crypto class not found in Windows. Contributed by Anu Engineer. 
(cherry picked from commit 50eeea1300)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs.cmd
 2015-05-27 22:56:04 -07:00
Andrew Wang a634809895 HDFS-8482. Rename BlockInfoContiguous to BlockInfo. Contributed by Zhe Zhang. 
(cherry picked from commit ff83459f192f7cc4ce864f0b1f01e1e08243be83)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfo.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
 2015-05-27 15:42:12 -07:00
Haohui Mai cc348fead7 Revert HDFS-8135 in branch-2. 2015-05-27 11:06:17 -07:00
Haohui Mai f70b9d9241 HDFS-8377. Support HTTP/2 in datanode. Contributed by Duo Zhang. 2015-05-24 22:30:50 -07:00
Vinayakumar B 658f5cf985 HDFS-8268. Port conflict log for data node server is not sufficient (Contributed by Mohammad Shahid Khan) 
(cherry picked from commit 0c6638c2ea)
 2015-05-22 16:15:39 +05:30
Arpit Agarwal a073e5bd31 HDFS-8454. Remove unnecessary throttling in TestDatanodeDeath. (Arpit Agarwal) 2015-05-21 20:44:07 -07:00
Xiaoyu Yao 61d7ccb27e HDFS-8451. DFSClient probe for encryption testing interprets empty URI property for enabled. Contributed by Steve Loughran. 
(cherry picked from commit 05e04f34f2)
 2015-05-21 11:59:11 -07:00
Haohui Mai 0b909d028f HDFS-8421. Move startFile() and related functions into FSDirWriteFileOp. Contributed by Haohui Mai. 2015-05-21 08:06:13 -07:00
Akira Ajisaka 185cddfd6a HDFS-4383. Document the lease limits. Contributed by Arshad Mohammad. 
(cherry picked from commit dc8434ab2b)
 2015-05-21 17:31:47 +09:00
Kihwal Lee 536b9ee6d6 HDFS-8404. Pending block replication can get stuck using older genstamp. Contributed by Nathan Roberts. 
(cherry picked from commit 8860e352c3)
 2015-05-19 13:06:48 -05:00
Kihwal Lee 9e656bfa94 HDFS-8131. Implement a space balanced block placement policy. Contributed by Liu Shaohui. 
(cherry picked from commit de30d66b26)
 2015-05-19 08:06:07 -05:00
Vinayakumar B 6dee42f6db HDFS-6348. SecondaryNameNode not terminating properly on runtime exceptions (Contributed by Rakesh R) 
(cherry picked from commit 93972a332a)
 2015-05-19 12:25:00 +05:30
Ravi Prakash e5b805d361 HDFS-4185. Add a metric for number of active leases (Rakesh R via raviprak) 
(cherry picked from commit cdfae446ad)
 2015-05-18 12:38:32 -07:00
Tsz-Wo Nicholas Sze 7bd4db968d HDFS-8405. Fix a typo in NamenodeFsck. Contributed by Takanobu Asanuma 2015-05-19 03:01:07 +08:00
Arpit Agarwal 9bcb740049 HDFS-8345. Storage policy APIs must be exposed via the FileSystem interface. (Arpit Agarwal) 2015-05-18 11:49:01 -07:00
Uma Maheswara Rao G ea875939f1 Revert from branch-2: HDFS-8332. DFS client API calls should check filesystem closed. Contributed by Rakesh R. 2015-05-18 14:38:30 +05:30
Arpit Agarwal 151f6d6dcc HDFS-8157. Writes to RAM DISK reserve locked memory for block files. (Arpit Agarwal) 2015-05-16 09:05:50 -07:00
Haohui Mai 46d62e7016 HDFS-8403. Eliminate retries in TestFileCreation#testOverwriteOpenForWrite. Contributed by Arpit Agarwal. 2015-05-15 19:12:46 -07:00
Haohui Mai 1796d94d62 HDFS-8394. Move getAdditionalBlock() and related functionalities into a separate class. Contributed by Haohui Mai. 2015-05-15 19:10:05 -07:00
Jing Zhao d6aa65d037 HDFS-8397. Refactor the error handling code in DataStreamer. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 8f37873342)
 2015-05-15 16:32:25 -07:00
Vinayakumar B d9455c790f HDFS-6888. Allow selectively audit logging ops (Contributed by Chen He) 
(cherry picked from commit 7f2e89fa7082840bfa3e8e593c93db050a80d04f)
 2015-05-15 11:05:26 +05:30
Akira Ajisaka 7fb3486eb3 HDFS-8350. Remove old webhdfs.xml and other outdated documentation stuff. Contributed by Brahma Reddy Battula. 2015-05-15 13:57:58 +09:00
Akira Ajisaka 2e5b7f24ab HDFS-8371. Fix test failure in TestHdfsConfigFields for spanreceiver properties. Contributed by Ray Chiang. 
(cherry picked from commit cbc01ed08e)
 2015-05-15 12:15:26 +09:00
Vinayakumar B 4bbcffa510 HDFS-8150. Make getFileChecksum fail for blocks under construction (Contributed by J.Andreina) 
(cherry picked from commit def9136e02)
 2015-05-14 15:55:20 +05:30
Haohui Mai 4b5915be9f HDFS-7728. Avoid updating quota usage while loading edits. Contributed by Jing Zhao. 2015-05-13 21:50:41 -07:00
Arpit Agarwal 33f6136ee3 HDFS-8243. Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings. (Contributed by Ruth Wisniewski) 2015-05-13 19:46:34 -07:00
Colin Patrick Mccabe 52da75180a HDFS-8380. Always call addStoredBlock on blocks which have been shifted from one storage to another (cmccabe) 
(cherry picked from commit 281d47a969)
 2015-05-13 14:45:37 -07:00
Kihwal Lee 2e9392c157 HDFS-8358. TestTraceAdmin fails. Contributed by Masatake Iwasaki. 
(cherry picked from commit f9a46a00d2)
 2015-05-13 14:16:37 -05:00
Vinayakumar B 2adb1257b1 HDFS-6300. Prevent multiple balancers from running simultaneously (Contributed by Rakesh R) 
(cherry picked from commit 065d8f2a34)
 2015-05-13 17:30:40 +05:30
Akira Ajisaka 7596c6e731 HDFS-6184. Capture NN's thread dump when it fails over. Contributed by Ming Ma. 
(cherry picked from commit 2463666ecb)
 2015-05-13 11:37:59 +09:00
yliu c31c6fbda7 HDFS-8255. Rename getBlockReplication to getPreferredBlockReplication. (Contributed by Zhe Zhang) 2015-05-12 21:26:57 +08:00