Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,755 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

4082 Commits

Author SHA1 Message Date
Wei-Chiu Chuang 0ee1644e39 HDFS-9937. Update dfsadmin command line help and HdfsQuotaAdminGuide. Contributed by Kai Sasaki. 
(cherry picked from commit 25f0a9b3ab)
 2016-07-26 08:05:14 -07:00
Steve Loughran e5a4b6cb94 Revert "HDFS-10668. Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount. Contributed by Mingliang Liu." 
This reverts commit b3ce778268.
 2016-07-26 14:30:31 +01:00
Masatake Iwasaki f4207d0336 HDFS-10671. Fix typo in HdfsRollingUpgrade.md. Contributed by Yiqun Lin. 
(cherry picked from commit 59466b8c18)
 2016-07-26 19:50:39 +09:00
Brahma Reddy Battula b3ce778268 HDFS-10668. Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount. Contributed by Mingliang Liu. 
(cherry picked from commit 7cac7655fd)
 2016-07-26 11:02:23 +05:30
Akira Ajisaka a04b193374 Revert "HDFS-10620. StringBuilder created and appended even if logging is disabled. Contributed by Staffan Friberg." 
This reverts commit 2685e16f38.
 2016-07-26 11:04:05 +09:00
Vinitha Reddy Gankidi 0dde4035c9 HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi. 2016-07-25 18:55:00 -07:00
Jing Zhao 30c772fc59 HDFS-10688. BPServiceActor may run into a tight loop for sending block report when hitting IOException. Contributed by Chen Liang. 
(cherry picked from commit 0cde9e12a7)
 2016-07-25 18:43:25 -07:00
Xiao Chen 1a115ea317 HDFS-10225. DataNode hot swap drives should disallow storage type changes. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 132deb4cac)
 2016-07-22 15:04:17 -07:00
Arpit Agarwal 2f1e352912 HDFS-10660. Expose storage policy apis via HDFSAdmin interface. (Contributed by Rakesh R) 2016-07-22 12:12:29 -07:00
Akira Ajisaka 1222889f1a HDFS-10287. MiniDFSCluster should implement AutoCloseable. Contributed by Andras Bokor. 
(cherry picked from commit fcde6940e0)
 2016-07-21 11:28:19 -07:00
Jing Zhao 419d6ce19c HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp. 
(cherry picked from commit bd3dcf46e2)
 2016-07-21 11:15:30 -07:00
Akira Ajisaka 2685e16f38 HDFS-10620. StringBuilder created and appended even if logging is disabled. Contributed by Staffan Friberg. 
(cherry picked from commit f7dabe3add)
 2016-07-19 15:17:31 -07:00
Akira Ajisaka c92601e981 HDFS-10603. Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot. Contributed by Yiqun Lin. 
(cherry picked from commit fc570b55b9)
 2016-07-19 13:52:06 -07:00
Jitendra Pandey 328866905c HADOOP-13368. DFSOpsCountStatistics$OpType#fromSymbol and s3a.Statistic#fromSymbol should be O(1) operation. Contributed by Mingliang Liu. 2016-07-15 14:29:59 -07:00
Akira Ajisaka 6171498375 HDFS-10628. Log HDFS Balancer exit message to its own log. Contributed by Jiayi Zhou. 
(cherry picked from commit c48e9d608c)
 2016-07-15 11:43:27 -07:00
Akira Ajisaka c9f5348bbf HADOOP-13351. TestDFSClientSocketSize buffer size tests are flaky. Contributed by Aaron Fabbri and Mingliang Liu. 
(cherry picked from commit 5537c6b234)
 2016-07-14 14:42:46 -07:00
Kihwal Lee dba8eee899 HDFS-10617. PendingReconstructionBlocks.size() should be synchronized. Contributed by Eric Badger. 2016-07-13 22:03:48 -05:00
Zhe Zhang 5b4e916b3c HDFS-10544. Balancer doesn't work with IPFailoverProxyProvider. 
(cherry picked from commit 087290e6b1)
 2016-07-12 23:27:16 -07:00
Lei Xu 715734c9a3 HDFS-10387. DataTransferProtocol#writeBlock missing some javadocs (John Zhuge via lei) 
(cherry picked from commit d5f5a6475b)
 2016-07-12 16:17:02 -07:00
Jitendra Pandey be1a11c9c8 HDFS-10579. HDFS web interfaces lack configs for X-FRAME-OPTIONS protection. Contributed by Anu Engineer. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
 2016-07-11 17:54:18 -07:00
Yongjun Zhang ee23094b14 HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit da6f1b88dd)
 2016-07-08 22:01:31 -07:00
Jitendra Pandey 63b64a20c2 HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu. 2016-07-07 15:00:34 -07:00
Uma Maheswara Rao G 909fa138f0 HDFS-10592:Fix intermittent test failure of TestNameNodeResourceChecker#testCheckThatNameNodeResourceMonitorIsRunning. Contributed by Rakesh R 
(cherry picked from commit ab092c56c2)
 2016-07-07 14:00:05 -07:00
Andrew Wang 728623242f HDFS-10488. Update WebHDFS documentation regarding CREATE and MKDIR default permissions. Contributed by Wellington Chevreuil. 2016-07-07 10:37:08 -07:00
Akira Ajisaka 8a9440298d HDFS-10582. Change deprecated configuration fs.checkpoint.dir to dfs.namenode.checkpoint.dir in HDFS Commands Doc. Contributed by Pan Yuxuan. 
(cherry picked from commit a3f93beaa1)
 2016-07-06 17:54:20 -07:00
Akira Ajisaka 0401adcaca HDFS-10589. Javadoc for HAState#HAState and HAState#setStateInternal contains non-existent params. Contributed by shenyinjie. 
(cherry picked from commit 8b4b5259d5)
 2016-07-04 07:15:44 -07:00
Akira Ajisaka 5057390cad HDFS-10572. Fix TestOfflineEditsViewer#testGenerated. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 2e835d986e)
 2016-07-03 21:12:37 -07:00
Jitendra Pandey 06b89f0d14 HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu. 2016-07-01 15:35:50 -07:00
Akira Ajisaka 1285035c67 HADOOP-10568. Reuse ObjectMapper instance in CombinedHostsFileReader and CombinedHostsFileWriter. Contributed by Yiqun Lin. 
(cherry picked from commit 991c946593)
 2016-06-29 10:10:56 -07:00
Vinayakumar B 1e34763181 HDFS-10440. Improve DataNode web UI (Contributed by Weiwei Yang) 
(cherry picked from commit 2a0082c51d)
 2016-06-28 16:51:00 +05:30
Sangjin Lee ae90d4dd90 HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee) 2016-06-24 14:48:36 -07:00
Kihwal Lee 742f9083f6 HDFS-10555: Unable to loadFSEdits due to a failure in readCachePoolInfo. Contributed by Uma Maheswara Rao G 
(cherry picked from commit 01643020d2)
 2016-06-23 09:19:49 -05:00
Akira Ajisaka 96dca785fa HDFS-10561. test_native_mini_dfs fails by NoClassDefFoundError. (aajisaka) 
(cherry picked from commit ff07b10803)
 2016-06-23 15:49:55 +09:00
Akira Ajisaka ad50a64ded HDFS-7597. DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping. Contributed by Daryn Sharp, Bob Hansen, and Xiao Chen. 
(cherry picked from commit d433b16ce6)
 2016-06-22 11:02:31 +09:00
Brahma Reddy Battula ee0f389ecd HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula) 
(cherry picked from commit f2ac132d6a)
 2016-06-21 15:44:45 +05:30
Colin Patrick Mccabe 4e11f33ccc HDFS-10448. CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1 (Yiqun Lin via cmccabe) 
(cherry picked from commit 46f1602e89)
 2016-06-20 18:31:40 -07:00
Colin Patrick Mccabe 0914658eb8 HDFS-10328. Add per-cache-pool default replication num configuration (xupeng via cmccabe) 
(cherry picked from commit 5f6b4157a4)
 2016-06-20 18:12:41 -07:00
Jitendra Pandey f2ef1145c5 HDFS-10538. Remove AsyncDistributedFileSystem. Contributed by Xiaobing Zhou and Jitendra Pandey. 2016-06-20 18:04:05 -07:00
Jitendra Pandey 8f93bbcb11 HADOOP-13291. Probing stats in DFSOpsCountStatistics/S3AStorageStatistics should be correctly implemented. Contributed by Mingliang Liu. 2016-06-20 16:28:55 -07:00
Brahma Reddy Battula 3f27f40503 HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 2016-06-20 12:38:18 +05:30
Arpit Agarwal bd33cc0179 HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal) 2016-06-18 16:17:10 -07:00
Andrew Wang 94759470b8 Fix hadoop-hdfs-native-client compilation on Windows. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 3ff0510ffd)
 2016-06-17 15:54:57 -07:00
Kihwal Lee 35c6b725db HDFS-10493. Add links to datanode web UI in namenode datanodes page. Contributed by Weiwei Yang. 
(cherry picked from commit 280069510b)
 2016-06-17 11:12:16 -05:00
Akira Ajisaka a36aa920f4 HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang. 
(cherry picked from commit 09e82acaf9)
 2016-06-17 16:21:05 +09:00
Colin Patrick Mccabe 49c0d9b325 HDFS-9466. TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit c7921c9bdd)
 2016-06-16 13:52:38 -07:00
Arpit Agarwal 159b249a3d HDFS-10532. Typo in RollingUpgrade docs. (Contributed by Yiqun Lin) 2016-06-16 10:10:49 -07:00
Vinayakumar B 6ab1f545fb HDFS-10256. Use GenericTestUtils.getTestDir method in tests for temporary directories (Contributed by Vinayakumar B) 
(cherry picked from commit cc6c265171)
 2016-06-16 16:56:27 +05:30
Colin Patrick Mccabe 8280e3bcc2 HDFS-10525. Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap (Xiao Chen via cmccabe) 
(cherry picked from commit 2ca73445f5)
 2016-06-15 22:50:36 -07:00
Colin Patrick Mccabe 17301ab395 HDFS-10505. OIV's ReverseXML processor should support ACLs (Surendra Singh Lilhore via cmccabe) 
(cherry picked from commit 2449db507d)
 2016-06-15 22:42:19 -07:00
Akira Ajisaka d1c475ddd4 HADOOP-12892. fix/rewrite create-release. Contributed by Allen Wittenauer. 2016-06-16 14:03:57 +09:00