Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,767 Commits 326 Branches 371 Tags
Commit Graph

4086 Commits

Author SHA1 Message Date
Akira Ajisaka
ab49c2b399 HDFS-10696. TestHDFSCLI fails. Contributed by Kai Sasaki. 
(cherry picked from commit 414fbfab41470923eb82a21628709e51fd3a3f6e)
 2016-07-28 16:59:25 +09:00
Yongjun Zhang
bd84cf3036 HDFS-10667. Report more accurate info about data corruption location. (Yuanbo Liu via Yongjun Zhang) 
(cherry picked from commit eb7ff0c9927131f4a797148b970a95a1abf7d847)
 2016-07-27 15:23:38 -07:00
Brahma Reddy Battula
096d3fa25c HDFS-10668. Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount. Contributed by Mingliang Liu. 2016-07-27 10:28:31 +05:30
Arpit Agarwal
c08c7b7a94 HDFS-10642. TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently. (Contributed by Mingliang Liu) 2016-07-26 12:44:36 -07:00
Wei-Chiu Chuang
0ee1644e39 HDFS-9937. Update dfsadmin command line help and HdfsQuotaAdminGuide. Contributed by Kai Sasaki. 
(cherry picked from commit 25f0a9b3ab136d44f70eb2805598e2df8325612a)
 2016-07-26 08:05:14 -07:00
Steve Loughran
e5a4b6cb94 Revert "HDFS-10668. Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount. Contributed by Mingliang Liu." 
This reverts commit b3ce778268a441b742b625594d1a55b83960f355.
 2016-07-26 14:30:31 +01:00
Masatake Iwasaki
f4207d0336 HDFS-10671. Fix typo in HdfsRollingUpgrade.md. Contributed by Yiqun Lin. 
(cherry picked from commit 59466b8c180716dda7aa670728580a88e54eb4d2)
 2016-07-26 19:50:39 +09:00
Brahma Reddy Battula
b3ce778268 HDFS-10668. Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount. Contributed by Mingliang Liu. 
(cherry picked from commit 7cac7655fd84ac394250705b31e3927fe548e34a)
 2016-07-26 11:02:23 +05:30
Akira Ajisaka
a04b193374 Revert "HDFS-10620. StringBuilder created and appended even if logging is disabled. Contributed by Staffan Friberg." 
This reverts commit 2685e16f381532d53aea413ce1c0a14181ee7c89.
 2016-07-26 11:04:05 +09:00
Vinitha Reddy Gankidi
0dde4035c9 HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi. 2016-07-25 18:55:00 -07:00
Jing Zhao
30c772fc59 HDFS-10688. BPServiceActor may run into a tight loop for sending block report when hitting IOException. Contributed by Chen Liang. 
(cherry picked from commit 0cde9e12a7175e4d8bc4ccd5c36055b280d1fbd6)
 2016-07-25 18:43:25 -07:00
Xiao Chen
1a115ea317 HDFS-10225. DataNode hot swap drives should disallow storage type changes. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 132deb4cacc413a85a6af2f390ec79a76c91961c)
 2016-07-22 15:04:17 -07:00
Arpit Agarwal
2f1e352912 HDFS-10660. Expose storage policy apis via HDFSAdmin interface. (Contributed by Rakesh R) 2016-07-22 12:12:29 -07:00
Akira Ajisaka
1222889f1a HDFS-10287. MiniDFSCluster should implement AutoCloseable. Contributed by Andras Bokor. 
(cherry picked from commit fcde6940e0cbdedb1105007e4857137ecdfa1284)
 2016-07-21 11:28:19 -07:00
Jing Zhao
419d6ce19c HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp. 
(cherry picked from commit bd3dcf46e263b6e6aa3fca6a5d9936cc49e3280f)
 2016-07-21 11:15:30 -07:00
Akira Ajisaka
2685e16f38 HDFS-10620. StringBuilder created and appended even if logging is disabled. Contributed by Staffan Friberg. 
(cherry picked from commit f7dabe3addf3f6eb32ea9b8ec1354fb442ce4222)
 2016-07-19 15:17:31 -07:00
Akira Ajisaka
c92601e981 HDFS-10603. Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot. Contributed by Yiqun Lin. 
(cherry picked from commit fc570b55b9d1d1d57329eca223f443e2c86f34b7)
 2016-07-19 13:52:06 -07:00
Jitendra Pandey
328866905c HADOOP-13368. DFSOpsCountStatistics$OpType#fromSymbol and s3a.Statistic#fromSymbol should be O(1) operation. Contributed by Mingliang Liu. 2016-07-15 14:29:59 -07:00
Akira Ajisaka
6171498375 HDFS-10628. Log HDFS Balancer exit message to its own log. Contributed by Jiayi Zhou. 
(cherry picked from commit c48e9d608c1daf7826f2e738c0a67d8eab79d8de)
 2016-07-15 11:43:27 -07:00
Akira Ajisaka
c9f5348bbf HADOOP-13351. TestDFSClientSocketSize buffer size tests are flaky. Contributed by Aaron Fabbri and Mingliang Liu. 
(cherry picked from commit 5537c6b23430285ebee33c6d9b69d3ec1e9b17b1)
 2016-07-14 14:42:46 -07:00
Kihwal Lee
dba8eee899 HDFS-10617. PendingReconstructionBlocks.size() should be synchronized. Contributed by Eric Badger. 2016-07-13 22:03:48 -05:00
Zhe Zhang
5b4e916b3c HDFS-10544. Balancer doesn't work with IPFailoverProxyProvider. 
(cherry picked from commit 087290e6b1cb1082646d966b65494082712ebe3e)
 2016-07-12 23:27:16 -07:00
Lei Xu
715734c9a3 HDFS-10387. DataTransferProtocol#writeBlock missing some javadocs (John Zhuge via lei) 
(cherry picked from commit d5f5a6475b19a52bf54f97cd8843408265b888f0)
 2016-07-12 16:17:02 -07:00
Jitendra Pandey
be1a11c9c8 HDFS-10579. HDFS web interfaces lack configs for X-FRAME-OPTIONS protection. Contributed by Anu Engineer. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
 2016-07-11 17:54:18 -07:00
Yongjun Zhang
ee23094b14 HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit da6f1b88dd47e22b24d44f6fc8bbee73e85746f7)
 2016-07-08 22:01:31 -07:00
Jitendra Pandey
63b64a20c2 HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu. 2016-07-07 15:00:34 -07:00
Uma Maheswara Rao G
909fa138f0 HDFS-10592:Fix intermittent test failure of TestNameNodeResourceChecker#testCheckThatNameNodeResourceMonitorIsRunning. Contributed by Rakesh R 
(cherry picked from commit ab092c56c251f27a9426e3c69a784417fdf9a26e)
 2016-07-07 14:00:05 -07:00
Andrew Wang
728623242f HDFS-10488. Update WebHDFS documentation regarding CREATE and MKDIR default permissions. Contributed by Wellington Chevreuil. 2016-07-07 10:37:08 -07:00
Akira Ajisaka
8a9440298d HDFS-10582. Change deprecated configuration fs.checkpoint.dir to dfs.namenode.checkpoint.dir in HDFS Commands Doc. Contributed by Pan Yuxuan. 
(cherry picked from commit a3f93beaa19d9acb7b1db2958102d0004b0eee46)
 2016-07-06 17:54:20 -07:00
Akira Ajisaka
0401adcaca HDFS-10589. Javadoc for HAState#HAState and HAState#setStateInternal contains non-existent params. Contributed by shenyinjie. 
(cherry picked from commit 8b4b5259d5088360476b4582c4cf7b0e7973eff3)
 2016-07-04 07:15:44 -07:00
Akira Ajisaka
5057390cad HDFS-10572. Fix TestOfflineEditsViewer#testGenerated. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 2e835d986ecdc881eab3ab9650d854b6df482b20)
 2016-07-03 21:12:37 -07:00
Jitendra Pandey
06b89f0d14 HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu. 2016-07-01 15:35:50 -07:00
Akira Ajisaka
1285035c67 HADOOP-10568. Reuse ObjectMapper instance in CombinedHostsFileReader and CombinedHostsFileWriter. Contributed by Yiqun Lin. 
(cherry picked from commit 991c946593454b73b56f3c403fe128afe6f46355)
 2016-06-29 10:10:56 -07:00
Vinayakumar B
1e34763181 HDFS-10440. Improve DataNode web UI (Contributed by Weiwei Yang) 
(cherry picked from commit 2a0082c51da7cbe2770eddb5f72cd7f8d72fa5f6)
 2016-06-28 16:51:00 +05:30
Sangjin Lee
ae90d4dd90 HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee) 2016-06-24 14:48:36 -07:00
Kihwal Lee
742f9083f6 HDFS-10555: Unable to loadFSEdits due to a failure in readCachePoolInfo. Contributed by Uma Maheswara Rao G 
(cherry picked from commit 01643020d24b606c26cb2dcaefdb6e47a5f06c8f)
 2016-06-23 09:19:49 -05:00
Akira Ajisaka
96dca785fa HDFS-10561. test_native_mini_dfs fails by NoClassDefFoundError. (aajisaka) 
(cherry picked from commit ff07b108039ecc4e680352f756930673ced42256)
 2016-06-23 15:49:55 +09:00
Akira Ajisaka
ad50a64ded HDFS-7597. DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping. Contributed by Daryn Sharp, Bob Hansen, and Xiao Chen. 
(cherry picked from commit d433b16ce6d74f1a44bc29446c74b1cb5f8a10fa)
 2016-06-22 11:02:31 +09:00
Brahma Reddy Battula
ee0f389ecd HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula) 
(cherry picked from commit f2ac132d6a21c215093b7f87acf2843ac8123716)
 2016-06-21 15:44:45 +05:30
Colin Patrick Mccabe
4e11f33ccc HDFS-10448. CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1 (Yiqun Lin via cmccabe) 
(cherry picked from commit 46f1602e896273b308fbd5df6c75f6c142828227)
 2016-06-20 18:31:40 -07:00
Colin Patrick Mccabe
0914658eb8 HDFS-10328. Add per-cache-pool default replication num configuration (xupeng via cmccabe) 
(cherry picked from commit 5f6b4157a40e974ccc6a56c39dbd35c54f393fbd)
 2016-06-20 18:12:41 -07:00
Jitendra Pandey
f2ef1145c5 HDFS-10538. Remove AsyncDistributedFileSystem. Contributed by Xiaobing Zhou and Jitendra Pandey. 2016-06-20 18:04:05 -07:00
Jitendra Pandey
8f93bbcb11 HADOOP-13291. Probing stats in DFSOpsCountStatistics/S3AStorageStatistics should be correctly implemented. Contributed by Mingliang Liu. 2016-06-20 16:28:55 -07:00
Brahma Reddy Battula
3f27f40503 HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 2016-06-20 12:38:18 +05:30
Arpit Agarwal
bd33cc0179 HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal) 2016-06-18 16:17:10 -07:00
Andrew Wang
94759470b8 Fix hadoop-hdfs-native-client compilation on Windows. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 3ff0510ffdc20e44f06aec591782f8875b686327)
 2016-06-17 15:54:57 -07:00
Kihwal Lee
35c6b725db HDFS-10493. Add links to datanode web UI in namenode datanodes page. Contributed by Weiwei Yang. 
(cherry picked from commit 280069510b71d81a150b2b28d9fa987891d82774)
 2016-06-17 11:12:16 -05:00
Akira Ajisaka
a36aa920f4 HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang. 
(cherry picked from commit 09e82acaf9a6d7663bc51bbca0cdeca4b582b535)
 2016-06-17 16:21:05 +09:00
Colin Patrick Mccabe
49c0d9b325 HDFS-9466. TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit c7921c9bddb79c9db5059b6c3f7a3a586a3cd95b)
 2016-06-16 13:52:38 -07:00
Arpit Agarwal
159b249a3d HDFS-10532. Typo in RollingUpgrade docs. (Contributed by Yiqun Lin) 2016-06-16 10:10:49 -07:00