Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,028 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

4273 Commits

Author SHA1 Message Date
Xiao Chen 83f1e3b10a Revert "HDFS-8377. Support HTTP/2 in datanode. Contributed by Duo Zhang." 
This reverts commit f70b9d9241.

(cherry picked from commit 67d2875f8f)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/webhdfs/WebHdfsHandler.java
 2017-03-06 14:59:07 -08:00
Brahma Reddy Battula 31bec2c16b HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula. 
(cherry picked from commit dcd03df9f9)
 2017-03-01 10:49:36 +05:30
Zhe Zhang 265ddb20c3 HDFS-11466. Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms. Contributed by Andrew Wang. 
(cherry picked from commit d269b488a7)
(cherry picked from commit 5fb785e154)
 2017-02-28 09:04:07 -08:00
Wei-Chiu Chuang 295e8685dd HDFS-8498. Blocks can be committed with wrong size. Contributed by Jing Zhao. 
(cherry picked from commit f3cdf29af4)
 2017-02-25 21:15:07 -08:00
Eric Payne 10d54eb978 HDFS-11404. Increase timeout on TestShortCircuitLocalRead.testDeprecatedGetBlockLocalPathInfoRpc. Contributed by Eric Badger 
(cherry picked from commit a07ddef101)
 2017-02-21 12:13:58 -06:00
Vinayakumar B 2b3e8b75c4 HDFS-11177. 'storagepolicies -getStoragePolicy' command should accept URI based path. (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit 4804050630)
(cherry picked from commit 00ca9f1792)
 2017-02-21 18:17:38 +05:30
Wei-Chiu Chuang 4c47cb68e8 HDFS-11333. Print a user friendly error message when plugins are not found. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 859bd159ae)
(cherry picked from commit a8531d5d52)
 2017-02-15 03:02:41 -08:00
Yongjun Zhang 5bb1350922 HDFS-11391. Numeric usernames do no work with WebHDFS FS write access. (Pierre Villard via Yongjun Zhang) 
(cherry picked from commit 8e53f2b9b0)
 2017-02-14 14:14:58 -08:00
Xiao Chen 8f9aae0193 HDFS-11390. Add process name to httpfs process. Contributed by Weiwei Yang. 
(cherry picked from commit 92dbdbc490)
 2017-02-14 09:47:41 -08:00
Wei-Chiu Chuang eca70e4bff HDFS-11084. Add a regression test for sticky bit support of OIV ReverseXML processor. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 89cadb42111e4ffbd3f4bde8250013bba23eb51e)
(cherry picked from commit 8e291e1015)
 2017-02-14 09:09:01 -08:00
Wei-Chiu Chuang 2463923492 HDFS-11306. Print remaining edit logs from buffer if edit log can't be rolled. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 1cde954a4f)
(cherry picked from commit 914eeb997b)
 2017-02-13 10:18:04 -08:00
Kihwal Lee 22f8b66137 HDFS-11379. DFSInputStream may infinite loop requesting block locations. Contributed by Daryn Sharp. 
(cherry picked from commit 33c62d2d19)
 2017-02-10 12:56:44 -06:00
Eric Payne 4e423edd95 HDFS-9300. TestDirectoryScanner.testThrottle() is still a little flakey. Contributed by Daniel Templeton. 
(cherry picked from commit 3c0adac88c)
 2017-02-02 15:34:59 -05:00
Anu Engineer 4f135647fd HDFS-9911. TestDataNodeLifeline Fails intermittently. Contributed by Yiqun Lin 
(cherry picked from commit a95639068c)
 2017-01-27 21:09:03 +00:00
Zhe Zhang 1a6b6e249f HDFS-10534. NameNode WebUI should display DataNode usage histogram. Contributed by Kai Sasaki. 
(cherry picked from commit 18e1d68209)
(cherry picked from commit 558fee285a)
 2017-01-25 10:53:06 -08:00
Akira Ajisaka 71cbc4f6b5 HDFS-11290. TestFSNameSystemMBean should wait until JMX cache is cleared. Contributed by Erik Krogen. 
(cherry picked from commit b1a9ec856b)
(cherry picked from commit db47bd15dd)
 2017-01-24 14:10:54 +09:00
Vinitha Reddy Gankidi e7b4f88acd HDFS-10733. NameNode terminated after full GC thinking QJM is unresponsive. Contributed by Vinitha Gankidi. 2017-01-18 12:57:09 -08:00
Andrew Wang b7b8671c0e HDFS-11312. Fix incompatible tag number change for nonDfsUsed in DatanodeInfoProto. Contributed by Sean Mackrory. 
(cherry picked from commit d51f8ba808)
(cherry picked from commit b089e122b1)
 2017-01-11 15:13:43 -08:00
Junping Du 7706a63fb4 Preparing for 2.8.1 development after cutting off 2.8.0 branch. 2017-01-10 18:03:51 -08:00
Yongjun Zhang f5e837e300 HDFS-11292. log lastWrittenTxId etc info in logSyncAll. Contributed by Yongjun Zhang. 
(cherry picked from commit 603cbcd513)
 2017-01-09 16:25:18 -08:00
Chris Nauroth 15e89634a5 HDFS-9483. Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 4c8f9e1302)
(cherry picked from commit 9c61858ee7)
 2017-01-05 15:05:12 -08:00
Wei-Chiu Chuang 162c6cc9f4 HDFS-11160. VolumeScanner reports write-in-progress replicas as corrupt incorrectly. Contributed by Wei-Chiu Chuang and Yongjun Zhang. 
(cherry picked from commit 0cb99db9d9)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java
 2017-01-05 13:29:43 -08:00
Haohui Mai e690cd5011 HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao. 2017-01-04 21:15:01 -08:00
Brahma Reddy Battula 7392a5a72c Revert "HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao." 
This reverts commit 0ff9efcf37.
 2017-01-03 19:30:45 +05:30
Haohui Mai 0ff9efcf37 HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao. 2016-12-31 01:07:41 -08:00
Daniel Templeton 747be79b22 HDFS-11278. Add missing @Test annotation for TestSafeMode.testSafeModeUtils() (Contributed by Lukas Majercak via Daniel Templeton) 
(cherry picked from commit ce3613c965)
(cherry picked from commit af266c8c85)
 2016-12-28 20:11:56 -08:00
Brahma Reddy Battula 218ed0a96b HDFS-11252. TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException. Contributed by Yiqun Lin. 
(cherry picked from commit 0ddb8defad)
 2016-12-28 10:43:21 +05:30
Mingliang Liu 9a976f3859 HDFS-11270. Document the missing options of NameNode bootstrap command. Contributed by Yiqun Lin 
(cherry picked from commit c0e0ef2969)
 2016-12-27 11:41:34 -08:00
Akira Ajisaka 0caa114183 HDFS-11272. Refine the assert messages in TestFSDirAttrOp. Contributed by Jimmy Xiang. 
(cherry picked from commit ea547529cb)
(cherry picked from commit cd331556f6)
 2016-12-26 17:17:40 +09:00
Akira Ajisaka daa475ff72 HDFS-11250. Fix a typo in ReplicaUnderRecovery#setRecoveryID. Contributed by Yiqun Lin. 
(cherry picked from commit 8f218ea284)
(cherry picked from commit 1b39268233)
 2016-12-26 16:53:14 +09:00
Akira Ajisaka 704560d95f HDFS-11271. Typo in NameNode UI. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 483cd06ad4)
(cherry picked from commit a779b4ab8f)
 2016-12-26 16:38:14 +09:00
Akira Ajisaka 990e272f96 HDFS-11258. Addendum patch to fix compile issue. Contributed by Jimmy Xiang. 
(cherry picked from commit 16c4dcad85)
 2016-12-23 03:58:10 +09:00
Haohui Mai 72a8c8dc6f HDFS-11258. File mtime change could not save to editlog. Contributed by Jimmy Xiang. 2016-12-21 14:22:27 -08:00
Mingliang Liu 059d33bb8b HDFS-11094. Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter. Contributed by Eric Badger 
(cherry picked from commit 012d28a1fa)
 2016-12-20 14:29:33 -08:00
Xiao Chen aec0d06a34 HDFS-11195. Return error when appending files by webhdfs rest api fails. Contributed by Yuanbo Liu. 
(cherry picked from commit 5b7acdd206)
 2016-12-20 12:27:44 -08:00
Brahma Reddy Battula a43bbea3c8 HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1b401f6a73)
 2016-12-20 21:16:54 +05:30
Akira Ajisaka 1e3304ad23 HDFS-11262. Remove unused variables in FSImage.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit d2026ae9e6)
(cherry picked from commit a95acbcb6e)
 2016-12-20 14:37:57 +09:00
Akira Ajisaka 07a221e6aa HDFS-11249. Redundant toString() in DFSConfigKeys.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 36947f79ba)
(cherry picked from commit eaa50a1087)
 2016-12-16 00:41:03 +09:00
Akira Ajisaka 901bc5eef5 HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin. 
(cherry picked from commit 72bff192cd)
(cherry picked from commit 190b2dca62)
 2016-12-14 18:54:39 +09:00
Andrew Wang 158292fd7e HDFS-10684. WebHDFS DataNode calls fail without parameter createparent. Contributed by John Zhuge. 
(cherry picked from commit fbdbbd57cd)
(cherry picked from commit 6b795c34d0)
 2016-12-13 18:01:40 -08:00
Vinayakumar B 69db9eecfa HDFS-10570. Remove classpath conflicts of netty-all jar in hadoop-hdfs-client (Contributed by Vinayakumar B) 
(cherry picked from commit c6fb9f0d0b)
 2016-12-12 12:12:30 +05:30
Wei-Chiu Chuang fa3b2bee61 HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 292bd78b44)
 2016-12-09 16:12:09 -08:00
Andrew Wang e8b0ef0618 HDFS-8630. WebHDFS : Support get/set/unset StoragePolicy. Contributed by Surendra Singh Lilhore. 2016-12-09 14:56:49 -08:00
Andrew Wang bced9e2e5b HDFS-11217. Annotate NameNode and DataNode MXBean interfaces as Private/Stable. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 5bd7dece92)
(cherry picked from commit 85adc6677b)
 2016-12-09 12:05:50 -08:00
Vinayakumar B b1c08737d8 HDFS-11224. Lifeline message should be ignored for dead nodes (Contributed by Vinayakumar B) 
(cherry picked from commit d1d4aba71b)
(cherry picked from commit 199d8b5594)
 2016-12-09 14:58:28 +05:30
Xiao Chen 892ee3f191 HDFS-11197. Listing encryption zones fails when deleting a EZ that is on a snapshotted directory. Contributed by Wellington Chevreuil. 
(cherry picked from commit 401c731872)
 2016-12-08 12:41:31 -08:00
Akira Ajisaka 39bf840398 HDFS-11223. Fix typos in HttpFs documentations. Contributed by Yiqun Lin. 
(cherry picked from commit 4c2cf5560f)
(cherry picked from commit 0478597ea9)
 2016-12-08 20:53:36 +09:00
Akira Ajisaka 59b0857c6b HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin. 
(cherry picked from commit 9ef89ede2f)
(cherry picked from commit e00a124cb5)
 2016-12-08 13:42:02 +09:00
Vinayakumar B 7dc22dbe0c HDFS-9057. allow/disallow snapshots via webhdfs (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 6d2332ae37)
(cherry picked from commit 4b21b47f56)
 2016-12-07 15:58:29 -08:00
Kihwal Lee ac9801fec8 HDFS-11198. NN UI should link DN web address using hostnames. Contributed by Weiwei Yang. 2016-12-06 08:08:28 -06:00