Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,200 Commits 326 Branches 371 Tags
Commit Graph

4253 Commits

Author SHA1 Message Date
Wei-Chiu Chuang
295e8685dd HDFS-8498. Blocks can be committed with wrong size. Contributed by Jing Zhao. 
(cherry picked from commit f3cdf29af4c67a1963f51f02bf88075bf6dce679)
 2017-02-25 21:15:07 -08:00
Eric Payne
10d54eb978 HDFS-11404. Increase timeout on TestShortCircuitLocalRead.testDeprecatedGetBlockLocalPathInfoRpc. Contributed by Eric Badger 
(cherry picked from commit a07ddef10115fd0082832f1c338b2484507a8f49)
 2017-02-21 12:13:58 -06:00
Vinayakumar B
2b3e8b75c4 HDFS-11177. 'storagepolicies -getStoragePolicy' command should accept URI based path. (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit 480405063063f564ae0cdb34e0757ac3990569aa)
(cherry picked from commit 00ca9f1792b8d2d572559b656ffd8ad7453ef319)
 2017-02-21 18:17:38 +05:30
Wei-Chiu Chuang
4c47cb68e8 HDFS-11333. Print a user friendly error message when plugins are not found. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 859bd159ae554174200334b5eb1d7e8dbef958ad)
(cherry picked from commit a8531d5d52fb219c2adb5b6025cfc3fad264e8aa)
 2017-02-15 03:02:41 -08:00
Yongjun Zhang
5bb1350922 HDFS-11391. Numeric usernames do no work with WebHDFS FS write access. (Pierre Villard via Yongjun Zhang) 
(cherry picked from commit 8e53f2b9b08560bf4f8e81e697063277dbdc68f9)
 2017-02-14 14:14:58 -08:00
Wei-Chiu Chuang
eca70e4bff HDFS-11084. Add a regression test for sticky bit support of OIV ReverseXML processor. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 89cadb42111e4ffbd3f4bde8250013bba23eb51e)
(cherry picked from commit 8e291e1015c4694f7b11cd97a6308d0d92a884cb)
 2017-02-14 09:09:01 -08:00
Wei-Chiu Chuang
2463923492 HDFS-11306. Print remaining edit logs from buffer if edit log can't be rolled. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 1cde954a4fe7760a09b680413ad763cbe4a8feb3)
(cherry picked from commit 914eeb997b798f526eb79b4ce475ba8ced2be55f)
 2017-02-13 10:18:04 -08:00
Kihwal Lee
22f8b66137 HDFS-11379. DFSInputStream may infinite loop requesting block locations. Contributed by Daryn Sharp. 
(cherry picked from commit 33c62d2d19cd80b9c0cb9f46a635f37080dbb27c)
 2017-02-10 12:56:44 -06:00
Eric Payne
4e423edd95 HDFS-9300. TestDirectoryScanner.testThrottle() is still a little flakey. Contributed by Daniel Templeton. 
(cherry picked from commit 3c0adac88c3cddb821a732aea02bc068cafd7ea8)
 2017-02-02 15:34:59 -05:00
Anu Engineer
4f135647fd HDFS-9911. TestDataNodeLifeline Fails intermittently. Contributed by Yiqun Lin 
(cherry picked from commit a95639068c99ebcaefe8b6c4268449d12a6577d6)
 2017-01-27 21:09:03 +00:00
Zhe Zhang
1a6b6e249f HDFS-10534. NameNode WebUI should display DataNode usage histogram. Contributed by Kai Sasaki. 
(cherry picked from commit 18e1d6820926646999e7ec248c504b4145cf1a76)
(cherry picked from commit 558fee285a00ba39f4d2bf3d81d2eab3c346bd57)
 2017-01-25 10:53:06 -08:00
Akira Ajisaka
71cbc4f6b5 HDFS-11290. TestFSNameSystemMBean should wait until JMX cache is cleared. Contributed by Erik Krogen. 
(cherry picked from commit b1a9ec856b572894e769f052aea2340fc3f23c78)
(cherry picked from commit db47bd15dd80a4a5727607832c16635cb0ec7726)
 2017-01-24 14:10:54 +09:00
Vinitha Reddy Gankidi
e7b4f88acd HDFS-10733. NameNode terminated after full GC thinking QJM is unresponsive. Contributed by Vinitha Gankidi. 2017-01-18 12:57:09 -08:00
Junping Du
7706a63fb4 Preparing for 2.8.1 development after cutting off 2.8.0 branch. 2017-01-10 18:03:51 -08:00
Yongjun Zhang
f5e837e300 HDFS-11292. log lastWrittenTxId etc info in logSyncAll. Contributed by Yongjun Zhang. 
(cherry picked from commit 603cbcd513a74c29e0e4ec9dc181ff08887d64a4)
 2017-01-09 16:25:18 -08:00
Chris Nauroth
15e89634a5 HDFS-9483. Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 4c8f9e130230457fc897ed7a2a09e14d078be90a)
(cherry picked from commit 9c61858ee754b167a90533375e85ca5bde3cdce1)
 2017-01-05 15:05:12 -08:00
Wei-Chiu Chuang
162c6cc9f4 HDFS-11160. VolumeScanner reports write-in-progress replicas as corrupt incorrectly. Contributed by Wei-Chiu Chuang and Yongjun Zhang. 
(cherry picked from commit 0cb99db9d91d113e7fbe229f90a61a33433cecb9)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java
 2017-01-05 13:29:43 -08:00
Daniel Templeton
747be79b22 HDFS-11278. Add missing @Test annotation for TestSafeMode.testSafeModeUtils() (Contributed by Lukas Majercak via Daniel Templeton) 
(cherry picked from commit ce3613c9656e57efdc73edd1787bd9622d1b716e)
(cherry picked from commit af266c8c85971da18c2675c5aa638907b5016fc5)
 2016-12-28 20:11:56 -08:00
Brahma Reddy Battula
218ed0a96b HDFS-11252. TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException. Contributed by Yiqun Lin. 
(cherry picked from commit 0ddb8defad6a7fd5eb69847d1789ba51952c0cf0)
 2016-12-28 10:43:21 +05:30
Mingliang Liu
9a976f3859 HDFS-11270. Document the missing options of NameNode bootstrap command. Contributed by Yiqun Lin 
(cherry picked from commit c0e0ef29696109af9a018462059f08fd99ee3121)
 2016-12-27 11:41:34 -08:00
Akira Ajisaka
0caa114183 HDFS-11272. Refine the assert messages in TestFSDirAttrOp. Contributed by Jimmy Xiang. 
(cherry picked from commit ea547529cb17c931a756ebffa6942f71f761ad13)
(cherry picked from commit cd331556f61efac2de41a27c8e146ff925b56588)
 2016-12-26 17:17:40 +09:00
Akira Ajisaka
daa475ff72 HDFS-11250. Fix a typo in ReplicaUnderRecovery#setRecoveryID. Contributed by Yiqun Lin. 
(cherry picked from commit 8f218ea2849477bdcb4918586aaefed0cd118341)
(cherry picked from commit 1b392682333ff7c95d9400bc1b49ef3adae37c54)
 2016-12-26 16:53:14 +09:00
Akira Ajisaka
704560d95f HDFS-11271. Typo in NameNode UI. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 483cd06ad43b85e00a782fe225f1f40657bab204)
(cherry picked from commit a779b4ab8f76875228554d84c4a8448e2ba400cb)
 2016-12-26 16:38:14 +09:00
Akira Ajisaka
990e272f96 HDFS-11258. Addendum patch to fix compile issue. Contributed by Jimmy Xiang. 
(cherry picked from commit 16c4dcad854059f63fd3052b3c006ac6130fab8c)
 2016-12-23 03:58:10 +09:00
Haohui Mai
72a8c8dc6f HDFS-11258. File mtime change could not save to editlog. Contributed by Jimmy Xiang. 2016-12-21 14:22:27 -08:00
Mingliang Liu
059d33bb8b HDFS-11094. Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter. Contributed by Eric Badger 
(cherry picked from commit 012d28a1fa4a0dd7e5cdfefd85cdc8c27f6cfff6)
 2016-12-20 14:29:33 -08:00
Xiao Chen
aec0d06a34 HDFS-11195. Return error when appending files by webhdfs rest api fails. Contributed by Yuanbo Liu. 
(cherry picked from commit 5b7acdd206f5a7d1b7af29b68adaa7587d7d8c43)
 2016-12-20 12:27:44 -08:00
Brahma Reddy Battula
a43bbea3c8 HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1b401f6a734df4e23a79b3bd89c816a1fc0de574)
 2016-12-20 21:16:54 +05:30
Akira Ajisaka
1e3304ad23 HDFS-11262. Remove unused variables in FSImage.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit d2026ae9e6c86f4fd9e48b80e71233181c1853d9)
(cherry picked from commit a95acbcb6e955cf1673f053cb9dab9e5e5dc6803)
 2016-12-20 14:37:57 +09:00
Akira Ajisaka
07a221e6aa HDFS-11249. Redundant toString() in DFSConfigKeys.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 36947f79ba66bf8ce150813e5dc1d06c789f2b2a)
(cherry picked from commit eaa50a1087ce1c29349bc266bc485fb2222ac5c5)
 2016-12-16 00:41:03 +09:00
Akira Ajisaka
901bc5eef5 HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin. 
(cherry picked from commit 72bff192cd37ff97442e0f8dd477fbc2e58fc12d)
(cherry picked from commit 190b2dca6204e659ed8561c682c4a03f30258298)
 2016-12-14 18:54:39 +09:00
Andrew Wang
158292fd7e HDFS-10684. WebHDFS DataNode calls fail without parameter createparent. Contributed by John Zhuge. 
(cherry picked from commit fbdbbd57cdc3d8c778fca9266a7cadf298c8ff6c)
(cherry picked from commit 6b795c34d0c534a8d5214c64036ba73708d58fd0)
 2016-12-13 18:01:40 -08:00
Wei-Chiu Chuang
fa3b2bee61 HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 292bd78b4494ba1a1073b32b3f89d95e72f3204d)
 2016-12-09 16:12:09 -08:00
Andrew Wang
e8b0ef0618 HDFS-8630. WebHDFS : Support get/set/unset StoragePolicy. Contributed by Surendra Singh Lilhore. 2016-12-09 14:56:49 -08:00
Andrew Wang
bced9e2e5b HDFS-11217. Annotate NameNode and DataNode MXBean interfaces as Private/Stable. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 5bd7dece920b20da95755cf7fbba9b3f39c7da69)
(cherry picked from commit 85adc6677ba28bf106361be595e709941cb36496)
 2016-12-09 12:05:50 -08:00
Vinayakumar B
b1c08737d8 HDFS-11224. Lifeline message should be ignored for dead nodes (Contributed by Vinayakumar B) 
(cherry picked from commit d1d4aba71b21871140b162583a4b94ce118e1fb3)
(cherry picked from commit 199d8b559434c296c22ce7cfe5fb8de0dead0d12)
 2016-12-09 14:58:28 +05:30
Xiao Chen
892ee3f191 HDFS-11197. Listing encryption zones fails when deleting a EZ that is on a snapshotted directory. Contributed by Wellington Chevreuil. 
(cherry picked from commit 401c7318723d8d62c7fc29728f7f4e8d336b4d2f)
 2016-12-08 12:41:31 -08:00
Akira Ajisaka
59b0857c6b HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin. 
(cherry picked from commit 9ef89ede2f18c76c601fd585cb9d47511f5fc3ed)
(cherry picked from commit e00a124cb5c43e34674faa8b450254074b7fd3a6)
 2016-12-08 13:42:02 +09:00
Vinayakumar B
7dc22dbe0c HDFS-9057. allow/disallow snapshots via webhdfs (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 6d2332ae375e26d024358c6e75fdb3c68a781a66)
(cherry picked from commit 4b21b47f5607027672403fce211165abe03b9a77)
 2016-12-07 15:58:29 -08:00
Kihwal Lee
ac9801fec8 HDFS-11198. NN UI should link DN web address using hostnames. Contributed by Weiwei Yang. 2016-12-06 08:08:28 -06:00
Andrew Wang
1a7b2ab9bb Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang" 
This reverts commit 3b80424d4f2ff073310c9628f4645aab6cfb6d4d.
 2016-12-05 23:09:30 -08:00
Andrew Wang
79f830ed22 HDFS-10581. Hide redundant table on NameNode WebUI when no nodes are decomissioning. Contributed by Weiwei Yang. 
(cherry picked from commit 8e63fa98eabac55bdb2254306584ad1e759c79eb)
(cherry picked from commit 2fdae7324b1c98a2262d0de8e73c0c9099ca6ff0)
 2016-12-05 18:14:09 -08:00
Mingliang Liu
3b80424d4f HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang 
(cherry picked from commit c7ff34f8dcca3a2024230c5383abd9299daa1b20)
(cherry picked from commit be969e591883aa6cdd69bb62cea4e8904ece65f1)
 2016-12-02 11:38:36 -08:00
Akira Ajisaka
5025a898e1 HDFS-11180. Intermittent deadlock in NameNode when failover happens. 
(cherry picked from commit 5a7941a4fc193259ab4a306f7fe4f68bf101d0e0)
 2016-12-02 11:35:22 +09:00
Kihwal Lee
dd4acebb41 HDFS-8674. Improve performance of postponed block scans. Contributed by Daryn Sharp. 
(cherry picked from commit 0d8a35bd6de5d2a5a9b816ca98f31975e94bd7c6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
 2016-12-01 12:20:30 -06:00
Robert Kanter
92ee5e2077 HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter) 
(cherry picked from commit 47ca9e26fba4a639e43bee5bfc001ffc4b42330d)
(cherry picked from commit 285edf691db42a3e17138d960f8560c62d8d0dde)
 2016-11-28 18:23:23 -08:00
Akira Ajisaka
011d478aab HDFS-11175. Document uppercase key names are not supported in TransparentEncryption.md. Contributed by Yiqun Lin. 
(cherry picked from commit 636f7547b7067c315cf5448d77e49a8fe55651b3)
(cherry picked from commit 0df7f5cdf673d9b0f97f85099c52a0a77342836e)
 2016-11-25 17:50:43 +09:00
Brahma Reddy Battula
9be7b353dd HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula. 
(cherry picked from commit afcf8d38e750f935c06629e641a1321b79c4cace)
 2016-11-22 20:36:32 +05:30
Kihwal Lee
f5410f0814 HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang. 
(cherry picked from commit 774b0cd845a67bc0e2ef99b415ce1e5432769551)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-11-21 10:52:42 -06:00
Brahma Reddy Battula
ce4cd98784 HDFS-11101. TestDFSShell#testMoveWithTargetPortEmpty fails intermittently. Contributed By Brahma Reddy Battula. 
(cherry picked from commit f92206774899b84e8abaecdf97399b65e0995ed8)
 2016-11-21 19:36:57 +05:30