Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,066 Commits 326 Branches 371 Tags
Commit Graph

4697 Commits

Author SHA1 Message Date
Vinayakumar B
199d8b5594 HDFS-11224. Lifeline message should be ignored for dead nodes (Contributed by Vinayakumar B) 
(cherry picked from commit d1d4aba71b21871140b162583a4b94ce118e1fb3)
 2016-12-09 14:54:37 +05:30
Xiao Chen
e51f32f74c HDFS-11197. Listing encryption zones fails when deleting a EZ that is on a snapshotted directory. Contributed by Wellington Chevreuil. 
(cherry picked from commit 401c7318723d8d62c7fc29728f7f4e8d336b4d2f)
 2016-12-08 12:41:17 -08:00
Akira Ajisaka
0478597ea9 HDFS-11223. Fix typos in HttpFs documentations. Contributed by Yiqun Lin. 
(cherry picked from commit 4c2cf5560f6d952cfa36ef656f0b04dc3150f8b3)
 2016-12-08 20:53:09 +09:00
Akira Ajisaka
e00a124cb5 HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin. 
(cherry picked from commit 9ef89ede2f18c76c601fd585cb9d47511f5fc3ed)
 2016-12-08 13:39:58 +09:00
Vinayakumar B
4b21b47f56 HDFS-9057. allow/disallow snapshots via webhdfs (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 6d2332ae375e26d024358c6e75fdb3c68a781a66)
 2016-12-07 15:58:15 -08:00
Ming Ma
d2656dc5a6 HDFS-10206. Datanodes not sorted properly by distance when the reader isn't a datanode. (Nandakumar via mingma) 2016-12-07 08:27:17 -08:00
Karthik Kambatla
8773cd5f76 HADOOP-13859. TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties. (Haibo Chen via kasha) 
(cherry picked from commit c8d0a049b00536385f06fad412a2288f005bf2ce)
 2016-12-06 14:16:38 -08:00
Mingliang Liu
eb9e7820a9 HDFS-11211. Add a time unit to the DataNode client trace format. Contributed by Jagadesh Kiran N 
(cherry picked from commit 43cb1678cc000b1fbf8b813ee14ecef19b86a55c)
 2016-12-06 09:13:38 -08:00
Kihwal Lee
f74dad7414 HDFS-11198. NN UI should link DN web address using hostnames. Contributed by Weiwei Yang. 2016-12-06 08:07:54 -06:00
Andrew Wang
6a2f239d9e Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang" 
This reverts commit be969e591883aa6cdd69bb62cea4e8904ece65f1.
 2016-12-05 23:09:14 -08:00
Andrew Wang
2fdae7324b HDFS-10581. Hide redundant table on NameNode WebUI when no nodes are decomissioning. Contributed by Weiwei Yang. 
(cherry picked from commit 8e63fa98eabac55bdb2254306584ad1e759c79eb)
 2016-12-05 18:14:06 -08:00
Wei-Chiu Chuang
b36af9b76c HDFS-11181. Fuse wrapper has a typo. Contributed by Wei-Chiu Chuang. 2016-12-05 08:46:57 -08:00
Mingliang Liu
be969e5918 HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang 
(cherry picked from commit c7ff34f8dcca3a2024230c5383abd9299daa1b20)
 2016-12-02 11:36:11 -08:00
Akira Ajisaka
5a7941a4fc HDFS-11180. Intermittent deadlock in NameNode when failover happens. 2016-12-02 11:34:05 +09:00
Kihwal Lee
0d8a35bd6d HDFS-8674. Improve performance of postponed block scans. Contributed by Daryn Sharp. 2016-12-01 12:15:15 -06:00
Ravi Prakash
fdf5394b2a HDFS-8678. Bring back the feature to view chunks of files in the HDFS file browser. Contributed by Ivo Udelsmann. 
(cherry picked from commit 625df87c7b8ec2787e743d845fadde5e73479dc1)
 2016-11-30 09:14:36 -08:00
Akira Ajisaka
0c895e8a62 HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge. 
(cherry picked from commit 00096dcc0c23af38e697cd7c6c29e3f00d744e54)
 2016-11-29 19:50:53 +09:00
Robert Kanter
285edf691d HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter) 
(cherry picked from commit 47ca9e26fba4a639e43bee5bfc001ffc4b42330d)
 2016-11-28 18:12:53 -08:00
Akira Ajisaka
6fe5ffd05d HDFS-11174. Wrong HttpFS test command in doc. Contributed by John Zhuge. 
(cherry picked from commit bb1b5e083b6f32646412b292d061ce5721f5dbe1)
 2016-11-25 21:29:28 +09:00
Akira Ajisaka
0df7f5cdf6 HDFS-11175. Document uppercase key names are not supported in TransparentEncryption.md. Contributed by Yiqun Lin. 
(cherry picked from commit 636f7547b7067c315cf5448d77e49a8fe55651b3)
 2016-11-25 17:50:14 +09:00
Brahma Reddy Battula
2207a84a7d HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula. 
(cherry picked from commit afcf8d38e750f935c06629e641a1321b79c4cace)
 2016-11-22 20:32:30 +05:30
Kihwal Lee
774b0cd845 HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang. 2016-11-21 10:39:04 -06:00
Brahma Reddy Battula
aa76fe4132 HDFS-11101. TestDFSShell#testMoveWithTargetPortEmpty fails intermittently. Contributed By Brahma Reddy Battula. 
(cherry picked from commit f92206774899b84e8abaecdf97399b65e0995ed8)
 2016-11-21 19:36:10 +05:30
Brahma Reddy Battula
f3649deca5 HDFS-11144. TestFileCreationDelete#testFileCreationDeleteParent fails wind bind exception. Contributed By Brahma Reddy Battula. 
(cherry picked from commit c68dad18ab5cdf01f3dea1bb5988f896609956b4)
 2016-11-21 10:59:23 +05:30
Brahma Reddy Battula
3e5a85f35e HDFS-11134. Fix bind exception threw in TestRenameWhileOpen. Contributed By Yiqun Lin. 
(cherry picked from commit b2d4b7b1b902aa830d44889d7747a4e1b816ab9d)
 2016-11-17 10:24:21 +05:30
Arpit Agarwal
da8c24bbad HDFS-11114. Support for running async disk checks in DataNode. 2016-11-16 13:38:15 -08:00
Mingliang Liu
57a0f84860 HDFS-11105. TestRBWBlockInvalidation#testRWRInvalidation fails intermittently. Contributed by Yiqun Lin 
(cherry picked from commit c90891e7b3afaa66dbca967b83a9997e80e893d8)
 2016-11-16 13:06:25 -08:00
Kihwal Lee
f08e227671 HDFS-8870. Lease is leaked on write failure. Contributed by Kuhu Shukla. 
(cherry picked from commit 4fcea8a0c8019d6d9a5e6f315c83659938b93a40)
 2016-11-15 14:51:34 -06:00
Mingliang Liu
4e0fcff8ab HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu 
(cherry picked from commit 5af572b6443715b7a741296c1bd520a1840f9a7c)
 2016-11-15 11:36:08 -08:00
Zhe Zhang
818915aabb HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 16:33:15 -08:00
Brahma Reddy Battula
399abe7c74 HDFS-11135. The tests in TestBalancer run fails due to NPE. Contributed By Yiqun Lin 
(cherry picked from commit 6efb8c9c6018ec688eeba8c61c220009ec350a44)
 2016-11-14 20:41:55 +05:30
Erik Krogen
98d9e9c4c8 HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen. 2016-11-13 14:50:33 -08:00
Mingliang Liu
fb3a5085e8 HADOOP-13813. TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing. Contributed by Mingliang Liu 2016-11-12 10:36:14 -08:00
Mingliang Liu
685d753d07 HDFS-11129. TestAppendSnapshotTruncate fails with bind exception. Contributed by Brahma Reddy Battula 
(cherry picked from commit 2ee18fc15e60dff9a42a80eb0c30e8bd8cedc26a)
 2016-11-11 22:16:05 -08:00
Xiaoyu Yao
5613b0818c HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang. 
(cherry picked from commit 4484b48498b2ab2a40a404c487c7a4e875df10dc)
 2016-11-11 14:31:54 -08:00
Mingliang Liu
289f03e49e HDFS-11122. TestDFSAdmin#testReportCommand fails due to timed out. Contributed by Yiqun Lin 
(cherry picked from commit aa6010ccca3045ce9f0bb819fb2cb7ff65e1822b)
 2016-11-11 12:30:22 -08:00
Brahma Reddy Battula
b51806b45f HDFS-11128. CreateEditsLog throws NullPointerException. Contributed by Hanisha Koneru. 
(cherry picked from commit 1ae57f0f75695178dc135b0c259d066f7da31c9d)
 2016-11-11 20:09:49 +05:30
Xiao Chen
a6146a1026 HDFS-11120. TestEncryptionZones should waitActive. Contributed by John Zhuge. 
(cherry picked from commit 907b1431c0ead934e26cf7dbc51bfab5d7cc5ddc)
 2016-11-09 17:16:31 -08:00
Wei-Chiu Chuang
16430c64b7 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang. 2016-11-09 13:28:16 -08:00
Brahma Reddy Battula
53ff3c9e03 HDFS-9482. Replace DatanodeInfo constructors with a builder pattern. Contributed by Brahma Reddy Battula. 2016-11-09 09:58:36 +05:30
Mingliang Liu
f5c9f9f1b2 HDFS-11083. Add unit test for DFSAdmin -report command. Contributed by Xiaobing Zhou 
(cherry picked from commit 62d8c17dfda75a6a6de06aedad2f22699a1cbad6)
 2016-11-08 17:05:34 -08:00
Andrew Wang
4f25fd975e HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey. 
(cherry picked from commit e1c6ef2efa9d87fdfc7474ca63998a13a3929874)
 2016-11-08 16:33:58 -08:00
Arpit Agarwal
b77239b46d Revert "HDFS-11114. Support for running async disk checks in DataNode." 
This reverts commit 732eaadddbe9a2682bf96ba06ce5e7ebfa58ba87.
 2016-11-08 09:04:58 -08:00
Arpit Agarwal
732eaadddb HDFS-11114. Support for running async disk checks in DataNode. 
This closes #153.
 2016-11-07 18:46:37 -08:00
Xiao Chen
f30d338766 HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu. 
(cherry picked from commit d8bab3dcb693b2773ede9a6e4f71ae85ee056f79)
 2016-11-04 18:08:46 -07:00
Mingliang Liu
4cee535aa5 HDFS-11085. Add unit test for NameNode failing to start when name dir is unwritable. Contributed by Xiaobing Zhou 
(cherry picked from commit 0c0ab102ab392ba07ed2aa8d8a67eef4c20cad9b)
 2016-11-04 14:39:54 -07:00
Andrew Wang
9ede5ccfdd HADOOP-11088. Quash unnecessary safemode WARN message during NameNode startup. Contributed by Yiqun Lin. 
(cherry picked from commit 5cad93d5c753112931ce97dba966d1ce6b53724b)
 2016-11-03 15:31:21 -07:00
Mingliang Liu
6d0cea4a5a HDFS-11076. Add unit test for extended Acls. Contributed by Chen Liang 
(cherry picked from commit 7534aee09af47c6961100588312da8d133be1b27)
 2016-11-03 13:52:18 -07:00
Arpit Agarwal
458b636a39 HDFS-11097. Fix warnings for deprecated StorageReceivedDeletedBlocks constructor. Contributed by Yiqun Lin. 2016-11-03 10:32:11 -07:00
Andrew Wang
99d0b3eb2b HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory. 2016-11-02 19:11:22 -07:00