Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,841 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

4205 Commits

Author SHA1 Message Date
Brahma Reddy Battula 4dc40fe28e HDFS-11135. The tests in TestBalancer run fails due to NPE. Contributed By Yiqun Lin 
(cherry picked from commit 6efb8c9c60)
 2016-11-14 20:42:50 +05:30
Erik Krogen 3d52459712 HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen. 
(cherry picked from commit 98d9e9c4c8)
 2016-11-13 14:54:49 -08:00
Mingliang Liu 4bcef1c616 HADOOP-13813. TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing. Contributed by Mingliang Liu 
(cherry picked from commit fb3a5085e8)
 2016-11-12 10:37:46 -08:00
Mingliang Liu fcedb6812b HDFS-11129. TestAppendSnapshotTruncate fails with bind exception. Contributed by Brahma Reddy Battula 
(cherry picked from commit 2ee18fc15e)
 2016-11-11 22:19:39 -08:00
Xiaoyu Yao c443ecb267 HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang. 
(cherry picked from commit 4484b48498)
 2016-11-11 14:32:11 -08:00
Mingliang Liu ae7a20f524 HDFS-11122. TestDFSAdmin#testReportCommand fails due to timed out. Contributed by Yiqun Lin 
(cherry picked from commit aa6010ccca)
 2016-11-11 12:35:21 -08:00
Brahma Reddy Battula 121b56de14 HDFS-11128. CreateEditsLog throws NullPointerException. Contributed by Hanisha Koneru. 
(cherry picked from commit 1ae57f0f75)
 2016-11-11 20:11:13 +05:30
Xiao Chen d81706cd99 HDFS-11120. TestEncryptionZones should waitActive. Contributed by John Zhuge. 
(cherry picked from commit 907b1431c0ead934e26cf7dbc51bfab5d7cc5ddc)
 2016-11-09 17:16:36 -08:00
Wei-Chiu Chuang 1d75da8e26 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 16430c64b7)
 2016-11-09 13:32:35 -08:00
Mingliang Liu ad992e05a6 HDFS-11083. Add unit test for DFSAdmin -report command. Contributed by Xiaobing Zhou 
(cherry picked from commit 62d8c17dfd)
 2016-11-08 17:10:59 -08:00
Mingliang Liu 00625004b7 HDFS-11085. Add unit test for NameNode failing to start when name dir is unwritable. Contributed by Xiaobing Zhou 
(cherry picked from commit 0c0ab102ab)
 2016-11-04 14:45:43 -07:00
Mingliang Liu b082d4b746 HDFS-11076. Add unit test for extended Acls. Contributed by Chen Liang 
(cherry picked from commit 7534aee09a)
 2016-11-03 13:55:43 -07:00
Arpit Agarwal 3f2bfdba3e HDFS-11097. Fix warnings for deprecated StorageReceivedDeletedBlocks constructor. Contributed by Yiqun Lin. 2016-11-03 10:33:28 -07:00
Andrew Wang e393dd788e HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory. 2016-11-02 19:11:25 -07:00
Brahma Reddy Battula 77142827e8 HDFS-11031. Add additional unit test for DataNode startup behavior when volumes fail. Contributed by Mingliang Liu. 
(cherry picked from commit 35e6081020)
 2016-11-02 10:40:22 +05:30
Mingliang Liu 10eb21e52e HDFS-11065. Add space quota tests for heterogenous storages. Contributed by Xiaobing Zhou 
(cherry picked from commit fa1512a740)
 2016-11-01 14:50:16 -07:00
Kihwal Lee db6dfeca1a HDFS-10997. Reduce number of path resolving methods. Contributed by Daryn Sharp. 
(cherry picked from commit 7c1a1834e4)
 2016-11-01 08:26:25 -05:00
Brahma Reddy Battula c895f08936 HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Rakesh R. 
(cherry picked from commit 1c5708f6de)
 2016-11-01 10:53:37 +05:30
Kihwal Lee 91640a0170 Addendum of HDFS-10722 to include HDFS-7964 logic. 
(cherry picked from commit 4a8e6dc02f)
(cherry picked from commit 3b2554f3b0)
(cherry picked from commit c2bb9bf00c)
 2016-10-31 16:37:00 -07:00
Zhe Zhang 7900b1e803 Revert "HDFS-10722. Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs. Contributed by Daryn Sharp." 
This reverts commit c2bb9bf00c.
 2016-10-31 16:35:05 -07:00
Kihwal Lee c2bb9bf00c HDFS-10722. Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs. Contributed by Daryn Sharp. 
(cherry picked from commit 4a8e6dc02f)
(cherry picked from commit 3b2554f3b0)
 2016-10-31 16:30:39 -07:00
Akira Ajisaka a17fc1dca3 HDFS-10485. Fix findbugs warning in FSEditLog.java. (aajisaka) 
(cherry picked from commit e620530301)
(cherry picked from commit b8c1db6f63)
 2016-10-31 16:24:35 -07:00
Jing Zhao e327325a37 HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp. 
(cherry picked from commit 2151716832)
(cherry picked from commit 3cb7ae11a8)
 2016-10-31 16:24:35 -07:00
Mingliang Liu fece3c881b HDFS-11030. TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing). Contributed by Mingliang Liu 
(cherry picked from commit 6bb12ecc3f)
 2016-10-31 16:06:41 -07:00
Arpit Agarwal f0a6d17e3b HDFS-11074. Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage. Contributed by Hanisha Koneru. 2016-10-31 12:40:03 -07:00
Mingliang Liu 616c1194fe HDFS-11047. Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode. Contributed by Xiaobing Zhou 
(cherry picked from commit 2848a27700)
 2016-10-28 11:18:26 -07:00
Mingliang Liu a8a99f3423 HDFS-11048. Audit Log should escape control characters. Contributed by Eric Badger 
(cherry picked from commit 8a9388e5f6)
 2016-10-28 11:01:09 -07:00
Erik Krogen 2ec90a1a4b HDFS-9500. Fix software version counts for DataNodes during rolling upgrade. Contributed by Erik Krogen. 
(cherry picked from commit f3ac1f41b8)
 2016-10-27 16:04:58 -07:00
Wei-Chiu Chuang bc2f429c0e HDFS-11055. Update default-log4j.properties for httpfs to imporve test logging. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 31ff42b510)
(cherry picked from commit 2cf3138d72)
 2016-10-27 13:47:26 -07:00
Kihwal Lee 40dbf2a18d HDFS-11069. Tighten the authorization of datanode RPC. Contributed by Kihwal Lee 
(cherry picked from commit ae48c496dc)
 2016-10-27 14:18:48 -05:00
Kihwal Lee 5b0d32b4aa Revert "HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Tianyin Xiu" 
This reverts commit d6dfc76dfe.
 2016-10-27 14:10:52 -05:00
Brahma Reddy Battula d6dfc76dfe HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Tianyin Xiu 
(cherry picked from commit ac35ee9393)
 2016-10-27 20:23:07 +05:30
Vinayakumar B 7279ce831d HDFS-8492. DN should notify NN when client requests a missing block (Contributed by Walter Su) 
(cherry picked from commit 1cf6ec4ad4)
(cherry picked from commit 144f7a9e0e)
 2016-10-27 16:56:25 +05:30
Masatake Iwasaki 6d9b6fac86 HADOOP-13017. Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0. Contributed by Steve Loughran. 
(cherry picked from commit 0bdd263d82)
 2016-10-27 15:55:35 +09:00
Mingliang Liu a7684f6517 HDFS-10921. TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode. Contributed by Eric Badger 
(cherry picked from commit 55e1fb8e32)
 2016-10-26 14:18:00 -07:00
Kihwal Lee e7bd2e8d63 HDFS-11053. Unnecessary superuser check in versionRequest(). Contributed by Kihwal Lee. 
(cherry picked from commit e90af4a89b)
 2016-10-26 09:18:01 -05:00
Kihwal Lee 49adab66b8 HDFS-11050. Change log level to 'warn' when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR. Contributed by Kuhu Shukla. 
(cherry picked from commit ce6bbfb23c)
 2016-10-26 08:11:51 -05:00
Arpit Agarwal df83d86da7 HDFS-11054. Suppress verbose log message in BlockPlacementPolicyDefault. Contributed by Chen Liang. 2016-10-25 19:51:53 -07:00
Xiaoyu Yao e0fc749a46 HDFS-11011. Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'. Contributed by Xiaobing Zhou. 
(cherry picked from commit 85f6fec0370b3cd94d6c2f19920c0b6d33f127c6)
(cherry picked from commit c2ba4b650168be4fad7ffdb546b8a0d985268393)
 2016-10-25 11:22:07 -07:00
Zhe Zhang 262518fa5b HDFS-11015. Enforce timeout in balancer. Contributed by Kihwal Lee. 
(cherry picked from commit f6367c5f44)
(cherry picked from commit ff806cbfc7)
 2016-10-25 10:59:03 -07:00
Kihwal Lee c82910203c HDFS-11042. Add missing cleanupSSLConfig() call for tests that use setupSSLConfig(). Contributed by Kuhu Shukla. 
(cherry picked from commit 086577c67a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFWithSWebhdfsFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java
 2016-10-24 09:00:28 -05:00
Brahma Reddy Battula 5754772bd6 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc03)
 2016-10-21 16:22:42 +05:30
Mingliang Liu cfac82a443 HDFS-10998. Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA. Contributed by Xiaobing Zhou 
(cherry picked from commit d7d87deece)
 2016-10-20 19:59:32 -07:00
Wei-Chiu Chuang b4edd115b4 HDFS-11018. Incorrect check and message in FsDatasetImpl#invalidate. Contributed by Yiqun Lin. 
(cherry picked from commit 6d2da38d16)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java

(cherry picked from commit 6f4192d77d)
 2016-10-20 12:41:00 -07:00
Steve Loughran 2b575a90f3 Revert "HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula" 
This reverts commit b63dd7b63b.
 2016-10-20 19:43:16 +01:00
Brahma Reddy Battula b63dd7b63b HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc03)
 2016-10-20 21:49:21 +05:30
Kihwal Lee f57d81955e HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 
(cherry picked from commit 5c0bffddc0)
 2016-10-20 11:02:57 -05:00
Brahma Reddy Battula d2fde9c8b0 HDFS-9480. Expose nonDfsUsed via StorageTypeStats. Contributed by Brahma Reddy Battula 
(cherry picked from commit 4c73be135c)
 2016-10-20 20:51:41 +05:30
Brahma Reddy Battula f5b080e152 HDFS-11025. TestDiskspaceQuotaUpdate fails in trunk due to Bind exception. Contributed by Yiqun Lin 
(cherry picked from commit 73504b1bdc)
 2016-10-20 10:47:16 +05:30
Arpit Agarwal e9592f14d5 HDFS-10752. Several log refactoring/improvement suggestion in HDFS. Contributed by Hanisha Koneru. 2016-10-19 17:22:23 -07:00