Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,355 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

4306 Commits

Author SHA1 Message Date
Andrew Wang 4f25fd975e HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey. 
(cherry picked from commit e1c6ef2efa)
 2016-11-08 16:33:58 -08:00
Arpit Agarwal b77239b46d Revert "HDFS-11114. Support for running async disk checks in DataNode." 
This reverts commit 732eaadddb.
 2016-11-08 09:04:58 -08:00
Arpit Agarwal 732eaadddb HDFS-11114. Support for running async disk checks in DataNode. 
This closes #153.
 2016-11-07 18:46:37 -08:00
Xiao Chen f30d338766 HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu. 
(cherry picked from commit d8bab3dcb6)
 2016-11-04 18:08:46 -07:00
Mingliang Liu 4cee535aa5 HDFS-11085. Add unit test for NameNode failing to start when name dir is unwritable. Contributed by Xiaobing Zhou 
(cherry picked from commit 0c0ab102ab)
 2016-11-04 14:39:54 -07:00
Andrew Wang 9ede5ccfdd HADOOP-11088. Quash unnecessary safemode WARN message during NameNode startup. Contributed by Yiqun Lin. 
(cherry picked from commit 5cad93d5c7)
 2016-11-03 15:31:21 -07:00
Mingliang Liu 6d0cea4a5a HDFS-11076. Add unit test for extended Acls. Contributed by Chen Liang 
(cherry picked from commit 7534aee09a)
 2016-11-03 13:52:18 -07:00
Arpit Agarwal 458b636a39 HDFS-11097. Fix warnings for deprecated StorageReceivedDeletedBlocks constructor. Contributed by Yiqun Lin. 2016-11-03 10:32:11 -07:00
Andrew Wang 99d0b3eb2b HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory. 2016-11-02 19:11:22 -07:00
Mingliang Liu 7a662bea89 HDFS-11095. BlockManagerSafeMode should respect extension period default config value (30s). Contributed by Mingliang Liu 
(cherry picked from commit 9b0c17f852)
 2016-11-02 15:02:08 -07:00
Brahma Reddy Battula 35e6081020 HDFS-11031. Add additional unit test for DataNode startup behavior when volumes fail. Contributed by Mingliang Liu. 2016-11-02 10:39:12 +05:30
Mingliang Liu 1dd59042ac HDFS-11065. Add space quota tests for heterogenous storages. Contributed by Xiaobing Zhou 
(cherry picked from commit fa1512a740)
 2016-11-01 14:46:24 -07:00
Kihwal Lee 7c1a1834e4 HDFS-10997. Reduce number of path resolving methods. Contributed by Daryn Sharp. 2016-11-01 08:04:54 -05:00
Brahma Reddy Battula 1c5708f6de HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Rakesh R. 2016-11-01 10:49:43 +05:30
Mingliang Liu 6bb12ecc3f HDFS-11030. TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing). Contributed by Mingliang Liu 2016-10-31 16:03:02 -07:00
Arpit Agarwal 56092e351b HDFS-11074. Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage. Contributed by Hanisha Koneru. 2016-10-31 12:39:54 -07:00
Mingliang Liu 2848a27700 HDFS-11047. Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode. Contributed by Xiaobing Zhou 2016-10-28 11:11:31 -07:00
Mingliang Liu d0da47ad9f HDFS-11048. Audit Log should escape control characters. Contributed by Eric Badger 
(cherry picked from commit 8a9388e5f6)
 2016-10-28 10:57:20 -07:00
Erik Krogen ce8ace372c HDFS-9500. Fix software version counts for DataNodes during rolling upgrade. Contributed by Erik Krogen. 
(cherry picked from commit f3ac1f41b8)
 2016-10-27 16:00:39 -07:00
Wei-Chiu Chuang 2cf3138d72 HDFS-11055. Update default-log4j.properties for httpfs to imporve test logging. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 31ff42b510)
 2016-10-27 13:38:02 -07:00
Kihwal Lee 5057abc390 HDFS-11069. Tighten the authorization of datanode RPC. Contributed by Kihwal Lee 
(cherry picked from commit ae48c496dc)
 2016-10-27 14:18:10 -05:00
Kihwal Lee 6c11a11918 Revert "HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Tianyin Xiu" 
This reverts commit f4300ea12a.
 2016-10-27 14:10:07 -05:00
Brahma Reddy Battula f4300ea12a HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Tianyin Xiu 
(cherry picked from commit ac35ee9393)
 2016-10-27 20:22:08 +05:30
Vinayakumar B 144f7a9e0e HDFS-8492. DN should notify NN when client requests a missing block (Contributed by Walter Su) 
(cherry picked from commit 1cf6ec4ad4)
 2016-10-27 16:46:09 +05:30
Akira Ajisaka 53ed19efec HDFS-11049. The description of dfs.block.replicator.classname is not clear. Contributed by Yiqun Lin. 
(cherry picked from commit 9c680d0b05)
 2016-10-27 16:37:32 +09:00
Masatake Iwasaki 7e918637de HADOOP-13017. Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0. Contributed by Steve Loughran. 
(cherry picked from commit 0bdd263d82)
 2016-10-27 15:54:03 +09:00
Vinayakumar B 72ce627533 HDFS-9929. Duplicate keys in NAMENODE_SPECIFIC_KEYS (Contributed by Akira Ajisaka) 
(cherry picked from commit f0642b02996ae90d85499ddef2e20bdf88d98c7b)
 2016-10-27 12:19:08 +05:30
Mingliang Liu 2aed61d887 HDFS-10921. TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode. Contributed by Eric Badger 
(cherry picked from commit 55e1fb8e32)
 2016-10-26 14:12:08 -07:00
Kihwal Lee 0cd43dd2b7 HDFS-11053. Unnecessary superuser check in versionRequest(). Contributed by Kihwal Lee. 
(cherry picked from commit e90af4a89b)
 2016-10-26 09:17:29 -05:00
Kihwal Lee 366ebb0822 HDFS-11050. Change log level to 'warn' when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR. Contributed by Kuhu Shukla. 
(cherry picked from commit ce6bbfb23c)
 2016-10-26 08:11:12 -05:00
Arpit Agarwal a071e33a91 HDFS-11054. Suppress verbose log message in BlockPlacementPolicyDefault. Contributed by Chen Liang. 2016-10-25 19:51:32 -07:00
Xiaoyu Yao 590d19c0a8 HDFS-11011. Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'. Contributed by Xiaobing Zhou. 
(cherry picked from commit 85f6fec0370b3cd94d6c2f19920c0b6d33f127c6)
 2016-10-25 11:24:27 -07:00
Zhe Zhang ff806cbfc7 HDFS-11015. Enforce timeout in balancer. Contributed by Kihwal Lee. 
(cherry picked from commit f6367c5f44)
 2016-10-25 10:45:31 -07:00
Kihwal Lee 086577c67a HDFS-11042. Add missing cleanupSSLConfig() call for tests that use setupSSLConfig(). Contributed by Kuhu Shukla. 
(cherry picked from commit b18f35f097)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
 2016-10-24 08:56:14 -05:00
Chris Douglas 25f4327f0b HADOOP-13702. Add instrumented ReadWriteLock. Contributed by Jingcheng Du 
(cherry picked from commit ae8bccd509)
 2016-10-21 13:01:08 -07:00
Brahma Reddy Battula 2ab149f0e4 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc03)
 2016-10-21 16:19:18 +05:30
Mingliang Liu c37c00b061 HDFS-10998. Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA. Contributed by Xiaobing Zhou 
(cherry picked from commit d7d87deece)
 2016-10-20 19:54:35 -07:00
Aaron T. Myers 0f616cefeb HDFS-10423. Increase default value of httpfs maxHttpHeaderSize. Contributed by Nicolae Popa. 
(cherry picked from commit aa1b583cf9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/libexec/httpfs-config.sh
 2016-10-20 13:34:52 -07:00
Wei-Chiu Chuang 6f4192d77d HDFS-11018. Incorrect check and message in FsDatasetImpl#invalidate. Contributed by Yiqun Lin. 
(cherry picked from commit 6d2da38d16)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
 2016-10-20 11:58:46 -07:00
Steve Loughran ab36519b6f Revert "HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula" 
This reverts commit bf6379fdd2.
 2016-10-20 19:32:10 +01:00
Brahma Reddy Battula bf6379fdd2 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc03)
 2016-10-20 21:48:23 +05:30
Kihwal Lee cacf83b6c3 HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 
(cherry picked from commit 5c0bffddc0)
 2016-10-20 11:02:02 -05:00
Brahma Reddy Battula 69a4b0c7d2 HDFS-10699. Log object instance get incorrectly in TestDFSAdmin. Contributed by Yiqun Lin 
(cherry picked from commit f5e401de3e7ad6e73b07fef1cb5915753b08fbdb)
 2016-10-20 21:08:39 +05:30
Brahma Reddy Battula df5671db74 HDFS-9480. Expose nonDfsUsed via StorageTypeStats. Contributed by Brahma Reddy Battula 
(cherry picked from commit 4c73be135c)
 2016-10-20 20:47:37 +05:30
Brahma Reddy Battula 5a37668d1b HDFS-11025. TestDiskspaceQuotaUpdate fails in trunk due to Bind exception. Contributed by Yiqun Lin 
(cherry picked from commit 73504b1bdc)
 2016-10-20 10:42:34 +05:30
Arpit Agarwal a3cbaf0c04 HDFS-10752. Several log refactoring/improvement suggestion in HDFS. Contributed by Hanisha Koneru. 2016-10-19 17:20:15 -07:00
Xiao Chen ad7d3c4db8 HDFS-11009. Add a tool to reconstruct block meta file from CLI. 
(cherry picked from commit bc4a32aea50e86819730312e89315c0244ce64bf)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetUtil.java
 2016-10-18 22:40:58 -07:00
Xiaoyu Yao 74f1c49d76 HDFS-10906. Add unit tests for Trash with HDFS encryption zones. Contributed by Hanisha Koneru. 
(cherry picked from commit 0c79d5af74944363f3d04f7e1702411db564bbfd)
 2016-10-18 14:07:57 -07:00
Kai Zheng 3972bb3bba HDFS-10920. TestStorageMover#testNoSpaceDisk is failing intermittently. Contributed by Rakesh R 2016-10-18 15:08:15 +06:00
Akira Ajisaka b2618685fb HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini. 
(cherry picked from commit bedfec0c10)
 2016-10-18 15:03:33 +09:00