Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,029 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

12029 Commits

Author SHA1 Message Date
Arpit Agarwal e9592f14d5 HDFS-10752. Several log refactoring/improvement suggestion in HDFS. Contributed by Hanisha Koneru. 2016-10-19 17:22:23 -07:00
Rohith Sharma K S 34023ca418 YARN-4763. RMApps Page crashes with NPE. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 19ee185907)
 2016-10-19 17:40:42 +00:00
Xiao Chen d22a6a8b82 HDFS-11009. Add a tool to reconstruct block meta file from CLI. 
(cherry picked from commit bc4a32aea50e86819730312e89315c0244ce64bf)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetUtil.java

(cherry picked from commit ad7d3c4db8)
 2016-10-18 22:42:09 -07:00
Xiaoyu Yao 190a53b898 HDFS-10906. Add unit tests for Trash with HDFS encryption zones. Contributed by Hanisha Koneru. 
(cherry picked from commit 0c79d5af74944363f3d04f7e1702411db564bbfd)
 2016-10-18 14:09:03 -07:00
Steve Loughran 1ecbf323ba HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran 2016-10-18 19:34:07 +01:00
Kai Zheng d26e11f30e HDFS-10920. TestStorageMover#testNoSpaceDisk is failing intermittently. Contributed by Rakesh R 2016-10-18 15:09:25 +06:00
Vinitha Reddy Gankidi ae972dd080 HDFS-10712. TestDataNodeVolumeFailure should pass not null BlockReportContext. Contributed by Vinitha Gankidi. 
(cherry picked from commit 278eeb1056)
 2016-10-17 19:02:29 -07:00
Xiaoyu Yao f8b2d77207 HDFS-10922. Adding additional unit tests for Trash (II). Contributed by Weiwei Yang. 
(cherry picked from commit f1802d0be05ecc0b3248690b6f9efedbc7784112)
 2016-10-17 14:04:58 -07:00
Vinayakumar B 36dad0abca HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B 
This closes #89

(cherry picked from commit 8d29e2451f)
 2016-10-17 14:04:58 -07:00
Andrew Wang 15ff590c37 HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei. 
(cherry picked from commit 987ee51141)
(cherry picked from commit 4ed7cf3b36)
 2016-10-17 13:32:52 -07:00
Allen Wittenauer 9d473b8ddc HADOOP-11559. Add links to RackAwareness and InterfaceClassification to site index (Masatake Iwasaki via aw) 
(cherry picked from commit 7eeca90daa)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-project/src/site/site.xml

(cherry picked from commit fbdb23d2af)
 2016-10-17 13:32:51 -07:00
Eric Yang b2667441e6 HADOOP-13707. Skip authorization for anonymous user to access Hadoop 
web interface in non-secure environment.  (Yuanbo Liu via eyang)
 2016-10-17 08:12:04 -07:00
Masatake Iwasaki 74782e7e42 HADOOP-13419. Fix javadoc warnings by JDK8 in hadoop-common package. Contributed by Kai Sasaki. 
(cherry picked from commit a13a607e20)
 2016-10-16 12:48:09 +09:00
Brahma Reddy Battula 1c473898aa HDFS-11003. Expose XmitsInProgress through DataNodeMXBean. Contributed By Brahma Reddy Battula 
(cherry picked from commit 5f4ae85bd8)
 2016-10-15 22:40:57 +05:30
Brahma Reddy Battula 34469cd98d Revert "HADOOP-13707. Skip authorization for anonymous user to access Hadoop" 
This reverts commit 3574e5692d.
 2016-10-15 22:18:24 +05:30
Akira Ajisaka 65e6a1181c HDFS-11012. Unnecessary INFO logging on DFSClients for InvalidToken. Contributed by Harsh J. 
(cherry picked from commit 5ad037df25)
(cherry picked from commit 35832901e8)
 2016-10-15 22:19:14 +09:00
Eric Yang 3574e5692d HADOOP-13707. Skip authorization for anonymous user to access Hadoop 
web interface in non-secure environment.  (Yuanbo Liu via eyang)
 2016-10-14 22:14:59 -07:00
Vinitha Reddy Gankidi 2304501bcf HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi. 
(cherry picked from commit 391ce535a7)
 2016-10-14 18:52:00 -07:00
Lei Xu b9fdbd7107 HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei) 
(cherry picked from commit 78cb79fa91)
 2016-10-14 15:01:37 -07:00
Mingliang Liu 15b1d522ee HDFS-11008. Change unit test for testing parsing "-source" parameter in Balancer CLI. Contributed by Mingliang Liu 
(cherry picked from commit 76cc84e6d4)
 2016-10-14 14:44:34 -07:00
Kihwal Lee 8d1fbf786b Revert "HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei)" 
This reverts commit f981dd1bca.
 2016-10-14 16:37:51 -05:00
Lei Xu f981dd1bca HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei) 
(cherry picked from commit 8c520a27cb)
 2016-10-14 13:44:18 -07:00
Andrew Wang f13b84b4eb HDFS-10883. 's behavior is not consistent in DFS after enabling EZ. Contributed by Yuanbo Liu. 
(cherry picked from commit 0007360c33)
 2016-10-14 11:41:42 -07:00
Varun Saxena 28d75482ff YARN-5599. Publish AM launch command to ATS (Rohith Sharma K S via Varun Saxena) 2016-10-14 23:36:39 +05:30
Benoy Antony ca20ffea46 HDFS-10735 Distcp using webhdfs on secure HA clusters fails with StandbyException 
(cherry picked from commit 701c27a776)
 2016-10-14 10:32:37 -07:00
Kihwal Lee 8c71fc1221 HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 
(cherry picked from commit 8a9f6635a3)
 2016-10-14 11:44:25 -05:00
Xiaoyu Yao e41295182a HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang. 
(cherry picked from commit dbe663d524)
(cherry picked from commit 1eb8c0e880)
 2016-10-14 08:45:14 -07:00
Xiao Chen 1ea7070042 HADOOP-13669. Addendum patch for KMS Server should log exceptions before throwing. 
(cherry picked from commit ae51b11f78)
 2016-10-13 22:32:30 -07:00
Brahma Reddy Battula 0884c31aec HDFS-10986. DFSAdmin should log detailed error message if any. Contributed by MingLiang Liu 2016-10-14 10:28:13 +05:30
Jing Zhao d3c4465147 HADOOP-13024. Distcp with -delete feature on raw data not implemented. Contributed by Mavin Martin. 
(cherry picked from commit 0a85d07983)
(cherry picked from commit ad69baf6a9)
 2016-10-13 13:28:05 -07:00
Andrew Wang 3892fd810b Revert "HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin." 
This reverts commit 7a5aaa789d.
 2016-10-13 13:23:01 -07:00
Kihwal Lee ded91992ad HDFS-10987. Make Decommission less expensive when lot of blocks present. Contributed by Brahma Reddy Battula. 
(cherry picked from commit c5a1303704)
 2016-10-13 14:57:44 -05:00
Andrew Wang 7a5aaa789d HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 
(cherry picked from commit fdce515091)
(cherry picked from commit 2e153bc8ab)
 2016-10-13 11:42:23 -07:00
Arpit Agarwal 3a9808e96c HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru. 2016-10-13 11:37:25 -07:00
Xiaoyu Yao 5abc788825 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao. 
(cherry picked from commit 9097e2efe4)
 2016-10-13 10:58:20 -07:00
Kihwal Lee 78777d4a96 HDFS-11000. webhdfs PUT does not work if requests are routed to call queue. Contributed by Kihwal Lee. 
(cherry picked from commit 9454dc5e80)
 2016-10-13 09:02:59 -05:00
Akira Ajisaka c7780b066d HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu. 
(cherry picked from commit 901eca004d)
(cherry picked from commit 43cf0b2973)
 2016-10-13 14:31:09 +09:00
Mingliang Liu 9b2a719031 HDFS-10903. Replace config key literal strings with config key names II: hadoop hdfs. Contributed by Chen Liang 
(cherry picked from commit b36aaa913c)
 2016-10-12 17:41:07 -07:00
Andrew Wang 9bde45d2fe HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures. 
(cherry picked from commit 12d739a34b)
(cherry picked from commit f131d61ff8)
 2016-10-12 15:20:10 -07:00
Kihwal Lee 136c6f6f7d HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah. 
(cherry picked from commit 5305a392c3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java
 2016-10-12 15:38:34 -05:00
Mingliang Liu 0f481e2022 HDFS-10965. Add unit test for HDFS command 'dfsadmin -printTopology'. Contributed by Xiaobing Zhou 2016-10-11 17:18:48 -07:00
Xiao Chen bc5a9931d7 HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key. 
(cherry picked from commit b84c4891f9)
 2016-10-11 17:05:20 -07:00
Xiaoyu Yao 6f2de54eb1 HDFS-10984. Expose nntop output as metrics. Contributed by Siddharth Wagle. 
(cherry picked from commit 61f0490a73)
 2016-10-11 16:00:17 -07:00
Andrew Wang 67f0319db6 HDFS-10991. Export hdfsTruncateFile symbol in libhdfs. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit dacd3ec66b)
 2016-10-11 15:07:28 -07:00
Wei-Chiu Chuang 773e2e6b6c HADOOP-13684. Snappy may complain Hadoop is built without snappy if libhadoop is not found. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4b32b1420d)
(cherry picked from commit 56184de510)
 2016-10-11 13:22:41 -07:00
Wei-Chiu Chuang aeb75213d4 HDFS-10933. Refactor TestFsck. Contributed by Takanobu Asanuma. 
(cherry picked from commit a6b3dc69d7a0835fa9159a0536c24ff6525e6c77)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
 2016-10-11 13:18:32 -07:00
Kihwal Lee 7f514e0c05 HDFS-10980. Optimize check for existence of parent directory. Contributed by Daryn Sharp. 
(cherry picked from commit e57fa81d95)
 2016-10-11 09:41:47 -05:00
Mingliang Liu 5a39a7560a HDFS-10972. Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'. Contributed by Xiaobing Zhou 2016-10-10 17:46:31 -07:00
Chris Nauroth 67d8301e55 HADOOP-13447. Refactor S3AFileSystem to support introduction of separate metadata repository and tests. Contributed by Chris Nauroth. 
(cherry picked from commit d152557cf7)
(cherry picked from commit e28930a38b)
 2016-10-10 14:01:19 -07:00
Chris Nauroth 027d76fa8c HADOOP-13446. Support running isolated unit tests separate from AWS integration tests. Contributed by Chris Nauroth. 
(cherry picked from commit cda68de9b9)
 2016-10-10 14:01:13 -07:00