Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,757 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

14757 Commits

Author SHA1 Message Date
Chris Nauroth d8fa1cfa67 HADOOP-13727. S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider. Contributed by Chris Nauroth. 2016-10-24 21:22:34 -07:00
Subru Krishnan 0a166b1347 YARN-5711. Propogate exceptions back to client when using hedging RM failover provider. 2016-10-24 18:59:51 -07:00
Akira Ajisaka dc3272bfe8 HDFS-11046. Duplicate '-' in the daemon log name. 2016-10-25 10:07:43 +09:00
Kihwal Lee 9d175853b0 HDFS-10997. Reduce number of path resolving methods. Contributed by Daryn Sharp. 2016-10-24 17:14:51 -05:00
Chris Douglas a1a0281e12 HADOOP-13626. Remove distcp dependency on FileStatus serialization 2016-10-24 12:46:54 -07:00
Kihwal Lee b18f35f097 HDFS-11042. Add missing cleanupSSLConfig() call for tests that use setupSSLConfig(). Contributed by Kuhu Shukla. 2016-10-24 08:28:44 -05:00
Xiaoyu Yao d0a347984d HADOOP-13749. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao. 2016-10-23 10:58:36 -07:00
Xiaoyu Yao da901b6c14 Revert "HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao." 
This reverts commit be72372248.
 2016-10-23 08:25:37 -07:00
Robert Kanter d4725bfcb2 MAPREDUCE-6728. Give fetchers hint when ShuffleHandler rejects a shuffling connection (haibochen via rkanter) 2016-10-21 17:46:17 -07:00
Andrew Wang c473490da0 HADOOP-13732. Upgrade OWASP dependency-check plugin version. Contributed by Mike Yoder. 2016-10-21 16:41:39 -07:00
Wei-Chiu Chuang 25438526ed HDFS-11033. Add documents for native raw erasure coder in XOR codes. Contributed by SammiChen. 2016-10-21 16:20:07 -07:00
Wei-Chiu Chuang df857f0d10 HDFS-10975. fsck -list-corruptfileblocks does not report corrupt EC files. Contributed by Takanobu Asanuma. 2016-10-21 15:43:12 -07:00
Xiaoyu Yao be72372248 HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao. 2016-10-21 14:23:02 -07:00
Robert Kanter 23d7d53a41 YARN-5679. TestAHSWebServices is failing (ajisakaa via rkanter) 2016-10-21 13:31:03 -07:00
Andrew Wang 61e30cf83c HDFS-8410. Add computation time metrics to datanode for ECWorker. Contributed by SammiChen. 2016-10-21 13:12:41 -07:00
Chris Douglas ae8bccd509 HADOOP-13702. Add instrumented ReadWriteLock. Contributed by Jingcheng Du 2016-10-21 12:59:54 -07:00
Varun Saxena 44eb2bd7ae YARN-5747. Application timeline metric aggregation in timeline v2 will lose last round aggregation when an application finishes (Li Lu via Varun Saxena) 2016-10-22 01:14:49 +05:30
Brahma Reddy Battula f63cd78f60 HDFS-10730. Fix some failed tests due to BindException. Contributed by Yiqun Lin 2016-10-21 18:16:39 +05:30
Karthik Kambatla 754cb4e30f YARN-5047. Refactor nodeUpdate across schedulers. (Ray Chiang via kasha) 2016-10-20 21:17:48 -07:00
Karthik Kambatla a064865abf YARN-4911. Bad placement policy in FairScheduler causes the RM to crash 2016-10-20 20:57:04 -07:00
Mingliang Liu d7d87deece HDFS-10998. Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA. Contributed by Xiaobing Zhou 2016-10-20 19:51:48 -07:00
Anu Engineer 262827cf75 HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal. 2016-10-20 13:35:26 -07:00
Wei-Chiu Chuang 5e83a21cb6 HDFS-10976. Report erasure coding policy of EC files in Fsck. Contributed by Wei-Chiu Chuang. 2016-10-20 13:06:43 -07:00
Anu Engineer 3fbf4cd5da HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran. 2016-10-20 12:33:58 -07:00
Wei-Chiu Chuang 6d2da38d16 HDFS-11018. Incorrect check and message in FsDatasetImpl#invalidate. Contributed by Yiqun Lin. 2016-10-20 10:56:39 -07:00
Brahma Reddy Battula f872c6bc03 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 2016-10-20 21:47:17 +05:30
Brahma Reddy Battula 6fb6b651e8 HDFS-10699. Log object instance get incorrectly in TestDFSAdmin. Contributed by Yiqun Lin 2016-10-20 21:28:16 +05:30
Kihwal Lee 5c0bffddc0 HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 2016-10-20 10:48:35 -05:00
Brahma Reddy Battula 4c73be135c HDFS-9480. Expose nonDfsUsed via StorageTypeStats. Contributed by Brahma Reddy Battula 2016-10-20 20:45:45 +05:30
Steve Loughran 9ae270af02 HADOOP-13735 ITestS3AFileContextStatistics.testStatistics() failing. Contributed by Pieter Reuse 2016-10-20 14:50:59 +01:00
Brahma Reddy Battula 73504b1bdc HDFS-11025. TestDiskspaceQuotaUpdate fails in trunk due to Bind exception. Contributed by Yiqun Lin 2016-10-20 10:41:18 +05:30
Yongjun Zhang 8650cc84f2 HDFS-9820. Improve distcp to support efficient restore to an earlier snapshot. Contributed by Yongjun Zhang. 2016-10-19 17:37:54 -07:00
Arpit Agarwal b4564103e4 HDFS-10752. Several log refactoring/improvement suggestion in HDFS. Contributed by Hanisha Koneru. 2016-10-19 17:20:07 -07:00
Sangjin Lee e9c4616b5e YARN-5561. [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST. Contributed by Rohith Sharma K S. 2016-10-19 09:45:23 -07:00
Xiao Chen c5573e6a75 HDFS-11009. Add a tool to reconstruct block meta file from CLI. 2016-10-18 22:42:28 -07:00
Benoy Antony 4bca385241 HADOOP-12082 Support multiple authentication schemes via AuthenticationFilter 2016-10-18 18:32:01 -07:00
Xiao Chen d75cbc5749 HADOOP-13693. Remove the message about HTTP OPTIONS in SPNEGO initialization message from kms audit log. 2016-10-18 18:24:59 -07:00
Xiao Chen efdf810cf9 HADOOP-7352. FileSystem#listStatus should throw IOE upon access error. Contributed by John Zhuge. 2016-10-18 18:18:43 -07:00
Robert Kanter 29caf6d7df MAPREDUCE-6791. remove unnecessary dependency from hadoop-mapreduce-client-jobclient to hadoop-mapreduce-client-shuffle (haibochen via rkanter) 2016-10-18 18:00:29 -07:00
Xiaoyu Yao c62ae7107f HDFS-10906. Add unit tests for Trash with HDFS encryption zones. Contributed by Hanisha Koneru. 2016-10-18 14:05:43 -07:00
Steve Loughran 6c348c5691 HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran 2016-10-18 21:16:02 +01:00
Xuan b733a6f862 YARN-5718. TimelineClient (and other places in YARN) shouldn't over-write HDFS client retry settings which could cause unexpected behavior. Contributed by Junping Du. 2016-10-18 11:06:47 -07:00
Varun Saxena b154d3edce YARN-5743. [Atsv2] Publish queue name and RMAppMetrics to ATS (Rohith Sharma K S via Varun Saxena) 2016-10-18 23:32:52 +05:30
Kai Zheng d26a1bb9d6 HDFS-10920. TestStorageMover#testNoSpaceDisk is failing intermittently. Contributed by Rakesh R 2016-10-18 14:51:08 +06:00
Kai Zheng c023c74886 HADOOP-13061. Refactor erasure coders. Contributed by Kai Sasaki 2016-10-18 12:02:53 +06:00
Akira Ajisaka bedfec0c10 HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini. 2016-10-18 15:00:44 +09:00
Yongjun Zhang 0bc6d37f3c Revert "HDFS-9820. Improve distcp to support efficient restore to an earlier snapshot. Contributed by Yongjun Zhang." 
This reverts commit 412c4c9a34.
 2016-10-17 22:47:37 -07:00
Ming Ma b61fb267b9 HDFS-9390. Block management for maintenance states. 2016-10-17 17:45:41 -07:00
Robert Kanter f5d9235914 YARN-5466. DefaultContainerExecutor needs JavaDocs (templedf via rkanter) 2016-10-17 14:29:09 -07:00
Xiaoyu Yao 8fd4c37c45 HDFS-10922. Adding additional unit tests for Trash (II). Contributed by Weiwei Yang. 2016-10-17 14:21:36 -07:00