Commit Graph

14819 Commits

Author SHA1 Message Date
Robert Kanter 29caf6d7df MAPREDUCE-6791. remove unnecessary dependency from hadoop-mapreduce-client-jobclient to hadoop-mapreduce-client-shuffle (haibochen via rkanter) 2016-10-18 18:00:29 -07:00
Xiaoyu Yao c62ae7107f HDFS-10906. Add unit tests for Trash with HDFS encryption zones. Contributed by Hanisha Koneru. 2016-10-18 14:05:43 -07:00
Steve Loughran 6c348c5691 HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran 2016-10-18 21:16:02 +01:00
Xuan b733a6f862 YARN-5718. TimelineClient (and other places in YARN) shouldn't over-write HDFS client retry settings which could cause unexpected behavior. Contributed by Junping Du. 2016-10-18 11:06:47 -07:00
Varun Saxena b154d3edce YARN-5743. [Atsv2] Publish queue name and RMAppMetrics to ATS (Rohith Sharma K S via Varun Saxena) 2016-10-18 23:32:52 +05:30
Kai Zheng d26a1bb9d6 HDFS-10920. TestStorageMover#testNoSpaceDisk is failing intermittently. Contributed by Rakesh R 2016-10-18 14:51:08 +06:00
Kai Zheng c023c74886 HADOOP-13061. Refactor erasure coders. Contributed by Kai Sasaki 2016-10-18 12:02:53 +06:00
Akira Ajisaka bedfec0c10 HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini. 2016-10-18 15:00:44 +09:00
Yongjun Zhang 0bc6d37f3c Revert "HDFS-9820. Improve distcp to support efficient restore to an earlier snapshot. Contributed by Yongjun Zhang."
This reverts commit 412c4c9a34.
2016-10-17 22:47:37 -07:00
Ming Ma b61fb267b9 HDFS-9390. Block management for maintenance states. 2016-10-17 17:45:41 -07:00
Robert Kanter f5d9235914 YARN-5466. DefaultContainerExecutor needs JavaDocs (templedf via rkanter) 2016-10-17 14:29:09 -07:00
Xiaoyu Yao 8fd4c37c45 HDFS-10922. Adding additional unit tests for Trash (II). Contributed by Weiwei Yang. 2016-10-17 14:21:36 -07:00
Andrew Wang b671ee6846 HDFS-11013. Correct typos in native erasure coding dump code. Contributed by László Bence Nagy. 2016-10-17 14:14:50 -07:00
Andrew Wang 987ee51141 HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei. 2016-10-17 13:25:58 -07:00
Andrew Wang 0f4afc8100 HADOOP-13722. Code cleanup -- ViewFileSystem and InodeTree. Contributed by Manoj Govindassamy. 2016-10-17 13:15:11 -07:00
Yongjun Zhang 412c4c9a34 HDFS-9820. Improve distcp to support efficient restore to an earlier snapshot. Contributed by Yongjun Zhang. 2016-10-17 11:04:42 -07:00
Wei-Chiu Chuang ed9fcbec54 HADOOP-13661. Upgrade HTrace version. Contributed by Sean Mackrory. 2016-10-17 05:04:49 -07:00
Sangjin Lee 1f304b0c7f YARN-5699. Retrospect yarn entity fields which are publishing in events info fields. Contributed by Rohith Sharma K S. 2016-10-15 13:54:40 -07:00
Brahma Reddy Battula 5f4ae85bd8 HDFS-11003. Expose XmitsInProgress through DataNodeMXBean. Contributed By Brahma Reddy Battula 2016-10-15 22:28:33 +05:30
Akira Ajisaka 5ad037df25 HDFS-11012. Unnecessary INFO logging on DFSClients for InvalidToken. Contributed by Harsh J.
This closes #142
2016-10-15 22:14:24 +09:00
Vinitha Reddy Gankidi 391ce535a7 HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi. 2016-10-14 18:13:54 -07:00
Anu Engineer 30bb1970cc HDFS-10558. DiskBalancer: Print the full path to plan file. Contributed by Xiaobing Zhou. 2016-10-14 17:07:59 -07:00
Mingliang Liu 76cc84e6d4 HDFS-11008. Change unit test for testing parsing "-source" parameter in Balancer CLI. Contributed by Mingliang Liu 2016-10-14 14:29:02 -07:00
Andrew Wang aee538be6c HADOOP-13721. Remove stale method ViewFileSystem#getTrashCanLocation. Contributed by Manoj Govindassamy. 2016-10-14 14:08:31 -07:00
Lei Xu 8c520a27cb HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei) 2016-10-14 13:41:59 -07:00
Jing Zhao adb96e109f HDFS-10827. When there are unrecoverable ec block groups, Namenode Web UI doesn't show the block names. Contributed by Takanobu Asanuma. 2016-10-14 13:21:53 -07:00
Andrew Wang 0007360c33 HDFS-10883. 's behavior is not consistent in DFS after enabling EZ. Contributed by Yuanbo Liu. 2016-10-14 11:41:29 -07:00
Benoy Antony 701c27a776 HDFS-10735 Distcp using webhdfs on secure HA clusters fails with StandbyException 2016-10-14 10:26:39 -07:00
Kihwal Lee 8a9f6635a3 HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 2016-10-14 11:38:48 -05:00
Xiaoyu Yao dbe663d524 HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang. 2016-10-13 23:05:16 -07:00
Akira Ajisaka 5a5a724731 HADOOP-13417. Fix javac and checkstyle warnings in hadoop-auth package. 2016-10-14 14:45:55 +09:00
Mingliang Liu d9f73f1b7c HADOOP-13723. AliyunOSSInputStream#read() should update read bytes stat correctly. Contributed by Mingliang Liu 2016-10-13 22:33:55 -07:00
Xiao Chen ae51b11f78 HADOOP-13669. Addendum patch for KMS Server should log exceptions before throwing. 2016-10-13 22:32:08 -07:00
Chris Douglas cf3f43e95b YARN-5717. Add tests for container-executor is_feature_enabled. Contributed by Sidharta Seethana 2016-10-13 20:49:07 -07:00
Jing Zhao 0a85d07983 HADOOP-13024. Distcp with -delete feature on raw data not implemented. Contributed by Mavin Martin. 2016-10-13 13:24:54 -07:00
Andrew Wang 8c721aa00a Revert "HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin."
This reverts commit fdce515091.
2016-10-13 13:23:28 -07:00
Kihwal Lee 332a61fd74 HDFS-10987. Make Decommission less expensive when lot of blocks present. Contributed by Brahma Reddy Battula. 2016-10-13 13:52:49 -05:00
Andrew Wang fdce515091 HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 2016-10-13 11:41:37 -07:00
Arpit Agarwal 008122b3c9 HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru. 2016-10-13 11:37:03 -07:00
Xiaoyu Yao 9097e2efe4 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao. 2016-10-13 10:52:28 -07:00
Anu Engineer b371c56365 HDFS-10949. DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity. Contributed by Xiaobing Zhou. 2016-10-13 10:26:07 -07:00
Brahma Reddy Battula 1291254042 HDFS-10986. DFSAdmin should log detailed error message if any. Contributed by MingLiang Liu 2016-10-13 22:05:00 +05:30
Kihwal Lee 9454dc5e80 HDFS-11000. webhdfs PUT does not work if requests are routed to call queue. Contributed by Kihwal Lee. 2016-10-13 08:47:15 -05:00
Akira Ajisaka 901eca004d HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu. 2016-10-13 14:29:30 +09:00
Andrew Wang 12d739a34b HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures. 2016-10-12 15:19:52 -07:00
Kihwal Lee 85cd06f663 HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah. 2016-10-12 15:11:42 -05:00
Karthik Kambatla 6476934ae5 YARN-5677. RM should transition to standby when connection is lost for an extended period. (Daniel Templeton via kasha) 2016-10-11 22:07:10 -07:00
Karthik Kambatla 6378845f9e YARN-4464. Lower the default max applications stored in the RM and store. (Daniel Templeton via kasha) 2016-10-11 21:42:08 -07:00
Mingliang Liu 7ba7092bbc HDFS-10965. Add unit test for HDFS command 'dfsadmin -printTopology'. Contributed by Xiaobing Zhou 2016-10-11 17:23:54 -07:00
Xiao Chen b84c4891f9 HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key. 2016-10-11 17:05:00 -07:00