Commit Graph

20981 Commits

Author SHA1 Message Date
Bharat Viswanadham 2091d1a4af HDDS-941. Rename ChunkGroupInputStream to keyInputStream and ChunkInputStream to BlockInputStream. Contributed by Shashikant Banerjee. 2019-01-09 20:02:36 -08:00
Jason Lowe c634589ab2 Revert "HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh."
This reverts commit ecdeaa7e6a.
2019-01-09 17:24:58 -06:00
Hanisha Koneru f4617c6239 Revert "HDDS-947. Implement OzoneManager State Machine."
This reverts commit 8dd11a1577.
2019-01-09 11:20:57 -08:00
Hanisha Koneru 8dd11a1577 HDDS-947. Implement OzoneManager State Machine. 2019-01-09 10:57:24 -08:00
Sean Mackrory 3420e26ae5 HADOOP-16027. [DOC] Effective use of FS instances during S3A integration tests. Contributed by Gabor Bota. 2019-01-09 10:57:58 -07:00
Takanobu Asanuma 709ddb10e5 HADOOP-15941. [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible. 2019-01-09 13:55:25 +09:00
shwetayakkali@cloudera.com 4ab5260b7e HDFS-14132. Add BlockLocation.isStriped() to determine if block is replicated or Striped
(Contributed by Shweta Yakkali via Daniel Templeton)

Change-Id: I0ed8996a0bae2ad2c7d3513143195533f7191af8
2019-01-08 17:04:57 -08:00
Jason Lowe 6a923464af YARN-6523. Optimize system credentials sent in node heartbeat responses. Contributed by Manikandan R 2019-01-08 16:54:05 -06:00
Márton Elek 32cf0412ce HDDS-965. Ozone: checkstyle improvements and code quality scripts. Contributed by Elek, Marton. 2019-01-08 22:27:19 +01:00
Giovanni Matteo Fumarola 1a08302897 HDFS-14189. Fix intermittent failure of TestNameNodeMetrics. Contributed by Ayush Saxena. 2019-01-08 10:38:06 -08:00
Márton Elek 999f31fd20 HDDS-924. MultipartUpload: S3 APi for complete Multipart Upload. Contributed by Bharat Viswanadham. 2019-01-08 15:48:48 +01:00
Márton Elek 695e93c2bb HDDS-969. Fix TestOzoneManagerRatisServer test failure. Contributed by Bharat Viswanadham. 2019-01-08 15:12:08 +01:00
Márton Elek 396ffba1aa HDDS-968. Fix TestObjectPut failures. Contributed by Bharat Viswanadham. 2019-01-08 14:54:38 +01:00
Kai Xie 188bebbe7e HADOOP-16018. DistCp won't reassemble chunks when blocks per chunk > 0.
Contributed by Kai Xie.
2019-01-08 11:57:57 +00:00
Weiwei Yang 0921b706f7 YARN-9037. [CSI] Ignore volume resource in resource calculators based on tags. Contributed by Sunil Govindan. 2019-01-08 14:30:53 +08:00
Bharat Viswanadham 4297e20c8b HDDS-926. Use Timeout rule for the the test methods in TestOzoneManager. Contributed by Dinesh Chitlangia. 2019-01-07 22:04:06 -08:00
Akira Ajisaka 7f78397036
Revert "HADOOP-14556. S3A to support Delegation Tokens."
This reverts commit d7152332b3.
2019-01-08 14:51:30 +09:00
Giovanni Matteo Fumarola 489411579c YARN-9169. Add metrics for queued opportunistic and guaranteed containers. Contributed by Abhishek Modi. 2019-01-07 15:16:55 -08:00
Anu Engineer 0f26b5efaa HDDS-931. Add documentation for ozone shell command providing ozone mapping for a S3Bucket.
Contributed by Bharat Viswanadham.
2019-01-07 13:06:45 -08:00
Wangda Tan 0a01d49917 YARN-8822. Nvidia-docker v2 support for YARN GPU feature. (Charo Zhang via wangda)
Change-Id: Id8af27134d3286a7a10d85eda9be25df9689d0e7
2019-01-07 12:07:26 -08:00
Anu Engineer 06279ecc55 HDDS-946. AuditParser - insert audit to database in batches.
contributed by Dinesh Chitlangia.
2019-01-07 11:19:42 -08:00
Bharat Viswanadham cdfbec47ce HDDS-930. Multipart Upload: Abort multiupload request. Contributed by Bharat Viswanadham. 2019-01-07 11:09:14 -08:00
Eric Yang 802932ca0b HADOOP-16031. Fixed TestSecureLogins unit test. Contributed by Akira Ajisaka 2019-01-07 13:21:14 -05:00
Steve Loughran d7152332b3
HADOOP-14556. S3A to support Delegation Tokens.
Contributed by Steve Loughran.
2019-01-07 13:18:03 +00:00
Márton Elek d66925a315 HDDS-902. MultipartUpload: S3 API for uploading a part file. Contributed by Bharat Viswanadham. 2019-01-07 12:39:46 +01:00
Márton Elek 992dd9d189 HDDS-901. MultipartUpload: S3 API for Initiate multipart upload. Contributed by Bharat Viswanadham. 2019-01-07 12:06:22 +01:00
Márton Elek d14c56d150 HDDS-916. MultipartUpload: Complete Multipart upload request. Contributed by Bharat Viswanadham. 2019-01-07 11:27:36 +01:00
Akira Ajisaka 32d5caa0a8
HADOOP-15937. [JDK 11] Update maven-shade-plugin.version to 3.2.1. Contributed by Dinesh Chitlangia. 2019-01-07 19:17:23 +09:00
Akira Ajisaka 5db7c49062
YARN-9162. Fix TestRMAdminCLI#testHelp. Contributed by Ayush Saxena. 2019-01-07 17:32:28 +09:00
Weiwei Yang 944cf87223 YARN-9173. FairShare calculation broken for large values after YARN-8833. Contributed by Wilfred Spiegelenburg. 2019-01-07 15:57:31 +08:00
Weiwei Yang f87b3b11c4 HADOOP-16030. AliyunOSS: bring fixes back from HADOOP-15671. Contributed by wujinhu. 2019-01-07 15:56:49 +08:00
Weiwei Yang d3321fbed0 Revert "YARN-9178. TestRMAdminCli#testHelp is failing in trunk. Contributed by Abhishek Modi."
This reverts commit 650b9cbe16.
2019-01-07 08:58:09 +08:00
Wangda Tan 2c02aa6ec2 YARN-9160. [Submarine] Document 'PYTHONPATH' environment variable setting when using -localization options. (Zhankun Tang via wangda)
Change-Id: I115b6710eb11501e21ab3e9e7cd1a87f322e5cf8
2019-01-06 10:25:35 -08:00
Wangda Tan 8f004fe4e0 YARN-9141. [Submarine] JobStatus outputs with system UTC clock, not local clock. (Zac Zhou via wangda)
Change-Id: Ib2b17cf7860ddc9188f06498086de3326bc09519
2019-01-06 10:24:29 -08:00
Weiwei Yang 650b9cbe16 YARN-9178. TestRMAdminCli#testHelp is failing in trunk. Contributed by Abhishek Modi. 2019-01-06 11:29:59 +08:00
Sunil G 1f425271a7
Revert "HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu."
This reverts commit e4fca6aae4.

Revert "HADOOP-15671. AliyunOSS: Support Assume Roles in AliyunOSS. Contributed by Jinhu Wu."

This reverts commit 2b635125fb.
2019-01-05 17:35:29 +09:00
Anu Engineer 999da98d67 HDDS-915. Submit client request to OM Ratis server.
Contributed by Hanisha Koneru.
2019-01-04 15:25:26 -08:00
Eric Yang d43af8b3db HADOOP-15996. Improved Kerberos username mapping strategy in Hadoop.
Contributed by Bolke de Bruin
2019-01-04 17:54:15 -05:00
Giovanni Matteo Fumarola 6e35f7130f YARN-9166. Fix logging for preemption of Opportunistic containers for Guaranteed containers. Contributed by Abhishek Modi. 2019-01-04 11:16:41 -08:00
Inigo Goiri f4e18242bd HADOOP-16028. Fix NetworkTopology chooseRandom function to support excluded nodes. Contributed by Sihai Ke. 2019-01-04 09:56:58 -08:00
Anu Engineer ddc0a40507 HDDS-896. Handle over replicated containers in SCM.
Contributed by Nandakumar.
2019-01-04 09:04:10 -08:00
Sunil G 51427cbdfb HADOOP-15997. KMS client uses wrong UGI after HADOOP-14445. Contributed by Wei-Chiu Chuang. 2019-01-04 21:49:06 +05:30
Rohith Sharma K S 8c6978c3ba YARN-6149. Allow port range to be specified while starting NM Timeline collector manager. Contributed by Abhishek Modi. 2019-01-04 14:07:02 +05:30
Rohith Sharma K S 573b158791 YARN-8567. Fetching yarn logs fails for long running application if it is not present in timeline store. Contributed by Tarun Parimi. 2019-01-04 14:01:35 +05:30
Sunil G f4906ac019 YARN-9038. [CSI] Add ability to publish/unpublish volumes on node managers. Contributed by Weiwei Yang. 2019-01-04 12:10:00 +05:30
Eric Yang dfceffa70d YARN-9147. Rmove auxiliary services when manifest file is removed.
Contributed by Billie Rinaldi
2019-01-03 12:57:21 -05:00
Pranay Singh ecdeaa7e6a HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-01-03 09:56:07 -08:00
Anu Engineer 14d232c0fe HDDS-957. Replace incorrect use of system property user.name.
Contributed by Dinesh Chitlangia.
2019-01-03 09:43:26 -08:00
Weiwei Yang cfe89e6f96 YARN-9164. Shutdown NM may cause NPE when opportunistic container scheduling is enabled. Contributed by lujie. 2019-01-03 23:56:28 +08:00
Weiwei Yang 040a202b20 HADOOP-15323. AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore. Contributed wujinhu. 2019-01-03 21:37:49 +08:00