Commit Graph

23220 Commits

Author SHA1 Message Date
Siyao Meng d7d6ec8fae HDDS-2128. Make ozone sh command work with OM HA service ids (#1445) 2019-09-20 14:22:55 -07:00
Doroszlai, Attila 53637301d1 HDDS-2157. checkstyle: print filenames relative to project root (#1485) 2019-09-20 14:05:35 -07:00
Inigo Goiri 3f223bebfa HDFS-14844. Make buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream configurable. Contributed by Lisheng Sun. 2019-09-20 11:45:01 -07:00
Nanda kumar b3173e1f58 HDDS-2001. Update Ratis version to 0.4.0.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-20 10:03:46 -07:00
Anu Engineer 5553887d95 HDDS-1949. Missing or error-prone test cleanup.
Contributed by Doroszlai, Attila.
2019-09-20 09:57:08 -07:00
Yuval Degani dd0834696a HADOOP-16581. Revise ValueQueue to correctly replenish queues that go below the watermark (#1463)
In the existing implementation, the ValueQueue::getAtMost() method will only trigger a refill on a key queue if it has gone empty, instead of triggering a refill when it has gone below the watermark. Revise the test suite to correctly verify this behavior.
2019-09-20 09:55:48 -07:00
Vinayakumar B 1654497f98
HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 (#1432)
HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1. Contributed by Vinayakumar B.
2019-09-20 16:08:30 +05:30
Xiaoyu Yao d072d3304c HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-19 22:43:00 -07:00
Vivek Ratnavel Subramanian 9be448b336 HDDS-2156. Fix alignment issues in HDDS doc pages
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-19 22:32:19 -07:00
Takanobu Asanuma 298f07abce HADOOP-16069. Support configure ZK_DTSM_ZK_KERBEROS_PRINCIPAL in ZKDelegationTokenSecretManager using principal with Schema /_HOST. Contributed by luhuachao. 2019-09-20 13:55:34 +09:00
Vivek Ratnavel Subramanian b7ae8a96cd HDDS-2101. Ozone filesystem provider doesn't exist (#1473) 2019-09-19 16:28:29 -07:00
Elek, Márton 126ef77a81 HDDS-2154. Fix Checkstyle issues (#1475) 2019-09-19 11:30:33 -07:00
Elek, Márton da1c67e0c2 HDDS-1054. List Multipart uploads in a bucket (#1277) 2019-09-19 11:06:02 -07:00
Inigo Goiri a79f286c6f HDFS-14609. RBF: Security should use common AuthenticationFilter. Contributed by Chen Zhang. 2019-09-19 11:00:10 -07:00
Doroszlai, Attila 1ada99b0bd HDDS-2151. Ozone client logs the entire request payload at DEBUG level (#1477) 2019-09-19 10:58:33 -07:00
Márton Elek f260b5aa5b HDDS-2127. Detailed Tools doc not reachable
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-19 09:50:21 -07:00
Márton Elek f6d884cd11 HDDS-2110. Arbitrary file can be downloaded with the help of ProfilerServlet
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-19 09:41:55 -07:00
Malcolm Taylor 56248f9d87
HADOOP-16556. Fix some alerts raised by LGTM.
Contributed by Malcolm Taylor.

Change-Id: Ic60c3f4681dd9d48b3afcba7520bd1e4d3cc4231
2019-09-19 16:00:05 +01:00
Kihwal Lee d4205dce17 HADOOP-16582. LocalFileSystem's mkdirs() does not work as expected under viewfs. Contributed by Kihwal Lee 2019-09-19 08:23:35 -05:00
Doroszlai, Attila c9900a01d1
HDDS-2141. Missing total number of operations
Closes #1462
2019-09-19 14:11:44 +02:00
dchitlangia 28913f733e
HDDS-2148. Remove redundant code in CreateBucketHandler.java
Closes #1471
2019-09-19 12:26:53 +02:00
Nanda kumar e78848fc3c
HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation
Closes #1435
2019-09-19 11:59:43 +02:00
dchitlangia 5c963a75d6
HDDS-2016. Add option to enforce GDPR in Bucket Create command
Closes #1458
2019-09-19 11:18:16 +02:00
Doroszlai, Attila 1029060e61
HDDS-2147. Include dumpstream in test report
Closes #1470
2019-09-19 10:41:00 +02:00
cxorm ef478fe73e
HDDS-730. ozone fs cli prints hadoop fs in usage
Closes #1464
2019-09-19 09:16:12 +02:00
Chen Liang 4ed0aefe9f HDFS-14822. [SBN read] Revisit GlobalStateIdContext locking when getting server state id. Contributed by Chen Liang. 2019-09-18 16:47:46 -07:00
Bharat Viswanadham f16eb093f7
HDDS-2144. MR job failing on secure Ozone cluster. (#1466) 2019-09-18 13:27:08 -07:00
Elek, Márton 53b57fdfa4 HDDS-2121. Create a shaded ozone filesystem (client) jar (#1452) 2019-09-18 13:25:15 -07:00
Steve Loughran 5db32b8ced HADOOP-16547. make sure that s3guard prune sets up the FS (#1402). Contributed by Steve Loughran.
Change-Id: Iaf71561cef6c797a3c66fed110faf08da6cac361
2019-09-18 19:22:15 +02:00
bshashikant 2c52d00a27
HDDS-2032. Ozone client should retry writes in case of any ratis/stateMachine exceptions. Contributed by Shashikant Banerjee (#1420). 2019-09-18 22:30:41 +05:30
Wei-Chiu Chuang 5dd859a8a0 HDFS-14836. FileIoProvider should not increase FileIoErrors metric in datanode volume metric. Contributed by Aiphago.
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
2019-09-18 09:34:01 -07:00
Siyao Meng 8d9e9ec3e5
HDDS-2065. Implement OMNodeDetails#toString
Closes #1387
2019-09-18 17:10:26 +02:00
Márton Elek c28e731156
Wrong commit message: Revert second "HDDS-2143. Rename classes under package org.apache.hadoop.utils"
This reverts commit 111b08a330.
2019-09-18 17:09:33 +02:00
Siyao Meng 111b08a330
HDDS-2143. Rename classes under package org.apache.hadoop.utils
Closes #1465
2019-09-18 17:00:26 +02:00
Bharat Viswanadham 6d4b20c047
HDDS-2143. Rename classes under package org.apache.hadoop.utils
Closes #1465
2019-09-18 16:51:39 +02:00
Viraj Jasani 285ed0a849
HDDS-2137. HddsClientUtils and OzoneUtils have duplicate verifyResourceName()
Closes #1455
2019-09-18 16:43:24 +02:00
Doroszlai, Attila 087ed86bcc
HDDS-2138. OM bucket operations do not add up
Closes #1468
2019-09-18 15:23:27 +02:00
Doroszlai, Attila 419dd0faf6
HDDS-2134. OM Metrics graphs include empty request type
Closes #1451
2019-09-18 14:09:15 +02:00
Márton Elek 15fded2788
HDDS-2022. Add additional freon tests
Closes #1341
2019-09-18 13:28:43 +02:00
Gabor Bota e97f0f1ed9
HADOOP-16565. Region must be provided when requesting session credentials or SdkClientException will be thrown (#1454). Contributed by Gabor Bota. 2019-09-18 10:51:08 +02:00
Sunil G 01d7924473 YARN-9814. JobHistoryServer can't delete aggregated files, if remote app root directory is created by NodeManager. Contributed by Adam Antal. 2019-09-18 09:27:41 +05:30
Weiwei Yang f8c14326ee YARN-2255. YARN Audit logging not added to log4j.properties. Contributed by Aihua Xu. 2019-09-18 09:12:28 +08:00
Hanisha Koneru 0dbfc4d9f2 HDDS-2139. Update BeanUtils and Jackson Databind dependency versions (#1456) 2019-09-17 17:39:30 -07:00
Doroszlai, Attila b88b6826c9 HDDS-2136. OM block allocation metric not paired with its failures (#1460) 2019-09-17 17:31:08 -07:00
Doroszlai, Attila a9ba2b6710 HDDS-2142. OM metrics mismatch (abort multipart request) (#1461) 2019-09-17 17:27:08 -07:00
Sahil Takiar 3cf6e4272f HDFS-14846: libhdfs tests are failing on trunk due to jni usage bugs
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-17 15:51:39 -07:00
Inigo Goiri f580a87079 HDFS-14795. Add Throttler for writing block. Contributed by Lisheng Sun. 2019-09-17 14:55:34 -07:00
Eric Yang eefe9bc85c YARN-9837. Fixed reading YARN Service JSON spec file larger than 128k.
Contributed by Tarun Parimi
2019-09-17 13:13:35 -04:00
Sunil G c474e24c0b YARN-9833. Race condition when DirectoryCollection.checkDirs() runs during container launch. Contributed by Peter Bacsko. 2019-09-17 19:41:38 +05:30
bshashikant 7f9073132d HDDS-2117. ContainerStateMachine#writeStateMachineData times out. (#1430) 2019-09-17 16:49:25 +05:30