91f50b98ca
HDDS-2167. Hadoop31-mr acceptance test is failing due to the shading
...
Closes #1507
2019-09-24 17:52:36 +02:00
51c64b357d
HDFS-13660. DistCp job fails when new data is appended in the file while the DistCp copy job is running
...
This uses the length of the file known at the start of the copy to determine the amount of data to copy.
* If a file is appended to during the copy, the original bytes are copied.
* If a file is truncated during a copy, or the attempt to read the data fails with a truncated stream,
distcp will now fail. Until now these failures were not detected.
Contributed by Mukund Thakur.
Change-Id: I576a49d951fa48d37a45a7e4c82c47488aa8e884
2019-09-24 11:23:24 +01:00
8f1a135118
HDDS-2081. Fix TestRatisPipelineProvider#testCreatePipelinesDnExclude. Contributed by Aravindan Vijayan. ( #1506 )
2019-09-24 12:59:51 +05:30
e8e7d7b4cd
HADOOP-16561. [MAPREDUCE] use protobuf-maven-plugin to generate protobuf classes ( #1500 )
...
Signed-off-by: Vinayakumar B <vinayakumarb@apache.org>
2019-09-24 08:52:12 +08:00
bfe1dac29d
HADOOP-16560. [YARN] use protobuf-maven-plugin to generate protobuf classes ( #1496 )
...
Signed-off-by: Vinayakumar B <vinayakumarb@apache.org>
2019-09-24 08:50:36 +08:00
0a716bd3a5
HDDS-2159. Fix Race condition in ProfileServlet#pid.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-23 17:21:19 -07:00
6cbe5d3809
HDDS-2160. Add acceptance test for ozonesecure-mr compose. Contributed by Xiaoyu Yao. ( #1490 )
2019-09-23 13:28:38 -07:00
3fd3d746fc
HDDS-2161. Create RepeatedKeyInfo structure to be saved in deletedTable
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-23 13:15:47 -07:00
3d78b1223d
YARN-9762. Add submission context label to audit logs. Contributed by Manoj Kumar
2019-09-23 13:12:16 -07:00
c30e495557
HDFS-14853. NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is not present. Contributed by Ranith Sardar.
2019-09-23 21:22:50 +05:30
2b5fc95851
HADOOP-16591 Fix S3A ITest*MRjob failures.
...
Contributed by Siddharth Seth.
Change-Id: I7f08201c9f7c0551514049389b5b398a84855191
2019-09-23 14:58:03 +01:00
aa664d7259
HADOOP-16138. hadoop fs mkdir / of nonexistent abfs container raises NPE ( #1302 ). Contributed by Gabor Bota.
...
Change-Id: I2f637865c871e400b95fe7ddaa24bf99fa192023
2019-09-23 13:29:01 +02:00
07c81e9bfc
HADOOP-16558. [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes ( #1494 ). Contributed by Vinayakumar B.
2019-09-23 12:37:47 +05:30
4c0a7a9e13
Make upstream aware of 3.2.1 release.
2019-09-23 06:20:54 +00:00
659c88801d
HDFS-14818. Check native pmdk lib by 'hadoop checknative' command. Contributed by Feilong He.
2019-09-22 22:02:54 +05:30
a94aa1ff46
HDDS-2150. Update dependency versions to avoid security vulnerabilities. ( #1472 )
2019-09-20 23:21:53 -07:00
e02b1023c2
HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB ( #1332 )
2019-09-21 11:50:45 +05:30
dbdc612b3b
HDDS-2163. Add 'Replication factor' to the output of list keys ( #1493 )
2019-09-20 22:59:45 -07:00
efed4450bf
HADOOP-16589. [pb-upgrade] Update docker image to make 3.7.1 protoc as default ( #1482 ). Contributed by Vinayakumar B.
2019-09-21 10:07:26 +05:30
aa938662f9
HDFS-14833. RBF: Router Update Doesn't Sync Quota. Contributed by Ayush Saxena.
2019-09-21 09:53:13 +05:30
d7d6ec8fae
HDDS-2128. Make ozone sh command work with OM HA service ids ( #1445 )
2019-09-20 14:22:55 -07:00
53637301d1
HDDS-2157. checkstyle: print filenames relative to project root ( #1485 )
2019-09-20 14:05:35 -07:00
3f223bebfa
HDFS-14844. Make buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream configurable. Contributed by Lisheng Sun.
2019-09-20 11:45:01 -07:00
b3173e1f58
HDDS-2001. Update Ratis version to 0.4.0.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-20 10:03:46 -07:00
5553887d95
HDDS-1949. Missing or error-prone test cleanup.
...
Contributed by Doroszlai, Attila.
2019-09-20 09:57:08 -07:00
dd0834696a
HADOOP-16581. Revise ValueQueue to correctly replenish queues that go below the watermark ( #1463 )
...
In the existing implementation, the ValueQueue::getAtMost() method will only trigger a refill on a key queue if it has gone empty, instead of triggering a refill when it has gone below the watermark. Revise the test suite to correctly verify this behavior.
2019-09-20 09:55:48 -07:00
1654497f98
HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 ( #1432 )
...
HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1. Contributed by Vinayakumar B.
2019-09-20 16:08:30 +05:30
d072d3304c
HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-19 22:43:00 -07:00
9be448b336
HDDS-2156. Fix alignment issues in HDDS doc pages
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-19 22:32:19 -07:00
298f07abce
HADOOP-16069. Support configure ZK_DTSM_ZK_KERBEROS_PRINCIPAL in ZKDelegationTokenSecretManager using principal with Schema /_HOST. Contributed by luhuachao.
2019-09-20 13:55:34 +09:00
b7ae8a96cd
HDDS-2101. Ozone filesystem provider doesn't exist ( #1473 )
2019-09-19 16:28:29 -07:00
126ef77a81
HDDS-2154. Fix Checkstyle issues ( #1475 )
2019-09-19 11:30:33 -07:00
da1c67e0c2
HDDS-1054. List Multipart uploads in a bucket ( #1277 )
2019-09-19 11:06:02 -07:00
a79f286c6f
HDFS-14609. RBF: Security should use common AuthenticationFilter. Contributed by Chen Zhang.
2019-09-19 11:00:10 -07:00
1ada99b0bd
HDDS-2151. Ozone client logs the entire request payload at DEBUG level ( #1477 )
2019-09-19 10:58:33 -07:00
f260b5aa5b
HDDS-2127. Detailed Tools doc not reachable
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-19 09:50:21 -07:00
f6d884cd11
HDDS-2110. Arbitrary file can be downloaded with the help of ProfilerServlet
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-19 09:41:55 -07:00
56248f9d87
HADOOP-16556. Fix some alerts raised by LGTM.
...
Contributed by Malcolm Taylor.
Change-Id: Ic60c3f4681dd9d48b3afcba7520bd1e4d3cc4231
2019-09-19 16:00:05 +01:00
d4205dce17
HADOOP-16582. LocalFileSystem's mkdirs() does not work as expected under viewfs. Contributed by Kihwal Lee
2019-09-19 08:23:35 -05:00
c9900a01d1
HDDS-2141. Missing total number of operations
...
Closes #1462
2019-09-19 14:11:44 +02:00
28913f733e
HDDS-2148. Remove redundant code in CreateBucketHandler.java
...
Closes #1471
2019-09-19 12:26:53 +02:00
e78848fc3c
HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation
...
Closes #1435
2019-09-19 11:59:43 +02:00
5c963a75d6
HDDS-2016. Add option to enforce GDPR in Bucket Create command
...
Closes #1458
2019-09-19 11:18:16 +02:00
1029060e61
HDDS-2147. Include dumpstream in test report
...
Closes #1470
2019-09-19 10:41:00 +02:00
ef478fe73e
HDDS-730. ozone fs cli prints hadoop fs in usage
...
Closes #1464
2019-09-19 09:16:12 +02:00
4ed0aefe9f
HDFS-14822. [SBN read] Revisit GlobalStateIdContext locking when getting server state id. Contributed by Chen Liang.
2019-09-18 16:47:46 -07:00
f16eb093f7
HDDS-2144. MR job failing on secure Ozone cluster. ( #1466 )
2019-09-18 13:27:08 -07:00
53b57fdfa4
HDDS-2121. Create a shaded ozone filesystem (client) jar ( #1452 )
2019-09-18 13:25:15 -07:00
5db32b8ced
HADOOP-16547. make sure that s3guard prune sets up the FS ( #1402 ). Contributed by Steve Loughran.
...
Change-Id: Iaf71561cef6c797a3c66fed110faf08da6cac361
2019-09-18 19:22:15 +02:00
2c52d00a27
HDDS-2032. Ozone client should retry writes in case of any ratis/stateMachine exceptions. Contributed by Shashikant Banerjee ( #1420 ).
2019-09-18 22:30:41 +05:30
Márton Elek
Mukund Thakur
avijayanhwx
Duo Zhang
Hanisha Koneru
Xiaoyu Yao
dchitlangia
Jonathan Hung
Ayush Saxena
Siddharth Seth
Gabor Bota
Vinayakumar B
Rohith Sharma K S
Rakesh Radhakrishnan
Vivek Ratnavel Subramanian
Siyao Meng
Doroszlai, Attila
Inigo Goiri
Nanda kumar
Anu Engineer
Yuval Degani
Takanobu Asanuma
Elek, Márton
Malcolm Taylor
Kihwal Lee
Doroszlai, Attila
cxorm
Chen Liang
Bharat Viswanadham
Steve Loughran
bshashikant