Commit Graph

23080 Commits

Author SHA1 Message Date
Sunil G 01d7924473 YARN-9814. JobHistoryServer can't delete aggregated files, if remote app root directory is created by NodeManager. Contributed by Adam Antal. 2019-09-18 09:27:41 +05:30
Weiwei Yang f8c14326ee YARN-2255. YARN Audit logging not added to log4j.properties. Contributed by Aihua Xu. 2019-09-18 09:12:28 +08:00
Hanisha Koneru 0dbfc4d9f2 HDDS-2139. Update BeanUtils and Jackson Databind dependency versions (#1456) 2019-09-17 17:39:30 -07:00
Doroszlai, Attila b88b6826c9 HDDS-2136. OM block allocation metric not paired with its failures (#1460) 2019-09-17 17:31:08 -07:00
Doroszlai, Attila a9ba2b6710 HDDS-2142. OM metrics mismatch (abort multipart request) (#1461) 2019-09-17 17:27:08 -07:00
Sahil Takiar 3cf6e4272f HDFS-14846: libhdfs tests are failing on trunk due to jni usage bugs
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-17 15:51:39 -07:00
Inigo Goiri f580a87079 HDFS-14795. Add Throttler for writing block. Contributed by Lisheng Sun. 2019-09-17 14:55:34 -07:00
Eric Yang eefe9bc85c YARN-9837. Fixed reading YARN Service JSON spec file larger than 128k.
Contributed by Tarun Parimi
2019-09-17 13:13:35 -04:00
Sunil G c474e24c0b YARN-9833. Race condition when DirectoryCollection.checkDirs() runs during container launch. Contributed by Peter Bacsko. 2019-09-17 19:41:38 +05:30
bshashikant 7f9073132d HDDS-2117. ContainerStateMachine#writeStateMachineData times out. (#1430) 2019-09-17 16:49:25 +05:30
Doroszlai, Attila f3de141787
HDDS-2135. OM Metric mismatch (MultipartUpload failures)
Closes #1453
2019-09-17 12:41:23 +02:00
Sahil Takiar 55ce454ce4
HADOOP-16371: Option to disable GCM for SSL connections when running on Java 8.
Contributed by Sahil Takiar.

This moves the SSLSocketFactoryEx class from hadoop-azure into hadoop-common
as the DelegatingSSLSocketFactory and binds the S3A connector to it so that
it can avoid using those HTTPS algorithms which are underperformant on Java 8.

Change-Id: Ie9e6ac24deac1aa05e136e08899620efa7d22abd
2019-09-17 11:32:03 +01:00
Márton Elek 3a549cea19
HDDS-2120. Remove hadoop classes from ozonefs-current jar
Closes #1434
2019-09-17 12:28:40 +02:00
Doroszlai, Attila e54977f888 HDDS-2132. TestKeyValueContainer is failing (#1457). 2019-09-17 14:31:33 +05:30
avijayanhwx 4f67081038 HDDS-2098 : Ozone shell command prints out ERROR when the log4j file … (#1411) 2019-09-16 22:36:53 -07:00
Mukul Kumar Singh 292bce7908 HDDS-2114. Rename does not preserve non-explicitly created interim directories. Contributed by Lokesh Jain & Istvan Fajth. 2019-09-17 10:47:12 +05:30
Márton Elek 2358e53e9c HDDS-2111. XSS fragments can be injected to the S3g landing page
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-16 15:48:09 -07:00
Vivek Ratnavel Subramanian 66bd1681f8 HDDS-2107. Datanodes should retry forever to connect to SCM in an unsecure environment (#1424) 2019-09-16 12:58:16 -07:00
Sammi Chen 4222b62f2b HDDS-1879. Support multiple excluded scopes when choosing datanodes in NetworkTopology (#1194) 2019-09-16 12:57:41 -07:00
Márton Elek c8d61ffef6 HDDS-2030. Generate simplifed reports by the dev-support/checks/*.sh scripts
Signed-off-by: Anu Engineer <aengineer@apache.org>
Co-Authored-By: Doroszlai, Attila <6454655+adoroszlai@users.noreply.github.com>
2019-09-16 12:17:33 -07:00
Xiaoyu Yao 56f042c48f
HDDS-2078. Get/Renew DelegationToken NPE after HDDS-1909
Closes #1444
2019-09-16 16:58:10 +02:00
Doroszlai, Attila 363373e0ef
HDDS-2124. Random next links
Closes #1443
2019-09-16 15:41:17 +02:00
Doroszlai, Attila e952ecf807
HDDS-2109. Refactor scm.container.client config
Closes #1426
2019-09-16 15:22:11 +02:00
Xiaoyu Yao b6334381df
HDDS-2096. Ozone ACL document missing AddAcl API
Closes #1427
2019-09-16 14:55:06 +02:00
shwetayakkali@cloudera.com 1e13fe6310
HDDS-2044.Remove 'ozone' from the recon module names. 2019-09-16 14:18:01 +02:00
Elek, Márton 85b1c728e4 HDDS-2129. Using dist profile fails with pom.ozone.xml as parent pom (#1449) 2019-09-15 08:22:17 -07:00
Abhishek Modi da2b4fe204 YARN-9794. RM crashes due to runtime errors in TimelineServiceV2Publisher. Contributed by Tarun Parimi. 2019-09-15 14:16:18 +05:30
Ayush Saxena e04b8a46c3 HDFS-14799. Do Not Call Map containsKey In Conjunction with get. Contributed by hemanthboyina. 2019-09-14 10:39:20 +05:30
Nanda kumar 9a931b823e
HDDS-2125. maven-javadoc-plugin.version is missing in pom.ozone.xml
Closes #1439
2019-09-14 06:32:11 +02:00
Arpit Agarwal 6a9f7caef4
Revert "HDDS-2057. Incorrect Default OM Port in Ozone FS URI Error Message."
This reverts commit 95010a41fc.
2019-09-13 11:40:42 -07:00
Siyao Meng e22a324f87 HDDS-2007. Make ozone fs shell command work with OM HA service ids (#1360) 2019-09-13 11:22:00 -07:00
Yi Sheng 1843c4688a HADOOP-16555. Update commons-compress to 1.19. (#1425) Contributed by YiSheng Lien. 2019-09-14 02:11:04 +08:00
avijayanhwx 8024818d33 HDDS-1786 : Datanodes takeSnapshot should delete previously created snapshots (#1163) 2019-09-13 23:20:31 +05:30
Stephen O'Donnell 06ad6540b3 HDFS-14821. Make HDFS-14617 (fsimage sub-sections) off by default. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-09-13 10:36:45 -07:00
HUAN-PING SU 4239007349 YARN-9787. Typo in analysesErrorMsg. Contributed by kevin su.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Surendra Singh Lilhore <surendralilhore@apache.org>
2019-09-13 10:36:45 -07:00
sdeka 95010a41fc HDDS-2057. Incorrect Default OM Port in Ozone FS URI Error Message.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-13 07:08:31 -07:00
Vinayakumar B 39e82acc48 HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable (#1429).
Addendum patch. Moved protobuf-3.7.1 installation within YETUS marker.
2019-09-13 16:50:16 +05:30
Doroszlai, Attila 4a9a6a21b8
HDDS-2122. Broken logo image on category sub-pages (#1437)
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-09-13 16:11:00 +05:30
Surendra Singh Lilhore 4852a90e4b HDFS-14754. Erasure Coding : The number of Under-Replicated Blocks never reduced. Contributed by hemanthboyina. 2019-09-13 00:17:13 +05:30
Gabor Bota 1505d3f5ff
HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch (#1433). Contributed by Gabor Bota.
Change-Id: Ied43ef1522dfc6a1210d6fc58c38d8208824931b
2019-09-12 19:04:57 +02:00
Shashikant Banerjee fe8cdf0ab8 HDDS-2076. Read fails because the block cannot be located in the container (#1410)
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-09-12 21:18:14 +05:30
Surendra Singh Lilhore 2ff2a7f612 HDFS-14798. Synchronize invalidateBlocks in DatanodeDescriptor. Contributed by hemanthboyina. 2019-09-12 19:43:18 +05:30
Surendra Singh Lilhore d1c303a497 HDFS-14699. Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold. Contributed by Zhao Yi Ming. 2019-09-12 19:11:50 +05:30
Vinayakumar B f4f9f0fe4f
HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable (#1429). Contributed by Vinayakumar B. 2019-09-12 16:47:54 +05:30
Gabor Bota 4e273a31f6
HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log) (#1208). Contributed by Gabor Bota.
Change-Id: I6bbb331b6c0a41c61043e482b95504fda8a50596
2019-09-12 13:12:46 +02:00
Abhishek Modi 44850f6784 YARN-9816. EntityGroupFSTimelineStore#scanActiveLogs fails when undesired files are present under /ats/active. Contribued by Prabhu Joseph. 2019-09-12 12:50:10 +05:30
Akira Ajisaka 68612a0410
HDFS-14840. Use Java Conccurent Instead of Synchronization in BlockPoolTokenSecretManager. Contributed by David Mollitor. 2019-09-12 12:41:57 +09:00
Abhishek Modi 3b06f0bf9e YARN-9819. Make TestOpportunisticContainerAllocatorAMService more resilient. Contribued by Abhishek Modi 2019-09-12 08:09:57 +05:30
Márton Elek f537410563
HDDS-2106. Avoid usage of hadoop projects as parent of hdds/ozone
Closes #1423
2019-09-12 02:38:41 +02:00
Eric Badger 56b7571131 YARN-9815 ReservationACLsTestBase fails with NPE. Contributed by Ahmed Hussein 2019-09-11 21:59:28 +00:00