c1d7d68c78
HDDS-1461. Optimize listStatus api in OzoneFileSystem ( #782 )
2019-05-21 14:47:48 +05:30
1cb2eb0df3
HDFS-14353. Erasure Coding: metrics xmitsInProgress become to negative. Contributed by maobaolong.
2019-05-20 17:22:58 -07:00
05db2a598e
HDDS-1487. Bootstrap React framework for Recon UI ( #831 )
...
HDDS-1487. Bootstrap React framework for Recon UI.
Contributed by Vivek Ratnavel Subramanian.
2019-05-20 22:09:58 +02:00
f63300228e
HDDS-1451 : SCMBlockManager findPipeline and createPipeline are not lock protected. ( #799 )
...
* HDDS-1451 : SCMBlockManager findPipeline and createPipeline are not lock protected.
* HDDS-1451 : Address review comments.
2019-05-20 22:02:56 +02:00
24c53e057a
YARN-9546. Add configuration option for YARN Native services AM classpath. Contributed by Gergely Pollak.
2019-05-20 10:53:01 -04:00
64c39856d2
Fixed checkstyle issues.
2019-05-20 08:13:37 +05:30
0d1d7c86ec
HDDS-1499. OzoneManager Cache. ( #798 )
2019-05-19 19:23:02 -07:00
a36274d699
HADOOP-16085. S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite.
...
Contributed by Ben Roling.
S3Guard will now track the etag of uploaded files and, if an S3
bucket is versioned, the object version.
You can then control how to react to a mismatch between the data
in the DynamoDB table and that in the store: warn, fail, or, when
using versions, return the original value.
This adds two new columns to the table: etag and version.
This is transparent to older S3A clients -but when such clients
add/update data to the S3Guard table, they will not add these values.
As a result, the etag/version checks will not work with files uploaded by older clients.
For a consistent experience, upgrade all clients to use the latest hadoop version.
2019-05-19 22:29:54 +01:00
729ccb2cab
SUBMARINE-58. Submarine client needs to generate fat jar. Contributed by Zac Zhou.
2019-05-19 21:18:33 +08:00
869a1ab41a
HDDS-1535. Space tracking for Open Containers : Handle Node Startup. Contributed by Supratim Deka
2019-05-18 16:16:33 +05:30
732133cb2a
HDDS-1422. Exception during DataNode shutdown. Contributed by Arpit A… ( #725 )
...
* HDDS-1422. Exception during DataNode shutdown. Contributed by Arpit Agarwal.
Change-Id: I6db6bdd19839a45e5341ed7e745cd38f68af8378
* Suppress spurious findbugs warning.
* Remove log file that got committed in error
2019-05-18 11:47:19 +02:00
12c81610e0
YARN-9505. Add container allocation latency for Opportunistic Scheduler. Contributed by Abhishek Modi.
2019-05-17 12:03:21 -07:00
3e5e5b028a
HDFS-14323. Distcp fails in Hadoop 3.x when 2.x source webhdfs url has special characters in hdfs file path. Contributed by Srinivasu Majeti.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-05-17 19:20:28 +02:00
4cb3da6ac7
HADOOP-16248. MutableQuantiles leak memory under heavy load.
...
Contributed by Alexis Daboville,
2019-05-17 15:15:22 +01:00
c183bd8e20
HDDS-1527. HDDS Datanode start fails due to datanode.id file read error. Contributed by Siddharth Wagle.
...
This closes #822 .
2019-05-16 15:13:10 -07:00
fab5b80a36
YARN-9554. Fixed TimelineEntity DAO serialization handling.
...
Contributed by Prabhu Joseph
2019-05-16 16:39:50 -04:00
03ea8ea92e
HDDS-1297. Fix IllegalArgumentException thrown with MiniOzoneCluster Initialization. Contributed by Yiqun Lin.
2019-05-16 17:04:46 +02:00
9248b7d58b
HDDS-1284. Adjust default values of pipline recovery for more resilient service restart.
2019-05-16 17:04:46 +02:00
b067f8acaa
HADOOP-16050: s3a SSL connections should use OpenSSL
...
(cherry picked from commit aebf229c17
2019-05-16 08:57:54 -06:00
b7de735159
HDDS-1522. Provide intellij runConfiguration for Ozone components. Contributed by Elek, Marton.
2019-05-16 16:38:50 +02:00
c15b3bca86
HADOOP-16294: Enable access to input options by DistCp subclasses.
...
Adding a protected-scope getter for the DistCpOptions, so that a subclass does
not need to save its own copy of the inputOptions supplied to its constructor,
if it wishes to override the createInputFileListing method with logic similar
to the original implementation, i.e. calling CopyListing#buildListing with a path and input options.
Author: Andrew Olson
2019-05-16 16:11:12 +02:00
2713dcf6e9
HADOOP-16307. Intern User Name and Group Name in FileStatus.
...
Author: David Mollitor
2019-05-16 16:02:07 +02:00
e66ecc564a
HDDS-1531. Disable the sync flag by default during chunk writes in Datanode ( #820 ). Contributed by Shashikant Banerjee.
2019-05-16 18:38:52 +05:30
de01422c2e
SUBMARINE-56. Update documentation to describe single-node PyTorch integration. Contributed by Szilard Nemeth.
2019-05-15 21:26:48 -07:00
d4c8858586
HADOOP-16247. NPE in FsUrlConnection. Contributed by Karthik Palanisamy.
2019-05-15 17:41:36 -07:00
77170e70d1
HDFS-14390. Provide kerberos support for AliasMap service used by Provided storage. Contributed by Ashvin Agrawal
2019-05-15 12:15:47 -07:00
55bd35921c
YARN-9552. FairScheduler: NODE_UPDATE can cause NoSuchElementException. Contributed by Peter Bacsko.
2019-05-15 11:50:46 -07:00
9569015802
HDDS-1511. Space tracking for Open Containers in HDDS Volumes. Contributed by Supratim Deka ( #812 )
2019-05-15 10:26:01 -07:00
570fa2da20
YARN-9508. YarnConfiguration areNodeLabel enabled is costly in allocation flow. Contributed by Bilwa S T.
2019-05-15 13:30:09 +05:30
2de1e30658
YARN-9547. ContainerStatusPBImpl default execution type is not returned. Contributed by Bilwa S T.
2019-05-15 13:21:39 +05:30
2d8282bb82
HADOOP-16306. AliyunOSS: Remove temporary files when upload small files to OSS. Contributed by wujinhu.
2019-05-14 14:05:39 -07:00
e2dfdaee7c
HDFS-14482: Crash when using libhdfs with bad classpath
2019-05-14 11:04:06 -07:00
7d831eca64
YARN-9519. TFile log aggregation file format is not working for yarn.log-aggregation.TFile.remote-app-log-dir config. Contributed by Adam Antal.
2019-05-14 10:48:08 -07:00
6bcc1dce52
HDDS-1503. Reduce garbage generated by non-netty threads in datanode ratis server ( #813 )
2019-05-14 14:49:50 +05:30
02c9efcb81
HDDS-1491. Ozone KeyInputStream seek() should not read the chunk file. ( #795 )
2019-05-13 20:49:52 -07:00
389e640f0c
HADOOP-16161. NetworkTopology#getWeightUsingNetworkLocation return unexpected result. Contributed by He Xiaoqiao.
2019-05-13 11:46:16 -07:00
206e633946
YARN-9453. Clean up code long if-else chain in ApplicationCLI#run. Contributed by Wanqiang Ji.
2019-05-13 11:11:20 -07:00
29ff7fb140
YARN-9493. Scheduler Page does not display the right page by query string. Contributed by Wanqiang Ji.
2019-05-13 10:57:12 -07:00
5847e00143
HDFS-14245. [SBN read] Enable ObserverReadProxyProvider to work with non-ClientProtocol proxy types. Contributed by Erik Krogen.
2019-05-13 08:39:59 -07:00
1a47c2b7ae
YARN-9539.Improve cleanup process of app activities and make some conditions configurable. Contributed by Tao Yang.
2019-05-12 22:31:39 -07:00
ff27e8eabd
HADOOP-16251. ABFS: add FSMainOperationsBaseTest. Re-commit to fix git metadata.
...
Author: Da Zhou
2019-05-10 13:57:30 -07:00
5f1a34649f
Revert "HADOOP-16251. ABFS: add FSMainOperationsBaseTest"
...
This reverts commit 7c2d7c05a9
2019-05-10 13:55:56 -07:00
7c2d7c05a9
HADOOP-16251. ABFS: add FSMainOperationsBaseTest
...
Author: Da Zhou
2019-05-10 12:46:03 -07:00
36267b6f7c
SUBMARINE-52. [SUBMARINE-14] Generate Service spec + launch script for single-node PyTorch learning job. Contributed by Szilard Nemeth.
2019-05-10 23:40:17 +08:00
64c7f36ab1
YARN-9504. [UI2] Fair scheduler queue view page does not show actual capacity. Contributed by Zoltan Siegl.
2019-05-10 14:27:23 +05:30
b832e174b0
HDDS-1474. "ozone.scm.datanode.id" config should take path for a dir and not a file ( #809 )
2019-05-09 17:11:09 -07:00
1b48100a5e
YARN-9522. AppBlock ignores full qualified class name of PseudoAuthenticationHandler. Contributed by Prabhu Joseph.
2019-05-09 14:02:58 -07:00
591ca69823
HADOOP-16278. With S3A Filesystem, Long Running services End up Doing lot of GC and eventually die.
...
Contributed by Rajat Khandelwal
2019-05-09 21:13:29 +01:00
2d31ccc1b3
Revert "HDDS-1474. ozone.scm.datanode.id config should take path for a dir ( #792 )" ( #808 )
...
This reverts commit 18cca583ac
2019-05-09 11:18:46 -07:00
ec36126346
YARN-9483. DistributedShell does not release container when failed to localize at launch. Contributed by Prabhu Joseph.
2019-05-09 10:59:31 -07:00
Lokesh Jain
Inigo Goiri
Vivek Ratnavel Subramanian
avijayanhwx
Sunil G
sdeka
Bharat Viswanadham
Ben Roling
Zhankun Tang
Arpit Agarwal
Giovanni Matteo Fumarola
Srinivasu Majeti
Alexis Daboville
Siddharth
Eric Yang
Márton Elek
Sahil Takiar
Elek, Márton
Andrew Olson
David Mollitor
Shashikant Banerjee
Virajith Jalaparti
supratimdeka
bibinchundatt
Weiwei Yang
Hanisha Koneru
Erik Krogen
DadanielZ
Aaron Fabbri
Rajat Khandelwal