Commit Graph

21538 Commits

Author SHA1 Message Date
Sahil Takiar 618e009ac0 HDFS-14111. hdfsOpenFile on HDFS causes unnecessary IO from file offset 0. Contributed by Sahil Takiar.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-03-06 15:04:06 -08:00
Wei-Chiu Chuang 6192c1fe3b Revert "HDFS-14111. hdfsOpenFile on HDFS causes unnecessary IO from file offset 0. Contributed by Sahil Takiar."
This reverts commit f5a4b43a49.
2019-03-06 15:02:18 -08:00
Sahil Takiar f5a4b43a49 HDFS-14111. hdfsOpenFile on HDFS causes unnecessary IO from file offset 0. Contributed by Sahil Takiar.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-03-06 14:58:45 -08:00
Eric Yang 01ada40ea4 YARN-9348. Application catalog build system bug fixes.
Contributed by Eric Yang
2019-03-06 17:55:48 -05:00
Márton Elek 45f976fdcf
HDDS-1113. Remove default dependencies from hadoop-ozone project. Contributed by Elek, Marton.
Closes #490
2019-03-06 18:22:22 +01:00
Mukul Kumar Singh 2c3ec37738 HDDS-1210. Ratis pipeline creation doesn't check raft client reply status during initialization. Contributed by Mukul Kumar Singh. 2019-03-06 21:38:21 +05:30
Ajay Kumar 9d87247af3
HDDS-1216. Change name of ozoneManager service in docker compose files to om.
Closes #553
2019-03-06 15:18:39 +01:00
Lokesh Jain 129fd5dd18 HDDS-1208. ContainerStateMachine should set chunk data as state machine data for ratis. Contributed by Lokesh Jain. 2019-03-06 17:00:37 +05:30
Sunil G c79f139519 YARN-8803. [UI2] Show flow runs in the order of recently created time in graph widgets. Contributed by Akhil PB. 2019-03-06 16:49:08 +05:30
Sunil G 46045c5cb3 YARN-9138. Improve test coverage for nvidia-smi binary execution of GpuDiscoverer. Contributed by Szilard Nemeth. 2019-03-06 16:01:08 +05:30
Shashikant Banerjee 62e89dc275 HDDS-1184. Parallelization of write chunks in datanodes is broken. Contributed by Shashikant Banerjee. 2019-03-06 10:00:16 +05:30
Inigo Goiri 945b504c25 HDFS-14326. Add CorruptFilesCount to JMX. Contributed by Danny Becker. 2019-03-05 17:39:52 -08:00
Arpit Agarwal 1ad5bfc53f
HDDS-1188. Implement a skeleton patch for Recon server with initial set of interfaces. Contributed by Siddharth Wagle. 2019-03-05 15:54:29 -08:00
Elek, Márton 7f636b47b5 HDDS-919. Enable prometheus endpoints for Ozone datanodes (#502)
Pull request from Elek, Márton. (#502)
2019-03-05 12:04:57 -08:00
Bharat Viswanadham 313e8b9f13 HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule. (#534)
* HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule.
2019-03-05 11:46:36 -08:00
Anu Engineer 7fd890116a HDDS-1171. Add benchmark for OM and OM client in Genesis.
Contributed by Lokesh Jain.
2019-03-05 11:31:09 -08:00
Eric Yang 3c5b7136e2 HADOOP-16150. Added concat method to ChecksumFS as unsupported operation.
Contributed by Steve Loughran

(cherry picked from commit 8b517e7ad6)
2019-03-05 13:32:00 -05:00
Arpit Agarwal 3ef1235215
HDDS-1218. Do the dist-layout-stitching for Ozone after the test-compile phase. Contributed by Marton Elek. 2019-03-05 10:25:31 -08:00
Arpit Agarwal df99137310
Merge pull request #555 from elek/HDDS-1219
HDDS-1219. TestContainerActionsHandler.testCloseContainerAction has an intermittent failure
2019-03-05 10:19:05 -08:00
Arpit Agarwal 549d54f9a3
Merge pull request #556 from elek/HDDS-1222
HDDS-1222. Remove TestContainerSQLCli unit test stub
2019-03-05 10:15:55 -08:00
Hanisha Koneru 12402b7a74 HDDS-1072. Implement RetryProxy and FailoverProxy for OM client. 2019-03-05 09:24:22 -08:00
Eric Yang 7b42e0e32a YARN-7266. Fixed deadlock in Timeline Server thread initialization.
Contributed by Prabhu Joseph
2019-03-05 12:17:01 -05:00
Shashikant Banerjee 5fcea54a50 HDDS-935. Avoid creating an already created container on a datanode in case of disk removal followed by datanode restart. Contributed by Shashikant Banerjee. 2019-03-05 22:09:46 +05:30
Ajay Yadav 353b90d59e HDDS-1156. testDelegationToken is failing in TestSecureOzoneCluster. Contributed by Ajay Kumar. 2019-03-05 08:37:10 -08:00
Márton Elek 02da06dd9f
HDDS-1222. Remove TestContainerSQLCli unit test stub. Contributed by Elek, Marton. 2019-03-05 16:35:04 +01:00
Billie Rinaldi 2576401928 YARN-7129. Application Catalog for YARN applications. Contributed by Eric Yang 2019-03-05 06:14:14 -08:00
Stephen O'Donnell 686c0141ef
HADOOP-16140. hadoop fs expunge to add -immediate option to purge trash immediately.
Contributed by Stephen O'Donnell.

Signed-off-by: Steve Loughran <stevel@apache.org>
2019-03-05 14:09:00 +00:00
Da Zhou 05df151d09
HADOOP-16163. NPE in setup/teardown of ITestAbfsDelegationTokens.
Contributed by Da Zhou.

Signed-off-by: Steve Loughran <stevel@apache.org>
2019-03-05 14:02:34 +00:00
Vinayakumar B f940ab242d HDFS-7663. Erasure Coding: Append on striped file. Contributed by Ayush Saxena. 2019-03-05 19:26:42 +05:30
Márton Elek 296259e9b3
HDDS-1219. TestContainerActionsHandler.testCloseContainerAction has an intermittent failure. Contributed by Elek, Marton. 2019-03-05 13:45:47 +01:00
Yufei Gu 0aefe2846f YARN-9298. Implement FS placement rules using PlacementRule interface. Contributed by Wilfred Spiegelenburg. 2019-03-04 23:49:07 -08:00
Inigo Goiri 4b7313e640 HDFS-14336. Fix checkstyle for NameNodeMXBean. Contributed by Danny Becker. 2019-03-04 23:03:32 -08:00
Prabhu Joseph e40e2d6ad5
YARN-7243. Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-03-05 14:10:08 +09:00
coder-chenzhi fe7551f21b
HADOOP-16162. Remove unused Job Summary Appender configurations from log4j.properties
This closes #551

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-03-05 13:41:33 +09:00
David Mollitor 9fcd89ab93
HADOOP-16148. Cleanup LineReader Unit Test.
Contributed by David Mollitor.

Signed-off-by: Steve Loughran <stevel@apache.org>
2019-03-04 23:08:12 +00:00
Elek, Márton 90c37ac40d HDDS-623. On SCM UI, Node Manager info is empty (#523)
* HDDS-623. On SCM UI, Node Manager info is empty. Contributed by Elek, Marton.
2019-03-04 14:35:00 -08:00
Sahil Takiar cb0fa0ce3f HDFS-14321. Fix -Xcheck:jni issues in libhdfs, run ctest with -Xcheck:jni enabled. Contributed by Sahil Takiar.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-03-04 12:37:57 -08:00
Anu Engineer 10b802b84b HDDS-1136 : Add metric counters to capture the RocksDB checkpointing statistics.
Contributed by Aravindan Vijayan.
2019-03-04 12:00:16 -08:00
Wei-Chiu Chuang 387dbe587a HDFS-14314. fullBlockReportLeaseId should be reset after registering to NN. Contributed by star. 2019-03-04 10:43:44 -08:00
Xiaoyu Yao eed8b794d8 HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. (#545) 2019-03-04 10:37:26 -08:00
bibinchundatt 15098df744 Revert "YARN-8132. Final Status of applications shown as UNDEFINED in ATS app queries. Contributed by Prabhu Joseph."
This reverts commit a63c358b78.
2019-03-04 16:57:31 +05:30
Yiqun Lin 18ea0c1493 HDFS-14182. Datanode usage histogram is clicked to show ip list. Contributed by fengchuang. 2019-03-04 17:34:24 +08:00
Akira Ajisaka bd8d299ded
YARN-7477. Moving logging APIs over to slf4j in hadoop-yarn-common. Contributed by Prabhu Joseph. 2019-03-04 16:59:20 +09:00
Wei-Chiu Chuang 6c4d566955
Revert "HDFS-14261. Kerberize JournalNodeSyncer unit test. Contributed by Siyao Meng."
This reverts commit 5c10630ad8.
2019-03-04 16:59:20 +09:00
Weiwei Yang e20b5ef52c
YARN-9332. RackResolver tool should accept multiple hosts. Contributed by Lantao Jin. 2019-03-04 16:59:20 +09:00
Hanisha Koneru b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client."
This reverts commit 8e1225991d.
2019-03-04 16:58:59 +09:00
Erik Krogen fc17ba172b
HDFS-14272. [SBN read] Make ObserverReadProxyProvider initialize its state ID against the active NN on startup. Contributed by Erik Krogen. 2019-03-04 16:52:04 +09:00
Ajay Yadav 9e53088493 Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contr…" (#544)
* Revert "Fix checkstyle issue"

This reverts commit 78c8a3323e.

* Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao."

This reverts commit 6fef6fc5ee.
2019-03-01 16:19:43 -08:00
Xiaoyu Yao 78c8a3323e Fix checkstyle issue 2019-03-01 16:15:20 -08:00
Xiaoyu Yao 6fef6fc5ee HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. 2019-03-01 16:15:20 -08:00