Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
21,361 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

21361 Commits

Author SHA1 Message Date
Ajay Kumar 5502da4ae2
HDDS-1216. Change name of ozoneManager service in docker compose files to om. 
Closes #553

(cherry picked from commit 9d87247af3)
 2019-03-07 14:41:28 +01:00
Márton Elek a50ffd8d05
HDDS-1222. Remove TestContainerSQLCli unit test stub. Contributed by Elek, Marton. 2019-03-07 14:35:59 +01:00
Márton Elek ab5da9a984
HDDS-1219. TestContainerActionsHandler.testCloseContainerAction has an intermittent failure. Contributed by Elek, Marton. 2019-03-07 14:35:51 +01:00
Shashikant Banerjee 8655abb353 HDDS-1184. Parallelization of write chunks in datanodes is broken. Contributed by Shashikant Banerjee. 
(cherry picked from commit 62e89dc275)
 2019-03-07 14:29:38 +05:30
Shashikant Banerjee b99ae7b4e2 HDDS-935. Avoid creating an already created container on a datanode in case of disk removal followed by datanode restart. Contributed by Shashikant Banerjee. 
(cherry picked from commit 5fcea54a50)
 2019-03-07 14:26:38 +05:30
Elek, Márton 8d906d7217 HDDS-919. Enable prometheus endpoints for Ozone datanodes (#502) 
Pull request from Elek, Márton. (#502)

(cherry picked from commit 7f636b47b5)
 2019-03-05 12:15:56 -08:00
Anu Engineer 6eb79815fa HDDS-1171. Add benchmark for OM and OM client in Genesis. 
Contributed by Lokesh Jain.

(cherry picked from commit 7fd890116a)
 2019-03-05 11:55:26 -08:00
Bharat Viswanadham 4cf50e3972 HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule. (#534) 
* HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule.

(cherry picked from commit 313e8b9f13)
 2019-03-05 11:48:52 -08:00
Arpit Agarwal c57e1ddd63
HDDS-1218. Do the dist-layout-stitching for Ozone after the test-compile phase. Contributed by Marton Elek. 
(cherry picked from commit 3ef1235215)
 2019-03-05 10:27:15 -08:00
Elek, Márton f4918acdae HDDS-623. On SCM UI, Node Manager info is empty (#523) 
* HDDS-623. On SCM UI, Node Manager info is empty. Contributed by Elek, Marton.

(cherry picked from commit 90c37ac40d)
 2019-03-05 09:35:52 -08:00
Ajay Yadav c3986dc53b
HDDS-1156. testDelegationToken is failing in TestSecureOzoneCluster. Contributed by Ajay Kumar. 
(cherry picked from commit 353b90d59e)
 2019-03-05 08:39:45 -08:00
Wei-Chiu Chuang 387dbe587a HDFS-14314. fullBlockReportLeaseId should be reset after registering to NN. Contributed by star. 2019-03-04 10:43:44 -08:00
Xiaoyu Yao eed8b794d8 HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. (#545) 2019-03-04 10:37:26 -08:00
bibinchundatt 15098df744 Revert "YARN-8132. Final Status of applications shown as UNDEFINED in ATS app queries. Contributed by Prabhu Joseph." 
This reverts commit a63c358b78.
 2019-03-04 16:57:31 +05:30
Yiqun Lin 18ea0c1493 HDFS-14182. Datanode usage histogram is clicked to show ip list. Contributed by fengchuang. 2019-03-04 17:34:24 +08:00
Akira Ajisaka bd8d299ded
YARN-7477. Moving logging APIs over to slf4j in hadoop-yarn-common. Contributed by Prabhu Joseph. 2019-03-04 16:59:20 +09:00
Wei-Chiu Chuang 6c4d566955
Revert "HDFS-14261. Kerberize JournalNodeSyncer unit test. Contributed by Siyao Meng." 
This reverts commit 5c10630ad8.
 2019-03-04 16:59:20 +09:00
Weiwei Yang e20b5ef52c
YARN-9332. RackResolver tool should accept multiple hosts. Contributed by Lantao Jin. 2019-03-04 16:59:20 +09:00
Hanisha Koneru b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client." 
This reverts commit 8e1225991d.
 2019-03-04 16:58:59 +09:00
Erik Krogen fc17ba172b
HDFS-14272. [SBN read] Make ObserverReadProxyProvider initialize its state ID against the active NN on startup. Contributed by Erik Krogen. 2019-03-04 16:52:04 +09:00
Ajay Yadav 9e53088493 Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contr…" (#544) 
* Revert "Fix checkstyle issue"

This reverts commit 78c8a3323e.

* Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao."

This reverts commit 6fef6fc5ee.
 2019-03-01 16:19:43 -08:00
Xiaoyu Yao 78c8a3323e Fix checkstyle issue 2019-03-01 16:15:20 -08:00
Xiaoyu Yao 6fef6fc5ee HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. 2019-03-01 16:15:20 -08:00
Ajay Kumar 4a3cddea70 HDDS-134. SCM CA: OM sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar. 2019-03-01 15:41:09 -08:00
Ajay Yadav 8b72aea5c7
Merge pull request #542 from xiaoyuyao/HDDS-1204 
HDDS-1204. Fix ClassNotFound issue with javax.xml.bind.DatatypeConver…
 2019-03-01 12:18:29 -08:00
Suma Shivaprasad cab8529ecb YARN-7904. Privileged, trusted containers should be supported only in ENTRYPOINT mode. Contributed by Eric Yang. 2019-03-01 11:06:09 -08:00
Xiaoyu Yao eea40cb88a
HDDS-1204. Fix ClassNotFound issue with javax.xml.bind.DatatypeConverter used by DefaultProfile. Contributed by Xiaoyu Yao. 2019-03-01 10:49:39 -08:00
Shashikant Banerjee de1dae64f2 HDDS-726. Ozone Client should update SCM to move the container out of allocation path in case a write transaction fails. Contributed by Shashikant Banerjee. 2019-03-01 23:30:28 +05:30
Inigo Goiri 80b77deb42 HDFS-14247. Repeat adding node description into network topology. Contributed by HuangTao. 2019-03-01 09:18:51 -08:00
Sunil G dcaca19871 YARN-9139. Simplify initializer code of GpuDiscoverer. Contributed by Szilard Nemeth. 2019-03-01 19:24:35 +05:30
Hanisha Koneru 8e1225991d HDDS-1072. Implement RetryProxy and FailoverProxy for OM client. 2019-03-01 00:27:39 -08:00
Brahma Reddy Battula 7a0db2f92b HDFS-13997. Secondary NN Web UI displays nothing, and the console log shows moment is not defined. Contributed by Ayush Saxena 2019-03-01 12:24:52 +05:30
Bharat Viswanadham 77b23c816e
HDDS-1182. Pipeline Rule where at least one datanode is reported in the pipeline. 2019-02-28 21:41:36 -08:00
Anu Engineer eae3db9649 HDDS-1191. Replace Ozone Rest client with S3 client in smoketests and docs. 
Contributed Elek, Marton.
 2019-02-28 17:14:47 -08:00
Bharat Viswanadham eae8819fd2
HDDS-1187. Healthy pipeline Chill Mode rule to consider only pipelines with replication factor three. 2019-02-28 17:03:39 -08:00
Ajay Kumar 0d61facd37 HADOOP-15889. Add hadoop.token configuration parameter to load tokens. Contributed by Íñigo Goiri 2019-02-28 10:34:28 -08:00
Inigo Goiri 05e4ddeee6 HDFS-14324. Fix TestDataNodeVolumeFailure. Contributed by Ayush Saxena. 2019-02-28 10:03:05 -08:00
Erik Krogen 0feba4396f HDFS-14305. Fix serial number calculation in BlockTokenSecretManager to avoid token key ID overlap between NameNodes. Contributed by He Xiaoqiao. 2019-02-28 08:48:10 -08:00
Xiaoyu Yao 3a8118b480
HDDS-1190. Fix jdk 11 issue for ozonesecure base image and docker-compose . Contributed by Xiaoyu Yao. 2019-02-28 15:51:08 +01:00
Steve Loughran 65f60e56b0
HADOOP-16068. ABFS Authentication and Delegation Token plugins to optionally be bound to specific URI of the store. 
Contributed by Steve Loughran.
 2019-02-28 14:22:32 +00:00
Márton Elek 84c4966a5a
HADOOP-16067. Incorrect Format Debug Statement KMSACLs. Contributed by Charan Hebri. 2019-02-28 12:15:47 +01:00
Szilard Nemeth 538bb4880d YARN-9323. FSLeafQueue#computeMaxAMResource does not override zero values for custom resources 
(Contributed by Szilard Nemeth via Daniel Templeton)

Change-Id: Id844ccf09488f367c0c7de0a3b2d4aca1bba31cc
 2019-02-27 19:59:48 -08:00
Szilard Nemeth 7b928f19a4 YARN-9322. Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo 
(Contributed by Szilard Nemeth via Daniel Templeton)

Change-Id: I14c12f1265999d62102f2ec5506d90015efeefe8
 2019-02-27 19:43:50 -08:00
Weiwei Yang 1779fc57a1 YARN-9324. TestSchedulingRequestContainerAllocation(Async) fails with junit-4.11. Contributed by Prabhu Joseph. 2019-02-28 09:56:29 +08:00
Ajay Kumar cbf82fabf0 HDDS-1061. DelegationToken: Add certificate serial id to Ozone Delegation Token Identifier. Contributed by Ajay Kumar. 2019-02-27 17:00:42 -08:00
Eric Yang 04b228e43b YARN-9334. Allow YARN Service client to send SPNEGO challenge header when authentication type is not simple. 
Contributed by Billie Rinaldi
 2019-02-27 18:47:14 -05:00
Vrushali C ea3cdc60b3 YARN-3841 [atsv2 Storage implementation] Adding retry semantics to HDFS backing storage. Contributed by Abhishek Modi. 2019-02-27 14:55:35 -08:00
Vrushali C 0ec962ac8f YARN-5336 Limit the flow name size & consider cleanup for hex chars. Contributed by Sushil Ks 2019-02-27 14:43:39 -08:00
Eric Yang feccd282fe HADOOP-16107. Update ChecksumFileSystem createFile/openFile API to generate checksum. 
Contributed by Steve Loughran
 2019-02-27 15:53:41 -05:00
Steve Loughran 5b43e42d0c HADOOP-16149 hadoop-mapreduce-client-app build not converging due to transient dependencies 
Change-Id: If95b12b223770b057041f99f0f8fd8ba370c377f
 2019-02-27 12:44:46 -08:00