Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
21,379 Commits 326 Branches 371 Tags
Commit Graph

21379 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mukul Kumar Singh
97fd3025a4 HDDS-1095. OzoneManager#openKey should do multiple block allocations in a single SCM rpc call. Contributed by Mukul Kumar Singh. 
(cherry picked from commit daf4660eebfa9267e7082f7c9a14c3dd5d6d5d46)
 2019-03-12 20:03:36 +05:30
Shashikant Banerjee
4373c12701 HDDS-1173. Fix a data corruption bug in BlockOutputStream. Contributed by Shashikant Banerjee. 
(cherry picked from commit b4aa24d3c5ad1b9309a58795e4b48e567695c4e4)
 2019-03-12 10:21:14 +05:30
Xiaoyu Yao
e673bebcfe HDDS-1245. OM delegation expiration time should use Time.now instead … (#587) 
Closes #587.

(cherry picked from commit c7307867f0d28dbb11e2194ff885da8269e4fb42)
 2019-03-11 21:20:57 -07:00
Ajay Yadav
6028aefb57 HDDS-596. Add robot test for OM Block Token. Contributed by Ajay Kumar. 
This closes (#581)

(cherry picked from commit 599e926d462134aa3235311feb27f3a8cdff6a51)
 2019-03-11 15:02:43 -07:00
Xiaoyu Yao
1050bf42fa HDDS-1236. Fix incorrect Ozone ClientProtocol KerberosInfo annotation. Contributed by Xiaoyu Yao. (#573) 
(cherry picked from commit 4fc493e511dacc41628925bdcb3506cd944346e6)
 2019-03-11 11:51:38 -07:00
Xiaoyu Yao
fe41e67ba4 Revert "HDDS-1236. Fix incorrect Ozone ClientProtocol KerberosInfo annotation. Contributed by Xiaoyu Yao. (#573)" 
This reverts commit 89fb60ffd07e0ea21c6fb431eacc9a575360fb93.
 2019-03-11 11:50:34 -07:00
Xiaoyu Yao
89fb60ffd0 HDDS-1236. Fix incorrect Ozone ClientProtocol KerberosInfo annotation. Contributed by Xiaoyu Yao. (#573) 
(cherry picked from commit 4fc493e511dacc41628925bdcb3506cd944346e6)
 2019-03-11 09:22:29 -07:00
Mukul Kumar Singh
5d67a17877 HDDS-1238. Fix Ratis Snapshot creation error if the snapshot file already exists in ContainerStateMachine. Contributed by Shashikant Banerjee. 
(cherry picked from commit 8458ced11e5b6690a41593c247c1190bf3f31c0b)
 2019-03-11 14:57:45 +05:30
Mukul Kumar Singh
aa9de9a0fa HDDS-1210. Ratis pipeline creation doesn't check raft client reply status during initialization. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 2c3ec37738544107238f75d0ca781fd23bdc309b)
 2019-03-11 14:57:45 +05:30
Lokesh Jain
60b5e178e3 HDDS-1220. KeyManager#openKey should release the bucket lock before doing an allocateBlock. Contributed by Lokesh Jain. 
(cherry picked from commit ebb5fa115b842a3bcb747e881ca2a8fe4c716d07)
 2019-03-11 14:56:51 +05:30
Bharat Viswanadham
e65717af25
HDDS-1242. In S3 when bucket already exists, it should just return location. 
(cherry picked from commit 73e1801b2db928d165e4cf076e1ba50ec1e8b48a)
 2019-03-09 21:48:46 -08:00
Xiaoyu Yao
49217971b5 HDDS-1235. BaseHttpServer NPE is HTTP policy is HTTPS_ONLY. Contributed by Xiaoyu Yao. 
Closes #572

(cherry picked from commit 11db46956c6062a986caf9009d3e36049e5830d4)
 2019-03-09 09:40:05 -08:00
Ajay Yadav
6465125a5a HDDS-594. SCM CA: DN sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar. (#547) 
(cherry picked from commit 064f38b3a51be5f99a0ba09d0d48c11286017017)
 2019-03-09 09:40:00 -08:00
Elek, Márton
118986cde7
HDDS-1213. Support plain text S3 MPU initialization request. 
(cherry picked from commit c072458e5d1ec88c8e4d76cd09623083b8ccfc03)
 2019-03-08 10:15:30 -08:00
Lokesh Jain
c334bc8baf HDDS-1208. ContainerStateMachine should set chunk data as state machine data for ratis. Contributed by Lokesh Jain. 
(cherry picked from commit 129fd5dd18dce0fba48561326a48082888bd6f83)
 2019-03-08 09:02:41 +05:30
Vivek Ratnavel Subramanian
62ab3425dc
HDDS-1226. ozone-filesystem jar missing in hadoop classpath 
Closes #560

(cherry picked from commit 475011bbf8b58a10457fe0c68a8e18edc5bf1623)
 2019-03-07 14:46:01 +01:00
Vivek Ratnavel Subramanian
67a26ac793
HDDS-1093. Configuration tab in OM/SCM ui is not displaying the correct values. 
(cherry picked from commit a55fc362999f269efa1b6304438148aef3c03ed8)
 2019-03-07 14:45:51 +01:00
Márton Elek
9cd3fe49cf
HDDS-1113. Remove default dependencies from hadoop-ozone project. Contributed by Elek, Marton. 
Closes #490

(cherry picked from commit 45f976fdcf1d8cbcdcbcc4783c9f13fddae1c429)
 2019-03-07 14:44:34 +01:00
Ajay Kumar
5502da4ae2
HDDS-1216. Change name of ozoneManager service in docker compose files to om. 
Closes #553

(cherry picked from commit 9d87247af30757fbf521a4b432149846790364c5)
 2019-03-07 14:41:28 +01:00
Márton Elek
a50ffd8d05
HDDS-1222. Remove TestContainerSQLCli unit test stub. Contributed by Elek, Marton. 2019-03-07 14:35:59 +01:00
Márton Elek
ab5da9a984
HDDS-1219. TestContainerActionsHandler.testCloseContainerAction has an intermittent failure. Contributed by Elek, Marton. 2019-03-07 14:35:51 +01:00
Shashikant Banerjee
8655abb353 HDDS-1184. Parallelization of write chunks in datanodes is broken. Contributed by Shashikant Banerjee. 
(cherry picked from commit 62e89dc275f120f54967744393e2ddde15575096)
 2019-03-07 14:29:38 +05:30
Shashikant Banerjee
b99ae7b4e2 HDDS-935. Avoid creating an already created container on a datanode in case of disk removal followed by datanode restart. Contributed by Shashikant Banerjee. 
(cherry picked from commit 5fcea54a50753a37b61f0e3c6be5a0236f95861a)
 2019-03-07 14:26:38 +05:30
Elek, Márton
8d906d7217 HDDS-919. Enable prometheus endpoints for Ozone datanodes (#502) 
Pull request from Elek, Márton. (#502)

(cherry picked from commit 7f636b47b5e430e340c8fd731fd9e35e22f9ddbf)
 2019-03-05 12:15:56 -08:00
Anu Engineer
6eb79815fa HDDS-1171. Add benchmark for OM and OM client in Genesis. 
Contributed by Lokesh Jain.

(cherry picked from commit 7fd890116ab941d51b28cf84b01330b6e33c9b18)
 2019-03-05 11:55:26 -08:00
Bharat Viswanadham
4cf50e3972 HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule. (#534) 
* HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule.

(cherry picked from commit 313e8b9f1344da376de2b0e899e78e384f37ff35)
 2019-03-05 11:48:52 -08:00
Arpit Agarwal
c57e1ddd63
HDDS-1218. Do the dist-layout-stitching for Ozone after the test-compile phase. Contributed by Marton Elek. 
(cherry picked from commit 3ef1235215c68e9f0aff8e17643c52838fa363a3)
 2019-03-05 10:27:15 -08:00
Elek, Márton
f4918acdae HDDS-623. On SCM UI, Node Manager info is empty (#523) 
* HDDS-623. On SCM UI, Node Manager info is empty. Contributed by Elek, Marton.

(cherry picked from commit 90c37ac40de5827335b4f739e6330e1d3558971e)
 2019-03-05 09:35:52 -08:00
Ajay Yadav
c3986dc53b
HDDS-1156. testDelegationToken is failing in TestSecureOzoneCluster. Contributed by Ajay Kumar. 
(cherry picked from commit 353b90d59e3583a73a76db550d47aa86b3f36d5d)
 2019-03-05 08:39:45 -08:00
Wei-Chiu Chuang
387dbe587a HDFS-14314. fullBlockReportLeaseId should be reset after registering to NN. Contributed by star. 2019-03-04 10:43:44 -08:00
Xiaoyu Yao
eed8b794d8 HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. (#545) 2019-03-04 10:37:26 -08:00
bibinchundatt
15098df744 Revert "YARN-8132. Final Status of applications shown as UNDEFINED in ATS app queries. Contributed by Prabhu Joseph." 
This reverts commit a63c358b78ad1d4765d7f0b2d595c49b693efb3f.
 2019-03-04 16:57:31 +05:30
Yiqun Lin
18ea0c1493 HDFS-14182. Datanode usage histogram is clicked to show ip list. Contributed by fengchuang. 2019-03-04 17:34:24 +08:00
Akira Ajisaka
bd8d299ded
YARN-7477. Moving logging APIs over to slf4j in hadoop-yarn-common. Contributed by Prabhu Joseph. 2019-03-04 16:59:20 +09:00
Wei-Chiu Chuang
6c4d566955
Revert "HDFS-14261. Kerberize JournalNodeSyncer unit test. Contributed by Siyao Meng." 
This reverts commit 5c10630ad8c976380491adec8e2d9f3e49ea8fa9.
 2019-03-04 16:59:20 +09:00
Weiwei Yang
e20b5ef52c
YARN-9332. RackResolver tool should accept multiple hosts. Contributed by Lantao Jin. 2019-03-04 16:59:20 +09:00
Hanisha Koneru
b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client." 
This reverts commit 8e1225991d8da7d6801fc3753319139873f23bc9.
 2019-03-04 16:58:59 +09:00
Erik Krogen
fc17ba172b
HDFS-14272. [SBN read] Make ObserverReadProxyProvider initialize its state ID against the active NN on startup. Contributed by Erik Krogen. 2019-03-04 16:52:04 +09:00
Ajay Yadav
9e53088493 Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contr…" (#544) 
* Revert "Fix checkstyle issue"

This reverts commit 78c8a3323ea31afe7512d41a1bde0d0103c64622.

* Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao."

This reverts commit 6fef6fc5ee5d9b72ba659d6a4289f571e1eabf1c.
 2019-03-01 16:19:43 -08:00
Xiaoyu Yao
78c8a3323e Fix checkstyle issue 2019-03-01 16:15:20 -08:00
Xiaoyu Yao
6fef6fc5ee HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. 2019-03-01 16:15:20 -08:00
Ajay Kumar
4a3cddea70 HDDS-134. SCM CA: OM sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar. 2019-03-01 15:41:09 -08:00
Ajay Yadav
8b72aea5c7
Merge pull request #542 from xiaoyuyao/HDDS-1204 
HDDS-1204. Fix ClassNotFound issue with javax.xml.bind.DatatypeConver…
 2019-03-01 12:18:29 -08:00
Suma Shivaprasad
cab8529ecb YARN-7904. Privileged, trusted containers should be supported only in ENTRYPOINT mode. Contributed by Eric Yang. 2019-03-01 11:06:09 -08:00
Xiaoyu Yao
eea40cb88a
HDDS-1204. Fix ClassNotFound issue with javax.xml.bind.DatatypeConverter used by DefaultProfile. Contributed by Xiaoyu Yao. 2019-03-01 10:49:39 -08:00
Shashikant Banerjee
de1dae64f2 HDDS-726. Ozone Client should update SCM to move the container out of allocation path in case a write transaction fails. Contributed by Shashikant Banerjee. 2019-03-01 23:30:28 +05:30
Inigo Goiri
80b77deb42 HDFS-14247. Repeat adding node description into network topology. Contributed by HuangTao. 2019-03-01 09:18:51 -08:00
Sunil G
dcaca19871 YARN-9139. Simplify initializer code of GpuDiscoverer. Contributed by Szilard Nemeth. 2019-03-01 19:24:35 +05:30
Hanisha Koneru
8e1225991d HDDS-1072. Implement RetryProxy and FailoverProxy for OM client. 2019-03-01 00:27:39 -08:00
Brahma Reddy Battula
7a0db2f92b HDFS-13997. Secondary NN Web UI displays nothing, and the console log shows moment is not defined. Contributed by Ayush Saxena 2019-03-01 12:24:52 +05:30