49c5e8ac24
HDDS-1672. Improve locking in OzoneManager. ( #1016 )
2019-06-28 14:05:19 -07:00
4848280437
HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. ( #956 )
2019-06-26 18:04:12 -07:00
0a37ccf379
HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist ( #1013 )
2019-06-26 11:44:49 -07:00
a79bdf760e
HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. ( #1014 )
2019-06-25 17:12:45 -07:00
4b50981cfa
HDDS-1709. TestScmSafeNode is flaky.
...
Contributed by Elek, Marton.
2019-06-25 13:57:01 -07:00
049bb42760
HDDS-1723. Create new OzoneManagerLock class. ( #1006 )
...
* HDDS-1723. Create new OzoneManagerLock class.
* add logs
* fix exception message
* add license
* fix findbug
* throw exception when acquiring 2nd lock failed.
* fix review comments
* fix missed review comment
* fix checkstyle
* fix review comments
2019-06-25 08:48:03 -07:00
d023f1f864
HDDS-1646. Support real persistence in the k8s example files ( #945 )
...
* HDDS-1646. Support real persistence in the k8s example files
* ephemeral clusters can be scaled up
2019-06-24 12:02:35 -07:00
004207996c
HDDS-1597. Remove hdds-server-scm dependency from ozone-common ( #969 )
...
* HDDS-1597. Remove hdds-server-scm dependency from ozone-common. Contributed by Elek, Marton.
* checkstyle fixes
* revert the import reorder of HddsUtil
* add javadoc
* switch back to the commons-lang2
* fix typo
* fix metrics core classpath problem (+rebase fix)
2019-06-24 11:56:04 -07:00
cba13c7f83
HDDS-1715. Update the Intellij runner definitition of SCM to use the new class name
...
Closes #1000
2019-06-21 16:25:10 +02:00
256bdd6982
HDDS-1678. Default image name for kubernetes examples should be ozone and not hadoop
...
Closes #959
2019-06-21 14:14:06 +02:00
d9a9e9913e
HDDS-1579. Create OMDoubleBuffer metrics. ( #871 )
2019-06-20 09:42:45 -07:00
9c4b15d2f4
HDDS-1508. Provide example k8s deployment files for the new CSI server
...
Closes #905
2019-06-20 16:36:42 +02:00
2dfa932818
HDDS-1684. OM should create Ratis related dirs only if ratis is enabled ( #965 )
2019-06-18 16:08:48 -07:00
37bd5bb342
HDDS-1702. Optimize Ozone Recon build time ( #982 )
2019-06-18 14:44:23 -07:00
fb1ce0d50a
HDDS-1670. Add limit support to /api/containers and /api/containers/{id} endpoints ( #954 )
2019-06-18 08:51:16 -07:00
3d020e914f
HDDS-1532. Improve the concurrent testing framework of Freon. ( #957 )
2019-06-17 11:09:05 -07:00
22b36dd311
HDDS-1660. Use Picocli for Ozone Manager
...
Closes #925
2019-06-17 14:13:50 +02:00
e70aeb4d7e
HDDS-1601. Implement updating lastAppliedIndex after buffer flush to OM DB. ( #972 )
2019-06-15 13:47:07 -07:00
89acbbc0b9
HDDS-1677. Auditparser robot test shold use a world writable working directory ( #958 )
2019-06-13 16:04:14 -07:00
940bcf01cd
HDDS-1587. Support dynamically adding delegated classes from to isolated class loader. Contributed by Junjie Chen. ( #942 )
2019-06-12 20:08:15 -07:00
88c53d516c
HDDS-1620. Implement Volume Write Requests to use Cache and DoubleBuffer. ( #884 )
2019-06-12 17:45:42 -07:00
a43f4440f7
HDDS-1543. Implement addAcl,removeAcl,setAcl,getAcl for Prefix. Contr… ( #927 )
2019-06-12 16:25:31 -07:00
1732312f45
HDDS-1663. Add datanode to network topology cluster during node regis… ( #937 )
2019-06-12 12:16:42 -07:00
3b31694c35
HDDS-1545. Cli to add,remove,get and delete acls for Ozone objects. Contributed by Ajay Kumar. ( #920 )
2019-06-12 06:51:34 -07:00
96e1e41746
HDDS-1627. Make the version of the used hadoop-runner configurable ( #886 )
2019-06-11 11:18:12 -07:00
3c9a5e7b16
HDDS-1635. Maintain docker entrypoint and envtoconf inside ozone project ( #894 )
2019-06-11 11:12:05 -07:00
f918e3fe62
HDDS-1669. SCM startup is failing if network-topology-default.xml is part of a jar
...
Closes #946
2019-06-11 19:30:22 +02:00
b05747901f
HDDS-1662. Missing test resources of integrataion-test project in target directory after compile
...
Closes #933
2019-06-11 12:25:42 +02:00
9deac3b6bf
HDDS-1657. Fix parallelStream usage in volume and key native acl. Contributed by Ajay Kumar. ( #926 )
2019-06-07 21:47:14 -07:00
46b23c11b0
HDDS-1636. Tracing id is not propagated via async datanode grpc call ( #895 )
2019-06-07 20:40:32 -07:00
85479577da
HDDS-1622. Use picocli for StorageContainerManager
...
Closes #918
2019-06-07 17:50:57 +02:00
a91d24fea4
HDDS-1496. Support partial chunk reads and checksum verification ( #804 )
2019-06-06 19:44:40 -07:00
0b115b60b0
HDDS-1371. OMSnapshotProvider to download DB checkpoint from leader OM. ( #703 )
2019-06-06 19:42:34 -07:00
8ca58efeec
HDDS-1490. Support configurable container placement policy through 'o… ( #903 )
2019-06-06 12:14:47 -07:00
76c0183ae3
HDDS-1652. HddsDispatcher should not shutdown volumeSet. Contributed by Xiaoyu Yao. ( #916 )
2019-06-06 23:47:59 +05:30
0b8a2608e0
HDDS-1605. Implement AuditLogging for OM HA Bucket write requests. ( #867 )
2019-06-06 10:13:36 -07:00
36757ad6a9
HDDS-1645. Change the version of Pico CLI to the latest 3.x release - 3.9.6
...
Closes #909
2019-06-06 16:00:00 +02:00
f7c77b395f
HDDS-1458. Create a maven profile to run fault injection tests. Contributed by Eric Yang.
2019-06-06 12:24:13 +02:00
3b1c2577d7
HDDS-1541. Implement addAcl,removeAcl,setAcl,getAcl for Key. Contributed by Ajay Kumat. ( #885 )
2019-06-05 14:42:10 -07:00
42cd861be0
HDDS-1628. Fix the execution and return code of smoketest executor shell script
...
Closes #902
2019-06-05 14:04:17 +02:00
ef2da40a70
HDDS-1640. Reduce the size of recon jar file
...
Closes #907
2019-06-05 07:51:23 +02:00
1a78794227
HDDS-1624 : Refactor operations inside the bucket lock in OM key write. ( #882 )
2019-06-04 15:41:37 -07:00
580b639908
HDDS-1600. Add userName and IPAddress as part of OMRequest. ( #857 )
2019-06-04 12:31:44 -07:00
97607f3dce
HDDS-1510. Classpath files are deployed to the maven repository as pom/jar files. Contributed by Elek, Marton. ( #900 )
2019-06-04 10:38:37 -07:00
e4b4fec66f
HDDS-1224. Restructure code to validate the response from server in the Read path ( #806 )
2019-06-04 10:37:02 -07:00
50909a7aa0
HDDS-1641. Csi server fails because transitive Netty dependencies ( #906 )
2019-06-04 09:18:15 -05:00
5d5081eff8
HDDS-1631. Fix auditparser smoketests ( #892 )
2019-06-04 01:30:43 -05:00
e140a45046
HDDS-1629. Tar file creation can be optional for non-dist builds. Contributed by Elek, Marton. ( #887 )
2019-06-04 01:20:45 -05:00
1fc359fc10
HDDS-1607. Create smoketest for non-secure mapreduce example ( #869 )
...
* HDDS-1607. Create smoketest for non-secure mapreduce example.
* remove hardcoded project version
2019-06-04 01:18:02 -05:00
21de9af903
HDDS-1625 : ConcurrentModificationException when SCM has containers of different owners. ( #883 )
2019-06-04 01:15:04 +05:30
f3271126fc
HDDS-1558. IllegalArgumentException while processing container Reports.
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-06-04 00:59:02 +05:30
2a97a37d9e
Revert "HDDS-1597. Remove hdds-server-scm dependency from ozone-common. ( #860 )"
...
This reverts commit baee71551d
2019-06-03 08:34:19 +02:00
c1d2d92187
HDDS-1540. Implement addAcl,removeAcl,setAcl,getAcl for Bucket. Contributed by Ajay Kumar. ( #874 )
2019-05-31 14:08:28 -07:00
1ae062c818
HDDS-1382. Create customized CSI server for Ozone
...
Closes #693
2019-05-31 13:35:58 +02:00
219e286722
HDDS-1608. Support Ozone Prefix ACLs in OM metadata table. Contributed by Xiaoyu Yao. ( #875 )
2019-05-30 16:44:38 -07:00
c965f7f499
HDDS-1551. Implement Bucket Write Requests to use Cache and DoubleBuffer. ( #850 )
2019-05-30 15:28:15 -07:00
baee71551d
HDDS-1597. Remove hdds-server-scm dependency from ozone-common. ( #860 )
2019-05-30 09:20:16 -07:00
1b041d4fd4
HDDS-1497. Refactor blockade Tests. Contributed by Nilotpal Nandi.
2019-05-30 16:46:06 +02:00
8c8cb2d6aa
HDDS-1502. Fix the compilation issue with commit 18c1eebc08.
2019-05-30 18:44:22 +05:30
18c1eebc08
HDDS-1502. Add metrics for Ozone Ratis performance.Contributed by Shashikant Banerjee( #833 ).
2019-05-30 16:17:45 +05:30
12be6ff2ff
HDDS-1539. Implement addAcl,removeAcl,setAcl,getAcl for Volume. Contributed Ajay Kumar. ( #847 )
2019-05-29 23:18:06 -07:00
9ad7cad205
HDDS-1530. Freon support big files larger than 2GB and add --bufferSize and --validateWrites options. Contributed by Xudong Cao. ( #830 )
2019-05-29 15:57:48 -07:00
0ead2090a6
HDDS-1542. Create Radix tree to support ozone prefix ACLs. Contributed by Xiaoyu Yao.
2019-05-29 22:39:27 +02:00
afd844059c
HADOOP-16331. Fix ASF License check in pom.xml
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-05-29 17:25:13 +09:00
7f2e87a419
HDDS-1604. ContainerReader#initializeUsedBytes leaks DB reference. Co… ( #866 )
2019-05-28 18:39:23 -07:00
79d14d0d42
HDDS-1341. TestContainerReplication#testContainerReplication fails intermittently. Contributed by Elek, Marton. ( #862 )
2019-05-28 14:40:45 -07:00
fb0b39f4bf
HDDS-1536. testSCMSafeModeRestrictedOp is failing consistently. Contributed by Xiaoyu Yao. ( #865 )
2019-05-28 14:02:36 -07:00
06fa4d2764
HDDS-1565. Rename k8s-dev and k8s-dev-push profiles to docker and docker-push.
...
Closes : #840
2019-05-28 16:53:54 +02:00
72dd79015a
HDDS-1534. freon should return non-zero exit code on failure. Contributed by Nilotpal Nandi.
2019-05-28 07:52:56 +05:30
83549dbbea
HDDS-1509. TestBlockOutputStreamWithFailures#test2DatanodesFailure fails intermittently. Contributed by Shashikant Banerjee ( #805 ).
2019-05-27 16:31:44 +05:30
f0e44b3a3f
HDDS-1584. Fix TestFailureHandlingByClient tests. Contributed by Shashikant Banerjee ( #845 ).
2019-05-27 16:26:21 +05:30
a3745c59a3
HDDS-1588. Update Ozone dist image to use jdk11. Contributed by Eric Yang.
2019-05-27 10:18:42 +02:00
9f933e6446
HADOOP-16323. https everywhere in Maven settings.
2019-05-27 15:24:59 +09:00
6d0e79c121
HDDS-1512. Implement DoubleBuffer in OzoneManager. ( #810 )
2019-05-24 10:50:54 -07:00
4b099b8b89
HDDS-1501 : Create a Recon task interface to update internal DB on updates from OM. ( #819 )
2019-05-23 15:34:55 -07:00
9c61494c02
HDDS-1065. OM and DN should persist SCM certificate as the trust root. Contributed by Ajay Kumar. ( #834 )
2019-05-22 11:47:32 -07:00
2fc6f8599a
HDDS-1449. JVM Exit in datanode while committing a key. Contributed by Mukul Kumar Singh. ( #825 )
2019-05-22 17:18:40 +05:30
77c49f2963
HDDS-1406. Avoid usage of commonPool in RatisPipelineUtils. ( #714 )
2019-05-21 18:41:30 -07:00
ef1cc725b8
HDDS-1538. Update ozone protobuf message for ACLs. Contributed by Ajay Kumar. ( #828 )
2019-05-21 15:53:40 -07:00
ff5691ca06
HDDS-1442. add spark container to ozonesecure-mr compose files
...
Closes #746
2019-05-21 17:10:46 +02:00
c1d7d68c78
HDDS-1461. Optimize listStatus api in OzoneFileSystem ( #782 )
2019-05-21 14:47:48 +05:30
05db2a598e
HDDS-1487. Bootstrap React framework for Recon UI ( #831 )
...
HDDS-1487. Bootstrap React framework for Recon UI.
Contributed by Vivek Ratnavel Subramanian.
2019-05-20 22:09:58 +02:00
0d1d7c86ec
HDDS-1499. OzoneManager Cache. ( #798 )
2019-05-19 19:23:02 -07:00
c183bd8e20
HDDS-1527. HDDS Datanode start fails due to datanode.id file read error. Contributed by Siddharth Wagle.
...
This closes #822 .
2019-05-16 15:13:10 -07:00
b7de735159
HDDS-1522. Provide intellij runConfiguration for Ozone components. Contributed by Elek, Marton.
2019-05-16 16:38:50 +02:00
9569015802
HDDS-1511. Space tracking for Open Containers in HDDS Volumes. Contributed by Supratim Deka ( #812 )
2019-05-15 10:26:01 -07:00
6bcc1dce52
HDDS-1503. Reduce garbage generated by non-netty threads in datanode ratis server ( #813 )
2019-05-14 14:49:50 +05:30
02c9efcb81
HDDS-1491. Ozone KeyInputStream seek() should not read the chunk file. ( #795 )
2019-05-13 20:49:52 -07:00
b832e174b0
HDDS-1474. "ozone.scm.datanode.id" config should take path for a dir and not a file ( #809 )
2019-05-09 17:11:09 -07:00
2d31ccc1b3
Revert "HDDS-1474. ozone.scm.datanode.id config should take path for a dir ( #792 )" ( #808 )
...
This reverts commit 18cca583ac
2019-05-09 11:18:46 -07:00
18cca583ac
HDDS-1474. ozone.scm.datanode.id config should take path for a dir ( #792 )
2019-05-09 10:23:44 -07:00
25951255ce
HDDS-1500. Allocate block failures in client should print exception trace. Contributed by Aravindan Vijayan ( #801 ).
2019-05-09 15:38:49 +05:30
c4be3ea276
HDDS-1489. Unnecessary log messages on console with Ozone shell. ( #797 )
2019-05-07 14:48:39 -07:00
eb9c8900bc
HDDS-1475 : Fix OzoneContainer start method. ( #788 )
2019-05-07 14:09:41 -07:00
7f0e2c67e0
HDDS-1395. Key write fails with BlockOutputStream has been closed exception ( #749 ). Contributed by Shashikant Banerjee
2019-05-08 01:00:10 +05:30
01451a57de
Revert "HDDS-1395. Key write fails with BlockOutputStream has been closed exception ( #749 )"
...
This reverts commit d525633619
2019-05-08 00:49:15 +05:30
d525633619
HDDS-1395. Key write fails with BlockOutputStream has been closed exception ( #749 )
...
HDDS-1395. Key write fails with BlockOutputStream has been closed exception (#749 ).
2019-05-08 00:38:53 +05:30
1a696cc761
HDDS-1424. Support multi-container robot test execution
...
Closes #726
2019-05-07 17:48:10 +02:00
fb7c1cad0e
Revert "HDDS-1384. TestBlockOutputStreamWithFailures is failing"
...
This reverts commit dead9b4049
2019-05-06 20:17:00 +02:00
1d70c8ca0f
HDDS-1464. Client should have different retry policies for different exceptions. ( #785 )
2019-05-05 09:21:15 -07:00
f194540520
HDDS-1448 : RatisPipelineProvider should only consider open pipeline while excluding dn for pipeline allocation. ( #786 )
2019-05-04 00:19:00 +05:30
1df679985b
HDDS-1473. DataNode ID file should be human readable. ( #781 )
2019-05-02 13:59:14 -07:00
4605db369e
HDDS-1482. Use strongly typed codec implementations for the S3Table
...
Closes #789
2019-05-02 13:56:30 +02:00
e2f0f72677
HDDS-1469. Generate default configuration fragments based on annotations
...
Closes #773
2019-05-02 12:14:43 +02:00
f1673b0db1
HDDS-1478. Provide k8s resources files for prometheus and performance tests
...
Closes #783
2019-05-02 11:23:44 +02:00
2ab318b603
HDDS-1412. Provide example k8s deployment files as part of the release package
...
Closes #719
2019-05-02 11:18:54 +02:00
f682a171f5
HDDS-1483. Fix getMultipartKey javadoc. ( #790 )
2019-05-01 21:51:11 -07:00
dead9b4049
HDDS-1384. TestBlockOutputStreamWithFailures is failing
...
Closes #750
2019-04-30 14:27:39 +02:00
95790bb7e5
HDDS-1430. NPE if secure ozone if KMS uri is not defined. Contributed by Ajay Kumar. ( #752 )
2019-04-29 14:07:23 -07:00
a96d16a843
HDDS-1455. Inconsistent naming convention with Ozone Kerberos configuration. Contributed by Xiaoyu Yao. ( #762 )
2019-04-29 11:18:11 -07:00
dbce729b24
HDDS-1472. Add retry to kinit command in smoketests. Contributed by Ajay Kumar. ( #778 )
2019-04-29 07:46:01 -07:00
b434f558ca
HDDS-1471. Update ratis dependency to 0.3.0. Contributed by Ajay Kumar. ( #777 )
2019-04-28 20:57:59 -07:00
43b2a4b77b
HDDS-1456. Stop the datanode, when any datanode statemachine state is… ( #769 )
2019-04-26 14:25:34 -07:00
37582705fa
HDDS-1403. KeyOutputStream writes fails after max retries while writing to a closed container ( #753 )
2019-04-26 10:39:03 -07:00
556eafd01a
HDDS-1460: Add the optmizations of HDDS-1300 to BasicOzoneFileSystem ( #765 )
2019-04-26 17:29:50 +05:30
c35abcd831
HDDS-999. Make the DNS resolution in OzoneManager more resilient
...
Closes #758
2019-04-26 12:38:24 +02:00
3f787cd506
HDDS-1192. Support -conf command line argument in GenericCli
...
Closes #713
2019-04-24 15:34:49 +02:00
59ded7641f
HDDS-1411. Add unit test to check if SCM correctly sends close commands for containers in closing state after a restart. ( #755 )
2019-04-23 21:04:14 +05:30
b979fdde99
HDDS-1447. Fix CheckStyle warnings. Contributed by Wanqiang Ji.
2019-04-18 08:54:43 +02:00
d608be660f
HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException.( #729 )
2019-04-17 14:49:02 +05:30
082f1e0437
Revert "HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException..( #729 )"
...
This reverts commit df2ae27f3e
2019-04-17 14:38:08 +05:30
df2ae27f3e
HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException..( #729 )
2019-04-17 14:25:35 +05:30
e5a918cda3
Revert "Merge pull request #729 from bshashikant/HDDS-1373"
...
This reverts commit 4ff4314e4004c0437d13
2019-04-17 14:17:54 +05:30
4ff4314e40
Merge pull request #729 from bshashikant/HDDS-1373
...
HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException. Contributed by Shashikant Banerjee.
2019-04-17 14:12:52 +05:30
04c0437d13
HDDS-1402. Remove unused ScmBlockLocationProtocol from ObjectStoreHandler ( #707 )
2019-04-16 19:16:05 -07:00
e543c3b31a
HDDS-1376. Datanode exits while executing client command when scmId is null ( #724 )
2019-04-16 13:51:39 -07:00
f2ab2795db
HDDS-1432. Ozone client list command truncates response without any indication. Contributed by Siddharth Wagle.
2019-04-16 12:35:49 -07:00
bfcb6534cd
HDDS-1380. Add functonality to write from multiple clients in MiniOzoneChaosCluster. Contributed by Shashikant Banerjee.
2019-04-16 18:52:07 +05:30
62e38ea911
HDDS-1396 : Recon start fails due to changes in Aggregate Schema definition. ( #700 )
2019-04-15 12:58:06 -07:00
ebbda181e4
HDDS-1198. Rename chill mode to safe mode. Contributed by Siddharth Wagle. ( #737 )
2019-04-13 07:27:03 -07:00
5379d85d8e
HDDS-1387. ConcurrentModificationException in TestMiniChaosOzoneCluster. Contributed by Marton Elek. ( #732 )
2019-04-12 15:19:50 -07:00
0c1fec34f4
HDDS-1425. Ozone compose files are not compatible with the latest docker-compose. ( #727 )
2019-04-12 09:45:36 -07:00
a458c5bd96
HDDS-1285. Implement actions need to be taken after chill mode exit wait time. ( #612 )
2019-04-12 09:40:27 -07:00
abace709cc
HDDS-1420. Tracing exception in DataNode HddsDispatcher
...
Closes #723
2019-04-12 12:21:10 +02:00
75ba719ddd
HDDS-1419. Fix shellcheck errors in start-chaos.sh
...
Closes #728
2019-04-12 11:59:55 +02:00
fd676e190a
HDDS-1426. Minor logging improvements for MiniOzoneChaosCluster
...
Closes #730
2019-04-12 11:42:23 +02:00
3b08ac4659
HDDS-1363. ozone.metadata.dirs doesn't pick multiple dirs ( #691 )
2019-04-12 15:00:08 +05:30
4003849fa4
HDDS-1416. MiniOzoneCluster should set custom value for hdds.datanode.replication.work.dir.
...
Contributed by chencan.
2019-04-12 14:45:57 +05:30
fcc7f9b32f
HDDS-1410. TestSCMNodeMetrics is flaky. Contributed by Siddharth Wagle.
2019-04-11 15:14:28 -07:00
22d0468b39
HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException. Contributed by Shashikant Banerjee
2019-04-11 22:13:41 +05:30
a0468c5756
HDDS-1348. Refactor BlockOutpuStream Class. Contributed by Shashikant Banerjee.
2019-04-11 19:31:26 +05:30
feaab241e5
HDDS-1418. Move bang line to the start of the start-chaos.sh script. Contributed by Arpit Agarwal. ( #720 )
...
Change-Id: I4fcf39d61a7d4c4ca79cb56a6958db0f691fe971
2019-04-10 12:44:01 -07:00
df01469141
HDDS-1401. Static ContainerCache in Datanodes can result in overwrite of container db. Contributed by Mukul Kumar Singh. ( #708 )
2019-04-10 18:00:10 +05:30
25c421bcc0
HDDS-1393. Convert all OM Bucket related operations to HA model. ( #704 )
2019-04-09 14:57:32 -07:00
312d4d4cc5
HDDS-1388. Add a shell script to run MiniOzoneChaosCluster using mvn exec. Contributed by Mukul Kumar Singh. ( #709 )
2019-04-09 13:08:25 -07:00
a78bdd15fc
HDDS-1405. ITestOzoneContractCreate is failing. ( #712 )
2019-04-09 23:05:54 +05:30
8ef3bc8113
HDDS-1383. Create project skeleton with CLI interface for In-place upgrade.
...
Closes #694
2019-04-09 17:35:14 +02:00
2d4f6b6daa
HDDS-372. There are three buffer copies in BlockOutputStream. Contributed by Shashikant Banerjee.
2019-04-09 10:27:58 +05:30
69e3745b86
HDDS-1340. Add List Containers API for Recon ( #648 )
2019-04-08 09:36:06 -07:00
26dc940813
HDDS-1390. Fix OzoneS3 Gateway server due to exclusion of hk2-api. ( #698 )
2019-04-05 12:36:00 -07:00
89f9c8604b
HDDS-1385. Make the ozonesecure-mr environment definition version independent. Contributed by Elek, Marton. ( #695 )
...
(cherry picked from commit d758c97873
2019-04-05 09:30:40 -07:00
0356b3699d
HDDS-1333. OzoneFileSystem can't work with spark/hadoop2.7 because incompatible security classes. Contributed by Elek, Marton. ( #653 )
...
(cherry picked from commit 7ec6a31eb3
2019-04-05 09:29:21 -07:00
77fe51e136
HDDS-1379. Convert all OM Volume related operations to HA model. ( #689 )
2019-04-04 21:09:50 -07:00
d2141ef886
HDDS-1189. Build failing due to rat check failure introduced by HDDS-1189. Contributed by Siddharth Wagle.
2019-04-04 17:38:02 -07:00
993f36ee33
HDDS-1353 : Metrics scm_pipeline_metrics_num_pipeline_creation_failed keeps increasing because of BackgroundPipelineCreator. ( #681 )
2019-04-04 19:18:32 +05:30
a92806d05a
HDDS-1189. Recon Aggregate DB schema and ORM. Contributed by Siddharth Wagle.
2019-04-04 17:33:37 +08:00
f09a78f73f
HDDS-1339. Implement ratis snapshots on OM ( #651 )
2019-04-03 22:50:28 -07:00
4e64f8d763
HDDS-1324. TestOzoneManagerHA tests are flaky ( #676 )
2019-04-03 16:02:19 -07:00
358f7f9b99
HDDS-1211. Test SCMChillMode failing randomly in Jenkins run ( #543 )
2019-04-03 15:02:00 -07:00
8ff41d6243
HDDS-1358 : Recon Server REST API not working as expected. ( #668 )
2019-04-03 14:52:06 -07:00
59022b28b7
HDDS-1330 : Add a docker compose for Ozone deployment with Recon. ( #669 )
2019-04-03 13:20:51 -07:00
d6c233fce6
HDDS-1377. OM failed to start with incorrect hostname set as ip address in CSR. ( #683 )
2019-04-03 11:53:51 -07:00
7cd7045eea
HDDS-1164. Add New blockade Tests to test Replica Manager. Contributed by Nilotpal Nandi.
2019-04-03 22:19:10 +05:30
bfc90bdc64
HDDS-1355. Only FQDN is accepted for OM rpc address in secure environment. Contributed by Ajay Kumar.
...
Closes #677
2019-04-02 15:43:01 +02:00
aeb43dfba3
HDDS-1153. Make tracing instrumentation configurable
...
Closes #673
2019-04-02 14:21:47 +02:00
d31c86892e
HDDS-1337. Handle GroupMismatchException in OzoneClient. Contributed by Shashikant Banerjee.
2019-04-02 16:32:30 +08:00
04f1db8936
HDDS-1260. Create Recon Server lifecyle integration with Ozone. ( #643 )
2019-04-01 09:59:32 -07:00
5f951ea2e3
HDDS-1255. Refactor ozone acceptance test to allow run in secure mode
2019-04-01 17:04:28 +02:00
0df949202a
HDDS-1067 . freon run on client gets hung when two of the datanodes are down in 3 datanode cluster. Contributed by Nilotpal Nandi.
2019-04-01 19:02:56 +05:30
ef5de29243
HDDS-1312. Add more unit tests to verify BlockOutputStream functionalities. Contributed by Shashikant Banerjee.
2019-04-01 16:09:58 +05:30
509f31b109
HDDS-1295. Add MiniOzoneChaosCluster to mimic long running workload in a unit test environment. Contributed by Mukul Kumar Singh.
2019-04-01 15:50:03 +05:30
bf3b7fd732
HDDS-1288. SCM - Failing test on trunk that waits for HB report processing. Contributed by Siddharth Wagle.
2019-03-30 10:54:45 -07:00
ec82e4cab2
HDDS-1357. ozone s3 shell command has confusing subcommands ( #663 )
2019-03-30 10:13:29 -07:00
7dc0ecc446
[HDDS-1351] NoClassDefFoundError when running ozone genconf (). Contributed by Doroszlai Attila.
...
This closes #659 .
2019-03-29 09:01:56 -07:00
6186ed94b9
HDDS-1300. Optimize non-recursive ozone filesystem apis. Contributed by Lokesh Jain.
2019-03-29 19:27:29 +05:30
ca5e4ce036
HDDS-1318. Fix MalformedTracerStateStringException on DN logs. Contributed by Xiaoyu Yao.
...
This closes #641
2019-03-28 12:00:58 -07:00
8a59efee34
HDDS-1346. Remove hard-coded version ozone-0.5.0 from ReadMe of ozonesecure-mr docker-compose. Contributed by Xiaoyu Yao.
...
This closes #652 .
2019-03-27 21:52:36 -07:00
b2269581f7
HDDS-1264. Remove Parametrized in TestOzoneShell. ( #614 )
2019-03-26 22:07:22 -07:00
eef8cae7cf
HDDS-1262. In OM HA OpenKey call Should happen only leader OM. ( #626 )
2019-03-26 21:48:01 -07:00
f426b7ce8f
HDDS-139. Output of createVolume can be improved. Contributed by Shweta.
2019-03-26 19:01:49 -07:00
82d477293c
HDDS-939. Add S3 access check to Ozone manager. Contributed by Ajay Kumar. ( #634 )
2019-03-26 08:59:59 -07:00
c99b107772
HDDS-1334. Fix asf license errors in newly added files by HDDS-1234. Contributed by Aravindan Vijayan.
2019-03-26 11:51:04 +08:00
e5d72f504e
HDDS-1234. Iterate the OM DB snapshot and populate the recon container DB. Contributed by Aravindan Vijayan.
2019-03-25 22:52:02 +08:00
67dd45fc25
HDDS-1185. Optimize GetFileStatus in OzoneFileSystem by reducing the number of rpc call to OM. Contributed by Mukul Kumar Singh.
2019-03-25 17:03:30 +05:30
d4e4a7d456
HDDS-1317. KeyOutputStream#write throws ArrayIndexOutOfBoundsException when running RandomWrite MR examples. Contributed by Shashikant Banerjee.
2019-03-25 15:41:20 +05:30
6a34c9bb29
HDDS-1299. Support TokenIssuer interface for running jobs with OzoneFileSystem. Contributed by Xiaoyu Yao.
...
This closes #627 .
2019-03-23 09:22:34 -07:00
dea6f2a065
HDDS-1291. Set OmKeyArgs#refreshPipeline flag properly to avoid reading from stale pipeline. Contributed by Xiaoyu Yao. ( #639 )
2019-03-22 15:08:28 -07:00
1d389ecb24
HDDS-1323. Ignore unit test TestFailureHandlingByClient. Contributed by Supratim Deka.
2019-03-22 11:29:56 -07:00
90afc9ab03
HDDS-1320. Update ozone to latest ratis snapshot build (0.4.0-1fc5ace-SNAPSHOT). Contributed by Mukul Kumar Singh.
2019-03-21 14:24:02 -07:00
2828f8c339
HDDS-1321. TestOzoneManagerHttpServer depends on hard-coded port numbers. Contributed by Arpit Agarwal. ( #633 )
...
Change-Id: I9656af4a7f41812da9d125c10ae0e8daf3dcf7f5
2019-03-21 14:18:58 -07:00
60cdd4cac1
HDDS-1233. Create an Ozone Manager Service provider for Recon. Contributed by Aravindan Vijayan.
2019-03-21 11:02:29 +08:00
310ebf5dc8
HDDS-1308. Fix asf license errors. ( #623 )
2019-03-19 14:06:39 -07:00
1639071b05
HDDS-1307. Test ScmChillMode testChillModeOperations failed. ( #622 )
...
HDDS-1307. Test ScmChillMode testChillModeOperations failed. Contributed by Bharat Viswanadham. (#622 )
2019-03-19 13:57:02 -07:00
992489c11c
HDDS-1215. Change hadoop-runner and apache/hadoop base image to use Java8. Contributed by Xiaoyu Yao.
...
This closes #615
2019-03-19 09:55:52 -07:00
f10d493325
HDDS-1119. DN get OM certificate from SCM CA for block token validation. Contributed by Ajay Kumar. ( #601 )
2019-03-18 23:08:17 -07:00
93db5da4d9
HDDS-1250. In OM HA AllocateBlock call where connecting to SCM from OM should not happen on Ratis.
2019-03-18 13:51:44 -07:00
66a104bc57
HDDS-1296. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. ( #616 )
2019-03-18 08:38:55 -07:00
4d2a116d6e
HDDS-699. Detect Ozone Network topology. Contributed by Sammi Chen.
2019-03-17 17:08:29 +08:00
5cfb88a225
HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. ( #594 )
2019-03-15 16:08:30 -07:00
16b78622cc
HDDS-1283. Fix the dynamic documentation of basic s3 client usage. Contributed by Elek, Marton. ( #605 )
2019-03-15 14:12:10 -07:00
d1afa03804
HDDS-1138. Ozone Client should avoid talking to SCM directly. Contributed by Xiaoyu Yao and Mukul Kumar Singh.
...
Closes #585
2019-03-15 10:41:06 -07:00
dc21655f2a
HDDS-1259. OzoneFS classpath separation is broken by the token validation. Contributed by Elek Marton.
...
Closes #604
2019-03-15 09:43:01 -07:00
a7f5e742a6
HDDS-1088. Add blockade Tests to test Replica Manager. Contributed by Nilotpal Nandi.
2019-03-15 20:54:41 +05:30
155ab6d5d8
HDDS-1098. Introduce Retry Policy in Ozone Client. Contributed by Shashikant Banerjee.
2019-03-15 15:40:59 +05:30
9001508485
HDDS-761. Create S3 subcommand to run S3 related operations.
...
Closes #579
2019-03-14 21:16:59 -07:00
2627dad333
HDDS-1265. ozone sh s3 getsecret throws Null Pointer Exception for unsecured clusters.
...
Closes #611
2019-03-14 17:21:06 -07:00
091a664977
HDDS-917. Expose NodeManagerMXBean as a MetricsSource. Contributed by Siddharth Wagle.
2019-03-14 12:41:52 -07:00
983b78afdc
HDDS-1237. Fix test TestSecureContainerServer.testClientServerRatisGrpc. Contributed by Mukul Kumar Singh.
2019-03-14 16:49:43 +05:30
3d140a537a
HDDS-1247. Bump trunk ozone version to 0.5.0. Contributed by Elek, Marton.
...
Closes #588
2019-03-14 12:01:25 +01:00
ea9fb07fd2
HDDS-1241. Update ozone to latest ratis snapshot build (0.4.0-5680cf5-SNAPSHOT). Contributed by Mukul Kumar Singh.
2019-03-14 15:18:06 +05:30
4fa009989b
HDDS-1254. Fix failure in TestOzoneManagerHttpServer & TestStorageContainerManagerHttpServer. Contributed by Ajay Kumar. ( #598 )
2019-03-13 12:01:08 -07:00
1f47fb7a2f
HDDS-1209. Fix the block allocation logic in SCM when client wants to exclude all available open containers in a chosen pipeline.
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-03-13 17:12:43 +05:30
0d62753da9
HDDS-1128. Create stateful manager class for the pipeline creation scheduling.
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-03-13 16:30:06 +05:30
c449cdebe6
HDDS-807. Period should be an invalid character in bucket names. Contributed by Siddharth Wagle.
2019-03-12 19:14:55 +01:00
dcb0de848d
HDDS-1043. Enable token based authentication for S3 api
...
Closes #561
2019-03-12 18:47:06 +01:00
2778259b88
HDDS-1253. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. ( #593 )
...
Closes PR #593
2019-03-12 09:34:18 -07:00
daf4660eeb
HDDS-1095. OzoneManager#openKey should do multiple block allocations in a single SCM rpc call. Contributed by Mukul Kumar Singh.
2019-03-12 20:02:19 +05:30
c7307867f0
HDDS-1245. OM delegation expiration time should use Time.now instead … ( #587 )
...
Closes #587 .
2019-03-11 21:15:40 -07:00
599e926d46
HDDS-596. Add robot test for OM Block Token. Contributed by Ajay Kumar.
...
This closes (#581 )
2019-03-11 15:01:04 -07:00
b4aa24d3c5
HDDS-1173. Fix a data corruption bug in BlockOutputStream. Contributed by Shashikant Banerjee.
2019-03-11 23:15:49 +05:30
4fc493e511
HDDS-1236. Fix incorrect Ozone ClientProtocol KerberosInfo annotation. Contributed by Xiaoyu Yao. ( #573 )
2019-03-11 09:19:19 -07:00
ebb5fa115b
HDDS-1220. KeyManager#openKey should release the bucket lock before doing an allocateBlock. Contributed by Lokesh Jain.
2019-03-11 14:54:44 +05:30
68aa2ccd89
HDDS-1240. Fix check style issues caused by HDDS-1196.
2019-03-09 21:50:46 -08:00
73e1801b2d
HDDS-1242. In S3 when bucket already exists, it should just return location.
2019-03-09 21:42:17 -08:00
c072458e5d
HDDS-1213. Support plain text S3 MPU initialization request.
2019-03-08 09:55:31 -08:00
341c076f05
HDDS-1196. Add a ReplicationStartTimer class. ( #567 )
2019-03-08 20:55:33 +05:30
fb851c9481
HDDS-1232. Recon Container DB service definition. Contributed by Aravindan Vijayan.
2019-03-08 16:59:41 +08:00
475011bbf8
HDDS-1226. ozone-filesystem jar missing in hadoop classpath
...
Closes #560
2019-03-07 14:09:13 +01:00
0eba4079bc
HDDS-1225. Provide docker-compose for OM HA.
...
Closes #562
2019-03-07 11:10:04 +01:00
bb12e81ec8
HDDS-1175. Serve read requests directly from RocksDB. ( #557 )
...
HDDS-1175. Serve read requests directly from RocksDB.
2019-03-06 19:44:55 -08:00
a55fc36299
HDDS-1093. Configuration tab in OM/SCM ui is not displaying the correct values.
2019-03-06 17:43:57 -08:00
45f976fdcf
HDDS-1113. Remove default dependencies from hadoop-ozone project. Contributed by Elek, Marton.
...
Closes #490
2019-03-06 18:22:22 +01:00
2c3ec37738
HDDS-1210. Ratis pipeline creation doesn't check raft client reply status during initialization. Contributed by Mukul Kumar Singh.
2019-03-06 21:38:21 +05:30
9d87247af3
HDDS-1216. Change name of ozoneManager service in docker compose files to om.
...
Closes #553
2019-03-06 15:18:39 +01:00
1ad5bfc53f
HDDS-1188. Implement a skeleton patch for Recon server with initial set of interfaces. Contributed by Siddharth Wagle.
2019-03-05 15:54:29 -08:00
7f636b47b5
HDDS-919. Enable prometheus endpoints for Ozone datanodes ( #502 )
...
Pull request from Elek, Márton. (#502 )
2019-03-05 12:04:57 -08:00
7fd890116a
HDDS-1171. Add benchmark for OM and OM client in Genesis.
...
Contributed by Lokesh Jain.
2019-03-05 11:31:09 -08:00
3ef1235215
HDDS-1218. Do the dist-layout-stitching for Ozone after the test-compile phase. Contributed by Marton Elek.
2019-03-05 10:25:31 -08:00
549d54f9a3
Merge pull request #556 from elek/HDDS-1222
...
HDDS-1222. Remove TestContainerSQLCli unit test stub
2019-03-05 10:15:55 -08:00
12402b7a74
HDDS-1072. Implement RetryProxy and FailoverProxy for OM client.
2019-03-05 09:24:22 -08:00
5fcea54a50
HDDS-935. Avoid creating an already created container on a datanode in case of disk removal followed by datanode restart. Contributed by Shashikant Banerjee.
2019-03-05 22:09:46 +05:30
353b90d59e
HDDS-1156. testDelegationToken is failing in TestSecureOzoneCluster. Contributed by Ajay Kumar.
2019-03-05 08:37:10 -08:00
02da06dd9f
HDDS-1222. Remove TestContainerSQLCli unit test stub. Contributed by Elek, Marton.
2019-03-05 16:35:04 +01:00
10b802b84b
HDDS-1136 : Add metric counters to capture the RocksDB checkpointing statistics.
...
Contributed by Aravindan Vijayan.
2019-03-04 12:00:16 -08:00
eed8b794d8
HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. ( #545 )
2019-03-04 10:37:26 -08:00
b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client."
...
This reverts commit 8e1225991d
2019-03-04 16:58:59 +09:00
9e53088493
Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contr…" ( #544 )
...
* Revert "Fix checkstyle issue"
This reverts commit 78c8a3323e6fef6fc5ee
2019-03-01 16:19:43 -08:00
78c8a3323e
Fix checkstyle issue
2019-03-01 16:15:20 -08:00
6fef6fc5ee
HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao.
2019-03-01 16:15:20 -08:00
4a3cddea70
HDDS-134. SCM CA: OM sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar.
2019-03-01 15:41:09 -08:00
Bharat Viswanadham
avijayanhwx
Anu Engineer
Elek, Márton
S O'Donnell
Márton Elek
Hanisha Koneru
Vivek Ratnavel Subramanian
Xudong Cao
Chen, Junjie
Xiaoyu Yao
Sammi Chen
Ajay Yadav
bshashikant
Shashikant Banerjee
Akira Ajisaka
Mukul Kumar Singh
Eric Yang
Ajay Kumar
Lokesh Jain
Siddharth
supratimdeka
Hanisha Koneru
dineshchitlangia
Kitti Nanasi
Siddharth
Arpit Agarwal
Arpit Agarwal
Doroszlai, Attila
Doroszlai, Attila
Nanda kumar
Mukul Kumar Singh
Mukul Kumar Singh
Lokesh Jain
Yiqun Lin
Shweta Yakkali
Aravindan Vijayan