Commit Graph

160 Commits

Author SHA1 Message Date
Joshua Darnell 03eff74438 Issue #56: added PayloadSample and refactored basic availability report 2021-04-29 18:56:34 -07:00
Joshua Darnell d6d0799fb5 Issue #56 - threaded sampling with auto-terminate upon reaching end of records 2021-04-29 03:18:40 -07:00
Joshua Darnell b6ed5308ea Issue #56 - Multi-threaded fetching and use of timezone offsets 2021-04-28 23:14:05 -07:00
Joshua Darnell 554af35f17 Merge branch 'issue-73-create-model-generators' into issue-56-payloads-sampling-tool 2021-04-27 16:25:24 -07:00
Joshua Darnell 0ac742e7d1 Issue #73 - Initial ResourceInfo Model Generation 2021-04-27 16:17:46 -07:00
Joshua Darnell dc93fbb9b6 Issue #56 - Intermediate Commit 2021-04-27 10:34:45 -07:00
Joshua Darnell 094fc33d19 Issue #56 - Adding properties file and other items 2021-04-14 21:27:37 -07:00
Joshua Darnell cd9791f33a Issue #56 - Commit of basic sampling with SHA 256 scoring 2021-04-14 21:25:43 -07:00
Joshua Darnell 19f72345b1
Make Report Generator Friendlier with Jenkins and Build Processes (#72)
* Added file generation to DD Metadata tests
* Updated most libraries and build.gradle accordingly
* Fixed annotation processor so it read Term instead of Type
2021-04-13 16:57:10 -07:00
Joshua Darnell b59ab5b4ec
issue-60-null-timestamp-handling (#70)
Going to merge since this is a null-check issue. Has passed testing.
2021-04-05 17:13:41 -07:00
Joshua Darnell e5549c84d4
Update gradle.yml (#71) 2021-04-05 17:05:00 -07:00
michaelpede ef10501763
Update DDLProcessor.java (#69) 2021-04-01 18:55:34 -07:00
Joshua Darnell 4ea56248f0
Add jenkins dd gradle task (#66)
* Added minimal DD build task for Jenkins environments
* Added Web API Core Jenkins Job
* Updated Olingo client and Guice
* Updated build.gradle
* Issue #55 - added =true test and reorganized tests, as well as generated new reference metadata and other artifacts
* Issue #52 - add better error messages for fetch-by-key test
* Fixed unreported issue with generateDDAcceptanceTests not working from the command line
* Improved metadata reports and updated reference metadata
* Improvements to Metadata and Metadata Report Generation. Added JSON schema for report format
* Issue #61 - added DDL generation to the RESO Commander for Reference Server
* Issue #61 - updated template .sql DDL files in /src/main/resources/ddl
* Issue #61 - added Lookup resource Inserts to DDL
* Issue #61 - fixed formatting issues
* Issue #51 - Improved Jenkins Builds in the Commander
* Fix failing tests with the mock Add/Edit spec
* Clean up tags for tests
* Issue #51 - improved Jenkin behavior, and added the ability to pass a set of reference queries
* Issue #51 - cleaned up constants
* Issue #51 - improved Jenkins Builds. Added Scenario.Write messages for DD 1.7 tests.
* Issue #51 - added better support for error handling in the testing scenarios, as well as fast failure on DD testing
2021-03-31 19:24:27 -07:00
Joshua Darnell fc556b39c0
Added Images for DD IntelliJ Walkthrough (#54) 2021-02-12 21:34:05 -08:00
Joshua Darnell 0aa39b0c6d
Issue 47 allow string lookups (#49)
Issue #47 - added tests for Collection based any and all tests
2021-01-08 04:09:19 -08:00
Joshua Darnell 30c346cd2e
Issue #47 - allow Edm.String and Collection(Edm.String) for Single and Multi lookups (#48)
Issue #47 - allow Edm.String and Collection(Edm.String) for single and multi lookups
2021-01-07 23:02:56 -08:00
Joshua Darnell 26dedd0031
Issue #45 - fix handling of all() so that result must contain no items or exactly contain the asserted value (#46) 2021-01-07 10:12:10 -08:00
Joshua Darnell bf1c55c818
Issue 34 Web API Core Tests (#43)
* Added DD Spreadsheet, Command Line option, and parser
* Initial check-in of DD generator and generated .feature files for 1.7 resources
* Added file naming and header info to the generated files, regenerated Gluecode
* Changed generator templates
* Added support for additional DD resources and updated generator
* Added new Commander build
* Changed templates
* Refactored generator and changed DD templates
* Refactored WorksheetProcessor into base class
* Added EDMX Generator
* Added dependency injection of test containers, changed from Java8 Lambda test expressions to functions
* Added skip logic and resource tags to generators
* Generated new tests and improved skipped test messaging
* Corrected Test Template
* Finished first round of DD tests: field presence
* Expanded field map to include all resources rather than just the one included in the Web API test
* DD test generator intermediate check-in
* EDMX Generator build enumerations generator
* EDMX generator can generate valid EDMX files. See: /src/main/resources
* Re-generated EDMX and BDD Tests from sanitized spreadsheet
* Issue #30 - Convert Web API Server tests to Core, and remove Date Part comparisons
* Updated DD BDD test format
* Wrapped up test templates and generated new BDD acceptance tests
* Cleaned up EDMX generation
* Wrapped up first round of EDMX generation using Key (but not KeyNumeric). Metadata validation passes on generated file
* Updated EDMX generator with Single and Multiple Enumerations
* Updated reference XSLX, generated new EDMX and BDD Tests
* Added updated BDD generators with improved tags and addedcomments with descriptions in the generated EDMX
* Added generation of comments for both Standard Fields and Standard Enumerations, and also added a StandardEnumeration class and builder
* Updated reference EDMX and BDD test generators to use Collections of enumerations rather than multi-select enum types. Added newly generated EDMX and BDD tests
* Added the ability to generate Standard Relationships into NavigationProperty definitions
* Added updated reference EDMX document
* Updated Standard Relationships and re-generated EDMX and Open API definitions
* Removed Partner Property Definitions and extra info logging
* Issue #34 - Rename Test IDs
* Issue #34 - Added query generator and additional RESOScript queries
* Issue #34 - Added remaining Core test queries to RESOScript files and cleaned up test IDs
* Added Data Dictionary tests for Collections, TODO: README and non-collection based enumerations
* Issue #37 - added support for multiple enumerations that use IsFlags=true
* Issue #37 - added better reporting
* Issue #37 - Allow Edm.Double in addition to Edm.Decimal as per Cert group 10/1/2020 call
* Issue #37 - added Gradle task to generate minimal 'pretty' reports.
* Issue #37 - added updated .JAR and updated build.gradle
* Issue #37 - Added additional error information to test results
* Issue #37 - Added BDD generation for Lookups and stubs for testing. Prepended 'sample' to the RESOScript templates
* Issue #37 - committing new BDD tests
* Issue #37 - Added enumeration MAY and MUST support
* Issue #37 - Added field-level synonyms checking and fixed invalid synonyms in DD sheet
* Issue #37 - added test to check that closed enumerations only have standard values
* Issue #37 - added better logging, including more info about standard vs. non-standard enumerations
* Issue #37 - further improvement of OData type error messages
* Issue #37 - Added fuzzy matching of enumerations using Levenshtein distance
* Issue #37 - Improved Edit Distance behavior, added IgnoredItem and ignored.json, and updated Vha, Usda, and Fha with VHA, USDA, and FHA
* Issue #37 - Added better error messages, --strict=true for strict testing mode, and metadata-report.json to output results to aggregation server
* Issue #37 - Added auto-generating output directory as well as a generateCertificationReports_DD_1_7 task that takes -DpathToJsonResults from the cert task and creates a pretty report
* Issue #37 - Added better error message formatting and handling, and help messages for gradle tasks
* Issue #37 - updated README and fixed some of the existing Web API Commander JAR tasks, as well as improved the all-in-one generateCertificationReport task
* Issue #37 - Cleaned up some items in the README and message output
* Update README.md
* Issue #34 - fixed metadata-request name in RESOScript
* Issue #34 - Added logging and container caching to Web API acceptance tests, and updated sample payloads
* Issue #34 - Cleaned up DD merge, Added Collections flag, updated README
* Issue #34 - Added ODataTransportWrapper and odata-openapi as a submodule
* Issue #37 - removed Data Dictionary lookup tests and added annotations to reference metadata
* Issue #37 - added new DD 1.7 Open API 3 spec
2021-01-06 00:09:01 -08:00
Joshua Darnell e6e1af4b5d
Issue 37 Add Data Dictionary testing to the RESO Commmander (#41)
* Added DD Spreadsheet, Command Line option, and parser
* Initial check-in of DD generator and generated .feature files for 1.7 resources
* Added file naming and header info to the generated files, regenerated Gluecode
* Changed generator templates
* Added support for additional DD resources and updated generator
* Added new Commander build
* Changed templates
* Refactored generator and changed DD templates
* Refactored WorksheetProcessor into base class
* Added EDMX Generator
* Added better EDMX generation
* Intermediate check-in for EDMX processor
* Added dependency injection of test containers, changed from Java8 Lambda test expressions to functions
* Added skip logic and resource tags to generators
* Generated new tests and improved skipped test messaging
* Corrected Test Template
* Finished first round of DD tests: field presence
* Expanded field map to include all resources rather than just the one included in the Web API test
* DD test generator intermediate check-in
* EDMX Generator build enumerations generator
* EDMX generator can generate valid EDMX files. See: /src/main/resources
* Re-generated EDMX and BDD Tests from sanitized spreadsheet
* Issue #30 - Convert Web API Server tests to Core, and remove Date Part comparisons
* Updated DD BDD test format
* Wrapped up test templates and generated new BDD acceptance tests
* Cleaned up EDMX generation
* Wrapped up first round of EDMX generation using Key (but not KeyNumeric). Metadata validation passes on generated file
* Updated EDMX generator with Single and Multiple Enumerations
* Updated reference XSLX, generated new EDMX and BDD Tests
* Added updated BDD generators with improved tags and addedcomments with descriptions in the generated EDMX
* Added generation of comments for both Standard Fields and Standard Enumerations, and also added a StandardEnumeration class and builder
* Updated reference EDMX and BDD test generators to use Collections of enumerations rather than multi-select enum types. Added newly generated EDMX and BDD tests
* Added the ability to generate Standard Relationships into NavigationProperty definitions
* Added updated reference EDMX document
* Updated Standard Relationships and re-generated EDMX and Open API definitions
* Removed Partner Property Definitions and extra info logging
* Added Data Dictionary tests for Collections, TODO: README and non-collection based enumerations
* Issue #37 - added support for multiple enumerations that use IsFlags=true
* Issue #37 - added better reporting
* Issue #37 - Allow Edm.Double in addition to Edm.Decimal as per Cert group 10/1/2020 call
* Issue #37 - added Gradle task to generate minimal 'pretty' reports.
* Issue #37 - added updated .JAR and updated build.gradle
* Issue #37 - Added additional error information to test results
* Issue #37 - Added BDD generation for Lookups and stubs for testing. Prepended 'sample' to the RESOScript templates
* Issue #37 - committing new BDD tests
* Issue #37 - Added enumeration MAY and MUST support
* Issue #37 - Added field-level synonyms checking and fixed invalid synonyms in DD sheet
* Issue #37 - added test to check that closed enumerations only have standard values
* Issue #37 - added better logging, including more info about standard vs. non-standard enumerations
* Issue #37 - further improvement of OData type error messages
* Issue #37 - Added fuzzy matching of enumerations using Levenshtein distance
* Issue #37 - Improved Edit Distance behavior, added IgnoredItem and ignored.json, and updated Vha, Usda, and Fha with VHA, USDA, and FHA
* Issue #37 - Added better error messages, --strict=true for strict testing mode, and metadata-report.json to output results to aggregation server
* Issue #37 - Added auto-generating output directory as well as a generateCertificationReports_DD_1_7 task that takes -DpathToJsonResults from the cert task and creates a pretty report
* Issue #37 - Added better error message formatting and handling, and help messages for gradle tasks
* Issue #37 - updated README and fixed some of the existing Web API Commander JAR tasks, as well as improved the all-in-one generateCertificationReport task
* Issue #37 - Cleaned up some items in the README and message output
* Update README.md
2021-01-05 23:47:04 -08:00
Joshua Darnell 017348cf1b
Create codeql-analysis.yml 2020-10-14 10:32:36 -07:00
Joshua Darnell 31d64ad132 Update issue templates 2020-09-29 23:34:10 -07:00
Joshua Darnell 7428d7142c
Issue #30 - Convert Web API Server tests to Core, and remove Date Par… (#31)
Issue #30 - Convert Web API Server tests to Core, and remove Date Part comparisons
2020-06-16 10:19:48 -07:00
Joshua Darnell a2843cad82
Issue #25 - Increase Fractional Seconds Precision (#28)
* Added improved fractionalsecond Commander acceptance tests, need to backfill into Web API server cert
* Added Date tests
* Refactored fractionalseconds tests to accept greater precision, and refactored Web API Server tests to use new payload comparison helpers. Also added more tests.
* Changed private access of Timestamp compare functions to public so they could be used from other test functions
* Updated if/then statetments to use switch() instead
* Generated new Commander Jar
2020-05-07 17:44:15 -07:00
Joshua Darnell fa117b19fd
Fixed incomplete client settings tags in resoscript templates (#22)
Fixes for platinum, gold, and mock platinum RESOScripts
2020-05-01 09:19:07 -07:00
Joshua Darnell cd3fd1ab84
Set encoding to UTF-8 and Fix Comparison Tests (#27)
* Fixed issue with UTF-8 encodings not being picked up from the Windows console
* Additional fixes to comparison tests
* Added tests for Integer comparisons
* Added String comparison tests
* Added timestamp comparison tests
* Renamed test files to match conventions
* Added Fractional Date Part tests
* Generated automated acceptance tests for remainder of compare() operations in TestUtils
* Checked in new Commander build
2020-04-27 20:23:49 -07:00
dgmyrek 59c409d37d
Merge pull request #20 from RESOStandards/issue-19-fail-all-if-metadata-fails
Issue #19 fail all if metadata fails
2020-04-16 13:48:02 -05:00
Joshua Darnell dfb1566b0e Fixed additional issue where XML Metadata needed to be fetched for individual test debugging 2020-04-13 04:45:51 -07:00
Joshua Darnell 66097735a4 Fixed small bug in validate test workflow 2020-04-13 03:28:58 -07:00
Joshua Darnell 3c96e39a7b Removed stray line from workflow YAML 2020-04-13 03:02:31 -07:00
Joshua Darnell ac0254d337 GitHub workflow - removed post-build artifact and added gradle caching 2020-04-13 02:59:15 -07:00
Joshua Darnell 1a8346cc1f Fixed YAML syntax error (v2) 2020-04-13 02:48:03 -07:00
Joshua Darnell d069c8b30c Fixed YAML syntax error 2020-04-13 02:41:59 -07:00
Joshua Darnell ce6eeb0cf0 Added DataSystem good/bad container tests, removed rest of Edm fetch logic, added build artifacts to github workflows to build commander lib, and improved state variables in the Web API Test Container 2020-04-13 02:40:22 -07:00
Joshua Darnell 5274dd8557 Cleaned up metadata checking and removed extra Edm metadata fetch, favoring deserialization from the XML Response payload instead 2020-04-12 15:19:27 -07:00
Joshua Darnell 4da68de5c3 Added additional WebAPIContainer tests, formatted code, started to clean up test/testContainer logic 2020-04-12 13:37:18 -07:00
Joshua Darnell dea7e62634 Improved file names and structure 2020-04-11 15:19:14 -07:00
Joshua Darnell e80d1fc172 Fixed some formatting issues 2020-04-09 01:47:10 -07:00
Joshua Darnell aca7bbe709 Adding some needed files... 2020-04-09 01:40:35 -07:00
Joshua Darnell 25750899c6 Added WebAPITestContainer acceptance tests 2020-04-09 01:36:55 -07:00
Joshua Darnell ba980dd213 Changed name of step from build to test 2020-04-08 22:30:27 -07:00
Joshua Darnell 43238553f5 Updated action for post-commit hook to support running tests 2020-04-08 22:20:39 -07:00
Joshua Darnell 476d4b00ce Added Commander acceptance testing for XML and Metadata checking 2020-04-08 22:15:31 -07:00
Joshua Darnell 63f1474257 moving TestUtils to common 2020-04-08 04:32:27 -07:00
Joshua Darnell 7be1cb7d1b Issue #19 - Fail subsequent tests eagerly when metadata fails 2020-04-08 04:22:10 -07:00
Joshua Darnell 26e2a3d915
removing 403 and 501 response code tests per workgroup vote (#16) 2020-04-06 15:00:51 -07:00
Joshua Darnell 13adc2cc24
Add Better XML parsing and Error Handling (#8)
* Added lazy loading of field hash, better XML handling and validation, additional validation for OData 4.0 and 4.01, and updated the RESOScript templates
* Added un-interpreted attempt to download and validate metadata if the Olingo client can't parse the response. Improved messaging.
* Changed XML metadata retrieval to fetch raw response so it could be validated using OASIS XSDs
* Added improved error message handling
2020-04-05 16:21:23 -07:00
Eric Finlay 8f1179cf2f
Merge pull request #10 from RESOStandards/eric/9
Issue#9 - moved field name and type checks, continue on null
2020-04-02 08:39:44 -07:00
Joshua Darnell f4c700a34c
Update README.md (#13) 2020-04-01 15:56:49 -07:00
Eric Finlay 6d63ca8692 Issue#9 - moved field name and type checks, continue on null expand field value
Signed-off-by: Eric Finlay <eric@rets.ly>
2020-04-01 13:28:48 -07:00
Eric Finlay 1045a1aed3
Update SRID value to make more sense for geographic queries (#7)
Signed-off-by: Eric Finlay <eric@rets.ly>
2020-04-01 09:37:57 -07:00