Skip to content

Validate all errors v2#156

Draft
dmartin35 wants to merge 3 commits into
chaostoolkit:masterfrom
dmartin35:validate-all-errors-v2
Draft

Validate all errors v2#156
dmartin35 wants to merge 3 commits into
chaostoolkit:masterfrom
dmartin35:validate-all-errors-v2

Conversation

@dmartin35

Copy link
Copy Markdown
Collaborator

@Lawouach

this is similar purpose as the previous PR, to validate all experiment file syntax and report all at once. This internal is though different.

This is mode advanced refactoring, that would be useful to display more information to the user than the error string. We could output the message, the field in error, the value being validated, as well as a path/location within the object structure.

This is done internally by Validation objects that shall be created by all validation functions, to append errors with all possible arguments, and return the list of errors. An error is now a dict with defined structure.

This PR is intended to be reviewed and chosen between the other one #155, before we continue any further

still to be done, is to add the path/location of each error.

David Martin and others added 2 commits December 18, 2019 12:04
…rs at once

Signed-off-by: David Martin <david@chaoiq.io>
…list of errors in message

Signed-off-by: David Martin <david@chaosiq.io>
@dmartin35
dmartin35 force-pushed the validate-all-errors-v2 branch from 9123381 to 94cb7bc Compare December 27, 2019 10:30
…t (to provide more feedback rather than simple msg)

Signed-off-by: David Martin <david@chaosiq.io>
@dmartin35
dmartin35 force-pushed the validate-all-errors-v2 branch from 94cb7bc to bd14964 Compare December 27, 2019 11:21
@codecov-io

codecov-io commented Dec 27, 2019

Copy link
Copy Markdown

Codecov Report

Merging #156 into master will increase coverage by 0.53%.
The diff coverage is 85.35%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #156      +/-   ##
==========================================
+ Coverage   86.41%   86.95%   +0.53%     
==========================================
  Files          23       24       +1     
  Lines        1627     1717      +90     
==========================================
+ Hits         1406     1493      +87     
- Misses        221      224       +3
Impacted Files Coverage Δ
chaoslib/provider/process.py 92.3% <100%> (+0.81%) ⬆️
chaoslib/exceptions.py 100% <100%> (ø) ⬆️
chaoslib/control/python.py 87.64% <100%> (+0.43%) ⬆️
chaoslib/extension.py 85.45% <100%> (+1.14%) ⬆️
chaoslib/validation.py 100% <100%> (ø)
chaoslib/types.py 100% <100%> (ø) ⬆️
chaoslib/control/__init__.py 86.88% <41.66%> (-0.27%) ⬇️
chaoslib/activity.py 88.73% <71.42%> (+1.14%) ⬆️
chaoslib/hypothesis.py 88.73% <81.39%> (+0.29%) ⬆️
chaoslib/experiment.py 91.09% <84%> (-0.62%) ⬇️
... and 4 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 44c3bf7...bd14964. Read the comment docs.

@Lawouach Lawouach added the viewed Issue has been viewed but not agreed upon yet label Apr 9, 2020
@Lawouach
Lawouach marked this pull request as draft July 6, 2020 12:23
@codecov-commenter

Copy link
Copy Markdown

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

❌ Patch coverage is 85.35354% with 29 lines in your changes missing coverage. Please review.
✅ Project coverage is 86.95%. Comparing base (69dd454) to head (bd14964).
⚠️ Report is 235 commits behind head on master.

Files with missing lines Patch % Lines
chaoslib/activity.py 71.42% 8 Missing ⚠️
chaoslib/hypothesis.py 81.39% 8 Missing ⚠️
chaoslib/control/__init__.py 41.66% 7 Missing ⚠️
chaoslib/experiment.py 84.00% 4 Missing ⚠️
chaoslib/provider/http.py 88.88% 1 Missing ⚠️
chaoslib/provider/python.py 94.73% 1 Missing ⚠️
❗ Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##           master     #156      +/-   ##
==========================================
+ Coverage   86.45%   86.95%   +0.50%     
==========================================
  Files          23       24       +1     
  Lines        1624     1717      +93     
==========================================
+ Hits         1404     1493      +89     
- Misses        220      224       +4     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

viewed Issue has been viewed but not agreed upon yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants