Summary
Unknown command-like data definitions are accepted and generate randomized regex-like output instead of failing validation. This can hide typos in faker/domain/helper command names and produce plausible-looking but incorrect test data.
Environment
Repeat Steps
- Open the deployed generator.
- Switch schema editor to text mode with Edit as Text.
- Enter:
value: internet.notACommand(commonOnly=true)
- Click Preview.
- Repeat from a clean page state.
- Try similar unknown command-like values:
value: person.notACommand()
value: commerce.notACommand()
value: date.notACommand()
value: helpers.notACommand()
Expected
The app should report an unknown command or invalid data definition error and should not generate output.
Actual
The app generates output by treating the command-like text as a regex-like pattern. Examples observed included internet%notACommandcommonOnly=true, person'notACommand, commerce~notACommand, date%notACommand, and helpers6notACommand. No validation status was shown for the repeated unknown command-like cases.
Evidence
Screenshots and video were captured in the local review artifact folder under docs/testing/20260627/issue-230-001. Structured evidence is in negative-validation-results.json and loop-gap-review-evidence.json.
Summary
Unknown command-like data definitions are accepted and generate randomized regex-like output instead of failing validation. This can hide typos in faker/domain/helper command names and produce plausible-looking but incorrect test data.
Environment
Repeat Steps
Expected
The app should report an unknown command or invalid data definition error and should not generate output.
Actual
The app generates output by treating the command-like text as a regex-like pattern. Examples observed included
internet%notACommandcommonOnly=true,person'notACommand,commerce~notACommand,date%notACommand, andhelpers6notACommand. No validation status was shown for the repeated unknown command-like cases.Evidence
Screenshots and video were captured in the local review artifact folder under docs/testing/20260627/issue-230-001. Structured evidence is in negative-validation-results.json and loop-gap-review-evidence.json.