Skip to content

Defect: Unknown command-like values generate regex-like output #249

Description

@eviltester

Summary

Unknown command-like data definitions are accepted and generate randomized regex-like output instead of failing validation. This can hide typos in faker/domain/helper command names and produce plausible-looking but incorrect test data.

Environment

Repeat Steps

  1. Open the deployed generator.
  2. Switch schema editor to text mode with Edit as Text.
  3. Enter:
value: internet.notACommand(commonOnly=true)
  1. Click Preview.
  2. Repeat from a clean page state.
  3. Try similar unknown command-like values:
value: person.notACommand()
value: commerce.notACommand()
value: date.notACommand()
value: helpers.notACommand()

Expected

The app should report an unknown command or invalid data definition error and should not generate output.

Actual

The app generates output by treating the command-like text as a regex-like pattern. Examples observed included internet%notACommandcommonOnly=true, person'notACommand, commerce~notACommand, date%notACommand, and helpers6notACommand. No validation status was shown for the repeated unknown command-like cases.

Evidence

Screenshots and video were captured in the local review artifact folder under docs/testing/20260627/issue-230-001. Structured evidence is in negative-validation-results.json and loop-gap-review-evidence.json.

Metadata

Metadata

Assignees

Labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions