Regression testing
To-date
Right now, most check-spelling testing is done through live use of the action
Plan
- Create a repository
check-spelling/regression-tests
- Create a template of commits
- Create a workflow which on each push applies each of the templated commits filling in the targeted revision and pushing them to
check-spelling/regression-tests
- Ideally have the workflow retrieve the results of each of the commits' actions and compare them against expected results.
Plan 2
- Create a
check-spelling-test
org. - Create a PAT for a bot user (possibly the existing @check-spelling-bot).
- Create a secret in the regression testing repository for that PAT.
- Use
gh
in workflows to create a brand new repository for each thing it tests.- Create the repository
- Insert the workflow(s)
- Create pull requests
- Add comments
- Check on how things are feeling.
- It could probably even have a second PAT which just has enough permission to poke the original repository to trigger data collection from the events in the test repository.
Timeline
Uncertain
FAQ | Showcase | Event descriptions | Configuration information | Known Issues | Possible features | Deprecations | Release notes | Helpful scripts