Skip to content

Extensive testing of (new) functionality #489

@sauterl

Description

@sauterl

Extensively test (new) functionality:

Evaluation Template Building

  • VBS-Style template
  • LSC-Style template
  • Templates including perpetual tasks
  • Exotic Templates
  • Try to break the builder

Evaluation Execution

  • VBS-Style evaluation, SYNC
  • VBS-Style evaluation, ASYNC
  • LSC-Style evalution, SYNC
  • LSC-Style evaluation, ASYNC
  • Perpetual tasks, SYNC
  • Perpetual tasks, ASYNC
  • Exotic Templates Evaluation, SYNC
  • Exotic Templates Evaluation, ASYNC
  • Robustness of submission endpoint

While doing the above, we should make sure that

  • The frontend behaves as expected
  • The backend behaves as expected
  • Errors in frontend are understandable for end users
  • Errors in backend are somewhat understandable and reportable
  • The API(s) works as intended

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

Status

Ready

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions