bug: group concurrency not being respected

[modern-sapien]

Node.js version

14

NPM version

latest

@checkly/cli version

latest

Steps to reproduce

Bug report: Group Concurrency setting not respected

A group check's concurrency setting is not respected when set. There's a timeout in the setup for 15 seconds for 8 checks. We should see these checks occurring over at a minimum of a two minute time period, but we see that it all happens in one.

Reproduction
https://github.com/modern-sapien/checkly-repro-error/tree/api-setup-failure

What is expected?

Concurrency is respected

What is actually happening?

Concurrency is not respected

Any additional comments?

No response

[modern-sapien]

@tnolet has this been picked up by anyone and maybe just not resolved here?

[tnolet]

@tnolet has this been picked up by anyone and maybe just not resolved here?

@modern-sapien no, this ticket has not been addressed yet.

[umutuzgur]

@clample I talked to @tnolet how this behavior should look like. He wants to have a concurrency within the groups but 2 separate groups would run in parallel. Feel free to reach out to him if you have any questions