Scripted checks on private probes calling fail() do not result in test execution failure

[peterschretlen]

Steps to reproduce:

Use this script:

import { fail } from 'k6';
 export default function() {
 fail("");
}

Create a scripted check using this script running on a private probe and a public probe.

Result: the tests running on the private probe will always pass. The tests running on the public probe will always fail (expected).

example logs from public probe

level=error  probe=Ohio  msg="Check failed" duration_seconds=0.08480728
 probe=Ohio  level=error msg="script did not execute successfully" error="fatal error occurred while running the script" errorCode=aborted
 probe=Ohio  time=2024-11-22T01:18:07Z level=error msg="GoError\n\tat go.k6.io/k6/js/modules/k6.(*K6).Fail-fm (native)\n\tat default (file:///script.k6:3:6(4))\n" executor=shared-iterations scenario=default source=stacktrace
 probe=Ohio  time=2024-11-22T01:18:07Z level=info msg="called failure" source=console
level=info  probe=Ohio  msg="Beginning check" type=scripted timeout_seconds=60

example logs from private probe

level=info  probe="nov 21 test"  msg="Check succeeded" duration_seconds=2.257529751
 probe="nov 21 test"  time=2024-11-22T01:17:59Z level=error msg="GoError\n\tat go.k6.io/k6/js/modules/k6.(*K6).Fail-fm (native)\n\tat default (file:///tmp/k6-runner534237818/322124267.js:3:6(4))\n" executor=shared-iterations scenario=default source=stacktrace
 probe="nov 21 test"  time=2024-11-22T01:17:59Z level=info msg="called failure" source=console
level=info  probe="nov 21 test"  msg="Beginning check" type=scripted timeout_seconds=60

Expected. The tests executions should also fail on the private probe.

This was tested on these private probe versions with the same result

• grafana/synthetic-monitoring-agent:v0.24.0-0-g5e69f42a
• grafana/synthetic-monitoring-agent:v0.29.5

[devtony15]

hello, when can we expect the fix?