01/02/2026 06:18:30 PM UTC [INFO] Job backup disabled (set BACKUP_FILE_LIFETIME env var to enable) 01/02/2026 06:18:32 PM UTC [INFO] Runtimes from KContext: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:18:32 PM UTC [INFO] Runtime types from KContext: [] 01/02/2026 06:18:32 PM UTC [INFO] Initializing runtimes: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:18:32 PM UTC [INFO] Filtering runtimes by name: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:18:32 PM UTC [WARNING] Runtime 'lava-qualcomm' not found in configuration 01/02/2026 06:18:32 PM UTC [INFO] Selected 11 runtime(s): ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:18:32 PM UTC [INFO] Default storage config from KContext: kci-storage 01/02/2026 06:18:32 PM UTC [INFO] Attempting to initialize storage config: kci-storage 01/02/2026 06:18:32 PM UTC [INFO] KContext get_storage_config returned: True 01/02/2026 06:18:32 PM UTC [INFO] KContext storage initialization successful: True 01/02/2026 06:18:32 PM UTC [INFO] Watchdog started with 600s timeout 01/02/2026 06:18:32 PM UTC [DEBUG] Node channel sub id: 102148 01/02/2026 06:18:32 PM UTC [DEBUG] Retry channel sub id: 102149 01/02/2026 06:18:32 PM UTC [INFO] Listening for available checkout events 01/02/2026 06:18:32 PM UTC [INFO] Press Ctrl-C to stop. 01/02/2026 06:18:32 PM UTC [INFO] Listening for available checkout events 01/02/2026 06:18:32 PM UTC [INFO] Press Ctrl-C to stop. 127.0.0.1 - - [02/Jan/2026 18:18:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:19:24] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:19:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:20:24] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:20:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:21:24] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:21:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:22:24] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:22:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:23:24] "GET /health HTTP/1.1" 200 - Exception in thread scheduler-retry: Traceback (most recent call last): File "/usr/local/lib/python3.12/threading.py", line 1075, in _bootstrap_inner self.run() File "/usr/local/lib/python3.12/threading.py", line 1012, in run self._target(*self._args, **self._kwargs) File "/home/kernelci/pipeline/./src/scheduler.py", line 667, in _run_scheduler self._run_job(job, runtime, platform, input_node, retry_counter) File "/home/kernelci/pipeline/./src/scheduler.py", line 350, in _run_job node = self._api_helper.create_job_node(job_config, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: APIHelper.create_job_node() takes 3 positional arguments but 6 were given 127.0.0.1 - - [02/Jan/2026 18:23:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:24:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:24:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:25:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:25:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:26:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:26:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:27:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:27:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:28:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:28:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:29:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:29:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:30:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:30:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:31:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:31:56] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:32:26] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:32:56] "GET /health HTTP/1.1" 200 - 01/02/2026 06:33:02 PM UTC [ERROR] WATCHDOG: Thread 'scheduler-retry' stuck for 603s (timeout: 600s). Forcing immediate exit! 01/02/2026 06:33:02 PM UTC [ERROR] ================================================================================ 01/02/2026 06:33:02 PM UTC [ERROR] STUCK THREAD DETECTED - FORCING EXIT 01/02/2026 06:33:02 PM UTC [ERROR] Thread: scheduler-retry, stuck for 603s 01/02/2026 06:33:02 PM UTC [ERROR] ================================================================================ 01/02/2026 06:18:30 PM UTC [INFO] Job backup disabled (set BACKUP_FILE_LIFETIME env var to enable) 01/02/2026 06:18:32 PM UTC [INFO] Runtimes from KContext: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:18:32 PM UTC [INFO] Runtime types from KContext: [] 01/02/2026 06:18:32 PM UTC [INFO] Initializing runtimes: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:18:32 PM UTC [INFO] Filtering runtimes by name: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:18:32 PM UTC [WARNING] Runtime 'lava-qualcomm' not found in configuration 01/02/2026 06:18:32 PM UTC [INFO] Selected 11 runtime(s): ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:18:32 PM UTC [INFO] Default storage config from KContext: kci-storage 01/02/2026 06:18:32 PM UTC [INFO] Attempting to initialize storage config: kci-storage 01/02/2026 06:18:32 PM UTC [INFO] KContext get_storage_config returned: True 01/02/2026 06:18:32 PM UTC [INFO] KContext storage initialization successful: True 01/02/2026 06:18:32 PM UTC [INFO] Watchdog started with 600s timeout 01/02/2026 06:18:32 PM UTC [DEBUG] Node channel sub id: 102148 01/02/2026 06:18:32 PM UTC [DEBUG] Retry channel sub id: 102149 01/02/2026 06:18:32 PM UTC [INFO] Listening for available checkout events 01/02/2026 06:18:32 PM UTC [INFO] Press Ctrl-C to stop. 01/02/2026 06:18:32 PM UTC [INFO] Listening for available checkout events 01/02/2026 06:18:32 PM UTC [INFO] Press Ctrl-C to stop. 127.0.0.1 - - [02/Jan/2026 18:18:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:19:24] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:19:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:20:24] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:20:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:21:24] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:21:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:22:24] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:22:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:23:24] "GET /health HTTP/1.1" 200 - Exception in thread scheduler-retry: Traceback (most recent call last): File "/usr/local/lib/python3.12/threading.py", line 1075, in _bootstrap_inner self.run() File "/usr/local/lib/python3.12/threading.py", line 1012, in run self._target(*self._args, **self._kwargs) File "/home/kernelci/pipeline/./src/scheduler.py", line 667, in _run_scheduler self._run_job(job, runtime, platform, input_node, retry_counter) File "/home/kernelci/pipeline/./src/scheduler.py", line 350, in _run_job node = self._api_helper.create_job_node(job_config, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: APIHelper.create_job_node() takes 3 positional arguments but 6 were given 127.0.0.1 - - [02/Jan/2026 18:23:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:24:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:24:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:25:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:25:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:26:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:26:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:27:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:27:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:28:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:28:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:29:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:29:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:30:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:30:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:31:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:31:56] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:32:26] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:32:56] "GET /health HTTP/1.1" 200 - 01/02/2026 06:33:02 PM UTC [ERROR] WATCHDOG: Thread 'scheduler-retry' stuck for 603s (timeout: 600s). Forcing immediate exit! 01/02/2026 06:33:02 PM UTC [ERROR] ================================================================================ 01/02/2026 06:33:02 PM UTC [ERROR] STUCK THREAD DETECTED - FORCING EXIT 01/02/2026 06:33:02 PM UTC [ERROR] Thread: scheduler-retry, stuck for 603s 01/02/2026 06:33:02 PM UTC [ERROR] ================================================================================ 01/02/2026 06:33:04 PM UTC [INFO] Job backup disabled (set BACKUP_FILE_LIFETIME env var to enable) 01/02/2026 06:33:04 PM UTC [INFO] Runtimes from KContext: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:33:04 PM UTC [INFO] Runtime types from KContext: [] 01/02/2026 06:33:04 PM UTC [INFO] Initializing runtimes: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:33:04 PM UTC [INFO] Filtering runtimes by name: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:33:04 PM UTC [WARNING] Runtime 'lava-qualcomm' not found in configuration 01/02/2026 06:33:04 PM UTC [INFO] Selected 11 runtime(s): ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:33:04 PM UTC [INFO] Default storage config from KContext: kci-storage 01/02/2026 06:33:04 PM UTC [INFO] Attempting to initialize storage config: kci-storage 01/02/2026 06:33:04 PM UTC [INFO] KContext get_storage_config returned: True 01/02/2026 06:33:04 PM UTC [INFO] KContext storage initialization successful: True 01/02/2026 06:33:04 PM UTC [INFO] Watchdog started with 600s timeout 01/02/2026 06:33:04 PM UTC [DEBUG] Node channel sub id: 102158 01/02/2026 06:33:04 PM UTC [DEBUG] Retry channel sub id: 102159 01/02/2026 06:33:04 PM UTC [INFO] Listening for available checkout events 01/02/2026 06:33:04 PM UTC [INFO] Press Ctrl-C to stop. 01/02/2026 06:33:04 PM UTC [INFO] Listening for available checkout events 01/02/2026 06:33:04 PM UTC [INFO] Press Ctrl-C to stop. Exception in thread scheduler-retry: Traceback (most recent call last): File "/usr/local/lib/python3.12/threading.py", line 1075, in _bootstrap_inner self.run() File "/usr/local/lib/python3.12/threading.py", line 1012, in run self._target(*self._args, **self._kwargs) File "/home/kernelci/pipeline/./src/scheduler.py", line 667, in _run_scheduler self._run_job(job, runtime, platform, input_node, retry_counter) File "/home/kernelci/pipeline/./src/scheduler.py", line 350, in _run_job node = self._api_helper.create_job_node(job_config, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: APIHelper.create_job_node() takes 3 positional arguments but 6 were given 127.0.0.1 - - [02/Jan/2026 18:33:32] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:34:02] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:34:32] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:35:02] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:35:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:36:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:36:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:37:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:37:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:38:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:38:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:39:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:39:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:40:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:40:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:41:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:41:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:42:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:42:34] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:43:04] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:43:34] "GET /health HTTP/1.1" 200 - 01/02/2026 06:43:34 PM UTC [ERROR] WATCHDOG: Thread 'scheduler-retry' stuck for 630s (timeout: 600s). Forcing immediate exit! 01/02/2026 06:43:34 PM UTC [ERROR] ================================================================================ 01/02/2026 06:43:34 PM UTC [ERROR] STUCK THREAD DETECTED - FORCING EXIT 01/02/2026 06:43:34 PM UTC [ERROR] Thread: scheduler-retry, stuck for 630s 01/02/2026 06:43:34 PM UTC [ERROR] ================================================================================ 01/02/2026 06:18:30 PM UTC [INFO] Job backup disabled (set BACKUP_FILE_LIFETIME env var to enable) 01/02/2026 06:18:32 PM UTC [INFO] Runtimes from KContext: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:18:32 PM UTC [INFO] Runtime types from KContext: [] 01/02/2026 06:18:32 PM UTC [INFO] Initializing runtimes: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:18:32 PM UTC [INFO] Filtering runtimes by name: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:18:32 PM UTC [WARNING] Runtime 'lava-qualcomm' not found in configuration 01/02/2026 06:18:32 PM UTC [INFO] Selected 11 runtime(s): ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:18:32 PM UTC [INFO] Default storage config from KContext: kci-storage 01/02/2026 06:18:32 PM UTC [INFO] Attempting to initialize storage config: kci-storage 01/02/2026 06:18:32 PM UTC [INFO] KContext get_storage_config returned: True 01/02/2026 06:18:32 PM UTC [INFO] KContext storage initialization successful: True 01/02/2026 06:18:32 PM UTC [INFO] Watchdog started with 600s timeout 01/02/2026 06:18:32 PM UTC [DEBUG] Node channel sub id: 102148 01/02/2026 06:18:32 PM UTC [DEBUG] Retry channel sub id: 102149 01/02/2026 06:18:32 PM UTC [INFO] Listening for available checkout events 01/02/2026 06:18:32 PM UTC [INFO] Press Ctrl-C to stop. 01/02/2026 06:18:32 PM UTC [INFO] Listening for available checkout events 01/02/2026 06:18:32 PM UTC [INFO] Press Ctrl-C to stop. 127.0.0.1 - - [02/Jan/2026 18:18:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:19:24] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:19:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:20:24] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:20:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:21:24] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:21:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:22:24] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:22:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:23:24] "GET /health HTTP/1.1" 200 - Exception in thread scheduler-retry: Traceback (most recent call last): File "/usr/local/lib/python3.12/threading.py", line 1075, in _bootstrap_inner self.run() File "/usr/local/lib/python3.12/threading.py", line 1012, in run self._target(*self._args, **self._kwargs) File "/home/kernelci/pipeline/./src/scheduler.py", line 667, in _run_scheduler self._run_job(job, runtime, platform, input_node, retry_counter) File "/home/kernelci/pipeline/./src/scheduler.py", line 350, in _run_job node = self._api_helper.create_job_node(job_config, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: APIHelper.create_job_node() takes 3 positional arguments but 6 were given 127.0.0.1 - - [02/Jan/2026 18:23:54] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:24:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:24:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:25:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:25:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:26:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:26:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:27:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:27:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:28:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:28:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:29:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:29:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:30:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:30:55] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:31:25] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:31:56] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:32:26] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:32:56] "GET /health HTTP/1.1" 200 - 01/02/2026 06:33:02 PM UTC [ERROR] WATCHDOG: Thread 'scheduler-retry' stuck for 603s (timeout: 600s). Forcing immediate exit! 01/02/2026 06:33:02 PM UTC [ERROR] ================================================================================ 01/02/2026 06:33:02 PM UTC [ERROR] STUCK THREAD DETECTED - FORCING EXIT 01/02/2026 06:33:02 PM UTC [ERROR] Thread: scheduler-retry, stuck for 603s 01/02/2026 06:33:02 PM UTC [ERROR] ================================================================================ 01/02/2026 06:33:04 PM UTC [INFO] Job backup disabled (set BACKUP_FILE_LIFETIME env var to enable) 01/02/2026 06:33:04 PM UTC [INFO] Runtimes from KContext: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:33:04 PM UTC [INFO] Runtime types from KContext: [] 01/02/2026 06:33:04 PM UTC [INFO] Initializing runtimes: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:33:04 PM UTC [INFO] Filtering runtimes by name: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:33:04 PM UTC [WARNING] Runtime 'lava-qualcomm' not found in configuration 01/02/2026 06:33:04 PM UTC [INFO] Selected 11 runtime(s): ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:33:04 PM UTC [INFO] Default storage config from KContext: kci-storage 01/02/2026 06:33:04 PM UTC [INFO] Attempting to initialize storage config: kci-storage 01/02/2026 06:33:04 PM UTC [INFO] KContext get_storage_config returned: True 01/02/2026 06:33:04 PM UTC [INFO] KContext storage initialization successful: True 01/02/2026 06:33:04 PM UTC [INFO] Watchdog started with 600s timeout 01/02/2026 06:33:04 PM UTC [DEBUG] Node channel sub id: 102158 01/02/2026 06:33:04 PM UTC [DEBUG] Retry channel sub id: 102159 01/02/2026 06:33:04 PM UTC [INFO] Listening for available checkout events 01/02/2026 06:33:04 PM UTC [INFO] Press Ctrl-C to stop. 01/02/2026 06:33:04 PM UTC [INFO] Listening for available checkout events 01/02/2026 06:33:04 PM UTC [INFO] Press Ctrl-C to stop. Exception in thread scheduler-retry: Traceback (most recent call last): File "/usr/local/lib/python3.12/threading.py", line 1075, in _bootstrap_inner self.run() File "/usr/local/lib/python3.12/threading.py", line 1012, in run self._target(*self._args, **self._kwargs) File "/home/kernelci/pipeline/./src/scheduler.py", line 667, in _run_scheduler self._run_job(job, runtime, platform, input_node, retry_counter) File "/home/kernelci/pipeline/./src/scheduler.py", line 350, in _run_job node = self._api_helper.create_job_node(job_config, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: APIHelper.create_job_node() takes 3 positional arguments but 6 were given 127.0.0.1 - - [02/Jan/2026 18:33:32] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:34:02] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:34:32] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:35:02] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:35:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:36:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:36:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:37:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:37:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:38:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:38:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:39:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:39:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:40:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:40:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:41:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:41:33] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:42:03] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:42:34] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:43:04] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:43:34] "GET /health HTTP/1.1" 200 - 01/02/2026 06:43:34 PM UTC [ERROR] WATCHDOG: Thread 'scheduler-retry' stuck for 630s (timeout: 600s). Forcing immediate exit! 01/02/2026 06:43:34 PM UTC [ERROR] ================================================================================ 01/02/2026 06:43:34 PM UTC [ERROR] STUCK THREAD DETECTED - FORCING EXIT 01/02/2026 06:43:34 PM UTC [ERROR] Thread: scheduler-retry, stuck for 630s 01/02/2026 06:43:34 PM UTC [ERROR] ================================================================================ 01/02/2026 06:43:36 PM UTC [INFO] Job backup disabled (set BACKUP_FILE_LIFETIME env var to enable) 01/02/2026 06:43:37 PM UTC [INFO] Runtimes from KContext: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:43:37 PM UTC [INFO] Runtime types from KContext: [] 01/02/2026 06:43:37 PM UTC [INFO] Initializing runtimes: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:43:37 PM UTC [INFO] Filtering runtimes by name: ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-qualcomm', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:43:37 PM UTC [WARNING] Runtime 'lava-qualcomm' not found in configuration 01/02/2026 06:43:37 PM UTC [INFO] Selected 11 runtime(s): ['lava-collabora', 'lava-collabora-staging', 'lava-clabbe', 'lava-broonie', 'lava-baylibre', 'lava-cip', 'lava-pengutronix', 'lava-kontron', 'lava-foundriesio', 'lava-testpull', 'pull-labs-demo'] 01/02/2026 06:43:37 PM UTC [INFO] Default storage config from KContext: kci-storage 01/02/2026 06:43:37 PM UTC [INFO] Attempting to initialize storage config: kci-storage 01/02/2026 06:43:37 PM UTC [INFO] KContext get_storage_config returned: True 01/02/2026 06:43:37 PM UTC [INFO] KContext storage initialization successful: True 01/02/2026 06:43:37 PM UTC [INFO] Watchdog started with 600s timeout 01/02/2026 06:43:37 PM UTC [DEBUG] Node channel sub id: 102162 01/02/2026 06:43:37 PM UTC [DEBUG] Retry channel sub id: 102163 01/02/2026 06:43:37 PM UTC [INFO] Listening for available checkout events 01/02/2026 06:43:37 PM UTC [INFO] Press Ctrl-C to stop. 01/02/2026 06:43:37 PM UTC [INFO] Listening for available checkout events 01/02/2026 06:43:37 PM UTC [INFO] Press Ctrl-C to stop. Exception in thread scheduler-retry: Traceback (most recent call last): File "/usr/local/lib/python3.12/threading.py", line 1075, in _bootstrap_inner self.run() File "/usr/local/lib/python3.12/threading.py", line 1012, in run self._target(*self._args, **self._kwargs) File "/home/kernelci/pipeline/./src/scheduler.py", line 667, in _run_scheduler self._run_job(job, runtime, platform, input_node, retry_counter) File "/home/kernelci/pipeline/./src/scheduler.py", line 350, in _run_job node = self._api_helper.create_job_node(job_config, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: APIHelper.create_job_node() takes 3 positional arguments but 6 were given 127.0.0.1 - - [02/Jan/2026 18:44:05] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:44:35] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:45:05] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:45:35] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:46:05] "GET /health HTTP/1.1" 200 - 127.0.0.1 - - [02/Jan/2026 18:46:35] "GET /health HTTP/1.1" 200 - 01/02/2026 06:46:35 PM UTC [INFO] Stopping. 01/02/2026 06:46:35 PM UTC [INFO] Unsubscribing: 102162 01/02/2026 06:46:36 PM UTC [INFO] Unsubscribing: 102163