INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:26:58,337 - lava_callback - INFO - Received callback for node 69f9394dd09fe59064f02d40 2026-05-07 00:26:58,346 - lava_callback - INFO - Starting async job submit for node 69f9394dd09fe59064f02d40 INFO: 172.21.0.1:53338 - "POST /node/69f9394dd09fe59064f02d40 HTTP/1.0" 202 Accepted 2026-05-07 00:26:58,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:26:58,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9394dd09fe59064f02d40 HTTP/1.1" 200 None 2026-05-07 00:26:58,369 - lava_callback - DEBUG - Processing node 69f9394dd09fe59064f02d40: baseline-arm-clabbe 2026-05-07 00:26:58,369 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9394dd09fe59064f02d40 2026-05-07 00:26:58,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:26:58,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9394dd09fe59064f02d40 HTTP/1.1" 200 None 2026-05-07 00:26:58,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:26:58,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 00:26:58,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:26:58,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9394dd09fe59064f02d40 HTTP/1.1" 200 None 2026-05-07 00:26:58,419 - lava_callback - ERROR - Error processing callback for node 69f9394dd09fe59064f02d40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:28:58,394 - lava_callback - INFO - Received callback for node 69f939c4d09fe59064f02d53 INFO: 172.21.0.1:51410 - "POST /node/69f939c4d09fe59064f02d53 HTTP/1.0" 202 Accepted 2026-05-07 00:28:58,400 - lava_callback - INFO - Starting async job submit for node 69f939c4d09fe59064f02d53 2026-05-07 00:28:58,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:28:58,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f939c4d09fe59064f02d53 HTTP/1.1" 200 None 2026-05-07 00:28:58,416 - lava_callback - DEBUG - Processing node 69f939c4d09fe59064f02d53: baseline-arm-clabbe 2026-05-07 00:28:58,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f939c4d09fe59064f02d53 2026-05-07 00:28:58,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:28:58,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f939c4d09fe59064f02d53 HTTP/1.1" 200 None 2026-05-07 00:28:58,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:28:58,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 00:28:58,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:28:58,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f939c4d09fe59064f02d53 HTTP/1.1" 200 None 2026-05-07 00:28:58,470 - lava_callback - ERROR - Error processing callback for node 69f939c4d09fe59064f02d53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:29:38,380 - lava_callback - INFO - Received callback for node 69f939ebd09fe59064f02d61 INFO: 172.21.0.1:60414 - "POST /node/69f939ebd09fe59064f02d61 HTTP/1.0" 202 Accepted 2026-05-07 00:29:38,386 - lava_callback - INFO - Starting async job submit for node 69f939ebd09fe59064f02d61 2026-05-07 00:29:38,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:29:38,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f939ebd09fe59064f02d61 HTTP/1.1" 200 None 2026-05-07 00:29:38,400 - lava_callback - DEBUG - Processing node 69f939ebd09fe59064f02d61: baseline-arm-clabbe 2026-05-07 00:29:38,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f939ebd09fe59064f02d61 2026-05-07 00:29:38,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:29:38,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f939ebd09fe59064f02d61 HTTP/1.1" 200 None 2026-05-07 00:29:38,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:29:38,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 00:29:38,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:29:38,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f939ebd09fe59064f02d61 HTTP/1.1" 200 None 2026-05-07 00:29:38,471 - lava_callback - ERROR - Error processing callback for node 69f939ebd09fe59064f02d61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50894 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:30:18,404 - lava_callback - INFO - Received callback for node 69f93a13d09fe59064f02d6e INFO: 172.21.0.1:50898 - "POST /node/69f93a13d09fe59064f02d6e HTTP/1.0" 202 Accepted 2026-05-07 00:30:18,410 - lava_callback - INFO - Starting async job submit for node 69f93a13d09fe59064f02d6e 2026-05-07 00:30:18,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:30:18,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93a13d09fe59064f02d6e HTTP/1.1" 200 None 2026-05-07 00:30:18,428 - lava_callback - DEBUG - Processing node 69f93a13d09fe59064f02d6e: baseline-arm-clabbe 2026-05-07 00:30:18,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93a13d09fe59064f02d6e 2026-05-07 00:30:18,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:30:18,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93a13d09fe59064f02d6e HTTP/1.1" 200 None 2026-05-07 00:30:18,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:30:18,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 00:30:18,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:30:18,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93a13d09fe59064f02d6e HTTP/1.1" 200 None 2026-05-07 00:30:18,507 - lava_callback - ERROR - Error processing callback for node 69f93a13d09fe59064f02d6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:31:38,540 - lava_callback - INFO - Received callback for node 69f93a64d09fe59064f05464 INFO: 172.21.0.1:49700 - "POST /node/69f93a64d09fe59064f05464 HTTP/1.0" 202 Accepted 2026-05-07 00:31:38,547 - lava_callback - INFO - Starting async job submit for node 69f93a64d09fe59064f05464 2026-05-07 00:31:38,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:31:38,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93a64d09fe59064f05464 HTTP/1.1" 200 None 2026-05-07 00:31:38,565 - lava_callback - DEBUG - Processing node 69f93a64d09fe59064f05464: baseline-arm-clabbe 2026-05-07 00:31:38,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93a64d09fe59064f05464 2026-05-07 00:31:38,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:31:38,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93a64d09fe59064f05464 HTTP/1.1" 200 None 2026-05-07 00:31:38,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:31:38,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 00:31:38,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:31:38,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93a64d09fe59064f05464 HTTP/1.1" 200 None 2026-05-07 00:31:38,615 - lava_callback - ERROR - Error processing callback for node 69f93a64d09fe59064f05464: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:32:43,214 - lava_callback - INFO - Received callback for node 69fbdd96474a995a1884313a INFO: 172.21.0.1:33526 - "POST /node/69fbdd96474a995a1884313a HTTP/1.0" 202 Accepted 2026-05-07 00:32:43,220 - lava_callback - INFO - Starting async job submit for node 69fbdd96474a995a1884313a 2026-05-07 00:32:43,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:32:43,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdd96474a995a1884313a HTTP/1.1" 200 None 2026-05-07 00:32:43,259 - lava_callback - DEBUG - Processing node 69fbdd96474a995a1884313a: baseline-x86 2026-05-07 00:32:43,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:32:43,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:32:43,532 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd96474a995a1884313a/log.txt.gz 2026-05-07 00:32:43,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:32:43,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:32:43,772 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd96474a995a1884313a/lava-logs.yaml 2026-05-07 00:32:43,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:32:43,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:32:43,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd96474a995a1884313a/lava_callback.json.gz 2026-05-07 00:32:43,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:32:43,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdd96474a995a1884313a HTTP/1.1" 200 None 2026-05-07 00:32:43,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:32:43,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda28474a995a18840a31 HTTP/1.1" 200 None 2026-05-07 00:32:43,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:32:44,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdd96474a995a1884313a HTTP/1.1" 200 None 2026-05-07 00:32:44,013 - lava_callback - INFO - Completed processing callback for node 69fbdd96474a995a1884313a INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:32:51,141 - lava_callback - INFO - Received callback for node 69fbdd98474a995a18843143 INFO: 172.21.0.1:50290 - "POST /node/69fbdd98474a995a18843143 HTTP/1.0" 202 Accepted 2026-05-07 00:32:51,148 - lava_callback - INFO - Starting async job submit for node 69fbdd98474a995a18843143 2026-05-07 00:32:51,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:32:51,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdd98474a995a18843143 HTTP/1.1" 200 None 2026-05-07 00:32:51,190 - lava_callback - DEBUG - Processing node 69fbdd98474a995a18843143: baseline-x86 2026-05-07 00:32:51,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:32:51,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:32:51,508 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd98474a995a18843143/log.txt.gz 2026-05-07 00:32:51,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:32:51,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:32:51,741 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd98474a995a18843143/lava-logs.yaml 2026-05-07 00:32:51,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:32:51,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:32:51,843 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd98474a995a18843143/lava_callback.json.gz 2026-05-07 00:32:51,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:32:51,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdd98474a995a18843143 HTTP/1.1" 200 None 2026-05-07 00:32:51,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:32:51,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda28474a995a18840a31 HTTP/1.1" 200 None 2026-05-07 00:32:51,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:32:51,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdd98474a995a18843143 HTTP/1.1" 200 None 2026-05-07 00:32:51,957 - lava_callback - INFO - Completed processing callback for node 69fbdd98474a995a18843143 INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:32:58,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:32:58,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:33:35,304 - lava_callback - INFO - Received callback for node 69fbdd97474a995a1884313d INFO: 172.21.0.1:47592 - "POST /node/69fbdd97474a995a1884313d HTTP/1.0" 202 Accepted 2026-05-07 00:33:35,310 - lava_callback - INFO - Starting async job submit for node 69fbdd97474a995a1884313d 2026-05-07 00:33:35,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:35,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdd97474a995a1884313d HTTP/1.1" 200 None 2026-05-07 00:33:35,344 - lava_callback - DEBUG - Processing node 69fbdd97474a995a1884313d: baseline-x86 2026-05-07 00:33:35,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:33:35,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:33:35,798 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd97474a995a1884313d/log.txt.gz 2026-05-07 00:33:35,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:33:36,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:33:36,130 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd97474a995a1884313d/lava-logs.yaml 2026-05-07 00:33:36,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:33:36,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:33:36,244 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd97474a995a1884313d/lava_callback.json.gz 2026-05-07 00:33:36,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:36,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdd97474a995a1884313d HTTP/1.1" 200 None 2026-05-07 00:33:36,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:36,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda28474a995a18840a31 HTTP/1.1" 200 None 2026-05-07 00:33:36,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:36,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdd97474a995a1884313d HTTP/1.1" 200 None 2026-05-07 00:33:36,325 - lava_callback - INFO - Completed processing callback for node 69fbdd97474a995a1884313d INFO: 172.21.0.1:47602 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:33:38,596 - lava_callback - INFO - Received callback for node 69f93acdd09fe59064f054ab INFO: 172.21.0.1:47616 - "POST /node/69f93acdd09fe59064f054ab HTTP/1.0" 202 Accepted 2026-05-07 00:33:38,602 - lava_callback - INFO - Starting async job submit for node 69f93acdd09fe59064f054ab 2026-05-07 00:33:38,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:38,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93acdd09fe59064f054ab HTTP/1.1" 200 None 2026-05-07 00:33:38,618 - lava_callback - DEBUG - Processing node 69f93acdd09fe59064f054ab: baseline-arm-clabbe 2026-05-07 00:33:38,618 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93acdd09fe59064f054ab 2026-05-07 00:33:38,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:38,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93acdd09fe59064f054ab HTTP/1.1" 200 None 2026-05-07 00:33:38,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:38,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 00:33:38,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:38,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93acdd09fe59064f054ab HTTP/1.1" 200 None 2026-05-07 00:33:38,669 - lava_callback - ERROR - Error processing callback for node 69f93acdd09fe59064f054ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:33:48,484 - lava_callback - INFO - Received callback for node 69fbdd99474a995a18843146 INFO: 172.21.0.1:37812 - "POST /node/69fbdd99474a995a18843146 HTTP/1.0" 202 Accepted 2026-05-07 00:33:48,493 - lava_callback - INFO - Starting async job submit for node 69fbdd99474a995a18843146 2026-05-07 00:33:48,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:48,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdd99474a995a18843146 HTTP/1.1" 200 None 2026-05-07 00:33:48,544 - lava_callback - DEBUG - Processing node 69fbdd99474a995a18843146: baseline-x86 2026-05-07 00:33:48,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:33:49,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:33:49,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd99474a995a18843146/log.txt.gz 2026-05-07 00:33:49,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:33:49,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:33:49,549 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd99474a995a18843146/lava-logs.yaml 2026-05-07 00:33:49,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:33:49,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:33:49,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd99474a995a18843146/lava_callback.json.gz 2026-05-07 00:33:49,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:49,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdd99474a995a18843146 HTTP/1.1" 200 None 2026-05-07 00:33:49,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:49,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda28474a995a18840a31 HTTP/1.1" 200 None 2026-05-07 00:33:49,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:49,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdd99474a995a18843146 HTTP/1.1" 200 None 2026-05-07 00:33:49,820 - lava_callback - INFO - Completed processing callback for node 69fbdd99474a995a18843146 INFO: 172.21.0.1:60134 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:33:58,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:33:58,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50354 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:35:18,673 - lava_callback - INFO - Received callback for node 69f93b31d09fe59064f054c0 INFO: 172.21.0.1:50370 - "POST /node/69f93b31d09fe59064f054c0 HTTP/1.0" 202 Accepted 2026-05-07 00:35:18,682 - lava_callback - INFO - Starting async job submit for node 69f93b31d09fe59064f054c0 2026-05-07 00:35:18,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:35:18,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93b31d09fe59064f054c0 HTTP/1.1" 200 None 2026-05-07 00:35:18,705 - lava_callback - DEBUG - Processing node 69f93b31d09fe59064f054c0: baseline-arm-clabbe 2026-05-07 00:35:18,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93b31d09fe59064f054c0 2026-05-07 00:35:18,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:35:18,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93b31d09fe59064f054c0 HTTP/1.1" 200 None 2026-05-07 00:35:18,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:35:18,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 00:35:18,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:35:18,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93b31d09fe59064f054c0 HTTP/1.1" 200 None 2026-05-07 00:35:18,755 - lava_callback - ERROR - Error processing callback for node 69f93b31d09fe59064f054c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35232 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:36:12,684 - lava_callback - INFO - Received callback for node 69fbddfb474a995a18843181 INFO: 172.21.0.1:33114 - "POST /node/69fbddfb474a995a18843181 HTTP/1.0" 202 Accepted 2026-05-07 00:36:12,700 - lava_callback - INFO - Starting async job submit for node 69fbddfb474a995a18843181 2026-05-07 00:36:12,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:36:12,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbddfb474a995a18843181 HTTP/1.1" 200 None 2026-05-07 00:36:12,768 - lava_callback - DEBUG - Processing node 69fbddfb474a995a18843181: baseline-arm 2026-05-07 00:36:13,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:36:13,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:36:13,346 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fbddfb474a995a18843181/log.txt.gz 2026-05-07 00:36:13,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:36:13,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:36:13,827 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbddfb474a995a18843181/lava-logs.yaml 2026-05-07 00:36:13,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:36:14,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:36:14,027 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbddfb474a995a18843181/lava_callback.json.gz 2026-05-07 00:36:14,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:36:14,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbddfb474a995a18843181 HTTP/1.1" 200 None 2026-05-07 00:36:14,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:36:14,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda05474a995a18840a0a HTTP/1.1" 200 None 2026-05-07 00:36:14,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:36:14,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbddfb474a995a18843181 HTTP/1.1" 200 None 2026-05-07 00:36:14,187 - lava_callback - INFO - Completed processing callback for node 69fbddfb474a995a18843181 INFO: 172.21.0.1:33132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:36:28,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:36:28,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:36:58,713 - lava_callback - INFO - Received callback for node 69f93b9cd09fe59064f054d7 INFO: 172.21.0.1:42314 - "POST /node/69f93b9cd09fe59064f054d7 HTTP/1.0" 202 Accepted 2026-05-07 00:36:58,719 - lava_callback - INFO - Starting async job submit for node 69f93b9cd09fe59064f054d7 2026-05-07 00:36:58,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:36:58,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93b9cd09fe59064f054d7 HTTP/1.1" 200 None 2026-05-07 00:36:58,735 - lava_callback - DEBUG - Processing node 69f93b9cd09fe59064f054d7: baseline-arm-clabbe 2026-05-07 00:36:58,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93b9cd09fe59064f054d7 2026-05-07 00:36:58,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:36:58,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93b9cd09fe59064f054d7 HTTP/1.1" 200 None 2026-05-07 00:36:58,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:36:58,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 00:36:58,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:36:58,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93b9cd09fe59064f054d7 HTTP/1.1" 200 None 2026-05-07 00:36:58,801 - lava_callback - ERROR - Error processing callback for node 69f93b9cd09fe59064f054d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:37:38,694 - lava_callback - INFO - Received callback for node 69f93bc2d09fe59064f054ef INFO: 172.21.0.1:40356 - "POST /node/69f93bc2d09fe59064f054ef HTTP/1.0" 202 Accepted 2026-05-07 00:37:38,699 - lava_callback - INFO - Starting async job submit for node 69f93bc2d09fe59064f054ef 2026-05-07 00:37:38,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:37:38,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93bc2d09fe59064f054ef HTTP/1.1" 200 None 2026-05-07 00:37:38,715 - lava_callback - DEBUG - Processing node 69f93bc2d09fe59064f054ef: baseline-arm-clabbe 2026-05-07 00:37:38,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93bc2d09fe59064f054ef 2026-05-07 00:37:38,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:37:38,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93bc2d09fe59064f054ef HTTP/1.1" 200 None 2026-05-07 00:37:38,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:37:38,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 00:37:38,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:37:38,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93bc2d09fe59064f054ef HTTP/1.1" 200 None 2026-05-07 00:37:38,760 - lava_callback - ERROR - Error processing callback for node 69f93bc2d09fe59064f054ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42534 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:39:58,749 - lava_callback - INFO - Received callback for node 69f93c58d09fe59064f054ff INFO: 172.21.0.1:42546 - "POST /node/69f93c58d09fe59064f054ff HTTP/1.0" 202 Accepted 2026-05-07 00:39:58,756 - lava_callback - INFO - Starting async job submit for node 69f93c58d09fe59064f054ff 2026-05-07 00:39:58,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:39:58,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c58d09fe59064f054ff HTTP/1.1" 200 None 2026-05-07 00:39:58,775 - lava_callback - DEBUG - Processing node 69f93c58d09fe59064f054ff: baseline-arm-clabbe 2026-05-07 00:39:58,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c58d09fe59064f054ff 2026-05-07 00:39:58,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:39:58,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c58d09fe59064f054ff HTTP/1.1" 200 None 2026-05-07 00:39:58,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:39:58,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 00:39:58,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:39:58,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c58d09fe59064f054ff HTTP/1.1" 200 None 2026-05-07 00:39:58,879 - lava_callback - ERROR - Error processing callback for node 69f93c58d09fe59064f054ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:40:21,914 - lava_callback - INFO - Received callback for node 69f93c6dd09fe59064f0551d INFO: 172.21.0.1:58014 - "POST /node/69f93c6dd09fe59064f0551d HTTP/1.0" 202 Accepted 2026-05-07 00:40:21,940 - lava_callback - INFO - Starting async job submit for node 69f93c6dd09fe59064f0551d 2026-05-07 00:40:21,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:21,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c6dd09fe59064f0551d HTTP/1.1" 200 None 2026-05-07 00:40:21,970 - lava_callback - DEBUG - Processing node 69f93c6dd09fe59064f0551d: baseline-arm-baylibre 2026-05-07 00:40:21,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c6dd09fe59064f0551d 2026-05-07 00:40:21,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:21,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c6dd09fe59064f0551d HTTP/1.1" 200 None 2026-05-07 00:40:21,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:22,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 00:40:22,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:22,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c6dd09fe59064f0551d HTTP/1.1" 200 None 2026-05-07 00:40:22,030 - lava_callback - ERROR - Error processing callback for node 69f93c6dd09fe59064f0551d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:40:22,583 - lava_callback - INFO - Received callback for node 69f93c6ed09fe59064f05521 INFO: 172.21.0.1:58020 - "POST /node/69f93c6ed09fe59064f05521 HTTP/1.0" 202 Accepted 2026-05-07 00:40:22,589 - lava_callback - INFO - Starting async job submit for node 69f93c6ed09fe59064f05521 2026-05-07 00:40:22,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:22,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c6ed09fe59064f05521 HTTP/1.1" 200 None 2026-05-07 00:40:22,604 - lava_callback - DEBUG - Processing node 69f93c6ed09fe59064f05521: baseline-arm-baylibre 2026-05-07 00:40:22,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c6ed09fe59064f05521 2026-05-07 00:40:22,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:22,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c6ed09fe59064f05521 HTTP/1.1" 200 None 2026-05-07 00:40:22,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:22,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 00:40:22,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:22,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c6ed09fe59064f05521 HTTP/1.1" 200 None 2026-05-07 00:40:22,664 - lava_callback - ERROR - Error processing callback for node 69f93c6ed09fe59064f05521: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:40:23,224 - lava_callback - INFO - Received callback for node 69f93c70d09fe59064f05536 INFO: 172.21.0.1:58022 - "POST /node/69f93c70d09fe59064f05536 HTTP/1.0" 202 Accepted 2026-05-07 00:40:23,230 - lava_callback - INFO - Starting async job submit for node 69f93c70d09fe59064f05536 2026-05-07 00:40:23,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:23,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c70d09fe59064f05536 HTTP/1.1" 200 None 2026-05-07 00:40:23,249 - lava_callback - DEBUG - Processing node 69f93c70d09fe59064f05536: baseline-arm-baylibre 2026-05-07 00:40:23,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c70d09fe59064f05536 2026-05-07 00:40:23,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:23,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c70d09fe59064f05536 HTTP/1.1" 200 None 2026-05-07 00:40:23,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:23,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 00:40:23,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:23,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c70d09fe59064f05536 HTTP/1.1" 200 None 2026-05-07 00:40:23,356 - lava_callback - ERROR - Error processing callback for node 69f93c70d09fe59064f05536: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:40:23,895 - lava_callback - INFO - Received callback for node 69f93c71d09fe59064f05539 INFO: 172.21.0.1:58030 - "POST /node/69f93c71d09fe59064f05539 HTTP/1.0" 202 Accepted 2026-05-07 00:40:23,904 - lava_callback - INFO - Starting async job submit for node 69f93c71d09fe59064f05539 2026-05-07 00:40:23,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:23,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c71d09fe59064f05539 HTTP/1.1" 200 None 2026-05-07 00:40:23,929 - lava_callback - DEBUG - Processing node 69f93c71d09fe59064f05539: baseline-arm-baylibre 2026-05-07 00:40:23,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c71d09fe59064f05539 2026-05-07 00:40:23,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:23,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c71d09fe59064f05539 HTTP/1.1" 200 None 2026-05-07 00:40:23,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:23,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 00:40:23,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:23,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c71d09fe59064f05539 HTTP/1.1" 200 None 2026-05-07 00:40:23,981 - lava_callback - ERROR - Error processing callback for node 69f93c71d09fe59064f05539: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:40:24,566 - lava_callback - INFO - Received callback for node 69f93c73d09fe59064f05544 INFO: 172.21.0.1:58032 - "POST /node/69f93c73d09fe59064f05544 HTTP/1.0" 202 Accepted 2026-05-07 00:40:24,572 - lava_callback - INFO - Starting async job submit for node 69f93c73d09fe59064f05544 2026-05-07 00:40:24,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:24,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c73d09fe59064f05544 HTTP/1.1" 200 None 2026-05-07 00:40:24,589 - lava_callback - DEBUG - Processing node 69f93c73d09fe59064f05544: baseline-arm-baylibre 2026-05-07 00:40:24,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c73d09fe59064f05544 2026-05-07 00:40:24,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:24,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c73d09fe59064f05544 HTTP/1.1" 200 None 2026-05-07 00:40:24,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:24,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 00:40:24,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:24,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c73d09fe59064f05544 HTTP/1.1" 200 None 2026-05-07 00:40:24,639 - lava_callback - ERROR - Error processing callback for node 69f93c73d09fe59064f05544: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:40:25,573 - lava_callback - INFO - Received callback for node 69fbdf66474a995a188431c7 INFO: 172.21.0.1:58048 - "POST /node/69fbdf66474a995a188431c7 HTTP/1.0" 202 Accepted 2026-05-07 00:40:25,581 - lava_callback - INFO - Starting async job submit for node 69fbdf66474a995a188431c7 2026-05-07 00:40:25,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:25,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf66474a995a188431c7 HTTP/1.1" 200 None 2026-05-07 00:40:25,611 - lava_callback - DEBUG - Processing node 69fbdf66474a995a188431c7: baseline-arm 2026-05-07 00:40:25,619 - lava_callback - WARNING - Failed to upload log 2026-05-07 00:40:25,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:40:25,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:40:25,740 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf66474a995a188431c7/lava-logs.yaml 2026-05-07 00:40:25,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:40:25,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:40:25,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf66474a995a188431c7/lava_callback.json.gz 2026-05-07 00:40:25,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:25,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf66474a995a188431c7 HTTP/1.1" 200 None 2026-05-07 00:40:25,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:25,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:40:25,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:25,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf66474a995a188431c7 HTTP/1.1" 200 None 2026-05-07 00:40:25,930 - lava_callback - INFO - Completed processing callback for node 69fbdf66474a995a188431c7 INFO: 172.21.0.1:58050 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:40:28,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:28,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53264 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:40:38,906 - lava_callback - INFO - Received callback for node 69f93c7cd09fe59064f05560 INFO: 172.21.0.1:53278 - "POST /node/69f93c7cd09fe59064f05560 HTTP/1.0" 202 Accepted 2026-05-07 00:40:38,912 - lava_callback - INFO - Starting async job submit for node 69f93c7cd09fe59064f05560 2026-05-07 00:40:38,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:38,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c7cd09fe59064f05560 HTTP/1.1" 200 None 2026-05-07 00:40:38,930 - lava_callback - DEBUG - Processing node 69f93c7cd09fe59064f05560: baseline-arm-clabbe 2026-05-07 00:40:38,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c7cd09fe59064f05560 2026-05-07 00:40:38,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:38,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c7cd09fe59064f05560 HTTP/1.1" 200 None 2026-05-07 00:40:38,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:38,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 00:40:38,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:38,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c7cd09fe59064f05560 HTTP/1.1" 200 None 2026-05-07 00:40:38,975 - lava_callback - ERROR - Error processing callback for node 69f93c7cd09fe59064f05560: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:40:39,670 - lava_callback - INFO - Received callback for node 69f93c80d09fe59064f05571 INFO: 172.21.0.1:53294 - "POST /node/69f93c80d09fe59064f05571 HTTP/1.0" 202 Accepted 2026-05-07 00:40:39,676 - lava_callback - INFO - Starting async job submit for node 69f93c80d09fe59064f05571 2026-05-07 00:40:39,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:39,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c80d09fe59064f05571 HTTP/1.1" 200 None 2026-05-07 00:40:39,691 - lava_callback - DEBUG - Processing node 69f93c80d09fe59064f05571: baseline-arm-clabbe 2026-05-07 00:40:39,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c80d09fe59064f05571 2026-05-07 00:40:39,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:39,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c80d09fe59064f05571 HTTP/1.1" 200 None 2026-05-07 00:40:39,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:39,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 00:40:39,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:39,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c80d09fe59064f05571 HTTP/1.1" 200 None 2026-05-07 00:40:39,735 - lava_callback - ERROR - Error processing callback for node 69f93c80d09fe59064f05571: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:40:40,335 - lava_callback - INFO - Received callback for node 69f93c80d09fe59064f05574 INFO: 172.21.0.1:41862 - "POST /node/69f93c80d09fe59064f05574 HTTP/1.0" 202 Accepted 2026-05-07 00:40:40,344 - lava_callback - INFO - Starting async job submit for node 69f93c80d09fe59064f05574 2026-05-07 00:40:40,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:40,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c80d09fe59064f05574 HTTP/1.1" 200 None 2026-05-07 00:40:40,370 - lava_callback - DEBUG - Processing node 69f93c80d09fe59064f05574: baseline-arm-clabbe 2026-05-07 00:40:40,370 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c80d09fe59064f05574 2026-05-07 00:40:40,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:40,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c80d09fe59064f05574 HTTP/1.1" 200 None 2026-05-07 00:40:40,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:40,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 00:40:40,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:40,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c80d09fe59064f05574 HTTP/1.1" 200 None 2026-05-07 00:40:40,435 - lava_callback - ERROR - Error processing callback for node 69f93c80d09fe59064f05574: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:40:40,992 - lava_callback - INFO - Received callback for node 69f93c81d09fe59064f05577 INFO: 172.21.0.1:41866 - "POST /node/69f93c81d09fe59064f05577 HTTP/1.0" 202 Accepted 2026-05-07 00:40:41,001 - lava_callback - INFO - Starting async job submit for node 69f93c81d09fe59064f05577 2026-05-07 00:40:41,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:41,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c81d09fe59064f05577 HTTP/1.1" 200 None 2026-05-07 00:40:41,021 - lava_callback - DEBUG - Processing node 69f93c81d09fe59064f05577: baseline-arm-clabbe 2026-05-07 00:40:41,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c81d09fe59064f05577 2026-05-07 00:40:41,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:41,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c81d09fe59064f05577 HTTP/1.1" 200 None 2026-05-07 00:40:41,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:41,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 00:40:41,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:41,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c81d09fe59064f05577 HTTP/1.1" 200 None 2026-05-07 00:40:41,099 - lava_callback - ERROR - Error processing callback for node 69f93c81d09fe59064f05577: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:40:41,692 - lava_callback - INFO - Received callback for node 69f93c82d09fe59064f0557a INFO: 172.21.0.1:41874 - "POST /node/69f93c82d09fe59064f0557a HTTP/1.0" 202 Accepted 2026-05-07 00:40:41,698 - lava_callback - INFO - Starting async job submit for node 69f93c82d09fe59064f0557a 2026-05-07 00:40:41,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:41,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c82d09fe59064f0557a HTTP/1.1" 200 None 2026-05-07 00:40:41,726 - lava_callback - DEBUG - Processing node 69f93c82d09fe59064f0557a: baseline-arm-clabbe 2026-05-07 00:40:41,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c82d09fe59064f0557a 2026-05-07 00:40:41,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:41,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c82d09fe59064f0557a HTTP/1.1" 200 None 2026-05-07 00:40:41,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:41,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 00:40:41,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:41,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c82d09fe59064f0557a HTTP/1.1" 200 None 2026-05-07 00:40:41,791 - lava_callback - ERROR - Error processing callback for node 69f93c82d09fe59064f0557a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:40:41,808 - lava_callback - INFO - Received callback for node 69f93c74d09fe59064f05547 INFO: 172.21.0.1:41880 - "POST /node/69f93c74d09fe59064f05547 HTTP/1.0" 202 Accepted 2026-05-07 00:40:41,828 - lava_callback - INFO - Starting async job submit for node 69f93c74d09fe59064f05547 2026-05-07 00:40:41,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:41,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c74d09fe59064f05547 HTTP/1.1" 200 None 2026-05-07 00:40:41,863 - lava_callback - DEBUG - Processing node 69f93c74d09fe59064f05547: baseline-arm-baylibre 2026-05-07 00:40:41,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c74d09fe59064f05547 2026-05-07 00:40:41,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:41,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c74d09fe59064f05547 HTTP/1.1" 200 None 2026-05-07 00:40:41,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:41,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 00:40:41,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:41,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c74d09fe59064f05547 HTTP/1.1" 200 None 2026-05-07 00:40:41,980 - lava_callback - ERROR - Error processing callback for node 69f93c74d09fe59064f05547: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:40:42,360 - lava_callback - INFO - Received callback for node 69f93c84d09fe59064f05580 INFO: 172.21.0.1:41884 - "POST /node/69f93c84d09fe59064f05580 HTTP/1.0" 202 Accepted 2026-05-07 00:40:42,367 - lava_callback - INFO - Starting async job submit for node 69f93c84d09fe59064f05580 2026-05-07 00:40:42,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:42,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c84d09fe59064f05580 HTTP/1.1" 200 None 2026-05-07 00:40:42,382 - lava_callback - DEBUG - Processing node 69f93c84d09fe59064f05580: baseline-arm-clabbe 2026-05-07 00:40:42,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93c84d09fe59064f05580 2026-05-07 00:40:42,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:42,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93c84d09fe59064f05580 HTTP/1.1" 200 None 2026-05-07 00:40:42,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:42,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 00:40:42,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:42,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93c84d09fe59064f05580 HTTP/1.1" 200 None 2026-05-07 00:40:42,431 - lava_callback - ERROR - Error processing callback for node 69f93c84d09fe59064f05580: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41894 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:40:53,457 - lava_callback - INFO - Received callback for node 69fbdf67474a995a188431ca INFO: 172.21.0.1:40504 - "POST /node/69fbdf67474a995a188431ca HTTP/1.0" 202 Accepted 2026-05-07 00:40:53,506 - lava_callback - INFO - Starting async job submit for node 69fbdf67474a995a188431ca 2026-05-07 00:40:53,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:53,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf67474a995a188431ca HTTP/1.1" 200 None 2026-05-07 00:40:53,557 - lava_callback - DEBUG - Processing node 69fbdf67474a995a188431ca: baseline-arm 2026-05-07 00:40:53,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:40:53,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:40:53,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf67474a995a188431ca/log.txt.gz 2026-05-07 00:40:53,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:40:53,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:40:53,985 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf67474a995a188431ca/lava-logs.yaml 2026-05-07 00:40:53,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:40:54,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:40:54,095 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf67474a995a188431ca/lava_callback.json.gz 2026-05-07 00:40:54,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:54,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf67474a995a188431ca HTTP/1.1" 200 None 2026-05-07 00:40:54,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:54,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:40:54,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:54,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf67474a995a188431ca HTTP/1.1" 200 None 2026-05-07 00:40:54,175 - lava_callback - INFO - Completed processing callback for node 69fbdf67474a995a188431ca INFO: 172.21.0.1:40518 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:40:57,273 - lava_callback - INFO - Received callback for node 69fbdf6a474a995a188431d3 INFO: 172.21.0.1:40530 - "POST /node/69fbdf6a474a995a188431d3 HTTP/1.0" 202 Accepted 2026-05-07 00:40:57,323 - lava_callback - INFO - Starting async job submit for node 69fbdf6a474a995a188431d3 2026-05-07 00:40:57,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:57,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf6a474a995a188431d3 HTTP/1.1" 200 None 2026-05-07 00:40:57,359 - lava_callback - DEBUG - Processing node 69fbdf6a474a995a188431d3: baseline-arm 2026-05-07 00:40:57,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:40:57,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:40:57,600 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf6a474a995a188431d3/log.txt.gz 2026-05-07 00:40:57,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:40:57,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:40:57,828 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf6a474a995a188431d3/lava-logs.yaml 2026-05-07 00:40:57,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:40:57,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:40:57,946 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf6a474a995a188431d3/lava_callback.json.gz 2026-05-07 00:40:57,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:57,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf6a474a995a188431d3 HTTP/1.1" 200 None 2026-05-07 00:40:57,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:58,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:40:58,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:58,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf6a474a995a188431d3 HTTP/1.1" 200 None 2026-05-07 00:40:58,038 - lava_callback - INFO - Completed processing callback for node 69fbdf6a474a995a188431d3 2026-05-07 00:40:58,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:40:58,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39794 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:41:26,391 - lava_callback - INFO - Received callback for node 69fbdf69474a995a188431d0 INFO: 172.21.0.1:51128 - "POST /node/69fbdf69474a995a188431d0 HTTP/1.0" 202 Accepted 2026-05-07 00:41:26,399 - lava_callback - INFO - Starting async job submit for node 69fbdf69474a995a188431d0 2026-05-07 00:41:26,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:26,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf69474a995a188431d0 HTTP/1.1" 200 None 2026-05-07 00:41:26,439 - lava_callback - DEBUG - Processing node 69fbdf69474a995a188431d0: baseline-arm INFO: 172.21.0.1:51136 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:41:26,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:26,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:26,863 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf69474a995a188431d0/log.txt.gz 2026-05-07 00:41:27,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:27,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:27,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf69474a995a188431d0/lava-logs.yaml 2026-05-07 00:41:27,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:27,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:27,325 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf69474a995a188431d0/lava_callback.json.gz 2026-05-07 00:41:27,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:27,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf69474a995a188431d0 HTTP/1.1" 200 None 2026-05-07 00:41:27,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:27,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:41:27,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:27,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf69474a995a188431d0 HTTP/1.1" 200 None 2026-05-07 00:41:27,398 - lava_callback - INFO - Completed processing callback for node 69fbdf69474a995a188431d0 2026-05-07 00:41:28,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:28,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:41:38,044 - lava_callback - INFO - Received callback for node 69fbdf66474a995a188431c2 INFO: 172.21.0.1:50510 - "POST /node/69fbdf66474a995a188431c2 HTTP/1.0" 202 Accepted 2026-05-07 00:41:38,050 - lava_callback - INFO - Starting async job submit for node 69fbdf66474a995a188431c2 2026-05-07 00:41:38,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:38,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf66474a995a188431c2 HTTP/1.1" 200 None 2026-05-07 00:41:38,087 - lava_callback - DEBUG - Processing node 69fbdf66474a995a188431c2: baseline-arm 2026-05-07 00:41:38,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:38,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:38,392 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf66474a995a188431c2/log.txt.gz 2026-05-07 00:41:38,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:38,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:38,674 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf66474a995a188431c2/lava-logs.yaml 2026-05-07 00:41:38,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:38,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:38,789 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf66474a995a188431c2/lava_callback.json.gz 2026-05-07 00:41:38,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:38,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf66474a995a188431c2 HTTP/1.1" 200 None 2026-05-07 00:41:38,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:38,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:41:38,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:38,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf66474a995a188431c2 HTTP/1.1" 200 None 2026-05-07 00:41:38,882 - lava_callback - INFO - Completed processing callback for node 69fbdf66474a995a188431c2 2026-05-07 00:41:41,320 - lava_callback - INFO - Received callback for node 69fbdf8d474a995a1884327f INFO: 172.21.0.1:55724 - "POST /node/69fbdf8d474a995a1884327f HTTP/1.0" 202 Accepted 2026-05-07 00:41:41,369 - lava_callback - INFO - Starting async job submit for node 69fbdf8d474a995a1884327f 2026-05-07 00:41:41,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:41,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf8d474a995a1884327f HTTP/1.1" 200 None 2026-05-07 00:41:41,418 - lava_callback - DEBUG - Processing node 69fbdf8d474a995a1884327f: baseline-arm-pengutronix 2026-05-07 00:41:41,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:41,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:41,607 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbdf8d474a995a1884327f/log.txt.gz 2026-05-07 00:41:41,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:41,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:41,809 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbdf8d474a995a1884327f/lava-logs.yaml 2026-05-07 00:41:41,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:41,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:41,907 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbdf8d474a995a1884327f/lava_callback.json.gz 2026-05-07 00:41:41,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:42,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf8d474a995a1884327f HTTP/1.1" 200 None 2026-05-07 00:41:42,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:42,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:41:42,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:42,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf8d474a995a1884327f HTTP/1.1" 200 None 2026-05-07 00:41:42,091 - lava_callback - INFO - Completed processing callback for node 69fbdf8d474a995a1884327f 2026-05-07 00:41:44,200 - lava_callback - INFO - Received callback for node 69fbdf89474a995a1884326f INFO: 172.21.0.1:55732 - "POST /node/69fbdf89474a995a1884326f HTTP/1.0" 202 Accepted 2026-05-07 00:41:44,206 - lava_callback - INFO - Starting async job submit for node 69fbdf89474a995a1884326f 2026-05-07 00:41:44,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:44,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf89474a995a1884326f HTTP/1.1" 200 None 2026-05-07 00:41:44,240 - lava_callback - DEBUG - Processing node 69fbdf89474a995a1884326f: baseline-arm-pengutronix 2026-05-07 00:41:44,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:44,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:44,457 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbdf89474a995a1884326f/log.txt.gz 2026-05-07 00:41:44,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:44,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:44,670 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbdf89474a995a1884326f/lava-logs.yaml 2026-05-07 00:41:44,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:44,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:44,771 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbdf89474a995a1884326f/lava_callback.json.gz 2026-05-07 00:41:44,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:44,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf89474a995a1884326f HTTP/1.1" 200 None 2026-05-07 00:41:44,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:44,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:41:44,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:44,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf89474a995a1884326f HTTP/1.1" 200 None 2026-05-07 00:41:44,839 - lava_callback - INFO - Completed processing callback for node 69fbdf89474a995a1884326f 2026-05-07 00:41:45,386 - lava_callback - INFO - Received callback for node 69fbdf8a474a995a18843279 INFO: 172.21.0.1:55748 - "POST /node/69fbdf8a474a995a18843279 HTTP/1.0" 202 Accepted 2026-05-07 00:41:45,393 - lava_callback - INFO - Starting async job submit for node 69fbdf8a474a995a18843279 2026-05-07 00:41:45,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:45,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf8a474a995a18843279 HTTP/1.1" 200 None 2026-05-07 00:41:45,432 - lava_callback - DEBUG - Processing node 69fbdf8a474a995a18843279: baseline-arm-pengutronix 2026-05-07 00:41:45,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:45,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:45,663 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbdf8a474a995a18843279/log.txt.gz 2026-05-07 00:41:45,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:46,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:46,053 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbdf8a474a995a18843279/lava-logs.yaml 2026-05-07 00:41:46,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:41:46,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:41:46,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbdf8a474a995a18843279/lava_callback.json.gz 2026-05-07 00:41:46,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:46,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf8a474a995a18843279 HTTP/1.1" 200 None 2026-05-07 00:41:46,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:46,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:41:46,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:46,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf8a474a995a18843279 HTTP/1.1" 200 None 2026-05-07 00:41:46,232 - lava_callback - INFO - Completed processing callback for node 69fbdf8a474a995a18843279 INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35382 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:41:58,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:41:58,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-07 00:42:00,911 - lava_callback - INFO - Received callback for node 69fbdf7a474a995a18843209 INFO: 172.21.0.1:60754 - "POST /node/69fbdf7a474a995a18843209 HTTP/1.0" 202 Accepted 2026-05-07 00:42:00,917 - lava_callback - INFO - Starting async job submit for node 69fbdf7a474a995a18843209 2026-05-07 00:42:00,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:00,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf7a474a995a18843209 HTTP/1.1" 200 None 2026-05-07 00:42:00,954 - lava_callback - DEBUG - Processing node 69fbdf7a474a995a18843209: baseline-arm-broonie 2026-05-07 00:42:01,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:01,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:01,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fbdf7a474a995a18843209/log.txt.gz 2026-05-07 00:42:01,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:01,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:01,547 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fbdf7a474a995a18843209/lava-logs.yaml 2026-05-07 00:42:01,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:01,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:01,657 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fbdf7a474a995a18843209/lava_callback.json.gz 2026-05-07 00:42:01,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:01,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf7a474a995a18843209 HTTP/1.1" 200 None 2026-05-07 00:42:01,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:01,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:42:01,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:01,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf7a474a995a18843209 HTTP/1.1" 200 None 2026-05-07 00:42:01,730 - lava_callback - INFO - Completed processing callback for node 69fbdf7a474a995a18843209 INFO: 172.21.0.1:60762 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:42:12,914 - lava_callback - INFO - Received callback for node 69fbdf77474a995a188431fb INFO: 172.21.0.1:50262 - "POST /node/69fbdf77474a995a188431fb HTTP/1.0" 202 Accepted 2026-05-07 00:42:12,920 - lava_callback - INFO - Starting async job submit for node 69fbdf77474a995a188431fb 2026-05-07 00:42:12,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:12,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf77474a995a188431fb HTTP/1.1" 200 None 2026-05-07 00:42:12,957 - lava_callback - DEBUG - Processing node 69fbdf77474a995a188431fb: baseline-arm-broonie 2026-05-07 00:42:13,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:13,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:13,234 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fbdf77474a995a188431fb/log.txt.gz INFO: 172.21.0.1:50278 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:42:13,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:13,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:13,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fbdf77474a995a188431fb/lava-logs.yaml 2026-05-07 00:42:13,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:13,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:13,656 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fbdf77474a995a188431fb/lava_callback.json.gz 2026-05-07 00:42:13,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:13,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf77474a995a188431fb HTTP/1.1" 200 None 2026-05-07 00:42:13,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:13,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:42:13,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:13,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf77474a995a188431fb HTTP/1.1" 200 None 2026-05-07 00:42:13,736 - lava_callback - INFO - Completed processing callback for node 69fbdf77474a995a188431fb 2026-05-07 00:42:14,358 - lava_callback - INFO - Received callback for node 69fbdf78474a995a18843204 INFO: 172.21.0.1:50286 - "POST /node/69fbdf78474a995a18843204 HTTP/1.0" 202 Accepted 2026-05-07 00:42:14,365 - lava_callback - INFO - Starting async job submit for node 69fbdf78474a995a18843204 2026-05-07 00:42:14,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:14,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf78474a995a18843204 HTTP/1.1" 200 None 2026-05-07 00:42:14,409 - lava_callback - DEBUG - Processing node 69fbdf78474a995a18843204: baseline-arm-broonie 2026-05-07 00:42:14,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:14,671 - lava_callback - INFO - Received callback for node 69fbdf85474a995a1884325a 2026-05-07 00:42:14,678 - lava_callback - INFO - Starting async job submit for node 69fbdf85474a995a1884325a INFO: 172.21.0.1:50302 - "POST /node/69fbdf85474a995a1884325a HTTP/1.0" 202 Accepted 2026-05-07 00:42:14,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:14,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:14,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fbdf78474a995a18843204/log.txt.gz 2026-05-07 00:42:14,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf85474a995a1884325a HTTP/1.1" 200 None 2026-05-07 00:42:14,785 - lava_callback - DEBUG - Processing node 69fbdf85474a995a1884325a: baseline-arm-kontron 2026-05-07 00:42:14,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:15,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:15,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:15,156 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fbdf85474a995a1884325a/log.txt.gz INFO: 172.21.0.1:50314 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-07 00:42:15,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:15,240 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fbdf78474a995a18843204/lava-logs.yaml 2026-05-07 00:42:15,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:15,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:15,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:15,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fbdf78474a995a18843204/lava_callback.json.gz 2026-05-07 00:42:15,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:15,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf78474a995a18843204 HTTP/1.1" 200 None 2026-05-07 00:42:15,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:15,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:15,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:42:15,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:15,436 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fbdf85474a995a1884325a/lava-logs.yaml 2026-05-07 00:42:15,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:15,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf78474a995a18843204 HTTP/1.1" 200 None 2026-05-07 00:42:15,465 - lava_callback - INFO - Completed processing callback for node 69fbdf78474a995a18843204 2026-05-07 00:42:15,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:15,591 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fbdf85474a995a1884325a/lava_callback.json.gz 2026-05-07 00:42:15,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:15,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf85474a995a1884325a HTTP/1.1" 200 None 2026-05-07 00:42:15,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:15,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:42:15,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:15,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf85474a995a1884325a HTTP/1.1" 200 None 2026-05-07 00:42:15,686 - lava_callback - INFO - Completed processing callback for node 69fbdf85474a995a1884325a 2026-05-07 00:42:15,825 - lava_callback - INFO - Received callback for node 69fbdf86474a995a1884325d INFO: 172.21.0.1:50330 - "POST /node/69fbdf86474a995a1884325d HTTP/1.0" 202 Accepted 2026-05-07 00:42:15,832 - lava_callback - INFO - Starting async job submit for node 69fbdf86474a995a1884325d 2026-05-07 00:42:15,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:15,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf86474a995a1884325d HTTP/1.1" 200 None 2026-05-07 00:42:15,879 - lava_callback - DEBUG - Processing node 69fbdf86474a995a1884325d: baseline-arm-kontron 2026-05-07 00:42:16,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:16,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:16,147 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fbdf86474a995a1884325d/log.txt.gz 2026-05-07 00:42:16,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:16,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:16,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fbdf86474a995a1884325d/lava-logs.yaml 2026-05-07 00:42:16,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:16,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:16,480 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fbdf86474a995a1884325d/lava_callback.json.gz 2026-05-07 00:42:16,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:42:16,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf86474a995a1884325d HTTP/1.1" 200 None 2026-05-07 00:42:16,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:16,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:42:16,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:16,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf86474a995a1884325d HTTP/1.1" 200 None 2026-05-07 00:42:16,553 - lava_callback - INFO - Completed processing callback for node 69fbdf86474a995a1884325d 2026-05-07 00:42:21,898 - lava_callback - INFO - Received callback for node 69f93cebd09fe59064f0567e INFO: 172.21.0.1:37518 - "POST /node/69f93cebd09fe59064f0567e HTTP/1.0" 202 Accepted 2026-05-07 00:42:21,903 - lava_callback - INFO - Starting async job submit for node 69f93cebd09fe59064f0567e 2026-05-07 00:42:21,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:21,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93cebd09fe59064f0567e HTTP/1.1" 200 None 2026-05-07 00:42:21,919 - lava_callback - DEBUG - Processing node 69f93cebd09fe59064f0567e: baseline-arm-baylibre 2026-05-07 00:42:21,919 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93cebd09fe59064f0567e 2026-05-07 00:42:21,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:21,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93cebd09fe59064f0567e HTTP/1.1" 200 None 2026-05-07 00:42:21,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:21,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 00:42:21,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:21,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93cebd09fe59064f0567e HTTP/1.1" 200 None 2026-05-07 00:42:21,965 - lava_callback - ERROR - Error processing callback for node 69f93cebd09fe59064f0567e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37532 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:42:26,868 - lava_callback - INFO - Received callback for node 69fbdf7d474a995a1884321a INFO: 172.21.0.1:37542 - "POST /node/69fbdf7d474a995a1884321a HTTP/1.0" 202 Accepted 2026-05-07 00:42:26,874 - lava_callback - INFO - Starting async job submit for node 69fbdf7d474a995a1884321a 2026-05-07 00:42:26,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:26,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf7d474a995a1884321a HTTP/1.1" 200 None 2026-05-07 00:42:26,910 - lava_callback - DEBUG - Processing node 69fbdf7d474a995a1884321a: baseline-arm-clabbe 2026-05-07 00:42:27,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:27,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:27,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fbdf7d474a995a1884321a/log.txt.gz 2026-05-07 00:42:27,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:27,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:27,471 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fbdf7d474a995a1884321a/lava-logs.yaml 2026-05-07 00:42:27,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:27,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:27,581 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fbdf7d474a995a1884321a/lava_callback.json.gz 2026-05-07 00:42:27,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:27,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf7d474a995a1884321a HTTP/1.1" 200 None 2026-05-07 00:42:27,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:27,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:42:27,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:27,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf7d474a995a1884321a HTTP/1.1" 200 None 2026-05-07 00:42:27,652 - lava_callback - INFO - Completed processing callback for node 69fbdf7d474a995a1884321a 2026-05-07 00:42:28,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:28,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-07 00:42:33,787 - lava_callback - INFO - Received callback for node 69fbdf75474a995a188431f0 INFO: 172.21.0.1:39754 - "POST /node/69fbdf75474a995a188431f0 HTTP/1.0" 202 Accepted 2026-05-07 00:42:33,793 - lava_callback - INFO - Starting async job submit for node 69fbdf75474a995a188431f0 2026-05-07 00:42:33,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:33,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf75474a995a188431f0 HTTP/1.1" 200 None 2026-05-07 00:42:33,832 - lava_callback - DEBUG - Processing node 69fbdf75474a995a188431f0: baseline-arm-broonie 2026-05-07 00:42:34,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:34,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:34,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fbdf75474a995a188431f0/log.txt.gz 2026-05-07 00:42:34,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:34,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:34,434 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fbdf75474a995a188431f0/lava-logs.yaml 2026-05-07 00:42:34,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:34,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:34,567 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fbdf75474a995a188431f0/lava_callback.json.gz 2026-05-07 00:42:34,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:34,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf75474a995a188431f0 HTTP/1.1" 200 None 2026-05-07 00:42:34,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:34,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:42:34,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:34,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf75474a995a188431f0 HTTP/1.1" 200 None 2026-05-07 00:42:34,642 - lava_callback - INFO - Completed processing callback for node 69fbdf75474a995a188431f0 INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41940 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:42:47,983 - lava_callback - INFO - Received callback for node 69fbdf7e474a995a1884321d INFO: 172.21.0.1:41944 - "POST /node/69fbdf7e474a995a1884321d HTTP/1.0" 202 Accepted 2026-05-07 00:42:47,989 - lava_callback - INFO - Starting async job submit for node 69fbdf7e474a995a1884321d 2026-05-07 00:42:48,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:48,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf7e474a995a1884321d HTTP/1.1" 200 None 2026-05-07 00:42:48,028 - lava_callback - DEBUG - Processing node 69fbdf7e474a995a1884321d: baseline-arm-clabbe 2026-05-07 00:42:48,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:48,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:48,480 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fbdf7e474a995a1884321d/log.txt.gz 2026-05-07 00:42:48,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:48,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:48,746 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fbdf7e474a995a1884321d/lava-logs.yaml 2026-05-07 00:42:48,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:48,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:48,880 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fbdf7e474a995a1884321d/lava_callback.json.gz 2026-05-07 00:42:48,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:48,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf7e474a995a1884321d HTTP/1.1" 200 None 2026-05-07 00:42:48,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:48,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:42:48,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:48,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf7e474a995a1884321d HTTP/1.1" 200 None 2026-05-07 00:42:48,966 - lava_callback - INFO - Completed processing callback for node 69fbdf7e474a995a1884321d 2026-05-07 00:42:51,524 - lava_callback - INFO - Received callback for node 69fbdfa3474a995a188432b9 INFO: 172.21.0.1:56680 - "POST /node/69fbdfa3474a995a188432b9 HTTP/1.0" 202 Accepted 2026-05-07 00:42:51,530 - lava_callback - INFO - Starting async job submit for node 69fbdfa3474a995a188432b9 2026-05-07 00:42:51,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:51,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa3474a995a188432b9 HTTP/1.1" 200 None 2026-05-07 00:42:51,568 - lava_callback - DEBUG - Processing node 69fbdfa3474a995a188432b9: ltp-dio 2026-05-07 00:42:51,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:52,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:52,098 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69fbdfa3474a995a188432b9/log.txt.gz 2026-05-07 00:42:52,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:52,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:52,608 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69fbdfa3474a995a188432b9/lava-logs.yaml 2026-05-07 00:42:52,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:42:52,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:42:52,733 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69fbdfa3474a995a188432b9/lava_callback.json.gz 2026-05-07 00:42:52,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:52,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa3474a995a188432b9 HTTP/1.1" 200 None 2026-05-07 00:42:52,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:52,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:42:52,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:52,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfa3474a995a188432b9 HTTP/1.1" 200 None 2026-05-07 00:42:52,827 - lava_callback - INFO - Completed processing callback for node 69fbdfa3474a995a188432b9 INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:42:58,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:42:58,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34598 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:44:02,927 - lava_callback - INFO - Received callback for node 69fbdf82474a995a1884322c INFO: 172.21.0.1:48598 - "POST /node/69fbdf82474a995a1884322c HTTP/1.0" 202 Accepted 2026-05-07 00:44:02,933 - lava_callback - INFO - Starting async job submit for node 69fbdf82474a995a1884322c 2026-05-07 00:44:02,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:44:02,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf82474a995a1884322c HTTP/1.1" 200 None 2026-05-07 00:44:02,968 - lava_callback - DEBUG - Processing node 69fbdf82474a995a1884322c: baseline-arm-clabbe 2026-05-07 00:44:03,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:44:03,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:44:03,308 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fbdf82474a995a1884322c/log.txt.gz 2026-05-07 00:44:03,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:44:03,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:44:03,587 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fbdf82474a995a1884322c/lava-logs.yaml 2026-05-07 00:44:03,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:44:03,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:44:03,693 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fbdf82474a995a1884322c/lava_callback.json.gz 2026-05-07 00:44:03,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:44:03,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf82474a995a1884322c HTTP/1.1" 200 None 2026-05-07 00:44:03,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:44:03,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:44:03,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:44:03,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf82474a995a1884322c HTTP/1.1" 200 None 2026-05-07 00:44:03,771 - lava_callback - INFO - Completed processing callback for node 69fbdf82474a995a1884322c INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43212 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:44:28,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:44:28,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56770 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:45:01,147 - lava_callback - INFO - Received callback for node 69fbdf9d474a995a18843298 INFO: 172.21.0.1:43998 - "POST /node/69fbdf9d474a995a18843298 HTTP/1.0" 202 Accepted 2026-05-07 00:45:01,153 - lava_callback - INFO - Starting async job submit for node 69fbdf9d474a995a18843298 2026-05-07 00:45:01,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:01,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf9d474a995a18843298 HTTP/1.1" 200 None 2026-05-07 00:45:01,205 - lava_callback - DEBUG - Processing node 69fbdf9d474a995a18843298: ltp-cap_bounds 2026-05-07 00:45:01,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:01,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:01,666 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fbdf9d474a995a18843298/log.txt.gz 2026-05-07 00:45:01,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:02,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:02,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fbdf9d474a995a18843298/lava-logs.yaml 2026-05-07 00:45:02,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:02,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:02,370 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fbdf9d474a995a18843298/lava_callback.json.gz 2026-05-07 00:45:02,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:02,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf9d474a995a18843298 HTTP/1.1" 200 None 2026-05-07 00:45:02,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:02,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:45:02,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:02,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf9d474a995a18843298 HTTP/1.1" 200 None 2026-05-07 00:45:02,444 - lava_callback - INFO - Completed processing callback for node 69fbdf9d474a995a18843298 INFO: 172.21.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48254 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:45:22,174 - lava_callback - INFO - Received callback for node 69fbdf9e474a995a1884329b INFO: 172.21.0.1:51356 - "POST /node/69fbdf9e474a995a1884329b HTTP/1.0" 202 Accepted 2026-05-07 00:45:22,180 - lava_callback - INFO - Starting async job submit for node 69fbdf9e474a995a1884329b 2026-05-07 00:45:22,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:22,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf9e474a995a1884329b HTTP/1.1" 200 None 2026-05-07 00:45:22,223 - lava_callback - DEBUG - Processing node 69fbdf9e474a995a1884329b: ltp-containers 2026-05-07 00:45:22,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:22,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:22,872 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69fbdf9e474a995a1884329b/log.txt.gz 2026-05-07 00:45:23,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:23,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:23,263 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69fbdf9e474a995a1884329b/lava-logs.yaml 2026-05-07 00:45:23,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:23,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:23,397 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69fbdf9e474a995a1884329b/lava_callback.json.gz 2026-05-07 00:45:23,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:23,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf9e474a995a1884329b HTTP/1.1" 200 None 2026-05-07 00:45:23,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:23,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:45:23,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:23,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf9e474a995a1884329b HTTP/1.1" 200 None 2026-05-07 00:45:23,478 - lava_callback - INFO - Completed processing callback for node 69fbdf9e474a995a1884329b 2026-05-07 00:45:23,735 - lava_callback - INFO - Received callback for node 69fbdfaf474a995a188432d1 INFO: 172.21.0.1:51370 - "POST /node/69fbdfaf474a995a188432d1 HTTP/1.0" 202 Accepted 2026-05-07 00:45:23,743 - lava_callback - INFO - Starting async job submit for node 69fbdfaf474a995a188432d1 2026-05-07 00:45:23,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:23,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfaf474a995a188432d1 HTTP/1.1" 200 None 2026-05-07 00:45:23,786 - lava_callback - DEBUG - Processing node 69fbdfaf474a995a188432d1: ltp-syscalls 2026-05-07 00:45:24,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:24,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:24,631 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fbdfaf474a995a188432d1/log.txt.gz 2026-05-07 00:45:25,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:25,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:25,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fbdfaf474a995a188432d1/lava-logs.yaml 2026-05-07 00:45:25,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:25,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:25,378 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fbdfaf474a995a188432d1/lava_callback.json.gz 2026-05-07 00:45:25,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:25,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfaf474a995a188432d1 HTTP/1.1" 200 None 2026-05-07 00:45:25,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:25,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:45:25,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:25,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfaf474a995a188432d1 HTTP/1.1" 200 None 2026-05-07 00:45:25,460 - lava_callback - INFO - Completed processing callback for node 69fbdfaf474a995a188432d1 INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:45:28,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:28,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 00:45:34,864 - lava_callback - INFO - Received callback for node 69fbe09e474a995a1884339d INFO: 172.21.0.1:58578 - "POST /node/69fbe09e474a995a1884339d HTTP/1.0" 202 Accepted 2026-05-07 00:45:34,872 - lava_callback - INFO - Starting async job submit for node 69fbe09e474a995a1884339d 2026-05-07 00:45:34,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:34,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe09e474a995a1884339d HTTP/1.1" 200 None 2026-05-07 00:45:34,900 - lava_callback - DEBUG - Processing node 69fbe09e474a995a1884339d: baseline-arm 2026-05-07 00:45:34,905 - lava_callback - WARNING - Failed to upload log 2026-05-07 00:45:34,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:34,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:34,983 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbe09e474a995a1884339d/lava-logs.yaml 2026-05-07 00:45:34,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:35,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:35,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbe09e474a995a1884339d/lava_callback.json.gz 2026-05-07 00:45:35,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:35,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe09e474a995a1884339d HTTP/1.1" 200 None 2026-05-07 00:45:35,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:35,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:45:35,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:35,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe09e474a995a1884339d HTTP/1.1" 200 None 2026-05-07 00:45:35,186 - lava_callback - INFO - Completed processing callback for node 69fbe09e474a995a1884339d INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:45:39,082 - lava_callback - INFO - Received callback for node 69f93dabd09fe59064f05707 INFO: 172.21.0.1:58598 - "POST /node/69f93dabd09fe59064f05707 HTTP/1.0" 202 Accepted 2026-05-07 00:45:39,087 - lava_callback - INFO - Starting async job submit for node 69f93dabd09fe59064f05707 2026-05-07 00:45:39,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:39,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93dabd09fe59064f05707 HTTP/1.1" 200 None 2026-05-07 00:45:39,103 - lava_callback - DEBUG - Processing node 69f93dabd09fe59064f05707: baseline-arm-clabbe 2026-05-07 00:45:39,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93dabd09fe59064f05707 2026-05-07 00:45:39,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:39,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93dabd09fe59064f05707 HTTP/1.1" 200 None 2026-05-07 00:45:39,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:39,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 00:45:39,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:39,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93dabd09fe59064f05707 HTTP/1.1" 200 None 2026-05-07 00:45:39,159 - lava_callback - ERROR - Error processing callback for node 69f93dabd09fe59064f05707: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:45:41,414 - lava_callback - INFO - Received callback for node 69fbdfa0474a995a1884329e INFO: 172.21.0.1:60856 - "POST /node/69fbdfa0474a995a1884329e HTTP/1.0" 202 Accepted 2026-05-07 00:45:41,421 - lava_callback - INFO - Starting async job submit for node 69fbdfa0474a995a1884329e 2026-05-07 00:45:41,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:41,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa0474a995a1884329e HTTP/1.1" 200 None 2026-05-07 00:45:41,460 - lava_callback - DEBUG - Processing node 69fbdfa0474a995a1884329e: ltp-controllers 2026-05-07 00:45:41,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:42,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:42,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69fbdfa0474a995a1884329e/log.txt.gz 2026-05-07 00:45:42,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:42,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:42,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69fbdfa0474a995a1884329e/lava-logs.yaml 2026-05-07 00:45:42,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:45:42,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:45:42,637 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69fbdfa0474a995a1884329e/lava_callback.json.gz 2026-05-07 00:45:42,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:42,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa0474a995a1884329e HTTP/1.1" 200 None 2026-05-07 00:45:42,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:42,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:45:42,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:42,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfa0474a995a1884329e HTTP/1.1" 200 None 2026-05-07 00:45:42,719 - lava_callback - INFO - Completed processing callback for node 69fbdfa0474a995a1884329e INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33050 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:45:58,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:45:58,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:46:19,008 - lava_callback - INFO - Received callback for node 69f93dd2d09fe59064f0571e INFO: 172.21.0.1:37998 - "POST /node/69f93dd2d09fe59064f0571e HTTP/1.0" 202 Accepted 2026-05-07 00:46:19,013 - lava_callback - INFO - Starting async job submit for node 69f93dd2d09fe59064f0571e 2026-05-07 00:46:19,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:46:19,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93dd2d09fe59064f0571e HTTP/1.1" 200 None 2026-05-07 00:46:19,028 - lava_callback - DEBUG - Processing node 69f93dd2d09fe59064f0571e: baseline-arm-clabbe 2026-05-07 00:46:19,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93dd2d09fe59064f0571e 2026-05-07 00:46:19,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:46:19,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93dd2d09fe59064f0571e HTTP/1.1" 200 None 2026-05-07 00:46:19,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:46:19,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 00:46:19,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:46:19,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93dd2d09fe59064f0571e HTTP/1.1" 200 None 2026-05-07 00:46:19,074 - lava_callback - ERROR - Error processing callback for node 69f93dd2d09fe59064f0571e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40478 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:46:33,281 - lava_callback - INFO - Received callback for node 69fbdfa2474a995a188432b6 INFO: 172.21.0.1:52728 - "POST /node/69fbdfa2474a995a188432b6 HTTP/1.0" 202 Accepted 2026-05-07 00:46:33,287 - lava_callback - INFO - Starting async job submit for node 69fbdfa2474a995a188432b6 2026-05-07 00:46:33,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:46:33,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa2474a995a188432b6 HTTP/1.1" 200 None 2026-05-07 00:46:33,349 - lava_callback - DEBUG - Processing node 69fbdfa2474a995a188432b6: ltp-cve 2026-05-07 00:46:33,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:46:33,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:46:33,840 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69fbdfa2474a995a188432b6/log.txt.gz 2026-05-07 00:46:34,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:46:34,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:46:34,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69fbdfa2474a995a188432b6/lava-logs.yaml 2026-05-07 00:46:34,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:46:34,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:46:34,393 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69fbdfa2474a995a188432b6/lava_callback.json.gz 2026-05-07 00:46:34,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:46:34,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa2474a995a188432b6 HTTP/1.1" 200 None 2026-05-07 00:46:34,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:46:34,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:46:34,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:46:34,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfa2474a995a188432b6 HTTP/1.1" 200 None 2026-05-07 00:46:34,470 - lava_callback - INFO - Completed processing callback for node 69fbdfa2474a995a188432b6 INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:46:58,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:46:58,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:47:39,150 - lava_callback - INFO - Received callback for node 69f93e1cd09fe59064f05741 INFO: 172.21.0.1:47850 - "POST /node/69f93e1cd09fe59064f05741 HTTP/1.0" 202 Accepted 2026-05-07 00:47:39,155 - lava_callback - INFO - Starting async job submit for node 69f93e1cd09fe59064f05741 2026-05-07 00:47:39,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:47:39,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93e1cd09fe59064f05741 HTTP/1.1" 200 None 2026-05-07 00:47:39,170 - lava_callback - DEBUG - Processing node 69f93e1cd09fe59064f05741: baseline-arm-clabbe 2026-05-07 00:47:39,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93e1cd09fe59064f05741 2026-05-07 00:47:39,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:47:39,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93e1cd09fe59064f05741 HTTP/1.1" 200 None 2026-05-07 00:47:39,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:47:39,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 00:47:39,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:47:39,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93e1cd09fe59064f05741 HTTP/1.1" 200 None 2026-05-07 00:47:39,216 - lava_callback - ERROR - Error processing callback for node 69f93e1cd09fe59064f05741: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47792 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:48:19,123 - lava_callback - INFO - Received callback for node 69f93e44d09fe59064f05759 INFO: 172.21.0.1:47802 - "POST /node/69f93e44d09fe59064f05759 HTTP/1.0" 202 Accepted 2026-05-07 00:48:19,129 - lava_callback - INFO - Starting async job submit for node 69f93e44d09fe59064f05759 2026-05-07 00:48:19,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:19,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93e44d09fe59064f05759 HTTP/1.1" 200 None 2026-05-07 00:48:19,146 - lava_callback - DEBUG - Processing node 69f93e44d09fe59064f05759: baseline-arm-clabbe 2026-05-07 00:48:19,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93e44d09fe59064f05759 2026-05-07 00:48:19,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:19,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93e44d09fe59064f05759 HTTP/1.1" 200 None 2026-05-07 00:48:19,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:19,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 00:48:19,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:19,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93e44d09fe59064f05759 HTTP/1.1" 200 None 2026-05-07 00:48:19,191 - lava_callback - ERROR - Error processing callback for node 69f93e44d09fe59064f05759: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:48:26,048 - lava_callback - INFO - Received callback for node 69fbdd97474a995a18843140 INFO: 172.21.0.1:37178 - "POST /node/69fbdd97474a995a18843140 HTTP/1.0" 202 Accepted 2026-05-07 00:48:26,055 - lava_callback - INFO - Starting async job submit for node 69fbdd97474a995a18843140 2026-05-07 00:48:26,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:26,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdd97474a995a18843140 HTTP/1.1" 200 None 2026-05-07 00:48:26,118 - lava_callback - DEBUG - Processing node 69fbdd97474a995a18843140: baseline-x86 INFO: 172.21.0.1:37194 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:48:26,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:48:27,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:48:27,021 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd97474a995a18843140/log.txt.gz 2026-05-07 00:48:27,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:48:27,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:48:27,671 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd97474a995a18843140/lava-logs.yaml 2026-05-07 00:48:27,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:48:28,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:48:28,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fbdd97474a995a18843140/lava_callback.json.gz DEBUG: Setup failed for 69fbdd97474a995a18843140. Transitting job node result: incomplete -> fail 2026-05-07 00:48:28,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:28,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdd97474a995a18843140 HTTP/1.1" 200 None 2026-05-07 00:48:28,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:28,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda28474a995a18840a31 HTTP/1.1" 200 None 2026-05-07 00:48:28,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:28,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdd97474a995a18843140 HTTP/1.1" 200 None 2026-05-07 00:48:28,294 - lava_callback - INFO - Completed processing callback for node 69fbdd97474a995a18843140 2026-05-07 00:48:28,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:28,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:48:59,150 - lava_callback - INFO - Received callback for node 69f93e6dd09fe59064f05772 INFO: 172.21.0.1:59394 - "POST /node/69f93e6dd09fe59064f05772 HTTP/1.0" 202 Accepted 2026-05-07 00:48:59,155 - lava_callback - INFO - Starting async job submit for node 69f93e6dd09fe59064f05772 2026-05-07 00:48:59,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:59,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93e6dd09fe59064f05772 HTTP/1.1" 200 None 2026-05-07 00:48:59,175 - lava_callback - DEBUG - Processing node 69f93e6dd09fe59064f05772: baseline-arm-clabbe 2026-05-07 00:48:59,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f93e6dd09fe59064f05772 2026-05-07 00:48:59,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:59,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93e6dd09fe59064f05772 HTTP/1.1" 200 None 2026-05-07 00:48:59,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:59,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 00:48:59,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:48:59,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f93e6dd09fe59064f05772 HTTP/1.1" 200 None 2026-05-07 00:48:59,219 - lava_callback - ERROR - Error processing callback for node 69f93e6dd09fe59064f05772: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:49:01,359 - lava_callback - INFO - Received callback for node 69fbdfa5474a995a188432bc INFO: 172.21.0.1:53616 - "POST /node/69fbdfa5474a995a188432bc HTTP/1.0" 202 Accepted 2026-05-07 00:49:01,365 - lava_callback - INFO - Starting async job submit for node 69fbdfa5474a995a188432bc 2026-05-07 00:49:01,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:49:01,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa5474a995a188432bc HTTP/1.1" 200 None 2026-05-07 00:49:01,406 - lava_callback - DEBUG - Processing node 69fbdfa5474a995a188432bc: ltp-fs_bind 2026-05-07 00:49:01,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:49:02,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:49:02,055 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fbdfa5474a995a188432bc/log.txt.gz 2026-05-07 00:49:02,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:49:02,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:49:02,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fbdfa5474a995a188432bc/lava-logs.yaml 2026-05-07 00:49:02,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:49:02,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:49:02,542 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fbdfa5474a995a188432bc/lava_callback.json.gz 2026-05-07 00:49:02,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:49:02,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa5474a995a188432bc HTTP/1.1" 200 None 2026-05-07 00:49:02,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:49:02,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:49:02,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:49:02,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfa5474a995a188432bc HTTP/1.1" 200 None 2026-05-07 00:49:02,619 - lava_callback - INFO - Completed processing callback for node 69fbdfa5474a995a188432bc INFO: 172.21.0.1:53620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:49:21,886 - lava_callback - INFO - Received callback for node 69fbdfa6474a995a188432bf INFO: 172.21.0.1:48492 - "POST /node/69fbdfa6474a995a188432bf HTTP/1.0" 202 Accepted 2026-05-07 00:49:21,892 - lava_callback - INFO - Starting async job submit for node 69fbdfa6474a995a188432bf 2026-05-07 00:49:21,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:49:21,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa6474a995a188432bf HTTP/1.1" 200 None 2026-05-07 00:49:21,931 - lava_callback - DEBUG - Processing node 69fbdfa6474a995a188432bf: ltp-fsx 2026-05-07 00:49:22,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:49:22,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:49:22,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69fbdfa6474a995a188432bf/log.txt.gz 2026-05-07 00:49:22,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:49:22,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:49:22,744 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69fbdfa6474a995a188432bf/lava-logs.yaml 2026-05-07 00:49:22,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:49:22,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:49:22,865 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69fbdfa6474a995a188432bf/lava_callback.json.gz 2026-05-07 00:49:22,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:49:22,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa6474a995a188432bf HTTP/1.1" 200 None 2026-05-07 00:49:22,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:49:22,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:49:22,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:49:22,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfa6474a995a188432bf HTTP/1.1" 200 None 2026-05-07 00:49:22,940 - lava_callback - INFO - Completed processing callback for node 69fbdfa6474a995a188432bf INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:49:28,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:49:28,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:50:21,421 - lava_callback - INFO - Received callback for node 69fbdfa7474a995a188432c2 INFO: 172.21.0.1:41664 - "POST /node/69fbdfa7474a995a188432c2 HTTP/1.0" 202 Accepted 2026-05-07 00:50:21,427 - lava_callback - INFO - Starting async job submit for node 69fbdfa7474a995a188432c2 2026-05-07 00:50:21,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:50:21,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa7474a995a188432c2 HTTP/1.1" 200 None 2026-05-07 00:50:21,472 - lava_callback - DEBUG - Processing node 69fbdfa7474a995a188432c2: ltp-input 2026-05-07 00:50:21,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:50:22,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:50:22,150 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69fbdfa7474a995a188432c2/log.txt.gz 2026-05-07 00:50:22,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:50:22,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:50:22,540 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69fbdfa7474a995a188432c2/lava-logs.yaml 2026-05-07 00:50:22,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:50:22,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:50:22,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69fbdfa7474a995a188432c2/lava_callback.json.gz 2026-05-07 00:50:22,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:50:22,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa7474a995a188432c2 HTTP/1.1" 200 None 2026-05-07 00:50:22,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:50:22,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:50:22,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:50:22,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfa7474a995a188432c2 HTTP/1.1" 200 None 2026-05-07 00:50:22,769 - lava_callback - INFO - Completed processing callback for node 69fbdfa7474a995a188432c2 INFO: 172.21.0.1:41670 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:50:28,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:50:28,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 00:50:33,832 - lava_callback - INFO - Received callback for node 69fbdfa9474a995a188432c5 INFO: 172.21.0.1:34692 - "POST /node/69fbdfa9474a995a188432c5 HTTP/1.0" 202 Accepted 2026-05-07 00:50:33,838 - lava_callback - INFO - Starting async job submit for node 69fbdfa9474a995a188432c5 2026-05-07 00:50:33,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:50:33,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa9474a995a188432c5 HTTP/1.1" 200 None 2026-05-07 00:50:33,883 - lava_callback - DEBUG - Processing node 69fbdfa9474a995a188432c5: ltp-ipc 2026-05-07 00:50:34,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:50:34,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:50:34,356 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69fbdfa9474a995a188432c5/log.txt.gz 2026-05-07 00:50:34,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:50:34,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:50:34,735 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69fbdfa9474a995a188432c5/lava-logs.yaml 2026-05-07 00:50:34,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:50:34,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:50:34,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69fbdfa9474a995a188432c5/lava_callback.json.gz 2026-05-07 00:50:34,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:50:34,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfa9474a995a188432c5 HTTP/1.1" 200 None 2026-05-07 00:50:34,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:50:34,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:50:34,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:50:34,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfa9474a995a188432c5 HTTP/1.1" 200 None 2026-05-07 00:50:34,960 - lava_callback - INFO - Completed processing callback for node 69fbdfa9474a995a188432c5 INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:50:58,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:50:58,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:53:01,481 - lava_callback - INFO - Received callback for node 69fbdfaa474a995a188432c8 INFO: 172.21.0.1:57702 - "POST /node/69fbdfaa474a995a188432c8 HTTP/1.0" 202 Accepted 2026-05-07 00:53:01,489 - lava_callback - INFO - Starting async job submit for node 69fbdfaa474a995a188432c8 2026-05-07 00:53:01,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:01,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfaa474a995a188432c8 HTTP/1.1" 200 None 2026-05-07 00:53:01,538 - lava_callback - DEBUG - Processing node 69fbdfaa474a995a188432c8: ltp-pty 2026-05-07 00:53:01,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:53:02,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:53:02,049 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69fbdfaa474a995a188432c8/log.txt.gz 2026-05-07 00:53:02,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:53:02,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:53:02,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69fbdfaa474a995a188432c8/lava-logs.yaml 2026-05-07 00:53:02,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:53:02,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:53:02,622 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69fbdfaa474a995a188432c8/lava_callback.json.gz 2026-05-07 00:53:02,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:02,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfaa474a995a188432c8 HTTP/1.1" 200 None 2026-05-07 00:53:02,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:02,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:53:02,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:02,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfaa474a995a188432c8 HTTP/1.1" 200 None 2026-05-07 00:53:02,712 - lava_callback - INFO - Completed processing callback for node 69fbdfaa474a995a188432c8 INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:53:22,022 - lava_callback - INFO - Received callback for node 69fbdfac474a995a188432cb INFO: 172.21.0.1:46706 - "POST /node/69fbdfac474a995a188432cb HTTP/1.0" 202 Accepted 2026-05-07 00:53:22,029 - lava_callback - INFO - Starting async job submit for node 69fbdfac474a995a188432cb 2026-05-07 00:53:22,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:22,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfac474a995a188432cb HTTP/1.1" 200 None 2026-05-07 00:53:22,070 - lava_callback - DEBUG - Processing node 69fbdfac474a995a188432cb: ltp-sched 2026-05-07 00:53:22,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:53:22,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:53:22,584 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69fbdfac474a995a188432cb/log.txt.gz 2026-05-07 00:53:22,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:53:22,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:53:22,963 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69fbdfac474a995a188432cb/lava-logs.yaml 2026-05-07 00:53:22,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:53:23,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:53:23,265 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69fbdfac474a995a188432cb/lava_callback.json.gz 2026-05-07 00:53:23,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:23,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfac474a995a188432cb HTTP/1.1" 200 None 2026-05-07 00:53:23,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:23,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:53:23,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:23,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfac474a995a188432cb HTTP/1.1" 200 None 2026-05-07 00:53:23,367 - lava_callback - INFO - Completed processing callback for node 69fbdfac474a995a188432cb INFO: 172.21.0.1:46712 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:53:28,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:28,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 00:53:33,570 - lava_callback - INFO - Received callback for node 69fbddfc474a995a18843184 INFO: 172.21.0.1:49928 - "POST /node/69fbddfc474a995a18843184 HTTP/1.0" 202 Accepted 2026-05-07 00:53:33,578 - lava_callback - INFO - Starting async job submit for node 69fbddfc474a995a18843184 2026-05-07 00:53:33,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:33,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbddfc474a995a18843184 HTTP/1.1" 200 None 2026-05-07 00:53:33,671 - lava_callback - DEBUG - Processing node 69fbddfc474a995a18843184: ltp-smoke 2026-05-07 00:53:34,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:53:34,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:53:34,363 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbddfc474a995a18843184/log.txt.gz 2026-05-07 00:53:34,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:53:35,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:53:35,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbddfc474a995a18843184/lava-logs.yaml 2026-05-07 00:53:35,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:53:35,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:53:35,285 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbddfc474a995a18843184/lava_callback.json.gz 2026-05-07 00:53:35,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:35,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbddfc474a995a18843184 HTTP/1.1" 200 None 2026-05-07 00:53:35,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:35,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda05474a995a18840a0a HTTP/1.1" 200 None 2026-05-07 00:53:35,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:35,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbddfc474a995a18843184 HTTP/1.1" 200 None 2026-05-07 00:53:35,672 - lava_callback - INFO - Completed processing callback for node 69fbddfc474a995a18843184 INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:53:58,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:53:58,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57602 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:54:33,585 - lava_callback - INFO - Received callback for node 69fbdfb0474a995a188432d4 INFO: 172.21.0.1:45124 - "POST /node/69fbdfb0474a995a188432d4 HTTP/1.0" 202 Accepted 2026-05-07 00:54:33,592 - lava_callback - INFO - Starting async job submit for node 69fbdfb0474a995a188432d4 2026-05-07 00:54:33,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:54:33,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfb0474a995a188432d4 HTTP/1.1" 200 None 2026-05-07 00:54:33,639 - lava_callback - DEBUG - Processing node 69fbdfb0474a995a188432d4: ltp-syscalls-ipc 2026-05-07 00:54:34,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:54:34,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:54:34,148 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fbdfb0474a995a188432d4/log.txt.gz 2026-05-07 00:54:34,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:54:34,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:54:34,714 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fbdfb0474a995a188432d4/lava-logs.yaml 2026-05-07 00:54:34,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:54:34,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:54:34,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fbdfb0474a995a188432d4/lava_callback.json.gz 2026-05-07 00:54:34,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:54:34,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfb0474a995a188432d4 HTTP/1.1" 200 None 2026-05-07 00:54:34,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:54:34,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:54:34,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:54:34,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfb0474a995a188432d4 HTTP/1.1" 200 None 2026-05-07 00:54:34,951 - lava_callback - INFO - Completed processing callback for node 69fbdfb0474a995a188432d4 INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49492 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:54:55,260 - lava_callback - INFO - Received callback for node 69fbe2d3474a995a188434bd INFO: 172.21.0.1:53206 - "POST /node/69fbe2d3474a995a188434bd HTTP/1.0" 202 Accepted 2026-05-07 00:54:55,266 - lava_callback - INFO - Starting async job submit for node 69fbe2d3474a995a188434bd 2026-05-07 00:54:55,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:54:55,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe2d3474a995a188434bd HTTP/1.1" 200 None 2026-05-07 00:54:55,284 - lava_callback - DEBUG - Processing node 69fbe2d3474a995a188434bd: baseline-arm 2026-05-07 00:54:55,289 - lava_callback - WARNING - Failed to upload log 2026-05-07 00:54:55,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:54:55,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:54:55,382 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbe2d3474a995a188434bd/lava-logs.yaml 2026-05-07 00:54:55,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:54:55,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:54:55,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbe2d3474a995a188434bd/lava_callback.json.gz 2026-05-07 00:54:55,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:54:55,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe2d3474a995a188434bd HTTP/1.1" 200 None 2026-05-07 00:54:55,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:54:55,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:54:55,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:54:55,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe2d3474a995a188434bd HTTP/1.1" 200 None 2026-05-07 00:54:55,521 - lava_callback - INFO - Completed processing callback for node 69fbe2d3474a995a188434bd INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:54:58,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:54:58,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:57:01,644 - lava_callback - INFO - Received callback for node 69fbdfb2474a995a188432d7 INFO: 172.21.0.1:34794 - "POST /node/69fbdfb2474a995a188432d7 HTTP/1.0" 202 Accepted 2026-05-07 00:57:01,650 - lava_callback - INFO - Starting async job submit for node 69fbdfb2474a995a188432d7 2026-05-07 00:57:01,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:01,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfb2474a995a188432d7 HTTP/1.1" 200 None 2026-05-07 00:57:01,689 - lava_callback - DEBUG - Processing node 69fbdfb2474a995a188432d7: ltp-timers 2026-05-07 00:57:02,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:57:02,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:57:02,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69fbdfb2474a995a188432d7/log.txt.gz 2026-05-07 00:57:02,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:57:02,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:57:02,489 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69fbdfb2474a995a188432d7/lava-logs.yaml 2026-05-07 00:57:02,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:57:02,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:57:02,615 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69fbdfb2474a995a188432d7/lava_callback.json.gz 2026-05-07 00:57:02,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:02,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfb2474a995a188432d7 HTTP/1.1" 200 None 2026-05-07 00:57:02,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:02,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:57:02,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:02,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfb2474a995a188432d7 HTTP/1.1" 200 None 2026-05-07 00:57:02,689 - lava_callback - INFO - Completed processing callback for node 69fbdfb2474a995a188432d7 INFO: 172.21.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:57:19,772 - lava_callback - INFO - Received callback for node 69f9405bd09fe59064f0587a INFO: 172.21.0.1:42128 - "POST /node/69f9405bd09fe59064f0587a HTTP/1.0" 202 Accepted 2026-05-07 00:57:19,777 - lava_callback - INFO - Starting async job submit for node 69f9405bd09fe59064f0587a 2026-05-07 00:57:19,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:19,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9405bd09fe59064f0587a HTTP/1.1" 200 None 2026-05-07 00:57:19,792 - lava_callback - DEBUG - Processing node 69f9405bd09fe59064f0587a: baseline-arm-clabbe 2026-05-07 00:57:19,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9405bd09fe59064f0587a 2026-05-07 00:57:19,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:19,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9405bd09fe59064f0587a HTTP/1.1" 200 None 2026-05-07 00:57:19,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:19,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 00:57:19,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:19,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9405bd09fe59064f0587a HTTP/1.1" 200 None 2026-05-07 00:57:19,845 - lava_callback - ERROR - Error processing callback for node 69f9405bd09fe59064f0587a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 00:57:21,641 - lava_callback - INFO - Received callback for node 69fbdfb3474a995a188432da INFO: 172.21.0.1:42132 - "POST /node/69fbdfb3474a995a188432da HTTP/1.0" 202 Accepted 2026-05-07 00:57:21,648 - lava_callback - INFO - Starting async job submit for node 69fbdfb3474a995a188432da 2026-05-07 00:57:21,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:21,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfb3474a995a188432da HTTP/1.1" 200 None 2026-05-07 00:57:21,690 - lava_callback - DEBUG - Processing node 69fbdfb3474a995a188432da: ltp-watchqueue 2026-05-07 00:57:22,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:57:22,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:57:22,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fbdfb3474a995a188432da/log.txt.gz 2026-05-07 00:57:22,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:57:22,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:57:22,533 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fbdfb3474a995a188432da/lava-logs.yaml 2026-05-07 00:57:22,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:57:22,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:57:22,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fbdfb3474a995a188432da/lava_callback.json.gz 2026-05-07 00:57:22,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:22,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfb3474a995a188432da HTTP/1.1" 200 None 2026-05-07 00:57:22,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:22,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:57:22,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:22,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfb3474a995a188432da HTTP/1.1" 200 None 2026-05-07 00:57:22,731 - lava_callback - INFO - Completed processing callback for node 69fbdfb3474a995a188432da INFO: 172.21.0.1:42134 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:57:28,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:28,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45034 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:57:52,829 - lava_callback - INFO - Received callback for node 69fbdf68474a995a188431cd INFO: 172.21.0.1:38544 - "POST /node/69fbdf68474a995a188431cd HTTP/1.0" 202 Accepted 2026-05-07 00:57:52,836 - lava_callback - INFO - Starting async job submit for node 69fbdf68474a995a188431cd 2026-05-07 00:57:52,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:52,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf68474a995a188431cd HTTP/1.1" 200 None 2026-05-07 00:57:52,914 - lava_callback - DEBUG - Processing node 69fbdf68474a995a188431cd: baseline-arm 2026-05-07 00:57:53,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:57:53,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:57:53,836 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf68474a995a188431cd/log.txt.gz 2026-05-07 00:57:54,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:57:54,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:57:54,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf68474a995a188431cd/lava-logs.yaml 2026-05-07 00:57:54,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:57:54,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:57:54,641 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbdf68474a995a188431cd/lava_callback.json.gz DEBUG: Setup failed for 69fbdf68474a995a188431cd. Transitting job node result: incomplete -> fail 2026-05-07 00:57:54,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:54,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf68474a995a188431cd HTTP/1.1" 200 None 2026-05-07 00:57:54,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:54,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:57:54,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:54,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf68474a995a188431cd HTTP/1.1" 200 None 2026-05-07 00:57:54,911 - lava_callback - INFO - Completed processing callback for node 69fbdf68474a995a188431cd INFO: 172.21.0.1:38548 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:57:58,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:57:58,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:58:41,738 - lava_callback - INFO - Received callback for node 69fbdfad474a995a188432ce INFO: 172.21.0.1:51076 - "POST /node/69fbdfad474a995a188432ce HTTP/1.0" 202 Accepted 2026-05-07 00:58:41,745 - lava_callback - INFO - Starting async job submit for node 69fbdfad474a995a188432ce 2026-05-07 00:58:41,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:58:41,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfad474a995a188432ce HTTP/1.1" 200 None 2026-05-07 00:58:41,798 - lava_callback - DEBUG - Processing node 69fbdfad474a995a188432ce: ltp-smoke 2026-05-07 00:58:42,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:58:42,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:58:42,329 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbdfad474a995a188432ce/log.txt.gz 2026-05-07 00:58:42,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:58:42,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:58:42,728 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbdfad474a995a188432ce/lava-logs.yaml 2026-05-07 00:58:42,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 00:58:42,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 00:58:42,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbdfad474a995a188432ce/lava_callback.json.gz 2026-05-07 00:58:42,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:58:42,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdfad474a995a188432ce HTTP/1.1" 200 None 2026-05-07 00:58:42,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:58:42,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 00:58:42,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:58:42,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdfad474a995a188432ce HTTP/1.1" 200 None 2026-05-07 00:58:42,967 - lava_callback - INFO - Completed processing callback for node 69fbdfad474a995a188432ce INFO: 172.21.0.1:51084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:58:58,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:58:58,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 00:59:03,343 - lava_callback - INFO - Received callback for node 69f940c9d09fe59064f058bb INFO: 172.21.0.1:58254 - "POST /node/69f940c9d09fe59064f058bb HTTP/1.0" 202 Accepted 2026-05-07 00:59:03,349 - lava_callback - INFO - Starting async job submit for node 69f940c9d09fe59064f058bb 2026-05-07 00:59:03,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:59:03,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f940c9d09fe59064f058bb HTTP/1.1" 200 None 2026-05-07 00:59:03,363 - lava_callback - DEBUG - Processing node 69f940c9d09fe59064f058bb: baseline-arm-baylibre 2026-05-07 00:59:03,364 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f940c9d09fe59064f058bb 2026-05-07 00:59:03,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:59:03,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f940c9d09fe59064f058bb HTTP/1.1" 200 None 2026-05-07 00:59:03,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:59:03,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-07 00:59:03,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:59:03,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f940c9d09fe59064f058bb HTTP/1.1" 200 None 2026-05-07 00:59:03,412 - lava_callback - ERROR - Error processing callback for node 69f940c9d09fe59064f058bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57878 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:00:08,664 - lava_callback - INFO - Received callback for node 69fbdf8b474a995a1884327c INFO: 172.21.0.1:57882 - "POST /node/69fbdf8b474a995a1884327c HTTP/1.0" 202 Accepted 2026-05-07 01:00:08,709 - lava_callback - INFO - Starting async job submit for node 69fbdf8b474a995a1884327c 2026-05-07 01:00:08,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:00:08,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf8b474a995a1884327c HTTP/1.1" 200 None 2026-05-07 01:00:08,748 - lava_callback - DEBUG - Processing node 69fbdf8b474a995a1884327c: baseline-arm-pengutronix 2026-05-07 01:00:08,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:00:09,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:00:09,132 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbdf8b474a995a1884327c/log.txt.gz 2026-05-07 01:00:09,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:00:09,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:00:09,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbdf8b474a995a1884327c/lava-logs.yaml 2026-05-07 01:00:09,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:00:09,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:00:09,431 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbdf8b474a995a1884327c/lava_callback.json.gz DEBUG: Setup failed for 69fbdf8b474a995a1884327c. Transitting job node result: incomplete -> fail 2026-05-07 01:00:09,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:00:09,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbdf8b474a995a1884327c HTTP/1.1" 200 None 2026-05-07 01:00:09,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:00:09,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 01:00:09,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:00:09,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbdf8b474a995a1884327c HTTP/1.1" 200 None 2026-05-07 01:00:09,636 - lava_callback - INFO - Completed processing callback for node 69fbdf8b474a995a1884327c INFO: 172.21.0.1:36458 - "GET /node/68f89b8e1f46926515078930%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:00:19,648 - lava_callback - INFO - Received callback for node 69f9411bd09fe59064f058dc INFO: 172.21.0.1:36492 - "POST /node/69f9411bd09fe59064f058dc HTTP/1.0" 202 Accepted 2026-05-07 01:00:19,654 - lava_callback - INFO - Starting async job submit for node 69f9411bd09fe59064f058dc 2026-05-07 01:00:19,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:00:19,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9411bd09fe59064f058dc HTTP/1.1" 200 None 2026-05-07 01:00:19,670 - lava_callback - DEBUG - Processing node 69f9411bd09fe59064f058dc: baseline-arm-clabbe 2026-05-07 01:00:19,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9411bd09fe59064f058dc 2026-05-07 01:00:19,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:00:19,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9411bd09fe59064f058dc HTTP/1.1" 200 None 2026-05-07 01:00:19,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:00:19,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 01:00:19,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:00:19,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9411bd09fe59064f058dc HTTP/1.1" 200 None 2026-05-07 01:00:19,716 - lava_callback - ERROR - Error processing callback for node 69f9411bd09fe59064f058dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43918 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:00:28,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:00:28,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:01:02,905 - lava_callback - INFO - Received callback for node 69f9413fd09fe59064f058ec INFO: 172.21.0.1:60552 - "POST /node/69f9413fd09fe59064f058ec HTTP/1.0" 202 Accepted 2026-05-07 01:01:02,910 - lava_callback - INFO - Starting async job submit for node 69f9413fd09fe59064f058ec 2026-05-07 01:01:02,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:02,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9413fd09fe59064f058ec HTTP/1.1" 200 None 2026-05-07 01:01:02,926 - lava_callback - DEBUG - Processing node 69f9413fd09fe59064f058ec: baseline-arm-baylibre 2026-05-07 01:01:02,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9413fd09fe59064f058ec 2026-05-07 01:01:02,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:02,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9413fd09fe59064f058ec HTTP/1.1" 200 None 2026-05-07 01:01:02,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:02,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-07 01:01:02,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:02,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9413fd09fe59064f058ec HTTP/1.1" 200 None 2026-05-07 01:01:02,972 - lava_callback - ERROR - Error processing callback for node 69f9413fd09fe59064f058ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:01:42,683 - lava_callback - INFO - Received callback for node 69fbe40a474a995a18843539 INFO: 172.21.0.1:54964 - "POST /node/69fbe40a474a995a18843539 HTTP/1.0" 202 Accepted 2026-05-07 01:01:42,691 - lava_callback - INFO - Starting async job submit for node 69fbe40a474a995a18843539 2026-05-07 01:01:42,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:42,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe40a474a995a18843539 HTTP/1.1" 200 None 2026-05-07 01:01:42,729 - lava_callback - DEBUG - Processing node 69fbe40a474a995a18843539: baseline-x86 2026-05-07 01:01:42,903 - lava_callback - INFO - Received callback for node 69f94171d09fe59064f058f7 INFO: 172.21.0.1:54978 - "POST /node/69f94171d09fe59064f058f7 HTTP/1.0" 202 Accepted 2026-05-07 01:01:42,931 - lava_callback - INFO - Starting async job submit for node 69f94171d09fe59064f058f7 2026-05-07 01:01:42,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:43,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94171d09fe59064f058f7 HTTP/1.1" 200 None 2026-05-07 01:01:43,009 - lava_callback - DEBUG - Processing node 69f94171d09fe59064f058f7: baseline-arm64-baylibre 2026-05-07 01:01:43,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94171d09fe59064f058f7 2026-05-07 01:01:43,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:43,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94171d09fe59064f058f7 HTTP/1.1" 200 None 2026-05-07 01:01:43,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:43,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:01:43,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 01:01:43,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:43,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94171d09fe59064f058f7 HTTP/1.1" 200 None 2026-05-07 01:01:43,169 - lava_callback - ERROR - Error processing callback for node 69f94171d09fe59064f058f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:01:43,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:01:43,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fbe40a474a995a18843539/log.txt.gz 2026-05-07 01:01:43,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:01:43,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:01:43,691 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fbe40a474a995a18843539/lava-logs.yaml 2026-05-07 01:01:43,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:01:43,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:01:43,818 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fbe40a474a995a18843539/lava_callback.json.gz 2026-05-07 01:01:43,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:43,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe40a474a995a18843539 HTTP/1.1" 200 None 2026-05-07 01:01:43,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:43,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda28474a995a18840a31 HTTP/1.1" 200 None 2026-05-07 01:01:43,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:43,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe40a474a995a18843539 HTTP/1.1" 200 None 2026-05-07 01:01:43,924 - lava_callback - INFO - Completed processing callback for node 69fbe40a474a995a18843539 INFO: 172.21.0.1:54986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:01:58,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:01:58,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:02:45,644 - lava_callback - INFO - Received callback for node 69fbe4a4474a995a18843585 INFO: 172.21.0.1:50960 - "POST /node/69fbe4a4474a995a18843585 HTTP/1.0" 202 Accepted 2026-05-07 01:02:45,654 - lava_callback - INFO - Starting async job submit for node 69fbe4a4474a995a18843585 2026-05-07 01:02:45,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:02:45,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe4a4474a995a18843585 HTTP/1.1" 200 None 2026-05-07 01:02:45,686 - lava_callback - DEBUG - Processing node 69fbe4a4474a995a18843585: baseline-arm 2026-05-07 01:02:45,697 - lava_callback - WARNING - Failed to upload log 2026-05-07 01:02:45,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:02:45,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:02:45,932 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbe4a4474a995a18843585/lava-logs.yaml 2026-05-07 01:02:45,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:02:46,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:02:46,016 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbe4a4474a995a18843585/lava_callback.json.gz 2026-05-07 01:02:46,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:02:46,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe4a4474a995a18843585 HTTP/1.1" 200 None 2026-05-07 01:02:46,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:02:46,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 01:02:46,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:02:46,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe4a4474a995a18843585 HTTP/1.1" 200 None 2026-05-07 01:02:46,094 - lava_callback - INFO - Completed processing callback for node 69fbe4a4474a995a18843585 INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59248 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:02:58,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:02:58,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:03:59,844 - lava_callback - INFO - Received callback for node 69f941f1d09fe59064f05933 INFO: 172.21.0.1:39722 - "POST /node/69f941f1d09fe59064f05933 HTTP/1.0" 202 Accepted 2026-05-07 01:03:59,853 - lava_callback - INFO - Starting async job submit for node 69f941f1d09fe59064f05933 2026-05-07 01:03:59,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:03:59,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f941f1d09fe59064f05933 HTTP/1.1" 200 None 2026-05-07 01:03:59,879 - lava_callback - DEBUG - Processing node 69f941f1d09fe59064f05933: baseline-arm64-clabbe 2026-05-07 01:03:59,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f941f1d09fe59064f05933 2026-05-07 01:03:59,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:03:59,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f941f1d09fe59064f05933 HTTP/1.1" 200 None 2026-05-07 01:03:59,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:03:59,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 01:03:59,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:03:59,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f941f1d09fe59064f05933 HTTP/1.1" 200 None 2026-05-07 01:03:59,940 - lava_callback - ERROR - Error processing callback for node 69f941f1d09fe59064f05933: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58886 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:05:19,897 - lava_callback - INFO - Received callback for node 69f94243d09fe59064f05967 INFO: 172.21.0.1:45512 - "POST /node/69f94243d09fe59064f05967 HTTP/1.0" 202 Accepted 2026-05-07 01:05:19,903 - lava_callback - INFO - Starting async job submit for node 69f94243d09fe59064f05967 2026-05-07 01:05:19,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:05:19,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94243d09fe59064f05967 HTTP/1.1" 200 None 2026-05-07 01:05:19,920 - lava_callback - DEBUG - Processing node 69f94243d09fe59064f05967: baseline-arm64-clabbe 2026-05-07 01:05:19,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94243d09fe59064f05967 2026-05-07 01:05:19,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:05:19,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94243d09fe59064f05967 HTTP/1.1" 200 None 2026-05-07 01:05:19,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:05:19,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 01:05:19,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:05:19,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94243d09fe59064f05967 HTTP/1.1" 200 None 2026-05-07 01:05:19,970 - lava_callback - ERROR - Error processing callback for node 69f94243d09fe59064f05967: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57164 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:06:23,228 - lava_callback - INFO - Received callback for node 69f94280d09fe59064f05a0d INFO: 172.21.0.1:51292 - "POST /node/69f94280d09fe59064f05a0d HTTP/1.0" 202 Accepted 2026-05-07 01:06:23,234 - lava_callback - INFO - Starting async job submit for node 69f94280d09fe59064f05a0d 2026-05-07 01:06:23,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:23,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94280d09fe59064f05a0d HTTP/1.1" 200 None 2026-05-07 01:06:23,249 - lava_callback - DEBUG - Processing node 69f94280d09fe59064f05a0d: baseline-arm64-baylibre 2026-05-07 01:06:23,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94280d09fe59064f05a0d 2026-05-07 01:06:23,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:23,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94280d09fe59064f05a0d HTTP/1.1" 200 None 2026-05-07 01:06:23,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:23,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 01:06:23,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:23,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94280d09fe59064f05a0d HTTP/1.1" 200 None 2026-05-07 01:06:23,298 - lava_callback - ERROR - Error processing callback for node 69f94280d09fe59064f05a0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:06:23,872 - lava_callback - INFO - Received callback for node 69f94281d09fe59064f05a10 INFO: 172.21.0.1:51300 - "POST /node/69f94281d09fe59064f05a10 HTTP/1.0" 202 Accepted 2026-05-07 01:06:23,878 - lava_callback - INFO - Starting async job submit for node 69f94281d09fe59064f05a10 2026-05-07 01:06:23,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:23,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94281d09fe59064f05a10 HTTP/1.1" 200 None 2026-05-07 01:06:23,895 - lava_callback - DEBUG - Processing node 69f94281d09fe59064f05a10: baseline-arm64-baylibre 2026-05-07 01:06:23,896 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94281d09fe59064f05a10 2026-05-07 01:06:23,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:23,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94281d09fe59064f05a10 HTTP/1.1" 200 None 2026-05-07 01:06:23,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:23,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 01:06:23,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:23,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94281d09fe59064f05a10 HTTP/1.1" 200 None 2026-05-07 01:06:23,985 - lava_callback - ERROR - Error processing callback for node 69f94281d09fe59064f05a10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:06:24,530 - lava_callback - INFO - Received callback for node 69f94283d09fe59064f05a13 INFO: 172.21.0.1:51312 - "POST /node/69f94283d09fe59064f05a13 HTTP/1.0" 202 Accepted 2026-05-07 01:06:24,540 - lava_callback - INFO - Starting async job submit for node 69f94283d09fe59064f05a13 2026-05-07 01:06:24,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:24,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94283d09fe59064f05a13 HTTP/1.1" 200 None 2026-05-07 01:06:24,556 - lava_callback - DEBUG - Processing node 69f94283d09fe59064f05a13: baseline-arm64-baylibre 2026-05-07 01:06:24,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94283d09fe59064f05a13 2026-05-07 01:06:24,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:24,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94283d09fe59064f05a13 HTTP/1.1" 200 None 2026-05-07 01:06:24,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:24,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 01:06:24,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:24,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94283d09fe59064f05a13 HTTP/1.1" 200 None 2026-05-07 01:06:24,610 - lava_callback - ERROR - Error processing callback for node 69f94283d09fe59064f05a13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:06:25,212 - lava_callback - INFO - Received callback for node 69f94285d09fe59064f05a1a INFO: 172.21.0.1:51322 - "POST /node/69f94285d09fe59064f05a1a HTTP/1.0" 202 Accepted 2026-05-07 01:06:25,225 - lava_callback - INFO - Starting async job submit for node 69f94285d09fe59064f05a1a 2026-05-07 01:06:25,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:25,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94285d09fe59064f05a1a HTTP/1.1" 200 None 2026-05-07 01:06:25,246 - lava_callback - DEBUG - Processing node 69f94285d09fe59064f05a1a: baseline-arm64-baylibre 2026-05-07 01:06:25,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94285d09fe59064f05a1a 2026-05-07 01:06:25,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:25,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94285d09fe59064f05a1a HTTP/1.1" 200 None 2026-05-07 01:06:25,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:25,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 01:06:25,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:25,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94285d09fe59064f05a1a HTTP/1.1" 200 None 2026-05-07 01:06:25,353 - lava_callback - ERROR - Error processing callback for node 69f94285d09fe59064f05a1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:06:25,862 - lava_callback - INFO - Received callback for node 69f94286d09fe59064f05a1e INFO: 172.21.0.1:51326 - "POST /node/69f94286d09fe59064f05a1e HTTP/1.0" 202 Accepted 2026-05-07 01:06:25,870 - lava_callback - INFO - Starting async job submit for node 69f94286d09fe59064f05a1e 2026-05-07 01:06:25,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:25,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94286d09fe59064f05a1e HTTP/1.1" 200 None 2026-05-07 01:06:25,891 - lava_callback - DEBUG - Processing node 69f94286d09fe59064f05a1e: baseline-arm64-baylibre 2026-05-07 01:06:25,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94286d09fe59064f05a1e 2026-05-07 01:06:25,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:25,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94286d09fe59064f05a1e HTTP/1.1" 200 None 2026-05-07 01:06:25,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:25,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 01:06:25,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:25,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94286d09fe59064f05a1e HTTP/1.1" 200 None 2026-05-07 01:06:25,964 - lava_callback - ERROR - Error processing callback for node 69f94286d09fe59064f05a1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:06:26,506 - lava_callback - INFO - Received callback for node 69f94288d09fe59064f05a21 INFO: 172.21.0.1:51328 - "POST /node/69f94288d09fe59064f05a21 HTTP/1.0" 202 Accepted 2026-05-07 01:06:26,513 - lava_callback - INFO - Starting async job submit for node 69f94288d09fe59064f05a21 2026-05-07 01:06:26,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:06:26,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94288d09fe59064f05a21 HTTP/1.1" 200 None 2026-05-07 01:06:26,529 - lava_callback - DEBUG - Processing node 69f94288d09fe59064f05a21: baseline-arm64-baylibre 2026-05-07 01:06:26,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94288d09fe59064f05a21 2026-05-07 01:06:26,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:26,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94288d09fe59064f05a21 HTTP/1.1" 200 None 2026-05-07 01:06:26,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:26,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 01:06:26,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:26,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94288d09fe59064f05a21 HTTP/1.1" 200 None 2026-05-07 01:06:26,580 - lava_callback - ERROR - Error processing callback for node 69f94288d09fe59064f05a21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:06:39,910 - lava_callback - INFO - Received callback for node 69f94295d09fe59064f05a66 INFO: 172.21.0.1:56186 - "POST /node/69f94295d09fe59064f05a66 HTTP/1.0" 202 Accepted 2026-05-07 01:06:39,918 - lava_callback - INFO - Starting async job submit for node 69f94295d09fe59064f05a66 2026-05-07 01:06:39,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:39,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94295d09fe59064f05a66 HTTP/1.1" 200 None 2026-05-07 01:06:39,936 - lava_callback - DEBUG - Processing node 69f94295d09fe59064f05a66: baseline-arm64-clabbe 2026-05-07 01:06:39,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94295d09fe59064f05a66 2026-05-07 01:06:39,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:39,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94295d09fe59064f05a66 HTTP/1.1" 200 None 2026-05-07 01:06:39,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:39,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 01:06:39,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:40,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94295d09fe59064f05a66 HTTP/1.1" 200 None 2026-05-07 01:06:40,007 - lava_callback - ERROR - Error processing callback for node 69f94295d09fe59064f05a66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:06:40,599 - lava_callback - INFO - Received callback for node 69f94297d09fe59064f05a6b INFO: 172.21.0.1:56202 - "POST /node/69f94297d09fe59064f05a6b HTTP/1.0" 202 Accepted 2026-05-07 01:06:40,609 - lava_callback - INFO - Starting async job submit for node 69f94297d09fe59064f05a6b 2026-05-07 01:06:40,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:40,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94297d09fe59064f05a6b HTTP/1.1" 200 None 2026-05-07 01:06:40,636 - lava_callback - DEBUG - Processing node 69f94297d09fe59064f05a6b: baseline-arm64-clabbe 2026-05-07 01:06:40,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94297d09fe59064f05a6b 2026-05-07 01:06:40,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:40,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94297d09fe59064f05a6b HTTP/1.1" 200 None 2026-05-07 01:06:40,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:40,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 01:06:40,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:40,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94297d09fe59064f05a6b HTTP/1.1" 200 None 2026-05-07 01:06:40,728 - lava_callback - ERROR - Error processing callback for node 69f94297d09fe59064f05a6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:06:41,288 - lava_callback - INFO - Received callback for node 69f94296d09fe59064f05a68 INFO: 172.21.0.1:56216 - "POST /node/69f94296d09fe59064f05a68 HTTP/1.0" 202 Accepted 2026-05-07 01:06:41,294 - lava_callback - INFO - Starting async job submit for node 69f94296d09fe59064f05a68 2026-05-07 01:06:41,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:41,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94296d09fe59064f05a68 HTTP/1.1" 200 None 2026-05-07 01:06:41,315 - lava_callback - DEBUG - Processing node 69f94296d09fe59064f05a68: baseline-arm64-clabbe 2026-05-07 01:06:41,315 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94296d09fe59064f05a68 2026-05-07 01:06:41,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:41,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94296d09fe59064f05a68 HTTP/1.1" 200 None 2026-05-07 01:06:41,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:41,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 01:06:41,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:41,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94296d09fe59064f05a68 HTTP/1.1" 200 None 2026-05-07 01:06:41,370 - lava_callback - ERROR - Error processing callback for node 69f94296d09fe59064f05a68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:06:41,967 - lava_callback - INFO - Received callback for node 69f94298d09fe59064f05a6e INFO: 172.21.0.1:56220 - "POST /node/69f94298d09fe59064f05a6e HTTP/1.0" 202 Accepted 2026-05-07 01:06:41,974 - lava_callback - INFO - Starting async job submit for node 69f94298d09fe59064f05a6e 2026-05-07 01:06:41,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:41,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94298d09fe59064f05a6e HTTP/1.1" 200 None 2026-05-07 01:06:41,996 - lava_callback - DEBUG - Processing node 69f94298d09fe59064f05a6e: baseline-arm64-clabbe 2026-05-07 01:06:41,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94298d09fe59064f05a6e 2026-05-07 01:06:41,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:42,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94298d09fe59064f05a6e HTTP/1.1" 200 None 2026-05-07 01:06:42,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:42,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 01:06:42,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:42,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94298d09fe59064f05a6e HTTP/1.1" 200 None 2026-05-07 01:06:42,069 - lava_callback - ERROR - Error processing callback for node 69f94298d09fe59064f05a6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:06:42,653 - lava_callback - INFO - Received callback for node 69f94299d09fe59064f05a72 INFO: 172.21.0.1:56230 - "POST /node/69f94299d09fe59064f05a72 HTTP/1.0" 202 Accepted 2026-05-07 01:06:42,662 - lava_callback - INFO - Starting async job submit for node 69f94299d09fe59064f05a72 2026-05-07 01:06:42,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:42,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94299d09fe59064f05a72 HTTP/1.1" 200 None 2026-05-07 01:06:42,689 - lava_callback - DEBUG - Processing node 69f94299d09fe59064f05a72: baseline-arm64-clabbe 2026-05-07 01:06:42,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94299d09fe59064f05a72 2026-05-07 01:06:42,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:42,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94299d09fe59064f05a72 HTTP/1.1" 200 None 2026-05-07 01:06:42,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:42,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 01:06:42,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:42,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94299d09fe59064f05a72 HTTP/1.1" 200 None 2026-05-07 01:06:42,749 - lava_callback - ERROR - Error processing callback for node 69f94299d09fe59064f05a72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:06:43,336 - lava_callback - INFO - Received callback for node 69f9429cd09fe59064f05a7b INFO: 172.21.0.1:56234 - "POST /node/69f9429cd09fe59064f05a7b HTTP/1.0" 202 Accepted 2026-05-07 01:06:43,342 - lava_callback - INFO - Starting async job submit for node 69f9429cd09fe59064f05a7b 2026-05-07 01:06:43,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:43,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9429cd09fe59064f05a7b HTTP/1.1" 200 None 2026-05-07 01:06:43,359 - lava_callback - DEBUG - Processing node 69f9429cd09fe59064f05a7b: baseline-arm64-clabbe 2026-05-07 01:06:43,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9429cd09fe59064f05a7b 2026-05-07 01:06:43,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:43,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9429cd09fe59064f05a7b HTTP/1.1" 200 None 2026-05-07 01:06:43,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:43,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 01:06:43,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:43,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9429cd09fe59064f05a7b HTTP/1.1" 200 None 2026-05-07 01:06:43,444 - lava_callback - ERROR - Error processing callback for node 69f9429cd09fe59064f05a7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:06:44,051 - lava_callback - INFO - Received callback for node 69f9429bd09fe59064f05a78 INFO: 172.21.0.1:56250 - "POST /node/69f9429bd09fe59064f05a78 HTTP/1.0" 202 Accepted 2026-05-07 01:06:44,059 - lava_callback - INFO - Starting async job submit for node 69f9429bd09fe59064f05a78 2026-05-07 01:06:44,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:44,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9429bd09fe59064f05a78 HTTP/1.1" 200 None 2026-05-07 01:06:44,088 - lava_callback - DEBUG - Processing node 69f9429bd09fe59064f05a78: baseline-arm64-clabbe 2026-05-07 01:06:44,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9429bd09fe59064f05a78 2026-05-07 01:06:44,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:44,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9429bd09fe59064f05a78 HTTP/1.1" 200 None 2026-05-07 01:06:44,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:44,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 01:06:44,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:06:44,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9429bd09fe59064f05a78 HTTP/1.1" 200 None 2026-05-07 01:06:44,143 - lava_callback - ERROR - Error processing callback for node 69f9429bd09fe59064f05a78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:07:44,360 - lava_callback - INFO - Received callback for node 69fbe5ba474a995a1884360c INFO: 172.21.0.1:42200 - "POST /node/69fbe5ba474a995a1884360c HTTP/1.0" 202 Accepted 2026-05-07 01:07:44,366 - lava_callback - INFO - Starting async job submit for node 69fbe5ba474a995a1884360c 2026-05-07 01:07:44,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:07:44,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ba474a995a1884360c HTTP/1.1" 200 None 2026-05-07 01:07:44,401 - lava_callback - DEBUG - Processing node 69fbe5ba474a995a1884360c: baseline-arm64 2026-05-07 01:07:44,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:07:44,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:07:44,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5ba474a995a1884360c/log.txt.gz 2026-05-07 01:07:44,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:07:44,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:07:45,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5ba474a995a1884360c/lava-logs.yaml 2026-05-07 01:07:45,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:07:45,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:07:45,111 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5ba474a995a1884360c/lava_callback.json.gz 2026-05-07 01:07:45,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:07:45,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ba474a995a1884360c HTTP/1.1" 200 None 2026-05-07 01:07:45,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:07:45,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:07:45,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:07:45,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5ba474a995a1884360c HTTP/1.1" 200 None 2026-05-07 01:07:45,179 - lava_callback - INFO - Completed processing callback for node 69fbe5ba474a995a1884360c INFO: 172.21.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:07:58,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:07:58,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 01:07:59,571 - lava_callback - INFO - Received callback for node 69fbe5d5474a995a18843661 INFO: 172.21.0.1:56200 - "POST /node/69fbe5d5474a995a18843661 HTTP/1.0" 202 Accepted 2026-05-07 01:07:59,577 - lava_callback - INFO - Starting async job submit for node 69fbe5d5474a995a18843661 2026-05-07 01:07:59,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:07:59,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d5474a995a18843661 HTTP/1.1" 200 None 2026-05-07 01:07:59,593 - lava_callback - DEBUG - Processing node 69fbe5d5474a995a18843661: baseline-nfs-arm64 2026-05-07 01:07:59,595 - lava_callback - WARNING - Failed to upload log 2026-05-07 01:07:59,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:07:59,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:07:59,683 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d5474a995a18843661/lava-logs.yaml 2026-05-07 01:07:59,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:07:59,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:07:59,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d5474a995a18843661/lava_callback.json.gz 2026-05-07 01:07:59,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:07:59,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d5474a995a18843661 HTTP/1.1" 200 None 2026-05-07 01:07:59,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:07:59,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:07:59,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:07:59,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5d5474a995a18843661 HTTP/1.1" 200 None 2026-05-07 01:07:59,814 - lava_callback - INFO - Completed processing callback for node 69fbe5d5474a995a18843661 2026-05-07 01:08:00,020 - lava_callback - INFO - Received callback for node 69f942edd09fe59064f05b97 INFO: 172.21.0.1:42758 - "POST /node/69f942edd09fe59064f05b97 HTTP/1.0" 202 Accepted 2026-05-07 01:08:00,026 - lava_callback - INFO - Starting async job submit for node 69f942edd09fe59064f05b97 2026-05-07 01:08:00,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:00,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f942edd09fe59064f05b97 HTTP/1.1" 200 None 2026-05-07 01:08:00,061 - lava_callback - DEBUG - Processing node 69f942edd09fe59064f05b97: baseline-arm64-clabbe 2026-05-07 01:08:00,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f942edd09fe59064f05b97 2026-05-07 01:08:00,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:00,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f942edd09fe59064f05b97 HTTP/1.1" 200 None 2026-05-07 01:08:00,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:00,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 01:08:00,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:00,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f942edd09fe59064f05b97 HTTP/1.1" 200 None 2026-05-07 01:08:00,138 - lava_callback - ERROR - Error processing callback for node 69f942edd09fe59064f05b97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:08:13,549 - lava_callback - INFO - Received callback for node 69fbe5c6474a995a18843639 INFO: 172.21.0.1:37524 - "POST /node/69fbe5c6474a995a18843639 HTTP/1.0" 202 Accepted 2026-05-07 01:08:13,555 - lava_callback - INFO - Starting async job submit for node 69fbe5c6474a995a18843639 2026-05-07 01:08:13,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:13,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c6474a995a18843639 HTTP/1.1" 200 None 2026-05-07 01:08:13,589 - lava_callback - DEBUG - Processing node 69fbe5c6474a995a18843639: baseline-arm64 2026-05-07 01:08:13,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:08:13,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:08:13,844 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c6474a995a18843639/log.txt.gz 2026-05-07 01:08:13,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:08:14,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:08:14,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c6474a995a18843639/lava-logs.yaml 2026-05-07 01:08:14,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:08:14,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:08:14,239 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c6474a995a18843639/lava_callback.json.gz 2026-05-07 01:08:14,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:14,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c6474a995a18843639 HTTP/1.1" 200 None 2026-05-07 01:08:14,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:14,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:08:14,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:14,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5c6474a995a18843639 HTTP/1.1" 200 None 2026-05-07 01:08:14,330 - lava_callback - INFO - Completed processing callback for node 69fbe5c6474a995a18843639 INFO: 172.21.0.1:37546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33272 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:08:28,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:29,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 01:08:35,045 - lava_callback - INFO - Received callback for node 69fbe5bc474a995a1884361c INFO: 172.21.0.1:38946 - "POST /node/69fbe5bc474a995a1884361c HTTP/1.0" 202 Accepted 2026-05-07 01:08:35,052 - lava_callback - INFO - Starting async job submit for node 69fbe5bc474a995a1884361c 2026-05-07 01:08:35,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:35,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5bc474a995a1884361c HTTP/1.1" 200 None 2026-05-07 01:08:35,090 - lava_callback - DEBUG - Processing node 69fbe5bc474a995a1884361c: baseline-arm64 2026-05-07 01:08:35,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:08:35,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:08:35,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5bc474a995a1884361c/log.txt.gz 2026-05-07 01:08:35,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:08:35,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:08:35,859 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5bc474a995a1884361c/lava-logs.yaml 2026-05-07 01:08:35,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:08:35,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:08:35,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5bc474a995a1884361c/lava_callback.json.gz 2026-05-07 01:08:36,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:36,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5bc474a995a1884361c HTTP/1.1" 200 None 2026-05-07 01:08:36,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:36,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:08:36,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:36,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5bc474a995a1884361c HTTP/1.1" 200 None 2026-05-07 01:08:36,082 - lava_callback - INFO - Completed processing callback for node 69fbe5bc474a995a1884361c INFO: 172.21.0.1:38962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:08:47,576 - lava_callback - INFO - Received callback for node 69fbe5bb474a995a1884360f INFO: 172.21.0.1:52158 - "POST /node/69fbe5bb474a995a1884360f HTTP/1.0" 202 Accepted 2026-05-07 01:08:47,582 - lava_callback - INFO - Starting async job submit for node 69fbe5bb474a995a1884360f 2026-05-07 01:08:47,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:47,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5bb474a995a1884360f HTTP/1.1" 200 None 2026-05-07 01:08:47,635 - lava_callback - DEBUG - Processing node 69fbe5bb474a995a1884360f: baseline-arm64 2026-05-07 01:08:47,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:08:47,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:08:47,981 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5bb474a995a1884360f/log.txt.gz 2026-05-07 01:08:48,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:08:48,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:08:48,432 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5bb474a995a1884360f/lava-logs.yaml 2026-05-07 01:08:48,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:08:48,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:08:48,561 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5bb474a995a1884360f/lava_callback.json.gz 2026-05-07 01:08:48,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:48,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5bb474a995a1884360f HTTP/1.1" 200 None 2026-05-07 01:08:48,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:48,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:08:48,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:48,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5bb474a995a1884360f HTTP/1.1" 200 None 2026-05-07 01:08:48,648 - lava_callback - INFO - Completed processing callback for node 69fbe5bb474a995a1884360f INFO: 172.21.0.1:33348 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:08:59,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:08:59,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39378 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:09:13,930 - lava_callback - INFO - Received callback for node 69fbe5e7474a995a188436ba INFO: 172.21.0.1:39390 - "POST /node/69fbe5e7474a995a188436ba HTTP/1.0" 202 Accepted 2026-05-07 01:09:13,936 - lava_callback - INFO - Starting async job submit for node 69fbe5e7474a995a188436ba 2026-05-07 01:09:13,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:13,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5e7474a995a188436ba HTTP/1.1" 200 None 2026-05-07 01:09:13,975 - lava_callback - DEBUG - Processing node 69fbe5e7474a995a188436ba: baseline-arm64-broonie 2026-05-07 01:09:14,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:14,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:14,270 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5e7474a995a188436ba/log.txt.gz 2026-05-07 01:09:14,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:14,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:14,529 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5e7474a995a188436ba/lava-logs.yaml 2026-05-07 01:09:14,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:14,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:14,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5e7474a995a188436ba/lava_callback.json.gz 2026-05-07 01:09:14,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:14,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5e7474a995a188436ba HTTP/1.1" 200 None 2026-05-07 01:09:14,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:14,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:09:14,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:14,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5e7474a995a188436ba HTTP/1.1" 200 None 2026-05-07 01:09:14,724 - lava_callback - INFO - Completed processing callback for node 69fbe5e7474a995a188436ba INFO: 172.21.0.1:39404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39416 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:09:25,099 - lava_callback - INFO - Received callback for node 69fbe600474a995a18843727 INFO: 172.21.0.1:36430 - "POST /node/69fbe600474a995a18843727 HTTP/1.0" 202 Accepted 2026-05-07 01:09:25,105 - lava_callback - INFO - Starting async job submit for node 69fbe600474a995a18843727 2026-05-07 01:09:25,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:25,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe600474a995a18843727 HTTP/1.1" 200 None 2026-05-07 01:09:25,143 - lava_callback - DEBUG - Processing node 69fbe600474a995a18843727: baseline-arm64-foundriesio 2026-05-07 01:09:25,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:25,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:25,451 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbe600474a995a18843727/log.txt.gz 2026-05-07 01:09:25,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:25,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:25,702 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbe600474a995a18843727/lava-logs.yaml 2026-05-07 01:09:25,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:25,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:25,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbe600474a995a18843727/lava_callback.json.gz 2026-05-07 01:09:25,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:25,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe600474a995a18843727 HTTP/1.1" 200 None 2026-05-07 01:09:25,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:25,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:09:25,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:25,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe600474a995a18843727 HTTP/1.1" 200 None 2026-05-07 01:09:25,952 - lava_callback - INFO - Completed processing callback for node 69fbe600474a995a18843727 INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:09:29,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:29,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 01:09:29,615 - lava_callback - INFO - Received callback for node 69fbe5fe474a995a18843721 INFO: 172.21.0.1:36458 - "POST /node/69fbe5fe474a995a18843721 HTTP/1.0" 202 Accepted 2026-05-07 01:09:29,621 - lava_callback - INFO - Starting async job submit for node 69fbe5fe474a995a18843721 2026-05-07 01:09:29,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:29,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5fe474a995a18843721 HTTP/1.1" 200 None 2026-05-07 01:09:29,660 - lava_callback - DEBUG - Processing node 69fbe5fe474a995a18843721: baseline-arm64-pengutronix 2026-05-07 01:09:29,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:29,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:29,942 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbe5fe474a995a18843721/log.txt.gz 2026-05-07 01:09:30,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:30,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:30,199 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbe5fe474a995a18843721/lava-logs.yaml 2026-05-07 01:09:30,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:30,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:30,303 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbe5fe474a995a18843721/lava_callback.json.gz 2026-05-07 01:09:30,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:30,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5fe474a995a18843721 HTTP/1.1" 200 None 2026-05-07 01:09:30,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:30,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:09:30,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:30,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5fe474a995a18843721 HTTP/1.1" 200 None 2026-05-07 01:09:30,381 - lava_callback - INFO - Completed processing callback for node 69fbe5fe474a995a18843721 2026-05-07 01:09:30,831 - lava_callback - INFO - Received callback for node 69fbe5fd474a995a1884371a INFO: 172.21.0.1:41730 - "POST /node/69fbe5fd474a995a1884371a HTTP/1.0" 202 Accepted 2026-05-07 01:09:30,839 - lava_callback - INFO - Starting async job submit for node 69fbe5fd474a995a1884371a 2026-05-07 01:09:30,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:30,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5fd474a995a1884371a HTTP/1.1" 200 None 2026-05-07 01:09:30,876 - lava_callback - DEBUG - Processing node 69fbe5fd474a995a1884371a: baseline-arm64-pengutronix 2026-05-07 01:09:31,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:31,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:31,148 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbe5fd474a995a1884371a/log.txt.gz 2026-05-07 01:09:31,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:31,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:31,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbe5fd474a995a1884371a/lava-logs.yaml 2026-05-07 01:09:31,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:31,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:31,509 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbe5fd474a995a1884371a/lava_callback.json.gz 2026-05-07 01:09:31,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:31,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5fd474a995a1884371a HTTP/1.1" 200 None 2026-05-07 01:09:31,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:31,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:09:31,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:31,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5fd474a995a1884371a HTTP/1.1" 200 None 2026-05-07 01:09:31,579 - lava_callback - INFO - Completed processing callback for node 69fbe5fd474a995a1884371a 2026-05-07 01:09:33,462 - lava_callback - INFO - Received callback for node 69fbe5ff474a995a18843724 INFO: 172.21.0.1:41742 - "POST /node/69fbe5ff474a995a18843724 HTTP/1.0" 202 Accepted 2026-05-07 01:09:33,468 - lava_callback - INFO - Starting async job submit for node 69fbe5ff474a995a18843724 2026-05-07 01:09:33,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:33,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ff474a995a18843724 HTTP/1.1" 200 None 2026-05-07 01:09:33,521 - lava_callback - DEBUG - Processing node 69fbe5ff474a995a18843724: baseline-arm64-pengutronix 2026-05-07 01:09:33,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:33,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:33,812 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbe5ff474a995a18843724/log.txt.gz 2026-05-07 01:09:33,929 - lava_callback - INFO - Received callback for node 69fbe5ee474a995a188436c9 INFO: 172.21.0.1:41756 - "POST /node/69fbe5ee474a995a188436c9 HTTP/1.0" 202 Accepted 2026-05-07 01:09:33,936 - lava_callback - INFO - Starting async job submit for node 69fbe5ee474a995a188436c9 2026-05-07 01:09:33,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:33,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:34,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ee474a995a188436c9 HTTP/1.1" 200 None 2026-05-07 01:09:34,016 - lava_callback - DEBUG - Processing node 69fbe5ee474a995a188436c9: baseline-arm64-broonie 2026-05-07 01:09:34,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:34,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbe5ff474a995a18843724/lava-logs.yaml 2026-05-07 01:09:34,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:34,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:34,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:34,353 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5ee474a995a188436c9/log.txt.gz 2026-05-07 01:09:34,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:34,411 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbe5ff474a995a18843724/lava_callback.json.gz 2026-05-07 01:09:34,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:34,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:34,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ff474a995a18843724 HTTP/1.1" 200 None 2026-05-07 01:09:34,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:34,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:09:34,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:34,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5ff474a995a18843724 HTTP/1.1" 200 None 2026-05-07 01:09:34,604 - lava_callback - INFO - Completed processing callback for node 69fbe5ff474a995a18843724 2026-05-07 01:09:34,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:34,746 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5ee474a995a188436c9/lava-logs.yaml 2026-05-07 01:09:34,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:34,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:34,862 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5ee474a995a188436c9/lava_callback.json.gz 2026-05-07 01:09:34,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:34,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ee474a995a188436c9 HTTP/1.1" 200 None 2026-05-07 01:09:34,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:34,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:09:34,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:34,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5ee474a995a188436c9 HTTP/1.1" 200 None 2026-05-07 01:09:34,945 - lava_callback - INFO - Completed processing callback for node 69fbe5ee474a995a188436c9 2026-05-07 01:09:35,867 - lava_callback - INFO - Received callback for node 69fbe5fc474a995a18843717 INFO: 172.21.0.1:41770 - "POST /node/69fbe5fc474a995a18843717 HTTP/1.0" 202 Accepted 2026-05-07 01:09:35,873 - lava_callback - INFO - Starting async job submit for node 69fbe5fc474a995a18843717 2026-05-07 01:09:35,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:35,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5fc474a995a18843717 HTTP/1.1" 200 None 2026-05-07 01:09:35,911 - lava_callback - DEBUG - Processing node 69fbe5fc474a995a18843717: baseline-arm64-kontron 2026-05-07 01:09:36,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:36,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:36,337 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fbe5fc474a995a18843717/log.txt.gz INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:09:36,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:41774 - "GET /node/697f2ce4ad063048cae7c41e%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-07 01:09:36,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:36,666 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fbe5fc474a995a18843717/lava-logs.yaml 2026-05-07 01:09:36,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:36,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:36,763 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fbe5fc474a995a18843717/lava_callback.json.gz 2026-05-07 01:09:36,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:36,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5fc474a995a18843717 HTTP/1.1" 200 None 2026-05-07 01:09:36,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:36,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:09:36,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:36,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5fc474a995a18843717 HTTP/1.1" 200 None 2026-05-07 01:09:36,835 - lava_callback - INFO - Completed processing callback for node 69fbe5fc474a995a18843717 2026-05-07 01:09:39,961 - lava_callback - INFO - Received callback for node 69f94343d09fe59064f05bee INFO: 172.21.0.1:42152 - "POST /node/69f94343d09fe59064f05bee HTTP/1.0" 202 Accepted 2026-05-07 01:09:39,966 - lava_callback - INFO - Starting async job submit for node 69f94343d09fe59064f05bee 2026-05-07 01:09:39,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:39,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94343d09fe59064f05bee HTTP/1.1" 200 None 2026-05-07 01:09:39,982 - lava_callback - DEBUG - Processing node 69f94343d09fe59064f05bee: baseline-arm64-clabbe 2026-05-07 01:09:39,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94343d09fe59064f05bee 2026-05-07 01:09:39,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:40,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94343d09fe59064f05bee HTTP/1.1" 200 None 2026-05-07 01:09:40,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:40,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 01:09:40,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:40,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94343d09fe59064f05bee HTTP/1.1" 200 None 2026-05-07 01:09:40,063 - lava_callback - ERROR - Error processing callback for node 69f94343d09fe59064f05bee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:09:40,609 - lava_callback - INFO - Received callback for node 69fbe601474a995a1884372a INFO: 172.21.0.1:42160 - "POST /node/69fbe601474a995a1884372a HTTP/1.0" 202 Accepted 2026-05-07 01:09:40,616 - lava_callback - INFO - Starting async job submit for node 69fbe601474a995a1884372a 2026-05-07 01:09:40,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:40,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe601474a995a1884372a HTTP/1.1" 200 None 2026-05-07 01:09:40,660 - lava_callback - DEBUG - Processing node 69fbe601474a995a1884372a: baseline-arm64-foundriesio 2026-05-07 01:09:41,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:41,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:41,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbe601474a995a1884372a/log.txt.gz 2026-05-07 01:09:41,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:41,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:41,543 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbe601474a995a1884372a/lava-logs.yaml 2026-05-07 01:09:41,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:41,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:41,678 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbe601474a995a1884372a/lava_callback.json.gz 2026-05-07 01:09:41,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:41,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe601474a995a1884372a HTTP/1.1" 200 None 2026-05-07 01:09:41,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:41,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:09:41,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:41,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe601474a995a1884372a HTTP/1.1" 200 None 2026-05-07 01:09:41,777 - lava_callback - INFO - Completed processing callback for node 69fbe601474a995a1884372a 2026-05-07 01:09:42,047 - lava_callback - INFO - Received callback for node 69fbe5ea474a995a188436c0 INFO: 172.21.0.1:42162 - "POST /node/69fbe5ea474a995a188436c0 HTTP/1.0" 202 Accepted 2026-05-07 01:09:42,058 - lava_callback - INFO - Starting async job submit for node 69fbe5ea474a995a188436c0 2026-05-07 01:09:42,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:42,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ea474a995a188436c0 HTTP/1.1" 200 None 2026-05-07 01:09:42,098 - lava_callback - DEBUG - Processing node 69fbe5ea474a995a188436c0: baseline-arm64-broonie 2026-05-07 01:09:42,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:42,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:42,490 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5ea474a995a188436c0/log.txt.gz 2026-05-07 01:09:42,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:42,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:42,800 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5ea474a995a188436c0/lava-logs.yaml 2026-05-07 01:09:42,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:42,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:42,894 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5ea474a995a188436c0/lava_callback.json.gz 2026-05-07 01:09:42,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:42,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ea474a995a188436c0 HTTP/1.1" 200 None 2026-05-07 01:09:42,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:42,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:09:42,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:42,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5ea474a995a188436c0 HTTP/1.1" 200 None 2026-05-07 01:09:42,967 - lava_callback - INFO - Completed processing callback for node 69fbe5ea474a995a188436c0 2026-05-07 01:09:43,532 - lava_callback - INFO - Received callback for node 69fbe5eb474a995a188436c3 INFO: 172.21.0.1:42168 - "POST /node/69fbe5eb474a995a188436c3 HTTP/1.0" 202 Accepted 2026-05-07 01:09:43,539 - lava_callback - INFO - Starting async job submit for node 69fbe5eb474a995a188436c3 2026-05-07 01:09:43,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:43,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5eb474a995a188436c3 HTTP/1.1" 200 None 2026-05-07 01:09:43,593 - lava_callback - DEBUG - Processing node 69fbe5eb474a995a188436c3: baseline-arm64-broonie 2026-05-07 01:09:43,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:43,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:43,942 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5eb474a995a188436c3/log.txt.gz 2026-05-07 01:09:44,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:44,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:44,218 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5eb474a995a188436c3/lava-logs.yaml 2026-05-07 01:09:44,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:09:44,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:09:44,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5eb474a995a188436c3/lava_callback.json.gz 2026-05-07 01:09:44,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:44,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5eb474a995a188436c3 HTTP/1.1" 200 None 2026-05-07 01:09:44,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:44,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:09:44,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:44,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5eb474a995a188436c3 HTTP/1.1" 200 None 2026-05-07 01:09:44,391 - lava_callback - INFO - Completed processing callback for node 69fbe5eb474a995a188436c3 INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48708 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:09:59,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:09:59,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-07 01:10:03,484 - lava_callback - INFO - Received callback for node 69fbe5f0474a995a188436d1 INFO: 172.21.0.1:55092 - "POST /node/69fbe5f0474a995a188436d1 HTTP/1.0" 202 Accepted 2026-05-07 01:10:03,490 - lava_callback - INFO - Starting async job submit for node 69fbe5f0474a995a188436d1 2026-05-07 01:10:03,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:03,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5f0474a995a188436d1 HTTP/1.1" 200 None 2026-05-07 01:10:03,529 - lava_callback - DEBUG - Processing node 69fbe5f0474a995a188436d1: baseline-arm64-broonie 2026-05-07 01:10:03,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:03,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:03,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5f0474a995a188436d1/log.txt.gz 2026-05-07 01:10:04,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:04,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:04,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5f0474a995a188436d1/lava-logs.yaml 2026-05-07 01:10:04,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:04,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:04,440 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5f0474a995a188436d1/lava_callback.json.gz 2026-05-07 01:10:04,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:04,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5f0474a995a188436d1 HTTP/1.1" 200 None 2026-05-07 01:10:04,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:04,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:10:04,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:04,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5f0474a995a188436d1 HTTP/1.1" 200 None 2026-05-07 01:10:04,520 - lava_callback - INFO - Completed processing callback for node 69fbe5f0474a995a188436d1 INFO: 172.21.0.1:55094 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:10:07,806 - lava_callback - INFO - Received callback for node 69fbe5f8474a995a1884370e INFO: 172.21.0.1:55098 - "POST /node/69fbe5f8474a995a1884370e HTTP/1.0" 202 Accepted 2026-05-07 01:10:07,812 - lava_callback - INFO - Starting async job submit for node 69fbe5f8474a995a1884370e 2026-05-07 01:10:07,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:07,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5f8474a995a1884370e HTTP/1.1" 200 None 2026-05-07 01:10:07,855 - lava_callback - DEBUG - Processing node 69fbe5f8474a995a1884370e: baseline-arm64-clabbe 2026-05-07 01:10:08,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:08,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:08,216 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fbe5f8474a995a1884370e/log.txt.gz 2026-05-07 01:10:08,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:08,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:08,481 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fbe5f8474a995a1884370e/lava-logs.yaml 2026-05-07 01:10:08,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:08,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:08,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fbe5f8474a995a1884370e/lava_callback.json.gz 2026-05-07 01:10:08,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:08,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5f8474a995a1884370e HTTP/1.1" 200 None 2026-05-07 01:10:08,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:08,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:10:08,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:08,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5f8474a995a1884370e HTTP/1.1" 200 None 2026-05-07 01:10:08,666 - lava_callback - INFO - Completed processing callback for node 69fbe5f8474a995a1884370e INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-07 01:10:16,409 - lava_callback - INFO - Received callback for node 69fbe5f3474a995a188436da INFO: 172.21.0.1:48036 - "POST /node/69fbe5f3474a995a188436da HTTP/1.0" 202 Accepted 2026-05-07 01:10:16,416 - lava_callback - INFO - Starting async job submit for node 69fbe5f3474a995a188436da 2026-05-07 01:10:16,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:16,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5f3474a995a188436da HTTP/1.1" 200 None 2026-05-07 01:10:16,454 - lava_callback - DEBUG - Processing node 69fbe5f3474a995a188436da: baseline-arm64-broonie INFO: 172.21.0.1:48046 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:10:16,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:16,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:16,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5f3474a995a188436da/log.txt.gz 2026-05-07 01:10:16,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:17,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:17,105 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5f3474a995a188436da/lava-logs.yaml 2026-05-07 01:10:17,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:17,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:17,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5f3474a995a188436da/lava_callback.json.gz 2026-05-07 01:10:17,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:17,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5f3474a995a188436da HTTP/1.1" 200 None 2026-05-07 01:10:17,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:17,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:10:17,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:17,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5f3474a995a188436da HTTP/1.1" 200 None 2026-05-07 01:10:17,274 - lava_callback - INFO - Completed processing callback for node 69fbe5f3474a995a188436da 2026-05-07 01:10:22,270 - lava_callback - INFO - Received callback for node 69fbe5f1474a995a188436d6 INFO: 172.21.0.1:39174 - "POST /node/69fbe5f1474a995a188436d6 HTTP/1.0" 202 Accepted 2026-05-07 01:10:22,276 - lava_callback - INFO - Starting async job submit for node 69fbe5f1474a995a188436d6 2026-05-07 01:10:22,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:22,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5f1474a995a188436d6 HTTP/1.1" 200 None 2026-05-07 01:10:22,314 - lava_callback - DEBUG - Processing node 69fbe5f1474a995a188436d6: baseline-arm64-broonie 2026-05-07 01:10:22,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:22,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:22,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5f1474a995a188436d6/log.txt.gz 2026-05-07 01:10:22,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:22,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:22,907 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5f1474a995a188436d6/lava-logs.yaml 2026-05-07 01:10:22,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:22,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:22,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5f1474a995a188436d6/lava_callback.json.gz 2026-05-07 01:10:23,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:23,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5f1474a995a188436d6 HTTP/1.1" 200 None 2026-05-07 01:10:23,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:23,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:10:23,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:23,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5f1474a995a188436d6 HTTP/1.1" 200 None 2026-05-07 01:10:23,070 - lava_callback - INFO - Completed processing callback for node 69fbe5f1474a995a188436d6 INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:10:29,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:29,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-07 01:10:34,650 - lava_callback - INFO - Received callback for node 69fbe5e8474a995a188436bd INFO: 172.21.0.1:36140 - "POST /node/69fbe5e8474a995a188436bd HTTP/1.0" 202 Accepted 2026-05-07 01:10:34,656 - lava_callback - INFO - Starting async job submit for node 69fbe5e8474a995a188436bd 2026-05-07 01:10:34,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:34,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5e8474a995a188436bd HTTP/1.1" 200 None 2026-05-07 01:10:34,692 - lava_callback - DEBUG - Processing node 69fbe5e8474a995a188436bd: baseline-arm64-broonie 2026-05-07 01:10:34,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:35,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:35,009 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5e8474a995a188436bd/log.txt.gz 2026-05-07 01:10:35,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:35,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:35,274 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5e8474a995a188436bd/lava-logs.yaml 2026-05-07 01:10:35,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:10:35,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:10:35,537 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5e8474a995a188436bd/lava_callback.json.gz 2026-05-07 01:10:35,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:35,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5e8474a995a188436bd HTTP/1.1" 200 None 2026-05-07 01:10:35,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:35,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:10:35,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:35,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5e8474a995a188436bd HTTP/1.1" 200 None 2026-05-07 01:10:35,659 - lava_callback - INFO - Completed processing callback for node 69fbe5e8474a995a188436bd INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53882 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:10:59,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:10:59,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 01:11:00,127 - lava_callback - INFO - Received callback for node 69f94396d09fe59064f05c19 INFO: 172.21.0.1:55772 - "POST /node/69f94396d09fe59064f05c19 HTTP/1.0" 202 Accepted 2026-05-07 01:11:00,133 - lava_callback - INFO - Starting async job submit for node 69f94396d09fe59064f05c19 2026-05-07 01:11:00,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:11:00,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94396d09fe59064f05c19 HTTP/1.1" 200 None 2026-05-07 01:11:00,156 - lava_callback - DEBUG - Processing node 69f94396d09fe59064f05c19: baseline-arm64-clabbe 2026-05-07 01:11:00,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94396d09fe59064f05c19 2026-05-07 01:11:00,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:11:00,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94396d09fe59064f05c19 HTTP/1.1" 200 None 2026-05-07 01:11:00,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:11:00,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 01:11:00,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:11:00,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94396d09fe59064f05c19 HTTP/1.1" 200 None 2026-05-07 01:11:00,201 - lava_callback - ERROR - Error processing callback for node 69f94396d09fe59064f05c19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:11:59,065 - lava_callback - INFO - Received callback for node 69fbe5ed474a995a188436c6 INFO: 172.21.0.1:45038 - "POST /node/69fbe5ed474a995a188436c6 HTTP/1.0" 202 Accepted 2026-05-07 01:11:59,071 - lava_callback - INFO - Starting async job submit for node 69fbe5ed474a995a188436c6 2026-05-07 01:11:59,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:11:59,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ed474a995a188436c6 HTTP/1.1" 200 None 2026-05-07 01:11:59,114 - lava_callback - DEBUG - Processing node 69fbe5ed474a995a188436c6: baseline-arm64-broonie 2026-05-07 01:11:59,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:11:59,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:11:59,688 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5ed474a995a188436c6/log.txt.gz 2026-05-07 01:11:59,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:11:59,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:11:59,996 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5ed474a995a188436c6/lava-logs.yaml 2026-05-07 01:12:00,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:12:00,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:12:00,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbe5ed474a995a188436c6/lava_callback.json.gz 2026-05-07 01:12:00,146 - lava_callback - INFO - Received callback for node 69f943dcd09fe59064f05c54 2026-05-07 01:12:00,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:41380 - "POST /node/69f943dcd09fe59064f05c54 HTTP/1.0" 202 Accepted 2026-05-07 01:12:00,152 - lava_callback - INFO - Starting async job submit for node 69f943dcd09fe59064f05c54 2026-05-07 01:12:00,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:12:00,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ed474a995a188436c6 HTTP/1.1" 200 None 2026-05-07 01:12:00,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f943dcd09fe59064f05c54 HTTP/1.1" 200 None 2026-05-07 01:12:00,173 - lava_callback - DEBUG - Processing node 69f943dcd09fe59064f05c54: baseline-arm-clabbe 2026-05-07 01:12:00,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f943dcd09fe59064f05c54 2026-05-07 01:12:00,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:12:00,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:12:00,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f943dcd09fe59064f05c54 HTTP/1.1" 200 None 2026-05-07 01:12:00,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:12:00,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:12:00,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:12:00,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 01:12:00,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:12:00,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5ed474a995a188436c6 HTTP/1.1" 200 None 2026-05-07 01:12:00,218 - lava_callback - INFO - Completed processing callback for node 69fbe5ed474a995a188436c6 2026-05-07 01:12:00,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f943dcd09fe59064f05c54 HTTP/1.1" 200 None 2026-05-07 01:12:00,271 - lava_callback - ERROR - Error processing callback for node 69f943dcd09fe59064f05c54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:12:29,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:12:29,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42024 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:13:20,165 - lava_callback - INFO - Received callback for node 69f9442bd09fe59064f05c77 INFO: 172.21.0.1:33802 - "POST /node/69f9442bd09fe59064f05c77 HTTP/1.0" 202 Accepted 2026-05-07 01:13:20,171 - lava_callback - INFO - Starting async job submit for node 69f9442bd09fe59064f05c77 2026-05-07 01:13:20,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:13:20,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9442bd09fe59064f05c77 HTTP/1.1" 200 None 2026-05-07 01:13:20,185 - lava_callback - DEBUG - Processing node 69f9442bd09fe59064f05c77: baseline-arm-clabbe 2026-05-07 01:13:20,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9442bd09fe59064f05c77 2026-05-07 01:13:20,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:13:20,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9442bd09fe59064f05c77 HTTP/1.1" 200 None 2026-05-07 01:13:20,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:13:20,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 01:13:20,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:13:20,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9442bd09fe59064f05c77 HTTP/1.1" 200 None 2026-05-07 01:13:20,235 - lava_callback - ERROR - Error processing callback for node 69f9442bd09fe59064f05c77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54714 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:14:00,801 - lava_callback - INFO - Received callback for node 69fbe5c1474a995a18843628 INFO: 172.21.0.1:58348 - "POST /node/69fbe5c1474a995a18843628 HTTP/1.0" 202 Accepted 2026-05-07 01:14:00,807 - lava_callback - INFO - Starting async job submit for node 69fbe5c1474a995a18843628 2026-05-07 01:14:00,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:00,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c1474a995a18843628 HTTP/1.1" 200 None 2026-05-07 01:14:00,835 - lava_callback - DEBUG - Processing node 69fbe5c1474a995a18843628: baseline-arm64 2026-05-07 01:14:00,867 - lava_callback - WARNING - Failed to upload log 2026-05-07 01:14:00,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:00,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:00,978 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c1474a995a18843628/lava-logs.yaml 2026-05-07 01:14:00,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:01,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:01,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c1474a995a18843628/lava_callback.json.gz 2026-05-07 01:14:01,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:01,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c1474a995a18843628 HTTP/1.1" 200 None 2026-05-07 01:14:01,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:01,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:14:01,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:01,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5c1474a995a18843628 HTTP/1.1" 200 None 2026-05-07 01:14:01,178 - lava_callback - INFO - Completed processing callback for node 69fbe5c1474a995a18843628 2026-05-07 01:14:03,719 - lava_callback - INFO - Received callback for node 69f9444fd09fe59064f05c8b INFO: 172.21.0.1:58352 - "POST /node/69f9444fd09fe59064f05c8b HTTP/1.0" 202 Accepted 2026-05-07 01:14:03,724 - lava_callback - INFO - Starting async job submit for node 69f9444fd09fe59064f05c8b 2026-05-07 01:14:03,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:03,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9444fd09fe59064f05c8b HTTP/1.1" 200 None 2026-05-07 01:14:03,744 - lava_callback - DEBUG - Processing node 69f9444fd09fe59064f05c8b: baseline-arm-baylibre 2026-05-07 01:14:03,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9444fd09fe59064f05c8b 2026-05-07 01:14:03,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:03,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9444fd09fe59064f05c8b HTTP/1.1" 200 None 2026-05-07 01:14:03,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:03,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-07 01:14:03,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:03,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9444fd09fe59064f05c8b HTTP/1.1" 200 None 2026-05-07 01:14:03,795 - lava_callback - ERROR - Error processing callback for node 69f9444fd09fe59064f05c8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:14:29,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:29,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 01:14:29,619 - lava_callback - INFO - Received callback for node 69fbe5c3474a995a1884362e INFO: 172.21.0.1:49244 - "POST /node/69fbe5c3474a995a1884362e HTTP/1.0" 202 Accepted 2026-05-07 01:14:29,625 - lava_callback - INFO - Starting async job submit for node 69fbe5c3474a995a1884362e 2026-05-07 01:14:29,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:29,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c3474a995a1884362e HTTP/1.1" 200 None 2026-05-07 01:14:29,669 - lava_callback - DEBUG - Processing node 69fbe5c3474a995a1884362e: baseline-arm64 2026-05-07 01:14:29,859 - lava_callback - INFO - Received callback for node 69fbe5c7474a995a1884363d INFO: 172.21.0.1:60480 - "POST /node/69fbe5c7474a995a1884363d HTTP/1.0" 202 Accepted 2026-05-07 01:14:29,886 - lava_callback - INFO - Starting async job submit for node 69fbe5c7474a995a1884363d 2026-05-07 01:14:29,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:30,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c7474a995a1884363d HTTP/1.1" 200 None 2026-05-07 01:14:30,076 - lava_callback - INFO - Received callback for node 69fbe5cb474a995a18843646 2026-05-07 01:14:30,085 - lava_callback - DEBUG - Processing node 69fbe5c7474a995a1884363d: baseline-arm64 2026-05-07 01:14:30,101 - lava_callback - INFO - Starting async job submit for node 69fbe5cb474a995a18843646 INFO: 172.21.0.1:60494 - "POST /node/69fbe5cb474a995a18843646 HTTP/1.0" 202 Accepted 2026-05-07 01:14:30,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:30,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:30,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5cb474a995a18843646 HTTP/1.1" 200 None 2026-05-07 01:14:30,249 - lava_callback - DEBUG - Processing node 69fbe5cb474a995a18843646: baseline-arm64 2026-05-07 01:14:30,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:30,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:30,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c3474a995a1884362e/log.txt.gz 2026-05-07 01:14:30,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:30,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:30,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:30,859 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5cb474a995a18843646/log.txt.gz 2026-05-07 01:14:30,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:30,942 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c7474a995a1884363d/log.txt.gz 2026-05-07 01:14:31,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:31,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:31,135 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c3474a995a1884362e/lava-logs.yaml 2026-05-07 01:14:31,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:31,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:31,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:31,290 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c3474a995a1884362e/lava_callback.json.gz 2026-05-07 01:14:31,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:31,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:31,315 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c7474a995a1884363d/lava-logs.yaml 2026-05-07 01:14:31,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:31,320 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5cb474a995a18843646/lava-logs.yaml 2026-05-07 01:14:31,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:31,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:31,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c3474a995a1884362e HTTP/1.1" 200 None 2026-05-07 01:14:31,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:31,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:14:31,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:31,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5c3474a995a1884362e HTTP/1.1" 200 None 2026-05-07 01:14:31,384 - lava_callback - INFO - Completed processing callback for node 69fbe5c3474a995a1884362e 2026-05-07 01:14:31,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:31,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c7474a995a1884363d/lava_callback.json.gz 2026-05-07 01:14:31,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:31,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:31,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5cb474a995a18843646/lava_callback.json.gz 2026-05-07 01:14:31,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:31,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c7474a995a1884363d HTTP/1.1" 200 None 2026-05-07 01:14:31,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:31,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5cb474a995a18843646 HTTP/1.1" 200 None 2026-05-07 01:14:31,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:31,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:14:31,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:31,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:14:31,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:31,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5c7474a995a1884363d HTTP/1.1" 200 None 2026-05-07 01:14:31,643 - lava_callback - INFO - Completed processing callback for node 69fbe5c7474a995a1884363d 2026-05-07 01:14:31,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5cb474a995a18843646 HTTP/1.1" 200 None 2026-05-07 01:14:31,688 - lava_callback - INFO - Completed processing callback for node 69fbe5cb474a995a18843646 INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:14:38,866 - lava_callback - INFO - Received callback for node 69fbe5c2474a995a1884362b INFO: 172.21.0.1:60510 - "POST /node/69fbe5c2474a995a1884362b HTTP/1.0" 202 Accepted 2026-05-07 01:14:38,873 - lava_callback - INFO - Starting async job submit for node 69fbe5c2474a995a1884362b 2026-05-07 01:14:38,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:38,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c2474a995a1884362b HTTP/1.1" 200 None 2026-05-07 01:14:38,916 - lava_callback - DEBUG - Processing node 69fbe5c2474a995a1884362b: baseline-arm64 2026-05-07 01:14:39,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:39,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:39,255 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c2474a995a1884362b/log.txt.gz 2026-05-07 01:14:39,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:39,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:39,533 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c2474a995a1884362b/lava-logs.yaml 2026-05-07 01:14:39,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:39,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:39,629 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c2474a995a1884362b/lava_callback.json.gz 2026-05-07 01:14:39,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:39,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c2474a995a1884362b HTTP/1.1" 200 None 2026-05-07 01:14:39,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:39,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:14:39,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:39,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5c2474a995a1884362b HTTP/1.1" 200 None 2026-05-07 01:14:39,706 - lava_callback - INFO - Completed processing callback for node 69fbe5c2474a995a1884362b 2026-05-07 01:14:43,662 - lava_callback - INFO - Received callback for node 69f94474d09fe59064f05ca0 INFO: 172.21.0.1:47622 - "POST /node/69f94474d09fe59064f05ca0 HTTP/1.0" 202 Accepted 2026-05-07 01:14:43,667 - lava_callback - INFO - Starting async job submit for node 69f94474d09fe59064f05ca0 2026-05-07 01:14:43,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:43,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94474d09fe59064f05ca0 HTTP/1.1" 200 None 2026-05-07 01:14:43,686 - lava_callback - DEBUG - Processing node 69f94474d09fe59064f05ca0: baseline-arm-baylibre 2026-05-07 01:14:43,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94474d09fe59064f05ca0 2026-05-07 01:14:43,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:43,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94474d09fe59064f05ca0 HTTP/1.1" 200 None 2026-05-07 01:14:43,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:43,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-07 01:14:43,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:43,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94474d09fe59064f05ca0 HTTP/1.1" 200 None 2026-05-07 01:14:43,741 - lava_callback - ERROR - Error processing callback for node 69f94474d09fe59064f05ca0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 01:14:44,148 - lava_callback - INFO - Received callback for node 69fbe5cc474a995a18843649 INFO: 172.21.0.1:47632 - "POST /node/69fbe5cc474a995a18843649 HTTP/1.0" 202 Accepted 2026-05-07 01:14:44,154 - lava_callback - INFO - Starting async job submit for node 69fbe5cc474a995a18843649 2026-05-07 01:14:44,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:44,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5cc474a995a18843649 HTTP/1.1" 200 None 2026-05-07 01:14:44,192 - lava_callback - DEBUG - Processing node 69fbe5cc474a995a18843649: baseline-arm64 2026-05-07 01:14:44,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:44,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:44,592 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5cc474a995a18843649/log.txt.gz 2026-05-07 01:14:44,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:44,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:44,932 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5cc474a995a18843649/lava-logs.yaml 2026-05-07 01:14:44,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:45,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:45,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5cc474a995a18843649/lava_callback.json.gz 2026-05-07 01:14:45,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:45,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5cc474a995a18843649 HTTP/1.1" 200 None 2026-05-07 01:14:45,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:45,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:14:45,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:45,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5cc474a995a18843649 HTTP/1.1" 200 None 2026-05-07 01:14:45,171 - lava_callback - INFO - Completed processing callback for node 69fbe5cc474a995a18843649 INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:14:46,909 - lava_callback - INFO - Received callback for node 69fbe5ca474a995a18843643 INFO: 172.21.0.1:47652 - "POST /node/69fbe5ca474a995a18843643 HTTP/1.0" 202 Accepted 2026-05-07 01:14:46,915 - lava_callback - INFO - Starting async job submit for node 69fbe5ca474a995a18843643 2026-05-07 01:14:46,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:46,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ca474a995a18843643 HTTP/1.1" 200 None 2026-05-07 01:14:46,952 - lava_callback - DEBUG - Processing node 69fbe5ca474a995a18843643: baseline-arm64 2026-05-07 01:14:47,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:47,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:47,345 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5ca474a995a18843643/log.txt.gz 2026-05-07 01:14:47,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:47,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:47,661 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5ca474a995a18843643/lava-logs.yaml 2026-05-07 01:14:47,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:47,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:47,748 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5ca474a995a18843643/lava_callback.json.gz 2026-05-07 01:14:47,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:47,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ca474a995a18843643 HTTP/1.1" 200 None 2026-05-07 01:14:47,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:47,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:14:47,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:47,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5ca474a995a18843643 HTTP/1.1" 200 None 2026-05-07 01:14:47,819 - lava_callback - INFO - Completed processing callback for node 69fbe5ca474a995a18843643 INFO: 172.21.0.1:51674 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:14:58,458 - lava_callback - INFO - Received callback for node 69fbe5c5474a995a18843634 INFO: 172.21.0.1:51688 - "POST /node/69fbe5c5474a995a18843634 HTTP/1.0" 202 Accepted 2026-05-07 01:14:58,465 - lava_callback - INFO - Starting async job submit for node 69fbe5c5474a995a18843634 2026-05-07 01:14:58,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:58,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c5474a995a18843634 HTTP/1.1" 200 None 2026-05-07 01:14:58,501 - lava_callback - DEBUG - Processing node 69fbe5c5474a995a18843634: baseline-arm64 2026-05-07 01:14:59,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:59,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:59,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c5474a995a18843634/log.txt.gz 2026-05-07 01:14:59,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:59,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-07 01:14:59,420 - lava_callback - INFO - Received callback for node 69fbe5da474a995a18843699 INFO: 172.21.0.1:51702 - "POST /node/69fbe5da474a995a18843699 HTTP/1.0" 202 Accepted 2026-05-07 01:14:59,427 - lava_callback - INFO - Starting async job submit for node 69fbe5da474a995a18843699 2026-05-07 01:14:59,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:59,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:59,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5da474a995a18843699 HTTP/1.1" 200 None 2026-05-07 01:14:59,466 - lava_callback - DEBUG - Processing node 69fbe5da474a995a18843699: baseline-nfs-arm64 2026-05-07 01:14:59,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:59,722 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c5474a995a18843634/lava-logs.yaml 2026-05-07 01:14:59,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:59,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:14:59,882 - lava_callback - INFO - Received callback for node 69fbe5bd474a995a1884361f INFO: 172.21.0.1:47846 - "POST /node/69fbe5bd474a995a1884361f HTTP/1.0" 202 Accepted 2026-05-07 01:14:59,889 - lava_callback - INFO - Starting async job submit for node 69fbe5bd474a995a1884361f 2026-05-07 01:14:59,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:14:59,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:59,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c5474a995a18843634/lava_callback.json.gz 2026-05-07 01:14:59,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5bd474a995a1884361f HTTP/1.1" 200 None 2026-05-07 01:14:59,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:14:59,971 - lava_callback - DEBUG - Processing node 69fbe5bd474a995a1884361f: baseline-arm64 2026-05-07 01:14:59,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:00,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5da474a995a18843699/log.txt.gz 2026-05-07 01:15:00,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c5474a995a18843634 HTTP/1.1" 200 None 2026-05-07 01:15:00,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:00,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:00,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:00,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:15:00,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:00,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5c5474a995a18843634 HTTP/1.1" 200 None 2026-05-07 01:15:00,588 - lava_callback - INFO - Completed processing callback for node 69fbe5c5474a995a18843634 2026-05-07 01:15:00,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:00,650 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5bd474a995a1884361f/log.txt.gz 2026-05-07 01:15:00,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:00,737 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5da474a995a18843699/lava-logs.yaml 2026-05-07 01:15:00,798 - lava_callback - INFO - Received callback for node 69fbe5d3474a995a1884365b INFO: 172.21.0.1:47852 - "POST /node/69fbe5d3474a995a1884365b HTTP/1.0" 202 Accepted 2026-05-07 01:15:00,811 - lava_callback - INFO - Starting async job submit for node 69fbe5d3474a995a1884365b 2026-05-07 01:15:00,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:00,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:00,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:00,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d3474a995a1884365b HTTP/1.1" 200 None 2026-05-07 01:15:00,876 - lava_callback - DEBUG - Processing node 69fbe5d3474a995a1884365b: baseline-nfs-arm64 2026-05-07 01:15:00,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:00,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:01,029 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5bd474a995a1884361f/lava-logs.yaml 2026-05-07 01:15:01,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5da474a995a18843699/lava_callback.json.gz INFO: 172.21.0.1:47854 - "GET /node/6930674cbbee432adda3c291%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-07 01:15:01,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:01,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:01,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5da474a995a18843699 HTTP/1.1" 200 None 2026-05-07 01:15:01,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47856 - "GET /node/6994389c5ae459b9df3d4be4%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-07 01:15:01,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:15:01,367 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:01,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:01,415 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5bd474a995a1884361f/lava_callback.json.gz 2026-05-07 01:15:01,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:01,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5da474a995a18843699 HTTP/1.1" 200 None 2026-05-07 01:15:01,549 - lava_callback - INFO - Completed processing callback for node 69fbe5da474a995a18843699 2026-05-07 01:15:01,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5bd474a995a1884361f HTTP/1.1" 200 None 2026-05-07 01:15:01,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:01,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:01,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:15:01,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:01,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5bd474a995a1884361f HTTP/1.1" 200 None 2026-05-07 01:15:01,702 - lava_callback - INFO - Completed processing callback for node 69fbe5bd474a995a1884361f 2026-05-07 01:15:01,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:01,789 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d3474a995a1884365b/log.txt.gz 2026-05-07 01:15:02,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:02,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:02,330 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d3474a995a1884365b/lava-logs.yaml 2026-05-07 01:15:02,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:02,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:02,444 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d3474a995a1884365b/lava_callback.json.gz 2026-05-07 01:15:02,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:02,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d3474a995a1884365b HTTP/1.1" 200 None 2026-05-07 01:15:02,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:02,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:15:02,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:02,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5d3474a995a1884365b HTTP/1.1" 200 None 2026-05-07 01:15:02,534 - lava_callback - INFO - Completed processing callback for node 69fbe5d3474a995a1884365b 2026-05-07 01:15:06,058 - lava_callback - INFO - Received callback for node 69fbe5c4474a995a18843631 INFO: 172.21.0.1:47862 - "POST /node/69fbe5c4474a995a18843631 HTTP/1.0" 202 Accepted 2026-05-07 01:15:06,064 - lava_callback - INFO - Starting async job submit for node 69fbe5c4474a995a18843631 2026-05-07 01:15:06,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:06,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c4474a995a18843631 HTTP/1.1" 200 None 2026-05-07 01:15:06,101 - lava_callback - DEBUG - Processing node 69fbe5c4474a995a18843631: baseline-arm64 INFO: 172.21.0.1:47874 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:15:06,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:06,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:06,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c4474a995a18843631/log.txt.gz 2026-05-07 01:15:06,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:07,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:07,126 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c4474a995a18843631/lava-logs.yaml 2026-05-07 01:15:07,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:07,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:07,246 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c4474a995a18843631/lava_callback.json.gz 2026-05-07 01:15:07,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:07,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c4474a995a18843631 HTTP/1.1" 200 None 2026-05-07 01:15:07,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:07,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:15:07,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:07,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5c4474a995a18843631 HTTP/1.1" 200 None 2026-05-07 01:15:07,325 - lava_callback - INFO - Completed processing callback for node 69fbe5c4474a995a18843631 2026-05-07 01:15:09,486 - lava_callback - INFO - Received callback for node 69fbe5d9474a995a1884366a INFO: 172.21.0.1:47880 - "POST /node/69fbe5d9474a995a1884366a HTTP/1.0" 202 Accepted 2026-05-07 01:15:09,493 - lava_callback - INFO - Starting async job submit for node 69fbe5d9474a995a1884366a 2026-05-07 01:15:09,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:09,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d9474a995a1884366a HTTP/1.1" 200 None 2026-05-07 01:15:09,549 - lava_callback - DEBUG - Processing node 69fbe5d9474a995a1884366a: baseline-nfs-arm64 2026-05-07 01:15:09,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:10,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:10,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d9474a995a1884366a/log.txt.gz 2026-05-07 01:15:10,097 - lava_callback - INFO - Received callback for node 69fbe5db474a995a1884369c INFO: 172.21.0.1:37532 - "POST /node/69fbe5db474a995a1884369c HTTP/1.0" 202 Accepted 2026-05-07 01:15:10,117 - lava_callback - INFO - Starting async job submit for node 69fbe5db474a995a1884369c 2026-05-07 01:15:10,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:10,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5db474a995a1884369c HTTP/1.1" 200 None 2026-05-07 01:15:10,249 - lava_callback - DEBUG - Processing node 69fbe5db474a995a1884369c: baseline-nfs-arm64 2026-05-07 01:15:10,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:10,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:10,538 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d9474a995a1884366a/lava-logs.yaml 2026-05-07 01:15:10,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:10,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:10,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:10,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:10,813 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5db474a995a1884369c/log.txt.gz 2026-05-07 01:15:10,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d9474a995a1884366a/lava_callback.json.gz 2026-05-07 01:15:10,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:10,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d9474a995a1884366a HTTP/1.1" 200 None 2026-05-07 01:15:10,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:11,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:15:11,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:11,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:11,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5d9474a995a1884366a HTTP/1.1" 200 None 2026-05-07 01:15:11,102 - lava_callback - INFO - Completed processing callback for node 69fbe5d9474a995a1884366a 2026-05-07 01:15:11,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:11,268 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5db474a995a1884369c/lava-logs.yaml 2026-05-07 01:15:11,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:11,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:11,396 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5db474a995a1884369c/lava_callback.json.gz 2026-05-07 01:15:11,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:11,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5db474a995a1884369c HTTP/1.1" 200 None 2026-05-07 01:15:11,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:11,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:15:11,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:11,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5db474a995a1884369c HTTP/1.1" 200 None 2026-05-07 01:15:11,477 - lava_callback - INFO - Completed processing callback for node 69fbe5db474a995a1884369c 2026-05-07 01:15:13,856 - lava_callback - INFO - Received callback for node 69fbe5d6474a995a18843664 INFO: 172.21.0.1:37546 - "POST /node/69fbe5d6474a995a18843664 HTTP/1.0" 202 Accepted 2026-05-07 01:15:13,862 - lava_callback - INFO - Starting async job submit for node 69fbe5d6474a995a18843664 2026-05-07 01:15:13,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:13,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d6474a995a18843664 HTTP/1.1" 200 None 2026-05-07 01:15:13,900 - lava_callback - DEBUG - Processing node 69fbe5d6474a995a18843664: baseline-nfs-arm64 INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:15:14,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:14,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:14,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d6474a995a18843664/log.txt.gz 2026-05-07 01:15:14,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:14,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:14,616 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d6474a995a18843664/lava-logs.yaml 2026-05-07 01:15:14,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:14,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:14,722 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d6474a995a18843664/lava_callback.json.gz 2026-05-07 01:15:14,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:14,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d6474a995a18843664 HTTP/1.1" 200 None 2026-05-07 01:15:14,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:14,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:15:14,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:14,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5d6474a995a18843664 HTTP/1.1" 200 None 2026-05-07 01:15:14,802 - lava_callback - INFO - Completed processing callback for node 69fbe5d6474a995a18843664 INFO: 172.21.0.1:37566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37570 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:15:21,103 - lava_callback - INFO - Received callback for node 69fbe5d4474a995a1884365e INFO: 172.21.0.1:51622 - "POST /node/69fbe5d4474a995a1884365e HTTP/1.0" 202 Accepted 2026-05-07 01:15:21,110 - lava_callback - INFO - Starting async job submit for node 69fbe5d4474a995a1884365e 2026-05-07 01:15:21,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:21,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d4474a995a1884365e HTTP/1.1" 200 None 2026-05-07 01:15:21,155 - lava_callback - DEBUG - Processing node 69fbe5d4474a995a1884365e: baseline-nfs-arm64 2026-05-07 01:15:21,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:21,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:21,831 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d4474a995a1884365e/log.txt.gz 2026-05-07 01:15:22,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:22,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:22,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d4474a995a1884365e/lava-logs.yaml 2026-05-07 01:15:22,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:22,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:22,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d4474a995a1884365e/lava_callback.json.gz 2026-05-07 01:15:22,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:22,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d4474a995a1884365e HTTP/1.1" 200 None 2026-05-07 01:15:22,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:22,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:15:22,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:22,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5d4474a995a1884365e HTTP/1.1" 200 None 2026-05-07 01:15:22,617 - lava_callback - INFO - Completed processing callback for node 69fbe5d4474a995a1884365e 2026-05-07 01:15:24,264 - lava_callback - INFO - Received callback for node 69fbe5ce474a995a1884364f INFO: 172.21.0.1:51630 - "POST /node/69fbe5ce474a995a1884364f HTTP/1.0" 202 Accepted 2026-05-07 01:15:24,271 - lava_callback - INFO - Starting async job submit for node 69fbe5ce474a995a1884364f 2026-05-07 01:15:24,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:24,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ce474a995a1884364f HTTP/1.1" 200 None 2026-05-07 01:15:24,307 - lava_callback - DEBUG - Processing node 69fbe5ce474a995a1884364f: baseline-nfs-arm64 2026-05-07 01:15:24,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:24,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:24,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5ce474a995a1884364f/log.txt.gz 2026-05-07 01:15:24,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:25,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:25,030 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5ce474a995a1884364f/lava-logs.yaml 2026-05-07 01:15:25,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:15:25,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:15:25,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5ce474a995a1884364f/lava_callback.json.gz 2026-05-07 01:15:25,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:25,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5ce474a995a1884364f HTTP/1.1" 200 None 2026-05-07 01:15:25,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:25,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:15:25,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:25,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5ce474a995a1884364f HTTP/1.1" 200 None 2026-05-07 01:15:25,235 - lava_callback - INFO - Completed processing callback for node 69fbe5ce474a995a1884364f INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:15:29,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:15:29,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:16:03,727 - lava_callback - INFO - Received callback for node 69f944c4d09fe59064f05cc1 INFO: 172.21.0.1:42766 - "POST /node/69f944c4d09fe59064f05cc1 HTTP/1.0" 202 Accepted 2026-05-07 01:16:03,732 - lava_callback - INFO - Starting async job submit for node 69f944c4d09fe59064f05cc1 2026-05-07 01:16:03,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:03,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f944c4d09fe59064f05cc1 HTTP/1.1" 200 None 2026-05-07 01:16:03,752 - lava_callback - DEBUG - Processing node 69f944c4d09fe59064f05cc1: baseline-arm-baylibre 2026-05-07 01:16:03,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f944c4d09fe59064f05cc1 2026-05-07 01:16:03,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:03,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f944c4d09fe59064f05cc1 HTTP/1.1" 200 None 2026-05-07 01:16:03,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:03,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-07 01:16:03,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:03,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f944c4d09fe59064f05cc1 HTTP/1.1" 200 None 2026-05-07 01:16:03,817 - lava_callback - ERROR - Error processing callback for node 69f944c4d09fe59064f05cc1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60590 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:16:17,596 - lava_callback - INFO - Received callback for node 69fbe5d0474a995a18843655 INFO: 172.21.0.1:60594 - "POST /node/69fbe5d0474a995a18843655 HTTP/1.0" 202 Accepted 2026-05-07 01:16:17,603 - lava_callback - INFO - Starting async job submit for node 69fbe5d0474a995a18843655 2026-05-07 01:16:17,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:17,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d0474a995a18843655 HTTP/1.1" 200 None 2026-05-07 01:16:17,641 - lava_callback - DEBUG - Processing node 69fbe5d0474a995a18843655: baseline-nfs-arm64 2026-05-07 01:16:17,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:16:18,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:16:18,075 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d0474a995a18843655/log.txt.gz 2026-05-07 01:16:18,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:16:19,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:16:19,089 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d0474a995a18843655/lava-logs.yaml 2026-05-07 01:16:19,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:16:19,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:16:19,425 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d0474a995a18843655/lava_callback.json.gz 2026-05-07 01:16:19,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:19,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d0474a995a18843655 HTTP/1.1" 200 None 2026-05-07 01:16:19,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:19,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:16:19,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:19,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5d0474a995a18843655 HTTP/1.1" 200 None 2026-05-07 01:16:19,497 - lava_callback - INFO - Completed processing callback for node 69fbe5d0474a995a18843655 INFO: 172.21.0.1:42270 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:16:29,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:29,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:16:40,335 - lava_callback - INFO - Received callback for node 69f944efd09fe59064f05cd5 INFO: 172.21.0.1:44372 - "POST /node/69f944efd09fe59064f05cd5 HTTP/1.0" 202 Accepted 2026-05-07 01:16:40,340 - lava_callback - INFO - Starting async job submit for node 69f944efd09fe59064f05cd5 2026-05-07 01:16:40,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:40,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f944efd09fe59064f05cd5 HTTP/1.1" 200 None 2026-05-07 01:16:40,357 - lava_callback - DEBUG - Processing node 69f944efd09fe59064f05cd5: baseline-arm-clabbe 2026-05-07 01:16:40,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f944efd09fe59064f05cd5 2026-05-07 01:16:40,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:40,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f944efd09fe59064f05cd5 HTTP/1.1" 200 None 2026-05-07 01:16:40,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:40,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-07 01:16:40,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:16:40,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f944efd09fe59064f05cd5 HTTP/1.1" 200 None 2026-05-07 01:16:40,407 - lava_callback - ERROR - Error processing callback for node 69f944efd09fe59064f05cd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:17:23,864 - lava_callback - INFO - Received callback for node 69f94515d09fe59064f05ce5 INFO: 172.21.0.1:36524 - "POST /node/69f94515d09fe59064f05ce5 HTTP/1.0" 202 Accepted 2026-05-07 01:17:23,870 - lava_callback - INFO - Starting async job submit for node 69f94515d09fe59064f05ce5 2026-05-07 01:17:23,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:17:23,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94515d09fe59064f05ce5 HTTP/1.1" 200 None 2026-05-07 01:17:23,884 - lava_callback - DEBUG - Processing node 69f94515d09fe59064f05ce5: baseline-arm-baylibre 2026-05-07 01:17:23,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94515d09fe59064f05ce5 2026-05-07 01:17:23,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:17:23,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94515d09fe59064f05ce5 HTTP/1.1" 200 None 2026-05-07 01:17:23,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:17:23,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-07 01:17:23,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:17:23,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94515d09fe59064f05ce5 HTTP/1.1" 200 None 2026-05-07 01:17:23,928 - lava_callback - ERROR - Error processing callback for node 69f94515d09fe59064f05ce5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:17:29,779 - lava_callback - INFO - Received callback for node 69fbe5cf474a995a18843652 INFO: 172.21.0.1:60258 - "POST /node/69fbe5cf474a995a18843652 HTTP/1.0" 202 Accepted 2026-05-07 01:17:29,785 - lava_callback - INFO - Starting async job submit for node 69fbe5cf474a995a18843652 2026-05-07 01:17:29,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:17:29,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5cf474a995a18843652 HTTP/1.1" 200 None 2026-05-07 01:17:29,824 - lava_callback - DEBUG - Processing node 69fbe5cf474a995a18843652: baseline-nfs-arm64 2026-05-07 01:17:30,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:17:30,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:17:30,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5cf474a995a18843652/log.txt.gz 2026-05-07 01:17:30,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:17:30,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:17:30,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5cf474a995a18843652/lava-logs.yaml 2026-05-07 01:17:30,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:17:31,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:17:31,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5cf474a995a18843652/lava_callback.json.gz 2026-05-07 01:17:31,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:17:31,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5cf474a995a18843652 HTTP/1.1" 200 None 2026-05-07 01:17:31,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:17:31,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:17:31,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:17:31,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5cf474a995a18843652 HTTP/1.1" 200 None 2026-05-07 01:17:31,389 - lava_callback - INFO - Completed processing callback for node 69fbe5cf474a995a18843652 INFO: 172.21.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43088 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:17:59,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:17:59,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 01:18:00,390 - lava_callback - INFO - Received callback for node 69f94543d09fe59064f05cfd INFO: 172.21.0.1:60750 - "POST /node/69f94543d09fe59064f05cfd HTTP/1.0" 202 Accepted 2026-05-07 01:18:00,396 - lava_callback - INFO - Starting async job submit for node 69f94543d09fe59064f05cfd 2026-05-07 01:18:00,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:18:00,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94543d09fe59064f05cfd HTTP/1.1" 200 None 2026-05-07 01:18:00,411 - lava_callback - DEBUG - Processing node 69f94543d09fe59064f05cfd: baseline-arm-clabbe 2026-05-07 01:18:00,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94543d09fe59064f05cfd 2026-05-07 01:18:00,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:18:00,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94543d09fe59064f05cfd HTTP/1.1" 200 None 2026-05-07 01:18:00,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:18:00,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-07 01:18:00,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:18:00,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94543d09fe59064f05cfd HTTP/1.1" 200 None 2026-05-07 01:18:00,481 - lava_callback - ERROR - Error processing callback for node 69f94543d09fe59064f05cfd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:19:00,486 - lava_callback - INFO - Received callback for node 69f94570d09fe59064f05d0d INFO: 172.21.0.1:37300 - "POST /node/69f94570d09fe59064f05d0d HTTP/1.0" 202 Accepted 2026-05-07 01:19:00,492 - lava_callback - INFO - Starting async job submit for node 69f94570d09fe59064f05d0d 2026-05-07 01:19:00,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:19:00,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94570d09fe59064f05d0d HTTP/1.1" 200 None 2026-05-07 01:19:00,507 - lava_callback - DEBUG - Processing node 69f94570d09fe59064f05d0d: baseline-arm-clabbe 2026-05-07 01:19:00,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94570d09fe59064f05d0d 2026-05-07 01:19:00,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:19:00,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94570d09fe59064f05d0d HTTP/1.1" 200 None 2026-05-07 01:19:00,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:19:00,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-07 01:19:00,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:19:00,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94570d09fe59064f05d0d HTTP/1.1" 200 None 2026-05-07 01:19:00,569 - lava_callback - ERROR - Error processing callback for node 69f94570d09fe59064f05d0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38254 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:20:14,637 - lava_callback - INFO - Received callback for node 69fbe4a2474a995a18843582 INFO: 172.21.0.1:38258 - "POST /node/69fbe4a2474a995a18843582 HTTP/1.0" 202 Accepted 2026-05-07 01:20:14,644 - lava_callback - INFO - Starting async job submit for node 69fbe4a2474a995a18843582 2026-05-07 01:20:14,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:20:14,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe4a2474a995a18843582 HTTP/1.1" 200 None 2026-05-07 01:20:14,725 - lava_callback - DEBUG - Processing node 69fbe4a2474a995a18843582: ltp-smoke INFO: 172.21.0.1:38268 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-07 01:20:15,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:20:15,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:20:15,329 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbe4a2474a995a18843582/log.txt.gz 2026-05-07 01:20:15,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:20:15,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:20:15,825 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbe4a2474a995a18843582/lava-logs.yaml 2026-05-07 01:20:15,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:20:15,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:20:15,953 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbe4a2474a995a18843582/lava_callback.json.gz 2026-05-07 01:20:16,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:20:16,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe4a2474a995a18843582 HTTP/1.1" 200 None 2026-05-07 01:20:16,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:20:16,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda05474a995a18840a0a HTTP/1.1" 200 None 2026-05-07 01:20:16,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:20:16,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe4a2474a995a18843582 HTTP/1.1" 200 None 2026-05-07 01:20:16,251 - lava_callback - INFO - Completed processing callback for node 69fbe4a2474a995a18843582 INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54458 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:20:29,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:20:29,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 01:20:35,264 - lava_callback - INFO - Received callback for node 69fbe4f8474a995a188435a0 INFO: 172.21.0.1:55394 - "POST /node/69fbe4f8474a995a188435a0 HTTP/1.0" 202 Accepted 2026-05-07 01:20:35,271 - lava_callback - INFO - Starting async job submit for node 69fbe4f8474a995a188435a0 2026-05-07 01:20:35,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:20:35,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe4f8474a995a188435a0 HTTP/1.1" 200 None 2026-05-07 01:20:35,352 - lava_callback - DEBUG - Processing node 69fbe4f8474a995a188435a0: baseline-arm 2026-05-07 01:20:35,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:20:36,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:20:36,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fbe4f8474a995a188435a0/log.txt.gz 2026-05-07 01:20:36,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55406 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:20:36,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:20:36,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbe4f8474a995a188435a0/lava-logs.yaml 2026-05-07 01:20:36,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:20:36,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:20:36,711 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbe4f8474a995a188435a0/lava_callback.json.gz DEBUG: Setup failed for 69fbe4f8474a995a188435a0. Transitting job node result: incomplete -> fail 2026-05-07 01:20:36,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:20:36,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe4f8474a995a188435a0 HTTP/1.1" 200 None 2026-05-07 01:20:36,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:20:36,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 01:20:36,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:20:36,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe4f8474a995a188435a0 HTTP/1.1" 200 None 2026-05-07 01:20:37,015 - lava_callback - INFO - Completed processing callback for node 69fbe4f8474a995a188435a0 INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET /node/69f2a8f8e2fa3d7693ba6f5c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:20:59,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:20:59,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58088 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:21:11,595 - lava_callback - INFO - Received callback for node 69fbe5cd474a995a1884364c INFO: 172.21.0.1:50346 - "POST /node/69fbe5cd474a995a1884364c HTTP/1.0" 202 Accepted 2026-05-07 01:21:11,602 - lava_callback - INFO - Starting async job submit for node 69fbe5cd474a995a1884364c 2026-05-07 01:21:11,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:21:11,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5cd474a995a1884364c HTTP/1.1" 200 None 2026-05-07 01:21:11,654 - lava_callback - DEBUG - Processing node 69fbe5cd474a995a1884364c: baseline-arm64 2026-05-07 01:21:12,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:21:12,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:21:12,152 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5cd474a995a1884364c/log.txt.gz 2026-05-07 01:21:12,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:21:12,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:21:12,698 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5cd474a995a1884364c/lava-logs.yaml 2026-05-07 01:21:12,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:21:12,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:21:12,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5cd474a995a1884364c/lava_callback.json.gz DEBUG: Setup failed for 69fbe5cd474a995a1884364c. Transitting job node result: incomplete -> fail 2026-05-07 01:21:12,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:21:12,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5cd474a995a1884364c HTTP/1.1" 200 None 2026-05-07 01:21:12,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:21:12,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:21:12,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:21:12,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5cd474a995a1884364c HTTP/1.1" 200 None 2026-05-07 01:21:13,034 - lava_callback - INFO - Completed processing callback for node 69fbe5cd474a995a1884364c INFO: 172.21.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58554 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:21:29,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:21:29,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:22:12,850 - lava_callback - INFO - Received callback for node 69fbe5be474a995a18843622 INFO: 172.21.0.1:52550 - "POST /node/69fbe5be474a995a18843622 HTTP/1.0" 202 Accepted 2026-05-07 01:22:12,857 - lava_callback - INFO - Starting async job submit for node 69fbe5be474a995a18843622 2026-05-07 01:22:12,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:22:12,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5be474a995a18843622 HTTP/1.1" 200 None 2026-05-07 01:22:12,901 - lava_callback - DEBUG - Processing node 69fbe5be474a995a18843622: baseline-arm64 2026-05-07 01:22:13,036 - lava_callback - WARNING - Failed to upload log 2026-05-07 01:22:13,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:22:13,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:22:13,271 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5be474a995a18843622/lava-logs.yaml 2026-05-07 01:22:13,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:22:13,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:22:13,436 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5be474a995a18843622/lava_callback.json.gz 2026-05-07 01:22:13,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:22:13,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5be474a995a18843622 HTTP/1.1" 200 None 2026-05-07 01:22:13,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:22:13,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:22:13,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:22:13,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5be474a995a18843622 HTTP/1.1" 200 None 2026-05-07 01:22:13,596 - lava_callback - INFO - Completed processing callback for node 69fbe5be474a995a18843622 INFO: 172.21.0.1:52552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:22:29,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:22:29,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45704 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:24:10,959 - lava_callback - INFO - Received callback for node 69fbe5c8474a995a18843640 INFO: 172.21.0.1:44644 - "POST /node/69fbe5c8474a995a18843640 HTTP/1.0" 202 Accepted 2026-05-07 01:24:10,965 - lava_callback - INFO - Starting async job submit for node 69fbe5c8474a995a18843640 2026-05-07 01:24:10,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:11,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c8474a995a18843640 HTTP/1.1" 200 None 2026-05-07 01:24:11,006 - lava_callback - DEBUG - Processing node 69fbe5c8474a995a18843640: baseline-arm64 2026-05-07 01:24:11,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:24:11,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:24:11,817 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c8474a995a18843640/log.txt.gz 2026-05-07 01:24:12,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:24:12,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:24:12,272 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c8474a995a18843640/lava-logs.yaml 2026-05-07 01:24:12,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:24:12,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:24:12,565 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c8474a995a18843640/lava_callback.json.gz 2026-05-07 01:24:12,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:12,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c8474a995a18843640 HTTP/1.1" 200 None 2026-05-07 01:24:12,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:12,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:24:12,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:12,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5c8474a995a18843640 HTTP/1.1" 200 None 2026-05-07 01:24:12,695 - lava_callback - INFO - Completed processing callback for node 69fbe5c8474a995a18843640 2026-05-07 01:24:13,537 - lava_callback - INFO - Received callback for node 69fbe5c0474a995a18843625 INFO: 172.21.0.1:44654 - "POST /node/69fbe5c0474a995a18843625 HTTP/1.0" 202 Accepted 2026-05-07 01:24:13,545 - lava_callback - INFO - Starting async job submit for node 69fbe5c0474a995a18843625 2026-05-07 01:24:13,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:13,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c0474a995a18843625 HTTP/1.1" 200 None 2026-05-07 01:24:13,605 - lava_callback - DEBUG - Processing node 69fbe5c0474a995a18843625: baseline-arm64 2026-05-07 01:24:13,854 - lava_callback - WARNING - Failed to upload log 2026-05-07 01:24:13,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:24:14,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:24:14,093 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c0474a995a18843625/lava-logs.yaml 2026-05-07 01:24:14,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:24:14,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:24:14,181 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbe5c0474a995a18843625/lava_callback.json.gz 2026-05-07 01:24:14,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:14,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5c0474a995a18843625 HTTP/1.1" 200 None 2026-05-07 01:24:14,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:14,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:24:14,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:14,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5c0474a995a18843625 HTTP/1.1" 200 None 2026-05-07 01:24:14,320 - lava_callback - INFO - Completed processing callback for node 69fbe5c0474a995a18843625 INFO: 172.21.0.1:44668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44684 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:24:21,285 - lava_callback - INFO - Received callback for node 69fbe5d7474a995a18843667 INFO: 172.21.0.1:39200 - "POST /node/69fbe5d7474a995a18843667 HTTP/1.0" 202 Accepted 2026-05-07 01:24:21,292 - lava_callback - INFO - Starting async job submit for node 69fbe5d7474a995a18843667 2026-05-07 01:24:21,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:21,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d7474a995a18843667 HTTP/1.1" 200 None 2026-05-07 01:24:21,341 - lava_callback - DEBUG - Processing node 69fbe5d7474a995a18843667: baseline-nfs-arm64 2026-05-07 01:24:21,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:24:21,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:24:21,962 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d7474a995a18843667/log.txt.gz 2026-05-07 01:24:22,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:24:22,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:24:22,404 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d7474a995a18843667/lava-logs.yaml 2026-05-07 01:24:22,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:24:22,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:24:22,530 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d7474a995a18843667/lava_callback.json.gz 2026-05-07 01:24:22,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:22,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d7474a995a18843667 HTTP/1.1" 200 None 2026-05-07 01:24:22,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:22,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:24:22,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:22,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5d7474a995a18843667 HTTP/1.1" 200 None 2026-05-07 01:24:22,668 - lava_callback - INFO - Completed processing callback for node 69fbe5d7474a995a18843667 INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:24:29,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:24:29,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50232 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:26:20,671 - lava_callback - INFO - Received callback for node 69f94736d09fe59064f05e34 INFO: 172.21.0.1:36768 - "POST /node/69f94736d09fe59064f05e34 HTTP/1.0" 202 Accepted 2026-05-07 01:26:20,677 - lava_callback - INFO - Starting async job submit for node 69f94736d09fe59064f05e34 2026-05-07 01:26:20,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:26:20,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94736d09fe59064f05e34 HTTP/1.1" 200 None 2026-05-07 01:26:20,694 - lava_callback - DEBUG - Processing node 69f94736d09fe59064f05e34: baseline-arm-clabbe 2026-05-07 01:26:20,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94736d09fe59064f05e34 2026-05-07 01:26:20,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:26:20,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94736d09fe59064f05e34 HTTP/1.1" 200 None 2026-05-07 01:26:20,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:26:20,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-07 01:26:20,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:26:20,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94736d09fe59064f05e34 HTTP/1.1" 200 None 2026-05-07 01:26:20,746 - lava_callback - ERROR - Error processing callback for node 69f94736d09fe59064f05e34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47944 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:28:20,742 - lava_callback - INFO - Received callback for node 69f947b0d09fe59064f05e7f INFO: 172.21.0.1:43112 - "POST /node/69f947b0d09fe59064f05e7f HTTP/1.0" 202 Accepted 2026-05-07 01:28:20,747 - lava_callback - INFO - Starting async job submit for node 69f947b0d09fe59064f05e7f 2026-05-07 01:28:20,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:28:20,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f947b0d09fe59064f05e7f HTTP/1.1" 200 None 2026-05-07 01:28:20,763 - lava_callback - DEBUG - Processing node 69f947b0d09fe59064f05e7f: baseline-arm-clabbe 2026-05-07 01:28:20,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f947b0d09fe59064f05e7f 2026-05-07 01:28:20,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:28:20,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f947b0d09fe59064f05e7f HTTP/1.1" 200 None 2026-05-07 01:28:20,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:28:20,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-07 01:28:20,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:28:20,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f947b0d09fe59064f05e7f HTTP/1.1" 200 None 2026-05-07 01:28:20,810 - lava_callback - ERROR - Error processing callback for node 69f947b0d09fe59064f05e7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:29:20,035 - lava_callback - INFO - Received callback for node 69fbead3474a995a18843aa2 INFO: 172.21.0.1:37208 - "POST /node/69fbead3474a995a18843aa2 HTTP/1.0" 202 Accepted 2026-05-07 01:29:20,041 - lava_callback - INFO - Starting async job submit for node 69fbead3474a995a18843aa2 2026-05-07 01:29:20,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:29:20,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbead3474a995a18843aa2 HTTP/1.1" 200 None 2026-05-07 01:29:20,057 - lava_callback - DEBUG - Processing node 69fbead3474a995a18843aa2: baseline-nfs-arm64 2026-05-07 01:29:20,058 - lava_callback - WARNING - Failed to upload log 2026-05-07 01:29:20,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:29:20,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:29:20,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbead3474a995a18843aa2/lava-logs.yaml 2026-05-07 01:29:20,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:29:20,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:29:20,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbead3474a995a18843aa2/lava_callback.json.gz 2026-05-07 01:29:20,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:29:20,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbead3474a995a18843aa2 HTTP/1.1" 200 None 2026-05-07 01:29:20,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:29:20,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:29:20,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:29:20,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbead3474a995a18843aa2 HTTP/1.1" 200 None 2026-05-07 01:29:20,582 - lava_callback - INFO - Completed processing callback for node 69fbead3474a995a18843aa2 INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:29:29,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:29:29,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56352 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:32:00,901 - lava_callback - INFO - Received callback for node 69f9487cd09fe59064f05ef3 INFO: 172.21.0.1:57056 - "POST /node/69f9487cd09fe59064f05ef3 HTTP/1.0" 202 Accepted 2026-05-07 01:32:00,906 - lava_callback - INFO - Starting async job submit for node 69f9487cd09fe59064f05ef3 2026-05-07 01:32:00,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:32:00,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9487cd09fe59064f05ef3 HTTP/1.1" 200 None 2026-05-07 01:32:00,921 - lava_callback - DEBUG - Processing node 69f9487cd09fe59064f05ef3: baseline-arm-clabbe 2026-05-07 01:32:00,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9487cd09fe59064f05ef3 2026-05-07 01:32:00,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:32:00,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9487cd09fe59064f05ef3 HTTP/1.1" 200 None 2026-05-07 01:32:00,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:32:00,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-07 01:32:00,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:32:00,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9487cd09fe59064f05ef3 HTTP/1.1" 200 None 2026-05-07 01:32:00,968 - lava_callback - ERROR - Error processing callback for node 69f9487cd09fe59064f05ef3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:32:27,474 - lava_callback - INFO - Received callback for node 69fbeb7c474a995a18843afd INFO: 172.21.0.1:42758 - "POST /node/69fbeb7c474a995a18843afd HTTP/1.0" 202 Accepted 2026-05-07 01:32:27,480 - lava_callback - INFO - Starting async job submit for node 69fbeb7c474a995a18843afd 2026-05-07 01:32:27,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:32:27,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbeb7c474a995a18843afd HTTP/1.1" 200 None 2026-05-07 01:32:27,524 - lava_callback - DEBUG - Processing node 69fbeb7c474a995a18843afd: baseline-arm64-foundriesio 2026-05-07 01:32:27,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:32:27,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:32:27,866 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbeb7c474a995a18843afd/log.txt.gz 2026-05-07 01:32:27,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:32:28,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:32:28,153 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbeb7c474a995a18843afd/lava-logs.yaml 2026-05-07 01:32:28,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:32:28,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:32:28,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbeb7c474a995a18843afd/lava_callback.json.gz 2026-05-07 01:32:28,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:32:28,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbeb7c474a995a18843afd HTTP/1.1" 200 None 2026-05-07 01:32:28,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:32:28,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:32:28,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:32:28,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbeb7c474a995a18843afd HTTP/1.1" 200 None 2026-05-07 01:32:28,352 - lava_callback - INFO - Completed processing callback for node 69fbeb7c474a995a18843afd 2026-05-07 01:32:29,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:32:29,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:33:28,066 - lava_callback - INFO - Received callback for node 69fbe5d2474a995a18843658 INFO: 172.21.0.1:34546 - "POST /node/69fbe5d2474a995a18843658 HTTP/1.0" 202 Accepted 2026-05-07 01:33:28,074 - lava_callback - INFO - Starting async job submit for node 69fbe5d2474a995a18843658 2026-05-07 01:33:28,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:33:28,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d2474a995a18843658 HTTP/1.1" 200 None 2026-05-07 01:33:28,134 - lava_callback - DEBUG - Processing node 69fbe5d2474a995a18843658: baseline-nfs-arm64 2026-05-07 01:33:29,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:33:29,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:33:29,408 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d2474a995a18843658/log.txt.gz 2026-05-07 01:33:30,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:33:30,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:33:30,407 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d2474a995a18843658/lava-logs.yaml 2026-05-07 01:33:30,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:33:30,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:33:30,596 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbe5d2474a995a18843658/lava_callback.json.gz DEBUG: Setup failed for 69fbe5d2474a995a18843658. Transitting job node result: incomplete -> fail 2026-05-07 01:33:30,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:33:30,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe5d2474a995a18843658 HTTP/1.1" 200 None 2026-05-07 01:33:30,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:33:30,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:33:30,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:33:30,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe5d2474a995a18843658 HTTP/1.1" 200 None 2026-05-07 01:33:30,853 - lava_callback - INFO - Completed processing callback for node 69fbe5d2474a995a18843658 INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:33:59,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:33:59,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:38:24,662 - lava_callback - INFO - Received callback for node 69fbec96474a995a18843b89 INFO: 172.21.0.1:39028 - "POST /node/69fbec96474a995a18843b89 HTTP/1.0" 202 Accepted 2026-05-07 01:38:24,681 - lava_callback - INFO - Starting async job submit for node 69fbec96474a995a18843b89 2026-05-07 01:38:24,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:38:24,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbec96474a995a18843b89 HTTP/1.1" 200 None 2026-05-07 01:38:24,726 - lava_callback - DEBUG - Processing node 69fbec96474a995a18843b89: baseline-arm64 2026-05-07 01:38:25,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:38:25,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:38:25,395 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbec96474a995a18843b89/log.txt.gz 2026-05-07 01:38:25,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:38:26,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:38:26,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbec96474a995a18843b89/lava-logs.yaml 2026-05-07 01:38:26,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:38:26,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:38:26,215 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbec96474a995a18843b89/lava_callback.json.gz 2026-05-07 01:38:26,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:38:26,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbec96474a995a18843b89 HTTP/1.1" 200 None 2026-05-07 01:38:26,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:38:26,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:38:26,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:38:26,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbec96474a995a18843b89 HTTP/1.1" 200 None 2026-05-07 01:38:26,369 - lava_callback - INFO - Completed processing callback for node 69fbec96474a995a18843b89 INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:38:29,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:38:29,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 01:38:31,288 - lava_callback - INFO - Received callback for node 69fbec4a474a995a18843b66 INFO: 172.21.0.1:48126 - "POST /node/69fbec4a474a995a18843b66 HTTP/1.0" 202 Accepted 2026-05-07 01:38:31,294 - lava_callback - INFO - Starting async job submit for node 69fbec4a474a995a18843b66 2026-05-07 01:38:31,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:38:31,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbec4a474a995a18843b66 HTTP/1.1" 200 None 2026-05-07 01:38:31,326 - lava_callback - DEBUG - Processing node 69fbec4a474a995a18843b66: baseline-arm64 2026-05-07 01:38:31,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:38:31,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:38:31,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbec4a474a995a18843b66/log.txt.gz 2026-05-07 01:38:31,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:38:32,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:38:32,090 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbec4a474a995a18843b66/lava-logs.yaml 2026-05-07 01:38:32,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:38:32,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:38:32,195 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbec4a474a995a18843b66/lava_callback.json.gz 2026-05-07 01:38:32,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:38:32,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbec4a474a995a18843b66 HTTP/1.1" 200 None 2026-05-07 01:38:32,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:38:32,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:38:32,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:38:32,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbec4a474a995a18843b66 HTTP/1.1" 200 None 2026-05-07 01:38:32,320 - lava_callback - INFO - Completed processing callback for node 69fbec4a474a995a18843b66 INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:38:59,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:38:59,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:39:09,863 - lava_callback - INFO - Received callback for node 69fbece6474a995a18843bb0 INFO: 172.21.0.1:57652 - "POST /node/69fbece6474a995a18843bb0 HTTP/1.0" 202 Accepted 2026-05-07 01:39:09,870 - lava_callback - INFO - Starting async job submit for node 69fbece6474a995a18843bb0 2026-05-07 01:39:09,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:39:09,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbece6474a995a18843bb0 HTTP/1.1" 200 None 2026-05-07 01:39:09,909 - lava_callback - DEBUG - Processing node 69fbece6474a995a18843bb0: baseline-nfs-arm64 2026-05-07 01:39:10,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:39:10,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:39:10,678 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbece6474a995a18843bb0/log.txt.gz 2026-05-07 01:39:11,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:39:11,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:39:11,212 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbece6474a995a18843bb0/lava-logs.yaml 2026-05-07 01:39:11,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:39:11,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:39:11,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbece6474a995a18843bb0/lava_callback.json.gz 2026-05-07 01:39:11,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:39:11,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbece6474a995a18843bb0 HTTP/1.1" 200 None 2026-05-07 01:39:11,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:39:11,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:39:11,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:39:11,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbece6474a995a18843bb0 HTTP/1.1" 200 None 2026-05-07 01:39:11,460 - lava_callback - INFO - Completed processing callback for node 69fbece6474a995a18843bb0 INFO: 172.21.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:39:29,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:39:29,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:40:42,663 - lava_callback - INFO - Received callback for node 69fbe551474a995a188435c8 INFO: 172.21.0.1:44468 - "POST /node/69fbe551474a995a188435c8 HTTP/1.0" 202 Accepted 2026-05-07 01:40:42,709 - lava_callback - INFO - Starting async job submit for node 69fbe551474a995a188435c8 2026-05-07 01:40:42,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:40:42,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe551474a995a188435c8 HTTP/1.1" 200 None 2026-05-07 01:40:42,755 - lava_callback - DEBUG - Processing node 69fbe551474a995a188435c8: baseline-arm-pengutronix 2026-05-07 01:40:42,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:40:42,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:40:42,950 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbe551474a995a188435c8/log.txt.gz 2026-05-07 01:40:43,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:40:43,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:40:43,156 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbe551474a995a188435c8/lava-logs.yaml 2026-05-07 01:40:43,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:40:43,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:40:43,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbe551474a995a188435c8/lava_callback.json.gz DEBUG: Setup failed for 69fbe551474a995a188435c8. Transitting job node result: incomplete -> fail 2026-05-07 01:40:43,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:40:43,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbe551474a995a188435c8 HTTP/1.1" 200 None 2026-05-07 01:40:43,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:40:43,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 01:40:43,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:40:43,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbe551474a995a188435c8 HTTP/1.1" 200 None 2026-05-07 01:40:43,462 - lava_callback - INFO - Completed processing callback for node 69fbe551474a995a188435c8 INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40946 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:40:59,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:40:59,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:41:44,860 - lava_callback - INFO - Received callback for node 69fbed9b474a995a18843c23 INFO: 172.21.0.1:57428 - "POST /node/69fbed9b474a995a18843c23 HTTP/1.0" 202 Accepted 2026-05-07 01:41:44,867 - lava_callback - INFO - Starting async job submit for node 69fbed9b474a995a18843c23 2026-05-07 01:41:44,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:41:44,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbed9b474a995a18843c23 HTTP/1.1" 200 None 2026-05-07 01:41:44,912 - lava_callback - DEBUG - Processing node 69fbed9b474a995a18843c23: baseline-arm64 2026-05-07 01:41:45,057 - lava_callback - WARNING - Failed to upload log 2026-05-07 01:41:45,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:41:45,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:41:45,251 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbed9b474a995a18843c23/lava-logs.yaml 2026-05-07 01:41:45,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:41:45,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:41:45,354 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbed9b474a995a18843c23/lava_callback.json.gz 2026-05-07 01:41:45,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:41:45,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbed9b474a995a18843c23 HTTP/1.1" 200 None 2026-05-07 01:41:45,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:41:45,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:41:45,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:41:45,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbed9b474a995a18843c23 HTTP/1.1" 200 None 2026-05-07 01:41:45,496 - lava_callback - INFO - Completed processing callback for node 69fbed9b474a995a18843c23 INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47818 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:41:59,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:41:59,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:44:55,368 - lava_callback - INFO - Received callback for node 69fbee32474a995a18843c70 INFO: 172.21.0.1:35108 - "POST /node/69fbee32474a995a18843c70 HTTP/1.0" 202 Accepted 2026-05-07 01:44:55,375 - lava_callback - INFO - Starting async job submit for node 69fbee32474a995a18843c70 2026-05-07 01:44:55,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:44:55,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbee32474a995a18843c70 HTTP/1.1" 200 None 2026-05-07 01:44:55,421 - lava_callback - DEBUG - Processing node 69fbee32474a995a18843c70: baseline-arm64 2026-05-07 01:44:55,628 - lava_callback - WARNING - Failed to upload log 2026-05-07 01:44:55,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:44:55,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:44:55,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbee32474a995a18843c70/lava-logs.yaml 2026-05-07 01:44:55,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:44:56,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:44:56,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbee32474a995a18843c70/lava_callback.json.gz 2026-05-07 01:44:56,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:44:56,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbee32474a995a18843c70 HTTP/1.1" 200 None 2026-05-07 01:44:56,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:44:56,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:44:56,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:44:56,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbee32474a995a18843c70 HTTP/1.1" 200 None 2026-05-07 01:44:56,358 - lava_callback - INFO - Completed processing callback for node 69fbee32474a995a18843c70 INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:44:59,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:44:59,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:46:58,334 - lava_callback - INFO - Received callback for node 69fbed55474a995a18843bfb INFO: 172.21.0.1:47064 - "POST /node/69fbed55474a995a18843bfb HTTP/1.0" 202 Accepted 2026-05-07 01:46:58,341 - lava_callback - INFO - Starting async job submit for node 69fbed55474a995a18843bfb 2026-05-07 01:46:58,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:46:58,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbed55474a995a18843bfb HTTP/1.1" 200 None 2026-05-07 01:46:58,392 - lava_callback - DEBUG - Processing node 69fbed55474a995a18843bfb: baseline-arm64 2026-05-07 01:46:58,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:46:58,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:46:58,902 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbed55474a995a18843bfb/log.txt.gz 2026-05-07 01:46:59,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:46:59,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:46:59,423 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbed55474a995a18843bfb/lava-logs.yaml 2026-05-07 01:46:59,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:46:59,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:46:59,564 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbed55474a995a18843bfb/lava_callback.json.gz DEBUG: Setup failed for 69fbed55474a995a18843bfb. Transitting job node result: incomplete -> fail 2026-05-07 01:46:59,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:46:59,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbed55474a995a18843bfb HTTP/1.1" 200 None 2026-05-07 01:46:59,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:46:59,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:46:59,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:46:59,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbed55474a995a18843bfb HTTP/1.1" 200 None 2026-05-07 01:46:59,781 - lava_callback - INFO - Completed processing callback for node 69fbed55474a995a18843bfb INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55070 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:47:29,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:47:29,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:47:40,756 - lava_callback - INFO - Received callback for node 69fbef20474a995a18843ce4 INFO: 172.21.0.1:46396 - "POST /node/69fbef20474a995a18843ce4 HTTP/1.0" 202 Accepted 2026-05-07 01:47:40,762 - lava_callback - INFO - Starting async job submit for node 69fbef20474a995a18843ce4 2026-05-07 01:47:40,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:47:40,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbef20474a995a18843ce4 HTTP/1.1" 200 None 2026-05-07 01:47:40,778 - lava_callback - DEBUG - Processing node 69fbef20474a995a18843ce4: baseline-nfs-arm64 2026-05-07 01:47:40,779 - lava_callback - WARNING - Failed to upload log 2026-05-07 01:47:40,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:47:40,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:47:40,881 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbef20474a995a18843ce4/lava-logs.yaml 2026-05-07 01:47:40,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:47:41,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:47:41,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbef20474a995a18843ce4/lava_callback.json.gz 2026-05-07 01:47:41,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:47:41,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbef20474a995a18843ce4 HTTP/1.1" 200 None 2026-05-07 01:47:41,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:47:41,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:47:41,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:47:41,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbef20474a995a18843ce4 HTTP/1.1" 200 None 2026-05-07 01:47:41,196 - lava_callback - INFO - Completed processing callback for node 69fbef20474a995a18843ce4 INFO: 172.21.0.1:46408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39706 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:47:59,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:47:59,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:51:08,049 - lava_callback - INFO - Received callback for node 69fbefb1474a995a18843d2e INFO: 172.21.0.1:50694 - "POST /node/69fbefb1474a995a18843d2e HTTP/1.0" 202 Accepted 2026-05-07 01:51:08,056 - lava_callback - INFO - Starting async job submit for node 69fbefb1474a995a18843d2e 2026-05-07 01:51:08,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:51:08,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbefb1474a995a18843d2e HTTP/1.1" 200 None 2026-05-07 01:51:08,105 - lava_callback - DEBUG - Processing node 69fbefb1474a995a18843d2e: baseline-arm64 2026-05-07 01:51:08,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:51:08,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:51:08,758 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbefb1474a995a18843d2e/log.txt.gz 2026-05-07 01:51:09,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:51:09,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:51:09,271 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbefb1474a995a18843d2e/lava-logs.yaml 2026-05-07 01:51:09,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:51:09,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:51:09,418 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbefb1474a995a18843d2e/lava_callback.json.gz 2026-05-07 01:51:09,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:51:09,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbefb1474a995a18843d2e HTTP/1.1" 200 None 2026-05-07 01:51:09,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:51:09,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:51:09,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:51:09,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbefb1474a995a18843d2e HTTP/1.1" 200 None 2026-05-07 01:51:09,583 - lava_callback - INFO - Completed processing callback for node 69fbefb1474a995a18843d2e INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:51:29,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:51:29,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32822 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:52:25,883 - lava_callback - INFO - Received callback for node 69f94d52d09fe59064f06224 INFO: 172.21.0.1:55824 - "POST /node/69f94d52d09fe59064f06224 HTTP/1.0" 202 Accepted 2026-05-07 01:52:25,888 - lava_callback - INFO - Starting async job submit for node 69f94d52d09fe59064f06224 2026-05-07 01:52:25,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:25,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94d52d09fe59064f06224 HTTP/1.1" 200 None 2026-05-07 01:52:25,904 - lava_callback - DEBUG - Processing node 69f94d52d09fe59064f06224: baseline-arm64-baylibre 2026-05-07 01:52:25,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94d52d09fe59064f06224 2026-05-07 01:52:25,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:25,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94d52d09fe59064f06224 HTTP/1.1" 200 None 2026-05-07 01:52:25,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:25,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-07 01:52:25,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:25,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94d52d09fe59064f06224 HTTP/1.1" 200 None 2026-05-07 01:52:25,950 - lava_callback - ERROR - Error processing callback for node 69f94d52d09fe59064f06224: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:52:41,713 - lava_callback - INFO - Received callback for node 69fbede9474a995a18843c49 INFO: 172.21.0.1:44054 - "POST /node/69fbede9474a995a18843c49 HTTP/1.0" 202 Accepted 2026-05-07 01:52:41,720 - lava_callback - INFO - Starting async job submit for node 69fbede9474a995a18843c49 2026-05-07 01:52:41,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:41,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbede9474a995a18843c49 HTTP/1.1" 200 None 2026-05-07 01:52:41,770 - lava_callback - DEBUG - Processing node 69fbede9474a995a18843c49: baseline-arm64 2026-05-07 01:52:42,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:52:42,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:52:42,508 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbede9474a995a18843c49/log.txt.gz 2026-05-07 01:52:42,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:52:42,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:52:42,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbede9474a995a18843c49/lava-logs.yaml 2026-05-07 01:52:42,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:52:43,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:52:43,091 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbede9474a995a18843c49/lava_callback.json.gz 2026-05-07 01:52:43,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:43,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbede9474a995a18843c49 HTTP/1.1" 200 None 2026-05-07 01:52:43,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:43,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:52:43,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:43,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbede9474a995a18843c49 HTTP/1.1" 200 None 2026-05-07 01:52:43,227 - lava_callback - INFO - Completed processing callback for node 69fbede9474a995a18843c49 INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:52:52,082 - lava_callback - INFO - Received callback for node 69fbed2c474a995a18843be1 INFO: 172.21.0.1:43200 - "POST /node/69fbed2c474a995a18843be1 HTTP/1.0" 202 Accepted 2026-05-07 01:52:52,089 - lava_callback - INFO - Starting async job submit for node 69fbed2c474a995a18843be1 2026-05-07 01:52:52,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:52,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbed2c474a995a18843be1 HTTP/1.1" 200 None 2026-05-07 01:52:52,159 - lava_callback - DEBUG - Processing node 69fbed2c474a995a18843be1: baseline-arm 2026-05-07 01:52:52,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:52:52,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:52:52,740 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fbed2c474a995a18843be1/log.txt.gz 2026-05-07 01:52:53,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:52:53,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:52:53,187 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbed2c474a995a18843be1/lava-logs.yaml 2026-05-07 01:52:53,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:52:53,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:52:53,338 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbed2c474a995a18843be1/lava_callback.json.gz DEBUG: Setup failed for 69fbed2c474a995a18843be1. Transitting job node result: incomplete -> fail 2026-05-07 01:52:53,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:53,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbed2c474a995a18843be1 HTTP/1.1" 200 None 2026-05-07 01:52:53,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:53,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 01:52:53,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:53,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbed2c474a995a18843be1 HTTP/1.1" 200 None 2026-05-07 01:52:53,603 - lava_callback - INFO - Completed processing callback for node 69fbed2c474a995a18843be1 INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:52:59,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:52:59,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:53:45,055 - lava_callback - INFO - Received callback for node 69fbf069474a995a18843d89 INFO: 172.21.0.1:57054 - "POST /node/69fbf069474a995a18843d89 HTTP/1.0" 202 Accepted 2026-05-07 01:53:45,062 - lava_callback - INFO - Starting async job submit for node 69fbf069474a995a18843d89 2026-05-07 01:53:45,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:53:45,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf069474a995a18843d89 HTTP/1.1" 200 None 2026-05-07 01:53:45,107 - lava_callback - DEBUG - Processing node 69fbf069474a995a18843d89: baseline-arm64 2026-05-07 01:53:45,244 - lava_callback - WARNING - Failed to upload log 2026-05-07 01:53:45,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:53:45,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:53:45,463 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf069474a995a18843d89/lava-logs.yaml 2026-05-07 01:53:45,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:53:45,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:53:45,569 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf069474a995a18843d89/lava_callback.json.gz 2026-05-07 01:53:45,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:53:45,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf069474a995a18843d89 HTTP/1.1" 200 None 2026-05-07 01:53:45,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:53:45,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:53:45,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:53:45,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf069474a995a18843d89 HTTP/1.1" 200 None 2026-05-07 01:53:45,715 - lava_callback - INFO - Completed processing callback for node 69fbf069474a995a18843d89 2026-05-07 01:53:45,867 - lava_callback - INFO - Received callback for node 69f94da5d09fe59064f06260 INFO: 172.21.0.1:57068 - "POST /node/69f94da5d09fe59064f06260 HTTP/1.0" 202 Accepted 2026-05-07 01:53:45,872 - lava_callback - INFO - Starting async job submit for node 69f94da5d09fe59064f06260 2026-05-07 01:53:45,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:53:45,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94da5d09fe59064f06260 HTTP/1.1" 200 None 2026-05-07 01:53:45,888 - lava_callback - DEBUG - Processing node 69f94da5d09fe59064f06260: baseline-arm64-baylibre 2026-05-07 01:53:45,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94da5d09fe59064f06260 2026-05-07 01:53:45,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:53:45,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94da5d09fe59064f06260 HTTP/1.1" 200 None 2026-05-07 01:53:45,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:53:45,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-07 01:53:45,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:53:45,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94da5d09fe59064f06260 HTTP/1.1" 200 None 2026-05-07 01:53:45,942 - lava_callback - ERROR - Error processing callback for node 69f94da5d09fe59064f06260: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59094 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:53:59,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:53:59,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44464 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:55:10,368 - lava_callback - INFO - Received callback for node 69fbf0b5474a995a18843db8 INFO: 172.21.0.1:40676 - "POST /node/69fbf0b5474a995a18843db8 HTTP/1.0" 202 Accepted 2026-05-07 01:55:10,377 - lava_callback - INFO - Starting async job submit for node 69fbf0b5474a995a18843db8 2026-05-07 01:55:10,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:55:10,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf0b5474a995a18843db8 HTTP/1.1" 200 None 2026-05-07 01:55:10,422 - lava_callback - DEBUG - Processing node 69fbf0b5474a995a18843db8: baseline-arm64 2026-05-07 01:55:10,631 - lava_callback - WARNING - Failed to upload log 2026-05-07 01:55:10,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:55:10,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:55:10,950 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf0b5474a995a18843db8/lava-logs.yaml 2026-05-07 01:55:10,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:55:11,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:55:11,234 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf0b5474a995a18843db8/lava_callback.json.gz 2026-05-07 01:55:11,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:55:11,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf0b5474a995a18843db8 HTTP/1.1" 200 None 2026-05-07 01:55:11,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:55:11,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:55:11,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:55:11,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf0b5474a995a18843db8 HTTP/1.1" 200 None 2026-05-07 01:55:11,390 - lava_callback - INFO - Completed processing callback for node 69fbf0b5474a995a18843db8 INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:55:29,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:55:29,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:55:36,950 - lava_callback - INFO - Received callback for node 69fbee84474a995a18843c90 INFO: 172.21.0.1:36420 - "POST /node/69fbee84474a995a18843c90 HTTP/1.0" 202 Accepted 2026-05-07 01:55:36,956 - lava_callback - INFO - Starting async job submit for node 69fbee84474a995a18843c90 2026-05-07 01:55:36,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:55:36,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbee84474a995a18843c90 HTTP/1.1" 200 None 2026-05-07 01:55:36,997 - lava_callback - DEBUG - Processing node 69fbee84474a995a18843c90: baseline-nfs-arm64 2026-05-07 01:55:37,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:55:37,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:55:37,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbee84474a995a18843c90/log.txt.gz 2026-05-07 01:55:37,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:55:38,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:55:38,048 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbee84474a995a18843c90/lava-logs.yaml 2026-05-07 01:55:38,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:55:38,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:55:38,191 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbee84474a995a18843c90/lava_callback.json.gz 2026-05-07 01:55:38,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:55:38,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbee84474a995a18843c90 HTTP/1.1" 200 None 2026-05-07 01:55:38,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:55:38,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:55:38,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:55:38,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbee84474a995a18843c90 HTTP/1.1" 200 None 2026-05-07 01:55:38,333 - lava_callback - INFO - Completed processing callback for node 69fbee84474a995a18843c90 INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:55:59,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:55:59,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39390 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:56:26,011 - lava_callback - INFO - Received callback for node 69f94e3dd09fe59064f06301 INFO: 172.21.0.1:44092 - "POST /node/69f94e3dd09fe59064f06301 HTTP/1.0" 202 Accepted 2026-05-07 01:56:26,016 - lava_callback - INFO - Starting async job submit for node 69f94e3dd09fe59064f06301 2026-05-07 01:56:26,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:56:26,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94e3dd09fe59064f06301 HTTP/1.1" 200 None 2026-05-07 01:56:26,037 - lava_callback - DEBUG - Processing node 69f94e3dd09fe59064f06301: baseline-arm64-baylibre 2026-05-07 01:56:26,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94e3dd09fe59064f06301 2026-05-07 01:56:26,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:56:26,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94e3dd09fe59064f06301 HTTP/1.1" 200 None 2026-05-07 01:56:26,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:56:26,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-07 01:56:26,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:56:26,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94e3dd09fe59064f06301 HTTP/1.1" 200 None 2026-05-07 01:56:26,083 - lava_callback - ERROR - Error processing callback for node 69f94e3dd09fe59064f06301: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44102 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:56:36,083 - lava_callback - INFO - Received callback for node 69fbed2a474a995a18843bde INFO: 172.21.0.1:52784 - "POST /node/69fbed2a474a995a18843bde HTTP/1.0" 202 Accepted 2026-05-07 01:56:36,090 - lava_callback - INFO - Starting async job submit for node 69fbed2a474a995a18843bde 2026-05-07 01:56:36,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:56:36,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbed2a474a995a18843bde HTTP/1.1" 200 None 2026-05-07 01:56:36,171 - lava_callback - DEBUG - Processing node 69fbed2a474a995a18843bde: ltp-smoke INFO: 172.21.0.1:52790 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:56:36,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:56:36,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:56:36,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbed2a474a995a18843bde/log.txt.gz 2026-05-07 01:56:37,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:56:37,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:56:37,395 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbed2a474a995a18843bde/lava-logs.yaml 2026-05-07 01:56:37,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:56:37,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:56:37,722 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbed2a474a995a18843bde/lava_callback.json.gz 2026-05-07 01:56:37,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:56:37,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbed2a474a995a18843bde HTTP/1.1" 200 None 2026-05-07 01:56:37,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:56:37,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda05474a995a18840a0a HTTP/1.1" 200 None 2026-05-07 01:56:37,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:56:37,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbed2a474a995a18843bde HTTP/1.1" 200 None 2026-05-07 01:56:38,067 - lava_callback - INFO - Completed processing callback for node 69fbed2a474a995a18843bde INFO: 172.21.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:56:59,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:56:59,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:57:46,136 - lava_callback - INFO - Received callback for node 69f94e92d09fe59064f06355 INFO: 172.21.0.1:38172 - "POST /node/69f94e92d09fe59064f06355 HTTP/1.0" 202 Accepted 2026-05-07 01:57:46,142 - lava_callback - INFO - Starting async job submit for node 69f94e92d09fe59064f06355 2026-05-07 01:57:46,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:57:46,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94e92d09fe59064f06355 HTTP/1.1" 200 None 2026-05-07 01:57:46,157 - lava_callback - DEBUG - Processing node 69f94e92d09fe59064f06355: baseline-arm64-baylibre 2026-05-07 01:57:46,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94e92d09fe59064f06355 2026-05-07 01:57:46,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:57:46,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94e92d09fe59064f06355 HTTP/1.1" 200 None 2026-05-07 01:57:46,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:57:46,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-07 01:57:46,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:57:46,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94e92d09fe59064f06355 HTTP/1.1" 200 None 2026-05-07 01:57:46,204 - lava_callback - ERROR - Error processing callback for node 69f94e92d09fe59064f06355: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:58:13,401 - lava_callback - INFO - Received callback for node 69fbf19b474a995a18843e2b INFO: 172.21.0.1:33002 - "POST /node/69fbf19b474a995a18843e2b HTTP/1.0" 202 Accepted 2026-05-07 01:58:13,407 - lava_callback - INFO - Starting async job submit for node 69fbf19b474a995a18843e2b 2026-05-07 01:58:13,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:58:13,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf19b474a995a18843e2b HTTP/1.1" 200 None 2026-05-07 01:58:13,423 - lava_callback - DEBUG - Processing node 69fbf19b474a995a18843e2b: baseline-nfs-arm64 2026-05-07 01:58:13,425 - lava_callback - WARNING - Failed to upload log 2026-05-07 01:58:13,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:58:13,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:58:13,517 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf19b474a995a18843e2b/lava-logs.yaml 2026-05-07 01:58:13,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 01:58:13,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 01:58:13,627 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf19b474a995a18843e2b/lava_callback.json.gz 2026-05-07 01:58:13,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:58:13,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf19b474a995a18843e2b HTTP/1.1" 200 None 2026-05-07 01:58:13,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:58:13,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 01:58:13,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:58:13,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf19b474a995a18843e2b HTTP/1.1" 200 None 2026-05-07 01:58:13,694 - lava_callback - INFO - Completed processing callback for node 69fbf19b474a995a18843e2b INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK 2026-05-07 01:58:29,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 01:58:29,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39734 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:00:29,779 - lava_callback - INFO - Received callback for node 69fbf1e1474a995a18843e48 INFO: 172.21.0.1:51638 - "POST /node/69fbf1e1474a995a18843e48 HTTP/1.0" 202 Accepted 2026-05-07 02:00:29,786 - lava_callback - INFO - Starting async job submit for node 69fbf1e1474a995a18843e48 2026-05-07 02:00:29,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:00:29,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf1e1474a995a18843e48 HTTP/1.1" 200 None 2026-05-07 02:00:29,831 - lava_callback - DEBUG - Processing node 69fbf1e1474a995a18843e48: baseline-arm64 2026-05-07 02:00:30,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:00:30,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:00:30,455 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf1e1474a995a18843e48/log.txt.gz 2026-05-07 02:00:30,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:00:30,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:00:30,938 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf1e1474a995a18843e48/lava-logs.yaml 2026-05-07 02:00:30,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:00:31,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:00:31,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf1e1474a995a18843e48/lava_callback.json.gz 2026-05-07 02:00:31,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:00:31,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf1e1474a995a18843e48 HTTP/1.1" 200 None 2026-05-07 02:00:31,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:00:31,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:00:31,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:00:31,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf1e1474a995a18843e48 HTTP/1.1" 200 None 2026-05-07 02:00:31,206 - lava_callback - INFO - Completed processing callback for node 69fbf1e1474a995a18843e48 INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38870 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:00:59,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:00:59,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:01:26,242 - lava_callback - INFO - Received callback for node 69f94f61d09fe59064f063e4 INFO: 172.21.0.1:56558 - "POST /node/69f94f61d09fe59064f063e4 HTTP/1.0" 202 Accepted 2026-05-07 02:01:26,248 - lava_callback - INFO - Starting async job submit for node 69f94f61d09fe59064f063e4 2026-05-07 02:01:26,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:26,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94f61d09fe59064f063e4 HTTP/1.1" 200 None 2026-05-07 02:01:26,264 - lava_callback - DEBUG - Processing node 69f94f61d09fe59064f063e4: baseline-arm64-baylibre 2026-05-07 02:01:26,264 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f94f61d09fe59064f063e4 2026-05-07 02:01:26,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:26,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f94f61d09fe59064f063e4 HTTP/1.1" 200 None 2026-05-07 02:01:26,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:26,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-07 02:01:26,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:26,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f94f61d09fe59064f063e4 HTTP/1.1" 200 None 2026-05-07 02:01:26,320 - lava_callback - ERROR - Error processing callback for node 69f94f61d09fe59064f063e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39290 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:01:39,888 - lava_callback - INFO - Received callback for node 69fbeffa474a995a18843d53 INFO: 172.21.0.1:34340 - "POST /node/69fbeffa474a995a18843d53 HTTP/1.0" 202 Accepted 2026-05-07 02:01:39,894 - lava_callback - INFO - Starting async job submit for node 69fbeffa474a995a18843d53 2026-05-07 02:01:39,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:39,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbeffa474a995a18843d53 HTTP/1.1" 200 None 2026-05-07 02:01:39,931 - lava_callback - DEBUG - Processing node 69fbeffa474a995a18843d53: baseline-arm64 2026-05-07 02:01:40,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:01:40,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:01:40,625 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbeffa474a995a18843d53/log.txt.gz 2026-05-07 02:01:40,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:01:41,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:01:41,027 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbeffa474a995a18843d53/lava-logs.yaml 2026-05-07 02:01:41,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:01:41,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:01:41,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbeffa474a995a18843d53/lava_callback.json.gz 2026-05-07 02:01:41,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:41,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbeffa474a995a18843d53 HTTP/1.1" 200 None 2026-05-07 02:01:41,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:41,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:01:41,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:41,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbeffa474a995a18843d53 HTTP/1.1" 200 None 2026-05-07 02:01:41,337 - lava_callback - INFO - Completed processing callback for node 69fbeffa474a995a18843d53 INFO: 172.21.0.1:34346 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:01:48,054 - lava_callback - INFO - Received callback for node 69fbf14d474a995a18843e00 INFO: 172.21.0.1:34358 - "POST /node/69fbf14d474a995a18843e00 HTTP/1.0" 202 Accepted 2026-05-07 02:01:48,061 - lava_callback - INFO - Starting async job submit for node 69fbf14d474a995a18843e00 2026-05-07 02:01:48,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:48,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf14d474a995a18843e00 HTTP/1.1" 200 None 2026-05-07 02:01:48,112 - lava_callback - DEBUG - Processing node 69fbf14d474a995a18843e00: baseline-arm64 2026-05-07 02:01:48,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:01:48,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:01:48,625 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf14d474a995a18843e00/log.txt.gz 2026-05-07 02:01:48,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:01:49,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:01:49,013 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf14d474a995a18843e00/lava-logs.yaml 2026-05-07 02:01:49,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:01:49,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:01:49,308 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf14d474a995a18843e00/lava_callback.json.gz DEBUG: Setup failed for 69fbf14d474a995a18843e00. Transitting job node result: incomplete -> fail 2026-05-07 02:01:49,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:49,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf14d474a995a18843e00 HTTP/1.1" 200 None 2026-05-07 02:01:49,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:49,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:01:49,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:49,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf14d474a995a18843e00 HTTP/1.1" 200 None 2026-05-07 02:01:49,545 - lava_callback - INFO - Completed processing callback for node 69fbf14d474a995a18843e00 INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:01:59,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:01:59,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55900 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:03:06,341 - lava_callback - INFO - Received callback for node 69fbf29d474a995a18843ea6 INFO: 172.21.0.1:33162 - "POST /node/69fbf29d474a995a18843ea6 HTTP/1.0" 202 Accepted 2026-05-07 02:03:06,348 - lava_callback - INFO - Starting async job submit for node 69fbf29d474a995a18843ea6 2026-05-07 02:03:06,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:03:06,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf29d474a995a18843ea6 HTTP/1.1" 200 None 2026-05-07 02:03:06,392 - lava_callback - DEBUG - Processing node 69fbf29d474a995a18843ea6: baseline-arm64 INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:03:06,529 - lava_callback - WARNING - Failed to upload log 2026-05-07 02:03:06,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:03:06,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:03:06,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf29d474a995a18843ea6/lava-logs.yaml 2026-05-07 02:03:06,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:03:06,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:03:06,871 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf29d474a995a18843ea6/lava_callback.json.gz 2026-05-07 02:03:06,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:03:06,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf29d474a995a18843ea6 HTTP/1.1" 200 None 2026-05-07 02:03:06,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:03:06,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:03:06,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:03:06,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf29d474a995a18843ea6 HTTP/1.1" 200 None 2026-05-07 02:03:07,005 - lava_callback - INFO - Completed processing callback for node 69fbf29d474a995a18843ea6 INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40494 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:03:29,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:03:29,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:04:06,482 - lava_callback - INFO - Received callback for node 69f95005d09fe59064f0645f INFO: 172.21.0.1:37494 - "POST /node/69f95005d09fe59064f0645f HTTP/1.0" 202 Accepted 2026-05-07 02:04:06,488 - lava_callback - INFO - Starting async job submit for node 69f95005d09fe59064f0645f 2026-05-07 02:04:06,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:04:06,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95005d09fe59064f0645f HTTP/1.1" 200 None 2026-05-07 02:04:06,503 - lava_callback - DEBUG - Processing node 69f95005d09fe59064f0645f: baseline-arm64-baylibre 2026-05-07 02:04:06,503 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95005d09fe59064f0645f 2026-05-07 02:04:06,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:04:06,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95005d09fe59064f0645f HTTP/1.1" 200 None 2026-05-07 02:04:06,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:04:06,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-07 02:04:06,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:04:06,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95005d09fe59064f0645f HTTP/1.1" 200 None 2026-05-07 02:04:06,554 - lava_callback - ERROR - Error processing callback for node 69f95005d09fe59064f0645f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:04:18,274 - lava_callback - INFO - Received callback for node 69fbf2e8474a995a18843ec5 INFO: 172.21.0.1:57814 - "POST /node/69fbf2e8474a995a18843ec5 HTTP/1.0" 202 Accepted 2026-05-07 02:04:18,281 - lava_callback - INFO - Starting async job submit for node 69fbf2e8474a995a18843ec5 2026-05-07 02:04:18,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:04:18,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf2e8474a995a18843ec5 HTTP/1.1" 200 None 2026-05-07 02:04:18,324 - lava_callback - DEBUG - Processing node 69fbf2e8474a995a18843ec5: baseline-arm64 2026-05-07 02:04:18,465 - lava_callback - WARNING - Failed to upload log 2026-05-07 02:04:18,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:04:18,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:04:18,683 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf2e8474a995a18843ec5/lava-logs.yaml 2026-05-07 02:04:18,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:04:18,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:04:18,778 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf2e8474a995a18843ec5/lava_callback.json.gz 2026-05-07 02:04:18,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:04:18,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf2e8474a995a18843ec5 HTTP/1.1" 200 None 2026-05-07 02:04:18,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:04:18,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:04:18,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:04:18,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf2e8474a995a18843ec5 HTTP/1.1" 200 None 2026-05-07 02:04:18,954 - lava_callback - INFO - Completed processing callback for node 69fbf2e8474a995a18843ec5 INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:04:29,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:04:29,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:05:42,302 - lava_callback - INFO - Received callback for node 69f95063d09fe59064f064b5 INFO: 172.21.0.1:58846 - "POST /node/69f95063d09fe59064f064b5 HTTP/1.0" 202 Accepted 2026-05-07 02:05:42,308 - lava_callback - INFO - Starting async job submit for node 69f95063d09fe59064f064b5 2026-05-07 02:05:42,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:05:42,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95063d09fe59064f064b5 HTTP/1.1" 200 None 2026-05-07 02:05:42,323 - lava_callback - DEBUG - Processing node 69f95063d09fe59064f064b5: baseline-arm64-clabbe 2026-05-07 02:05:42,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95063d09fe59064f064b5 2026-05-07 02:05:42,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:05:42,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95063d09fe59064f064b5 HTTP/1.1" 200 None 2026-05-07 02:05:42,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:05:42,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-07 02:05:42,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:05:42,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95063d09fe59064f064b5 HTTP/1.1" 200 None 2026-05-07 02:05:42,369 - lava_callback - ERROR - Error processing callback for node 69f95063d09fe59064f064b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52236 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:07:02,315 - lava_callback - INFO - Received callback for node 69f950b5d09fe59064f064fc INFO: 172.21.0.1:49184 - "POST /node/69f950b5d09fe59064f064fc HTTP/1.0" 202 Accepted 2026-05-07 02:07:02,320 - lava_callback - INFO - Starting async job submit for node 69f950b5d09fe59064f064fc 2026-05-07 02:07:02,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:07:02,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f950b5d09fe59064f064fc HTTP/1.1" 200 None 2026-05-07 02:07:02,342 - lava_callback - DEBUG - Processing node 69f950b5d09fe59064f064fc: baseline-arm64-clabbe 2026-05-07 02:07:02,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f950b5d09fe59064f064fc 2026-05-07 02:07:02,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:07:02,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f950b5d09fe59064f064fc HTTP/1.1" 200 None 2026-05-07 02:07:02,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:07:02,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-07 02:07:02,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:07:02,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f950b5d09fe59064f064fc HTTP/1.1" 200 None 2026-05-07 02:07:02,388 - lava_callback - ERROR - Error processing callback for node 69f950b5d09fe59064f064fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-07 02:08:16,474 - lava_callback - INFO - Received callback for node 69fbef6b474a995a18843d0b INFO: 172.21.0.1:47890 - "POST /node/69fbef6b474a995a18843d0b HTTP/1.0" 202 Accepted 2026-05-07 02:08:16,483 - lava_callback - INFO - Starting async job submit for node 69fbef6b474a995a18843d0b INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:08:16,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:08:16,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbef6b474a995a18843d0b HTTP/1.1" 200 None 2026-05-07 02:08:16,550 - lava_callback - DEBUG - Processing node 69fbef6b474a995a18843d0b: baseline-nfs-arm64 2026-05-07 02:08:17,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:08:17,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:08:17,828 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbef6b474a995a18843d0b/log.txt.gz 2026-05-07 02:08:18,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:08:18,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:08:18,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbef6b474a995a18843d0b/lava-logs.yaml 2026-05-07 02:08:18,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:08:18,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:08:18,798 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbef6b474a995a18843d0b/lava_callback.json.gz DEBUG: Setup failed for 69fbef6b474a995a18843d0b. Transitting job node result: incomplete -> fail 2026-05-07 02:08:18,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:08:18,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbef6b474a995a18843d0b HTTP/1.1" 200 None 2026-05-07 02:08:18,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:08:18,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:08:18,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:08:18,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbef6b474a995a18843d0b HTTP/1.1" 200 None 2026-05-07 02:08:19,052 - lava_callback - INFO - Completed processing callback for node 69fbef6b474a995a18843d0b 2026-05-07 02:08:22,335 - lava_callback - INFO - Received callback for node 69f95108d09fe59064f0655a INFO: 172.21.0.1:42942 - "POST /node/69f95108d09fe59064f0655a HTTP/1.0" 202 Accepted 2026-05-07 02:08:22,341 - lava_callback - INFO - Starting async job submit for node 69f95108d09fe59064f0655a 2026-05-07 02:08:22,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:08:22,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95108d09fe59064f0655a HTTP/1.1" 200 None 2026-05-07 02:08:22,372 - lava_callback - DEBUG - Processing node 69f95108d09fe59064f0655a: baseline-arm64-clabbe 2026-05-07 02:08:22,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95108d09fe59064f0655a 2026-05-07 02:08:22,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:08:22,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95108d09fe59064f0655a HTTP/1.1" 200 None 2026-05-07 02:08:22,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:08:22,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-07 02:08:22,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:08:22,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95108d09fe59064f0655a HTTP/1.1" 200 None 2026-05-07 02:08:22,422 - lava_callback - ERROR - Error processing callback for node 69f95108d09fe59064f0655a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42946 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:08:29,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:08:29,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46016 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:09:34,791 - lava_callback - INFO - Received callback for node 69fbf381474a995a18843f09 INFO: 172.21.0.1:48386 - "POST /node/69fbf381474a995a18843f09 HTTP/1.0" 202 Accepted 2026-05-07 02:09:34,797 - lava_callback - INFO - Starting async job submit for node 69fbf381474a995a18843f09 2026-05-07 02:09:34,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:09:34,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf381474a995a18843f09 HTTP/1.1" 200 None 2026-05-07 02:09:34,834 - lava_callback - DEBUG - Processing node 69fbf381474a995a18843f09: baseline-arm64 2026-05-07 02:09:35,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:09:35,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:09:35,306 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf381474a995a18843f09/log.txt.gz 2026-05-07 02:09:35,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:09:36,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:09:36,221 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf381474a995a18843f09/lava-logs.yaml 2026-05-07 02:09:36,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:09:36,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:09:36,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf381474a995a18843f09/lava_callback.json.gz 2026-05-07 02:09:36,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:09:36,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf381474a995a18843f09 HTTP/1.1" 200 None 2026-05-07 02:09:36,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:09:36,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:09:36,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:09:36,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf381474a995a18843f09 HTTP/1.1" 200 None 2026-05-07 02:09:36,477 - lava_callback - INFO - Completed processing callback for node 69fbf381474a995a18843f09 INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:09:42,418 - lava_callback - INFO - Received callback for node 69f9515cd09fe59064f065a2 INFO: 172.21.0.1:48492 - "POST /node/69f9515cd09fe59064f065a2 HTTP/1.0" 202 Accepted 2026-05-07 02:09:42,425 - lava_callback - INFO - Starting async job submit for node 69f9515cd09fe59064f065a2 2026-05-07 02:09:42,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:09:42,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9515cd09fe59064f065a2 HTTP/1.1" 200 None 2026-05-07 02:09:42,440 - lava_callback - DEBUG - Processing node 69f9515cd09fe59064f065a2: baseline-arm64-clabbe 2026-05-07 02:09:42,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9515cd09fe59064f065a2 2026-05-07 02:09:42,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:09:42,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9515cd09fe59064f065a2 HTTP/1.1" 200 None 2026-05-07 02:09:42,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:09:42,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-07 02:09:42,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:09:42,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9515cd09fe59064f065a2 HTTP/1.1" 200 None 2026-05-07 02:09:42,508 - lava_callback - ERROR - Error processing callback for node 69f9515cd09fe59064f065a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:09:59,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:09:59,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32952 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:11:02,049 - lava_callback - INFO - Received callback for node 69fbf22e474a995a18843e69 INFO: 172.21.0.1:38522 - "POST /node/69fbf22e474a995a18843e69 HTTP/1.0" 202 Accepted 2026-05-07 02:11:02,056 - lava_callback - INFO - Starting async job submit for node 69fbf22e474a995a18843e69 2026-05-07 02:11:02,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:11:02,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf22e474a995a18843e69 HTTP/1.1" 200 None 2026-05-07 02:11:02,098 - lava_callback - DEBUG - Processing node 69fbf22e474a995a18843e69: baseline-arm64 2026-05-07 02:11:02,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:11:02,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:11:02,722 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf22e474a995a18843e69/log.txt.gz 2026-05-07 02:11:03,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:11:03,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:11:03,218 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf22e474a995a18843e69/lava-logs.yaml 2026-05-07 02:11:03,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:11:03,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:11:03,354 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf22e474a995a18843e69/lava_callback.json.gz 2026-05-07 02:11:03,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:11:03,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf22e474a995a18843e69 HTTP/1.1" 200 None 2026-05-07 02:11:03,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:11:03,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:11:03,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:11:03,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf22e474a995a18843e69 HTTP/1.1" 200 None 2026-05-07 02:11:03,504 - lava_callback - INFO - Completed processing callback for node 69fbf22e474a995a18843e69 INFO: 172.21.0.1:38536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56228 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:11:29,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:11:29,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35894 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:11:42,836 - lava_callback - INFO - Received callback for node 69fbf04f474a995a18843d80 INFO: 172.21.0.1:51162 - "POST /node/69fbf04f474a995a18843d80 HTTP/1.0" 202 Accepted 2026-05-07 02:11:42,885 - lava_callback - INFO - Starting async job submit for node 69fbf04f474a995a18843d80 2026-05-07 02:11:42,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:11:42,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf04f474a995a18843d80 HTTP/1.1" 200 None 2026-05-07 02:11:42,924 - lava_callback - DEBUG - Processing node 69fbf04f474a995a18843d80: baseline-arm-pengutronix 2026-05-07 02:11:43,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:11:43,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:11:43,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbf04f474a995a18843d80/log.txt.gz 2026-05-07 02:11:43,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:11:43,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:11:43,302 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbf04f474a995a18843d80/lava-logs.yaml 2026-05-07 02:11:43,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:11:43,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:11:43,396 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbf04f474a995a18843d80/lava_callback.json.gz DEBUG: Setup failed for 69fbf04f474a995a18843d80. Transitting job node result: incomplete -> fail 2026-05-07 02:11:43,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:11:43,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf04f474a995a18843d80 HTTP/1.1" 200 None 2026-05-07 02:11:43,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:11:43,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 02:11:43,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:11:43,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf04f474a995a18843d80 HTTP/1.1" 200 None 2026-05-07 02:11:43,545 - lava_callback - INFO - Completed processing callback for node 69fbf04f474a995a18843d80 INFO: 172.21.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:11:59,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:11:59,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-07 02:12:02,515 - lava_callback - INFO - Received callback for node 69f951e6d09fe59064f065e7 INFO: 172.21.0.1:43488 - "POST /node/69f951e6d09fe59064f065e7 HTTP/1.0" 202 Accepted 2026-05-07 02:12:02,521 - lava_callback - INFO - Starting async job submit for node 69f951e6d09fe59064f065e7 2026-05-07 02:12:02,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:12:02,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f951e6d09fe59064f065e7 HTTP/1.1" 200 None 2026-05-07 02:12:02,536 - lava_callback - DEBUG - Processing node 69f951e6d09fe59064f065e7: baseline-arm64-clabbe 2026-05-07 02:12:02,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f951e6d09fe59064f065e7 2026-05-07 02:12:02,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:12:02,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f951e6d09fe59064f065e7 HTTP/1.1" 200 None 2026-05-07 02:12:02,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:12:02,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-07 02:12:02,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:12:02,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f951e6d09fe59064f065e7 HTTP/1.1" 200 None 2026-05-07 02:12:02,584 - lava_callback - ERROR - Error processing callback for node 69f951e6d09fe59064f065e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46592 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:13:42,564 - lava_callback - INFO - Received callback for node 69f9524ad09fe59064f06616 INFO: 172.21.0.1:37136 - "POST /node/69f9524ad09fe59064f06616 HTTP/1.0" 202 Accepted 2026-05-07 02:13:42,570 - lava_callback - INFO - Starting async job submit for node 69f9524ad09fe59064f06616 2026-05-07 02:13:42,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:13:42,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9524ad09fe59064f06616 HTTP/1.1" 200 None 2026-05-07 02:13:42,585 - lava_callback - DEBUG - Processing node 69f9524ad09fe59064f06616: baseline-arm64-clabbe 2026-05-07 02:13:42,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9524ad09fe59064f06616 2026-05-07 02:13:42,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:13:42,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9524ad09fe59064f06616 HTTP/1.1" 200 None 2026-05-07 02:13:42,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:13:42,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-07 02:13:42,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:13:42,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9524ad09fe59064f06616 HTTP/1.1" 200 None 2026-05-07 02:13:42,634 - lava_callback - ERROR - Error processing callback for node 69f9524ad09fe59064f06616: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:14:48,745 - lava_callback - INFO - Received callback for node 69fbf3d1474a995a18843f2b INFO: 172.21.0.1:44182 - "POST /node/69fbf3d1474a995a18843f2b HTTP/1.0" 202 Accepted 2026-05-07 02:14:48,756 - lava_callback - INFO - Starting async job submit for node 69fbf3d1474a995a18843f2b 2026-05-07 02:14:48,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:14:48,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf3d1474a995a18843f2b HTTP/1.1" 200 None 2026-05-07 02:14:48,818 - lava_callback - DEBUG - Processing node 69fbf3d1474a995a18843f2b: baseline-arm64 2026-05-07 02:14:49,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:14:49,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:14:49,395 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf3d1474a995a18843f2b/log.txt.gz 2026-05-07 02:14:49,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:14:49,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:14:49,864 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf3d1474a995a18843f2b/lava-logs.yaml 2026-05-07 02:14:49,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:14:49,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:14:49,979 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf3d1474a995a18843f2b/lava_callback.json.gz DEBUG: Setup failed for 69fbf3d1474a995a18843f2b. Transitting job node result: incomplete -> fail 2026-05-07 02:14:50,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:14:50,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf3d1474a995a18843f2b HTTP/1.1" 200 None 2026-05-07 02:14:50,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:14:50,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:14:50,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:14:50,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf3d1474a995a18843f2b HTTP/1.1" 200 None 2026-05-07 02:14:50,177 - lava_callback - INFO - Completed processing callback for node 69fbf3d1474a995a18843f2b INFO: 172.21.0.1:58776 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:14:59,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:14:59,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35526 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:15:37,309 - lava_callback - INFO - Received callback for node 69fbf33b474a995a18843eea INFO: 172.21.0.1:35540 - "POST /node/69fbf33b474a995a18843eea HTTP/1.0" 202 Accepted 2026-05-07 02:15:37,316 - lava_callback - INFO - Starting async job submit for node 69fbf33b474a995a18843eea 2026-05-07 02:15:37,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:15:37,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf33b474a995a18843eea HTTP/1.1" 200 None 2026-05-07 02:15:37,358 - lava_callback - DEBUG - Processing node 69fbf33b474a995a18843eea: baseline-nfs-arm64 2026-05-07 02:15:38,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:15:38,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:15:38,149 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf33b474a995a18843eea/log.txt.gz 2026-05-07 02:15:38,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:15:38,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:15:38,591 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf33b474a995a18843eea/lava-logs.yaml 2026-05-07 02:15:38,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:15:38,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:15:38,728 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf33b474a995a18843eea/lava_callback.json.gz 2026-05-07 02:15:38,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:15:38,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf33b474a995a18843eea HTTP/1.1" 200 None 2026-05-07 02:15:38,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:15:38,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:15:38,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:15:38,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf33b474a995a18843eea HTTP/1.1" 200 None 2026-05-07 02:15:38,866 - lava_callback - INFO - Completed processing callback for node 69fbf33b474a995a18843eea INFO: 172.21.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49194 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:15:59,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:15:59,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:17:55,646 - lava_callback - INFO - Received callback for node 69fbf275474a995a18843e8b INFO: 172.21.0.1:57918 - "POST /node/69fbf275474a995a18843e8b HTTP/1.0" 202 Accepted 2026-05-07 02:17:55,654 - lava_callback - INFO - Starting async job submit for node 69fbf275474a995a18843e8b 2026-05-07 02:17:55,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:17:55,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf275474a995a18843e8b HTTP/1.1" 200 None 2026-05-07 02:17:55,723 - lava_callback - DEBUG - Processing node 69fbf275474a995a18843e8b: baseline-arm 2026-05-07 02:17:56,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:17:56,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:17:56,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fbf275474a995a18843e8b/log.txt.gz INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:17:56,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:17:57,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:17:57,044 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fbf275474a995a18843e8b/lava-logs.yaml 2026-05-07 02:17:57,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:17:57,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:17:57,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fbf275474a995a18843e8b/lava_callback.json.gz DEBUG: Setup failed for 69fbf275474a995a18843e8b. Transitting job node result: incomplete -> fail 2026-05-07 02:17:57,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:17:57,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf275474a995a18843e8b HTTP/1.1" 200 None 2026-05-07 02:17:57,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:17:57,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 02:17:57,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:17:57,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf275474a995a18843e8b HTTP/1.1" 200 None 2026-05-07 02:17:57,494 - lava_callback - INFO - Completed processing callback for node 69fbf275474a995a18843e8b 2026-05-07 02:17:59,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:17:59,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42814 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:21:37,547 - lava_callback - INFO - Received callback for node 69fbf37d474a995a18843f06 INFO: 172.21.0.1:42820 - "POST /node/69fbf37d474a995a18843f06 HTTP/1.0" 202 Accepted 2026-05-07 02:21:37,557 - lava_callback - INFO - Starting async job submit for node 69fbf37d474a995a18843f06 2026-05-07 02:21:37,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:21:37,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf37d474a995a18843f06 HTTP/1.1" 200 None 2026-05-07 02:21:37,636 - lava_callback - DEBUG - Processing node 69fbf37d474a995a18843f06: ltp-smoke 2026-05-07 02:21:38,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:21:38,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:21:38,178 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbf37d474a995a18843f06/log.txt.gz 2026-05-07 02:21:38,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:21:38,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:21:38,548 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbf37d474a995a18843f06/lava-logs.yaml 2026-05-07 02:21:38,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:21:38,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:21:38,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fbf37d474a995a18843f06/lava_callback.json.gz 2026-05-07 02:21:38,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:21:38,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf37d474a995a18843f06 HTTP/1.1" 200 None 2026-05-07 02:21:38,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:21:38,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda05474a995a18840a0a HTTP/1.1" 200 None 2026-05-07 02:21:38,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:21:38,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf37d474a995a18843f06 HTTP/1.1" 200 None 2026-05-07 02:21:38,938 - lava_callback - INFO - Completed processing callback for node 69fbf37d474a995a18843f06 INFO: 172.21.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:21:59,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:21:59,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46232 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:23:42,887 - lava_callback - INFO - Received callback for node 69fbf4bc474a995a18843f78 INFO: 172.21.0.1:54062 - "POST /node/69fbf4bc474a995a18843f78 HTTP/1.0" 202 Accepted 2026-05-07 02:23:42,894 - lava_callback - INFO - Starting async job submit for node 69fbf4bc474a995a18843f78 2026-05-07 02:23:42,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:23:42,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf4bc474a995a18843f78 HTTP/1.1" 200 None 2026-05-07 02:23:42,933 - lava_callback - DEBUG - Processing node 69fbf4bc474a995a18843f78: baseline-arm64 2026-05-07 02:23:43,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:23:43,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:23:43,577 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf4bc474a995a18843f78/log.txt.gz 2026-05-07 02:23:43,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:23:43,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:23:44,002 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf4bc474a995a18843f78/lava-logs.yaml 2026-05-07 02:23:44,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:23:44,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:23:44,139 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbf4bc474a995a18843f78/lava_callback.json.gz 2026-05-07 02:23:44,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:23:44,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf4bc474a995a18843f78 HTTP/1.1" 200 None 2026-05-07 02:23:44,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:23:44,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:23:44,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:23:44,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf4bc474a995a18843f78 HTTP/1.1" 200 None 2026-05-07 02:23:44,307 - lava_callback - INFO - Completed processing callback for node 69fbf4bc474a995a18843f78 INFO: 172.21.0.1:54066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37444 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:23:59,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:23:59,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57982 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:28:25,270 - lava_callback - INFO - Received callback for node 69fbf41d474a995a18843f4e INFO: 172.21.0.1:34248 - "POST /node/69fbf41d474a995a18843f4e HTTP/1.0" 202 Accepted 2026-05-07 02:28:25,282 - lava_callback - INFO - Starting async job submit for node 69fbf41d474a995a18843f4e 2026-05-07 02:28:25,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:28:25,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf41d474a995a18843f4e HTTP/1.1" 200 None 2026-05-07 02:28:25,346 - lava_callback - DEBUG - Processing node 69fbf41d474a995a18843f4e: baseline-nfs-arm64 2026-05-07 02:28:26,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34256 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:28:26,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:28:26,613 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf41d474a995a18843f4e/log.txt.gz 2026-05-07 02:28:27,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:28:27,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:28:27,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf41d474a995a18843f4e/lava-logs.yaml 2026-05-07 02:28:27,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:28:27,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:28:27,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf41d474a995a18843f4e/lava_callback.json.gz DEBUG: Setup failed for 69fbf41d474a995a18843f4e. Transitting job node result: incomplete -> fail 2026-05-07 02:28:27,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:28:27,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf41d474a995a18843f4e HTTP/1.1" 200 None 2026-05-07 02:28:27,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:28:27,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:28:27,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:28:27,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf41d474a995a18843f4e HTTP/1.1" 200 None 2026-05-07 02:28:27,975 - lava_callback - INFO - Completed processing callback for node 69fbf41d474a995a18843f4e 2026-05-07 02:28:29,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:28:29,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33408 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:28:37,941 - lava_callback - INFO - Received callback for node 69fbf5d4474a995a18843fb8 INFO: 172.21.0.1:33416 - "POST /node/69fbf5d4474a995a18843fb8 HTTP/1.0" 202 Accepted 2026-05-07 02:28:37,948 - lava_callback - INFO - Starting async job submit for node 69fbf5d4474a995a18843fb8 2026-05-07 02:28:37,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:28:37,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf5d4474a995a18843fb8 HTTP/1.1" 200 None 2026-05-07 02:28:37,989 - lava_callback - DEBUG - Processing node 69fbf5d4474a995a18843fb8: baseline-nfs-arm64 2026-05-07 02:28:38,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:28:38,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:28:38,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf5d4474a995a18843fb8/log.txt.gz 2026-05-07 02:28:38,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:28:39,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:28:39,137 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf5d4474a995a18843fb8/lava-logs.yaml 2026-05-07 02:28:39,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:28:39,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:28:39,307 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf5d4474a995a18843fb8/lava_callback.json.gz 2026-05-07 02:28:39,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:28:39,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf5d4474a995a18843fb8 HTTP/1.1" 200 None 2026-05-07 02:28:39,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:28:39,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:28:39,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:28:39,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf5d4474a995a18843fb8 HTTP/1.1" 200 None 2026-05-07 02:28:39,487 - lava_callback - INFO - Completed processing callback for node 69fbf5d4474a995a18843fb8 INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49882 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:29:00,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:29:00,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET /node/693f409224745582e399fab5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44746 - "GET /node/69f48d04ec4729f146b432be%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:48:40,214 - lava_callback - INFO - Received callback for node 69fbf8d4474a995a18843fec INFO: 172.21.0.1:51916 - "POST /node/69fbf8d4474a995a18843fec HTTP/1.0" 202 Accepted 2026-05-07 02:48:40,223 - lava_callback - INFO - Starting async job submit for node 69fbf8d4474a995a18843fec 2026-05-07 02:48:40,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:48:40,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf8d4474a995a18843fec HTTP/1.1" 200 None 2026-05-07 02:48:40,281 - lava_callback - DEBUG - Processing node 69fbf8d4474a995a18843fec: baseline-nfs-arm64 2026-05-07 02:48:41,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:48:41,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:48:41,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf8d4474a995a18843fec/log.txt.gz 2026-05-07 02:48:42,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:48:42,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:48:42,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf8d4474a995a18843fec/lava-logs.yaml 2026-05-07 02:48:42,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 02:48:42,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 02:48:42,704 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbf8d4474a995a18843fec/lava_callback.json.gz DEBUG: Setup failed for 69fbf8d4474a995a18843fec. Transitting job node result: incomplete -> fail 2026-05-07 02:48:42,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:48:42,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf8d4474a995a18843fec HTTP/1.1" 200 None 2026-05-07 02:48:42,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:48:42,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-07 02:48:42,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:48:42,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf8d4474a995a18843fec HTTP/1.1" 200 None 2026-05-07 02:48:42,944 - lava_callback - INFO - Completed processing callback for node 69fbf8d4474a995a18843fec INFO: 172.21.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34670 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:49:00,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:49:00,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:58:09,647 - lava_callback - INFO - Received callback for node 69f95cbed09fe59064f06754 INFO: 172.21.0.1:34946 - "POST /node/69f95cbed09fe59064f06754 HTTP/1.0" 202 Accepted 2026-05-07 02:58:09,652 - lava_callback - INFO - Starting async job submit for node 69f95cbed09fe59064f06754 2026-05-07 02:58:09,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:58:09,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95cbed09fe59064f06754 HTTP/1.1" 200 None 2026-05-07 02:58:09,667 - lava_callback - DEBUG - Processing node 69f95cbed09fe59064f06754: baseline-arm-baylibre 2026-05-07 02:58:09,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95cbed09fe59064f06754 2026-05-07 02:58:09,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:58:09,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95cbed09fe59064f06754 HTTP/1.1" 200 None 2026-05-07 02:58:09,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:58:09,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-07 02:58:09,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:58:09,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95cbed09fe59064f06754 HTTP/1.1" 200 None 2026-05-07 02:58:09,715 - lava_callback - ERROR - Error processing callback for node 69f95cbed09fe59064f06754: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37630 - "GET / HTTP/1.0" 200 OK 2026-05-07 02:59:09,386 - lava_callback - INFO - Received callback for node 69f95cfbd09fe59064f06764 INFO: 172.21.0.1:37634 - "POST /node/69f95cfbd09fe59064f06764 HTTP/1.0" 202 Accepted 2026-05-07 02:59:09,392 - lava_callback - INFO - Starting async job submit for node 69f95cfbd09fe59064f06764 2026-05-07 02:59:09,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:59:09,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95cfbd09fe59064f06764 HTTP/1.1" 200 None 2026-05-07 02:59:09,413 - lava_callback - DEBUG - Processing node 69f95cfbd09fe59064f06764: baseline-arm-baylibre 2026-05-07 02:59:09,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95cfbd09fe59064f06764 2026-05-07 02:59:09,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:59:09,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95cfbd09fe59064f06764 HTTP/1.1" 200 None 2026-05-07 02:59:09,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:59:09,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-07 02:59:09,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 02:59:09,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95cfbd09fe59064f06764 HTTP/1.1" 200 None 2026-05-07 02:59:09,479 - lava_callback - ERROR - Error processing callback for node 69f95cfbd09fe59064f06764: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK 2026-05-07 03:00:09,490 - lava_callback - INFO - Received callback for node 69f95d26d09fe59064f06774 INFO: 172.21.0.1:50720 - "POST /node/69f95d26d09fe59064f06774 HTTP/1.0" 202 Accepted 2026-05-07 03:00:09,496 - lava_callback - INFO - Starting async job submit for node 69f95d26d09fe59064f06774 2026-05-07 03:00:09,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:00:09,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95d26d09fe59064f06774 HTTP/1.1" 200 None 2026-05-07 03:00:09,532 - lava_callback - DEBUG - Processing node 69f95d26d09fe59064f06774: baseline-arm-baylibre 2026-05-07 03:00:09,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95d26d09fe59064f06774 2026-05-07 03:00:09,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:00:09,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95d26d09fe59064f06774 HTTP/1.1" 200 None 2026-05-07 03:00:09,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:00:09,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-07 03:00:09,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:00:09,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95d26d09fe59064f06774 HTTP/1.1" 200 None 2026-05-07 03:00:09,608 - lava_callback - ERROR - Error processing callback for node 69f95d26d09fe59064f06774: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38354 - "GET / HTTP/1.0" 200 OK 2026-05-07 03:01:29,512 - lava_callback - INFO - Received callback for node 69f95d74d09fe59064f06783 INFO: 172.21.0.1:38360 - "POST /node/69f95d74d09fe59064f06783 HTTP/1.0" 202 Accepted 2026-05-07 03:01:29,517 - lava_callback - INFO - Starting async job submit for node 69f95d74d09fe59064f06783 2026-05-07 03:01:29,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:01:29,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95d74d09fe59064f06783 HTTP/1.1" 200 None 2026-05-07 03:01:29,537 - lava_callback - DEBUG - Processing node 69f95d74d09fe59064f06783: baseline-arm-baylibre 2026-05-07 03:01:29,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95d74d09fe59064f06783 2026-05-07 03:01:29,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:01:29,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95d74d09fe59064f06783 HTTP/1.1" 200 None 2026-05-07 03:01:29,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:01:29,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-07 03:01:29,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:01:29,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95d74d09fe59064f06783 HTTP/1.1" 200 None 2026-05-07 03:01:29,583 - lava_callback - ERROR - Error processing callback for node 69f95d74d09fe59064f06783: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37596 - "GET / HTTP/1.0" 200 OK 2026-05-07 03:02:29,574 - lava_callback - INFO - Received callback for node 69f95db1d09fe59064f06795 INFO: 172.21.0.1:37602 - "POST /node/69f95db1d09fe59064f06795 HTTP/1.0" 202 Accepted 2026-05-07 03:02:29,580 - lava_callback - INFO - Starting async job submit for node 69f95db1d09fe59064f06795 2026-05-07 03:02:29,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:02:29,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95db1d09fe59064f06795 HTTP/1.1" 200 None 2026-05-07 03:02:29,596 - lava_callback - DEBUG - Processing node 69f95db1d09fe59064f06795: baseline-arm-baylibre 2026-05-07 03:02:29,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95db1d09fe59064f06795 2026-05-07 03:02:29,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:02:29,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95db1d09fe59064f06795 HTTP/1.1" 200 None 2026-05-07 03:02:29,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:02:29,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-07 03:02:29,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:02:29,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95db1d09fe59064f06795 HTTP/1.1" 200 None 2026-05-07 03:02:29,652 - lava_callback - ERROR - Error processing callback for node 69f95db1d09fe59064f06795: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41738 - "GET / HTTP/1.0" 200 OK 2026-05-07 03:03:29,630 - lava_callback - INFO - Received callback for node 69f95deed09fe59064f067a6 INFO: 172.21.0.1:41742 - "POST /node/69f95deed09fe59064f067a6 HTTP/1.0" 202 Accepted 2026-05-07 03:03:29,635 - lava_callback - INFO - Starting async job submit for node 69f95deed09fe59064f067a6 2026-05-07 03:03:29,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:03:29,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95deed09fe59064f067a6 HTTP/1.1" 200 None 2026-05-07 03:03:29,651 - lava_callback - DEBUG - Processing node 69f95deed09fe59064f067a6: baseline-arm-baylibre 2026-05-07 03:03:29,651 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95deed09fe59064f067a6 2026-05-07 03:03:29,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:03:29,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95deed09fe59064f067a6 HTTP/1.1" 200 None 2026-05-07 03:03:29,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:03:29,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-07 03:03:29,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:03:29,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95deed09fe59064f067a6 HTTP/1.1" 200 None 2026-05-07 03:03:29,760 - lava_callback - ERROR - Error processing callback for node 69f95deed09fe59064f067a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34208 - "GET / HTTP/1.0" 200 OK 2026-05-07 03:05:44,576 - lava_callback - INFO - Received callback for node 69f95e83d09fe59064f067dd INFO: 172.21.0.1:55524 - "POST /node/69f95e83d09fe59064f067dd HTTP/1.0" 202 Accepted 2026-05-07 03:05:44,582 - lava_callback - INFO - Starting async job submit for node 69f95e83d09fe59064f067dd 2026-05-07 03:05:44,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:05:44,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95e83d09fe59064f067dd HTTP/1.1" 200 None 2026-05-07 03:05:44,597 - lava_callback - DEBUG - Processing node 69f95e83d09fe59064f067dd: baseline-arm-clabbe 2026-05-07 03:05:44,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95e83d09fe59064f067dd 2026-05-07 03:05:44,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:05:44,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95e83d09fe59064f067dd HTTP/1.1" 200 None 2026-05-07 03:05:44,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:05:44,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-07 03:05:44,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:05:44,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95e83d09fe59064f067dd HTTP/1.1" 200 None 2026-05-07 03:05:44,644 - lava_callback - ERROR - Error processing callback for node 69f95e83d09fe59064f067dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39732 - "GET / HTTP/1.0" 200 OK 2026-05-07 03:06:44,599 - lava_callback - INFO - Received callback for node 69f95eb0d09fe59064f067f5 INFO: 172.21.0.1:44566 - "POST /node/69f95eb0d09fe59064f067f5 HTTP/1.0" 202 Accepted 2026-05-07 03:06:44,607 - lava_callback - INFO - Starting async job submit for node 69f95eb0d09fe59064f067f5 2026-05-07 03:06:44,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:06:44,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95eb0d09fe59064f067f5 HTTP/1.1" 200 None 2026-05-07 03:06:44,624 - lava_callback - DEBUG - Processing node 69f95eb0d09fe59064f067f5: baseline-arm-clabbe 2026-05-07 03:06:44,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95eb0d09fe59064f067f5 2026-05-07 03:06:44,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:06:44,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95eb0d09fe59064f067f5 HTTP/1.1" 200 None 2026-05-07 03:06:44,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:06:44,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-07 03:06:44,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:06:44,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95eb0d09fe59064f067f5 HTTP/1.1" 200 None 2026-05-07 03:06:44,693 - lava_callback - ERROR - Error processing callback for node 69f95eb0d09fe59064f067f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK 2026-05-07 03:07:24,590 - lava_callback - INFO - Received callback for node 69f95ee1d09fe59064f06804 INFO: 172.21.0.1:39188 - "POST /node/69f95ee1d09fe59064f06804 HTTP/1.0" 202 Accepted 2026-05-07 03:07:24,599 - lava_callback - INFO - Starting async job submit for node 69f95ee1d09fe59064f06804 2026-05-07 03:07:24,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:07:24,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95ee1d09fe59064f06804 HTTP/1.1" 200 None 2026-05-07 03:07:24,621 - lava_callback - DEBUG - Processing node 69f95ee1d09fe59064f06804: baseline-arm-clabbe 2026-05-07 03:07:24,621 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95ee1d09fe59064f06804 2026-05-07 03:07:24,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:07:24,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95ee1d09fe59064f06804 HTTP/1.1" 200 None 2026-05-07 03:07:24,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:07:24,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-07 03:07:24,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:07:24,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95ee1d09fe59064f06804 HTTP/1.1" 200 None 2026-05-07 03:07:24,678 - lava_callback - ERROR - Error processing callback for node 69f95ee1d09fe59064f06804: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK 2026-05-07 03:08:04,634 - lava_callback - INFO - Received callback for node 69f95f0dd09fe59064f06817 INFO: 172.21.0.1:54072 - "POST /node/69f95f0dd09fe59064f06817 HTTP/1.0" 202 Accepted 2026-05-07 03:08:04,640 - lava_callback - INFO - Starting async job submit for node 69f95f0dd09fe59064f06817 2026-05-07 03:08:04,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:08:04,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95f0dd09fe59064f06817 HTTP/1.1" 200 None 2026-05-07 03:08:04,654 - lava_callback - DEBUG - Processing node 69f95f0dd09fe59064f06817: baseline-arm-clabbe 2026-05-07 03:08:04,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95f0dd09fe59064f06817 2026-05-07 03:08:04,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:08:04,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95f0dd09fe59064f06817 HTTP/1.1" 200 None 2026-05-07 03:08:04,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:08:04,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-07 03:08:04,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:08:04,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95f0dd09fe59064f06817 HTTP/1.1" 200 None 2026-05-07 03:08:04,700 - lava_callback - ERROR - Error processing callback for node 69f95f0dd09fe59064f06817: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK 2026-05-07 03:09:04,664 - lava_callback - INFO - Received callback for node 69f95f3bd09fe59064f06827 INFO: 172.21.0.1:48360 - "POST /node/69f95f3bd09fe59064f06827 HTTP/1.0" 202 Accepted 2026-05-07 03:09:04,670 - lava_callback - INFO - Starting async job submit for node 69f95f3bd09fe59064f06827 2026-05-07 03:09:04,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:09:04,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95f3bd09fe59064f06827 HTTP/1.1" 200 None 2026-05-07 03:09:04,687 - lava_callback - DEBUG - Processing node 69f95f3bd09fe59064f06827: baseline-arm-clabbe 2026-05-07 03:09:04,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95f3bd09fe59064f06827 2026-05-07 03:09:04,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:09:04,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95f3bd09fe59064f06827 HTTP/1.1" 200 None 2026-05-07 03:09:04,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:09:04,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-07 03:09:04,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:09:04,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95f3bd09fe59064f06827 HTTP/1.1" 200 None 2026-05-07 03:09:04,738 - lava_callback - ERROR - Error processing callback for node 69f95f3bd09fe59064f06827: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK 2026-05-07 03:09:44,644 - lava_callback - INFO - Received callback for node 69f95f69d09fe59064f0683b INFO: 172.21.0.1:53986 - "POST /node/69f95f69d09fe59064f0683b HTTP/1.0" 202 Accepted 2026-05-07 03:09:44,650 - lava_callback - INFO - Starting async job submit for node 69f95f69d09fe59064f0683b 2026-05-07 03:09:44,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:09:44,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95f69d09fe59064f0683b HTTP/1.1" 200 None 2026-05-07 03:09:44,665 - lava_callback - DEBUG - Processing node 69f95f69d09fe59064f0683b: baseline-arm-clabbe 2026-05-07 03:09:44,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f95f69d09fe59064f0683b 2026-05-07 03:09:44,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:09:44,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f95f69d09fe59064f0683b HTTP/1.1" 200 None 2026-05-07 03:09:44,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:09:44,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-07 03:09:44,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:09:44,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f95f69d09fe59064f0683b HTTP/1.1" 200 None 2026-05-07 03:09:44,714 - lava_callback - ERROR - Error processing callback for node 69f95f69d09fe59064f0683b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-07 03:09:45,456 - lava_callback - INFO - Received callback for node 69fbf512474a995a18843f9d INFO: 172.21.0.1:53992 - "POST /node/69fbf512474a995a18843f9d HTTP/1.0" 202 Accepted 2026-05-07 03:09:45,501 - lava_callback - INFO - Starting async job submit for node 69fbf512474a995a18843f9d 2026-05-07 03:09:45,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:09:45,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf512474a995a18843f9d HTTP/1.1" 200 None 2026-05-07 03:09:45,541 - lava_callback - DEBUG - Processing node 69fbf512474a995a18843f9d: baseline-arm-pengutronix 2026-05-07 03:09:45,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 03:09:45,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 03:09:45,739 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbf512474a995a18843f9d/log.txt.gz 2026-05-07 03:09:45,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 03:09:45,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 03:09:45,938 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbf512474a995a18843f9d/lava-logs.yaml 2026-05-07 03:09:45,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-07 03:09:46,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-07 03:09:46,051 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fbf512474a995a18843f9d/lava_callback.json.gz DEBUG: Setup failed for 69fbf512474a995a18843f9d. Transitting job node result: incomplete -> fail 2026-05-07 03:09:46,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:09:46,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbf512474a995a18843f9d HTTP/1.1" 200 None 2026-05-07 03:09:46,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:09:46,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-07 03:09:46,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:09:46,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbf512474a995a18843f9d HTTP/1.1" 200 None 2026-05-07 03:09:46,238 - lava_callback - INFO - Completed processing callback for node 69fbf512474a995a18843f9d INFO: 172.21.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK 2026-05-07 03:10:00,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 03:10:00,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET /node/6990adfac45febfe44522052%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET /node/69935317523507f3806a7d78%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET /node/69834fa4409235c29c0e061d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53612 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:25:34,236 - lava_callback - INFO - Received callback for node 69f97139d09fe59064f069c7 INFO: 172.21.0.1:48120 - "POST /node/69f97139d09fe59064f069c7 HTTP/1.0" 202 Accepted 2026-05-07 04:25:34,242 - lava_callback - INFO - Starting async job submit for node 69f97139d09fe59064f069c7 2026-05-07 04:25:34,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:25:34,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97139d09fe59064f069c7 HTTP/1.1" 200 None 2026-05-07 04:25:34,258 - lava_callback - DEBUG - Processing node 69f97139d09fe59064f069c7: baseline-arm64-baylibre 2026-05-07 04:25:34,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97139d09fe59064f069c7 2026-05-07 04:25:34,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:25:34,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97139d09fe59064f069c7 HTTP/1.1" 200 None 2026-05-07 04:25:34,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:25:34,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-07 04:25:34,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:25:34,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97139d09fe59064f069c7 HTTP/1.1" 200 None 2026-05-07 04:25:34,310 - lava_callback - ERROR - Error processing callback for node 69f97139d09fe59064f069c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35874 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:26:54,127 - lava_callback - INFO - Received callback for node 69f9718cd09fe59064f06a0b INFO: 172.21.0.1:51244 - "POST /node/69f9718cd09fe59064f06a0b HTTP/1.0" 202 Accepted 2026-05-07 04:26:54,133 - lava_callback - INFO - Starting async job submit for node 69f9718cd09fe59064f06a0b 2026-05-07 04:26:54,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:26:54,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9718cd09fe59064f06a0b HTTP/1.1" 200 None 2026-05-07 04:26:54,158 - lava_callback - DEBUG - Processing node 69f9718cd09fe59064f06a0b: baseline-arm64-baylibre 2026-05-07 04:26:54,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9718cd09fe59064f06a0b 2026-05-07 04:26:54,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:26:54,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9718cd09fe59064f06a0b HTTP/1.1" 200 None 2026-05-07 04:26:54,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:26:54,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-07 04:26:54,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:26:54,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9718cd09fe59064f06a0b HTTP/1.1" 200 None 2026-05-07 04:26:54,218 - lava_callback - ERROR - Error processing callback for node 69f9718cd09fe59064f06a0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60620 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:28:34,225 - lava_callback - INFO - Received callback for node 69f971e7d09fe59064f06a41 INFO: 172.21.0.1:48988 - "POST /node/69f971e7d09fe59064f06a41 HTTP/1.0" 202 Accepted 2026-05-07 04:28:34,231 - lava_callback - INFO - Starting async job submit for node 69f971e7d09fe59064f06a41 2026-05-07 04:28:34,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:28:34,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f971e7d09fe59064f06a41 HTTP/1.1" 200 None 2026-05-07 04:28:34,246 - lava_callback - DEBUG - Processing node 69f971e7d09fe59064f06a41: baseline-arm64-baylibre 2026-05-07 04:28:34,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f971e7d09fe59064f06a41 2026-05-07 04:28:34,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:28:34,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f971e7d09fe59064f06a41 HTTP/1.1" 200 None 2026-05-07 04:28:34,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:28:34,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-07 04:28:34,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:28:34,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f971e7d09fe59064f06a41 HTTP/1.1" 200 None 2026-05-07 04:28:34,293 - lava_callback - ERROR - Error processing callback for node 69f971e7d09fe59064f06a41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:29:54,331 - lava_callback - INFO - Received callback for node 69f97239d09fe59064f06a66 INFO: 172.21.0.1:40686 - "POST /node/69f97239d09fe59064f06a66 HTTP/1.0" 202 Accepted 2026-05-07 04:29:54,337 - lava_callback - INFO - Starting async job submit for node 69f97239d09fe59064f06a66 2026-05-07 04:29:54,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:29:54,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97239d09fe59064f06a66 HTTP/1.1" 200 None 2026-05-07 04:29:54,352 - lava_callback - DEBUG - Processing node 69f97239d09fe59064f06a66: baseline-arm64-baylibre 2026-05-07 04:29:54,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97239d09fe59064f06a66 2026-05-07 04:29:54,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:29:54,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97239d09fe59064f06a66 HTTP/1.1" 200 None 2026-05-07 04:29:54,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:29:54,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-07 04:29:54,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:29:54,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97239d09fe59064f06a66 HTTP/1.1" 200 None 2026-05-07 04:29:54,397 - lava_callback - ERROR - Error processing callback for node 69f97239d09fe59064f06a66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43034 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:31:34,433 - lava_callback - INFO - Received callback for node 69f9729ed09fe59064f06a95 INFO: 172.21.0.1:36528 - "POST /node/69f9729ed09fe59064f06a95 HTTP/1.0" 202 Accepted 2026-05-07 04:31:34,439 - lava_callback - INFO - Starting async job submit for node 69f9729ed09fe59064f06a95 2026-05-07 04:31:34,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:31:34,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9729ed09fe59064f06a95 HTTP/1.1" 200 None 2026-05-07 04:31:34,454 - lava_callback - DEBUG - Processing node 69f9729ed09fe59064f06a95: baseline-arm64-baylibre 2026-05-07 04:31:34,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9729ed09fe59064f06a95 2026-05-07 04:31:34,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:31:34,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9729ed09fe59064f06a95 HTTP/1.1" 200 None 2026-05-07 04:31:34,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:31:34,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-07 04:31:34,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:31:34,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9729ed09fe59064f06a95 HTTP/1.1" 200 None 2026-05-07 04:31:34,508 - lava_callback - ERROR - Error processing callback for node 69f9729ed09fe59064f06a95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:32:54,432 - lava_callback - INFO - Received callback for node 69f972f0d09fe59064f06aba INFO: 172.21.0.1:46804 - "POST /node/69f972f0d09fe59064f06aba HTTP/1.0" 202 Accepted 2026-05-07 04:32:54,440 - lava_callback - INFO - Starting async job submit for node 69f972f0d09fe59064f06aba 2026-05-07 04:32:54,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:32:54,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f972f0d09fe59064f06aba HTTP/1.1" 200 None 2026-05-07 04:32:54,456 - lava_callback - DEBUG - Processing node 69f972f0d09fe59064f06aba: baseline-arm64-baylibre 2026-05-07 04:32:54,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f972f0d09fe59064f06aba 2026-05-07 04:32:54,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:32:54,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f972f0d09fe59064f06aba HTTP/1.1" 200 None 2026-05-07 04:32:54,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:32:54,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-07 04:32:54,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:32:54,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f972f0d09fe59064f06aba HTTP/1.1" 200 None 2026-05-07 04:32:54,521 - lava_callback - ERROR - Error processing callback for node 69f972f0d09fe59064f06aba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60062 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:34:48,058 - lava_callback - INFO - Received callback for node 69f97359d09fe59064f06aea INFO: 172.21.0.1:60078 - "POST /node/69f97359d09fe59064f06aea HTTP/1.0" 202 Accepted 2026-05-07 04:34:48,064 - lava_callback - INFO - Starting async job submit for node 69f97359d09fe59064f06aea 2026-05-07 04:34:48,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:34:48,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97359d09fe59064f06aea HTTP/1.1" 200 None 2026-05-07 04:34:48,080 - lava_callback - DEBUG - Processing node 69f97359d09fe59064f06aea: baseline-arm64-clabbe 2026-05-07 04:34:48,080 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97359d09fe59064f06aea 2026-05-07 04:34:48,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:34:48,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97359d09fe59064f06aea HTTP/1.1" 200 None 2026-05-07 04:34:48,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:34:48,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-07 04:34:48,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:34:48,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97359d09fe59064f06aea HTTP/1.1" 200 None 2026-05-07 04:34:48,136 - lava_callback - ERROR - Error processing callback for node 69f97359d09fe59064f06aea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49416 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:36:28,076 - lava_callback - INFO - Received callback for node 69f973b9d09fe59064f06b2b INFO: 172.21.0.1:49428 - "POST /node/69f973b9d09fe59064f06b2b HTTP/1.0" 202 Accepted 2026-05-07 04:36:28,082 - lava_callback - INFO - Starting async job submit for node 69f973b9d09fe59064f06b2b 2026-05-07 04:36:28,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:36:28,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f973b9d09fe59064f06b2b HTTP/1.1" 200 None 2026-05-07 04:36:28,098 - lava_callback - DEBUG - Processing node 69f973b9d09fe59064f06b2b: baseline-arm64-clabbe 2026-05-07 04:36:28,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f973b9d09fe59064f06b2b 2026-05-07 04:36:28,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:36:28,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f973b9d09fe59064f06b2b HTTP/1.1" 200 None 2026-05-07 04:36:28,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:36:28,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-07 04:36:28,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:36:28,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f973b9d09fe59064f06b2b HTTP/1.1" 200 None 2026-05-07 04:36:28,144 - lava_callback - ERROR - Error processing callback for node 69f973b9d09fe59064f06b2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:37:48,175 - lava_callback - INFO - Received callback for node 69f9740ed09fe59064f06b6e INFO: 172.21.0.1:42082 - "POST /node/69f9740ed09fe59064f06b6e HTTP/1.0" 202 Accepted 2026-05-07 04:37:48,181 - lava_callback - INFO - Starting async job submit for node 69f9740ed09fe59064f06b6e 2026-05-07 04:37:48,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:37:48,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9740ed09fe59064f06b6e HTTP/1.1" 200 None 2026-05-07 04:37:48,197 - lava_callback - DEBUG - Processing node 69f9740ed09fe59064f06b6e: baseline-arm64-clabbe 2026-05-07 04:37:48,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9740ed09fe59064f06b6e 2026-05-07 04:37:48,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:37:48,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9740ed09fe59064f06b6e HTTP/1.1" 200 None 2026-05-07 04:37:48,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:37:48,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-07 04:37:48,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:37:48,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9740ed09fe59064f06b6e HTTP/1.1" 200 None 2026-05-07 04:37:48,266 - lava_callback - ERROR - Error processing callback for node 69f9740ed09fe59064f06b6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:39:08,215 - lava_callback - INFO - Received callback for node 69f97465d09fe59064f06ba1 INFO: 172.21.0.1:49586 - "POST /node/69f97465d09fe59064f06ba1 HTTP/1.0" 202 Accepted 2026-05-07 04:39:08,221 - lava_callback - INFO - Starting async job submit for node 69f97465d09fe59064f06ba1 2026-05-07 04:39:08,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:39:08,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97465d09fe59064f06ba1 HTTP/1.1" 200 None 2026-05-07 04:39:08,236 - lava_callback - DEBUG - Processing node 69f97465d09fe59064f06ba1: baseline-arm64-clabbe 2026-05-07 04:39:08,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97465d09fe59064f06ba1 2026-05-07 04:39:08,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:39:08,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97465d09fe59064f06ba1 HTTP/1.1" 200 None 2026-05-07 04:39:08,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:39:08,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-07 04:39:08,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:39:08,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97465d09fe59064f06ba1 HTTP/1.1" 200 None 2026-05-07 04:39:08,287 - lava_callback - ERROR - Error processing callback for node 69f97465d09fe59064f06ba1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54756 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:40:48,290 - lava_callback - INFO - Received callback for node 69f974c2d09fe59064f06bd1 INFO: 172.21.0.1:54764 - "POST /node/69f974c2d09fe59064f06bd1 HTTP/1.0" 202 Accepted 2026-05-07 04:40:48,296 - lava_callback - INFO - Starting async job submit for node 69f974c2d09fe59064f06bd1 2026-05-07 04:40:48,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:40:48,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f974c2d09fe59064f06bd1 HTTP/1.1" 200 None 2026-05-07 04:40:48,312 - lava_callback - DEBUG - Processing node 69f974c2d09fe59064f06bd1: baseline-arm64-clabbe 2026-05-07 04:40:48,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f974c2d09fe59064f06bd1 2026-05-07 04:40:48,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:40:48,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f974c2d09fe59064f06bd1 HTTP/1.1" 200 None 2026-05-07 04:40:48,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:40:48,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-07 04:40:48,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:40:48,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f974c2d09fe59064f06bd1 HTTP/1.1" 200 None 2026-05-07 04:40:48,361 - lava_callback - ERROR - Error processing callback for node 69f974c2d09fe59064f06bd1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:42:08,351 - lava_callback - INFO - Received callback for node 69f97513d09fe59064f06c07 INFO: 172.21.0.1:48580 - "POST /node/69f97513d09fe59064f06c07 HTTP/1.0" 202 Accepted 2026-05-07 04:42:08,357 - lava_callback - INFO - Starting async job submit for node 69f97513d09fe59064f06c07 2026-05-07 04:42:08,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:42:08,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97513d09fe59064f06c07 HTTP/1.1" 200 None 2026-05-07 04:42:08,372 - lava_callback - DEBUG - Processing node 69f97513d09fe59064f06c07: baseline-arm64-clabbe 2026-05-07 04:42:08,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97513d09fe59064f06c07 2026-05-07 04:42:08,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:42:08,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97513d09fe59064f06c07 HTTP/1.1" 200 None 2026-05-07 04:42:08,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:42:08,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-07 04:42:08,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:42:08,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97513d09fe59064f06c07 HTTP/1.1" 200 None 2026-05-07 04:42:08,436 - lava_callback - ERROR - Error processing callback for node 69f97513d09fe59064f06c07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:43:35,125 - lava_callback - INFO - Received callback for node 69f97562d09fe59064f06c28 INFO: 172.21.0.1:50778 - "POST /node/69f97562d09fe59064f06c28 HTTP/1.0" 202 Accepted 2026-05-07 04:43:35,131 - lava_callback - INFO - Starting async job submit for node 69f97562d09fe59064f06c28 2026-05-07 04:43:35,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:43:35,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97562d09fe59064f06c28 HTTP/1.1" 200 None 2026-05-07 04:43:35,152 - lava_callback - DEBUG - Processing node 69f97562d09fe59064f06c28: baseline-arm-baylibre 2026-05-07 04:43:35,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97562d09fe59064f06c28 2026-05-07 04:43:35,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:43:35,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97562d09fe59064f06c28 HTTP/1.1" 200 None 2026-05-07 04:43:35,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:43:35,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 04:43:35,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:43:35,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97562d09fe59064f06c28 HTTP/1.1" 200 None 2026-05-07 04:43:35,213 - lava_callback - ERROR - Error processing callback for node 69f97562d09fe59064f06c28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:44:35,090 - lava_callback - INFO - Received callback for node 69f9759fd09fe59064f06c3d INFO: 172.21.0.1:49986 - "POST /node/69f9759fd09fe59064f06c3d HTTP/1.0" 202 Accepted 2026-05-07 04:44:35,095 - lava_callback - INFO - Starting async job submit for node 69f9759fd09fe59064f06c3d 2026-05-07 04:44:35,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:44:35,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9759fd09fe59064f06c3d HTTP/1.1" 200 None 2026-05-07 04:44:35,110 - lava_callback - DEBUG - Processing node 69f9759fd09fe59064f06c3d: baseline-arm-baylibre 2026-05-07 04:44:35,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9759fd09fe59064f06c3d 2026-05-07 04:44:35,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:44:35,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9759fd09fe59064f06c3d HTTP/1.1" 200 None 2026-05-07 04:44:35,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:44:35,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 04:44:35,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:44:35,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9759fd09fe59064f06c3d HTTP/1.1" 200 None 2026-05-07 04:44:35,169 - lava_callback - ERROR - Error processing callback for node 69f9759fd09fe59064f06c3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-07 04:45:15,212 - lava_callback - INFO - Received callback for node 69f975c9d09fe59064f06c4e INFO: 172.21.0.1:51452 - "POST /node/69f975c9d09fe59064f06c4e HTTP/1.0" 202 Accepted 2026-05-07 04:45:15,218 - lava_callback - INFO - Starting async job submit for node 69f975c9d09fe59064f06c4e 2026-05-07 04:45:15,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:45:15,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f975c9d09fe59064f06c4e HTTP/1.1" 200 None 2026-05-07 04:45:15,240 - lava_callback - DEBUG - Processing node 69f975c9d09fe59064f06c4e: baseline-arm-baylibre 2026-05-07 04:45:15,240 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f975c9d09fe59064f06c4e 2026-05-07 04:45:15,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:45:15,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f975c9d09fe59064f06c4e HTTP/1.1" 200 None 2026-05-07 04:45:15,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:45:15,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 04:45:15,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:45:15,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f975c9d09fe59064f06c4e HTTP/1.1" 200 None 2026-05-07 04:45:15,296 - lava_callback - ERROR - Error processing callback for node 69f975c9d09fe59064f06c4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:48:28,631 - lava_callback - INFO - Received callback for node 69f97695d09fe59064f06c77 INFO: 172.21.0.1:43150 - "POST /node/69f97695d09fe59064f06c77 HTTP/1.0" 202 Accepted 2026-05-07 04:48:28,637 - lava_callback - INFO - Starting async job submit for node 69f97695d09fe59064f06c77 2026-05-07 04:48:28,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:48:28,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97695d09fe59064f06c77 HTTP/1.1" 200 None 2026-05-07 04:48:28,656 - lava_callback - DEBUG - Processing node 69f97695d09fe59064f06c77: baseline-arm-clabbe 2026-05-07 04:48:28,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97695d09fe59064f06c77 2026-05-07 04:48:28,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:48:28,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97695d09fe59064f06c77 HTTP/1.1" 200 None 2026-05-07 04:48:28,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:48:28,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 04:48:28,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:48:28,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97695d09fe59064f06c77 HTTP/1.1" 200 None 2026-05-07 04:48:28,701 - lava_callback - ERROR - Error processing callback for node 69f97695d09fe59064f06c77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:49:28,632 - lava_callback - INFO - Received callback for node 69f976d1d09fe59064f06c8a INFO: 172.21.0.1:33216 - "POST /node/69f976d1d09fe59064f06c8a HTTP/1.0" 202 Accepted 2026-05-07 04:49:28,638 - lava_callback - INFO - Starting async job submit for node 69f976d1d09fe59064f06c8a 2026-05-07 04:49:28,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:49:28,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f976d1d09fe59064f06c8a HTTP/1.1" 200 None 2026-05-07 04:49:28,653 - lava_callback - DEBUG - Processing node 69f976d1d09fe59064f06c8a: baseline-arm-clabbe 2026-05-07 04:49:28,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f976d1d09fe59064f06c8a 2026-05-07 04:49:28,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:49:28,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f976d1d09fe59064f06c8a HTTP/1.1" 200 None 2026-05-07 04:49:28,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:49:28,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 04:49:28,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:49:28,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f976d1d09fe59064f06c8a HTTP/1.1" 200 None 2026-05-07 04:49:28,700 - lava_callback - ERROR - Error processing callback for node 69f976d1d09fe59064f06c8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:50:08,698 - lava_callback - INFO - Received callback for node 69f976fcd09fe59064f06c9c INFO: 172.21.0.1:46842 - "POST /node/69f976fcd09fe59064f06c9c HTTP/1.0" 202 Accepted 2026-05-07 04:50:08,703 - lava_callback - INFO - Starting async job submit for node 69f976fcd09fe59064f06c9c 2026-05-07 04:50:08,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:50:08,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f976fcd09fe59064f06c9c HTTP/1.1" 200 None 2026-05-07 04:50:08,718 - lava_callback - DEBUG - Processing node 69f976fcd09fe59064f06c9c: baseline-arm-clabbe 2026-05-07 04:50:08,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f976fcd09fe59064f06c9c 2026-05-07 04:50:08,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:50:08,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f976fcd09fe59064f06c9c HTTP/1.1" 200 None 2026-05-07 04:50:08,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:50:08,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 04:50:08,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:50:08,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f976fcd09fe59064f06c9c HTTP/1.1" 200 None 2026-05-07 04:50:08,775 - lava_callback - ERROR - Error processing callback for node 69f976fcd09fe59064f06c9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-07 04:52:15,541 - lava_callback - INFO - Received callback for node 69f97774d09fe59064f06cd7 INFO: 172.21.0.1:40530 - "POST /node/69f97774d09fe59064f06cd7 HTTP/1.0" 202 Accepted 2026-05-07 04:52:15,546 - lava_callback - INFO - Starting async job submit for node 69f97774d09fe59064f06cd7 2026-05-07 04:52:15,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:52:15,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97774d09fe59064f06cd7 HTTP/1.1" 200 None 2026-05-07 04:52:15,562 - lava_callback - DEBUG - Processing node 69f97774d09fe59064f06cd7: baseline-arm-baylibre 2026-05-07 04:52:15,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97774d09fe59064f06cd7 2026-05-07 04:52:15,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:52:15,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97774d09fe59064f06cd7 HTTP/1.1" 200 None 2026-05-07 04:52:15,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:52:15,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-07 04:52:15,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:52:15,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97774d09fe59064f06cd7 HTTP/1.1" 200 None 2026-05-07 04:52:15,617 - lava_callback - ERROR - Error processing callback for node 69f97774d09fe59064f06cd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43156 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:53:08,749 - lava_callback - INFO - Received callback for node 69f977a4d09fe59064f06cf4 INFO: 172.21.0.1:43168 - "POST /node/69f977a4d09fe59064f06cf4 HTTP/1.0" 202 Accepted 2026-05-07 04:53:08,756 - lava_callback - INFO - Starting async job submit for node 69f977a4d09fe59064f06cf4 2026-05-07 04:53:08,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:53:08,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f977a4d09fe59064f06cf4 HTTP/1.1" 200 None 2026-05-07 04:53:08,772 - lava_callback - DEBUG - Processing node 69f977a4d09fe59064f06cf4: baseline-arm-clabbe 2026-05-07 04:53:08,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f977a4d09fe59064f06cf4 2026-05-07 04:53:08,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:53:08,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f977a4d09fe59064f06cf4 HTTP/1.1" 200 None 2026-05-07 04:53:08,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:53:08,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 04:53:08,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:53:08,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f977a4d09fe59064f06cf4 HTTP/1.1" 200 None 2026-05-07 04:53:08,829 - lava_callback - ERROR - Error processing callback for node 69f977a4d09fe59064f06cf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59554 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:54:28,831 - lava_callback - INFO - Received callback for node 69f977fbd09fe59064f06d0c INFO: 172.21.0.1:59562 - "POST /node/69f977fbd09fe59064f06d0c HTTP/1.0" 202 Accepted 2026-05-07 04:54:28,837 - lava_callback - INFO - Starting async job submit for node 69f977fbd09fe59064f06d0c 2026-05-07 04:54:28,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:54:28,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f977fbd09fe59064f06d0c HTTP/1.1" 200 None 2026-05-07 04:54:28,852 - lava_callback - DEBUG - Processing node 69f977fbd09fe59064f06d0c: baseline-arm-clabbe 2026-05-07 04:54:28,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f977fbd09fe59064f06d0c 2026-05-07 04:54:28,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:54:28,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f977fbd09fe59064f06d0c HTTP/1.1" 200 None 2026-05-07 04:54:28,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:54:28,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 04:54:28,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:54:28,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f977fbd09fe59064f06d0c HTTP/1.1" 200 None 2026-05-07 04:54:28,898 - lava_callback - ERROR - Error processing callback for node 69f977fbd09fe59064f06d0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48090 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:55:08,888 - lava_callback - INFO - Received callback for node 69f97826d09fe59064f06d1f INFO: 172.21.0.1:48096 - "POST /node/69f97826d09fe59064f06d1f HTTP/1.0" 202 Accepted 2026-05-07 04:55:08,894 - lava_callback - INFO - Starting async job submit for node 69f97826d09fe59064f06d1f 2026-05-07 04:55:08,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:55:08,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97826d09fe59064f06d1f HTTP/1.1" 200 None 2026-05-07 04:55:08,913 - lava_callback - DEBUG - Processing node 69f97826d09fe59064f06d1f: baseline-arm-clabbe 2026-05-07 04:55:08,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97826d09fe59064f06d1f 2026-05-07 04:55:08,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:55:08,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97826d09fe59064f06d1f HTTP/1.1" 200 None 2026-05-07 04:55:08,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:55:08,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 04:55:08,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:55:08,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97826d09fe59064f06d1f HTTP/1.1" 200 None 2026-05-07 04:55:08,974 - lava_callback - ERROR - Error processing callback for node 69f97826d09fe59064f06d1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59172 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:55:48,935 - lava_callback - INFO - Received callback for node 69f97851d09fe59064f06d36 INFO: 172.21.0.1:59180 - "POST /node/69f97851d09fe59064f06d36 HTTP/1.0" 202 Accepted 2026-05-07 04:55:48,940 - lava_callback - INFO - Starting async job submit for node 69f97851d09fe59064f06d36 2026-05-07 04:55:48,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:55:48,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97851d09fe59064f06d36 HTTP/1.1" 200 None 2026-05-07 04:55:48,956 - lava_callback - DEBUG - Processing node 69f97851d09fe59064f06d36: baseline-arm-clabbe 2026-05-07 04:55:48,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97851d09fe59064f06d36 2026-05-07 04:55:48,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:55:48,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97851d09fe59064f06d36 HTTP/1.1" 200 None 2026-05-07 04:55:48,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:55:48,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 04:55:48,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:55:49,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97851d09fe59064f06d36 HTTP/1.1" 200 None 2026-05-07 04:55:49,003 - lava_callback - ERROR - Error processing callback for node 69f97851d09fe59064f06d36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:58:08,947 - lava_callback - INFO - Received callback for node 69f978d2d09fe59064f06d88 INFO: 172.21.0.1:47708 - "POST /node/69f978d2d09fe59064f06d88 HTTP/1.0" 202 Accepted 2026-05-07 04:58:08,952 - lava_callback - INFO - Starting async job submit for node 69f978d2d09fe59064f06d88 2026-05-07 04:58:08,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:58:08,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f978d2d09fe59064f06d88 HTTP/1.1" 200 None 2026-05-07 04:58:08,968 - lava_callback - DEBUG - Processing node 69f978d2d09fe59064f06d88: baseline-arm-clabbe 2026-05-07 04:58:08,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f978d2d09fe59064f06d88 2026-05-07 04:58:08,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:58:08,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f978d2d09fe59064f06d88 HTTP/1.1" 200 None 2026-05-07 04:58:08,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:58:08,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-07 04:58:08,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:58:09,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f978d2d09fe59064f06d88 HTTP/1.1" 200 None 2026-05-07 04:58:09,017 - lava_callback - ERROR - Error processing callback for node 69f978d2d09fe59064f06d88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52042 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:58:48,962 - lava_callback - INFO - Received callback for node 69f978fed09fe59064f06d9c INFO: 172.21.0.1:52050 - "POST /node/69f978fed09fe59064f06d9c HTTP/1.0" 202 Accepted 2026-05-07 04:58:48,967 - lava_callback - INFO - Starting async job submit for node 69f978fed09fe59064f06d9c 2026-05-07 04:58:48,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:58:48,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f978fed09fe59064f06d9c HTTP/1.1" 200 None 2026-05-07 04:58:48,983 - lava_callback - DEBUG - Processing node 69f978fed09fe59064f06d9c: baseline-arm-clabbe 2026-05-07 04:58:48,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f978fed09fe59064f06d9c 2026-05-07 04:58:48,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:58:48,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f978fed09fe59064f06d9c HTTP/1.1" 200 None 2026-05-07 04:58:48,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:58:49,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-07 04:58:49,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:58:49,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f978fed09fe59064f06d9c HTTP/1.1" 200 None 2026-05-07 04:58:49,035 - lava_callback - ERROR - Error processing callback for node 69f978fed09fe59064f06d9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK 2026-05-07 04:59:28,993 - lava_callback - INFO - Received callback for node 69f97929d09fe59064f06db9 INFO: 172.21.0.1:32898 - "POST /node/69f97929d09fe59064f06db9 HTTP/1.0" 202 Accepted 2026-05-07 04:59:29,000 - lava_callback - INFO - Starting async job submit for node 69f97929d09fe59064f06db9 2026-05-07 04:59:29,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:59:29,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97929d09fe59064f06db9 HTTP/1.1" 200 None 2026-05-07 04:59:29,019 - lava_callback - DEBUG - Processing node 69f97929d09fe59064f06db9: baseline-arm-clabbe 2026-05-07 04:59:29,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97929d09fe59064f06db9 2026-05-07 04:59:29,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:59:29,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97929d09fe59064f06db9 HTTP/1.1" 200 None 2026-05-07 04:59:29,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:59:29,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-07 04:59:29,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 04:59:29,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97929d09fe59064f06db9 HTTP/1.1" 200 None 2026-05-07 04:59:29,089 - lava_callback - ERROR - Error processing callback for node 69f97929d09fe59064f06db9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:00:09,270 - lava_callback - INFO - Received callback for node 69f97954d09fe59064f06dca INFO: 172.21.0.1:46668 - "POST /node/69f97954d09fe59064f06dca HTTP/1.0" 202 Accepted 2026-05-07 05:00:09,277 - lava_callback - INFO - Starting async job submit for node 69f97954d09fe59064f06dca 2026-05-07 05:00:09,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:00:09,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97954d09fe59064f06dca HTTP/1.1" 200 None 2026-05-07 05:00:09,292 - lava_callback - DEBUG - Processing node 69f97954d09fe59064f06dca: baseline-arm-clabbe 2026-05-07 05:00:09,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97954d09fe59064f06dca 2026-05-07 05:00:09,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:00:09,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97954d09fe59064f06dca HTTP/1.1" 200 None 2026-05-07 05:00:09,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:00:09,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-07 05:00:09,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:00:09,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97954d09fe59064f06dca HTTP/1.1" 200 None 2026-05-07 05:00:09,363 - lava_callback - ERROR - Error processing callback for node 69f97954d09fe59064f06dca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45972 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34244 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:01:09,115 - lava_callback - INFO - Received callback for node 69f97981d09fe59064f06de5 INFO: 172.21.0.1:34250 - "POST /node/69f97981d09fe59064f06de5 HTTP/1.0" 202 Accepted 2026-05-07 05:01:09,122 - lava_callback - INFO - Starting async job submit for node 69f97981d09fe59064f06de5 2026-05-07 05:01:09,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:01:09,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97981d09fe59064f06de5 HTTP/1.1" 200 None 2026-05-07 05:01:09,139 - lava_callback - DEBUG - Processing node 69f97981d09fe59064f06de5: baseline-arm-clabbe 2026-05-07 05:01:09,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97981d09fe59064f06de5 2026-05-07 05:01:09,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:01:09,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97981d09fe59064f06de5 HTTP/1.1" 200 None 2026-05-07 05:01:09,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:01:09,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-07 05:01:09,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:01:09,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97981d09fe59064f06de5 HTTP/1.1" 200 None 2026-05-07 05:01:09,196 - lava_callback - ERROR - Error processing callback for node 69f97981d09fe59064f06de5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:01:49,102 - lava_callback - INFO - Received callback for node 69f979acd09fe59064f06dfc INFO: 172.21.0.1:57188 - "POST /node/69f979acd09fe59064f06dfc HTTP/1.0" 202 Accepted 2026-05-07 05:01:49,108 - lava_callback - INFO - Starting async job submit for node 69f979acd09fe59064f06dfc 2026-05-07 05:01:49,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:01:49,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f979acd09fe59064f06dfc HTTP/1.1" 200 None 2026-05-07 05:01:49,124 - lava_callback - DEBUG - Processing node 69f979acd09fe59064f06dfc: baseline-arm-clabbe 2026-05-07 05:01:49,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f979acd09fe59064f06dfc 2026-05-07 05:01:49,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:01:49,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f979acd09fe59064f06dfc HTTP/1.1" 200 None 2026-05-07 05:01:49,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:01:49,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-07 05:01:49,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:01:49,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f979acd09fe59064f06dfc HTTP/1.1" 200 None 2026-05-07 05:01:49,168 - lava_callback - ERROR - Error processing callback for node 69f979acd09fe59064f06dfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:02:29,173 - lava_callback - INFO - Received callback for node 69f979d7d09fe59064f06e0f INFO: 172.21.0.1:48846 - "POST /node/69f979d7d09fe59064f06e0f HTTP/1.0" 202 Accepted 2026-05-07 05:02:29,179 - lava_callback - INFO - Starting async job submit for node 69f979d7d09fe59064f06e0f 2026-05-07 05:02:29,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:02:29,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f979d7d09fe59064f06e0f HTTP/1.1" 200 None 2026-05-07 05:02:29,193 - lava_callback - DEBUG - Processing node 69f979d7d09fe59064f06e0f: baseline-arm-clabbe 2026-05-07 05:02:29,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f979d7d09fe59064f06e0f 2026-05-07 05:02:29,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:02:29,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f979d7d09fe59064f06e0f HTTP/1.1" 200 None 2026-05-07 05:02:29,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:02:29,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 05:02:29,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:02:29,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f979d7d09fe59064f06e0f HTTP/1.1" 200 None 2026-05-07 05:02:29,286 - lava_callback - ERROR - Error processing callback for node 69f979d7d09fe59064f06e0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48296 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:03:09,152 - lava_callback - INFO - Received callback for node 69f97a03d09fe59064f06e2a INFO: 172.21.0.1:48304 - "POST /node/69f97a03d09fe59064f06e2a HTTP/1.0" 202 Accepted 2026-05-07 05:03:09,158 - lava_callback - INFO - Starting async job submit for node 69f97a03d09fe59064f06e2a 2026-05-07 05:03:09,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:03:09,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97a03d09fe59064f06e2a HTTP/1.1" 200 None 2026-05-07 05:03:09,173 - lava_callback - DEBUG - Processing node 69f97a03d09fe59064f06e2a: baseline-arm-clabbe 2026-05-07 05:03:09,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97a03d09fe59064f06e2a 2026-05-07 05:03:09,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:03:09,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97a03d09fe59064f06e2a HTTP/1.1" 200 None 2026-05-07 05:03:09,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:03:09,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 05:03:09,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:03:09,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97a03d09fe59064f06e2a HTTP/1.1" 200 None 2026-05-07 05:03:09,223 - lava_callback - ERROR - Error processing callback for node 69f97a03d09fe59064f06e2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:03:49,249 - lava_callback - INFO - Received callback for node 69f97a2ed09fe59064f06e3f INFO: 172.21.0.1:32922 - "POST /node/69f97a2ed09fe59064f06e3f HTTP/1.0" 202 Accepted 2026-05-07 05:03:49,254 - lava_callback - INFO - Starting async job submit for node 69f97a2ed09fe59064f06e3f 2026-05-07 05:03:49,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:03:49,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97a2ed09fe59064f06e3f HTTP/1.1" 200 None 2026-05-07 05:03:49,271 - lava_callback - DEBUG - Processing node 69f97a2ed09fe59064f06e3f: baseline-arm-clabbe 2026-05-07 05:03:49,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97a2ed09fe59064f06e3f 2026-05-07 05:03:49,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:03:49,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97a2ed09fe59064f06e3f HTTP/1.1" 200 None 2026-05-07 05:03:49,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:03:49,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 05:03:49,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:03:49,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97a2ed09fe59064f06e3f HTTP/1.1" 200 None 2026-05-07 05:03:49,320 - lava_callback - ERROR - Error processing callback for node 69f97a2ed09fe59064f06e3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:04:29,219 - lava_callback - INFO - Received callback for node 69f97a5bd09fe59064f06e5d INFO: 172.21.0.1:59204 - "POST /node/69f97a5bd09fe59064f06e5d HTTP/1.0" 202 Accepted 2026-05-07 05:04:29,225 - lava_callback - INFO - Starting async job submit for node 69f97a5bd09fe59064f06e5d 2026-05-07 05:04:29,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:04:29,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97a5bd09fe59064f06e5d HTTP/1.1" 200 None 2026-05-07 05:04:29,240 - lava_callback - DEBUG - Processing node 69f97a5bd09fe59064f06e5d: baseline-arm-clabbe 2026-05-07 05:04:29,240 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97a5bd09fe59064f06e5d 2026-05-07 05:04:29,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:04:29,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97a5bd09fe59064f06e5d HTTP/1.1" 200 None 2026-05-07 05:04:29,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:04:29,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 05:04:29,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:04:29,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97a5bd09fe59064f06e5d HTTP/1.1" 200 None 2026-05-07 05:04:29,288 - lava_callback - ERROR - Error processing callback for node 69f97a5bd09fe59064f06e5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:05:29,306 - lava_callback - INFO - Received callback for node 69f97a86d09fe59064f06e6b INFO: 172.21.0.1:44528 - "POST /node/69f97a86d09fe59064f06e6b HTTP/1.0" 202 Accepted 2026-05-07 05:05:29,311 - lava_callback - INFO - Starting async job submit for node 69f97a86d09fe59064f06e6b 2026-05-07 05:05:29,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:05:29,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97a86d09fe59064f06e6b HTTP/1.1" 200 None 2026-05-07 05:05:29,327 - lava_callback - DEBUG - Processing node 69f97a86d09fe59064f06e6b: baseline-arm-clabbe 2026-05-07 05:05:29,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97a86d09fe59064f06e6b 2026-05-07 05:05:29,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:05:29,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97a86d09fe59064f06e6b HTTP/1.1" 200 None 2026-05-07 05:05:29,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:05:29,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 05:05:29,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:05:29,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97a86d09fe59064f06e6b HTTP/1.1" 200 None 2026-05-07 05:05:29,376 - lava_callback - ERROR - Error processing callback for node 69f97a86d09fe59064f06e6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33910 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:06:09,271 - lava_callback - INFO - Received callback for node 69f97ab5d09fe59064f06e84 INFO: 172.21.0.1:33924 - "POST /node/69f97ab5d09fe59064f06e84 HTTP/1.0" 202 Accepted 2026-05-07 05:06:09,276 - lava_callback - INFO - Starting async job submit for node 69f97ab5d09fe59064f06e84 2026-05-07 05:06:09,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:06:09,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97ab5d09fe59064f06e84 HTTP/1.1" 200 None 2026-05-07 05:06:09,292 - lava_callback - DEBUG - Processing node 69f97ab5d09fe59064f06e84: baseline-arm-clabbe 2026-05-07 05:06:09,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97ab5d09fe59064f06e84 2026-05-07 05:06:09,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:06:09,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97ab5d09fe59064f06e84 HTTP/1.1" 200 None 2026-05-07 05:06:09,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:06:09,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 05:06:09,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:06:09,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97ab5d09fe59064f06e84 HTTP/1.1" 200 None 2026-05-07 05:06:09,344 - lava_callback - ERROR - Error processing callback for node 69f97ab5d09fe59064f06e84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:07:49,371 - lava_callback - INFO - Received callback for node 69f97b1ed09fe59064f06e9a INFO: 172.21.0.1:42568 - "POST /node/69f97b1ed09fe59064f06e9a HTTP/1.0" 202 Accepted 2026-05-07 05:07:49,380 - lava_callback - INFO - Starting async job submit for node 69f97b1ed09fe59064f06e9a 2026-05-07 05:07:49,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:07:49,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97b1ed09fe59064f06e9a HTTP/1.1" 200 None 2026-05-07 05:07:49,398 - lava_callback - DEBUG - Processing node 69f97b1ed09fe59064f06e9a: baseline-arm-clabbe 2026-05-07 05:07:49,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97b1ed09fe59064f06e9a 2026-05-07 05:07:49,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:07:49,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97b1ed09fe59064f06e9a HTTP/1.1" 200 None 2026-05-07 05:07:49,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:07:49,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 05:07:49,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:07:49,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97b1ed09fe59064f06e9a HTTP/1.1" 200 None 2026-05-07 05:07:49,462 - lava_callback - ERROR - Error processing callback for node 69f97b1ed09fe59064f06e9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:08:29,372 - lava_callback - INFO - Received callback for node 69f97b4ad09fe59064f06ebc INFO: 172.21.0.1:42462 - "POST /node/69f97b4ad09fe59064f06ebc HTTP/1.0" 202 Accepted 2026-05-07 05:08:29,377 - lava_callback - INFO - Starting async job submit for node 69f97b4ad09fe59064f06ebc 2026-05-07 05:08:29,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:08:29,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97b4ad09fe59064f06ebc HTTP/1.1" 200 None 2026-05-07 05:08:29,393 - lava_callback - DEBUG - Processing node 69f97b4ad09fe59064f06ebc: baseline-arm-clabbe 2026-05-07 05:08:29,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97b4ad09fe59064f06ebc 2026-05-07 05:08:29,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:08:29,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97b4ad09fe59064f06ebc HTTP/1.1" 200 None 2026-05-07 05:08:29,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:08:29,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-07 05:08:29,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:08:29,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97b4ad09fe59064f06ebc HTTP/1.1" 200 None 2026-05-07 05:08:29,450 - lava_callback - ERROR - Error processing callback for node 69f97b4ad09fe59064f06ebc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:09:16,679 - lava_callback - INFO - Received callback for node 69f97b79d09fe59064f06ec8 INFO: 172.21.0.1:59158 - "POST /node/69f97b79d09fe59064f06ec8 HTTP/1.0" 202 Accepted 2026-05-07 05:09:16,685 - lava_callback - INFO - Starting async job submit for node 69f97b79d09fe59064f06ec8 2026-05-07 05:09:16,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:09:16,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97b79d09fe59064f06ec8 HTTP/1.1" 200 None 2026-05-07 05:09:16,700 - lava_callback - DEBUG - Processing node 69f97b79d09fe59064f06ec8: baseline-arm64-baylibre 2026-05-07 05:09:16,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97b79d09fe59064f06ec8 2026-05-07 05:09:16,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:09:16,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97b79d09fe59064f06ec8 HTTP/1.1" 200 None 2026-05-07 05:09:16,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:09:16,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:09:16,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:09:16,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97b79d09fe59064f06ec8 HTTP/1.1" 200 None 2026-05-07 05:09:16,752 - lava_callback - ERROR - Error processing callback for node 69f97b79d09fe59064f06ec8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:10:36,498 - lava_callback - INFO - Received callback for node 69f97bc9d09fe59064f06f1a INFO: 172.21.0.1:51174 - "POST /node/69f97bc9d09fe59064f06f1a HTTP/1.0" 202 Accepted 2026-05-07 05:10:36,504 - lava_callback - INFO - Starting async job submit for node 69f97bc9d09fe59064f06f1a 2026-05-07 05:10:36,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:10:36,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97bc9d09fe59064f06f1a HTTP/1.1" 200 None 2026-05-07 05:10:36,520 - lava_callback - DEBUG - Processing node 69f97bc9d09fe59064f06f1a: baseline-arm64-baylibre 2026-05-07 05:10:36,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97bc9d09fe59064f06f1a 2026-05-07 05:10:36,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:10:36,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97bc9d09fe59064f06f1a HTTP/1.1" 200 None 2026-05-07 05:10:36,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:10:36,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:10:36,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:10:36,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97bc9d09fe59064f06f1a HTTP/1.1" 200 None 2026-05-07 05:10:36,565 - lava_callback - ERROR - Error processing callback for node 69f97bc9d09fe59064f06f1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:12:16,603 - lava_callback - INFO - Received callback for node 69f97c1fd09fe59064f06f4b INFO: 172.21.0.1:35628 - "POST /node/69f97c1fd09fe59064f06f4b HTTP/1.0" 202 Accepted 2026-05-07 05:12:16,609 - lava_callback - INFO - Starting async job submit for node 69f97c1fd09fe59064f06f4b 2026-05-07 05:12:16,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:12:16,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97c1fd09fe59064f06f4b HTTP/1.1" 200 None 2026-05-07 05:12:16,624 - lava_callback - DEBUG - Processing node 69f97c1fd09fe59064f06f4b: baseline-arm64-baylibre 2026-05-07 05:12:16,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97c1fd09fe59064f06f4b 2026-05-07 05:12:16,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:12:16,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97c1fd09fe59064f06f4b HTTP/1.1" 200 None 2026-05-07 05:12:16,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:12:16,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:12:16,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:12:16,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97c1fd09fe59064f06f4b HTTP/1.1" 200 None 2026-05-07 05:12:16,672 - lava_callback - ERROR - Error processing callback for node 69f97c1fd09fe59064f06f4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55548 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:13:36,849 - lava_callback - INFO - Received callback for node 69f97c71d09fe59064f06f7a INFO: 172.21.0.1:55552 - "POST /node/69f97c71d09fe59064f06f7a HTTP/1.0" 202 Accepted 2026-05-07 05:13:36,855 - lava_callback - INFO - Starting async job submit for node 69f97c71d09fe59064f06f7a 2026-05-07 05:13:36,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:13:36,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97c71d09fe59064f06f7a HTTP/1.1" 200 None 2026-05-07 05:13:36,874 - lava_callback - DEBUG - Processing node 69f97c71d09fe59064f06f7a: baseline-arm64-baylibre 2026-05-07 05:13:36,874 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97c71d09fe59064f06f7a 2026-05-07 05:13:36,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:13:36,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97c71d09fe59064f06f7a HTTP/1.1" 200 None 2026-05-07 05:13:36,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:13:36,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:13:36,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:13:36,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97c71d09fe59064f06f7a HTTP/1.1" 200 None 2026-05-07 05:13:36,936 - lava_callback - ERROR - Error processing callback for node 69f97c71d09fe59064f06f7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:15:16,954 - lava_callback - INFO - Received callback for node 69f97cd9d09fe59064f06fa2 INFO: 172.21.0.1:46832 - "POST /node/69f97cd9d09fe59064f06fa2 HTTP/1.0" 202 Accepted 2026-05-07 05:15:16,960 - lava_callback - INFO - Starting async job submit for node 69f97cd9d09fe59064f06fa2 2026-05-07 05:15:16,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:15:16,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97cd9d09fe59064f06fa2 HTTP/1.1" 200 None 2026-05-07 05:15:16,975 - lava_callback - DEBUG - Processing node 69f97cd9d09fe59064f06fa2: baseline-arm64-baylibre 2026-05-07 05:15:16,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97cd9d09fe59064f06fa2 2026-05-07 05:15:16,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:15:16,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97cd9d09fe59064f06fa2 HTTP/1.1" 200 None 2026-05-07 05:15:16,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:15:17,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:15:17,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:15:17,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97cd9d09fe59064f06fa2 HTTP/1.1" 200 None 2026-05-07 05:15:17,025 - lava_callback - ERROR - Error processing callback for node 69f97cd9d09fe59064f06fa2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43296 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:16:49,755 - lava_callback - INFO - Received callback for node 69f97d36d09fe59064f06fc6 INFO: 172.21.0.1:51788 - "POST /node/69f97d36d09fe59064f06fc6 HTTP/1.0" 202 Accepted 2026-05-07 05:16:49,765 - lava_callback - INFO - Starting async job submit for node 69f97d36d09fe59064f06fc6 2026-05-07 05:16:49,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:16:49,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97d36d09fe59064f06fc6 HTTP/1.1" 200 None 2026-05-07 05:16:49,781 - lava_callback - DEBUG - Processing node 69f97d36d09fe59064f06fc6: baseline-arm64-clabbe 2026-05-07 05:16:49,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97d36d09fe59064f06fc6 2026-05-07 05:16:49,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:16:49,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97d36d09fe59064f06fc6 HTTP/1.1" 200 None 2026-05-07 05:16:49,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:16:49,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:16:49,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:16:49,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97d36d09fe59064f06fc6 HTTP/1.1" 200 None 2026-05-07 05:16:49,831 - lava_callback - ERROR - Error processing callback for node 69f97d36d09fe59064f06fc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:17:56,885 - lava_callback - INFO - Received callback for node 69f97d81d09fe59064f06ff6 INFO: 172.21.0.1:38950 - "POST /node/69f97d81d09fe59064f06ff6 HTTP/1.0" 202 Accepted 2026-05-07 05:17:56,891 - lava_callback - INFO - Starting async job submit for node 69f97d81d09fe59064f06ff6 2026-05-07 05:17:56,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:17:56,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97d81d09fe59064f06ff6 HTTP/1.1" 200 None 2026-05-07 05:17:56,921 - lava_callback - DEBUG - Processing node 69f97d81d09fe59064f06ff6: baseline-arm64-baylibre 2026-05-07 05:17:56,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97d81d09fe59064f06ff6 2026-05-07 05:17:56,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:17:56,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97d81d09fe59064f06ff6 HTTP/1.1" 200 None 2026-05-07 05:17:56,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:17:56,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:17:56,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:17:56,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97d81d09fe59064f06ff6 HTTP/1.1" 200 None 2026-05-07 05:17:56,989 - lava_callback - ERROR - Error processing callback for node 69f97d81d09fe59064f06ff6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:19:29,856 - lava_callback - INFO - Received callback for node 69f97dd9d09fe59064f07036 INFO: 172.21.0.1:53206 - "POST /node/69f97dd9d09fe59064f07036 HTTP/1.0" 202 Accepted 2026-05-07 05:19:29,862 - lava_callback - INFO - Starting async job submit for node 69f97dd9d09fe59064f07036 2026-05-07 05:19:29,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:19:29,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97dd9d09fe59064f07036 HTTP/1.1" 200 None 2026-05-07 05:19:29,877 - lava_callback - DEBUG - Processing node 69f97dd9d09fe59064f07036: baseline-arm64-clabbe 2026-05-07 05:19:29,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97dd9d09fe59064f07036 2026-05-07 05:19:29,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:19:29,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97dd9d09fe59064f07036 HTTP/1.1" 200 None 2026-05-07 05:19:29,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:19:29,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:19:29,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:19:29,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97dd9d09fe59064f07036 HTTP/1.1" 200 None 2026-05-07 05:19:29,924 - lava_callback - ERROR - Error processing callback for node 69f97dd9d09fe59064f07036: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:22:30,040 - lava_callback - INFO - Received callback for node 69f97e86d09fe59064f07089 INFO: 172.21.0.1:48278 - "POST /node/69f97e86d09fe59064f07089 HTTP/1.0" 202 Accepted 2026-05-07 05:22:30,046 - lava_callback - INFO - Starting async job submit for node 69f97e86d09fe59064f07089 2026-05-07 05:22:30,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:22:30,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97e86d09fe59064f07089 HTTP/1.1" 200 None 2026-05-07 05:22:30,061 - lava_callback - DEBUG - Processing node 69f97e86d09fe59064f07089: baseline-arm64-clabbe 2026-05-07 05:22:30,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97e86d09fe59064f07089 2026-05-07 05:22:30,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:22:30,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97e86d09fe59064f07089 HTTP/1.1" 200 None 2026-05-07 05:22:30,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:22:30,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:22:30,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:22:30,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97e86d09fe59064f07089 HTTP/1.1" 200 None 2026-05-07 05:22:30,117 - lava_callback - ERROR - Error processing callback for node 69f97e86d09fe59064f07089: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35302 - "GET /node/695d54262317100ab3f1f879%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47490 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:23:50,089 - lava_callback - INFO - Received callback for node 69f97edad09fe59064f070b3 INFO: 172.21.0.1:52666 - "POST /node/69f97edad09fe59064f070b3 HTTP/1.0" 202 Accepted 2026-05-07 05:23:50,095 - lava_callback - INFO - Starting async job submit for node 69f97edad09fe59064f070b3 2026-05-07 05:23:50,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:23:50,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97edad09fe59064f070b3 HTTP/1.1" 200 None 2026-05-07 05:23:50,110 - lava_callback - DEBUG - Processing node 69f97edad09fe59064f070b3: baseline-arm64-clabbe 2026-05-07 05:23:50,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97edad09fe59064f070b3 2026-05-07 05:23:50,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:23:50,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97edad09fe59064f070b3 HTTP/1.1" 200 None 2026-05-07 05:23:50,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:23:50,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:23:50,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:23:50,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97edad09fe59064f070b3 HTTP/1.1" 200 None 2026-05-07 05:23:50,164 - lava_callback - ERROR - Error processing callback for node 69f97edad09fe59064f070b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:25:17,326 - lava_callback - INFO - Received callback for node 69f97f29d09fe59064f070dc INFO: 172.21.0.1:56048 - "POST /node/69f97f29d09fe59064f070dc HTTP/1.0" 202 Accepted 2026-05-07 05:25:17,332 - lava_callback - INFO - Starting async job submit for node 69f97f29d09fe59064f070dc 2026-05-07 05:25:17,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:25:17,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97f29d09fe59064f070dc HTTP/1.1" 200 None 2026-05-07 05:25:17,346 - lava_callback - DEBUG - Processing node 69f97f29d09fe59064f070dc: baseline-arm64-baylibre 2026-05-07 05:25:17,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97f29d09fe59064f070dc 2026-05-07 05:25:17,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:25:17,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97f29d09fe59064f070dc HTTP/1.1" 200 None 2026-05-07 05:25:17,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:25:17,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:25:17,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:25:17,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97f29d09fe59064f070dc HTTP/1.1" 200 None 2026-05-07 05:25:17,399 - lava_callback - ERROR - Error processing callback for node 69f97f29d09fe59064f070dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53686 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:26:50,187 - lava_callback - INFO - Received callback for node 69f97f89d09fe59064f07110 INFO: 172.21.0.1:55428 - "POST /node/69f97f89d09fe59064f07110 HTTP/1.0" 202 Accepted 2026-05-07 05:26:50,193 - lava_callback - INFO - Starting async job submit for node 69f97f89d09fe59064f07110 2026-05-07 05:26:50,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:26:50,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97f89d09fe59064f07110 HTTP/1.1" 200 None 2026-05-07 05:26:50,229 - lava_callback - DEBUG - Processing node 69f97f89d09fe59064f07110: baseline-arm64-clabbe 2026-05-07 05:26:50,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f97f89d09fe59064f07110 2026-05-07 05:26:50,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:26:50,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f97f89d09fe59064f07110 HTTP/1.1" 200 None 2026-05-07 05:26:50,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:26:50,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:26:50,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:26:50,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f97f89d09fe59064f07110 HTTP/1.1" 200 None 2026-05-07 05:26:50,345 - lava_callback - ERROR - Error processing callback for node 69f97f89d09fe59064f07110: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34240 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:29:30,305 - lava_callback - INFO - Received callback for node 69f98024d09fe59064f0717c INFO: 172.21.0.1:34152 - "POST /node/69f98024d09fe59064f0717c HTTP/1.0" 202 Accepted 2026-05-07 05:29:30,311 - lava_callback - INFO - Starting async job submit for node 69f98024d09fe59064f0717c 2026-05-07 05:29:30,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:29:30,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f98024d09fe59064f0717c HTTP/1.1" 200 None 2026-05-07 05:29:30,326 - lava_callback - DEBUG - Processing node 69f98024d09fe59064f0717c: baseline-arm64-clabbe 2026-05-07 05:29:30,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f98024d09fe59064f0717c 2026-05-07 05:29:30,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:29:30,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f98024d09fe59064f0717c HTTP/1.1" 200 None 2026-05-07 05:29:30,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:29:30,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:29:30,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:29:30,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f98024d09fe59064f0717c HTTP/1.1" 200 None 2026-05-07 05:29:30,376 - lava_callback - ERROR - Error processing callback for node 69f98024d09fe59064f0717c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:30:37,618 - lava_callback - INFO - Received callback for node 69f98071d09fe59064f071a9 INFO: 172.21.0.1:38148 - "POST /node/69f98071d09fe59064f071a9 HTTP/1.0" 202 Accepted 2026-05-07 05:30:37,624 - lava_callback - INFO - Starting async job submit for node 69f98071d09fe59064f071a9 2026-05-07 05:30:37,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:30:37,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f98071d09fe59064f071a9 HTTP/1.1" 200 None 2026-05-07 05:30:37,639 - lava_callback - DEBUG - Processing node 69f98071d09fe59064f071a9: baseline-arm64-baylibre 2026-05-07 05:30:37,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f98071d09fe59064f071a9 2026-05-07 05:30:37,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:30:37,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f98071d09fe59064f071a9 HTTP/1.1" 200 None 2026-05-07 05:30:37,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:30:37,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:30:37,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:30:37,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f98071d09fe59064f071a9 HTTP/1.1" 200 None 2026-05-07 05:30:37,690 - lava_callback - ERROR - Error processing callback for node 69f98071d09fe59064f071a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:32:10,499 - lava_callback - INFO - Received callback for node 69f980cdd09fe59064f071d2 INFO: 172.21.0.1:50570 - "POST /node/69f980cdd09fe59064f071d2 HTTP/1.0" 202 Accepted 2026-05-07 05:32:10,504 - lava_callback - INFO - Starting async job submit for node 69f980cdd09fe59064f071d2 2026-05-07 05:32:10,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:32:10,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f980cdd09fe59064f071d2 HTTP/1.1" 200 None 2026-05-07 05:32:10,540 - lava_callback - DEBUG - Processing node 69f980cdd09fe59064f071d2: baseline-arm64-clabbe 2026-05-07 05:32:10,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f980cdd09fe59064f071d2 2026-05-07 05:32:10,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:32:10,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f980cdd09fe59064f071d2 HTTP/1.1" 200 None 2026-05-07 05:32:10,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:32:10,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:32:10,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:32:10,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f980cdd09fe59064f071d2 HTTP/1.1" 200 None 2026-05-07 05:32:10,584 - lava_callback - ERROR - Error processing callback for node 69f980cdd09fe59064f071d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35480 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:44:18,323 - lava_callback - INFO - Received callback for node 69f983a2d09fe59064f07331 INFO: 172.21.0.1:35494 - "POST /node/69f983a2d09fe59064f07331 HTTP/1.0" 202 Accepted 2026-05-07 05:44:18,331 - lava_callback - INFO - Starting async job submit for node 69f983a2d09fe59064f07331 2026-05-07 05:44:18,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:44:18,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f983a2d09fe59064f07331 HTTP/1.1" 200 None 2026-05-07 05:44:18,347 - lava_callback - DEBUG - Processing node 69f983a2d09fe59064f07331: baseline-arm64-baylibre 2026-05-07 05:44:18,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f983a2d09fe59064f07331 2026-05-07 05:44:18,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:44:18,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f983a2d09fe59064f07331 HTTP/1.1" 200 None 2026-05-07 05:44:18,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:44:18,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-07 05:44:18,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:44:18,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f983a2d09fe59064f07331 HTTP/1.1" 200 None 2026-05-07 05:44:18,417 - lava_callback - ERROR - Error processing callback for node 69f983a2d09fe59064f07331: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:48:31,413 - lava_callback - INFO - Received callback for node 69f984a1d09fe59064f073a8 INFO: 172.21.0.1:37298 - "POST /node/69f984a1d09fe59064f073a8 HTTP/1.0" 202 Accepted 2026-05-07 05:48:31,419 - lava_callback - INFO - Starting async job submit for node 69f984a1d09fe59064f073a8 2026-05-07 05:48:31,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:48:31,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f984a1d09fe59064f073a8 HTTP/1.1" 200 None 2026-05-07 05:48:31,434 - lava_callback - DEBUG - Processing node 69f984a1d09fe59064f073a8: baseline-arm64-clabbe 2026-05-07 05:48:31,434 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f984a1d09fe59064f073a8 2026-05-07 05:48:31,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:48:31,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f984a1d09fe59064f073a8 HTTP/1.1" 200 None 2026-05-07 05:48:31,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:48:31,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-07 05:48:31,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:48:31,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f984a1d09fe59064f073a8 HTTP/1.1" 200 None 2026-05-07 05:48:31,481 - lava_callback - ERROR - Error processing callback for node 69f984a1d09fe59064f073a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:49:51,186 - lava_callback - INFO - Received callback for node 69f984f6d09fe59064f073d1 INFO: 172.21.0.1:36474 - "POST /node/69f984f6d09fe59064f073d1 HTTP/1.0" 202 Accepted 2026-05-07 05:49:51,195 - lava_callback - INFO - Starting async job submit for node 69f984f6d09fe59064f073d1 2026-05-07 05:49:51,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:49:51,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f984f6d09fe59064f073d1 HTTP/1.1" 200 None 2026-05-07 05:49:51,211 - lava_callback - DEBUG - Processing node 69f984f6d09fe59064f073d1: baseline-arm64-clabbe 2026-05-07 05:49:51,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f984f6d09fe59064f073d1 2026-05-07 05:49:51,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:49:51,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f984f6d09fe59064f073d1 HTTP/1.1" 200 None 2026-05-07 05:49:51,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:49:51,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-07 05:49:51,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:49:51,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f984f6d09fe59064f073d1 HTTP/1.1" 200 None 2026-05-07 05:49:51,278 - lava_callback - ERROR - Error processing callback for node 69f984f6d09fe59064f073d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59102 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:51:11,209 - lava_callback - INFO - Received callback for node 69f9854ad09fe59064f073fc INFO: 172.21.0.1:36502 - "POST /node/69f9854ad09fe59064f073fc HTTP/1.0" 202 Accepted 2026-05-07 05:51:11,214 - lava_callback - INFO - Starting async job submit for node 69f9854ad09fe59064f073fc 2026-05-07 05:51:11,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:51:11,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9854ad09fe59064f073fc HTTP/1.1" 200 None 2026-05-07 05:51:11,228 - lava_callback - DEBUG - Processing node 69f9854ad09fe59064f073fc: baseline-arm64-clabbe 2026-05-07 05:51:11,229 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9854ad09fe59064f073fc 2026-05-07 05:51:11,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:51:11,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9854ad09fe59064f073fc HTTP/1.1" 200 None 2026-05-07 05:51:11,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:51:11,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-07 05:51:11,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:51:11,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9854ad09fe59064f073fc HTTP/1.1" 200 None 2026-05-07 05:51:11,283 - lava_callback - ERROR - Error processing callback for node 69f9854ad09fe59064f073fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45720 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:52:51,343 - lava_callback - INFO - Received callback for node 69f9859ed09fe59064f0742e INFO: 172.21.0.1:47718 - "POST /node/69f9859ed09fe59064f0742e HTTP/1.0" 202 Accepted 2026-05-07 05:52:51,348 - lava_callback - INFO - Starting async job submit for node 69f9859ed09fe59064f0742e 2026-05-07 05:52:51,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:52:51,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9859ed09fe59064f0742e HTTP/1.1" 200 None 2026-05-07 05:52:51,366 - lava_callback - DEBUG - Processing node 69f9859ed09fe59064f0742e: baseline-arm64-clabbe 2026-05-07 05:52:51,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9859ed09fe59064f0742e 2026-05-07 05:52:51,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:52:51,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9859ed09fe59064f0742e HTTP/1.1" 200 None 2026-05-07 05:52:51,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:52:51,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-07 05:52:51,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:52:51,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9859ed09fe59064f0742e HTTP/1.1" 200 None 2026-05-07 05:52:51,413 - lava_callback - ERROR - Error processing callback for node 69f9859ed09fe59064f0742e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:54:11,381 - lava_callback - INFO - Received callback for node 69f985f4d09fe59064f07455 INFO: 172.21.0.1:58128 - "POST /node/69f985f4d09fe59064f07455 HTTP/1.0" 202 Accepted 2026-05-07 05:54:11,387 - lava_callback - INFO - Starting async job submit for node 69f985f4d09fe59064f07455 2026-05-07 05:54:11,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:54:11,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f985f4d09fe59064f07455 HTTP/1.1" 200 None 2026-05-07 05:54:11,410 - lava_callback - DEBUG - Processing node 69f985f4d09fe59064f07455: baseline-arm64-clabbe 2026-05-07 05:54:11,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f985f4d09fe59064f07455 2026-05-07 05:54:11,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:54:11,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f985f4d09fe59064f07455 HTTP/1.1" 200 None 2026-05-07 05:54:11,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:54:11,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-07 05:54:11,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:54:11,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f985f4d09fe59064f07455 HTTP/1.1" 200 None 2026-05-07 05:54:11,460 - lava_callback - ERROR - Error processing callback for node 69f985f4d09fe59064f07455: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:55:31,407 - lava_callback - INFO - Received callback for node 69f98648d09fe59064f07472 INFO: 172.21.0.1:41340 - "POST /node/69f98648d09fe59064f07472 HTTP/1.0" 202 Accepted 2026-05-07 05:55:31,412 - lava_callback - INFO - Starting async job submit for node 69f98648d09fe59064f07472 2026-05-07 05:55:31,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:55:31,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f98648d09fe59064f07472 HTTP/1.1" 200 None 2026-05-07 05:55:31,429 - lava_callback - DEBUG - Processing node 69f98648d09fe59064f07472: baseline-arm64-clabbe 2026-05-07 05:55:31,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f98648d09fe59064f07472 2026-05-07 05:55:31,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:55:31,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f98648d09fe59064f07472 HTTP/1.1" 200 None 2026-05-07 05:55:31,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:55:31,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-07 05:55:31,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:55:31,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f98648d09fe59064f07472 HTTP/1.1" 200 None 2026-05-07 05:55:31,479 - lava_callback - ERROR - Error processing callback for node 69f98648d09fe59064f07472: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:57:11,552 - lava_callback - INFO - Received callback for node 69f986a3d09fe59064f07496 INFO: 172.21.0.1:41376 - "POST /node/69f986a3d09fe59064f07496 HTTP/1.0" 202 Accepted 2026-05-07 05:57:11,557 - lava_callback - INFO - Starting async job submit for node 69f986a3d09fe59064f07496 2026-05-07 05:57:11,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:57:11,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f986a3d09fe59064f07496 HTTP/1.1" 200 None 2026-05-07 05:57:11,582 - lava_callback - DEBUG - Processing node 69f986a3d09fe59064f07496: baseline-arm64-clabbe 2026-05-07 05:57:11,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f986a3d09fe59064f07496 2026-05-07 05:57:11,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:57:11,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f986a3d09fe59064f07496 HTTP/1.1" 200 None 2026-05-07 05:57:11,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:57:11,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:57:11,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:57:11,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f986a3d09fe59064f07496 HTTP/1.1" 200 None 2026-05-07 05:57:11,628 - lava_callback - ERROR - Error processing callback for node 69f986a3d09fe59064f07496: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56104 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:58:19,101 - lava_callback - INFO - Received callback for node 69f986efd09fe59064f074bd INFO: 172.21.0.1:56108 - "POST /node/69f986efd09fe59064f074bd HTTP/1.0" 202 Accepted 2026-05-07 05:58:19,107 - lava_callback - INFO - Starting async job submit for node 69f986efd09fe59064f074bd 2026-05-07 05:58:19,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:58:19,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f986efd09fe59064f074bd HTTP/1.1" 200 None 2026-05-07 05:58:19,129 - lava_callback - DEBUG - Processing node 69f986efd09fe59064f074bd: baseline-arm64-baylibre 2026-05-07 05:58:19,129 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f986efd09fe59064f074bd 2026-05-07 05:58:19,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:58:19,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f986efd09fe59064f074bd HTTP/1.1" 200 None 2026-05-07 05:58:19,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:58:19,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:58:19,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:58:19,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f986efd09fe59064f074bd HTTP/1.1" 200 None 2026-05-07 05:58:19,175 - lava_callback - ERROR - Error processing callback for node 69f986efd09fe59064f074bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46280 - "GET / HTTP/1.0" 200 OK 2026-05-07 05:59:51,590 - lava_callback - INFO - Received callback for node 69f98747d09fe59064f074ed INFO: 172.21.0.1:54128 - "POST /node/69f98747d09fe59064f074ed HTTP/1.0" 202 Accepted 2026-05-07 05:59:51,595 - lava_callback - INFO - Starting async job submit for node 69f98747d09fe59064f074ed 2026-05-07 05:59:51,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:59:51,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f98747d09fe59064f074ed HTTP/1.1" 200 None 2026-05-07 05:59:51,610 - lava_callback - DEBUG - Processing node 69f98747d09fe59064f074ed: baseline-arm64-clabbe 2026-05-07 05:59:51,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f98747d09fe59064f074ed 2026-05-07 05:59:51,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:59:51,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f98747d09fe59064f074ed HTTP/1.1" 200 None 2026-05-07 05:59:51,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:59:51,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 05:59:51,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 05:59:51,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f98747d09fe59064f074ed HTTP/1.1" 200 None 2026-05-07 05:59:51,662 - lava_callback - ERROR - Error processing callback for node 69f98747d09fe59064f074ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:01:11,673 - lava_callback - INFO - Received callback for node 69f9879cd09fe59064f07518 INFO: 172.21.0.1:42740 - "POST /node/69f9879cd09fe59064f07518 HTTP/1.0" 202 Accepted 2026-05-07 06:01:11,679 - lava_callback - INFO - Starting async job submit for node 69f9879cd09fe59064f07518 2026-05-07 06:01:11,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:01:11,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9879cd09fe59064f07518 HTTP/1.1" 200 None 2026-05-07 06:01:11,694 - lava_callback - DEBUG - Processing node 69f9879cd09fe59064f07518: baseline-arm64-clabbe 2026-05-07 06:01:11,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9879cd09fe59064f07518 2026-05-07 06:01:11,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:01:11,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9879cd09fe59064f07518 HTTP/1.1" 200 None 2026-05-07 06:01:11,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:01:11,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 06:01:11,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:01:11,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9879cd09fe59064f07518 HTTP/1.1" 200 None 2026-05-07 06:01:11,796 - lava_callback - ERROR - Error processing callback for node 69f9879cd09fe59064f07518: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:02:51,755 - lava_callback - INFO - Received callback for node 69f987f6d09fe59064f07540 INFO: 172.21.0.1:60630 - "POST /node/69f987f6d09fe59064f07540 HTTP/1.0" 202 Accepted 2026-05-07 06:02:51,760 - lava_callback - INFO - Starting async job submit for node 69f987f6d09fe59064f07540 2026-05-07 06:02:51,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:02:51,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f987f6d09fe59064f07540 HTTP/1.1" 200 None 2026-05-07 06:02:51,801 - lava_callback - DEBUG - Processing node 69f987f6d09fe59064f07540: baseline-arm64-clabbe 2026-05-07 06:02:51,801 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f987f6d09fe59064f07540 2026-05-07 06:02:51,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:02:51,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f987f6d09fe59064f07540 HTTP/1.1" 200 None 2026-05-07 06:02:51,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:02:51,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 06:02:51,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:02:51,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f987f6d09fe59064f07540 HTTP/1.1" 200 None 2026-05-07 06:02:51,867 - lava_callback - ERROR - Error processing callback for node 69f987f6d09fe59064f07540: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49032 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:04:11,800 - lava_callback - INFO - Received callback for node 69f98849d09fe59064f07558 INFO: 172.21.0.1:57594 - "POST /node/69f98849d09fe59064f07558 HTTP/1.0" 202 Accepted 2026-05-07 06:04:11,806 - lava_callback - INFO - Starting async job submit for node 69f98849d09fe59064f07558 2026-05-07 06:04:11,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:04:11,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f98849d09fe59064f07558 HTTP/1.1" 200 None 2026-05-07 06:04:11,852 - lava_callback - DEBUG - Processing node 69f98849d09fe59064f07558: baseline-arm64-clabbe 2026-05-07 06:04:11,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f98849d09fe59064f07558 2026-05-07 06:04:11,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:04:11,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f98849d09fe59064f07558 HTTP/1.1" 200 None 2026-05-07 06:04:11,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:04:11,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 06:04:11,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:04:11,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f98849d09fe59064f07558 HTTP/1.1" 200 None 2026-05-07 06:04:11,904 - lava_callback - ERROR - Error processing callback for node 69f98849d09fe59064f07558: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:05:31,958 - lava_callback - INFO - Received callback for node 69f988a0d09fe59064f07585 INFO: 172.21.0.1:60170 - "POST /node/69f988a0d09fe59064f07585 HTTP/1.0" 202 Accepted 2026-05-07 06:05:31,963 - lava_callback - INFO - Starting async job submit for node 69f988a0d09fe59064f07585 2026-05-07 06:05:31,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:05:31,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f988a0d09fe59064f07585 HTTP/1.1" 200 None 2026-05-07 06:05:31,979 - lava_callback - DEBUG - Processing node 69f988a0d09fe59064f07585: baseline-arm64-clabbe 2026-05-07 06:05:31,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f988a0d09fe59064f07585 2026-05-07 06:05:31,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:05:31,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f988a0d09fe59064f07585 HTTP/1.1" 200 None 2026-05-07 06:05:31,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:05:32,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 06:05:32,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:05:32,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f988a0d09fe59064f07585 HTTP/1.1" 200 None 2026-05-07 06:05:32,036 - lava_callback - ERROR - Error processing callback for node 69f988a0d09fe59064f07585: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:06:51,889 - lava_callback - INFO - Received callback for node 69f988f6d09fe59064f075aa INFO: 172.21.0.1:36430 - "POST /node/69f988f6d09fe59064f075aa HTTP/1.0" 202 Accepted 2026-05-07 06:06:51,895 - lava_callback - INFO - Starting async job submit for node 69f988f6d09fe59064f075aa 2026-05-07 06:06:51,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:06:51,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f988f6d09fe59064f075aa HTTP/1.1" 200 None 2026-05-07 06:06:51,910 - lava_callback - DEBUG - Processing node 69f988f6d09fe59064f075aa: baseline-arm64-clabbe 2026-05-07 06:06:51,910 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f988f6d09fe59064f075aa 2026-05-07 06:06:51,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:06:51,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f988f6d09fe59064f075aa HTTP/1.1" 200 None 2026-05-07 06:06:51,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:06:51,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 06:06:51,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:06:51,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f988f6d09fe59064f075aa HTTP/1.1" 200 None 2026-05-07 06:06:51,961 - lava_callback - ERROR - Error processing callback for node 69f988f6d09fe59064f075aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36362 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:08:31,928 - lava_callback - INFO - Received callback for node 69f9894cd09fe59064f075cf INFO: 172.21.0.1:57272 - "POST /node/69f9894cd09fe59064f075cf HTTP/1.0" 202 Accepted 2026-05-07 06:08:31,934 - lava_callback - INFO - Starting async job submit for node 69f9894cd09fe59064f075cf 2026-05-07 06:08:31,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:08:31,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9894cd09fe59064f075cf HTTP/1.1" 200 None 2026-05-07 06:08:31,958 - lava_callback - DEBUG - Processing node 69f9894cd09fe59064f075cf: baseline-arm64-clabbe 2026-05-07 06:08:31,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9894cd09fe59064f075cf 2026-05-07 06:08:31,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:08:31,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9894cd09fe59064f075cf HTTP/1.1" 200 None 2026-05-07 06:08:31,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:08:31,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 06:08:31,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:08:32,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9894cd09fe59064f075cf HTTP/1.1" 200 None 2026-05-07 06:08:32,010 - lava_callback - ERROR - Error processing callback for node 69f9894cd09fe59064f075cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:09:52,041 - lava_callback - INFO - Received callback for node 69f989a2d09fe59064f075f7 INFO: 172.21.0.1:43464 - "POST /node/69f989a2d09fe59064f075f7 HTTP/1.0" 202 Accepted 2026-05-07 06:09:52,047 - lava_callback - INFO - Starting async job submit for node 69f989a2d09fe59064f075f7 2026-05-07 06:09:52,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:09:52,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f989a2d09fe59064f075f7 HTTP/1.1" 200 None 2026-05-07 06:09:52,063 - lava_callback - DEBUG - Processing node 69f989a2d09fe59064f075f7: baseline-arm64-clabbe 2026-05-07 06:09:52,063 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f989a2d09fe59064f075f7 2026-05-07 06:09:52,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:09:52,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f989a2d09fe59064f075f7 HTTP/1.1" 200 None 2026-05-07 06:09:52,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:09:52,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 06:09:52,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:09:52,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f989a2d09fe59064f075f7 HTTP/1.1" 200 None 2026-05-07 06:09:52,112 - lava_callback - ERROR - Error processing callback for node 69f989a2d09fe59064f075f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:11:12,040 - lava_callback - INFO - Received callback for node 69f989f8d09fe59064f07623 INFO: 172.21.0.1:33668 - "POST /node/69f989f8d09fe59064f07623 HTTP/1.0" 202 Accepted 2026-05-07 06:11:12,046 - lava_callback - INFO - Starting async job submit for node 69f989f8d09fe59064f07623 2026-05-07 06:11:12,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:11:12,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f989f8d09fe59064f07623 HTTP/1.1" 200 None 2026-05-07 06:11:12,067 - lava_callback - DEBUG - Processing node 69f989f8d09fe59064f07623: baseline-arm64-clabbe 2026-05-07 06:11:12,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f989f8d09fe59064f07623 2026-05-07 06:11:12,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:11:12,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f989f8d09fe59064f07623 HTTP/1.1" 200 None 2026-05-07 06:11:12,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:11:12,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 06:11:12,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:11:12,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f989f8d09fe59064f07623 HTTP/1.1" 200 None 2026-05-07 06:11:12,117 - lava_callback - ERROR - Error processing callback for node 69f989f8d09fe59064f07623: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:12:32,148 - lava_callback - INFO - Received callback for node 69f98a4cd09fe59064f0764e INFO: 172.21.0.1:60052 - "POST /node/69f98a4cd09fe59064f0764e HTTP/1.0" 202 Accepted 2026-05-07 06:12:32,155 - lava_callback - INFO - Starting async job submit for node 69f98a4cd09fe59064f0764e 2026-05-07 06:12:32,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:12:32,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f98a4cd09fe59064f0764e HTTP/1.1" 200 None 2026-05-07 06:12:32,173 - lava_callback - DEBUG - Processing node 69f98a4cd09fe59064f0764e: baseline-arm64-clabbe 2026-05-07 06:12:32,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f98a4cd09fe59064f0764e 2026-05-07 06:12:32,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:12:32,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f98a4cd09fe59064f0764e HTTP/1.1" 200 None 2026-05-07 06:12:32,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:12:32,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 06:12:32,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:12:32,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f98a4cd09fe59064f0764e HTTP/1.1" 200 None 2026-05-07 06:12:32,228 - lava_callback - ERROR - Error processing callback for node 69f98a4cd09fe59064f0764e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36690 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:47:13,570 - lava_callback - INFO - Received callback for node 69f99268d09fe59064f07760 INFO: 172.21.0.1:43158 - "POST /node/69f99268d09fe59064f07760 HTTP/1.0" 202 Accepted 2026-05-07 06:47:13,576 - lava_callback - INFO - Starting async job submit for node 69f99268d09fe59064f07760 2026-05-07 06:47:13,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:47:13,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99268d09fe59064f07760 HTTP/1.1" 200 None 2026-05-07 06:47:13,591 - lava_callback - DEBUG - Processing node 69f99268d09fe59064f07760: baseline-arm-clabbe 2026-05-07 06:47:13,591 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99268d09fe59064f07760 2026-05-07 06:47:13,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:47:13,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99268d09fe59064f07760 HTTP/1.1" 200 None 2026-05-07 06:47:13,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:47:13,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 06:47:13,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:47:13,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99268d09fe59064f07760 HTTP/1.1" 200 None 2026-05-07 06:47:13,652 - lava_callback - ERROR - Error processing callback for node 69f99268d09fe59064f07760: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35474 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:47:53,509 - lava_callback - INFO - Received callback for node 69f99290d09fe59064f07771 INFO: 172.21.0.1:52494 - "POST /node/69f99290d09fe59064f07771 HTTP/1.0" 202 Accepted 2026-05-07 06:47:53,514 - lava_callback - INFO - Starting async job submit for node 69f99290d09fe59064f07771 2026-05-07 06:47:53,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:47:53,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99290d09fe59064f07771 HTTP/1.1" 200 None 2026-05-07 06:47:53,529 - lava_callback - DEBUG - Processing node 69f99290d09fe59064f07771: baseline-arm-clabbe 2026-05-07 06:47:53,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99290d09fe59064f07771 2026-05-07 06:47:53,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:47:53,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99290d09fe59064f07771 HTTP/1.1" 200 None 2026-05-07 06:47:53,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:47:53,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 06:47:53,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:47:53,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99290d09fe59064f07771 HTTP/1.1" 200 None 2026-05-07 06:47:53,584 - lava_callback - ERROR - Error processing callback for node 69f99290d09fe59064f07771: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:48:33,577 - lava_callback - INFO - Received callback for node 69f992b8d09fe59064f07784 INFO: 172.21.0.1:34450 - "POST /node/69f992b8d09fe59064f07784 HTTP/1.0" 202 Accepted 2026-05-07 06:48:33,584 - lava_callback - INFO - Starting async job submit for node 69f992b8d09fe59064f07784 2026-05-07 06:48:33,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:48:33,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f992b8d09fe59064f07784 HTTP/1.1" 200 None 2026-05-07 06:48:33,602 - lava_callback - DEBUG - Processing node 69f992b8d09fe59064f07784: baseline-arm-clabbe 2026-05-07 06:48:33,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f992b8d09fe59064f07784 2026-05-07 06:48:33,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:48:33,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f992b8d09fe59064f07784 HTTP/1.1" 200 None 2026-05-07 06:48:33,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:48:33,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 06:48:33,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:48:33,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f992b8d09fe59064f07784 HTTP/1.1" 200 None 2026-05-07 06:48:33,658 - lava_callback - ERROR - Error processing callback for node 69f992b8d09fe59064f07784: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:49:13,539 - lava_callback - INFO - Received callback for node 69f992e0d09fe59064f07795 INFO: 172.21.0.1:43918 - "POST /node/69f992e0d09fe59064f07795 HTTP/1.0" 202 Accepted 2026-05-07 06:49:13,544 - lava_callback - INFO - Starting async job submit for node 69f992e0d09fe59064f07795 2026-05-07 06:49:13,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:49:13,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f992e0d09fe59064f07795 HTTP/1.1" 200 None 2026-05-07 06:49:13,559 - lava_callback - DEBUG - Processing node 69f992e0d09fe59064f07795: baseline-arm-clabbe 2026-05-07 06:49:13,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f992e0d09fe59064f07795 2026-05-07 06:49:13,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:49:13,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f992e0d09fe59064f07795 HTTP/1.1" 200 None 2026-05-07 06:49:13,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:49:13,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 06:49:13,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:49:13,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f992e0d09fe59064f07795 HTTP/1.1" 200 None 2026-05-07 06:49:13,609 - lava_callback - ERROR - Error processing callback for node 69f992e0d09fe59064f07795: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57382 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:49:53,608 - lava_callback - INFO - Received callback for node 69f99308d09fe59064f077a8 INFO: 172.21.0.1:42530 - "POST /node/69f99308d09fe59064f077a8 HTTP/1.0" 202 Accepted 2026-05-07 06:49:53,614 - lava_callback - INFO - Starting async job submit for node 69f99308d09fe59064f077a8 2026-05-07 06:49:53,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:49:53,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99308d09fe59064f077a8 HTTP/1.1" 200 None 2026-05-07 06:49:53,628 - lava_callback - DEBUG - Processing node 69f99308d09fe59064f077a8: baseline-arm-clabbe 2026-05-07 06:49:53,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99308d09fe59064f077a8 2026-05-07 06:49:53,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:49:53,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99308d09fe59064f077a8 HTTP/1.1" 200 None 2026-05-07 06:49:53,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:49:53,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 06:49:53,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:49:53,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99308d09fe59064f077a8 HTTP/1.1" 200 None 2026-05-07 06:49:53,677 - lava_callback - ERROR - Error processing callback for node 69f99308d09fe59064f077a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43134 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:50:33,608 - lava_callback - INFO - Received callback for node 69f9932ed09fe59064f077ba INFO: 172.21.0.1:41520 - "POST /node/69f9932ed09fe59064f077ba HTTP/1.0" 202 Accepted 2026-05-07 06:50:33,614 - lava_callback - INFO - Starting async job submit for node 69f9932ed09fe59064f077ba 2026-05-07 06:50:33,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:50:33,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9932ed09fe59064f077ba HTTP/1.1" 200 None 2026-05-07 06:50:33,628 - lava_callback - DEBUG - Processing node 69f9932ed09fe59064f077ba: baseline-arm-clabbe 2026-05-07 06:50:33,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9932ed09fe59064f077ba 2026-05-07 06:50:33,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:50:33,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9932ed09fe59064f077ba HTTP/1.1" 200 None 2026-05-07 06:50:33,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:50:33,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-07 06:50:33,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:50:33,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9932ed09fe59064f077ba HTTP/1.1" 200 None 2026-05-07 06:50:33,673 - lava_callback - ERROR - Error processing callback for node 69f9932ed09fe59064f077ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47940 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:51:01,883 - lava_callback - INFO - Received callback for node 69f9934fd09fe59064f077ca INFO: 172.21.0.1:49424 - "POST /node/69f9934fd09fe59064f077ca HTTP/1.0" 202 Accepted 2026-05-07 06:51:01,892 - lava_callback - INFO - Starting async job submit for node 69f9934fd09fe59064f077ca 2026-05-07 06:51:01,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:51:01,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9934fd09fe59064f077ca HTTP/1.1" 200 None 2026-05-07 06:51:01,907 - lava_callback - DEBUG - Processing node 69f9934fd09fe59064f077ca: baseline-arm-baylibre 2026-05-07 06:51:01,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9934fd09fe59064f077ca 2026-05-07 06:51:01,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:51:01,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9934fd09fe59064f077ca HTTP/1.1" 200 None 2026-05-07 06:51:01,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:51:01,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 06:51:01,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:51:01,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9934fd09fe59064f077ca HTTP/1.1" 200 None 2026-05-07 06:51:01,967 - lava_callback - ERROR - Error processing callback for node 69f9934fd09fe59064f077ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44320 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:52:33,698 - lava_callback - INFO - Received callback for node 69f9939fd09fe59064f077e7 INFO: 172.21.0.1:36282 - "POST /node/69f9939fd09fe59064f077e7 HTTP/1.0" 202 Accepted 2026-05-07 06:52:33,703 - lava_callback - INFO - Starting async job submit for node 69f9939fd09fe59064f077e7 2026-05-07 06:52:33,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:52:33,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9939fd09fe59064f077e7 HTTP/1.1" 200 None 2026-05-07 06:52:33,718 - lava_callback - DEBUG - Processing node 69f9939fd09fe59064f077e7: baseline-arm-clabbe 2026-05-07 06:52:33,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9939fd09fe59064f077e7 2026-05-07 06:52:33,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:52:33,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9939fd09fe59064f077e7 HTTP/1.1" 200 None 2026-05-07 06:52:33,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:52:33,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 06:52:33,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:52:33,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9939fd09fe59064f077e7 HTTP/1.1" 200 None 2026-05-07 06:52:33,784 - lava_callback - ERROR - Error processing callback for node 69f9939fd09fe59064f077e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32988 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:53:13,678 - lava_callback - INFO - Received callback for node 69f993c6d09fe59064f077fa INFO: 172.21.0.1:57814 - "POST /node/69f993c6d09fe59064f077fa HTTP/1.0" 202 Accepted 2026-05-07 06:53:13,684 - lava_callback - INFO - Starting async job submit for node 69f993c6d09fe59064f077fa 2026-05-07 06:53:13,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:53:13,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f993c6d09fe59064f077fa HTTP/1.1" 200 None 2026-05-07 06:53:13,699 - lava_callback - DEBUG - Processing node 69f993c6d09fe59064f077fa: baseline-arm-clabbe 2026-05-07 06:53:13,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f993c6d09fe59064f077fa 2026-05-07 06:53:13,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:53:13,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f993c6d09fe59064f077fa HTTP/1.1" 200 None 2026-05-07 06:53:13,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:53:13,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 06:53:13,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:53:13,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f993c6d09fe59064f077fa HTTP/1.1" 200 None 2026-05-07 06:53:13,755 - lava_callback - ERROR - Error processing callback for node 69f993c6d09fe59064f077fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:53:53,751 - lava_callback - INFO - Received callback for node 69f993edd09fe59064f0780a INFO: 172.21.0.1:36818 - "POST /node/69f993edd09fe59064f0780a HTTP/1.0" 202 Accepted 2026-05-07 06:53:53,756 - lava_callback - INFO - Starting async job submit for node 69f993edd09fe59064f0780a 2026-05-07 06:53:53,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:53:53,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f993edd09fe59064f0780a HTTP/1.1" 200 None 2026-05-07 06:53:53,771 - lava_callback - DEBUG - Processing node 69f993edd09fe59064f0780a: baseline-arm-clabbe 2026-05-07 06:53:53,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f993edd09fe59064f0780a 2026-05-07 06:53:53,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:53:53,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f993edd09fe59064f0780a HTTP/1.1" 200 None 2026-05-07 06:53:53,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:53:53,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 06:53:53,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:53:53,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f993edd09fe59064f0780a HTTP/1.1" 200 None 2026-05-07 06:53:53,829 - lava_callback - ERROR - Error processing callback for node 69f993edd09fe59064f0780a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40416 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:54:33,733 - lava_callback - INFO - Received callback for node 69f99416d09fe59064f07818 INFO: 172.21.0.1:56360 - "POST /node/69f99416d09fe59064f07818 HTTP/1.0" 202 Accepted 2026-05-07 06:54:33,739 - lava_callback - INFO - Starting async job submit for node 69f99416d09fe59064f07818 2026-05-07 06:54:33,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:54:33,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99416d09fe59064f07818 HTTP/1.1" 200 None 2026-05-07 06:54:33,755 - lava_callback - DEBUG - Processing node 69f99416d09fe59064f07818: baseline-arm-clabbe 2026-05-07 06:54:33,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99416d09fe59064f07818 2026-05-07 06:54:33,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:54:33,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99416d09fe59064f07818 HTTP/1.1" 200 None 2026-05-07 06:54:33,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:54:33,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 06:54:33,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:54:33,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99416d09fe59064f07818 HTTP/1.1" 200 None 2026-05-07 06:54:33,814 - lava_callback - ERROR - Error processing callback for node 69f99416d09fe59064f07818: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:55:13,823 - lava_callback - INFO - Received callback for node 69f9943ed09fe59064f07828 INFO: 172.21.0.1:38434 - "POST /node/69f9943ed09fe59064f07828 HTTP/1.0" 202 Accepted 2026-05-07 06:55:13,828 - lava_callback - INFO - Starting async job submit for node 69f9943ed09fe59064f07828 2026-05-07 06:55:13,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:55:13,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9943ed09fe59064f07828 HTTP/1.1" 200 None 2026-05-07 06:55:13,851 - lava_callback - DEBUG - Processing node 69f9943ed09fe59064f07828: baseline-arm-clabbe 2026-05-07 06:55:13,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9943ed09fe59064f07828 2026-05-07 06:55:13,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:55:13,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9943ed09fe59064f07828 HTTP/1.1" 200 None 2026-05-07 06:55:13,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:55:13,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 06:55:13,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:55:13,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9943ed09fe59064f07828 HTTP/1.1" 200 None 2026-05-07 06:55:13,897 - lava_callback - ERROR - Error processing callback for node 69f9943ed09fe59064f07828: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:55:53,788 - lava_callback - INFO - Received callback for node 69f99466d09fe59064f07838 INFO: 172.21.0.1:40430 - "POST /node/69f99466d09fe59064f07838 HTTP/1.0" 202 Accepted 2026-05-07 06:55:53,793 - lava_callback - INFO - Starting async job submit for node 69f99466d09fe59064f07838 2026-05-07 06:55:53,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:55:53,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99466d09fe59064f07838 HTTP/1.1" 200 None 2026-05-07 06:55:53,808 - lava_callback - DEBUG - Processing node 69f99466d09fe59064f07838: baseline-arm-clabbe 2026-05-07 06:55:53,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99466d09fe59064f07838 2026-05-07 06:55:53,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:55:53,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99466d09fe59064f07838 HTTP/1.1" 200 None 2026-05-07 06:55:53,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:55:53,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 06:55:53,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:55:53,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99466d09fe59064f07838 HTTP/1.1" 200 None 2026-05-07 06:55:53,853 - lava_callback - ERROR - Error processing callback for node 69f99466d09fe59064f07838: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41510 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:56:33,869 - lava_callback - INFO - Received callback for node 69f9948dd09fe59064f07845 INFO: 172.21.0.1:54518 - "POST /node/69f9948dd09fe59064f07845 HTTP/1.0" 202 Accepted 2026-05-07 06:56:33,875 - lava_callback - INFO - Starting async job submit for node 69f9948dd09fe59064f07845 2026-05-07 06:56:33,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:56:33,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9948dd09fe59064f07845 HTTP/1.1" 200 None 2026-05-07 06:56:33,894 - lava_callback - DEBUG - Processing node 69f9948dd09fe59064f07845: baseline-arm-clabbe 2026-05-07 06:56:33,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9948dd09fe59064f07845 2026-05-07 06:56:33,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:56:33,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9948dd09fe59064f07845 HTTP/1.1" 200 None 2026-05-07 06:56:33,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:56:33,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 06:56:33,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:56:33,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9948dd09fe59064f07845 HTTP/1.1" 200 None 2026-05-07 06:56:33,948 - lava_callback - ERROR - Error processing callback for node 69f9948dd09fe59064f07845: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56346 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:57:13,834 - lava_callback - INFO - Received callback for node 69f994b4d09fe59064f07853 INFO: 172.21.0.1:46254 - "POST /node/69f994b4d09fe59064f07853 HTTP/1.0" 202 Accepted 2026-05-07 06:57:13,840 - lava_callback - INFO - Starting async job submit for node 69f994b4d09fe59064f07853 2026-05-07 06:57:13,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:57:13,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f994b4d09fe59064f07853 HTTP/1.1" 200 None 2026-05-07 06:57:13,855 - lava_callback - DEBUG - Processing node 69f994b4d09fe59064f07853: baseline-arm-clabbe 2026-05-07 06:57:13,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f994b4d09fe59064f07853 2026-05-07 06:57:13,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:57:13,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f994b4d09fe59064f07853 HTTP/1.1" 200 None 2026-05-07 06:57:13,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:57:13,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 06:57:13,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:57:13,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f994b4d09fe59064f07853 HTTP/1.1" 200 None 2026-05-07 06:57:13,906 - lava_callback - ERROR - Error processing callback for node 69f994b4d09fe59064f07853: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:57:33,879 - lava_callback - INFO - Received callback for node 69f994dad09fe59064f07860 INFO: 172.21.0.1:45526 - "POST /node/69f994dad09fe59064f07860 HTTP/1.0" 202 Accepted 2026-05-07 06:57:33,885 - lava_callback - INFO - Starting async job submit for node 69f994dad09fe59064f07860 2026-05-07 06:57:33,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:57:33,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f994dad09fe59064f07860 HTTP/1.1" 200 None 2026-05-07 06:57:33,901 - lava_callback - DEBUG - Processing node 69f994dad09fe59064f07860: baseline-arm-clabbe 2026-05-07 06:57:33,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f994dad09fe59064f07860 2026-05-07 06:57:33,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:57:33,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f994dad09fe59064f07860 HTTP/1.1" 200 None 2026-05-07 06:57:33,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:57:33,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 06:57:33,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:57:33,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f994dad09fe59064f07860 HTTP/1.1" 200 None 2026-05-07 06:57:33,956 - lava_callback - ERROR - Error processing callback for node 69f994dad09fe59064f07860: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK 2026-05-07 06:58:13,881 - lava_callback - INFO - Received callback for node 69f994ffd09fe59064f0786a INFO: 172.21.0.1:33032 - "POST /node/69f994ffd09fe59064f0786a HTTP/1.0" 202 Accepted 2026-05-07 06:58:13,887 - lava_callback - INFO - Starting async job submit for node 69f994ffd09fe59064f0786a 2026-05-07 06:58:13,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:58:13,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f994ffd09fe59064f0786a HTTP/1.1" 200 None 2026-05-07 06:58:13,902 - lava_callback - DEBUG - Processing node 69f994ffd09fe59064f0786a: baseline-arm-clabbe 2026-05-07 06:58:13,902 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f994ffd09fe59064f0786a 2026-05-07 06:58:13,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:58:13,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f994ffd09fe59064f0786a HTTP/1.1" 200 None 2026-05-07 06:58:13,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:58:13,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-07 06:58:13,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 06:58:13,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f994ffd09fe59064f0786a HTTP/1.1" 200 None 2026-05-07 06:58:13,948 - lava_callback - ERROR - Error processing callback for node 69f994ffd09fe59064f0786a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48702 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:02:42,446 - lava_callback - INFO - Received callback for node 69f99610d09fe59064f07896 INFO: 172.21.0.1:48704 - "POST /node/69f99610d09fe59064f07896 HTTP/1.0" 202 Accepted 2026-05-07 07:02:42,451 - lava_callback - INFO - Starting async job submit for node 69f99610d09fe59064f07896 2026-05-07 07:02:42,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:02:42,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99610d09fe59064f07896 HTTP/1.1" 200 None 2026-05-07 07:02:42,470 - lava_callback - DEBUG - Processing node 69f99610d09fe59064f07896: baseline-arm64-baylibre 2026-05-07 07:02:42,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99610d09fe59064f07896 2026-05-07 07:02:42,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:02:42,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99610d09fe59064f07896 HTTP/1.1" 200 None 2026-05-07 07:02:42,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:02:42,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:02:42,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:02:42,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99610d09fe59064f07896 HTTP/1.1" 200 None 2026-05-07 07:02:42,521 - lava_callback - ERROR - Error processing callback for node 69f99610d09fe59064f07896: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56018 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:04:54,108 - lava_callback - INFO - Received callback for node 69f9968fd09fe59064f078de INFO: 172.21.0.1:44288 - "POST /node/69f9968fd09fe59064f078de HTTP/1.0" 202 Accepted 2026-05-07 07:04:54,118 - lava_callback - INFO - Starting async job submit for node 69f9968fd09fe59064f078de 2026-05-07 07:04:54,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:04:54,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9968fd09fe59064f078de HTTP/1.1" 200 None 2026-05-07 07:04:54,136 - lava_callback - DEBUG - Processing node 69f9968fd09fe59064f078de: baseline-arm64-clabbe 2026-05-07 07:04:54,136 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9968fd09fe59064f078de 2026-05-07 07:04:54,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:04:54,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9968fd09fe59064f078de HTTP/1.1" 200 None 2026-05-07 07:04:54,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:04:54,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:04:54,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:04:54,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9968fd09fe59064f078de HTTP/1.1" 200 None 2026-05-07 07:04:54,192 - lava_callback - ERROR - Error processing callback for node 69f9968fd09fe59064f078de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46184 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:06:14,202 - lava_callback - INFO - Received callback for node 69f996e1d09fe59064f07910 INFO: 172.21.0.1:58440 - "POST /node/69f996e1d09fe59064f07910 HTTP/1.0" 202 Accepted 2026-05-07 07:06:14,211 - lava_callback - INFO - Starting async job submit for node 69f996e1d09fe59064f07910 2026-05-07 07:06:14,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:06:14,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f996e1d09fe59064f07910 HTTP/1.1" 200 None 2026-05-07 07:06:14,226 - lava_callback - DEBUG - Processing node 69f996e1d09fe59064f07910: baseline-arm64-clabbe 2026-05-07 07:06:14,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f996e1d09fe59064f07910 2026-05-07 07:06:14,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:06:14,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f996e1d09fe59064f07910 HTTP/1.1" 200 None 2026-05-07 07:06:14,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:06:14,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:06:14,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:06:14,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f996e1d09fe59064f07910 HTTP/1.1" 200 None 2026-05-07 07:06:14,286 - lava_callback - ERROR - Error processing callback for node 69f996e1d09fe59064f07910: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET /node/698a177322b4cc0f227ae1e4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:22:43,628 - lava_callback - INFO - Received callback for node 69f99ab1d09fe59064f07b16 INFO: 172.21.0.1:39460 - "POST /node/69f99ab1d09fe59064f07b16 HTTP/1.0" 202 Accepted 2026-05-07 07:22:43,634 - lava_callback - INFO - Starting async job submit for node 69f99ab1d09fe59064f07b16 2026-05-07 07:22:43,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:22:43,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99ab1d09fe59064f07b16 HTTP/1.1" 200 None 2026-05-07 07:22:43,657 - lava_callback - DEBUG - Processing node 69f99ab1d09fe59064f07b16: baseline-arm64-baylibre 2026-05-07 07:22:43,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99ab1d09fe59064f07b16 2026-05-07 07:22:43,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:22:43,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99ab1d09fe59064f07b16 HTTP/1.1" 200 None 2026-05-07 07:22:43,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:22:43,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 07:22:43,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:22:43,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99ab1d09fe59064f07b16 HTTP/1.1" 200 None 2026-05-07 07:22:43,707 - lava_callback - ERROR - Error processing callback for node 69f99ab1d09fe59064f07b16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:25:34,951 - lava_callback - INFO - Received callback for node 69f99b5cd09fe59064f07b62 INFO: 172.21.0.1:45100 - "POST /node/69f99b5cd09fe59064f07b62 HTTP/1.0" 202 Accepted 2026-05-07 07:25:34,957 - lava_callback - INFO - Starting async job submit for node 69f99b5cd09fe59064f07b62 2026-05-07 07:25:34,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:25:34,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99b5cd09fe59064f07b62 HTTP/1.1" 200 None 2026-05-07 07:25:34,972 - lava_callback - DEBUG - Processing node 69f99b5cd09fe59064f07b62: baseline-arm64-clabbe 2026-05-07 07:25:34,972 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99b5cd09fe59064f07b62 2026-05-07 07:25:34,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:25:34,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99b5cd09fe59064f07b62 HTTP/1.1" 200 None 2026-05-07 07:25:34,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:25:35,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 07:25:35,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:25:35,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99b5cd09fe59064f07b62 HTTP/1.1" 200 None 2026-05-07 07:25:35,027 - lava_callback - ERROR - Error processing callback for node 69f99b5cd09fe59064f07b62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:26:54,948 - lava_callback - INFO - Received callback for node 69f99badd09fe59064f07b8a INFO: 172.21.0.1:34082 - "POST /node/69f99badd09fe59064f07b8a HTTP/1.0" 202 Accepted 2026-05-07 07:26:54,953 - lava_callback - INFO - Starting async job submit for node 69f99badd09fe59064f07b8a 2026-05-07 07:26:54,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:26:54,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99badd09fe59064f07b8a HTTP/1.1" 200 None 2026-05-07 07:26:54,968 - lava_callback - DEBUG - Processing node 69f99badd09fe59064f07b8a: baseline-arm64-clabbe 2026-05-07 07:26:54,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99badd09fe59064f07b8a 2026-05-07 07:26:54,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:26:54,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99badd09fe59064f07b8a HTTP/1.1" 200 None 2026-05-07 07:26:54,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:26:54,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:26:54,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:26:55,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99badd09fe59064f07b8a HTTP/1.1" 200 None 2026-05-07 07:26:55,017 - lava_callback - ERROR - Error processing callback for node 69f99badd09fe59064f07b8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:28:15,056 - lava_callback - INFO - Received callback for node 69f99c00d09fe59064f07bb7 INFO: 172.21.0.1:58788 - "POST /node/69f99c00d09fe59064f07bb7 HTTP/1.0" 202 Accepted 2026-05-07 07:28:15,061 - lava_callback - INFO - Starting async job submit for node 69f99c00d09fe59064f07bb7 2026-05-07 07:28:15,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:28:15,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99c00d09fe59064f07bb7 HTTP/1.1" 200 None 2026-05-07 07:28:15,079 - lava_callback - DEBUG - Processing node 69f99c00d09fe59064f07bb7: baseline-arm64-clabbe 2026-05-07 07:28:15,079 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99c00d09fe59064f07bb7 2026-05-07 07:28:15,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:28:15,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99c00d09fe59064f07bb7 HTTP/1.1" 200 None 2026-05-07 07:28:15,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:28:15,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 07:28:15,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:28:15,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99c00d09fe59064f07bb7 HTTP/1.1" 200 None 2026-05-07 07:28:15,125 - lava_callback - ERROR - Error processing callback for node 69f99c00d09fe59064f07bb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33060 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:29:35,107 - lava_callback - INFO - Received callback for node 69f99c59d09fe59064f07be0 INFO: 172.21.0.1:55138 - "POST /node/69f99c59d09fe59064f07be0 HTTP/1.0" 202 Accepted 2026-05-07 07:29:35,112 - lava_callback - INFO - Starting async job submit for node 69f99c59d09fe59064f07be0 2026-05-07 07:29:35,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:29:35,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99c59d09fe59064f07be0 HTTP/1.1" 200 None 2026-05-07 07:29:35,131 - lava_callback - DEBUG - Processing node 69f99c59d09fe59064f07be0: baseline-arm64-clabbe 2026-05-07 07:29:35,131 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99c59d09fe59064f07be0 2026-05-07 07:29:35,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:29:35,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99c59d09fe59064f07be0 HTTP/1.1" 200 None 2026-05-07 07:29:35,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:29:35,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 07:29:35,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:29:35,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99c59d09fe59064f07be0 HTTP/1.1" 200 None 2026-05-07 07:29:35,175 - lava_callback - ERROR - Error processing callback for node 69f99c59d09fe59064f07be0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:30:55,135 - lava_callback - INFO - Received callback for node 69f99ca7d09fe59064f07c0f INFO: 172.21.0.1:38564 - "POST /node/69f99ca7d09fe59064f07c0f HTTP/1.0" 202 Accepted 2026-05-07 07:30:55,140 - lava_callback - INFO - Starting async job submit for node 69f99ca7d09fe59064f07c0f 2026-05-07 07:30:55,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:30:55,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99ca7d09fe59064f07c0f HTTP/1.1" 200 None 2026-05-07 07:30:55,164 - lava_callback - DEBUG - Processing node 69f99ca7d09fe59064f07c0f: baseline-arm64-clabbe 2026-05-07 07:30:55,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99ca7d09fe59064f07c0f 2026-05-07 07:30:55,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:30:55,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99ca7d09fe59064f07c0f HTTP/1.1" 200 None 2026-05-07 07:30:55,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:30:55,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 07:30:55,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:30:55,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99ca7d09fe59064f07c0f HTTP/1.1" 200 None 2026-05-07 07:30:55,209 - lava_callback - ERROR - Error processing callback for node 69f99ca7d09fe59064f07c0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48312 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44068 - "GET /security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-07 07:32:15,203 - lava_callback - INFO - Received callback for node 69f99cf2d09fe59064f07c57 INFO: 172.21.0.1:50828 - "POST /node/69f99cf2d09fe59064f07c57 HTTP/1.0" 202 Accepted 2026-05-07 07:32:15,209 - lava_callback - INFO - Starting async job submit for node 69f99cf2d09fe59064f07c57 2026-05-07 07:32:15,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:32:15,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99cf2d09fe59064f07c57 HTTP/1.1" 200 None 2026-05-07 07:32:15,231 - lava_callback - DEBUG - Processing node 69f99cf2d09fe59064f07c57: baseline-arm64-clabbe 2026-05-07 07:32:15,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99cf2d09fe59064f07c57 2026-05-07 07:32:15,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:32:15,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99cf2d09fe59064f07c57 HTTP/1.1" 200 None 2026-05-07 07:32:15,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:32:15,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 07:32:15,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:32:15,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99cf2d09fe59064f07c57 HTTP/1.1" 200 None 2026-05-07 07:32:15,285 - lava_callback - ERROR - Error processing callback for node 69f99cf2d09fe59064f07c57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45776 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:33:35,247 - lava_callback - INFO - Received callback for node 69f99d45d09fe59064f07c70 INFO: 172.21.0.1:38386 - "POST /node/69f99d45d09fe59064f07c70 HTTP/1.0" 202 Accepted 2026-05-07 07:33:35,253 - lava_callback - INFO - Starting async job submit for node 69f99d45d09fe59064f07c70 2026-05-07 07:33:35,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:33:35,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99d45d09fe59064f07c70 HTTP/1.1" 200 None 2026-05-07 07:33:35,270 - lava_callback - DEBUG - Processing node 69f99d45d09fe59064f07c70: baseline-arm64-clabbe 2026-05-07 07:33:35,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99d45d09fe59064f07c70 2026-05-07 07:33:35,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:33:35,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99d45d09fe59064f07c70 HTTP/1.1" 200 None 2026-05-07 07:33:35,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:33:35,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-07 07:33:35,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:33:35,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99d45d09fe59064f07c70 HTTP/1.1" 200 None 2026-05-07 07:33:35,340 - lava_callback - ERROR - Error processing callback for node 69f99d45d09fe59064f07c70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39764 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:34:44,298 - lava_callback - INFO - Received callback for node 69f99d90d09fe59064f07c93 INFO: 172.21.0.1:60596 - "POST /node/69f99d90d09fe59064f07c93 HTTP/1.0" 202 Accepted 2026-05-07 07:34:44,304 - lava_callback - INFO - Starting async job submit for node 69f99d90d09fe59064f07c93 2026-05-07 07:34:44,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:34:44,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99d90d09fe59064f07c93 HTTP/1.1" 200 None 2026-05-07 07:34:44,318 - lava_callback - DEBUG - Processing node 69f99d90d09fe59064f07c93: baseline-arm64-baylibre 2026-05-07 07:34:44,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99d90d09fe59064f07c93 2026-05-07 07:34:44,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:34:44,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99d90d09fe59064f07c93 HTTP/1.1" 200 None 2026-05-07 07:34:44,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:34:44,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:34:44,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:34:44,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99d90d09fe59064f07c93 HTTP/1.1" 200 None 2026-05-07 07:34:44,370 - lava_callback - ERROR - Error processing callback for node 69f99d90d09fe59064f07c93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-07 07:36:15,334 - lava_callback - INFO - Received callback for node 69f99de7d09fe59064f07cb8 INFO: 172.21.0.1:41070 - "POST /node/69f99de7d09fe59064f07cb8 HTTP/1.0" 202 Accepted 2026-05-07 07:36:15,340 - lava_callback - INFO - Starting async job submit for node 69f99de7d09fe59064f07cb8 2026-05-07 07:36:15,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:36:15,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99de7d09fe59064f07cb8 HTTP/1.1" 200 None 2026-05-07 07:36:15,359 - lava_callback - DEBUG - Processing node 69f99de7d09fe59064f07cb8: baseline-arm64-clabbe 2026-05-07 07:36:15,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99de7d09fe59064f07cb8 2026-05-07 07:36:15,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:36:15,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99de7d09fe59064f07cb8 HTTP/1.1" 200 None 2026-05-07 07:36:15,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:36:15,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:36:15,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:36:15,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99de7d09fe59064f07cb8 HTTP/1.1" 200 None 2026-05-07 07:36:15,438 - lava_callback - ERROR - Error processing callback for node 69f99de7d09fe59064f07cb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:37:35,401 - lava_callback - INFO - Received callback for node 69f99e39d09fe59064f07ce0 INFO: 172.21.0.1:46906 - "POST /node/69f99e39d09fe59064f07ce0 HTTP/1.0" 202 Accepted 2026-05-07 07:37:35,411 - lava_callback - INFO - Starting async job submit for node 69f99e39d09fe59064f07ce0 2026-05-07 07:37:35,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:37:35,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99e39d09fe59064f07ce0 HTTP/1.1" 200 None 2026-05-07 07:37:35,436 - lava_callback - DEBUG - Processing node 69f99e39d09fe59064f07ce0: baseline-arm64-clabbe 2026-05-07 07:37:35,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99e39d09fe59064f07ce0 2026-05-07 07:37:35,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:37:35,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99e39d09fe59064f07ce0 HTTP/1.1" 200 None 2026-05-07 07:37:35,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:37:35,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:37:35,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:37:35,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99e39d09fe59064f07ce0 HTTP/1.1" 200 None 2026-05-07 07:37:35,511 - lava_callback - ERROR - Error processing callback for node 69f99e39d09fe59064f07ce0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:38:55,450 - lava_callback - INFO - Received callback for node 69f99e8ad09fe59064f07cf7 INFO: 172.21.0.1:56538 - "POST /node/69f99e8ad09fe59064f07cf7 HTTP/1.0" 202 Accepted 2026-05-07 07:38:55,457 - lava_callback - INFO - Starting async job submit for node 69f99e8ad09fe59064f07cf7 2026-05-07 07:38:55,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:38:55,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99e8ad09fe59064f07cf7 HTTP/1.1" 200 None 2026-05-07 07:38:55,474 - lava_callback - DEBUG - Processing node 69f99e8ad09fe59064f07cf7: baseline-arm64-clabbe 2026-05-07 07:38:55,474 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99e8ad09fe59064f07cf7 2026-05-07 07:38:55,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:38:55,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99e8ad09fe59064f07cf7 HTTP/1.1" 200 None 2026-05-07 07:38:55,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:38:55,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:38:55,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:38:55,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99e8ad09fe59064f07cf7 HTTP/1.1" 200 None 2026-05-07 07:38:55,560 - lava_callback - ERROR - Error processing callback for node 69f99e8ad09fe59064f07cf7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-07 07:40:15,416 - lava_callback - INFO - Received callback for node 69f99edcd09fe59064f07d18 INFO: 172.21.0.1:41600 - "POST /node/69f99edcd09fe59064f07d18 HTTP/1.0" 202 Accepted 2026-05-07 07:40:15,421 - lava_callback - INFO - Starting async job submit for node 69f99edcd09fe59064f07d18 2026-05-07 07:40:15,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:40:15,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99edcd09fe59064f07d18 HTTP/1.1" 200 None 2026-05-07 07:40:15,437 - lava_callback - DEBUG - Processing node 69f99edcd09fe59064f07d18: baseline-arm64-clabbe 2026-05-07 07:40:15,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99edcd09fe59064f07d18 2026-05-07 07:40:15,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:40:15,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99edcd09fe59064f07d18 HTTP/1.1" 200 None 2026-05-07 07:40:15,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:40:15,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:40:15,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:40:15,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99edcd09fe59064f07d18 HTTP/1.1" 200 None 2026-05-07 07:40:15,483 - lava_callback - ERROR - Error processing callback for node 69f99edcd09fe59064f07d18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:41:55,575 - lava_callback - INFO - Received callback for node 69f99f2dd09fe59064f07d3b INFO: 172.21.0.1:59002 - "POST /node/69f99f2dd09fe59064f07d3b HTTP/1.0" 202 Accepted 2026-05-07 07:41:55,581 - lava_callback - INFO - Starting async job submit for node 69f99f2dd09fe59064f07d3b 2026-05-07 07:41:55,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:41:55,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99f2dd09fe59064f07d3b HTTP/1.1" 200 None 2026-05-07 07:41:55,598 - lava_callback - DEBUG - Processing node 69f99f2dd09fe59064f07d3b: baseline-arm64-clabbe 2026-05-07 07:41:55,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99f2dd09fe59064f07d3b 2026-05-07 07:41:55,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:41:55,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99f2dd09fe59064f07d3b HTTP/1.1" 200 None 2026-05-07 07:41:55,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:41:55,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:41:55,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:41:55,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99f2dd09fe59064f07d3b HTTP/1.1" 200 None 2026-05-07 07:41:55,662 - lava_callback - ERROR - Error processing callback for node 69f99f2dd09fe59064f07d3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-07 07:43:15,586 - lava_callback - INFO - Received callback for node 69f99f7fd09fe59064f07d56 INFO: 172.21.0.1:46302 - "POST /node/69f99f7fd09fe59064f07d56 HTTP/1.0" 202 Accepted 2026-05-07 07:43:15,592 - lava_callback - INFO - Starting async job submit for node 69f99f7fd09fe59064f07d56 2026-05-07 07:43:15,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:43:15,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99f7fd09fe59064f07d56 HTTP/1.1" 200 None 2026-05-07 07:43:15,607 - lava_callback - DEBUG - Processing node 69f99f7fd09fe59064f07d56: baseline-arm64-clabbe 2026-05-07 07:43:15,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99f7fd09fe59064f07d56 2026-05-07 07:43:15,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:43:15,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99f7fd09fe59064f07d56 HTTP/1.1" 200 None 2026-05-07 07:43:15,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:43:15,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:43:15,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:43:15,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99f7fd09fe59064f07d56 HTTP/1.1" 200 None 2026-05-07 07:43:15,655 - lava_callback - ERROR - Error processing callback for node 69f99f7fd09fe59064f07d56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44306 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:44:35,643 - lava_callback - INFO - Received callback for node 69f99fd1d09fe59064f07d7b INFO: 172.21.0.1:54132 - "POST /node/69f99fd1d09fe59064f07d7b HTTP/1.0" 202 Accepted 2026-05-07 07:44:35,648 - lava_callback - INFO - Starting async job submit for node 69f99fd1d09fe59064f07d7b 2026-05-07 07:44:35,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:44:35,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99fd1d09fe59064f07d7b HTTP/1.1" 200 None 2026-05-07 07:44:35,663 - lava_callback - DEBUG - Processing node 69f99fd1d09fe59064f07d7b: baseline-arm64-clabbe 2026-05-07 07:44:35,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f99fd1d09fe59064f07d7b 2026-05-07 07:44:35,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:44:35,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f99fd1d09fe59064f07d7b HTTP/1.1" 200 None 2026-05-07 07:44:35,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:44:35,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:44:35,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:44:35,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f99fd1d09fe59064f07d7b HTTP/1.1" 200 None 2026-05-07 07:44:35,710 - lava_callback - ERROR - Error processing callback for node 69f99fd1d09fe59064f07d7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK 2026-05-07 07:45:55,800 - lava_callback - INFO - Received callback for node 69f9a025d09fe59064f07d9e INFO: 172.21.0.1:35086 - "POST /node/69f9a025d09fe59064f07d9e HTTP/1.0" 202 Accepted 2026-05-07 07:45:55,822 - lava_callback - INFO - Starting async job submit for node 69f9a025d09fe59064f07d9e 2026-05-07 07:45:55,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:45:55,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a025d09fe59064f07d9e HTTP/1.1" 200 None 2026-05-07 07:45:55,847 - lava_callback - DEBUG - Processing node 69f9a025d09fe59064f07d9e: baseline-arm64-clabbe 2026-05-07 07:45:55,847 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9a025d09fe59064f07d9e 2026-05-07 07:45:55,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:45:55,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a025d09fe59064f07d9e HTTP/1.1" 200 None 2026-05-07 07:45:55,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:45:55,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:45:55,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:45:55,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9a025d09fe59064f07d9e HTTP/1.1" 200 None 2026-05-07 07:45:55,895 - lava_callback - ERROR - Error processing callback for node 69f9a025d09fe59064f07d9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-07 07:47:15,738 - lava_callback - INFO - Received callback for node 69f9a07ad09fe59064f07dc1 INFO: 172.21.0.1:54218 - "POST /node/69f9a07ad09fe59064f07dc1 HTTP/1.0" 202 Accepted 2026-05-07 07:47:15,744 - lava_callback - INFO - Starting async job submit for node 69f9a07ad09fe59064f07dc1 2026-05-07 07:47:15,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:47:15,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a07ad09fe59064f07dc1 HTTP/1.1" 200 None 2026-05-07 07:47:15,759 - lava_callback - DEBUG - Processing node 69f9a07ad09fe59064f07dc1: baseline-arm64-clabbe 2026-05-07 07:47:15,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9a07ad09fe59064f07dc1 2026-05-07 07:47:15,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:47:15,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a07ad09fe59064f07dc1 HTTP/1.1" 200 None 2026-05-07 07:47:15,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:47:15,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-07 07:47:15,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 07:47:15,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9a07ad09fe59064f07dc1 HTTP/1.1" 200 None 2026-05-07 07:47:15,805 - lava_callback - ERROR - Error processing callback for node 69f9a07ad09fe59064f07dc1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET /login HTTP/1.0" 404 Not Found INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]