INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:23:55,211 - lava_callback - INFO - Received callback for node 69f8c8170573a8210e12ce5a 2026-05-06 16:23:55,217 - lava_callback - INFO - Starting async job submit for node 69f8c8170573a8210e12ce5a INFO: 172.21.0.1:58974 - "POST /node/69f8c8170573a8210e12ce5a HTTP/1.0" 202 Accepted 2026-05-06 16:23:55,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:23:55,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c8170573a8210e12ce5a HTTP/1.1" 200 None 2026-05-06 16:23:55,245 - lava_callback - DEBUG - Processing node 69f8c8170573a8210e12ce5a: baseline-arm64-baylibre 2026-05-06 16:23:55,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8c8170573a8210e12ce5a 2026-05-06 16:23:55,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:23:55,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c8170573a8210e12ce5a HTTP/1.1" 200 None 2026-05-06 16:23:55,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:23:55,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 16:23:55,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:23:55,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8c8170573a8210e12ce5a HTTP/1.1" 200 None 2026-05-06 16:23:55,299 - lava_callback - ERROR - Error processing callback for node 69f8c8170573a8210e12ce5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:25:14,982 - lava_callback - INFO - Received callback for node 69f8c8690573a8210e12ce89 INFO: 172.21.0.1:49114 - "POST /node/69f8c8690573a8210e12ce89 HTTP/1.0" 202 Accepted 2026-05-06 16:25:14,988 - lava_callback - INFO - Starting async job submit for node 69f8c8690573a8210e12ce89 2026-05-06 16:25:14,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:25:15,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c8690573a8210e12ce89 HTTP/1.1" 200 None 2026-05-06 16:25:15,003 - lava_callback - DEBUG - Processing node 69f8c8690573a8210e12ce89: baseline-arm64-baylibre 2026-05-06 16:25:15,004 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8c8690573a8210e12ce89 2026-05-06 16:25:15,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:25:15,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c8690573a8210e12ce89 HTTP/1.1" 200 None 2026-05-06 16:25:15,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:25:15,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 16:25:15,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:25:15,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8c8690573a8210e12ce89 HTTP/1.1" 200 None 2026-05-06 16:25:15,051 - lava_callback - ERROR - Error processing callback for node 69f8c8690573a8210e12ce89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:26:55,042 - lava_callback - INFO - Received callback for node 69f8c8bd0573a8210e12cebd INFO: 172.21.0.1:39666 - "POST /node/69f8c8bd0573a8210e12cebd HTTP/1.0" 202 Accepted 2026-05-06 16:26:55,048 - lava_callback - INFO - Starting async job submit for node 69f8c8bd0573a8210e12cebd 2026-05-06 16:26:55,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:26:55,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c8bd0573a8210e12cebd HTTP/1.1" 200 None 2026-05-06 16:26:55,063 - lava_callback - DEBUG - Processing node 69f8c8bd0573a8210e12cebd: baseline-arm64-baylibre 2026-05-06 16:26:55,063 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8c8bd0573a8210e12cebd 2026-05-06 16:26:55,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:26:55,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c8bd0573a8210e12cebd HTTP/1.1" 200 None 2026-05-06 16:26:55,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:26:55,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 16:26:55,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:26:55,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8c8bd0573a8210e12cebd HTTP/1.1" 200 None 2026-05-06 16:26:55,109 - lava_callback - ERROR - Error processing callback for node 69f8c8bd0573a8210e12cebd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 16:28:15,172 - lava_callback - INFO - Received callback for node 69f8c9110573a8210e12cf09 INFO: 172.21.0.1:47962 - "POST /node/69f8c9110573a8210e12cf09 HTTP/1.0" 202 Accepted 2026-05-06 16:28:15,177 - lava_callback - INFO - Starting async job submit for node 69f8c9110573a8210e12cf09 2026-05-06 16:28:15,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:28:15,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c9110573a8210e12cf09 HTTP/1.1" 200 None 2026-05-06 16:28:15,195 - lava_callback - DEBUG - Processing node 69f8c9110573a8210e12cf09: baseline-arm64-baylibre 2026-05-06 16:28:15,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8c9110573a8210e12cf09 2026-05-06 16:28:15,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:28:15,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c9110573a8210e12cf09 HTTP/1.1" 200 None 2026-05-06 16:28:15,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:28:15,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 16:28:15,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:28:15,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8c9110573a8210e12cf09 HTTP/1.1" 200 None 2026-05-06 16:28:15,243 - lava_callback - ERROR - Error processing callback for node 69f8c9110573a8210e12cf09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:29:35,449 - lava_callback - INFO - Received callback for node 69f8c9660573a8210e12cf60 INFO: 172.21.0.1:37724 - "POST /node/69f8c9660573a8210e12cf60 HTTP/1.0" 202 Accepted 2026-05-06 16:29:35,459 - lava_callback - INFO - Starting async job submit for node 69f8c9660573a8210e12cf60 2026-05-06 16:29:35,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:29:35,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c9660573a8210e12cf60 HTTP/1.1" 200 None 2026-05-06 16:29:35,484 - lava_callback - DEBUG - Processing node 69f8c9660573a8210e12cf60: baseline-arm64-baylibre 2026-05-06 16:29:35,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8c9660573a8210e12cf60 2026-05-06 16:29:35,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:29:35,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c9660573a8210e12cf60 HTTP/1.1" 200 None 2026-05-06 16:29:35,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:29:35,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 16:29:35,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:29:35,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8c9660573a8210e12cf60 HTTP/1.1" 200 None 2026-05-06 16:29:35,550 - lava_callback - ERROR - Error processing callback for node 69f8c9660573a8210e12cf60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:30:55,282 - lava_callback - INFO - Received callback for node 69f8c9b80573a8210e12cfad INFO: 172.21.0.1:43482 - "POST /node/69f8c9b80573a8210e12cfad HTTP/1.0" 202 Accepted 2026-05-06 16:30:55,287 - lava_callback - INFO - Starting async job submit for node 69f8c9b80573a8210e12cfad 2026-05-06 16:30:55,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:30:55,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c9b80573a8210e12cfad HTTP/1.1" 200 None 2026-05-06 16:30:55,304 - lava_callback - DEBUG - Processing node 69f8c9b80573a8210e12cfad: baseline-arm64-baylibre 2026-05-06 16:30:55,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8c9b80573a8210e12cfad 2026-05-06 16:30:55,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:30:55,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c9b80573a8210e12cfad HTTP/1.1" 200 None 2026-05-06 16:30:55,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:30:55,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 16:30:55,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:30:55,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8c9b80573a8210e12cfad HTTP/1.1" 200 None 2026-05-06 16:30:55,358 - lava_callback - ERROR - Error processing callback for node 69f8c9b80573a8210e12cfad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:32:38,981 - lava_callback - INFO - Received callback for node 69f8ca110573a8210e12cffe INFO: 172.21.0.1:36842 - "POST /node/69f8ca110573a8210e12cffe HTTP/1.0" 202 Accepted 2026-05-06 16:32:38,987 - lava_callback - INFO - Starting async job submit for node 69f8ca110573a8210e12cffe 2026-05-06 16:32:38,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:32:39,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ca110573a8210e12cffe HTTP/1.1" 200 None 2026-05-06 16:32:39,002 - lava_callback - DEBUG - Processing node 69f8ca110573a8210e12cffe: baseline-arm64-clabbe 2026-05-06 16:32:39,002 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ca110573a8210e12cffe 2026-05-06 16:32:39,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:32:39,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ca110573a8210e12cffe HTTP/1.1" 200 None 2026-05-06 16:32:39,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:32:39,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 16:32:39,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:32:39,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ca110573a8210e12cffe HTTP/1.1" 200 None 2026-05-06 16:32:39,049 - lava_callback - ERROR - Error processing callback for node 69f8ca110573a8210e12cffe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:33:59,031 - lava_callback - INFO - Received callback for node 69f8ca650573a8210e12d047 INFO: 172.21.0.1:57466 - "POST /node/69f8ca650573a8210e12d047 HTTP/1.0" 202 Accepted 2026-05-06 16:33:59,037 - lava_callback - INFO - Starting async job submit for node 69f8ca650573a8210e12d047 2026-05-06 16:33:59,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:33:59,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ca650573a8210e12d047 HTTP/1.1" 200 None 2026-05-06 16:33:59,052 - lava_callback - DEBUG - Processing node 69f8ca650573a8210e12d047: baseline-arm64-clabbe 2026-05-06 16:33:59,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ca650573a8210e12d047 2026-05-06 16:33:59,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:33:59,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ca650573a8210e12d047 HTTP/1.1" 200 None 2026-05-06 16:33:59,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:33:59,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 16:33:59,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:33:59,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ca650573a8210e12d047 HTTP/1.1" 200 None 2026-05-06 16:33:59,110 - lava_callback - ERROR - Error processing callback for node 69f8ca650573a8210e12d047: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45814 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:35:19,113 - lava_callback - INFO - Received callback for node 69f8caba0573a8210e12f7ca INFO: 172.21.0.1:45830 - "POST /node/69f8caba0573a8210e12f7ca HTTP/1.0" 202 Accepted 2026-05-06 16:35:19,119 - lava_callback - INFO - Starting async job submit for node 69f8caba0573a8210e12f7ca 2026-05-06 16:35:19,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:35:19,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8caba0573a8210e12f7ca HTTP/1.1" 200 None 2026-05-06 16:35:19,135 - lava_callback - DEBUG - Processing node 69f8caba0573a8210e12f7ca: baseline-arm64-clabbe 2026-05-06 16:35:19,135 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8caba0573a8210e12f7ca 2026-05-06 16:35:19,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:35:19,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8caba0573a8210e12f7ca HTTP/1.1" 200 None 2026-05-06 16:35:19,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:35:19,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 16:35:19,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:35:19,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8caba0573a8210e12f7ca HTTP/1.1" 200 None 2026-05-06 16:35:19,193 - lava_callback - ERROR - Error processing callback for node 69f8caba0573a8210e12f7ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:36:39,120 - lava_callback - INFO - Received callback for node 69f8cb110573a8210e12f825 INFO: 172.21.0.1:49370 - "POST /node/69f8cb110573a8210e12f825 HTTP/1.0" 202 Accepted 2026-05-06 16:36:39,126 - lava_callback - INFO - Starting async job submit for node 69f8cb110573a8210e12f825 2026-05-06 16:36:39,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:36:39,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cb110573a8210e12f825 HTTP/1.1" 200 None 2026-05-06 16:36:39,142 - lava_callback - DEBUG - Processing node 69f8cb110573a8210e12f825: baseline-arm64-clabbe 2026-05-06 16:36:39,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cb110573a8210e12f825 2026-05-06 16:36:39,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:36:39,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cb110573a8210e12f825 HTTP/1.1" 200 None 2026-05-06 16:36:39,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:36:39,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 16:36:39,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:36:39,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cb110573a8210e12f825 HTTP/1.1" 200 None 2026-05-06 16:36:39,188 - lava_callback - ERROR - Error processing callback for node 69f8cb110573a8210e12f825: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45488 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:38:19,171 - lava_callback - INFO - Received callback for node 69f8cb670573a8210e12f87e INFO: 172.21.0.1:45502 - "POST /node/69f8cb670573a8210e12f87e HTTP/1.0" 202 Accepted 2026-05-06 16:38:19,177 - lava_callback - INFO - Starting async job submit for node 69f8cb670573a8210e12f87e 2026-05-06 16:38:19,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:38:19,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cb670573a8210e12f87e HTTP/1.1" 200 None 2026-05-06 16:38:19,192 - lava_callback - DEBUG - Processing node 69f8cb670573a8210e12f87e: baseline-arm64-clabbe 2026-05-06 16:38:19,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cb670573a8210e12f87e 2026-05-06 16:38:19,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:38:19,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cb670573a8210e12f87e HTTP/1.1" 200 None 2026-05-06 16:38:19,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:38:19,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 16:38:19,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:38:19,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cb670573a8210e12f87e HTTP/1.1" 200 None 2026-05-06 16:38:19,250 - lava_callback - ERROR - Error processing callback for node 69f8cb670573a8210e12f87e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:39:39,261 - lava_callback - INFO - Received callback for node 69f8cbbe0573a8210e12f8d7 INFO: 172.21.0.1:53854 - "POST /node/69f8cbbe0573a8210e12f8d7 HTTP/1.0" 202 Accepted 2026-05-06 16:39:39,270 - lava_callback - INFO - Starting async job submit for node 69f8cbbe0573a8210e12f8d7 2026-05-06 16:39:39,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:39:39,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cbbe0573a8210e12f8d7 HTTP/1.1" 200 None 2026-05-06 16:39:39,300 - lava_callback - DEBUG - Processing node 69f8cbbe0573a8210e12f8d7: baseline-arm64-clabbe 2026-05-06 16:39:39,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cbbe0573a8210e12f8d7 2026-05-06 16:39:39,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:39:39,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cbbe0573a8210e12f8d7 HTTP/1.1" 200 None 2026-05-06 16:39:39,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:39:39,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 16:39:39,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:39:39,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cbbe0573a8210e12f8d7 HTTP/1.1" 200 None 2026-05-06 16:39:39,348 - lava_callback - ERROR - Error processing callback for node 69f8cbbe0573a8210e12f8d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57346 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 16:42:15,940 - lava_callback - INFO - Received callback for node 69f8cc5a0573a8210e12f930 INFO: 172.21.0.1:57356 - "POST /node/69f8cc5a0573a8210e12f930 HTTP/1.0" 202 Accepted 2026-05-06 16:42:15,945 - lava_callback - INFO - Starting async job submit for node 69f8cc5a0573a8210e12f930 2026-05-06 16:42:15,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:42:15,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cc5a0573a8210e12f930 HTTP/1.1" 200 None 2026-05-06 16:42:15,961 - lava_callback - DEBUG - Processing node 69f8cc5a0573a8210e12f930: baseline-arm-baylibre 2026-05-06 16:42:15,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cc5a0573a8210e12f930 2026-05-06 16:42:15,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:42:15,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cc5a0573a8210e12f930 HTTP/1.1" 200 None 2026-05-06 16:42:15,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:42:15,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 16:42:15,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:42:16,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cc5a0573a8210e12f930 HTTP/1.1" 200 None 2026-05-06 16:42:16,007 - lava_callback - ERROR - Error processing callback for node 69f8cc5a0573a8210e12f930: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:42:55,849 - lava_callback - INFO - Received callback for node 69f8cc850573a8210e12f956 INFO: 172.21.0.1:58472 - "POST /node/69f8cc850573a8210e12f956 HTTP/1.0" 202 Accepted 2026-05-06 16:42:55,855 - lava_callback - INFO - Starting async job submit for node 69f8cc850573a8210e12f956 2026-05-06 16:42:55,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:42:55,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cc850573a8210e12f956 HTTP/1.1" 200 None 2026-05-06 16:42:55,877 - lava_callback - DEBUG - Processing node 69f8cc850573a8210e12f956: baseline-arm-baylibre 2026-05-06 16:42:55,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cc850573a8210e12f956 2026-05-06 16:42:55,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:42:55,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cc850573a8210e12f956 HTTP/1.1" 200 None 2026-05-06 16:42:55,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:42:55,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 16:42:55,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:42:55,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cc850573a8210e12f956 HTTP/1.1" 200 None 2026-05-06 16:42:55,947 - lava_callback - ERROR - Error processing callback for node 69f8cc850573a8210e12f956: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:43:35,907 - lava_callback - INFO - Received callback for node 69f8ccaf0573a8210e12f9aa INFO: 172.21.0.1:51892 - "POST /node/69f8ccaf0573a8210e12f9aa HTTP/1.0" 202 Accepted 2026-05-06 16:43:35,912 - lava_callback - INFO - Starting async job submit for node 69f8ccaf0573a8210e12f9aa 2026-05-06 16:43:35,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:43:35,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ccaf0573a8210e12f9aa HTTP/1.1" 200 None 2026-05-06 16:43:35,927 - lava_callback - DEBUG - Processing node 69f8ccaf0573a8210e12f9aa: baseline-arm-baylibre 2026-05-06 16:43:35,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ccaf0573a8210e12f9aa 2026-05-06 16:43:35,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:43:35,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ccaf0573a8210e12f9aa HTTP/1.1" 200 None 2026-05-06 16:43:35,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:43:35,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 16:43:35,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:43:35,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ccaf0573a8210e12f9aa HTTP/1.1" 200 None 2026-05-06 16:43:35,970 - lava_callback - ERROR - Error processing callback for node 69f8ccaf0573a8210e12f9aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 16:44:15,916 - lava_callback - INFO - Received callback for node 69f8ccde0573a8210e12f9c9 INFO: 172.21.0.1:58532 - "POST /node/69f8ccde0573a8210e12f9c9 HTTP/1.0" 202 Accepted 2026-05-06 16:44:15,922 - lava_callback - INFO - Starting async job submit for node 69f8ccde0573a8210e12f9c9 2026-05-06 16:44:15,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:44:15,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ccde0573a8210e12f9c9 HTTP/1.1" 200 None 2026-05-06 16:44:15,938 - lava_callback - DEBUG - Processing node 69f8ccde0573a8210e12f9c9: baseline-arm-baylibre 2026-05-06 16:44:15,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ccde0573a8210e12f9c9 2026-05-06 16:44:15,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:44:15,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ccde0573a8210e12f9c9 HTTP/1.1" 200 None 2026-05-06 16:44:15,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:44:15,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 16:44:15,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:44:15,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ccde0573a8210e12f9c9 HTTP/1.1" 200 None 2026-05-06 16:44:15,983 - lava_callback - ERROR - Error processing callback for node 69f8ccde0573a8210e12f9c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 16:45:16,109 - lava_callback - INFO - Received callback for node 69f8cd0d0573a8210e12fa0e INFO: 172.21.0.1:57196 - "POST /node/69f8cd0d0573a8210e12fa0e HTTP/1.0" 202 Accepted 2026-05-06 16:45:16,115 - lava_callback - INFO - Starting async job submit for node 69f8cd0d0573a8210e12fa0e 2026-05-06 16:45:16,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:45:16,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cd0d0573a8210e12fa0e HTTP/1.1" 200 None 2026-05-06 16:45:16,130 - lava_callback - DEBUG - Processing node 69f8cd0d0573a8210e12fa0e: baseline-arm-baylibre 2026-05-06 16:45:16,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cd0d0573a8210e12fa0e 2026-05-06 16:45:16,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:45:16,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cd0d0573a8210e12fa0e HTTP/1.1" 200 None 2026-05-06 16:45:16,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:45:16,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 16:45:16,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:45:16,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cd0d0573a8210e12fa0e HTTP/1.1" 200 None 2026-05-06 16:45:16,184 - lava_callback - ERROR - Error processing callback for node 69f8cd0d0573a8210e12fa0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:45:56,031 - lava_callback - INFO - Received callback for node 69f8cd390573a8210e12fa2e INFO: 172.21.0.1:50178 - "POST /node/69f8cd390573a8210e12fa2e HTTP/1.0" 202 Accepted 2026-05-06 16:45:56,036 - lava_callback - INFO - Starting async job submit for node 69f8cd390573a8210e12fa2e 2026-05-06 16:45:56,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:45:56,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cd390573a8210e12fa2e HTTP/1.1" 200 None 2026-05-06 16:45:56,059 - lava_callback - DEBUG - Processing node 69f8cd390573a8210e12fa2e: baseline-arm-baylibre 2026-05-06 16:45:56,059 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cd390573a8210e12fa2e 2026-05-06 16:45:56,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:45:56,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cd390573a8210e12fa2e HTTP/1.1" 200 None 2026-05-06 16:45:56,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:45:56,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 16:45:56,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:45:56,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cd390573a8210e12fa2e HTTP/1.1" 200 None 2026-05-06 16:45:56,113 - lava_callback - ERROR - Error processing callback for node 69f8cd390573a8210e12fa2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42402 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:46:39,576 - lava_callback - INFO - Received callback for node 69f8cd690573a8210e12fa78 INFO: 172.21.0.1:42416 - "POST /node/69f8cd690573a8210e12fa78 HTTP/1.0" 202 Accepted 2026-05-06 16:46:39,581 - lava_callback - INFO - Starting async job submit for node 69f8cd690573a8210e12fa78 2026-05-06 16:46:39,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:46:39,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cd690573a8210e12fa78 HTTP/1.1" 200 None 2026-05-06 16:46:39,682 - lava_callback - DEBUG - Processing node 69f8cd690573a8210e12fa78: baseline-arm-clabbe 2026-05-06 16:46:39,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cd690573a8210e12fa78 2026-05-06 16:46:39,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:46:39,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cd690573a8210e12fa78 HTTP/1.1" 200 None 2026-05-06 16:46:39,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:46:39,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 16:46:39,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:46:39,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cd690573a8210e12fa78 HTTP/1.1" 200 None 2026-05-06 16:46:39,738 - lava_callback - ERROR - Error processing callback for node 69f8cd690573a8210e12fa78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51152 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:47:39,487 - lava_callback - INFO - Received callback for node 69f8cd970573a8210e12fa97 INFO: 172.21.0.1:51166 - "POST /node/69f8cd970573a8210e12fa97 HTTP/1.0" 202 Accepted 2026-05-06 16:47:39,493 - lava_callback - INFO - Starting async job submit for node 69f8cd970573a8210e12fa97 2026-05-06 16:47:39,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:39,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cd970573a8210e12fa97 HTTP/1.1" 200 None 2026-05-06 16:47:39,508 - lava_callback - DEBUG - Processing node 69f8cd970573a8210e12fa97: baseline-arm-clabbe 2026-05-06 16:47:39,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cd970573a8210e12fa97 2026-05-06 16:47:39,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:39,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cd970573a8210e12fa97 HTTP/1.1" 200 None 2026-05-06 16:47:39,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:39,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 16:47:39,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:39,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cd970573a8210e12fa97 HTTP/1.1" 200 None 2026-05-06 16:47:39,553 - lava_callback - ERROR - Error processing callback for node 69f8cd970573a8210e12fa97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:47:56,235 - lava_callback - INFO - Received callback for node 69f8cdad0573a8210e12fad4 INFO: 172.21.0.1:44036 - "POST /node/69f8cdad0573a8210e12fad4 HTTP/1.0" 202 Accepted 2026-05-06 16:47:56,240 - lava_callback - INFO - Starting async job submit for node 69f8cdad0573a8210e12fad4 2026-05-06 16:47:56,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:56,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdad0573a8210e12fad4 HTTP/1.1" 200 None 2026-05-06 16:47:56,255 - lava_callback - DEBUG - Processing node 69f8cdad0573a8210e12fad4: baseline-arm-baylibre 2026-05-06 16:47:56,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdad0573a8210e12fad4 2026-05-06 16:47:56,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:56,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdad0573a8210e12fad4 HTTP/1.1" 200 None 2026-05-06 16:47:56,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:56,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 16:47:56,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:56,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdad0573a8210e12fad4 HTTP/1.1" 200 None 2026-05-06 16:47:56,305 - lava_callback - ERROR - Error processing callback for node 69f8cdad0573a8210e12fad4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:47:56,900 - lava_callback - INFO - Received callback for node 69f8cdae0573a8210e12fad7 INFO: 172.21.0.1:44046 - "POST /node/69f8cdae0573a8210e12fad7 HTTP/1.0" 202 Accepted 2026-05-06 16:47:56,906 - lava_callback - INFO - Starting async job submit for node 69f8cdae0573a8210e12fad7 2026-05-06 16:47:56,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:56,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdae0573a8210e12fad7 HTTP/1.1" 200 None 2026-05-06 16:47:56,921 - lava_callback - DEBUG - Processing node 69f8cdae0573a8210e12fad7: baseline-arm-baylibre 2026-05-06 16:47:56,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdae0573a8210e12fad7 2026-05-06 16:47:56,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:56,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdae0573a8210e12fad7 HTTP/1.1" 200 None 2026-05-06 16:47:56,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:56,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 16:47:56,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:56,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdae0573a8210e12fad7 HTTP/1.1" 200 None 2026-05-06 16:47:56,966 - lava_callback - ERROR - Error processing callback for node 69f8cdae0573a8210e12fad7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 16:47:57,547 - lava_callback - INFO - Received callback for node 69f8cdaf0573a8210e12fadc INFO: 172.21.0.1:44052 - "POST /node/69f8cdaf0573a8210e12fadc HTTP/1.0" 202 Accepted 2026-05-06 16:47:57,556 - lava_callback - INFO - Starting async job submit for node 69f8cdaf0573a8210e12fadc 2026-05-06 16:47:57,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:57,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdaf0573a8210e12fadc HTTP/1.1" 200 None 2026-05-06 16:47:57,571 - lava_callback - DEBUG - Processing node 69f8cdaf0573a8210e12fadc: baseline-arm-baylibre 2026-05-06 16:47:57,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdaf0573a8210e12fadc 2026-05-06 16:47:57,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:57,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdaf0573a8210e12fadc HTTP/1.1" 200 None 2026-05-06 16:47:57,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:57,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 16:47:57,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:57,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdaf0573a8210e12fadc HTTP/1.1" 200 None 2026-05-06 16:47:57,629 - lava_callback - ERROR - Error processing callback for node 69f8cdaf0573a8210e12fadc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 16:47:58,212 - lava_callback - INFO - Received callback for node 69f8cdb00573a8210e12fadf INFO: 172.21.0.1:44062 - "POST /node/69f8cdb00573a8210e12fadf HTTP/1.0" 202 Accepted 2026-05-06 16:47:58,218 - lava_callback - INFO - Starting async job submit for node 69f8cdb00573a8210e12fadf 2026-05-06 16:47:58,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:58,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdb00573a8210e12fadf HTTP/1.1" 200 None 2026-05-06 16:47:58,232 - lava_callback - DEBUG - Processing node 69f8cdb00573a8210e12fadf: baseline-arm-baylibre 2026-05-06 16:47:58,233 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdb00573a8210e12fadf 2026-05-06 16:47:58,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:58,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdb00573a8210e12fadf HTTP/1.1" 200 None 2026-05-06 16:47:58,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:58,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 16:47:58,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:58,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdb00573a8210e12fadf HTTP/1.1" 200 None 2026-05-06 16:47:58,286 - lava_callback - ERROR - Error processing callback for node 69f8cdb00573a8210e12fadf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 16:47:58,905 - lava_callback - INFO - Received callback for node 69f8cdb30573a8210e12faea INFO: 172.21.0.1:44078 - "POST /node/69f8cdb30573a8210e12faea HTTP/1.0" 202 Accepted 2026-05-06 16:47:58,910 - lava_callback - INFO - Starting async job submit for node 69f8cdb30573a8210e12faea 2026-05-06 16:47:58,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:58,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdb30573a8210e12faea HTTP/1.1" 200 None 2026-05-06 16:47:58,925 - lava_callback - DEBUG - Processing node 69f8cdb30573a8210e12faea: baseline-arm-baylibre 2026-05-06 16:47:58,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdb30573a8210e12faea 2026-05-06 16:47:58,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:58,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdb30573a8210e12faea HTTP/1.1" 200 None 2026-05-06 16:47:58,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:58,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 16:47:58,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:58,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdb30573a8210e12faea HTTP/1.1" 200 None 2026-05-06 16:47:58,971 - lava_callback - ERROR - Error processing callback for node 69f8cdb30573a8210e12faea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 16:47:59,506 - lava_callback - INFO - Received callback for node 69f8cdbb0573a8210e12fb32 INFO: 172.21.0.1:44090 - "POST /node/69f8cdbb0573a8210e12fb32 HTTP/1.0" 202 Accepted 2026-05-06 16:47:59,516 - lava_callback - INFO - Starting async job submit for node 69f8cdbb0573a8210e12fb32 2026-05-06 16:47:59,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:59,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdbb0573a8210e12fb32 HTTP/1.1" 200 None 2026-05-06 16:47:59,533 - lava_callback - DEBUG - Processing node 69f8cdbb0573a8210e12fb32: baseline-arm-clabbe 2026-05-06 16:47:59,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdbb0573a8210e12fb32 2026-05-06 16:47:59,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:59,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdbb0573a8210e12fb32 HTTP/1.1" 200 None 2026-05-06 16:47:59,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:59,553 - lava_callback - INFO - Received callback for node 69f8cdb40573a8210e12faed 2026-05-06 16:47:59,559 - lava_callback - INFO - Starting async job submit for node 69f8cdb40573a8210e12faed INFO: 172.21.0.1:44098 - "POST /node/69f8cdb40573a8210e12faed HTTP/1.0" 202 Accepted 2026-05-06 16:47:59,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:59,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 16:47:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:59,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdb40573a8210e12faed HTTP/1.1" 200 None 2026-05-06 16:47:59,586 - lava_callback - DEBUG - Processing node 69f8cdb40573a8210e12faed: baseline-arm-baylibre 2026-05-06 16:47:59,586 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdb40573a8210e12faed 2026-05-06 16:47:59,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:59,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdbb0573a8210e12fb32 HTTP/1.1" 200 None 2026-05-06 16:47:59,589 - lava_callback - ERROR - Error processing callback for node 69f8cdbb0573a8210e12fb32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 16:47:59,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdb40573a8210e12faed HTTP/1.1" 200 None 2026-05-06 16:47:59,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:59,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 16:47:59,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:47:59,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdb40573a8210e12faed HTTP/1.1" 200 None 2026-05-06 16:47:59,745 - lava_callback - ERROR - Error processing callback for node 69f8cdb40573a8210e12faed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:48:19,503 - lava_callback - INFO - Received callback for node 69f8cdbf0573a8210e12fb40 INFO: 172.21.0.1:35114 - "POST /node/69f8cdbf0573a8210e12fb40 HTTP/1.0" 202 Accepted 2026-05-06 16:48:19,509 - lava_callback - INFO - Starting async job submit for node 69f8cdbf0573a8210e12fb40 2026-05-06 16:48:19,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:19,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdbf0573a8210e12fb40 HTTP/1.1" 200 None 2026-05-06 16:48:19,529 - lava_callback - DEBUG - Processing node 69f8cdbf0573a8210e12fb40: baseline-arm-clabbe 2026-05-06 16:48:19,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdbf0573a8210e12fb40 2026-05-06 16:48:19,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:19,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdbf0573a8210e12fb40 HTTP/1.1" 200 None 2026-05-06 16:48:19,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:19,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 16:48:19,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:19,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdbf0573a8210e12fb40 HTTP/1.1" 200 None 2026-05-06 16:48:19,583 - lava_callback - ERROR - Error processing callback for node 69f8cdbf0573a8210e12fb40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 16:48:20,231 - lava_callback - INFO - Received callback for node 69f8cdc00573a8210e12fb43 INFO: 172.21.0.1:55674 - "POST /node/69f8cdc00573a8210e12fb43 HTTP/1.0" 202 Accepted 2026-05-06 16:48:20,236 - lava_callback - INFO - Starting async job submit for node 69f8cdc00573a8210e12fb43 2026-05-06 16:48:20,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:20,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc00573a8210e12fb43 HTTP/1.1" 200 None 2026-05-06 16:48:20,252 - lava_callback - DEBUG - Processing node 69f8cdc00573a8210e12fb43: baseline-arm-clabbe 2026-05-06 16:48:20,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdc00573a8210e12fb43 2026-05-06 16:48:20,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:20,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc00573a8210e12fb43 HTTP/1.1" 200 None 2026-05-06 16:48:20,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:20,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 16:48:20,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:20,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdc00573a8210e12fb43 HTTP/1.1" 200 None 2026-05-06 16:48:20,309 - lava_callback - ERROR - Error processing callback for node 69f8cdc00573a8210e12fb43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 16:48:20,859 - lava_callback - INFO - Received callback for node 69f8cdc50573a8210e12fb58 INFO: 172.21.0.1:55688 - "POST /node/69f8cdc50573a8210e12fb58 HTTP/1.0" 202 Accepted 2026-05-06 16:48:20,864 - lava_callback - INFO - Starting async job submit for node 69f8cdc50573a8210e12fb58 2026-05-06 16:48:20,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:20,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc50573a8210e12fb58 HTTP/1.1" 200 None 2026-05-06 16:48:20,879 - lava_callback - DEBUG - Processing node 69f8cdc50573a8210e12fb58: baseline-arm-clabbe 2026-05-06 16:48:20,879 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdc50573a8210e12fb58 2026-05-06 16:48:20,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:20,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc50573a8210e12fb58 HTTP/1.1" 200 None 2026-05-06 16:48:20,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:20,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 16:48:20,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:20,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdc50573a8210e12fb58 HTTP/1.1" 200 None 2026-05-06 16:48:20,958 - lava_callback - ERROR - Error processing callback for node 69f8cdc50573a8210e12fb58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 16:48:21,553 - lava_callback - INFO - Received callback for node 69f8cdc10573a8210e12fb4a INFO: 172.21.0.1:55690 - "POST /node/69f8cdc10573a8210e12fb4a HTTP/1.0" 202 Accepted 2026-05-06 16:48:21,559 - lava_callback - INFO - Starting async job submit for node 69f8cdc10573a8210e12fb4a 2026-05-06 16:48:21,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:21,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc10573a8210e12fb4a HTTP/1.1" 200 None 2026-05-06 16:48:21,575 - lava_callback - DEBUG - Processing node 69f8cdc10573a8210e12fb4a: baseline-arm-clabbe 2026-05-06 16:48:21,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdc10573a8210e12fb4a 2026-05-06 16:48:21,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:21,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc10573a8210e12fb4a HTTP/1.1" 200 None 2026-05-06 16:48:21,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:21,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 16:48:21,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:21,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdc10573a8210e12fb4a HTTP/1.1" 200 None 2026-05-06 16:48:21,627 - lava_callback - ERROR - Error processing callback for node 69f8cdc10573a8210e12fb4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 16:48:22,212 - lava_callback - INFO - Received callback for node 69f8cdc20573a8210e12fb4d INFO: 172.21.0.1:55700 - "POST /node/69f8cdc20573a8210e12fb4d HTTP/1.0" 202 Accepted 2026-05-06 16:48:22,217 - lava_callback - INFO - Starting async job submit for node 69f8cdc20573a8210e12fb4d 2026-05-06 16:48:22,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:22,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc20573a8210e12fb4d HTTP/1.1" 200 None 2026-05-06 16:48:22,233 - lava_callback - DEBUG - Processing node 69f8cdc20573a8210e12fb4d: baseline-arm-clabbe 2026-05-06 16:48:22,233 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdc20573a8210e12fb4d 2026-05-06 16:48:22,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:22,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc20573a8210e12fb4d HTTP/1.1" 200 None 2026-05-06 16:48:22,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:22,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 16:48:22,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:22,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdc20573a8210e12fb4d HTTP/1.1" 200 None 2026-05-06 16:48:22,285 - lava_callback - ERROR - Error processing callback for node 69f8cdc20573a8210e12fb4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 16:48:22,852 - lava_callback - INFO - Received callback for node 69f8cdc30573a8210e12fb53 INFO: 172.21.0.1:55702 - "POST /node/69f8cdc30573a8210e12fb53 HTTP/1.0" 202 Accepted 2026-05-06 16:48:22,858 - lava_callback - INFO - Starting async job submit for node 69f8cdc30573a8210e12fb53 2026-05-06 16:48:22,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:22,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc30573a8210e12fb53 HTTP/1.1" 200 None 2026-05-06 16:48:22,878 - lava_callback - DEBUG - Processing node 69f8cdc30573a8210e12fb53: baseline-arm-clabbe 2026-05-06 16:48:22,878 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdc30573a8210e12fb53 2026-05-06 16:48:22,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:22,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc30573a8210e12fb53 HTTP/1.1" 200 None 2026-05-06 16:48:22,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:22,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 16:48:22,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:22,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdc30573a8210e12fb53 HTTP/1.1" 200 None 2026-05-06 16:48:22,925 - lava_callback - ERROR - Error processing callback for node 69f8cdc30573a8210e12fb53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:48:59,603 - lava_callback - INFO - Received callback for node 69f8cdf10573a8210e12fc12 INFO: 172.21.0.1:45302 - "POST /node/69f8cdf10573a8210e12fc12 HTTP/1.0" 202 Accepted 2026-05-06 16:48:59,608 - lava_callback - INFO - Starting async job submit for node 69f8cdf10573a8210e12fc12 2026-05-06 16:48:59,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:59,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdf10573a8210e12fc12 HTTP/1.1" 200 None 2026-05-06 16:48:59,629 - lava_callback - DEBUG - Processing node 69f8cdf10573a8210e12fc12: baseline-arm-clabbe 2026-05-06 16:48:59,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cdf10573a8210e12fc12 2026-05-06 16:48:59,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:59,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdf10573a8210e12fc12 HTTP/1.1" 200 None 2026-05-06 16:48:59,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:59,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 16:48:59,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:48:59,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdf10573a8210e12fc12 HTTP/1.1" 200 None 2026-05-06 16:48:59,676 - lava_callback - ERROR - Error processing callback for node 69f8cdf10573a8210e12fc12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45556 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:49:39,568 - lava_callback - INFO - Received callback for node 69f8ce1e0573a8210e12fc56 INFO: 172.21.0.1:45568 - "POST /node/69f8ce1e0573a8210e12fc56 HTTP/1.0" 202 Accepted 2026-05-06 16:49:39,574 - lava_callback - INFO - Starting async job submit for node 69f8ce1e0573a8210e12fc56 2026-05-06 16:49:39,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:49:39,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ce1e0573a8210e12fc56 HTTP/1.1" 200 None 2026-05-06 16:49:39,596 - lava_callback - DEBUG - Processing node 69f8ce1e0573a8210e12fc56: baseline-arm-clabbe 2026-05-06 16:49:39,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ce1e0573a8210e12fc56 2026-05-06 16:49:39,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:49:39,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ce1e0573a8210e12fc56 HTTP/1.1" 200 None 2026-05-06 16:49:39,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:49:39,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 16:49:39,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:49:39,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ce1e0573a8210e12fc56 HTTP/1.1" 200 None 2026-05-06 16:49:39,655 - lava_callback - ERROR - Error processing callback for node 69f8ce1e0573a8210e12fc56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:55:56,760 - lava_callback - INFO - Received callback for node 69f8cf930573a8210e12fe58 INFO: 172.21.0.1:50066 - "POST /node/69f8cf930573a8210e12fe58 HTTP/1.0" 202 Accepted 2026-05-06 16:55:56,766 - lava_callback - INFO - Starting async job submit for node 69f8cf930573a8210e12fe58 2026-05-06 16:55:56,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:55:56,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cf930573a8210e12fe58 HTTP/1.1" 200 None 2026-05-06 16:55:56,781 - lava_callback - DEBUG - Processing node 69f8cf930573a8210e12fe58: baseline-arm64-baylibre 2026-05-06 16:55:56,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cf930573a8210e12fe58 2026-05-06 16:55:56,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:55:56,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cf930573a8210e12fe58 HTTP/1.1" 200 None 2026-05-06 16:55:56,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:55:56,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 16:55:56,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:55:56,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cf930573a8210e12fe58 HTTP/1.1" 200 None 2026-05-06 16:55:56,860 - lava_callback - ERROR - Error processing callback for node 69f8cf930573a8210e12fe58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:57:16,723 - lava_callback - INFO - Received callback for node 69f8cfe70573a8210e12feb6 INFO: 172.21.0.1:56452 - "POST /node/69f8cfe70573a8210e12feb6 HTTP/1.0" 202 Accepted 2026-05-06 16:57:16,728 - lava_callback - INFO - Starting async job submit for node 69f8cfe70573a8210e12feb6 2026-05-06 16:57:16,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:57:16,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cfe70573a8210e12feb6 HTTP/1.1" 200 None 2026-05-06 16:57:16,744 - lava_callback - DEBUG - Processing node 69f8cfe70573a8210e12feb6: baseline-arm64-baylibre 2026-05-06 16:57:16,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8cfe70573a8210e12feb6 2026-05-06 16:57:16,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:57:16,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cfe70573a8210e12feb6 HTTP/1.1" 200 None 2026-05-06 16:57:16,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:57:16,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 16:57:16,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:57:16,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cfe70573a8210e12feb6 HTTP/1.1" 200 None 2026-05-06 16:57:16,791 - lava_callback - ERROR - Error processing callback for node 69f8cfe70573a8210e12feb6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK 2026-05-06 16:58:56,834 - lava_callback - INFO - Received callback for node 69f8d03c0573a8210e12fef7 INFO: 172.21.0.1:35354 - "POST /node/69f8d03c0573a8210e12fef7 HTTP/1.0" 202 Accepted 2026-05-06 16:58:56,840 - lava_callback - INFO - Starting async job submit for node 69f8d03c0573a8210e12fef7 2026-05-06 16:58:56,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:58:56,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d03c0573a8210e12fef7 HTTP/1.1" 200 None 2026-05-06 16:58:56,855 - lava_callback - DEBUG - Processing node 69f8d03c0573a8210e12fef7: baseline-arm64-baylibre 2026-05-06 16:58:56,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d03c0573a8210e12fef7 2026-05-06 16:58:56,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:58:56,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d03c0573a8210e12fef7 HTTP/1.1" 200 None 2026-05-06 16:58:56,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:58:56,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 16:58:56,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 16:58:56,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d03c0573a8210e12fef7 HTTP/1.1" 200 None 2026-05-06 16:58:56,907 - lava_callback - ERROR - Error processing callback for node 69f8d03c0573a8210e12fef7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:00:16,856 - lava_callback - INFO - Received callback for node 69f8d0940573a8210e12ff30 INFO: 172.21.0.1:42972 - "POST /node/69f8d0940573a8210e12ff30 HTTP/1.0" 202 Accepted 2026-05-06 17:00:16,861 - lava_callback - INFO - Starting async job submit for node 69f8d0940573a8210e12ff30 2026-05-06 17:00:16,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:00:16,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d0940573a8210e12ff30 HTTP/1.1" 200 None 2026-05-06 17:00:16,877 - lava_callback - DEBUG - Processing node 69f8d0940573a8210e12ff30: baseline-arm64-baylibre 2026-05-06 17:00:16,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d0940573a8210e12ff30 2026-05-06 17:00:16,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:00:16,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d0940573a8210e12ff30 HTTP/1.1" 200 None 2026-05-06 17:00:16,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:00:16,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 17:00:16,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:00:16,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d0940573a8210e12ff30 HTTP/1.1" 200 None 2026-05-06 17:00:16,934 - lava_callback - ERROR - Error processing callback for node 69f8d0940573a8210e12ff30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35078 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:01:36,992 - lava_callback - INFO - Received callback for node 69f8d0ed0573a8210e12ff70 INFO: 172.21.0.1:35088 - "POST /node/69f8d0ed0573a8210e12ff70 HTTP/1.0" 202 Accepted 2026-05-06 17:01:36,998 - lava_callback - INFO - Starting async job submit for node 69f8d0ed0573a8210e12ff70 2026-05-06 17:01:36,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:01:37,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d0ed0573a8210e12ff70 HTTP/1.1" 200 None 2026-05-06 17:01:37,014 - lava_callback - DEBUG - Processing node 69f8d0ed0573a8210e12ff70: baseline-arm64-baylibre 2026-05-06 17:01:37,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d0ed0573a8210e12ff70 2026-05-06 17:01:37,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:01:37,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d0ed0573a8210e12ff70 HTTP/1.1" 200 None 2026-05-06 17:01:37,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:01:37,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 17:01:37,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:01:37,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d0ed0573a8210e12ff70 HTTP/1.1" 200 None 2026-05-06 17:01:37,060 - lava_callback - ERROR - Error processing callback for node 69f8d0ed0573a8210e12ff70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42918 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:03:17,042 - lava_callback - INFO - Received callback for node 69f8d1440573a8210e12ffad INFO: 172.21.0.1:42930 - "POST /node/69f8d1440573a8210e12ffad HTTP/1.0" 202 Accepted 2026-05-06 17:03:17,048 - lava_callback - INFO - Starting async job submit for node 69f8d1440573a8210e12ffad 2026-05-06 17:03:17,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:03:17,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1440573a8210e12ffad HTTP/1.1" 200 None 2026-05-06 17:03:17,063 - lava_callback - DEBUG - Processing node 69f8d1440573a8210e12ffad: baseline-arm64-baylibre 2026-05-06 17:03:17,063 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1440573a8210e12ffad 2026-05-06 17:03:17,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:03:17,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1440573a8210e12ffad HTTP/1.1" 200 None 2026-05-06 17:03:17,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:03:17,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 17:03:17,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:03:17,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1440573a8210e12ffad HTTP/1.1" 200 None 2026-05-06 17:03:17,117 - lava_callback - ERROR - Error processing callback for node 69f8d1440573a8210e12ffad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:04:11,130 - lava_callback - INFO - Received callback for node 69fafdca5ce316b79a7142c6 INFO: 172.21.0.1:39024 - "POST /node/69fafdca5ce316b79a7142c6 HTTP/1.0" 202 Accepted 2026-05-06 17:04:11,136 - lava_callback - INFO - Starting async job submit for node 69fafdca5ce316b79a7142c6 2026-05-06 17:04:11,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:04:11,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafdca5ce316b79a7142c6 HTTP/1.1" 200 None 2026-05-06 17:04:11,168 - lava_callback - DEBUG - Processing node 69fafdca5ce316b79a7142c6: baseline-x86 2026-05-06 17:04:11,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:04:11,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:04:11,585 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fafdca5ce316b79a7142c6/log.txt.gz 2026-05-06 17:04:11,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:04:12,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:04:12,064 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fafdca5ce316b79a7142c6/lava-logs.yaml 2026-05-06 17:04:12,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:04:12,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:04:12,354 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fafdca5ce316b79a7142c6/lava_callback.json.gz 2026-05-06 17:04:12,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:04:12,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafdca5ce316b79a7142c6 HTTP/1.1" 200 None 2026-05-06 17:04:12,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:04:12,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9a55ce316b79a713c91 HTTP/1.1" 200 None 2026-05-06 17:04:12,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:04:12,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafdca5ce316b79a7142c6 HTTP/1.1" 200 None 2026-05-06 17:04:12,427 - lava_callback - INFO - Completed processing callback for node 69fafdca5ce316b79a7142c6 INFO: 172.21.0.1:39040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:04:25,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:04:25,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:04:40,269 - lava_callback - INFO - Received callback for node 69f8d1a20573a8210e12ffe9 INFO: 172.21.0.1:55236 - "POST /node/69f8d1a20573a8210e12ffe9 HTTP/1.0" 202 Accepted 2026-05-06 17:04:40,275 - lava_callback - INFO - Starting async job submit for node 69f8d1a20573a8210e12ffe9 2026-05-06 17:04:40,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:04:40,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1a20573a8210e12ffe9 HTTP/1.1" 200 None 2026-05-06 17:04:40,291 - lava_callback - DEBUG - Processing node 69f8d1a20573a8210e12ffe9: baseline-arm64-clabbe 2026-05-06 17:04:40,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1a20573a8210e12ffe9 2026-05-06 17:04:40,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:04:40,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1a20573a8210e12ffe9 HTTP/1.1" 200 None 2026-05-06 17:04:40,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:04:40,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 17:04:40,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:04:40,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1a20573a8210e12ffe9 HTTP/1.1" 200 None 2026-05-06 17:04:40,336 - lava_callback - ERROR - Error processing callback for node 69f8d1a20573a8210e12ffe9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:05:37,163 - lava_callback - INFO - Received callback for node 69f8d1d80573a8210e1300a7 INFO: 172.21.0.1:53850 - "POST /node/69f8d1d80573a8210e1300a7 HTTP/1.0" 202 Accepted 2026-05-06 17:05:37,169 - lava_callback - INFO - Starting async job submit for node 69f8d1d80573a8210e1300a7 2026-05-06 17:05:37,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:37,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d80573a8210e1300a7 HTTP/1.1" 200 None 2026-05-06 17:05:37,185 - lava_callback - DEBUG - Processing node 69f8d1d80573a8210e1300a7: baseline-arm64-baylibre 2026-05-06 17:05:37,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1d80573a8210e1300a7 2026-05-06 17:05:37,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:37,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d80573a8210e1300a7 HTTP/1.1" 200 None 2026-05-06 17:05:37,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:37,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 17:05:37,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:37,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1d80573a8210e1300a7 HTTP/1.1" 200 None 2026-05-06 17:05:37,240 - lava_callback - ERROR - Error processing callback for node 69f8d1d80573a8210e1300a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 17:05:37,827 - lava_callback - INFO - Received callback for node 69f8d1d90573a8210e1300aa INFO: 172.21.0.1:53866 - "POST /node/69f8d1d90573a8210e1300aa HTTP/1.0" 202 Accepted 2026-05-06 17:05:37,833 - lava_callback - INFO - Starting async job submit for node 69f8d1d90573a8210e1300aa 2026-05-06 17:05:37,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:37,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d90573a8210e1300aa HTTP/1.1" 200 None 2026-05-06 17:05:37,848 - lava_callback - DEBUG - Processing node 69f8d1d90573a8210e1300aa: baseline-arm64-baylibre 2026-05-06 17:05:37,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1d90573a8210e1300aa 2026-05-06 17:05:37,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:37,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d90573a8210e1300aa HTTP/1.1" 200 None 2026-05-06 17:05:37,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:37,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 17:05:37,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:37,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1d90573a8210e1300aa HTTP/1.1" 200 None 2026-05-06 17:05:37,897 - lava_callback - ERROR - Error processing callback for node 69f8d1d90573a8210e1300aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 17:05:38,488 - lava_callback - INFO - Received callback for node 69f8d1db0573a8210e1300ad INFO: 172.21.0.1:53868 - "POST /node/69f8d1db0573a8210e1300ad HTTP/1.0" 202 Accepted 2026-05-06 17:05:38,493 - lava_callback - INFO - Starting async job submit for node 69f8d1db0573a8210e1300ad 2026-05-06 17:05:38,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:38,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1db0573a8210e1300ad HTTP/1.1" 200 None 2026-05-06 17:05:38,516 - lava_callback - DEBUG - Processing node 69f8d1db0573a8210e1300ad: baseline-arm64-baylibre 2026-05-06 17:05:38,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1db0573a8210e1300ad 2026-05-06 17:05:38,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:38,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1db0573a8210e1300ad HTTP/1.1" 200 None 2026-05-06 17:05:38,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:38,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 17:05:38,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:38,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1db0573a8210e1300ad HTTP/1.1" 200 None 2026-05-06 17:05:38,573 - lava_callback - ERROR - Error processing callback for node 69f8d1db0573a8210e1300ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 17:05:39,205 - lava_callback - INFO - Received callback for node 69f8d1dd0573a8210e1300b4 INFO: 172.21.0.1:53874 - "POST /node/69f8d1dd0573a8210e1300b4 HTTP/1.0" 202 Accepted 2026-05-06 17:05:39,210 - lava_callback - INFO - Starting async job submit for node 69f8d1dd0573a8210e1300b4 2026-05-06 17:05:39,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:39,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1dd0573a8210e1300b4 HTTP/1.1" 200 None 2026-05-06 17:05:39,225 - lava_callback - DEBUG - Processing node 69f8d1dd0573a8210e1300b4: baseline-arm64-baylibre 2026-05-06 17:05:39,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1dd0573a8210e1300b4 2026-05-06 17:05:39,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:39,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1dd0573a8210e1300b4 HTTP/1.1" 200 None 2026-05-06 17:05:39,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:39,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 17:05:39,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:39,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1dd0573a8210e1300b4 HTTP/1.1" 200 None 2026-05-06 17:05:39,275 - lava_callback - ERROR - Error processing callback for node 69f8d1dd0573a8210e1300b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 17:05:39,875 - lava_callback - INFO - Received callback for node 69f8d1df0573a8210e1300b7 INFO: 172.21.0.1:51758 - "POST /node/69f8d1df0573a8210e1300b7 HTTP/1.0" 202 Accepted 2026-05-06 17:05:39,881 - lava_callback - INFO - Starting async job submit for node 69f8d1df0573a8210e1300b7 2026-05-06 17:05:39,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:39,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1df0573a8210e1300b7 HTTP/1.1" 200 None 2026-05-06 17:05:39,903 - lava_callback - DEBUG - Processing node 69f8d1df0573a8210e1300b7: baseline-arm64-baylibre 2026-05-06 17:05:39,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1df0573a8210e1300b7 2026-05-06 17:05:39,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:39,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1df0573a8210e1300b7 HTTP/1.1" 200 None 2026-05-06 17:05:39,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:39,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 17:05:39,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:39,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1df0573a8210e1300b7 HTTP/1.1" 200 None 2026-05-06 17:05:39,950 - lava_callback - ERROR - Error processing callback for node 69f8d1df0573a8210e1300b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:05:57,142 - lava_callback - INFO - Received callback for node 69f8d1e00573a8210e1300ba INFO: 172.21.0.1:34858 - "POST /node/69f8d1e00573a8210e1300ba HTTP/1.0" 202 Accepted 2026-05-06 17:05:57,152 - lava_callback - INFO - Starting async job submit for node 69f8d1e00573a8210e1300ba 2026-05-06 17:05:57,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:57,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1e00573a8210e1300ba HTTP/1.1" 200 None 2026-05-06 17:05:57,181 - lava_callback - DEBUG - Processing node 69f8d1e00573a8210e1300ba: baseline-arm64-baylibre 2026-05-06 17:05:57,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1e00573a8210e1300ba 2026-05-06 17:05:57,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:57,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1e00573a8210e1300ba HTTP/1.1" 200 None 2026-05-06 17:05:57,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:57,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 17:05:57,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:05:57,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1e00573a8210e1300ba HTTP/1.1" 200 None 2026-05-06 17:05:57,274 - lava_callback - ERROR - Error processing callback for node 69f8d1e00573a8210e1300ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 17:06:00,394 - lava_callback - INFO - Received callback for node 69f8d1ef0573a8210e1300dd INFO: 172.21.0.1:43952 - "POST /node/69f8d1ef0573a8210e1300dd HTTP/1.0" 202 Accepted 2026-05-06 17:06:00,404 - lava_callback - INFO - Starting async job submit for node 69f8d1ef0573a8210e1300dd 2026-05-06 17:06:00,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:00,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1ef0573a8210e1300dd HTTP/1.1" 200 None 2026-05-06 17:06:00,434 - lava_callback - DEBUG - Processing node 69f8d1ef0573a8210e1300dd: baseline-arm64-clabbe 2026-05-06 17:06:00,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1ef0573a8210e1300dd 2026-05-06 17:06:00,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:00,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1ef0573a8210e1300dd HTTP/1.1" 200 None 2026-05-06 17:06:00,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:00,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 17:06:00,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:00,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1ef0573a8210e1300dd HTTP/1.1" 200 None 2026-05-06 17:06:00,533 - lava_callback - ERROR - Error processing callback for node 69f8d1ef0573a8210e1300dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 17:06:01,089 - lava_callback - INFO - Received callback for node 69f8d1f10573a8210e130109 INFO: 172.21.0.1:43962 - "POST /node/69f8d1f10573a8210e130109 HTTP/1.0" 202 Accepted 2026-05-06 17:06:01,098 - lava_callback - INFO - Starting async job submit for node 69f8d1f10573a8210e130109 2026-05-06 17:06:01,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:01,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f10573a8210e130109 HTTP/1.1" 200 None 2026-05-06 17:06:01,127 - lava_callback - DEBUG - Processing node 69f8d1f10573a8210e130109: baseline-arm64-clabbe 2026-05-06 17:06:01,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1f10573a8210e130109 2026-05-06 17:06:01,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:01,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f10573a8210e130109 HTTP/1.1" 200 None 2026-05-06 17:06:01,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:01,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 17:06:01,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:01,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1f10573a8210e130109 HTTP/1.1" 200 None 2026-05-06 17:06:01,219 - lava_callback - ERROR - Error processing callback for node 69f8d1f10573a8210e130109: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 17:06:01,771 - lava_callback - INFO - Received callback for node 69f8d1f20573a8210e13010c INFO: 172.21.0.1:43978 - "POST /node/69f8d1f20573a8210e13010c HTTP/1.0" 202 Accepted 2026-05-06 17:06:01,782 - lava_callback - INFO - Starting async job submit for node 69f8d1f20573a8210e13010c 2026-05-06 17:06:01,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:01,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f20573a8210e13010c HTTP/1.1" 200 None 2026-05-06 17:06:01,810 - lava_callback - DEBUG - Processing node 69f8d1f20573a8210e13010c: baseline-arm64-clabbe 2026-05-06 17:06:01,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1f20573a8210e13010c 2026-05-06 17:06:01,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:01,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f20573a8210e13010c HTTP/1.1" 200 None 2026-05-06 17:06:01,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:01,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 17:06:01,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:01,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1f20573a8210e13010c HTTP/1.1" 200 None 2026-05-06 17:06:01,900 - lava_callback - ERROR - Error processing callback for node 69f8d1f20573a8210e13010c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 17:06:02,459 - lava_callback - INFO - Received callback for node 69f8d1f20573a8210e13010f INFO: 172.21.0.1:43994 - "POST /node/69f8d1f20573a8210e13010f HTTP/1.0" 202 Accepted 2026-05-06 17:06:02,468 - lava_callback - INFO - Starting async job submit for node 69f8d1f20573a8210e13010f 2026-05-06 17:06:02,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:02,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f20573a8210e13010f HTTP/1.1" 200 None 2026-05-06 17:06:02,499 - lava_callback - DEBUG - Processing node 69f8d1f20573a8210e13010f: baseline-arm64-clabbe 2026-05-06 17:06:02,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1f20573a8210e13010f 2026-05-06 17:06:02,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:02,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f20573a8210e13010f HTTP/1.1" 200 None 2026-05-06 17:06:02,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:02,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 17:06:02,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:02,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1f20573a8210e13010f HTTP/1.1" 200 None 2026-05-06 17:06:02,619 - lava_callback - ERROR - Error processing callback for node 69f8d1f20573a8210e13010f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 17:06:03,153 - lava_callback - INFO - Received callback for node 69f8d1f50573a8210e130120 INFO: 172.21.0.1:44002 - "POST /node/69f8d1f50573a8210e130120 HTTP/1.0" 202 Accepted 2026-05-06 17:06:03,163 - lava_callback - INFO - Starting async job submit for node 69f8d1f50573a8210e130120 2026-05-06 17:06:03,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:03,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f50573a8210e130120 HTTP/1.1" 200 None 2026-05-06 17:06:03,191 - lava_callback - DEBUG - Processing node 69f8d1f50573a8210e130120: baseline-arm64-clabbe 2026-05-06 17:06:03,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1f50573a8210e130120 2026-05-06 17:06:03,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:03,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f50573a8210e130120 HTTP/1.1" 200 None 2026-05-06 17:06:03,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:03,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 17:06:03,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:03,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1f50573a8210e130120 HTTP/1.1" 200 None 2026-05-06 17:06:03,279 - lava_callback - ERROR - Error processing callback for node 69f8d1f50573a8210e130120: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 17:06:03,837 - lava_callback - INFO - Received callback for node 69f8d1f40573a8210e130116 INFO: 172.21.0.1:44004 - "POST /node/69f8d1f40573a8210e130116 HTTP/1.0" 202 Accepted 2026-05-06 17:06:03,846 - lava_callback - INFO - Starting async job submit for node 69f8d1f40573a8210e130116 2026-05-06 17:06:03,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:03,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f40573a8210e130116 HTTP/1.1" 200 None 2026-05-06 17:06:03,873 - lava_callback - DEBUG - Processing node 69f8d1f40573a8210e130116: baseline-arm64-clabbe 2026-05-06 17:06:03,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1f40573a8210e130116 2026-05-06 17:06:03,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:03,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f40573a8210e130116 HTTP/1.1" 200 None 2026-05-06 17:06:03,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:03,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 17:06:03,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:03,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1f40573a8210e130116 HTTP/1.1" 200 None 2026-05-06 17:06:03,962 - lava_callback - ERROR - Error processing callback for node 69f8d1f40573a8210e130116: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:06:20,380 - lava_callback - INFO - Received callback for node 69f8d1fe0573a8210e130139 INFO: 172.21.0.1:38146 - "POST /node/69f8d1fe0573a8210e130139 HTTP/1.0" 202 Accepted 2026-05-06 17:06:20,386 - lava_callback - INFO - Starting async job submit for node 69f8d1fe0573a8210e130139 2026-05-06 17:06:20,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:20,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1fe0573a8210e130139 HTTP/1.1" 200 None 2026-05-06 17:06:20,402 - lava_callback - DEBUG - Processing node 69f8d1fe0573a8210e130139: baseline-arm64-clabbe 2026-05-06 17:06:20,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d1fe0573a8210e130139 2026-05-06 17:06:20,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:20,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1fe0573a8210e130139 HTTP/1.1" 200 None 2026-05-06 17:06:20,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:20,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 17:06:20,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:06:20,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1fe0573a8210e130139 HTTP/1.1" 200 None 2026-05-06 17:06:20,448 - lava_callback - ERROR - Error processing callback for node 69f8d1fe0573a8210e130139: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43892 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:07:40,367 - lava_callback - INFO - Received callback for node 69f8d2530573a8210e130274 INFO: 172.21.0.1:57430 - "POST /node/69f8d2530573a8210e130274 HTTP/1.0" 202 Accepted 2026-05-06 17:07:40,375 - lava_callback - INFO - Starting async job submit for node 69f8d2530573a8210e130274 2026-05-06 17:07:40,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:07:40,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d2530573a8210e130274 HTTP/1.1" 200 None 2026-05-06 17:07:40,390 - lava_callback - DEBUG - Processing node 69f8d2530573a8210e130274: baseline-arm64-clabbe 2026-05-06 17:07:40,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d2530573a8210e130274 2026-05-06 17:07:40,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:07:40,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d2530573a8210e130274 HTTP/1.1" 200 None 2026-05-06 17:07:40,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:07:40,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 17:07:40,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:07:40,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d2530573a8210e130274 HTTP/1.1" 200 None 2026-05-06 17:07:40,502 - lava_callback - ERROR - Error processing callback for node 69f8d2530573a8210e130274: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:09:20,470 - lava_callback - INFO - Received callback for node 69f8d2aa0573a8210e1302d1 INFO: 172.21.0.1:45160 - "POST /node/69f8d2aa0573a8210e1302d1 HTTP/1.0" 202 Accepted 2026-05-06 17:09:20,476 - lava_callback - INFO - Starting async job submit for node 69f8d2aa0573a8210e1302d1 2026-05-06 17:09:20,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:09:20,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d2aa0573a8210e1302d1 HTTP/1.1" 200 None 2026-05-06 17:09:20,491 - lava_callback - DEBUG - Processing node 69f8d2aa0573a8210e1302d1: baseline-arm64-clabbe 2026-05-06 17:09:20,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d2aa0573a8210e1302d1 2026-05-06 17:09:20,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:09:20,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d2aa0573a8210e1302d1 HTTP/1.1" 200 None 2026-05-06 17:09:20,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:09:20,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 17:09:20,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:09:20,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d2aa0573a8210e1302d1 HTTP/1.1" 200 None 2026-05-06 17:09:20,610 - lava_callback - ERROR - Error processing callback for node 69f8d2aa0573a8210e1302d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:10:40,625 - lava_callback - INFO - Received callback for node 69f8d3000573a8210e130315 INFO: 172.21.0.1:44370 - "POST /node/69f8d3000573a8210e130315 HTTP/1.0" 202 Accepted 2026-05-06 17:10:40,631 - lava_callback - INFO - Starting async job submit for node 69f8d3000573a8210e130315 2026-05-06 17:10:40,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:10:40,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d3000573a8210e130315 HTTP/1.1" 200 None 2026-05-06 17:10:40,647 - lava_callback - DEBUG - Processing node 69f8d3000573a8210e130315: baseline-arm64-clabbe 2026-05-06 17:10:40,647 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d3000573a8210e130315 2026-05-06 17:10:40,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:10:40,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d3000573a8210e130315 HTTP/1.1" 200 None 2026-05-06 17:10:40,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:10:40,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 17:10:40,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:10:40,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d3000573a8210e130315 HTTP/1.1" 200 None 2026-05-06 17:10:40,703 - lava_callback - ERROR - Error processing callback for node 69f8d3000573a8210e130315: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:12:00,637 - lava_callback - INFO - Received callback for node 69f8d3580573a8210e130340 INFO: 172.21.0.1:35564 - "POST /node/69f8d3580573a8210e130340 HTTP/1.0" 202 Accepted 2026-05-06 17:12:00,643 - lava_callback - INFO - Starting async job submit for node 69f8d3580573a8210e130340 2026-05-06 17:12:00,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:12:00,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d3580573a8210e130340 HTTP/1.1" 200 None 2026-05-06 17:12:00,662 - lava_callback - DEBUG - Processing node 69f8d3580573a8210e130340: baseline-arm64-clabbe 2026-05-06 17:12:00,662 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d3580573a8210e130340 2026-05-06 17:12:00,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:12:00,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d3580573a8210e130340 HTTP/1.1" 200 None 2026-05-06 17:12:00,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:12:00,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 17:12:00,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:12:00,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d3580573a8210e130340 HTTP/1.1" 200 None 2026-05-06 17:12:00,726 - lava_callback - ERROR - Error processing callback for node 69f8d3580573a8210e130340: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58362 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:14:05,189 - lava_callback - INFO - Received callback for node 69fb52d15ce316b79a7161e0 INFO: 172.21.0.1:35060 - "POST /node/69fb52d15ce316b79a7161e0 HTTP/1.0" 202 Accepted 2026-05-06 17:14:05,195 - lava_callback - INFO - Starting async job submit for node 69fb52d15ce316b79a7161e0 2026-05-06 17:14:05,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:14:05,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb52d15ce316b79a7161e0 HTTP/1.1" 200 None 2026-05-06 17:14:05,232 - lava_callback - DEBUG - Processing node 69fb52d15ce316b79a7161e0: baseline-x86 2026-05-06 17:14:05,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:14:05,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:14:05,707 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fb52d15ce316b79a7161e0/log.txt.gz 2026-05-06 17:14:05,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:14:06,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:14:06,094 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fb52d15ce316b79a7161e0/lava-logs.yaml 2026-05-06 17:14:06,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:14:06,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:14:06,214 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fb52d15ce316b79a7161e0/lava_callback.json.gz 2026-05-06 17:14:06,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:14:06,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb52d15ce316b79a7161e0 HTTP/1.1" 200 None 2026-05-06 17:14:06,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:14:06,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9a55ce316b79a713c91 HTTP/1.1" 200 None 2026-05-06 17:14:06,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:14:06,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb52d15ce316b79a7161e0 HTTP/1.1" 200 None 2026-05-06 17:14:06,307 - lava_callback - INFO - Completed processing callback for node 69fb52d15ce316b79a7161e0 INFO: 172.21.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38312 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:14:25,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:14:25,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:14:37,809 - lava_callback - INFO - Received callback for node 69f8d3f50573a8210e1303fb INFO: 172.21.0.1:43224 - "POST /node/69f8d3f50573a8210e1303fb HTTP/1.0" 202 Accepted 2026-05-06 17:14:37,815 - lava_callback - INFO - Starting async job submit for node 69f8d3f50573a8210e1303fb 2026-05-06 17:14:37,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:14:37,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d3f50573a8210e1303fb HTTP/1.1" 200 None 2026-05-06 17:14:37,830 - lava_callback - DEBUG - Processing node 69f8d3f50573a8210e1303fb: baseline-arm-baylibre 2026-05-06 17:14:37,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d3f50573a8210e1303fb 2026-05-06 17:14:37,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:14:37,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d3f50573a8210e1303fb HTTP/1.1" 200 None 2026-05-06 17:14:37,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:14:37,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-06 17:14:37,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:14:37,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d3f50573a8210e1303fb HTTP/1.1" 200 None 2026-05-06 17:14:37,888 - lava_callback - ERROR - Error processing callback for node 69f8d3f50573a8210e1303fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:16:17,860 - lava_callback - INFO - Received callback for node 69f8d44f0573a8210e130468 INFO: 172.21.0.1:56380 - "POST /node/69f8d44f0573a8210e130468 HTTP/1.0" 202 Accepted 2026-05-06 17:16:17,866 - lava_callback - INFO - Starting async job submit for node 69f8d44f0573a8210e130468 2026-05-06 17:16:17,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:16:17,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d44f0573a8210e130468 HTTP/1.1" 200 None 2026-05-06 17:16:17,882 - lava_callback - DEBUG - Processing node 69f8d44f0573a8210e130468: baseline-arm-baylibre 2026-05-06 17:16:17,882 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d44f0573a8210e130468 2026-05-06 17:16:17,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:16:17,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d44f0573a8210e130468 HTTP/1.1" 200 None 2026-05-06 17:16:17,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:16:17,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-06 17:16:17,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:16:17,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d44f0573a8210e130468 HTTP/1.1" 200 None 2026-05-06 17:16:17,931 - lava_callback - ERROR - Error processing callback for node 69f8d44f0573a8210e130468: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:17:57,910 - lava_callback - INFO - Received callback for node 69f8d4ba0573a8210e1304ad INFO: 172.21.0.1:50840 - "POST /node/69f8d4ba0573a8210e1304ad HTTP/1.0" 202 Accepted 2026-05-06 17:17:57,916 - lava_callback - INFO - Starting async job submit for node 69f8d4ba0573a8210e1304ad 2026-05-06 17:17:57,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:17:57,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d4ba0573a8210e1304ad HTTP/1.1" 200 None 2026-05-06 17:17:57,931 - lava_callback - DEBUG - Processing node 69f8d4ba0573a8210e1304ad: baseline-arm-baylibre 2026-05-06 17:17:57,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d4ba0573a8210e1304ad 2026-05-06 17:17:57,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:17:57,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d4ba0573a8210e1304ad HTTP/1.1" 200 None 2026-05-06 17:17:57,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:17:57,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-06 17:17:57,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:17:57,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d4ba0573a8210e1304ad HTTP/1.1" 200 None 2026-05-06 17:17:57,979 - lava_callback - ERROR - Error processing callback for node 69f8d4ba0573a8210e1304ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:20:58,042 - lava_callback - INFO - Received callback for node 69f8d5700573a8210e130563 INFO: 172.21.0.1:58410 - "POST /node/69f8d5700573a8210e130563 HTTP/1.0" 202 Accepted 2026-05-06 17:20:58,049 - lava_callback - INFO - Starting async job submit for node 69f8d5700573a8210e130563 2026-05-06 17:20:58,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:20:58,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d5700573a8210e130563 HTTP/1.1" 200 None 2026-05-06 17:20:58,069 - lava_callback - DEBUG - Processing node 69f8d5700573a8210e130563: baseline-arm-baylibre 2026-05-06 17:20:58,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d5700573a8210e130563 2026-05-06 17:20:58,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:20:58,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d5700573a8210e130563 HTTP/1.1" 200 None 2026-05-06 17:20:58,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:20:58,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-06 17:20:58,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:20:58,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d5700573a8210e130563 HTTP/1.1" 200 None 2026-05-06 17:20:58,127 - lava_callback - ERROR - Error processing callback for node 69f8d5700573a8210e130563: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46680 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:22:38,144 - lava_callback - INFO - Received callback for node 69f8d5ca0573a8210e1305c0 INFO: 172.21.0.1:46682 - "POST /node/69f8d5ca0573a8210e1305c0 HTTP/1.0" 202 Accepted 2026-05-06 17:22:38,150 - lava_callback - INFO - Starting async job submit for node 69f8d5ca0573a8210e1305c0 2026-05-06 17:22:38,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:22:38,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d5ca0573a8210e1305c0 HTTP/1.1" 200 None 2026-05-06 17:22:38,172 - lava_callback - DEBUG - Processing node 69f8d5ca0573a8210e1305c0: baseline-arm-baylibre 2026-05-06 17:22:38,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d5ca0573a8210e1305c0 2026-05-06 17:22:38,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:22:38,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d5ca0573a8210e1305c0 HTTP/1.1" 200 None 2026-05-06 17:22:38,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:22:38,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-06 17:22:38,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:22:38,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d5ca0573a8210e1305c0 HTTP/1.1" 200 None 2026-05-06 17:22:38,246 - lava_callback - ERROR - Error processing callback for node 69f8d5ca0573a8210e1305c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53576 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:23:18,120 - lava_callback - INFO - Received callback for node 69f8d5f60573a8210e130603 INFO: 172.21.0.1:53582 - "POST /node/69f8d5f60573a8210e130603 HTTP/1.0" 202 Accepted 2026-05-06 17:23:18,126 - lava_callback - INFO - Starting async job submit for node 69f8d5f60573a8210e130603 2026-05-06 17:23:18,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:23:18,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d5f60573a8210e130603 HTTP/1.1" 200 None 2026-05-06 17:23:18,140 - lava_callback - DEBUG - Processing node 69f8d5f60573a8210e130603: baseline-arm-baylibre 2026-05-06 17:23:18,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d5f60573a8210e130603 2026-05-06 17:23:18,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:23:18,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d5f60573a8210e130603 HTTP/1.1" 200 None 2026-05-06 17:23:18,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:23:18,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-06 17:23:18,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:23:18,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d5f60573a8210e130603 HTTP/1.1" 200 None 2026-05-06 17:23:18,204 - lava_callback - ERROR - Error processing callback for node 69f8d5f60573a8210e130603: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:24:01,065 - lava_callback - INFO - Received callback for node 69f8d6260573a8210e13061d INFO: 172.21.0.1:39348 - "POST /node/69f8d6260573a8210e13061d HTTP/1.0" 202 Accepted 2026-05-06 17:24:01,075 - lava_callback - INFO - Starting async job submit for node 69f8d6260573a8210e13061d 2026-05-06 17:24:01,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:24:01,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d6260573a8210e13061d HTTP/1.1" 200 None 2026-05-06 17:24:01,098 - lava_callback - DEBUG - Processing node 69f8d6260573a8210e13061d: baseline-arm-clabbe 2026-05-06 17:24:01,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d6260573a8210e13061d 2026-05-06 17:24:01,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:24:01,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d6260573a8210e13061d HTTP/1.1" 200 None 2026-05-06 17:24:01,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:24:01,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-06 17:24:01,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:24:01,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d6260573a8210e13061d HTTP/1.1" 200 None 2026-05-06 17:24:01,170 - lava_callback - ERROR - Error processing callback for node 69f8d6260573a8210e13061d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:32:41,383 - lava_callback - INFO - Received callback for node 69f8d82a0573a8210e1307fd INFO: 172.21.0.1:52598 - "POST /node/69f8d82a0573a8210e1307fd HTTP/1.0" 202 Accepted 2026-05-06 17:32:41,390 - lava_callback - INFO - Starting async job submit for node 69f8d82a0573a8210e1307fd 2026-05-06 17:32:41,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:32:41,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d82a0573a8210e1307fd HTTP/1.1" 200 None 2026-05-06 17:32:41,411 - lava_callback - DEBUG - Processing node 69f8d82a0573a8210e1307fd: baseline-arm-clabbe 2026-05-06 17:32:41,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d82a0573a8210e1307fd 2026-05-06 17:32:41,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:32:41,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d82a0573a8210e1307fd HTTP/1.1" 200 None 2026-05-06 17:32:41,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:32:41,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-06 17:32:41,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:32:41,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d82a0573a8210e1307fd HTTP/1.1" 200 None 2026-05-06 17:32:41,472 - lava_callback - ERROR - Error processing callback for node 69f8d82a0573a8210e1307fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52756 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:33:21,280 - lava_callback - INFO - Received callback for node 69f8d8570573a8210e13081e INFO: 172.21.0.1:56150 - "POST /node/69f8d8570573a8210e13081e HTTP/1.0" 202 Accepted 2026-05-06 17:33:21,285 - lava_callback - INFO - Starting async job submit for node 69f8d8570573a8210e13081e 2026-05-06 17:33:21,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:33:21,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d8570573a8210e13081e HTTP/1.1" 200 None 2026-05-06 17:33:21,301 - lava_callback - DEBUG - Processing node 69f8d8570573a8210e13081e: baseline-arm-clabbe 2026-05-06 17:33:21,302 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d8570573a8210e13081e 2026-05-06 17:33:21,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:33:21,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d8570573a8210e13081e HTTP/1.1" 200 None 2026-05-06 17:33:21,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:33:21,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-06 17:33:21,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:33:21,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d8570573a8210e13081e HTTP/1.1" 200 None 2026-05-06 17:33:21,348 - lava_callback - ERROR - Error processing callback for node 69f8d8570573a8210e13081e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:53866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:36:41,544 - lava_callback - INFO - Received callback for node 69f8d91b0573a8210e13089a INFO: 172.21.0.1:43606 - "POST /node/69f8d91b0573a8210e13089a HTTP/1.0" 202 Accepted 2026-05-06 17:36:41,551 - lava_callback - INFO - Starting async job submit for node 69f8d91b0573a8210e13089a 2026-05-06 17:36:41,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:36:41,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d91b0573a8210e13089a HTTP/1.1" 200 None 2026-05-06 17:36:41,569 - lava_callback - DEBUG - Processing node 69f8d91b0573a8210e13089a: baseline-arm-clabbe 2026-05-06 17:36:41,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d91b0573a8210e13089a 2026-05-06 17:36:41,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:36:41,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d91b0573a8210e13089a HTTP/1.1" 200 None 2026-05-06 17:36:41,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:36:41,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-06 17:36:41,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:36:41,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d91b0573a8210e13089a HTTP/1.1" 200 None 2026-05-06 17:36:41,633 - lava_callback - ERROR - Error processing callback for node 69f8d91b0573a8210e13089a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:38:11,737 - lava_callback - INFO - Received callback for node 69fb7c6bdf29cd80ecaa0b34 INFO: 172.21.0.1:58138 - "POST /node/69fb7c6bdf29cd80ecaa0b34 HTTP/1.0" 202 Accepted 2026-05-06 17:38:11,747 - lava_callback - INFO - Starting async job submit for node 69fb7c6bdf29cd80ecaa0b34 2026-05-06 17:38:11,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:11,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c6bdf29cd80ecaa0b34 HTTP/1.1" 200 None 2026-05-06 17:38:11,778 - lava_callback - DEBUG - Processing node 69fb7c6bdf29cd80ecaa0b34: baseline-arm 2026-05-06 17:38:11,787 - lava_callback - WARNING - Failed to upload log 2026-05-06 17:38:11,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:38:11,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:38:11,971 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6bdf29cd80ecaa0b34/lava-logs.yaml 2026-05-06 17:38:11,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:38:12,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:38:12,082 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6bdf29cd80ecaa0b34/lava_callback.json.gz 2026-05-06 17:38:12,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:12,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c6bdf29cd80ecaa0b34 HTTP/1.1" 200 None 2026-05-06 17:38:12,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:12,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:38:12,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:12,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c6bdf29cd80ecaa0b34 HTTP/1.1" 200 None 2026-05-06 17:38:12,134 - lava_callback - INFO - Completed processing callback for node 69fb7c6bdf29cd80ecaa0b34 INFO: 172.21.0.1:58144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58150 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:38:19,803 - lava_callback - INFO - Received callback for node 69fb7c6edf29cd80ecaa0b40 INFO: 172.21.0.1:55660 - "POST /node/69fb7c6edf29cd80ecaa0b40 HTTP/1.0" 202 Accepted 2026-05-06 17:38:19,850 - lava_callback - INFO - Starting async job submit for node 69fb7c6edf29cd80ecaa0b40 2026-05-06 17:38:19,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:19,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c6edf29cd80ecaa0b40 HTTP/1.1" 200 None 2026-05-06 17:38:19,924 - lava_callback - DEBUG - Processing node 69fb7c6edf29cd80ecaa0b40: baseline-arm 2026-05-06 17:38:20,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:38:20,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:38:20,225 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6edf29cd80ecaa0b40/log.txt.gz 2026-05-06 17:38:20,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:38:20,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:38:20,407 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6edf29cd80ecaa0b40/lava-logs.yaml 2026-05-06 17:38:20,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:38:20,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:38:20,506 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6edf29cd80ecaa0b40/lava_callback.json.gz 2026-05-06 17:38:20,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:20,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c6edf29cd80ecaa0b40 HTTP/1.1" 200 None 2026-05-06 17:38:20,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:20,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:38:20,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:20,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c6edf29cd80ecaa0b40 HTTP/1.1" 200 None 2026-05-06 17:38:20,625 - lava_callback - INFO - Completed processing callback for node 69fb7c6edf29cd80ecaa0b40 2026-05-06 17:38:25,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:25,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:38:37,446 - lava_callback - INFO - Received callback for node 69fb7c6bdf29cd80ecaa0b37 INFO: 172.21.0.1:46686 - "POST /node/69fb7c6bdf29cd80ecaa0b37 HTTP/1.0" 202 Accepted 2026-05-06 17:38:37,494 - lava_callback - INFO - Starting async job submit for node 69fb7c6bdf29cd80ecaa0b37 2026-05-06 17:38:37,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:37,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c6bdf29cd80ecaa0b37 HTTP/1.1" 200 None 2026-05-06 17:38:37,527 - lava_callback - DEBUG - Processing node 69fb7c6bdf29cd80ecaa0b37: baseline-arm 2026-05-06 17:38:37,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:38:37,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:38:37,741 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6bdf29cd80ecaa0b37/log.txt.gz 2026-05-06 17:38:37,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:38:37,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:38:37,937 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6bdf29cd80ecaa0b37/lava-logs.yaml 2026-05-06 17:38:37,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:38:38,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:38:38,040 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6bdf29cd80ecaa0b37/lava_callback.json.gz 2026-05-06 17:38:38,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:38,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c6bdf29cd80ecaa0b37 HTTP/1.1" 200 None 2026-05-06 17:38:38,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:38,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:38:38,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:38,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c6bdf29cd80ecaa0b37 HTTP/1.1" 200 None 2026-05-06 17:38:38,109 - lava_callback - INFO - Completed processing callback for node 69fb7c6bdf29cd80ecaa0b37 INFO: 172.21.0.1:55830 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:38:52,071 - lava_callback - INFO - Received callback for node 69fb7c6ddf29cd80ecaa0b3d INFO: 172.21.0.1:33338 - "POST /node/69fb7c6ddf29cd80ecaa0b3d HTTP/1.0" 202 Accepted 2026-05-06 17:38:52,077 - lava_callback - INFO - Starting async job submit for node 69fb7c6ddf29cd80ecaa0b3d 2026-05-06 17:38:52,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:52,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c6ddf29cd80ecaa0b3d HTTP/1.1" 200 None 2026-05-06 17:38:52,128 - lava_callback - DEBUG - Processing node 69fb7c6ddf29cd80ecaa0b3d: baseline-arm 2026-05-06 17:38:52,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:38:52,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:38:52,433 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6ddf29cd80ecaa0b3d/log.txt.gz 2026-05-06 17:38:52,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:38:52,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:38:52,870 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6ddf29cd80ecaa0b3d/lava-logs.yaml 2026-05-06 17:38:52,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:38:52,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:38:52,978 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6ddf29cd80ecaa0b3d/lava_callback.json.gz 2026-05-06 17:38:53,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:53,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c6ddf29cd80ecaa0b3d HTTP/1.1" 200 None 2026-05-06 17:38:53,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:53,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:38:53,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:53,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c6ddf29cd80ecaa0b3d HTTP/1.1" 200 None 2026-05-06 17:38:53,070 - lava_callback - INFO - Completed processing callback for node 69fb7c6ddf29cd80ecaa0b3d 2026-05-06 17:38:55,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:38:55,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:39:01,246 - lava_callback - INFO - Received callback for node 69fb7c6adf29cd80ecaa0b31 INFO: 172.21.0.1:56596 - "POST /node/69fb7c6adf29cd80ecaa0b31 HTTP/1.0" 202 Accepted 2026-05-06 17:39:01,252 - lava_callback - INFO - Starting async job submit for node 69fb7c6adf29cd80ecaa0b31 2026-05-06 17:39:01,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:01,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c6adf29cd80ecaa0b31 HTTP/1.1" 200 None 2026-05-06 17:39:01,301 - lava_callback - DEBUG - Processing node 69fb7c6adf29cd80ecaa0b31: baseline-arm 2026-05-06 17:39:01,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:01,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:01,705 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6adf29cd80ecaa0b31/log.txt.gz 2026-05-06 17:39:01,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:01,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:01,951 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6adf29cd80ecaa0b31/lava-logs.yaml 2026-05-06 17:39:01,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:02,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:02,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6adf29cd80ecaa0b31/lava_callback.json.gz 2026-05-06 17:39:02,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:02,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c6adf29cd80ecaa0b31 HTTP/1.1" 200 None 2026-05-06 17:39:02,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:02,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:39:02,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:02,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c6adf29cd80ecaa0b31 HTTP/1.1" 200 None 2026-05-06 17:39:02,137 - lava_callback - INFO - Completed processing callback for node 69fb7c6adf29cd80ecaa0b31 INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:39:18,681 - lava_callback - INFO - Received callback for node 69fb7c90df29cd80ecaa0bcb INFO: 172.21.0.1:33358 - "POST /node/69fb7c90df29cd80ecaa0bcb HTTP/1.0" 202 Accepted 2026-05-06 17:39:18,732 - lava_callback - INFO - Starting async job submit for node 69fb7c90df29cd80ecaa0bcb 2026-05-06 17:39:18,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:18,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c90df29cd80ecaa0bcb HTTP/1.1" 200 None 2026-05-06 17:39:18,778 - lava_callback - DEBUG - Processing node 69fb7c90df29cd80ecaa0bcb: baseline-arm-pengutronix 2026-05-06 17:39:18,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:19,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:19,084 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb7c90df29cd80ecaa0bcb/log.txt.gz 2026-05-06 17:39:19,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:19,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:19,271 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb7c90df29cd80ecaa0bcb/lava-logs.yaml 2026-05-06 17:39:19,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:19,345 - lava_callback - INFO - Received callback for node 69fb7c7cdf29cd80ecaa0b83 INFO: 172.21.0.1:33370 - "POST /node/69fb7c7cdf29cd80ecaa0b83 HTTP/1.0" 202 Accepted 2026-05-06 17:39:19,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:19,352 - lava_callback - INFO - Starting async job submit for node 69fb7c7cdf29cd80ecaa0b83 2026-05-06 17:39:19,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:19,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb7c90df29cd80ecaa0bcb/lava_callback.json.gz 2026-05-06 17:39:19,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:19,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c7cdf29cd80ecaa0b83 HTTP/1.1" 200 None 2026-05-06 17:39:19,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c90df29cd80ecaa0bcb HTTP/1.1" 200 None 2026-05-06 17:39:19,422 - lava_callback - DEBUG - Processing node 69fb7c7cdf29cd80ecaa0b83: baseline-arm-broonie 2026-05-06 17:39:19,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:19,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:39:19,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:19,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c90df29cd80ecaa0bcb HTTP/1.1" 200 None 2026-05-06 17:39:19,662 - lava_callback - INFO - Completed processing callback for node 69fb7c90df29cd80ecaa0bcb 2026-05-06 17:39:19,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:19,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:19,829 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fb7c7cdf29cd80ecaa0b83/log.txt.gz 2026-05-06 17:39:19,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:20,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:20,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fb7c7cdf29cd80ecaa0b83/lava-logs.yaml 2026-05-06 17:39:20,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:20,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:20,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fb7c7cdf29cd80ecaa0b83/lava_callback.json.gz 2026-05-06 17:39:20,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:20,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c7cdf29cd80ecaa0b83 HTTP/1.1" 200 None 2026-05-06 17:39:20,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:20,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:39:20,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:20,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c7cdf29cd80ecaa0b83 HTTP/1.1" 200 None 2026-05-06 17:39:20,256 - lava_callback - INFO - Completed processing callback for node 69fb7c7cdf29cd80ecaa0b83 2026-05-06 17:39:23,414 - lava_callback - INFO - Received callback for node 69fb7c8edf29cd80ecaa0bc5 INFO: 172.21.0.1:32920 - "POST /node/69fb7c8edf29cd80ecaa0bc5 HTTP/1.0" 202 Accepted 2026-05-06 17:39:23,420 - lava_callback - INFO - Starting async job submit for node 69fb7c8edf29cd80ecaa0bc5 2026-05-06 17:39:23,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:23,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c8edf29cd80ecaa0bc5 HTTP/1.1" 200 None 2026-05-06 17:39:23,452 - lava_callback - DEBUG - Processing node 69fb7c8edf29cd80ecaa0bc5: baseline-arm-pengutronix 2026-05-06 17:39:23,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:23,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:23,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb7c8edf29cd80ecaa0bc5/log.txt.gz 2026-05-06 17:39:23,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:23,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:23,978 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb7c8edf29cd80ecaa0bc5/lava-logs.yaml 2026-05-06 17:39:23,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:24,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:24,129 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb7c8edf29cd80ecaa0bc5/lava_callback.json.gz 2026-05-06 17:39:24,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:24,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c8edf29cd80ecaa0bc5 HTTP/1.1" 200 None 2026-05-06 17:39:24,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:24,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:39:24,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:24,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c8edf29cd80ecaa0bc5 HTTP/1.1" 200 None 2026-05-06 17:39:24,209 - lava_callback - INFO - Completed processing callback for node 69fb7c8edf29cd80ecaa0bc5 2026-05-06 17:39:25,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:25,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:39:36,848 - lava_callback - INFO - Received callback for node 69fb7c8ddf29cd80ecaa0bc2 INFO: 172.21.0.1:35238 - "POST /node/69fb7c8ddf29cd80ecaa0bc2 HTTP/1.0" 202 Accepted 2026-05-06 17:39:36,854 - lava_callback - INFO - Starting async job submit for node 69fb7c8ddf29cd80ecaa0bc2 2026-05-06 17:39:36,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:36,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c8ddf29cd80ecaa0bc2 HTTP/1.1" 200 None 2026-05-06 17:39:36,893 - lava_callback - DEBUG - Processing node 69fb7c8ddf29cd80ecaa0bc2: baseline-arm-pengutronix 2026-05-06 17:39:37,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:37,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:37,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb7c8ddf29cd80ecaa0bc2/log.txt.gz 2026-05-06 17:39:37,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:37,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:37,455 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb7c8ddf29cd80ecaa0bc2/lava-logs.yaml 2026-05-06 17:39:37,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:37,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:37,556 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb7c8ddf29cd80ecaa0bc2/lava_callback.json.gz 2026-05-06 17:39:37,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:37,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c8ddf29cd80ecaa0bc2 HTTP/1.1" 200 None 2026-05-06 17:39:37,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:37,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:39:37,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:37,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c8ddf29cd80ecaa0bc2 HTTP/1.1" 200 None 2026-05-06 17:39:37,639 - lava_callback - INFO - Completed processing callback for node 69fb7c8ddf29cd80ecaa0bc2 2026-05-06 17:39:38,249 - lava_callback - INFO - Received callback for node 69fb7c7bdf29cd80ecaa0b80 INFO: 172.21.0.1:35250 - "POST /node/69fb7c7bdf29cd80ecaa0b80 HTTP/1.0" 202 Accepted 2026-05-06 17:39:38,255 - lava_callback - INFO - Starting async job submit for node 69fb7c7bdf29cd80ecaa0b80 2026-05-06 17:39:38,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:38,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c7bdf29cd80ecaa0b80 HTTP/1.1" 200 None 2026-05-06 17:39:38,292 - lava_callback - DEBUG - Processing node 69fb7c7bdf29cd80ecaa0b80: baseline-arm-broonie 2026-05-06 17:39:38,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:38,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:38,569 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fb7c7bdf29cd80ecaa0b80/log.txt.gz 2026-05-06 17:39:38,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:38,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:38,823 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fb7c7bdf29cd80ecaa0b80/lava-logs.yaml 2026-05-06 17:39:38,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:38,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:38,922 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fb7c7bdf29cd80ecaa0b80/lava_callback.json.gz 2026-05-06 17:39:38,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:38,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c7bdf29cd80ecaa0b80 HTTP/1.1" 200 None 2026-05-06 17:39:38,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:38,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:39:38,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:39,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c7bdf29cd80ecaa0b80 HTTP/1.1" 200 None 2026-05-06 17:39:39,008 - lava_callback - INFO - Completed processing callback for node 69fb7c7bdf29cd80ecaa0b80 2026-05-06 17:39:45,169 - lava_callback - INFO - Received callback for node 69fb7c7edf29cd80ecaa0b86 INFO: 172.21.0.1:60988 - "POST /node/69fb7c7edf29cd80ecaa0b86 HTTP/1.0" 202 Accepted 2026-05-06 17:39:45,178 - lava_callback - INFO - Starting async job submit for node 69fb7c7edf29cd80ecaa0b86 2026-05-06 17:39:45,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:45,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c7edf29cd80ecaa0b86 HTTP/1.1" 200 None 2026-05-06 17:39:45,219 - lava_callback - DEBUG - Processing node 69fb7c7edf29cd80ecaa0b86: baseline-arm-broonie 2026-05-06 17:39:45,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:45,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:45,777 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fb7c7edf29cd80ecaa0b86/log.txt.gz 2026-05-06 17:39:45,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:46,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:46,283 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fb7c7edf29cd80ecaa0b86/lava-logs.yaml 2026-05-06 17:39:46,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:46,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:46,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fb7c7edf29cd80ecaa0b86/lava_callback.json.gz 2026-05-06 17:39:46,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:46,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c7edf29cd80ecaa0b86 HTTP/1.1" 200 None 2026-05-06 17:39:46,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:46,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:39:46,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:39:46,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c7edf29cd80ecaa0b86 HTTP/1.1" 200 None 2026-05-06 17:39:46,570 - lava_callback - INFO - Completed processing callback for node 69fb7c7edf29cd80ecaa0b86 2026-05-06 17:39:55,426 - lava_callback - INFO - Received callback for node 69fb7c81df29cd80ecaa0b95 INFO: 172.21.0.1:59700 - "POST /node/69fb7c81df29cd80ecaa0b95 HTTP/1.0" 202 Accepted 2026-05-06 17:39:55,432 - lava_callback - INFO - Starting async job submit for node 69fb7c81df29cd80ecaa0b95 2026-05-06 17:39:55,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:55,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:55,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c81df29cd80ecaa0b95 HTTP/1.1" 200 None 2026-05-06 17:39:55,475 - lava_callback - DEBUG - Processing node 69fb7c81df29cd80ecaa0b95: baseline-arm-clabbe 2026-05-06 17:39:55,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-06 17:39:55,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:55,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:55,852 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fb7c81df29cd80ecaa0b95/log.txt.gz 2026-05-06 17:39:55,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:56,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:56,126 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fb7c81df29cd80ecaa0b95/lava-logs.yaml 2026-05-06 17:39:56,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:56,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:56,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fb7c81df29cd80ecaa0b95/lava_callback.json.gz 2026-05-06 17:39:56,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:56,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c81df29cd80ecaa0b95 HTTP/1.1" 200 None 2026-05-06 17:39:56,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:56,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:39:56,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:56,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c81df29cd80ecaa0b95 HTTP/1.1" 200 None 2026-05-06 17:39:56,323 - lava_callback - INFO - Completed processing callback for node 69fb7c81df29cd80ecaa0b95 INFO: 172.21.0.1:59710 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:39:58,469 - lava_callback - INFO - Received callback for node 69fb7c8adf29cd80ecaa0bb3 INFO: 172.21.0.1:59716 - "POST /node/69fb7c8adf29cd80ecaa0bb3 HTTP/1.0" 202 Accepted 2026-05-06 17:39:58,474 - lava_callback - INFO - Starting async job submit for node 69fb7c8adf29cd80ecaa0bb3 2026-05-06 17:39:58,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:58,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c8adf29cd80ecaa0bb3 HTTP/1.1" 200 None 2026-05-06 17:39:58,512 - lava_callback - DEBUG - Processing node 69fb7c8adf29cd80ecaa0bb3: baseline-arm-kontron 2026-05-06 17:39:58,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:58,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:58,765 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fb7c8adf29cd80ecaa0bb3/log.txt.gz 2026-05-06 17:39:58,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:58,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:58,994 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fb7c8adf29cd80ecaa0bb3/lava-logs.yaml 2026-05-06 17:39:58,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:39:59,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:39:59,087 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fb7c8adf29cd80ecaa0bb3/lava_callback.json.gz 2026-05-06 17:39:59,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:59,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c8adf29cd80ecaa0bb3 HTTP/1.1" 200 None 2026-05-06 17:39:59,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:59,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:39:59,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:39:59,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c8adf29cd80ecaa0bb3 HTTP/1.1" 200 None 2026-05-06 17:39:59,160 - lava_callback - INFO - Completed processing callback for node 69fb7c8adf29cd80ecaa0bb3 2026-05-06 17:40:01,698 - lava_callback - INFO - Received callback for node 69f8d9ee0573a8210e13093e INFO: 172.21.0.1:36674 - "POST /node/69f8d9ee0573a8210e13093e HTTP/1.0" 202 Accepted 2026-05-06 17:40:01,704 - lava_callback - INFO - Starting async job submit for node 69f8d9ee0573a8210e13093e 2026-05-06 17:40:01,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:01,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d9ee0573a8210e13093e HTTP/1.1" 200 None 2026-05-06 17:40:01,719 - lava_callback - DEBUG - Processing node 69f8d9ee0573a8210e13093e: baseline-arm-clabbe 2026-05-06 17:40:01,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8d9ee0573a8210e13093e 2026-05-06 17:40:01,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:01,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d9ee0573a8210e13093e HTTP/1.1" 200 None 2026-05-06 17:40:01,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:01,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-06 17:40:01,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:01,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d9ee0573a8210e13093e HTTP/1.1" 200 None 2026-05-06 17:40:01,763 - lava_callback - ERROR - Error processing callback for node 69f8d9ee0573a8210e13093e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 17:40:06,088 - lava_callback - INFO - Received callback for node 69fb7c7adf29cd80ecaa0b5d INFO: 172.21.0.1:36680 - "POST /node/69fb7c7adf29cd80ecaa0b5d HTTP/1.0" 202 Accepted 2026-05-06 17:40:06,094 - lava_callback - INFO - Starting async job submit for node 69fb7c7adf29cd80ecaa0b5d 2026-05-06 17:40:06,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:06,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c7adf29cd80ecaa0b5d HTTP/1.1" 200 None 2026-05-06 17:40:06,135 - lava_callback - DEBUG - Processing node 69fb7c7adf29cd80ecaa0b5d: baseline-arm-broonie 2026-05-06 17:40:06,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:40:06,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:40:06,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fb7c7adf29cd80ecaa0b5d/log.txt.gz INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:40:06,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:40:06,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:40:06,674 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fb7c7adf29cd80ecaa0b5d/lava-logs.yaml 2026-05-06 17:40:06,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:40:06,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:40:06,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fb7c7adf29cd80ecaa0b5d/lava_callback.json.gz 2026-05-06 17:40:06,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:06,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c7adf29cd80ecaa0b5d HTTP/1.1" 200 None 2026-05-06 17:40:06,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:06,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:40:06,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:06,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c7adf29cd80ecaa0b5d HTTP/1.1" 200 None 2026-05-06 17:40:06,860 - lava_callback - INFO - Completed processing callback for node 69fb7c7adf29cd80ecaa0b5d INFO: 172.21.0.1:34070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34080 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:40:18,553 - lava_callback - INFO - Received callback for node 69fb7c89df29cd80ecaa0bb0 INFO: 172.21.0.1:34088 - "POST /node/69fb7c89df29cd80ecaa0bb0 HTTP/1.0" 202 Accepted 2026-05-06 17:40:18,559 - lava_callback - INFO - Starting async job submit for node 69fb7c89df29cd80ecaa0bb0 2026-05-06 17:40:18,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:18,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c89df29cd80ecaa0bb0 HTTP/1.1" 200 None 2026-05-06 17:40:18,596 - lava_callback - DEBUG - Processing node 69fb7c89df29cd80ecaa0bb0: baseline-arm-kontron 2026-05-06 17:40:18,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:40:18,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:40:18,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fb7c89df29cd80ecaa0bb0/log.txt.gz 2026-05-06 17:40:18,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:40:19,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:40:19,113 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fb7c89df29cd80ecaa0bb0/lava-logs.yaml 2026-05-06 17:40:19,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:40:19,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:40:19,210 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fb7c89df29cd80ecaa0bb0/lava_callback.json.gz 2026-05-06 17:40:19,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:19,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c89df29cd80ecaa0bb0 HTTP/1.1" 200 None 2026-05-06 17:40:19,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:19,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:40:19,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:19,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c89df29cd80ecaa0bb0 HTTP/1.1" 200 None 2026-05-06 17:40:19,291 - lava_callback - INFO - Completed processing callback for node 69fb7c89df29cd80ecaa0bb0 2026-05-06 17:40:20,192 - lava_callback - INFO - Received callback for node 69fb7ca8df29cd80ecaa0c14 INFO: 172.21.0.1:41742 - "POST /node/69fb7ca8df29cd80ecaa0c14 HTTP/1.0" 202 Accepted 2026-05-06 17:40:20,200 - lava_callback - INFO - Starting async job submit for node 69fb7ca8df29cd80ecaa0c14 2026-05-06 17:40:20,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:20,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ca8df29cd80ecaa0c14 HTTP/1.1" 200 None 2026-05-06 17:40:20,257 - lava_callback - DEBUG - Processing node 69fb7ca8df29cd80ecaa0c14: ltp-dio 2026-05-06 17:40:20,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:40:20,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:40:20,847 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69fb7ca8df29cd80ecaa0c14/log.txt.gz 2026-05-06 17:40:21,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:40:21,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:40:21,244 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69fb7ca8df29cd80ecaa0c14/lava-logs.yaml 2026-05-06 17:40:21,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:40:21,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:40:21,373 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69fb7ca8df29cd80ecaa0c14/lava_callback.json.gz 2026-05-06 17:40:21,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:21,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ca8df29cd80ecaa0c14 HTTP/1.1" 200 None 2026-05-06 17:40:21,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:21,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:40:21,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:21,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7ca8df29cd80ecaa0c14 HTTP/1.1" 200 None 2026-05-06 17:40:21,448 - lava_callback - INFO - Completed processing callback for node 69fb7ca8df29cd80ecaa0c14 2026-05-06 17:40:25,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:25,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:40:54,335 - lava_callback - INFO - Received callback for node 69fb7c82df29cd80ecaa0b99 INFO: 172.21.0.1:52794 - "POST /node/69fb7c82df29cd80ecaa0b99 HTTP/1.0" 202 Accepted 2026-05-06 17:40:54,343 - lava_callback - INFO - Starting async job submit for node 69fb7c82df29cd80ecaa0b99 2026-05-06 17:40:54,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:54,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c82df29cd80ecaa0b99 HTTP/1.1" 200 None 2026-05-06 17:40:54,381 - lava_callback - DEBUG - Processing node 69fb7c82df29cd80ecaa0b99: baseline-arm-clabbe 2026-05-06 17:40:54,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:40:54,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:40:54,717 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fb7c82df29cd80ecaa0b99/log.txt.gz 2026-05-06 17:40:54,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:40:54,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:40:54,963 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fb7c82df29cd80ecaa0b99/lava-logs.yaml 2026-05-06 17:40:54,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:40:55,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:40:55,053 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fb7c82df29cd80ecaa0b99/lava_callback.json.gz 2026-05-06 17:40:55,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:55,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c82df29cd80ecaa0b99 HTTP/1.1" 200 None 2026-05-06 17:40:55,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:55,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:40:55,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:55,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c82df29cd80ecaa0b99 HTTP/1.1" 200 None 2026-05-06 17:40:55,138 - lava_callback - INFO - Completed processing callback for node 69fb7c82df29cd80ecaa0b99 2026-05-06 17:40:55,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:40:55,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:41:39,349 - lava_callback - INFO - Received callback for node 69fb7c86df29cd80ecaa0baa INFO: 172.21.0.1:33280 - "POST /node/69fb7c86df29cd80ecaa0baa HTTP/1.0" 202 Accepted 2026-05-06 17:41:39,355 - lava_callback - INFO - Starting async job submit for node 69fb7c86df29cd80ecaa0baa 2026-05-06 17:41:39,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:41:39,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c86df29cd80ecaa0baa HTTP/1.1" 200 None 2026-05-06 17:41:39,392 - lava_callback - DEBUG - Processing node 69fb7c86df29cd80ecaa0baa: baseline-arm-clabbe 2026-05-06 17:41:39,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:41:39,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:41:39,672 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fb7c86df29cd80ecaa0baa/log.txt.gz 2026-05-06 17:41:39,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:41:39,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:41:39,938 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fb7c86df29cd80ecaa0baa/lava-logs.yaml 2026-05-06 17:41:39,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:41:40,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:41:40,051 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fb7c86df29cd80ecaa0baa/lava_callback.json.gz 2026-05-06 17:41:40,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:41:40,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c86df29cd80ecaa0baa HTTP/1.1" 200 None 2026-05-06 17:41:40,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:41:40,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:41:40,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:41:40,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c86df29cd80ecaa0baa HTTP/1.1" 200 None 2026-05-06 17:41:40,133 - lava_callback - INFO - Completed processing callback for node 69fb7c86df29cd80ecaa0baa INFO: 172.21.0.1:54264 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:41:55,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:41:55,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33000 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:42:45,548 - lava_callback - INFO - Received callback for node 69fb7ca4df29cd80ecaa0c0e INFO: 172.21.0.1:58908 - "POST /node/69fb7ca4df29cd80ecaa0c0e HTTP/1.0" 202 Accepted 2026-05-06 17:42:45,556 - lava_callback - INFO - Starting async job submit for node 69fb7ca4df29cd80ecaa0c0e 2026-05-06 17:42:45,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:42:45,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ca4df29cd80ecaa0c0e HTTP/1.1" 200 None 2026-05-06 17:42:45,599 - lava_callback - DEBUG - Processing node 69fb7ca4df29cd80ecaa0c0e: ltp-controllers 2026-05-06 17:42:46,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:42:46,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:42:46,227 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69fb7ca4df29cd80ecaa0c0e/log.txt.gz 2026-05-06 17:42:46,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:42:46,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:42:46,710 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69fb7ca4df29cd80ecaa0c0e/lava-logs.yaml 2026-05-06 17:42:46,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:42:46,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:42:46,902 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69fb7ca4df29cd80ecaa0c0e/lava_callback.json.gz 2026-05-06 17:42:46,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:42:46,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ca4df29cd80ecaa0c0e HTTP/1.1" 200 None 2026-05-06 17:42:46,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:42:46,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:42:46,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:42:46,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7ca4df29cd80ecaa0c0e HTTP/1.1" 200 None 2026-05-06 17:42:46,991 - lava_callback - INFO - Completed processing callback for node 69fb7ca4df29cd80ecaa0c0e 2026-05-06 17:42:55,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:42:55,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:43:05,639 - lava_callback - INFO - Received callback for node 69fb7cb3df29cd80ecaa0c39 INFO: 172.21.0.1:34828 - "POST /node/69fb7cb3df29cd80ecaa0c39 HTTP/1.0" 202 Accepted 2026-05-06 17:43:05,651 - lava_callback - INFO - Starting async job submit for node 69fb7cb3df29cd80ecaa0c39 2026-05-06 17:43:05,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:05,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cb3df29cd80ecaa0c39 HTTP/1.1" 200 None 2026-05-06 17:43:05,701 - lava_callback - DEBUG - Processing node 69fb7cb3df29cd80ecaa0c39: ltp-syscalls 2026-05-06 17:43:06,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34842 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:43:06,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:43:06,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fb7cb3df29cd80ecaa0c39/log.txt.gz INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:43:07,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:43:07,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:43:07,194 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fb7cb3df29cd80ecaa0c39/lava-logs.yaml 2026-05-06 17:43:07,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:43:07,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:43:07,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fb7cb3df29cd80ecaa0c39/lava_callback.json.gz 2026-05-06 17:43:07,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:07,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cb3df29cd80ecaa0c39 HTTP/1.1" 200 None 2026-05-06 17:43:07,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:07,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:43:07,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:07,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7cb3df29cd80ecaa0c39 HTTP/1.1" 200 None 2026-05-06 17:43:07,453 - lava_callback - INFO - Completed processing callback for node 69fb7cb3df29cd80ecaa0c39 2026-05-06 17:43:13,890 - lava_callback - INFO - Received callback for node 69fb7da5df29cd80ecaa3469 INFO: 172.21.0.1:41990 - "POST /node/69fb7da5df29cd80ecaa3469 HTTP/1.0" 202 Accepted 2026-05-06 17:43:13,895 - lava_callback - INFO - Starting async job submit for node 69fb7da5df29cd80ecaa3469 2026-05-06 17:43:13,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:13,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7da5df29cd80ecaa3469 HTTP/1.1" 200 None 2026-05-06 17:43:13,913 - lava_callback - DEBUG - Processing node 69fb7da5df29cd80ecaa3469: baseline-arm 2026-05-06 17:43:13,918 - lava_callback - WARNING - Failed to upload log 2026-05-06 17:43:13,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:43:14,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:43:14,009 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7da5df29cd80ecaa3469/lava-logs.yaml 2026-05-06 17:43:14,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:43:14,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:43:14,095 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7da5df29cd80ecaa3469/lava_callback.json.gz 2026-05-06 17:43:14,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:14,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7da5df29cd80ecaa3469 HTTP/1.1" 200 None 2026-05-06 17:43:14,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:14,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:43:14,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:14,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7da5df29cd80ecaa3469 HTTP/1.1" 200 None 2026-05-06 17:43:14,154 - lava_callback - INFO - Completed processing callback for node 69fb7da5df29cd80ecaa3469 INFO: 172.21.0.1:42000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:43:25,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:25,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-06 17:43:25,681 - lava_callback - INFO - Received callback for node 69fb7ca1df29cd80ecaa0c08 INFO: 172.21.0.1:49190 - "POST /node/69fb7ca1df29cd80ecaa0c08 HTTP/1.0" 202 Accepted 2026-05-06 17:43:25,691 - lava_callback - INFO - Starting async job submit for node 69fb7ca1df29cd80ecaa0c08 2026-05-06 17:43:25,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:25,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ca1df29cd80ecaa0c08 HTTP/1.1" 200 None 2026-05-06 17:43:25,757 - lava_callback - DEBUG - Processing node 69fb7ca1df29cd80ecaa0c08: ltp-cap_bounds 2026-05-06 17:43:26,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:43:26,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:43:26,308 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fb7ca1df29cd80ecaa0c08/log.txt.gz INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:43:26,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:43:26,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:43:26,676 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fb7ca1df29cd80ecaa0c08/lava-logs.yaml 2026-05-06 17:43:26,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:43:26,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:43:26,803 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fb7ca1df29cd80ecaa0c08/lava_callback.json.gz 2026-05-06 17:43:26,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:26,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ca1df29cd80ecaa0c08 HTTP/1.1" 200 None 2026-05-06 17:43:26,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:26,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:43:26,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:26,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7ca1df29cd80ecaa0c08 HTTP/1.1" 200 None 2026-05-06 17:43:26,887 - lava_callback - INFO - Completed processing callback for node 69fb7ca1df29cd80ecaa0c08 INFO: 172.21.0.1:42190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:43:55,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:43:55,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39902 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:44:05,478 - lava_callback - INFO - Received callback for node 69fb7ca6df29cd80ecaa0c11 INFO: 172.21.0.1:56422 - "POST /node/69fb7ca6df29cd80ecaa0c11 HTTP/1.0" 202 Accepted 2026-05-06 17:44:05,485 - lava_callback - INFO - Starting async job submit for node 69fb7ca6df29cd80ecaa0c11 2026-05-06 17:44:05,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:44:05,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ca6df29cd80ecaa0c11 HTTP/1.1" 200 None 2026-05-06 17:44:05,535 - lava_callback - DEBUG - Processing node 69fb7ca6df29cd80ecaa0c11: ltp-cve 2026-05-06 17:44:05,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:44:06,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:44:06,092 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69fb7ca6df29cd80ecaa0c11/log.txt.gz 2026-05-06 17:44:06,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:44:06,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:44:06,496 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69fb7ca6df29cd80ecaa0c11/lava-logs.yaml 2026-05-06 17:44:06,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:56432 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:44:06,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:44:06,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69fb7ca6df29cd80ecaa0c11/lava_callback.json.gz 2026-05-06 17:44:06,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:44:06,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ca6df29cd80ecaa0c11 HTTP/1.1" 200 None 2026-05-06 17:44:06,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:44:06,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:44:06,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:44:06,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7ca6df29cd80ecaa0c11 HTTP/1.1" 200 None 2026-05-06 17:44:06,696 - lava_callback - INFO - Completed processing callback for node 69fb7ca6df29cd80ecaa0c11 INFO: 172.21.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:44:25,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:44:25,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:45:57,452 - lava_callback - INFO - Received callback for node 69fb7ca3df29cd80ecaa0c0b INFO: 172.21.0.1:41144 - "POST /node/69fb7ca3df29cd80ecaa0c0b HTTP/1.0" 202 Accepted 2026-05-06 17:45:57,459 - lava_callback - INFO - Starting async job submit for node 69fb7ca3df29cd80ecaa0c0b 2026-05-06 17:45:57,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:45:57,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ca3df29cd80ecaa0c0b HTTP/1.1" 200 None 2026-05-06 17:45:57,511 - lava_callback - DEBUG - Processing node 69fb7ca3df29cd80ecaa0c0b: ltp-containers 2026-05-06 17:45:58,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:45:58,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:45:58,123 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69fb7ca3df29cd80ecaa0c0b/log.txt.gz 2026-05-06 17:45:58,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:45:58,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:45:58,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69fb7ca3df29cd80ecaa0c0b/lava-logs.yaml 2026-05-06 17:45:58,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:45:58,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:45:58,733 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69fb7ca3df29cd80ecaa0c0b/lava_callback.json.gz 2026-05-06 17:45:58,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:45:58,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ca3df29cd80ecaa0c0b HTTP/1.1" 200 None 2026-05-06 17:45:58,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:45:58,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:45:58,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:45:58,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7ca3df29cd80ecaa0c0b HTTP/1.1" 200 None 2026-05-06 17:45:58,818 - lava_callback - INFO - Completed processing callback for node 69fb7ca3df29cd80ecaa0c0b INFO: 172.21.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42440 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:46:25,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:46:25,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:47:52,210 - lava_callback - INFO - Received callback for node 69fb7ec0df29cd80ecaa34d5 INFO: 172.21.0.1:43660 - "POST /node/69fb7ec0df29cd80ecaa34d5 HTTP/1.0" 202 Accepted 2026-05-06 17:47:52,216 - lava_callback - INFO - Starting async job submit for node 69fb7ec0df29cd80ecaa34d5 2026-05-06 17:47:52,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:47:52,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ec0df29cd80ecaa34d5 HTTP/1.1" 200 None 2026-05-06 17:47:52,234 - lava_callback - DEBUG - Processing node 69fb7ec0df29cd80ecaa34d5: baseline-arm 2026-05-06 17:47:52,240 - lava_callback - WARNING - Failed to upload log 2026-05-06 17:47:52,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:47:52,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:47:52,350 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7ec0df29cd80ecaa34d5/lava-logs.yaml 2026-05-06 17:47:52,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:47:52,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:47:52,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7ec0df29cd80ecaa34d5/lava_callback.json.gz 2026-05-06 17:47:52,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:47:52,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ec0df29cd80ecaa34d5 HTTP/1.1" 200 None 2026-05-06 17:47:52,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:47:52,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:47:52,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:47:52,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7ec0df29cd80ecaa34d5 HTTP/1.1" 200 None 2026-05-06 17:47:52,516 - lava_callback - INFO - Completed processing callback for node 69fb7ec0df29cd80ecaa34d5 2026-05-06 17:47:55,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:47:55,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:49:59,671 - lava_callback - INFO - Received callback for node 69f8dc320573a8210e130acd INFO: 172.21.0.1:58588 - "POST /node/69f8dc320573a8210e130acd HTTP/1.0" 202 Accepted 2026-05-06 17:49:59,678 - lava_callback - INFO - Starting async job submit for node 69f8dc320573a8210e130acd 2026-05-06 17:49:59,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:49:59,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dc320573a8210e130acd HTTP/1.1" 200 None 2026-05-06 17:49:59,702 - lava_callback - DEBUG - Processing node 69f8dc320573a8210e130acd: baseline-arm64-baylibre 2026-05-06 17:49:59,702 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8dc320573a8210e130acd 2026-05-06 17:49:59,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:49:59,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dc320573a8210e130acd HTTP/1.1" 200 None 2026-05-06 17:49:59,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:49:59,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-06 17:49:59,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:49:59,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8dc320573a8210e130acd HTTP/1.1" 200 None 2026-05-06 17:49:59,749 - lava_callback - ERROR - Error processing callback for node 69f8dc320573a8210e130acd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42248 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:52:24,945 - lava_callback - INFO - Received callback for node 69fb7fd2df29cd80ecaa3524 INFO: 172.21.0.1:57112 - "POST /node/69fb7fd2df29cd80ecaa3524 HTTP/1.0" 202 Accepted 2026-05-06 17:52:24,955 - lava_callback - INFO - Starting async job submit for node 69fb7fd2df29cd80ecaa3524 2026-05-06 17:52:24,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:52:24,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7fd2df29cd80ecaa3524 HTTP/1.1" 200 None 2026-05-06 17:52:24,973 - lava_callback - DEBUG - Processing node 69fb7fd2df29cd80ecaa3524: baseline-arm 2026-05-06 17:52:24,981 - lava_callback - WARNING - Failed to upload log 2026-05-06 17:52:24,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:52:25,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:52:25,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7fd2df29cd80ecaa3524/lava-logs.yaml 2026-05-06 17:52:25,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:52:25,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:52:25,181 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7fd2df29cd80ecaa3524/lava_callback.json.gz 2026-05-06 17:52:25,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:52:25,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7fd2df29cd80ecaa3524 HTTP/1.1" 200 None 2026-05-06 17:52:25,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:52:25,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:52:25,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:52:25,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7fd2df29cd80ecaa3524 HTTP/1.1" 200 None 2026-05-06 17:52:25,244 - lava_callback - INFO - Completed processing callback for node 69fb7fd2df29cd80ecaa3524 2026-05-06 17:52:25,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:52:25,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:54:02,272 - lava_callback - INFO - Received callback for node 69f8dd370573a8210e130b9f INFO: 172.21.0.1:54518 - "POST /node/69f8dd370573a8210e130b9f HTTP/1.0" 202 Accepted 2026-05-06 17:54:02,278 - lava_callback - INFO - Starting async job submit for node 69f8dd370573a8210e130b9f 2026-05-06 17:54:02,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:54:02,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dd370573a8210e130b9f HTTP/1.1" 200 None 2026-05-06 17:54:02,294 - lava_callback - DEBUG - Processing node 69f8dd370573a8210e130b9f: baseline-arm64-clabbe 2026-05-06 17:54:02,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8dd370573a8210e130b9f 2026-05-06 17:54:02,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:54:02,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dd370573a8210e130b9f HTTP/1.1" 200 None 2026-05-06 17:54:02,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:54:02,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-06 17:54:02,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:54:02,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8dd370573a8210e130b9f HTTP/1.1" 200 None 2026-05-06 17:54:02,355 - lava_callback - ERROR - Error processing callback for node 69f8dd370573a8210e130b9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:55:38,634 - lava_callback - INFO - Received callback for node 69fb7c6cdf29cd80ecaa0b3a INFO: 172.21.0.1:44656 - "POST /node/69fb7c6cdf29cd80ecaa0b3a HTTP/1.0" 202 Accepted 2026-05-06 17:55:38,641 - lava_callback - INFO - Starting async job submit for node 69fb7c6cdf29cd80ecaa0b3a 2026-05-06 17:55:38,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:55:38,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c6cdf29cd80ecaa0b3a HTTP/1.1" 200 None 2026-05-06 17:55:38,723 - lava_callback - DEBUG - Processing node 69fb7c6cdf29cd80ecaa0b3a: baseline-arm 2026-05-06 17:55:39,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:55:39,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:55:39,493 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6cdf29cd80ecaa0b3a/log.txt.gz 2026-05-06 17:55:39,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:55:40,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:55:40,032 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6cdf29cd80ecaa0b3a/lava-logs.yaml 2026-05-06 17:55:40,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:55:40,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:55:40,151 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb7c6cdf29cd80ecaa0b3a/lava_callback.json.gz DEBUG: Setup failed for 69fb7c6cdf29cd80ecaa0b3a. Transitting job node result: incomplete -> fail 2026-05-06 17:55:40,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:55:40,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c6cdf29cd80ecaa0b3a HTTP/1.1" 200 None 2026-05-06 17:55:40,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:55:40,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:55:40,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:55:40,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c6cdf29cd80ecaa0b3a HTTP/1.1" 200 None 2026-05-06 17:55:40,503 - lava_callback - INFO - Completed processing callback for node 69fb7c6cdf29cd80ecaa0b3a INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:55:55,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:55:55,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:57:02,294 - lava_callback - INFO - Received callback for node 69f8dddf0573a8210e130c0b INFO: 172.21.0.1:48078 - "POST /node/69f8dddf0573a8210e130c0b HTTP/1.0" 202 Accepted 2026-05-06 17:57:02,302 - lava_callback - INFO - Starting async job submit for node 69f8dddf0573a8210e130c0b 2026-05-06 17:57:02,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:57:02,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dddf0573a8210e130c0b HTTP/1.1" 200 None 2026-05-06 17:57:02,328 - lava_callback - DEBUG - Processing node 69f8dddf0573a8210e130c0b: baseline-arm64-clabbe 2026-05-06 17:57:02,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8dddf0573a8210e130c0b 2026-05-06 17:57:02,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:57:02,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dddf0573a8210e130c0b HTTP/1.1" 200 None 2026-05-06 17:57:02,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:57:02,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-06 17:57:02,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:57:02,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8dddf0573a8210e130c0b HTTP/1.1" 200 None 2026-05-06 17:57:02,410 - lava_callback - ERROR - Error processing callback for node 69f8dddf0573a8210e130c0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:57:46,171 - lava_callback - INFO - Received callback for node 69fb7c8fdf29cd80ecaa0bc8 INFO: 172.21.0.1:50538 - "POST /node/69fb7c8fdf29cd80ecaa0bc8 HTTP/1.0" 202 Accepted 2026-05-06 17:57:46,217 - lava_callback - INFO - Starting async job submit for node 69fb7c8fdf29cd80ecaa0bc8 2026-05-06 17:57:46,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:57:46,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c8fdf29cd80ecaa0bc8 HTTP/1.1" 200 None 2026-05-06 17:57:46,256 - lava_callback - DEBUG - Processing node 69fb7c8fdf29cd80ecaa0bc8: baseline-arm-pengutronix 2026-05-06 17:57:46,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:57:46,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:57:46,457 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb7c8fdf29cd80ecaa0bc8/log.txt.gz INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:57:46,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:57:46,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:57:46,673 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb7c8fdf29cd80ecaa0bc8/lava-logs.yaml 2026-05-06 17:57:46,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 17:57:46,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 17:57:46,763 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb7c8fdf29cd80ecaa0bc8/lava_callback.json.gz DEBUG: Setup failed for 69fb7c8fdf29cd80ecaa0bc8. Transitting job node result: incomplete -> fail 2026-05-06 17:57:46,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:57:46,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c8fdf29cd80ecaa0bc8 HTTP/1.1" 200 None 2026-05-06 17:57:46,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:57:46,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 17:57:46,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:57:46,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c8fdf29cd80ecaa0bc8 HTTP/1.1" 200 None 2026-05-06 17:57:46,956 - lava_callback - INFO - Completed processing callback for node 69fb7c8fdf29cd80ecaa0bc8 2026-05-06 17:57:55,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:57:55,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53716 - "GET / HTTP/1.0" 200 OK 2026-05-06 17:59:42,421 - lava_callback - INFO - Received callback for node 69f8de870573a8210e130c82 INFO: 172.21.0.1:35930 - "POST /node/69f8de870573a8210e130c82 HTTP/1.0" 202 Accepted 2026-05-06 17:59:42,426 - lava_callback - INFO - Starting async job submit for node 69f8de870573a8210e130c82 2026-05-06 17:59:42,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:59:42,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8de870573a8210e130c82 HTTP/1.1" 200 None 2026-05-06 17:59:42,442 - lava_callback - DEBUG - Processing node 69f8de870573a8210e130c82: baseline-arm64-clabbe 2026-05-06 17:59:42,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8de870573a8210e130c82 2026-05-06 17:59:42,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:59:42,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8de870573a8210e130c82 HTTP/1.1" 200 None 2026-05-06 17:59:42,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:59:42,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-06 17:59:42,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 17:59:42,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8de870573a8210e130c82 HTTP/1.1" 200 None 2026-05-06 17:59:42,496 - lava_callback - ERROR - Error processing callback for node 69f8de870573a8210e130c82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:01:22,480 - lava_callback - INFO - Received callback for node 69f8dedf0573a8210e130cb0 INFO: 172.21.0.1:48768 - "POST /node/69f8dedf0573a8210e130cb0 HTTP/1.0" 202 Accepted 2026-05-06 18:01:22,486 - lava_callback - INFO - Starting async job submit for node 69f8dedf0573a8210e130cb0 2026-05-06 18:01:22,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:01:22,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dedf0573a8210e130cb0 HTTP/1.1" 200 None 2026-05-06 18:01:22,501 - lava_callback - DEBUG - Processing node 69f8dedf0573a8210e130cb0: baseline-arm64-clabbe 2026-05-06 18:01:22,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8dedf0573a8210e130cb0 2026-05-06 18:01:22,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:01:22,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dedf0573a8210e130cb0 HTTP/1.1" 200 None 2026-05-06 18:01:22,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:01:22,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-06 18:01:22,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:01:22,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8dedf0573a8210e130cb0 HTTP/1.1" 200 None 2026-05-06 18:01:22,566 - lava_callback - ERROR - Error processing callback for node 69f8dedf0573a8210e130cb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59590 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:05:42,799 - lava_callback - INFO - Received callback for node 69f8dfe00573a8210e130d35 INFO: 172.21.0.1:51056 - "POST /node/69f8dfe00573a8210e130d35 HTTP/1.0" 202 Accepted 2026-05-06 18:05:42,805 - lava_callback - INFO - Starting async job submit for node 69f8dfe00573a8210e130d35 2026-05-06 18:05:42,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:05:42,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dfe00573a8210e130d35 HTTP/1.1" 200 None 2026-05-06 18:05:42,822 - lava_callback - DEBUG - Processing node 69f8dfe00573a8210e130d35: baseline-arm64-clabbe 2026-05-06 18:05:42,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8dfe00573a8210e130d35 2026-05-06 18:05:42,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:05:42,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dfe00573a8210e130d35 HTTP/1.1" 200 None 2026-05-06 18:05:42,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:05:42,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-06 18:05:42,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:05:42,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8dfe00573a8210e130d35 HTTP/1.1" 200 None 2026-05-06 18:05:42,872 - lava_callback - ERROR - Error processing callback for node 69f8dfe00573a8210e130d35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:07:02,888 - lava_callback - INFO - Received callback for node 69f8e0370573a8210e130d78 INFO: 172.21.0.1:48932 - "POST /node/69f8e0370573a8210e130d78 HTTP/1.0" 202 Accepted 2026-05-06 18:07:02,894 - lava_callback - INFO - Starting async job submit for node 69f8e0370573a8210e130d78 2026-05-06 18:07:02,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:07:02,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e0370573a8210e130d78 HTTP/1.1" 200 None 2026-05-06 18:07:02,915 - lava_callback - DEBUG - Processing node 69f8e0370573a8210e130d78: baseline-arm64-clabbe 2026-05-06 18:07:02,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e0370573a8210e130d78 2026-05-06 18:07:02,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:07:02,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e0370573a8210e130d78 HTTP/1.1" 200 None 2026-05-06 18:07:02,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:07:02,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-06 18:07:02,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:07:02,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e0370573a8210e130d78 HTTP/1.1" 200 None 2026-05-06 18:07:02,978 - lava_callback - ERROR - Error processing callback for node 69f8e0370573a8210e130d78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:09:06,429 - lava_callback - INFO - Received callback for node 69fb7ca9df29cd80ecaa0c17 INFO: 172.21.0.1:33460 - "POST /node/69fb7ca9df29cd80ecaa0c17 HTTP/1.0" 202 Accepted 2026-05-06 18:09:06,436 - lava_callback - INFO - Starting async job submit for node 69fb7ca9df29cd80ecaa0c17 2026-05-06 18:09:06,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:09:06,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ca9df29cd80ecaa0c17 HTTP/1.1" 200 None 2026-05-06 18:09:06,474 - lava_callback - DEBUG - Processing node 69fb7ca9df29cd80ecaa0c17: ltp-fs_bind INFO: 172.21.0.1:33466 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:09:06,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:09:06,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:09:06,948 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fb7ca9df29cd80ecaa0c17/log.txt.gz 2026-05-06 18:09:07,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:09:07,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:09:07,344 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fb7ca9df29cd80ecaa0c17/lava-logs.yaml 2026-05-06 18:09:07,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:09:07,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:09:07,497 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fb7ca9df29cd80ecaa0c17/lava_callback.json.gz 2026-05-06 18:09:07,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:09:07,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ca9df29cd80ecaa0c17 HTTP/1.1" 200 None 2026-05-06 18:09:07,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:09:07,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:09:07,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:09:07,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7ca9df29cd80ecaa0c17 HTTP/1.1" 200 None 2026-05-06 18:09:07,595 - lava_callback - INFO - Completed processing callback for node 69fb7ca9df29cd80ecaa0c17 INFO: 172.21.0.1:58900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58914 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:09:25,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:09:25,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:10:46,468 - lava_callback - INFO - Received callback for node 69fb7cabdf29cd80ecaa0c1a INFO: 172.21.0.1:43956 - "POST /node/69fb7cabdf29cd80ecaa0c1a HTTP/1.0" 202 Accepted 2026-05-06 18:10:46,478 - lava_callback - INFO - Starting async job submit for node 69fb7cabdf29cd80ecaa0c1a 2026-05-06 18:10:46,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:43964 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:10:46,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cabdf29cd80ecaa0c1a HTTP/1.1" 200 None 2026-05-06 18:10:46,524 - lava_callback - DEBUG - Processing node 69fb7cabdf29cd80ecaa0c1a: ltp-fsx 2026-05-06 18:10:46,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:10:47,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:10:47,022 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69fb7cabdf29cd80ecaa0c1a/log.txt.gz 2026-05-06 18:10:47,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:10:47,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:10:47,391 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69fb7cabdf29cd80ecaa0c1a/lava-logs.yaml 2026-05-06 18:10:47,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:10:47,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:10:47,503 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69fb7cabdf29cd80ecaa0c1a/lava_callback.json.gz 2026-05-06 18:10:47,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:10:47,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cabdf29cd80ecaa0c1a HTTP/1.1" 200 None 2026-05-06 18:10:47,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:10:47,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:10:47,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:10:47,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7cabdf29cd80ecaa0c1a HTTP/1.1" 200 None 2026-05-06 18:10:47,595 - lava_callback - INFO - Completed processing callback for node 69fb7cabdf29cd80ecaa0c1a 2026-05-06 18:10:55,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:10:55,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:11:00,930 - lava_callback - INFO - Received callback for node 69f8e12f0573a8210e130e0c INFO: 172.21.0.1:37660 - "POST /node/69f8e12f0573a8210e130e0c HTTP/1.0" 202 Accepted 2026-05-06 18:11:00,936 - lava_callback - INFO - Starting async job submit for node 69f8e12f0573a8210e130e0c 2026-05-06 18:11:00,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:00,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e12f0573a8210e130e0c HTTP/1.1" 200 None 2026-05-06 18:11:00,952 - lava_callback - DEBUG - Processing node 69f8e12f0573a8210e130e0c: baseline-arm64-baylibre 2026-05-06 18:11:00,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e12f0573a8210e130e0c 2026-05-06 18:11:00,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:00,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e12f0573a8210e130e0c HTTP/1.1" 200 None 2026-05-06 18:11:00,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:00,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-06 18:11:00,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:01,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e12f0573a8210e130e0c HTTP/1.1" 200 None 2026-05-06 18:11:01,017 - lava_callback - ERROR - Error processing callback for node 69f8e12f0573a8210e130e0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:11:18,282 - lava_callback - INFO - Received callback for node 69fb7cacdf29cd80ecaa0c1d INFO: 172.21.0.1:44372 - "POST /node/69fb7cacdf29cd80ecaa0c1d HTTP/1.0" 202 Accepted 2026-05-06 18:11:18,289 - lava_callback - INFO - Starting async job submit for node 69fb7cacdf29cd80ecaa0c1d 2026-05-06 18:11:18,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:18,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cacdf29cd80ecaa0c1d HTTP/1.1" 200 None 2026-05-06 18:11:18,328 - lava_callback - DEBUG - Processing node 69fb7cacdf29cd80ecaa0c1d: ltp-input 2026-05-06 18:11:18,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:11:18,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:11:18,769 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69fb7cacdf29cd80ecaa0c1d/log.txt.gz 2026-05-06 18:11:19,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:11:19,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:11:19,185 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69fb7cacdf29cd80ecaa0c1d/lava-logs.yaml 2026-05-06 18:11:19,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:11:19,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:11:19,348 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69fb7cacdf29cd80ecaa0c1d/lava_callback.json.gz 2026-05-06 18:11:19,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:19,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cacdf29cd80ecaa0c1d HTTP/1.1" 200 None 2026-05-06 18:11:19,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:19,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:11:19,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:19,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7cacdf29cd80ecaa0c1d HTTP/1.1" 200 None 2026-05-06 18:11:19,429 - lava_callback - INFO - Completed processing callback for node 69fb7cacdf29cd80ecaa0c1d 2026-05-06 18:11:25,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:25,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:11:46,554 - lava_callback - INFO - Received callback for node 69fb7caedf29cd80ecaa0c24 INFO: 172.21.0.1:60216 - "POST /node/69fb7caedf29cd80ecaa0c24 HTTP/1.0" 202 Accepted 2026-05-06 18:11:46,561 - lava_callback - INFO - Starting async job submit for node 69fb7caedf29cd80ecaa0c24 2026-05-06 18:11:46,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:46,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7caedf29cd80ecaa0c24 HTTP/1.1" 200 None 2026-05-06 18:11:46,602 - lava_callback - DEBUG - Processing node 69fb7caedf29cd80ecaa0c24: ltp-ipc 2026-05-06 18:11:47,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:11:47,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:11:47,135 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69fb7caedf29cd80ecaa0c24/log.txt.gz 2026-05-06 18:11:47,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:11:47,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:11:47,511 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69fb7caedf29cd80ecaa0c24/lava-logs.yaml 2026-05-06 18:11:47,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:11:47,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:11:47,627 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69fb7caedf29cd80ecaa0c24/lava_callback.json.gz 2026-05-06 18:11:47,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:47,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7caedf29cd80ecaa0c24 HTTP/1.1" 200 None 2026-05-06 18:11:47,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:47,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:11:47,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:47,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7caedf29cd80ecaa0c24 HTTP/1.1" 200 None 2026-05-06 18:11:47,730 - lava_callback - INFO - Completed processing callback for node 69fb7caedf29cd80ecaa0c24 2026-05-06 18:11:55,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:11:55,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:13:06,654 - lava_callback - INFO - Received callback for node 69fb7cafdf29cd80ecaa0c2f INFO: 172.21.0.1:51440 - "POST /node/69fb7cafdf29cd80ecaa0c2f HTTP/1.0" 202 Accepted 2026-05-06 18:13:06,662 - lava_callback - INFO - Starting async job submit for node 69fb7cafdf29cd80ecaa0c2f 2026-05-06 18:13:06,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:13:06,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cafdf29cd80ecaa0c2f HTTP/1.1" 200 None 2026-05-06 18:13:06,703 - lava_callback - DEBUG - Processing node 69fb7cafdf29cd80ecaa0c2f: ltp-pty 2026-05-06 18:13:07,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:13:07,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:13:07,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69fb7cafdf29cd80ecaa0c2f/log.txt.gz INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:13:07,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:13:07,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:13:07,704 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69fb7cafdf29cd80ecaa0c2f/lava-logs.yaml 2026-05-06 18:13:07,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:13:07,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:13:07,840 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69fb7cafdf29cd80ecaa0c2f/lava_callback.json.gz 2026-05-06 18:13:07,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:13:07,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cafdf29cd80ecaa0c2f HTTP/1.1" 200 None 2026-05-06 18:13:07,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:13:07,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:13:07,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:13:07,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7cafdf29cd80ecaa0c2f HTTP/1.1" 200 None 2026-05-06 18:13:07,916 - lava_callback - INFO - Completed processing callback for node 69fb7cafdf29cd80ecaa0c2f INFO: 172.21.0.1:60102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60112 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:13:25,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:13:25,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52336 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:14:41,039 - lava_callback - INFO - Received callback for node 69f8e2070573a8210e130ec6 INFO: 172.21.0.1:44146 - "POST /node/69f8e2070573a8210e130ec6 HTTP/1.0" 202 Accepted 2026-05-06 18:14:41,048 - lava_callback - INFO - Starting async job submit for node 69f8e2070573a8210e130ec6 2026-05-06 18:14:41,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:14:41,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e2070573a8210e130ec6 HTTP/1.1" 200 None 2026-05-06 18:14:41,064 - lava_callback - DEBUG - Processing node 69f8e2070573a8210e130ec6: baseline-arm64-baylibre 2026-05-06 18:14:41,065 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e2070573a8210e130ec6 2026-05-06 18:14:41,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:14:41,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e2070573a8210e130ec6 HTTP/1.1" 200 None 2026-05-06 18:14:41,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:14:41,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-06 18:14:41,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:14:41,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e2070573a8210e130ec6 HTTP/1.1" 200 None 2026-05-06 18:14:41,112 - lava_callback - ERROR - Error processing callback for node 69f8e2070573a8210e130ec6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:15:14,548 - lava_callback - INFO - Received callback for node 69fb810adf29cd80ecaa359e INFO: 172.21.0.1:45366 - "POST /node/69fb810adf29cd80ecaa359e HTTP/1.0" 202 Accepted 2026-05-06 18:15:14,555 - lava_callback - INFO - Starting async job submit for node 69fb810adf29cd80ecaa359e 2026-05-06 18:15:14,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:14,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb810adf29cd80ecaa359e HTTP/1.1" 200 None 2026-05-06 18:15:14,631 - lava_callback - DEBUG - Processing node 69fb810adf29cd80ecaa359e: baseline-arm INFO: 172.21.0.1:45374 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 18:15:15,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:15:15,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:15:15,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fb810adf29cd80ecaa359e/log.txt.gz 2026-05-06 18:15:15,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:15:16,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:15:16,053 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb810adf29cd80ecaa359e/lava-logs.yaml 2026-05-06 18:15:16,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:15:16,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:15:16,172 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb810adf29cd80ecaa359e/lava_callback.json.gz DEBUG: Setup failed for 69fb810adf29cd80ecaa359e. Transitting job node result: incomplete -> fail 2026-05-06 18:15:16,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:16,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb810adf29cd80ecaa359e HTTP/1.1" 200 None 2026-05-06 18:15:16,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:16,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:15:16,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:16,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb810adf29cd80ecaa359e HTTP/1.1" 200 None 2026-05-06 18:15:16,429 - lava_callback - INFO - Completed processing callback for node 69fb810adf29cd80ecaa359e INFO: 172.21.0.1:45390 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:15:18,777 - lava_callback - INFO - Received callback for node 69fb7cb2df29cd80ecaa0c36 INFO: 172.21.0.1:45400 - "POST /node/69fb7cb2df29cd80ecaa0c36 HTTP/1.0" 202 Accepted 2026-05-06 18:15:18,783 - lava_callback - INFO - Starting async job submit for node 69fb7cb2df29cd80ecaa0c36 2026-05-06 18:15:18,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:18,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cb2df29cd80ecaa0c36 HTTP/1.1" 200 None 2026-05-06 18:15:18,823 - lava_callback - DEBUG - Processing node 69fb7cb2df29cd80ecaa0c36: ltp-smoke 2026-05-06 18:15:19,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:15:19,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:15:19,258 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fb7cb2df29cd80ecaa0c36/log.txt.gz 2026-05-06 18:15:19,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:15:19,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:15:19,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fb7cb2df29cd80ecaa0c36/lava-logs.yaml 2026-05-06 18:15:19,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:15:19,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:15:19,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fb7cb2df29cd80ecaa0c36/lava_callback.json.gz 2026-05-06 18:15:19,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:19,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cb2df29cd80ecaa0c36 HTTP/1.1" 200 None 2026-05-06 18:15:19,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:19,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:15:19,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:19,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7cb2df29cd80ecaa0c36 HTTP/1.1" 200 None 2026-05-06 18:15:19,838 - lava_callback - INFO - Completed processing callback for node 69fb7cb2df29cd80ecaa0c36 2026-05-06 18:15:25,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:25,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47218 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:15:27,401 - lava_callback - INFO - Received callback for node 69fb7cb1df29cd80ecaa0c32 INFO: 172.21.0.1:47220 - "POST /node/69fb7cb1df29cd80ecaa0c32 HTTP/1.0" 202 Accepted 2026-05-06 18:15:27,408 - lava_callback - INFO - Starting async job submit for node 69fb7cb1df29cd80ecaa0c32 2026-05-06 18:15:27,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:27,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cb1df29cd80ecaa0c32 HTTP/1.1" 200 None 2026-05-06 18:15:27,448 - lava_callback - DEBUG - Processing node 69fb7cb1df29cd80ecaa0c32: ltp-sched 2026-05-06 18:15:27,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:15:27,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:15:27,920 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69fb7cb1df29cd80ecaa0c32/log.txt.gz 2026-05-06 18:15:28,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:15:28,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:15:28,282 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69fb7cb1df29cd80ecaa0c32/lava-logs.yaml 2026-05-06 18:15:28,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:15:28,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:15:28,393 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69fb7cb1df29cd80ecaa0c32/lava_callback.json.gz 2026-05-06 18:15:28,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:28,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cb1df29cd80ecaa0c32 HTTP/1.1" 200 None 2026-05-06 18:15:28,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:28,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:15:28,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:28,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7cb1df29cd80ecaa0c32 HTTP/1.1" 200 None 2026-05-06 18:15:28,483 - lava_callback - INFO - Completed processing callback for node 69fb7cb1df29cd80ecaa0c32 INFO: 172.21.0.1:39900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:15:47,465 - lava_callback - INFO - Received callback for node 69fb7cb5df29cd80ecaa0c3c INFO: 172.21.0.1:42836 - "POST /node/69fb7cb5df29cd80ecaa0c3c HTTP/1.0" 202 Accepted 2026-05-06 18:15:47,472 - lava_callback - INFO - Starting async job submit for node 69fb7cb5df29cd80ecaa0c3c 2026-05-06 18:15:47,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:47,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cb5df29cd80ecaa0c3c HTTP/1.1" 200 None 2026-05-06 18:15:47,519 - lava_callback - DEBUG - Processing node 69fb7cb5df29cd80ecaa0c3c: ltp-syscalls-ipc 2026-05-06 18:15:47,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:15:48,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:15:48,068 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fb7cb5df29cd80ecaa0c3c/log.txt.gz 2026-05-06 18:15:48,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:15:48,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:15:48,432 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fb7cb5df29cd80ecaa0c3c/lava-logs.yaml 2026-05-06 18:15:48,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:15:48,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:15:48,545 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fb7cb5df29cd80ecaa0c3c/lava_callback.json.gz 2026-05-06 18:15:48,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:48,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cb5df29cd80ecaa0c3c HTTP/1.1" 200 None 2026-05-06 18:15:48,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:48,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:15:48,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:48,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7cb5df29cd80ecaa0c3c HTTP/1.1" 200 None 2026-05-06 18:15:48,626 - lava_callback - INFO - Completed processing callback for node 69fb7cb5df29cd80ecaa0c3c 2026-05-06 18:15:55,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:15:55,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57826 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:16:34,960 - lava_callback - INFO - Received callback for node 69fb855fdf29cd80ecaa36c6 INFO: 172.21.0.1:34710 - "POST /node/69fb855fdf29cd80ecaa36c6 HTTP/1.0" 202 Accepted 2026-05-06 18:16:34,966 - lava_callback - INFO - Starting async job submit for node 69fb855fdf29cd80ecaa36c6 2026-05-06 18:16:34,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:16:35,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb855fdf29cd80ecaa36c6 HTTP/1.1" 200 None 2026-05-06 18:16:35,014 - lava_callback - DEBUG - Processing node 69fb855fdf29cd80ecaa36c6: baseline-x86 2026-05-06 18:16:35,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:16:35,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:16:35,337 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fb855fdf29cd80ecaa36c6/log.txt.gz 2026-05-06 18:16:35,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:16:35,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:16:35,575 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fb855fdf29cd80ecaa36c6/lava-logs.yaml 2026-05-06 18:16:35,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:16:35,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:16:35,673 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fb855fdf29cd80ecaa36c6/lava_callback.json.gz 2026-05-06 18:16:35,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:16:35,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb855fdf29cd80ecaa36c6 HTTP/1.1" 200 None 2026-05-06 18:16:35,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:16:35,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a9adf29cd80ecaa02d1 HTTP/1.1" 200 None 2026-05-06 18:16:35,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:16:35,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb855fdf29cd80ecaa36c6 HTTP/1.1" 200 None 2026-05-06 18:16:35,742 - lava_callback - INFO - Completed processing callback for node 69fb855fdf29cd80ecaa36c6 INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:16:37,092 - lava_callback - INFO - Received callback for node 69fb8562df29cd80ecaa36cf INFO: 172.21.0.1:34734 - "POST /node/69fb8562df29cd80ecaa36cf HTTP/1.0" 202 Accepted 2026-05-06 18:16:37,099 - lava_callback - INFO - Starting async job submit for node 69fb8562df29cd80ecaa36cf 2026-05-06 18:16:37,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:16:37,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8562df29cd80ecaa36cf HTTP/1.1" 200 None 2026-05-06 18:16:37,137 - lava_callback - DEBUG - Processing node 69fb8562df29cd80ecaa36cf: baseline-x86 2026-05-06 18:16:37,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:16:37,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:16:37,467 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fb8562df29cd80ecaa36cf/log.txt.gz 2026-05-06 18:16:37,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:16:37,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:16:37,746 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fb8562df29cd80ecaa36cf/lava-logs.yaml 2026-05-06 18:16:37,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:16:37,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:16:37,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fb8562df29cd80ecaa36cf/lava_callback.json.gz 2026-05-06 18:16:37,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:16:37,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8562df29cd80ecaa36cf HTTP/1.1" 200 None 2026-05-06 18:16:37,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:16:37,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a9adf29cd80ecaa02d1 HTTP/1.1" 200 None 2026-05-06 18:16:37,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:16:37,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8562df29cd80ecaa36cf HTTP/1.1" 200 None 2026-05-06 18:16:37,921 - lava_callback - INFO - Completed processing callback for node 69fb8562df29cd80ecaa36cf INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:16:55,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:16:55,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60672 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:17:01,138 - lava_callback - INFO - Received callback for node 69f8e2990573a8210e130f13 INFO: 172.21.0.1:44244 - "POST /node/69f8e2990573a8210e130f13 HTTP/1.0" 202 Accepted 2026-05-06 18:17:01,144 - lava_callback - INFO - Starting async job submit for node 69f8e2990573a8210e130f13 2026-05-06 18:17:01,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:01,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e2990573a8210e130f13 HTTP/1.1" 200 None 2026-05-06 18:17:01,163 - lava_callback - DEBUG - Processing node 69f8e2990573a8210e130f13: baseline-arm64-baylibre 2026-05-06 18:17:01,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e2990573a8210e130f13 2026-05-06 18:17:01,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:01,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e2990573a8210e130f13 HTTP/1.1" 200 None 2026-05-06 18:17:01,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:01,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-06 18:17:01,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:01,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e2990573a8210e130f13 HTTP/1.1" 200 None 2026-05-06 18:17:01,218 - lava_callback - ERROR - Error processing callback for node 69f8e2990573a8210e130f13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:17:06,965 - lava_callback - INFO - Received callback for node 69fb7cb6df29cd80ecaa0c63 INFO: 172.21.0.1:44268 - "POST /node/69fb7cb6df29cd80ecaa0c63 HTTP/1.0" 202 Accepted 2026-05-06 18:17:06,972 - lava_callback - INFO - Starting async job submit for node 69fb7cb6df29cd80ecaa0c63 2026-05-06 18:17:07,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:07,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cb6df29cd80ecaa0c63 HTTP/1.1" 200 None 2026-05-06 18:17:07,019 - lava_callback - DEBUG - Processing node 69fb7cb6df29cd80ecaa0c63: ltp-timers INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:17:07,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:17:07,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:17:07,496 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69fb7cb6df29cd80ecaa0c63/log.txt.gz 2026-05-06 18:17:07,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:17:07,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:17:07,849 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69fb7cb6df29cd80ecaa0c63/lava-logs.yaml 2026-05-06 18:17:07,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:17:07,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:17:07,958 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69fb7cb6df29cd80ecaa0c63/lava_callback.json.gz 2026-05-06 18:17:07,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:08,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cb6df29cd80ecaa0c63 HTTP/1.1" 200 None 2026-05-06 18:17:08,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:08,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:17:08,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:08,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7cb6df29cd80ecaa0c63 HTTP/1.1" 200 None 2026-05-06 18:17:08,040 - lava_callback - INFO - Completed processing callback for node 69fb7cb6df29cd80ecaa0c63 INFO: 172.21.0.1:39306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:17:17,301 - lava_callback - INFO - Received callback for node 69fb8560df29cd80ecaa36c9 INFO: 172.21.0.1:39322 - "POST /node/69fb8560df29cd80ecaa36c9 HTTP/1.0" 202 Accepted 2026-05-06 18:17:17,307 - lava_callback - INFO - Starting async job submit for node 69fb8560df29cd80ecaa36c9 2026-05-06 18:17:17,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:17,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8560df29cd80ecaa36c9 HTTP/1.1" 200 None 2026-05-06 18:17:17,340 - lava_callback - DEBUG - Processing node 69fb8560df29cd80ecaa36c9: baseline-x86 2026-05-06 18:17:17,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:17:17,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:17:17,810 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fb8560df29cd80ecaa36c9/log.txt.gz 2026-05-06 18:17:17,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:17:18,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:17:18,185 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fb8560df29cd80ecaa36c9/lava-logs.yaml 2026-05-06 18:17:18,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:17:18,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:17:18,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fb8560df29cd80ecaa36c9/lava_callback.json.gz 2026-05-06 18:17:18,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:18,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8560df29cd80ecaa36c9 HTTP/1.1" 200 None 2026-05-06 18:17:18,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:18,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a9adf29cd80ecaa02d1 HTTP/1.1" 200 None 2026-05-06 18:17:18,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:18,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8560df29cd80ecaa36c9 HTTP/1.1" 200 None 2026-05-06 18:17:18,396 - lava_callback - INFO - Completed processing callback for node 69fb8560df29cd80ecaa36c9 2026-05-06 18:17:25,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:25,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34574 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:17:34,841 - lava_callback - INFO - Received callback for node 69fb8561df29cd80ecaa36cc INFO: 172.21.0.1:53548 - "POST /node/69fb8561df29cd80ecaa36cc HTTP/1.0" 202 Accepted 2026-05-06 18:17:34,847 - lava_callback - INFO - Starting async job submit for node 69fb8561df29cd80ecaa36cc 2026-05-06 18:17:34,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:34,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8561df29cd80ecaa36cc HTTP/1.1" 200 None 2026-05-06 18:17:34,880 - lava_callback - DEBUG - Processing node 69fb8561df29cd80ecaa36cc: baseline-x86 2026-05-06 18:17:35,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:17:35,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:17:35,237 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fb8561df29cd80ecaa36cc/log.txt.gz 2026-05-06 18:17:35,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:17:35,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:17:35,577 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fb8561df29cd80ecaa36cc/lava-logs.yaml 2026-05-06 18:17:35,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:17:35,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:17:35,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fb8561df29cd80ecaa36cc/lava_callback.json.gz 2026-05-06 18:17:35,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:35,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8561df29cd80ecaa36cc HTTP/1.1" 200 None 2026-05-06 18:17:35,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:35,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a9adf29cd80ecaa02d1 HTTP/1.1" 200 None 2026-05-06 18:17:35,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:35,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8561df29cd80ecaa36cc HTTP/1.1" 200 None 2026-05-06 18:17:35,784 - lava_callback - INFO - Completed processing callback for node 69fb8561df29cd80ecaa36cc INFO: 172.21.0.1:53552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45904 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:17:55,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:17:55,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51542 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:18:41,228 - lava_callback - INFO - Received callback for node 69f8e2ee0573a8210e130f36 INFO: 172.21.0.1:41202 - "POST /node/69f8e2ee0573a8210e130f36 HTTP/1.0" 202 Accepted 2026-05-06 18:18:41,234 - lava_callback - INFO - Starting async job submit for node 69f8e2ee0573a8210e130f36 2026-05-06 18:18:41,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:18:41,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e2ee0573a8210e130f36 HTTP/1.1" 200 None 2026-05-06 18:18:41,249 - lava_callback - DEBUG - Processing node 69f8e2ee0573a8210e130f36: baseline-arm64-baylibre 2026-05-06 18:18:41,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e2ee0573a8210e130f36 2026-05-06 18:18:41,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:18:41,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e2ee0573a8210e130f36 HTTP/1.1" 200 None 2026-05-06 18:18:41,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:18:41,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-06 18:18:41,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:18:41,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e2ee0573a8210e130f36 HTTP/1.1" 200 None 2026-05-06 18:18:41,314 - lava_callback - ERROR - Error processing callback for node 69f8e2ee0573a8210e130f36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54866 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:20:01,301 - lava_callback - INFO - Received callback for node 69f8e3470573a8210e130f62 INFO: 172.21.0.1:36832 - "POST /node/69f8e3470573a8210e130f62 HTTP/1.0" 202 Accepted 2026-05-06 18:20:01,307 - lava_callback - INFO - Starting async job submit for node 69f8e3470573a8210e130f62 2026-05-06 18:20:01,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:20:01,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e3470573a8210e130f62 HTTP/1.1" 200 None 2026-05-06 18:20:01,330 - lava_callback - DEBUG - Processing node 69f8e3470573a8210e130f62: baseline-arm64-baylibre 2026-05-06 18:20:01,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e3470573a8210e130f62 2026-05-06 18:20:01,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:20:01,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e3470573a8210e130f62 HTTP/1.1" 200 None 2026-05-06 18:20:01,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:20:01,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-06 18:20:01,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:20:01,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e3470573a8210e130f62 HTTP/1.1" 200 None 2026-05-06 18:20:01,407 - lava_callback - ERROR - Error processing callback for node 69f8e3470573a8210e130f62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36846 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:20:07,330 - lava_callback - INFO - Received callback for node 69fb7cb8df29cd80ecaa0c66 INFO: 172.21.0.1:36850 - "POST /node/69fb7cb8df29cd80ecaa0c66 HTTP/1.0" 202 Accepted 2026-05-06 18:20:07,337 - lava_callback - INFO - Starting async job submit for node 69fb7cb8df29cd80ecaa0c66 2026-05-06 18:20:07,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:20:07,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cb8df29cd80ecaa0c66 HTTP/1.1" 200 None 2026-05-06 18:20:07,376 - lava_callback - DEBUG - Processing node 69fb7cb8df29cd80ecaa0c66: ltp-watchqueue INFO: 172.21.0.1:36860 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:20:07,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:20:07,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:20:07,833 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fb7cb8df29cd80ecaa0c66/log.txt.gz 2026-05-06 18:20:08,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:20:08,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:20:08,280 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fb7cb8df29cd80ecaa0c66/lava-logs.yaml 2026-05-06 18:20:08,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:20:08,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:20:08,419 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fb7cb8df29cd80ecaa0c66/lava_callback.json.gz 2026-05-06 18:20:08,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:20:08,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cb8df29cd80ecaa0c66 HTTP/1.1" 200 None 2026-05-06 18:20:08,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:20:08,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:20:08,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:20:08,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7cb8df29cd80ecaa0c66 HTTP/1.1" 200 None 2026-05-06 18:20:08,515 - lava_callback - INFO - Completed processing callback for node 69fb7cb8df29cd80ecaa0c66 INFO: 172.21.0.1:56986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:20:25,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:20:26,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54404 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:22:21,537 - lava_callback - INFO - Received callback for node 69f8e3d90573a8210e130f9a INFO: 172.21.0.1:40430 - "POST /node/69f8e3d90573a8210e130f9a HTTP/1.0" 202 Accepted 2026-05-06 18:22:21,543 - lava_callback - INFO - Starting async job submit for node 69f8e3d90573a8210e130f9a 2026-05-06 18:22:21,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:22:21,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e3d90573a8210e130f9a HTTP/1.1" 200 None 2026-05-06 18:22:21,568 - lava_callback - DEBUG - Processing node 69f8e3d90573a8210e130f9a: baseline-arm64-baylibre 2026-05-06 18:22:21,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e3d90573a8210e130f9a 2026-05-06 18:22:21,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:22:21,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e3d90573a8210e130f9a HTTP/1.1" 200 None 2026-05-06 18:22:21,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:22:21,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-06 18:22:21,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:22:21,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e3d90573a8210e130f9a HTTP/1.1" 200 None 2026-05-06 18:22:21,623 - lava_callback - ERROR - Error processing callback for node 69f8e3d90573a8210e130f9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:24:03,638 - lava_callback - INFO - Received callback for node 69f8e4340573a8210e130fe7 INFO: 172.21.0.1:43276 - "POST /node/69f8e4340573a8210e130fe7 HTTP/1.0" 202 Accepted 2026-05-06 18:24:03,643 - lava_callback - INFO - Starting async job submit for node 69f8e4340573a8210e130fe7 2026-05-06 18:24:03,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:24:03,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e4340573a8210e130fe7 HTTP/1.1" 200 None 2026-05-06 18:24:03,658 - lava_callback - DEBUG - Processing node 69f8e4340573a8210e130fe7: baseline-arm64-clabbe 2026-05-06 18:24:03,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e4340573a8210e130fe7 2026-05-06 18:24:03,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:24:03,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e4340573a8210e130fe7 HTTP/1.1" 200 None 2026-05-06 18:24:03,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:24:03,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-06 18:24:03,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:24:03,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e4340573a8210e130fe7 HTTP/1.1" 200 None 2026-05-06 18:24:03,718 - lava_callback - ERROR - Error processing callback for node 69f8e4340573a8210e130fe7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:26:43,754 - lava_callback - INFO - Received callback for node 69f8e4d80573a8210e13107e INFO: 172.21.0.1:41494 - "POST /node/69f8e4d80573a8210e13107e HTTP/1.0" 202 Accepted 2026-05-06 18:26:43,760 - lava_callback - INFO - Starting async job submit for node 69f8e4d80573a8210e13107e 2026-05-06 18:26:43,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:26:43,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e4d80573a8210e13107e HTTP/1.1" 200 None 2026-05-06 18:26:43,780 - lava_callback - DEBUG - Processing node 69f8e4d80573a8210e13107e: baseline-arm64-clabbe 2026-05-06 18:26:43,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e4d80573a8210e13107e 2026-05-06 18:26:43,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:26:43,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e4d80573a8210e13107e HTTP/1.1" 200 None 2026-05-06 18:26:43,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:26:43,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-06 18:26:43,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:26:43,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e4d80573a8210e13107e HTTP/1.1" 200 None 2026-05-06 18:26:43,849 - lava_callback - ERROR - Error processing callback for node 69f8e4d80573a8210e13107e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:28:03,792 - lava_callback - INFO - Received callback for node 69f8e52e0573a8210e1310b1 INFO: 172.21.0.1:59032 - "POST /node/69f8e52e0573a8210e1310b1 HTTP/1.0" 202 Accepted 2026-05-06 18:28:03,797 - lava_callback - INFO - Starting async job submit for node 69f8e52e0573a8210e1310b1 2026-05-06 18:28:03,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:28:03,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e52e0573a8210e1310b1 HTTP/1.1" 200 None 2026-05-06 18:28:03,813 - lava_callback - DEBUG - Processing node 69f8e52e0573a8210e1310b1: baseline-arm64-clabbe 2026-05-06 18:28:03,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e52e0573a8210e1310b1 2026-05-06 18:28:03,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:28:03,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e52e0573a8210e1310b1 HTTP/1.1" 200 None 2026-05-06 18:28:03,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:28:03,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-06 18:28:03,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:28:03,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e52e0573a8210e1310b1 HTTP/1.1" 200 None 2026-05-06 18:28:03,857 - lava_callback - ERROR - Error processing callback for node 69f8e52e0573a8210e1310b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:32:23,935 - lava_callback - INFO - Received callback for node 69f8e6280573a8210e13115f INFO: 172.21.0.1:36508 - "POST /node/69f8e6280573a8210e13115f HTTP/1.0" 202 Accepted 2026-05-06 18:32:23,944 - lava_callback - INFO - Starting async job submit for node 69f8e6280573a8210e13115f 2026-05-06 18:32:23,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:32:23,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e6280573a8210e13115f HTTP/1.1" 200 None 2026-05-06 18:32:23,975 - lava_callback - DEBUG - Processing node 69f8e6280573a8210e13115f: baseline-arm64-clabbe 2026-05-06 18:32:23,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e6280573a8210e13115f 2026-05-06 18:32:23,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:32:23,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e6280573a8210e13115f HTTP/1.1" 200 None 2026-05-06 18:32:23,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:32:24,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-06 18:32:24,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:32:24,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e6280573a8210e13115f HTTP/1.1" 200 None 2026-05-06 18:32:24,029 - lava_callback - ERROR - Error processing callback for node 69f8e6280573a8210e13115f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:32:53,957 - lava_callback - INFO - Received callback for node 69fb8535df29cd80ecaa36a4 INFO: 172.21.0.1:48366 - "POST /node/69fb8535df29cd80ecaa36a4 HTTP/1.0" 202 Accepted 2026-05-06 18:32:53,965 - lava_callback - INFO - Starting async job submit for node 69fb8535df29cd80ecaa36a4 2026-05-06 18:32:54,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:32:54,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8535df29cd80ecaa36a4 HTTP/1.1" 200 None 2026-05-06 18:32:54,059 - lava_callback - DEBUG - Processing node 69fb8535df29cd80ecaa36a4: baseline-arm 2026-05-06 18:32:54,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:32:54,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:32:54,731 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fb8535df29cd80ecaa36a4/log.txt.gz 2026-05-06 18:32:55,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:32:55,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:32:55,259 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb8535df29cd80ecaa36a4/lava-logs.yaml 2026-05-06 18:32:55,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:32:55,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:32:55,408 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb8535df29cd80ecaa36a4/lava_callback.json.gz DEBUG: Setup failed for 69fb8535df29cd80ecaa36a4. Transitting job node result: incomplete -> fail 2026-05-06 18:32:55,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:32:55,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8535df29cd80ecaa36a4 HTTP/1.1" 200 None 2026-05-06 18:32:55,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:32:55,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:32:55,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:32:55,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8535df29cd80ecaa36a4 HTTP/1.1" 200 None 2026-05-06 18:32:55,717 - lava_callback - INFO - Completed processing callback for node 69fb8535df29cd80ecaa36a4 2026-05-06 18:32:56,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:32:56,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:33:44,002 - lava_callback - INFO - Received callback for node 69f8e67d0573a8210e1311a9 INFO: 172.21.0.1:45922 - "POST /node/69f8e67d0573a8210e1311a9 HTTP/1.0" 202 Accepted 2026-05-06 18:33:44,008 - lava_callback - INFO - Starting async job submit for node 69f8e67d0573a8210e1311a9 2026-05-06 18:33:44,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:33:44,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e67d0573a8210e1311a9 HTTP/1.1" 200 None 2026-05-06 18:33:44,029 - lava_callback - DEBUG - Processing node 69f8e67d0573a8210e1311a9: baseline-arm64-clabbe 2026-05-06 18:33:44,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e67d0573a8210e1311a9 2026-05-06 18:33:44,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:33:44,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e67d0573a8210e1311a9 HTTP/1.1" 200 None 2026-05-06 18:33:44,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:33:44,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-06 18:33:44,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:33:44,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e67d0573a8210e1311a9 HTTP/1.1" 200 None 2026-05-06 18:33:44,076 - lava_callback - ERROR - Error processing callback for node 69f8e67d0573a8210e1311a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:36:44,193 - lava_callback - INFO - Received callback for node 69f8e7260573a8210e131232 INFO: 172.21.0.1:49350 - "POST /node/69f8e7260573a8210e131232 HTTP/1.0" 202 Accepted 2026-05-06 18:36:44,200 - lava_callback - INFO - Starting async job submit for node 69f8e7260573a8210e131232 2026-05-06 18:36:44,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:36:44,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e7260573a8210e131232 HTTP/1.1" 200 None 2026-05-06 18:36:44,219 - lava_callback - DEBUG - Processing node 69f8e7260573a8210e131232: baseline-arm64-clabbe 2026-05-06 18:36:44,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e7260573a8210e131232 2026-05-06 18:36:44,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:36:44,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e7260573a8210e131232 HTTP/1.1" 200 None 2026-05-06 18:36:44,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:36:44,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-06 18:36:44,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:36:44,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e7260573a8210e131232 HTTP/1.1" 200 None 2026-05-06 18:36:44,288 - lava_callback - ERROR - Error processing callback for node 69f8e7260573a8210e131232: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50724 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:46:22,862 - lava_callback - INFO - Received callback for node 69f8e9710573a8210e1313c9 INFO: 172.21.0.1:56616 - "POST /node/69f8e9710573a8210e1313c9 HTTP/1.0" 202 Accepted 2026-05-06 18:46:22,872 - lava_callback - INFO - Starting async job submit for node 69f8e9710573a8210e1313c9 2026-05-06 18:46:22,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:46:22,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e9710573a8210e1313c9 HTTP/1.1" 200 None 2026-05-06 18:46:22,892 - lava_callback - DEBUG - Processing node 69f8e9710573a8210e1313c9: baseline-arm64-baylibre 2026-05-06 18:46:22,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e9710573a8210e1313c9 2026-05-06 18:46:22,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:46:22,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e9710573a8210e1313c9 HTTP/1.1" 200 None 2026-05-06 18:46:22,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:46:22,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 18:46:22,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:46:22,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e9710573a8210e1313c9 HTTP/1.1" 200 None 2026-05-06 18:46:22,953 - lava_callback - ERROR - Error processing callback for node 69f8e9710573a8210e1313c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:47:42,843 - lava_callback - INFO - Received callback for node 69f8e9c40573a8210e1313f1 INFO: 172.21.0.1:51038 - "POST /node/69f8e9c40573a8210e1313f1 HTTP/1.0" 202 Accepted 2026-05-06 18:47:42,848 - lava_callback - INFO - Starting async job submit for node 69f8e9c40573a8210e1313f1 2026-05-06 18:47:42,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:47:42,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e9c40573a8210e1313f1 HTTP/1.1" 200 None 2026-05-06 18:47:42,876 - lava_callback - DEBUG - Processing node 69f8e9c40573a8210e1313f1: baseline-arm64-baylibre 2026-05-06 18:47:42,876 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8e9c40573a8210e1313f1 2026-05-06 18:47:42,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:47:42,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e9c40573a8210e1313f1 HTTP/1.1" 200 None 2026-05-06 18:47:42,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:47:42,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 18:47:42,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:47:42,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e9c40573a8210e1313f1 HTTP/1.1" 200 None 2026-05-06 18:47:42,921 - lava_callback - ERROR - Error processing callback for node 69f8e9c40573a8210e1313f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:49:04,615 - lava_callback - INFO - Received callback for node 69f8ea160573a8210e131415 INFO: 172.21.0.1:40452 - "POST /node/69f8ea160573a8210e131415 HTTP/1.0" 202 Accepted 2026-05-06 18:49:04,621 - lava_callback - INFO - Starting async job submit for node 69f8ea160573a8210e131415 2026-05-06 18:49:04,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:49:04,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ea160573a8210e131415 HTTP/1.1" 200 None 2026-05-06 18:49:04,636 - lava_callback - DEBUG - Processing node 69f8ea160573a8210e131415: baseline-arm-clabbe 2026-05-06 18:49:04,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ea160573a8210e131415 2026-05-06 18:49:04,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:49:04,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ea160573a8210e131415 HTTP/1.1" 200 None 2026-05-06 18:49:04,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:49:04,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-06 18:49:04,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:49:04,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ea160573a8210e131415 HTTP/1.1" 200 None 2026-05-06 18:49:04,683 - lava_callback - ERROR - Error processing callback for node 69f8ea160573a8210e131415: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:50:03,041 - lava_callback - INFO - Received callback for node 69f8ea450573a8210e13142a INFO: 172.21.0.1:44366 - "POST /node/69f8ea450573a8210e13142a HTTP/1.0" 202 Accepted 2026-05-06 18:50:03,047 - lava_callback - INFO - Starting async job submit for node 69f8ea450573a8210e13142a 2026-05-06 18:50:03,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:50:03,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ea450573a8210e13142a HTTP/1.1" 200 None 2026-05-06 18:50:03,063 - lava_callback - DEBUG - Processing node 69f8ea450573a8210e13142a: baseline-arm64-baylibre 2026-05-06 18:50:03,063 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ea450573a8210e13142a 2026-05-06 18:50:03,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:50:03,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ea450573a8210e13142a HTTP/1.1" 200 None 2026-05-06 18:50:03,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:50:03,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 18:50:03,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:50:03,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ea450573a8210e13142a HTTP/1.1" 200 None 2026-05-06 18:50:03,108 - lava_callback - ERROR - Error processing callback for node 69f8ea450573a8210e13142a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:51:23,251 - lava_callback - INFO - Received callback for node 69f8ea9c0573a8210e131477 INFO: 172.21.0.1:51966 - "POST /node/69f8ea9c0573a8210e131477 HTTP/1.0" 202 Accepted 2026-05-06 18:51:23,257 - lava_callback - INFO - Starting async job submit for node 69f8ea9c0573a8210e131477 2026-05-06 18:51:23,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:51:23,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ea9c0573a8210e131477 HTTP/1.1" 200 None 2026-05-06 18:51:23,272 - lava_callback - DEBUG - Processing node 69f8ea9c0573a8210e131477: baseline-arm64-baylibre 2026-05-06 18:51:23,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ea9c0573a8210e131477 2026-05-06 18:51:23,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:51:23,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ea9c0573a8210e131477 HTTP/1.1" 200 None 2026-05-06 18:51:23,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:51:23,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 18:51:23,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:51:23,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ea9c0573a8210e131477 HTTP/1.1" 200 None 2026-05-06 18:51:23,321 - lava_callback - ERROR - Error processing callback for node 69f8ea9c0573a8210e131477: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49386 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:52:44,794 - lava_callback - INFO - Received callback for node 69f8eaee0573a8210e1314b4 INFO: 172.21.0.1:40438 - "POST /node/69f8eaee0573a8210e1314b4 HTTP/1.0" 202 Accepted 2026-05-06 18:52:44,800 - lava_callback - INFO - Starting async job submit for node 69f8eaee0573a8210e1314b4 2026-05-06 18:52:44,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:52:44,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eaee0573a8210e1314b4 HTTP/1.1" 200 None 2026-05-06 18:52:44,815 - lava_callback - DEBUG - Processing node 69f8eaee0573a8210e1314b4: baseline-arm-clabbe 2026-05-06 18:52:44,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8eaee0573a8210e1314b4 2026-05-06 18:52:44,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:52:44,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eaee0573a8210e1314b4 HTTP/1.1" 200 None 2026-05-06 18:52:44,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:52:44,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-06 18:52:44,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:52:44,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8eaee0573a8210e1314b4 HTTP/1.1" 200 None 2026-05-06 18:52:44,863 - lava_callback - ERROR - Error processing callback for node 69f8eaee0573a8210e1314b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38318 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:53:24,836 - lava_callback - INFO - Received callback for node 69f8eb180573a8210e1314c1 INFO: 172.21.0.1:60626 - "POST /node/69f8eb180573a8210e1314c1 HTTP/1.0" 202 Accepted 2026-05-06 18:53:24,842 - lava_callback - INFO - Starting async job submit for node 69f8eb180573a8210e1314c1 2026-05-06 18:53:24,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:53:24,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eb180573a8210e1314c1 HTTP/1.1" 200 None 2026-05-06 18:53:24,862 - lava_callback - DEBUG - Processing node 69f8eb180573a8210e1314c1: baseline-arm-clabbe 2026-05-06 18:53:24,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8eb180573a8210e1314c1 2026-05-06 18:53:24,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:53:24,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eb180573a8210e1314c1 HTTP/1.1" 200 None 2026-05-06 18:53:24,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:53:24,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-06 18:53:24,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:53:24,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8eb180573a8210e1314c1 HTTP/1.1" 200 None 2026-05-06 18:53:24,922 - lava_callback - ERROR - Error processing callback for node 69f8eb180573a8210e1314c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43514 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:54:04,799 - lava_callback - INFO - Received callback for node 69f8eb430573a8210e1314d0 INFO: 172.21.0.1:44364 - "POST /node/69f8eb430573a8210e1314d0 HTTP/1.0" 202 Accepted 2026-05-06 18:54:04,805 - lava_callback - INFO - Starting async job submit for node 69f8eb430573a8210e1314d0 2026-05-06 18:54:04,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:54:04,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eb430573a8210e1314d0 HTTP/1.1" 200 None 2026-05-06 18:54:04,825 - lava_callback - DEBUG - Processing node 69f8eb430573a8210e1314d0: baseline-arm-clabbe 2026-05-06 18:54:04,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8eb430573a8210e1314d0 2026-05-06 18:54:04,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:54:04,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eb430573a8210e1314d0 HTTP/1.1" 200 None 2026-05-06 18:54:04,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:54:04,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-06 18:54:04,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:54:04,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8eb430573a8210e1314d0 HTTP/1.1" 200 None 2026-05-06 18:54:04,889 - lava_callback - ERROR - Error processing callback for node 69f8eb430573a8210e1314d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:54:40,472 - lava_callback - INFO - Received callback for node 69fb8958df29cd80ecaa374a INFO: 172.21.0.1:38196 - "POST /node/69fb8958df29cd80ecaa374a HTTP/1.0" 202 Accepted 2026-05-06 18:54:40,495 - lava_callback - INFO - Starting async job submit for node 69fb8958df29cd80ecaa374a 2026-05-06 18:54:40,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:54:40,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8958df29cd80ecaa374a HTTP/1.1" 200 None 2026-05-06 18:54:40,610 - lava_callback - DEBUG - Processing node 69fb8958df29cd80ecaa374a: baseline-arm 2026-05-06 18:54:41,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:54:41,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:54:41,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fb8958df29cd80ecaa374a/log.txt.gz 2026-05-06 18:54:41,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:54:41,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:54:41,907 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb8958df29cd80ecaa374a/lava-logs.yaml 2026-05-06 18:54:41,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:54:42,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:54:42,046 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb8958df29cd80ecaa374a/lava_callback.json.gz DEBUG: Setup failed for 69fb8958df29cd80ecaa374a. Transitting job node result: incomplete -> fail 2026-05-06 18:54:42,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:54:42,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8958df29cd80ecaa374a HTTP/1.1" 200 None 2026-05-06 18:54:42,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:54:42,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:54:42,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:54:42,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8958df29cd80ecaa374a HTTP/1.1" 200 None 2026-05-06 18:54:42,306 - lava_callback - INFO - Completed processing callback for node 69fb8958df29cd80ecaa374a INFO: 172.21.0.1:38212 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:54:56,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:54:56,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:55:43,368 - lava_callback - INFO - Received callback for node 69f8eba00573a8210e1314f9 INFO: 172.21.0.1:46132 - "POST /node/69f8eba00573a8210e1314f9 HTTP/1.0" 202 Accepted 2026-05-06 18:55:43,373 - lava_callback - INFO - Starting async job submit for node 69f8eba00573a8210e1314f9 2026-05-06 18:55:43,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:55:43,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eba00573a8210e1314f9 HTTP/1.1" 200 None 2026-05-06 18:55:43,388 - lava_callback - DEBUG - Processing node 69f8eba00573a8210e1314f9: baseline-arm64-baylibre 2026-05-06 18:55:43,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8eba00573a8210e1314f9 2026-05-06 18:55:43,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:55:43,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eba00573a8210e1314f9 HTTP/1.1" 200 None 2026-05-06 18:55:43,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:55:43,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 18:55:43,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:55:43,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8eba00573a8210e1314f9 HTTP/1.1" 200 None 2026-05-06 18:55:43,433 - lava_callback - ERROR - Error processing callback for node 69f8eba00573a8210e1314f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 18:55:44,633 - lava_callback - INFO - Received callback for node 69fb818adf29cd80ecaa35d7 INFO: 172.21.0.1:46138 - "POST /node/69fb818adf29cd80ecaa35d7 HTTP/1.0" 202 Accepted 2026-05-06 18:55:44,681 - lava_callback - INFO - Starting async job submit for node 69fb818adf29cd80ecaa35d7 2026-05-06 18:55:44,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:55:44,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb818adf29cd80ecaa35d7 HTTP/1.1" 200 None 2026-05-06 18:55:44,720 - lava_callback - DEBUG - Processing node 69fb818adf29cd80ecaa35d7: baseline-arm-pengutronix 2026-05-06 18:55:44,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:55:44,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:55:44,926 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb818adf29cd80ecaa35d7/log.txt.gz 2026-05-06 18:55:44,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:55:45,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:55:45,093 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb818adf29cd80ecaa35d7/lava-logs.yaml 2026-05-06 18:55:45,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 18:55:45,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 18:55:45,178 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb818adf29cd80ecaa35d7/lava_callback.json.gz DEBUG: Setup failed for 69fb818adf29cd80ecaa35d7. Transitting job node result: incomplete -> fail 2026-05-06 18:55:45,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:55:45,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb818adf29cd80ecaa35d7 HTTP/1.1" 200 None 2026-05-06 18:55:45,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:55:45,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 18:55:45,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:55:45,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb818adf29cd80ecaa35d7 HTTP/1.1" 200 None 2026-05-06 18:55:45,339 - lava_callback - INFO - Completed processing callback for node 69fb818adf29cd80ecaa35d7 INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:55:56,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:55:56,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42912 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:57:03,535 - lava_callback - INFO - Received callback for node 69f8ebf60573a8210e13152a INFO: 172.21.0.1:37406 - "POST /node/69f8ebf60573a8210e13152a HTTP/1.0" 202 Accepted 2026-05-06 18:57:03,541 - lava_callback - INFO - Starting async job submit for node 69f8ebf60573a8210e13152a 2026-05-06 18:57:03,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:57:03,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ebf60573a8210e13152a HTTP/1.1" 200 None 2026-05-06 18:57:03,556 - lava_callback - DEBUG - Processing node 69f8ebf60573a8210e13152a: baseline-arm64-baylibre 2026-05-06 18:57:03,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ebf60573a8210e13152a 2026-05-06 18:57:03,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:57:03,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ebf60573a8210e13152a HTTP/1.1" 200 None 2026-05-06 18:57:03,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:57:03,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 18:57:03,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:57:03,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ebf60573a8210e13152a HTTP/1.1" 200 None 2026-05-06 18:57:03,613 - lava_callback - ERROR - Error processing callback for node 69f8ebf60573a8210e13152a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37028 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:58:25,025 - lava_callback - INFO - Received callback for node 69f8ec430573a8210e13155a INFO: 172.21.0.1:51134 - "POST /node/69f8ec430573a8210e13155a HTTP/1.0" 202 Accepted 2026-05-06 18:58:25,031 - lava_callback - INFO - Starting async job submit for node 69f8ec430573a8210e13155a 2026-05-06 18:58:25,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:58:25,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ec430573a8210e13155a HTTP/1.1" 200 None 2026-05-06 18:58:25,047 - lava_callback - DEBUG - Processing node 69f8ec430573a8210e13155a: baseline-arm-clabbe 2026-05-06 18:58:25,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ec430573a8210e13155a 2026-05-06 18:58:25,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:58:25,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ec430573a8210e13155a HTTP/1.1" 200 None 2026-05-06 18:58:25,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:58:25,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-06 18:58:25,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:58:25,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ec430573a8210e13155a HTTP/1.1" 200 None 2026-05-06 18:58:25,108 - lava_callback - ERROR - Error processing callback for node 69f8ec430573a8210e13155a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET / HTTP/1.0" 200 OK 2026-05-06 18:59:03,500 - lava_callback - INFO - Received callback for node 69f8ec720573a8210e13156b INFO: 172.21.0.1:41518 - "POST /node/69f8ec720573a8210e13156b HTTP/1.0" 202 Accepted 2026-05-06 18:59:03,507 - lava_callback - INFO - Starting async job submit for node 69f8ec720573a8210e13156b 2026-05-06 18:59:03,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:59:03,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ec720573a8210e13156b HTTP/1.1" 200 None 2026-05-06 18:59:03,532 - lava_callback - DEBUG - Processing node 69f8ec720573a8210e13156b: baseline-arm64-baylibre 2026-05-06 18:59:03,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ec720573a8210e13156b 2026-05-06 18:59:03,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:59:03,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ec720573a8210e13156b HTTP/1.1" 200 None 2026-05-06 18:59:03,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:59:03,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 18:59:03,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 18:59:03,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ec720573a8210e13156b HTTP/1.1" 200 None 2026-05-06 18:59:03,581 - lava_callback - ERROR - Error processing callback for node 69f8ec720573a8210e13156b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:00:23,534 - lava_callback - INFO - Received callback for node 69f8ecc40573a8210e13159f INFO: 172.21.0.1:51920 - "POST /node/69f8ecc40573a8210e13159f HTTP/1.0" 202 Accepted 2026-05-06 19:00:23,539 - lava_callback - INFO - Starting async job submit for node 69f8ecc40573a8210e13159f 2026-05-06 19:00:23,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:00:23,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ecc40573a8210e13159f HTTP/1.1" 200 None 2026-05-06 19:00:23,561 - lava_callback - DEBUG - Processing node 69f8ecc40573a8210e13159f: baseline-arm64-baylibre 2026-05-06 19:00:23,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ecc40573a8210e13159f 2026-05-06 19:00:23,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:00:23,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ecc40573a8210e13159f HTTP/1.1" 200 None 2026-05-06 19:00:23,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:00:23,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:00:23,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:00:23,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ecc40573a8210e13159f HTTP/1.1" 200 None 2026-05-06 19:00:23,606 - lava_callback - ERROR - Error processing callback for node 69f8ecc40573a8210e13159f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53686 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:02:03,683 - lava_callback - INFO - Received callback for node 69f8ed180573a8210e1315e0 INFO: 172.21.0.1:35652 - "POST /node/69f8ed180573a8210e1315e0 HTTP/1.0" 202 Accepted 2026-05-06 19:02:03,692 - lava_callback - INFO - Starting async job submit for node 69f8ed180573a8210e1315e0 2026-05-06 19:02:03,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:02:03,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ed180573a8210e1315e0 HTTP/1.1" 200 None 2026-05-06 19:02:03,709 - lava_callback - DEBUG - Processing node 69f8ed180573a8210e1315e0: baseline-arm64-baylibre 2026-05-06 19:02:03,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ed180573a8210e1315e0 2026-05-06 19:02:03,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:02:03,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ed180573a8210e1315e0 HTTP/1.1" 200 None 2026-05-06 19:02:03,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:02:03,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:02:03,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:02:03,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ed180573a8210e1315e0 HTTP/1.1" 200 None 2026-05-06 19:02:03,769 - lava_callback - ERROR - Error processing callback for node 69f8ed180573a8210e1315e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:03:25,165 - lava_callback - INFO - Received callback for node 69f8ed750573a8210e131610 INFO: 172.21.0.1:50628 - "POST /node/69f8ed750573a8210e131610 HTTP/1.0" 202 Accepted 2026-05-06 19:03:25,171 - lava_callback - INFO - Starting async job submit for node 69f8ed750573a8210e131610 2026-05-06 19:03:25,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:03:25,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ed750573a8210e131610 HTTP/1.1" 200 None 2026-05-06 19:03:25,186 - lava_callback - DEBUG - Processing node 69f8ed750573a8210e131610: baseline-arm64-clabbe 2026-05-06 19:03:25,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ed750573a8210e131610 2026-05-06 19:03:25,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:03:25,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ed750573a8210e131610 HTTP/1.1" 200 None 2026-05-06 19:03:25,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:03:25,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:03:25,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:03:25,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ed750573a8210e131610 HTTP/1.1" 200 None 2026-05-06 19:03:25,239 - lava_callback - ERROR - Error processing callback for node 69f8ed750573a8210e131610: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:04:43,802 - lava_callback - INFO - Received callback for node 69f8edc40573a8210e131645 INFO: 172.21.0.1:38096 - "POST /node/69f8edc40573a8210e131645 HTTP/1.0" 202 Accepted 2026-05-06 19:04:43,808 - lava_callback - INFO - Starting async job submit for node 69f8edc40573a8210e131645 2026-05-06 19:04:43,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:04:43,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8edc40573a8210e131645 HTTP/1.1" 200 None 2026-05-06 19:04:43,824 - lava_callback - DEBUG - Processing node 69f8edc40573a8210e131645: baseline-arm64-baylibre 2026-05-06 19:04:43,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8edc40573a8210e131645 2026-05-06 19:04:43,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:04:43,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8edc40573a8210e131645 HTTP/1.1" 200 None 2026-05-06 19:04:43,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:04:43,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:04:43,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:04:43,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8edc40573a8210e131645 HTTP/1.1" 200 None 2026-05-06 19:04:43,879 - lava_callback - ERROR - Error processing callback for node 69f8edc40573a8210e131645: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:06:25,256 - lava_callback - INFO - Received callback for node 69f8ee200573a8210e131682 INFO: 172.21.0.1:41162 - "POST /node/69f8ee200573a8210e131682 HTTP/1.0" 202 Accepted 2026-05-06 19:06:25,261 - lava_callback - INFO - Starting async job submit for node 69f8ee200573a8210e131682 2026-05-06 19:06:25,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:06:25,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ee200573a8210e131682 HTTP/1.1" 200 None 2026-05-06 19:06:25,276 - lava_callback - DEBUG - Processing node 69f8ee200573a8210e131682: baseline-arm64-clabbe 2026-05-06 19:06:25,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ee200573a8210e131682 2026-05-06 19:06:25,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:06:25,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ee200573a8210e131682 HTTP/1.1" 200 None 2026-05-06 19:06:25,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:06:25,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:06:25,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:06:25,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ee200573a8210e131682 HTTP/1.1" 200 None 2026-05-06 19:06:25,340 - lava_callback - ERROR - Error processing callback for node 69f8ee200573a8210e131682: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59228 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:07:45,387 - lava_callback - INFO - Received callback for node 69f8ee750573a8210e1316b0 INFO: 172.21.0.1:37568 - "POST /node/69f8ee750573a8210e1316b0 HTTP/1.0" 202 Accepted 2026-05-06 19:07:45,392 - lava_callback - INFO - Starting async job submit for node 69f8ee750573a8210e1316b0 2026-05-06 19:07:45,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:07:45,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ee750573a8210e1316b0 HTTP/1.1" 200 None 2026-05-06 19:07:45,408 - lava_callback - DEBUG - Processing node 69f8ee750573a8210e1316b0: baseline-arm64-clabbe 2026-05-06 19:07:45,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ee750573a8210e1316b0 2026-05-06 19:07:45,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:07:45,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ee750573a8210e1316b0 HTTP/1.1" 200 None 2026-05-06 19:07:45,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:07:45,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:07:45,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:07:45,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ee750573a8210e1316b0 HTTP/1.1" 200 None 2026-05-06 19:07:45,465 - lava_callback - ERROR - Error processing callback for node 69f8ee750573a8210e1316b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:09:04,039 - lava_callback - INFO - Received callback for node 69f8eec20573a8210e1316c9 INFO: 172.21.0.1:60570 - "POST /node/69f8eec20573a8210e1316c9 HTTP/1.0" 202 Accepted 2026-05-06 19:09:04,045 - lava_callback - INFO - Starting async job submit for node 69f8eec20573a8210e1316c9 2026-05-06 19:09:04,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:09:04,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eec20573a8210e1316c9 HTTP/1.1" 200 None 2026-05-06 19:09:04,062 - lava_callback - DEBUG - Processing node 69f8eec20573a8210e1316c9: baseline-arm64-baylibre 2026-05-06 19:09:04,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8eec20573a8210e1316c9 2026-05-06 19:09:04,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:09:04,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eec20573a8210e1316c9 HTTP/1.1" 200 None 2026-05-06 19:09:04,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:09:04,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:09:04,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:09:04,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8eec20573a8210e1316c9 HTTP/1.1" 200 None 2026-05-06 19:09:04,114 - lava_callback - ERROR - Error processing callback for node 69f8eec20573a8210e1316c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:10:24,094 - lava_callback - INFO - Received callback for node 69f8ef1c0573a8210e131705 INFO: 172.21.0.1:34862 - "POST /node/69f8ef1c0573a8210e131705 HTTP/1.0" 202 Accepted 2026-05-06 19:10:24,099 - lava_callback - INFO - Starting async job submit for node 69f8ef1c0573a8210e131705 2026-05-06 19:10:24,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:10:24,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ef1c0573a8210e131705 HTTP/1.1" 200 None 2026-05-06 19:10:24,114 - lava_callback - DEBUG - Processing node 69f8ef1c0573a8210e131705: baseline-arm64-baylibre 2026-05-06 19:10:24,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ef1c0573a8210e131705 2026-05-06 19:10:24,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:10:24,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ef1c0573a8210e131705 HTTP/1.1" 200 None 2026-05-06 19:10:24,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:10:24,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:10:24,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:10:24,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ef1c0573a8210e131705 HTTP/1.1" 200 None 2026-05-06 19:10:24,182 - lava_callback - ERROR - Error processing callback for node 69f8ef1c0573a8210e131705: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34364 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:12:05,491 - lava_callback - INFO - Received callback for node 69f8ef760573a8210e13173d INFO: 172.21.0.1:51316 - "POST /node/69f8ef760573a8210e13173d HTTP/1.0" 202 Accepted 2026-05-06 19:12:05,497 - lava_callback - INFO - Starting async job submit for node 69f8ef760573a8210e13173d 2026-05-06 19:12:05,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:12:05,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ef760573a8210e13173d HTTP/1.1" 200 None 2026-05-06 19:12:05,517 - lava_callback - DEBUG - Processing node 69f8ef760573a8210e13173d: baseline-arm64-clabbe 2026-05-06 19:12:05,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ef760573a8210e13173d 2026-05-06 19:12:05,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:12:05,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ef760573a8210e13173d HTTP/1.1" 200 None 2026-05-06 19:12:05,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:12:05,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:12:05,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:12:05,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ef760573a8210e13173d HTTP/1.1" 200 None 2026-05-06 19:12:05,570 - lava_callback - ERROR - Error processing callback for node 69f8ef760573a8210e13173d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51968 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:13:25,751 - lava_callback - INFO - Received callback for node 69f8efcd0573a8210e13176a INFO: 172.21.0.1:59336 - "POST /node/69f8efcd0573a8210e13176a HTTP/1.0" 202 Accepted 2026-05-06 19:13:25,756 - lava_callback - INFO - Starting async job submit for node 69f8efcd0573a8210e13176a 2026-05-06 19:13:25,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:13:25,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8efcd0573a8210e13176a HTTP/1.1" 200 None 2026-05-06 19:13:25,771 - lava_callback - DEBUG - Processing node 69f8efcd0573a8210e13176a: baseline-arm64-clabbe 2026-05-06 19:13:25,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8efcd0573a8210e13176a 2026-05-06 19:13:25,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:13:25,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8efcd0573a8210e13176a HTTP/1.1" 200 None 2026-05-06 19:13:25,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:13:25,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:13:25,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:13:25,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8efcd0573a8210e13176a HTTP/1.1" 200 None 2026-05-06 19:13:25,816 - lava_callback - ERROR - Error processing callback for node 69f8efcd0573a8210e13176a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:15:05,645 - lava_callback - INFO - Received callback for node 69f8f0230573a8210e1317a5 INFO: 172.21.0.1:33668 - "POST /node/69f8f0230573a8210e1317a5 HTTP/1.0" 202 Accepted 2026-05-06 19:15:05,651 - lava_callback - INFO - Starting async job submit for node 69f8f0230573a8210e1317a5 2026-05-06 19:15:05,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:15:05,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f0230573a8210e1317a5 HTTP/1.1" 200 None 2026-05-06 19:15:05,667 - lava_callback - DEBUG - Processing node 69f8f0230573a8210e1317a5: baseline-arm64-clabbe 2026-05-06 19:15:05,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f0230573a8210e1317a5 2026-05-06 19:15:05,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:15:05,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f0230573a8210e1317a5 HTTP/1.1" 200 None 2026-05-06 19:15:05,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:15:05,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:15:05,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:15:05,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f0230573a8210e1317a5 HTTP/1.1" 200 None 2026-05-06 19:15:05,716 - lava_callback - ERROR - Error processing callback for node 69f8f0230573a8210e1317a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53758 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:15:24,511 - lava_callback - INFO - Received callback for node 69fb8ec6df29cd80ecaa3818 INFO: 172.21.0.1:55124 - "POST /node/69fb8ec6df29cd80ecaa3818 HTTP/1.0" 202 Accepted 2026-05-06 19:15:24,557 - lava_callback - INFO - Starting async job submit for node 69fb8ec6df29cd80ecaa3818 2026-05-06 19:15:24,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:15:24,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8ec6df29cd80ecaa3818 HTTP/1.1" 200 None 2026-05-06 19:15:24,597 - lava_callback - DEBUG - Processing node 69fb8ec6df29cd80ecaa3818: baseline-arm-pengutronix 2026-05-06 19:15:24,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 19:15:24,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 19:15:24,791 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb8ec6df29cd80ecaa3818/log.txt.gz 2026-05-06 19:15:24,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 19:15:24,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 19:15:24,973 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb8ec6df29cd80ecaa3818/lava-logs.yaml 2026-05-06 19:15:24,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 19:15:25,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 19:15:25,059 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb8ec6df29cd80ecaa3818/lava_callback.json.gz DEBUG: Setup failed for 69fb8ec6df29cd80ecaa3818. Transitting job node result: incomplete -> fail 2026-05-06 19:15:25,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:15:25,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8ec6df29cd80ecaa3818 HTTP/1.1" 200 None 2026-05-06 19:15:25,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:15:25,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 19:15:25,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:15:25,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8ec6df29cd80ecaa3818 HTTP/1.1" 200 None 2026-05-06 19:15:25,202 - lava_callback - INFO - Completed processing callback for node 69fb8ec6df29cd80ecaa3818 2026-05-06 19:15:26,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:15:26,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39282 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:16:25,716 - lava_callback - INFO - Received callback for node 69f8f0790573a8210e1317e2 INFO: 172.21.0.1:58436 - "POST /node/69f8f0790573a8210e1317e2 HTTP/1.0" 202 Accepted 2026-05-06 19:16:25,722 - lava_callback - INFO - Starting async job submit for node 69f8f0790573a8210e1317e2 2026-05-06 19:16:25,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:16:25,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f0790573a8210e1317e2 HTTP/1.1" 200 None 2026-05-06 19:16:25,737 - lava_callback - DEBUG - Processing node 69f8f0790573a8210e1317e2: baseline-arm64-clabbe 2026-05-06 19:16:25,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f0790573a8210e1317e2 2026-05-06 19:16:25,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:16:25,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f0790573a8210e1317e2 HTTP/1.1" 200 None 2026-05-06 19:16:25,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:16:25,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:16:25,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:16:25,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f0790573a8210e1317e2 HTTP/1.1" 200 None 2026-05-06 19:16:25,782 - lava_callback - ERROR - Error processing callback for node 69f8f0790573a8210e1317e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:17:45,758 - lava_callback - INFO - Received callback for node 69f8f0d00573a8210e13180a INFO: 172.21.0.1:36720 - "POST /node/69f8f0d00573a8210e13180a HTTP/1.0" 202 Accepted 2026-05-06 19:17:45,764 - lava_callback - INFO - Starting async job submit for node 69f8f0d00573a8210e13180a 2026-05-06 19:17:45,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:17:45,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f0d00573a8210e13180a HTTP/1.1" 200 None 2026-05-06 19:17:45,778 - lava_callback - DEBUG - Processing node 69f8f0d00573a8210e13180a: baseline-arm64-clabbe 2026-05-06 19:17:45,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f0d00573a8210e13180a 2026-05-06 19:17:45,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:17:45,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f0d00573a8210e13180a HTTP/1.1" 200 None 2026-05-06 19:17:45,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:17:45,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:17:45,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:17:45,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f0d00573a8210e13180a HTTP/1.1" 200 None 2026-05-06 19:17:45,824 - lava_callback - ERROR - Error processing callback for node 69f8f0d00573a8210e13180a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:19:05,793 - lava_callback - INFO - Received callback for node 69f8f1270573a8210e13183f INFO: 172.21.0.1:56804 - "POST /node/69f8f1270573a8210e13183f HTTP/1.0" 202 Accepted 2026-05-06 19:19:05,799 - lava_callback - INFO - Starting async job submit for node 69f8f1270573a8210e13183f 2026-05-06 19:19:05,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:19:05,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f1270573a8210e13183f HTTP/1.1" 200 None 2026-05-06 19:19:05,815 - lava_callback - DEBUG - Processing node 69f8f1270573a8210e13183f: baseline-arm64-clabbe 2026-05-06 19:19:05,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f1270573a8210e13183f 2026-05-06 19:19:05,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:19:05,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f1270573a8210e13183f HTTP/1.1" 200 None 2026-05-06 19:19:05,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:19:05,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:19:05,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:19:05,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f1270573a8210e13183f HTTP/1.1" 200 None 2026-05-06 19:19:05,881 - lava_callback - ERROR - Error processing callback for node 69f8f1270573a8210e13183f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50626 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:20:24,770 - lava_callback - INFO - Received callback for node 69f8f16a0573a8210e13186b INFO: 172.21.0.1:58108 - "POST /node/69f8f16a0573a8210e13186b HTTP/1.0" 202 Accepted 2026-05-06 19:20:24,776 - lava_callback - INFO - Starting async job submit for node 69f8f16a0573a8210e13186b 2026-05-06 19:20:24,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:20:24,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f16a0573a8210e13186b HTTP/1.1" 200 None 2026-05-06 19:20:24,791 - lava_callback - DEBUG - Processing node 69f8f16a0573a8210e13186b: baseline-arm-baylibre 2026-05-06 19:20:24,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f16a0573a8210e13186b 2026-05-06 19:20:24,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:20:24,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f16a0573a8210e13186b HTTP/1.1" 200 None 2026-05-06 19:20:24,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:20:24,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:20:24,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:20:24,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f16a0573a8210e13186b HTTP/1.1" 200 None 2026-05-06 19:20:24,847 - lava_callback - ERROR - Error processing callback for node 69f8f16a0573a8210e13186b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42112 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:21:25,894 - lava_callback - INFO - Received callback for node 69f8f1a70573a8210e131881 INFO: 172.21.0.1:57390 - "POST /node/69f8f1a70573a8210e131881 HTTP/1.0" 202 Accepted 2026-05-06 19:21:25,900 - lava_callback - INFO - Starting async job submit for node 69f8f1a70573a8210e131881 2026-05-06 19:21:25,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:21:25,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f1a70573a8210e131881 HTTP/1.1" 200 None 2026-05-06 19:21:25,916 - lava_callback - DEBUG - Processing node 69f8f1a70573a8210e131881: baseline-arm64-clabbe 2026-05-06 19:21:25,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f1a70573a8210e131881 2026-05-06 19:21:25,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:21:25,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f1a70573a8210e131881 HTTP/1.1" 200 None 2026-05-06 19:21:25,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:21:25,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:21:25,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:21:25,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f1a70573a8210e131881 HTTP/1.1" 200 None 2026-05-06 19:21:25,974 - lava_callback - ERROR - Error processing callback for node 69f8f1a70573a8210e131881: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52584 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:24:04,850 - lava_callback - INFO - Received callback for node 69f8f24a0573a8210e1318c9 INFO: 172.21.0.1:33120 - "POST /node/69f8f24a0573a8210e1318c9 HTTP/1.0" 202 Accepted 2026-05-06 19:24:04,856 - lava_callback - INFO - Starting async job submit for node 69f8f24a0573a8210e1318c9 2026-05-06 19:24:04,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:24:04,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f24a0573a8210e1318c9 HTTP/1.1" 200 None 2026-05-06 19:24:04,873 - lava_callback - DEBUG - Processing node 69f8f24a0573a8210e1318c9: baseline-arm-baylibre 2026-05-06 19:24:04,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f24a0573a8210e1318c9 2026-05-06 19:24:04,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:24:04,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f24a0573a8210e1318c9 HTTP/1.1" 200 None 2026-05-06 19:24:04,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:24:04,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:24:04,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:24:04,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f24a0573a8210e1318c9 HTTP/1.1" 200 None 2026-05-06 19:24:04,946 - lava_callback - ERROR - Error processing callback for node 69f8f24a0573a8210e1318c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:24:44,862 - lava_callback - INFO - Received callback for node 69f8f2730573a8210e1318e4 INFO: 172.21.0.1:50902 - "POST /node/69f8f2730573a8210e1318e4 HTTP/1.0" 202 Accepted 2026-05-06 19:24:44,868 - lava_callback - INFO - Starting async job submit for node 69f8f2730573a8210e1318e4 2026-05-06 19:24:44,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:24:44,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f2730573a8210e1318e4 HTTP/1.1" 200 None 2026-05-06 19:24:44,883 - lava_callback - DEBUG - Processing node 69f8f2730573a8210e1318e4: baseline-arm-baylibre 2026-05-06 19:24:44,883 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f2730573a8210e1318e4 2026-05-06 19:24:44,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:24:44,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f2730573a8210e1318e4 HTTP/1.1" 200 None 2026-05-06 19:24:44,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:24:44,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:24:44,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:24:44,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f2730573a8210e1318e4 HTTP/1.1" 200 None 2026-05-06 19:24:44,932 - lava_callback - ERROR - Error processing callback for node 69f8f2730573a8210e1318e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:25:24,918 - lava_callback - INFO - Received callback for node 69f8f29d0573a8210e1318ef INFO: 172.21.0.1:35828 - "POST /node/69f8f29d0573a8210e1318ef HTTP/1.0" 202 Accepted 2026-05-06 19:25:24,923 - lava_callback - INFO - Starting async job submit for node 69f8f29d0573a8210e1318ef 2026-05-06 19:25:24,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:25:24,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f29d0573a8210e1318ef HTTP/1.1" 200 None 2026-05-06 19:25:24,940 - lava_callback - DEBUG - Processing node 69f8f29d0573a8210e1318ef: baseline-arm-baylibre 2026-05-06 19:25:24,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f29d0573a8210e1318ef 2026-05-06 19:25:24,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:25:24,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f29d0573a8210e1318ef HTTP/1.1" 200 None 2026-05-06 19:25:24,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:25:24,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:25:24,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:25:25,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f29d0573a8210e1318ef HTTP/1.1" 200 None 2026-05-06 19:25:25,012 - lava_callback - ERROR - Error processing callback for node 69f8f29d0573a8210e1318ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:26:04,980 - lava_callback - INFO - Received callback for node 69f8f2c80573a8210e1318fe INFO: 172.21.0.1:43648 - "POST /node/69f8f2c80573a8210e1318fe HTTP/1.0" 202 Accepted 2026-05-06 19:26:04,985 - lava_callback - INFO - Starting async job submit for node 69f8f2c80573a8210e1318fe 2026-05-06 19:26:04,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:26:05,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f2c80573a8210e1318fe HTTP/1.1" 200 None 2026-05-06 19:26:05,002 - lava_callback - DEBUG - Processing node 69f8f2c80573a8210e1318fe: baseline-arm-baylibre 2026-05-06 19:26:05,002 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f2c80573a8210e1318fe 2026-05-06 19:26:05,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:26:05,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f2c80573a8210e1318fe HTTP/1.1" 200 None 2026-05-06 19:26:05,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:26:05,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:26:05,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:26:05,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f2c80573a8210e1318fe HTTP/1.1" 200 None 2026-05-06 19:26:05,070 - lava_callback - ERROR - Error processing callback for node 69f8f2c80573a8210e1318fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:27:06,081 - lava_callback - INFO - Received callback for node 69f8f3010573a8210e131911 INFO: 172.21.0.1:47140 - "POST /node/69f8f3010573a8210e131911 HTTP/1.0" 202 Accepted 2026-05-06 19:27:06,087 - lava_callback - INFO - Starting async job submit for node 69f8f3010573a8210e131911 2026-05-06 19:27:06,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:27:06,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f3010573a8210e131911 HTTP/1.1" 200 None 2026-05-06 19:27:06,102 - lava_callback - DEBUG - Processing node 69f8f3010573a8210e131911: baseline-arm64-clabbe 2026-05-06 19:27:06,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f3010573a8210e131911 2026-05-06 19:27:06,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:27:06,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f3010573a8210e131911 HTTP/1.1" 200 None 2026-05-06 19:27:06,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:27:06,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:27:06,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:27:06,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f3010573a8210e131911 HTTP/1.1" 200 None 2026-05-06 19:27:06,147 - lava_callback - ERROR - Error processing callback for node 69f8f3010573a8210e131911: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:30:46,272 - lava_callback - INFO - Received callback for node 69f8f3d70573a8210e13198c INFO: 172.21.0.1:39756 - "POST /node/69f8f3d70573a8210e13198c HTTP/1.0" 202 Accepted 2026-05-06 19:30:46,278 - lava_callback - INFO - Starting async job submit for node 69f8f3d70573a8210e13198c 2026-05-06 19:30:46,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:30:46,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f3d70573a8210e13198c HTTP/1.1" 200 None 2026-05-06 19:30:46,295 - lava_callback - DEBUG - Processing node 69f8f3d70573a8210e13198c: baseline-arm64-clabbe 2026-05-06 19:30:46,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f3d70573a8210e13198c 2026-05-06 19:30:46,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:30:46,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f3d70573a8210e13198c HTTP/1.1" 200 None 2026-05-06 19:30:46,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:30:46,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:30:46,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:30:46,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f3d70573a8210e13198c HTTP/1.1" 200 None 2026-05-06 19:30:46,360 - lava_callback - ERROR - Error processing callback for node 69f8f3d70573a8210e13198c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43034 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:31:45,545 - lava_callback - INFO - Received callback for node 69f8f4180573a8210e1319a6 INFO: 172.21.0.1:39838 - "POST /node/69f8f4180573a8210e1319a6 HTTP/1.0" 202 Accepted 2026-05-06 19:31:45,553 - lava_callback - INFO - Starting async job submit for node 69f8f4180573a8210e1319a6 2026-05-06 19:31:45,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:31:45,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f4180573a8210e1319a6 HTTP/1.1" 200 None 2026-05-06 19:31:45,572 - lava_callback - DEBUG - Processing node 69f8f4180573a8210e1319a6: baseline-arm-baylibre 2026-05-06 19:31:45,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f4180573a8210e1319a6 2026-05-06 19:31:45,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:31:45,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f4180573a8210e1319a6 HTTP/1.1" 200 None 2026-05-06 19:31:45,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:31:45,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:31:45,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:31:45,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f4180573a8210e1319a6 HTTP/1.1" 200 None 2026-05-06 19:31:45,631 - lava_callback - ERROR - Error processing callback for node 69f8f4180573a8210e1319a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40802 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:32:26,342 - lava_callback - INFO - Received callback for node 69f8f4430573a8210e1319b3 INFO: 172.21.0.1:42434 - "POST /node/69f8f4430573a8210e1319b3 HTTP/1.0" 202 Accepted 2026-05-06 19:32:26,352 - lava_callback - INFO - Starting async job submit for node 69f8f4430573a8210e1319b3 2026-05-06 19:32:26,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:32:26,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f4430573a8210e1319b3 HTTP/1.1" 200 None 2026-05-06 19:32:26,375 - lava_callback - DEBUG - Processing node 69f8f4430573a8210e1319b3: baseline-arm-clabbe 2026-05-06 19:32:26,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f4430573a8210e1319b3 2026-05-06 19:32:26,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:32:26,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f4430573a8210e1319b3 HTTP/1.1" 200 None 2026-05-06 19:32:26,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:32:26,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:32:26,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:32:26,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f4430573a8210e1319b3 HTTP/1.1" 200 None 2026-05-06 19:32:26,432 - lava_callback - ERROR - Error processing callback for node 69f8f4430573a8210e1319b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56724 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:33:05,335 - lava_callback - INFO - Received callback for node 69f8f4650573a8210e1319bf INFO: 172.21.0.1:35928 - "POST /node/69f8f4650573a8210e1319bf HTTP/1.0" 202 Accepted 2026-05-06 19:33:05,340 - lava_callback - INFO - Starting async job submit for node 69f8f4650573a8210e1319bf 2026-05-06 19:33:05,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:33:05,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f4650573a8210e1319bf HTTP/1.1" 200 None 2026-05-06 19:33:05,356 - lava_callback - DEBUG - Processing node 69f8f4650573a8210e1319bf: baseline-arm-baylibre 2026-05-06 19:33:05,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f4650573a8210e1319bf 2026-05-06 19:33:05,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:33:05,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f4650573a8210e1319bf HTTP/1.1" 200 None 2026-05-06 19:33:05,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:33:05,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:33:05,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:33:05,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f4650573a8210e1319bf HTTP/1.1" 200 None 2026-05-06 19:33:05,404 - lava_callback - ERROR - Error processing callback for node 69f8f4650573a8210e1319bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:34:25,397 - lava_callback - INFO - Received callback for node 69f8f4b40573a8210e1319d7 INFO: 172.21.0.1:41424 - "POST /node/69f8f4b40573a8210e1319d7 HTTP/1.0" 202 Accepted 2026-05-06 19:34:25,402 - lava_callback - INFO - Starting async job submit for node 69f8f4b40573a8210e1319d7 2026-05-06 19:34:25,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:34:25,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f4b40573a8210e1319d7 HTTP/1.1" 200 None 2026-05-06 19:34:25,446 - lava_callback - DEBUG - Processing node 69f8f4b40573a8210e1319d7: baseline-arm-baylibre 2026-05-06 19:34:25,446 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f4b40573a8210e1319d7 2026-05-06 19:34:25,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:34:25,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f4b40573a8210e1319d7 HTTP/1.1" 200 None 2026-05-06 19:34:25,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:34:25,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-06 19:34:25,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:34:25,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f4b40573a8210e1319d7 HTTP/1.1" 200 None 2026-05-06 19:34:25,562 - lava_callback - ERROR - Error processing callback for node 69f8f4b40573a8210e1319d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33078 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:35:05,453 - lava_callback - INFO - Received callback for node 69f8f4e70573a8210e1319e7 INFO: 172.21.0.1:49998 - "POST /node/69f8f4e70573a8210e1319e7 HTTP/1.0" 202 Accepted 2026-05-06 19:35:05,458 - lava_callback - INFO - Starting async job submit for node 69f8f4e70573a8210e1319e7 2026-05-06 19:35:05,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:35:05,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f4e70573a8210e1319e7 HTTP/1.1" 200 None 2026-05-06 19:35:05,477 - lava_callback - DEBUG - Processing node 69f8f4e70573a8210e1319e7: baseline-arm64-baylibre 2026-05-06 19:35:05,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f4e70573a8210e1319e7 2026-05-06 19:35:05,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:35:05,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f4e70573a8210e1319e7 HTTP/1.1" 200 None 2026-05-06 19:35:05,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:35:05,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:35:05,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:35:05,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f4e70573a8210e1319e7 HTTP/1.1" 200 None 2026-05-06 19:35:05,530 - lava_callback - ERROR - Error processing callback for node 69f8f4e70573a8210e1319e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 19:35:05,862 - lava_callback - INFO - Received callback for node 69fb935adf29cd80ecaa38b9 INFO: 172.21.0.1:50012 - "POST /node/69fb935adf29cd80ecaa38b9 HTTP/1.0" 202 Accepted 2026-05-06 19:35:05,910 - lava_callback - INFO - Starting async job submit for node 69fb935adf29cd80ecaa38b9 2026-05-06 19:35:05,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:35:05,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb935adf29cd80ecaa38b9 HTTP/1.1" 200 None 2026-05-06 19:35:05,954 - lava_callback - DEBUG - Processing node 69fb935adf29cd80ecaa38b9: baseline-arm-pengutronix 2026-05-06 19:35:06,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 19:35:06,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 19:35:06,169 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb935adf29cd80ecaa38b9/log.txt.gz 2026-05-06 19:35:06,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 19:35:06,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 19:35:06,367 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb935adf29cd80ecaa38b9/lava-logs.yaml 2026-05-06 19:35:06,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 19:35:06,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 19:35:06,455 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fb935adf29cd80ecaa38b9/lava_callback.json.gz DEBUG: Setup failed for 69fb935adf29cd80ecaa38b9. Transitting job node result: incomplete -> fail 2026-05-06 19:35:06,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:35:06,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb935adf29cd80ecaa38b9 HTTP/1.1" 200 None 2026-05-06 19:35:06,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:35:06,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-06 19:35:06,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:35:06,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb935adf29cd80ecaa38b9 HTTP/1.1" 200 None 2026-05-06 19:35:06,608 - lava_callback - INFO - Completed processing callback for node 69fb935adf29cd80ecaa38b9 INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:35:26,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:35:26,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:36:25,585 - lava_callback - INFO - Received callback for node 69f8f52d0573a8210e131a04 INFO: 172.21.0.1:60172 - "POST /node/69f8f52d0573a8210e131a04 HTTP/1.0" 202 Accepted 2026-05-06 19:36:25,591 - lava_callback - INFO - Starting async job submit for node 69f8f52d0573a8210e131a04 2026-05-06 19:36:25,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:36:25,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f52d0573a8210e131a04 HTTP/1.1" 200 None 2026-05-06 19:36:25,608 - lava_callback - DEBUG - Processing node 69f8f52d0573a8210e131a04: baseline-arm-baylibre 2026-05-06 19:36:25,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f52d0573a8210e131a04 2026-05-06 19:36:25,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:36:25,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f52d0573a8210e131a04 HTTP/1.1" 200 None 2026-05-06 19:36:25,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:36:25,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-06 19:36:25,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:36:25,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f52d0573a8210e131a04 HTTP/1.1" 200 None 2026-05-06 19:36:25,654 - lava_callback - ERROR - Error processing callback for node 69f8f52d0573a8210e131a04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37592 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:37:05,644 - lava_callback - INFO - Received callback for node 69f8f5530573a8210e131a10 INFO: 172.21.0.1:57296 - "POST /node/69f8f5530573a8210e131a10 HTTP/1.0" 202 Accepted 2026-05-06 19:37:05,649 - lava_callback - INFO - Starting async job submit for node 69f8f5530573a8210e131a10 2026-05-06 19:37:05,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:37:05,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f5530573a8210e131a10 HTTP/1.1" 200 None 2026-05-06 19:37:05,665 - lava_callback - DEBUG - Processing node 69f8f5530573a8210e131a10: baseline-arm-baylibre 2026-05-06 19:37:05,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f5530573a8210e131a10 2026-05-06 19:37:05,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:37:05,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f5530573a8210e131a10 HTTP/1.1" 200 None 2026-05-06 19:37:05,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:37:05,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:37:05,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:37:05,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f5530573a8210e131a10 HTTP/1.1" 200 None 2026-05-06 19:37:05,717 - lava_callback - ERROR - Error processing callback for node 69f8f5530573a8210e131a10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47730 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:37:46,519 - lava_callback - INFO - Received callback for node 69f8f57f0573a8210e131a21 INFO: 172.21.0.1:55660 - "POST /node/69f8f57f0573a8210e131a21 HTTP/1.0" 202 Accepted 2026-05-06 19:37:46,525 - lava_callback - INFO - Starting async job submit for node 69f8f57f0573a8210e131a21 2026-05-06 19:37:46,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:55668 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:37:46,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f57f0573a8210e131a21 HTTP/1.1" 200 None 2026-05-06 19:37:46,543 - lava_callback - DEBUG - Processing node 69f8f57f0573a8210e131a21: baseline-arm-clabbe 2026-05-06 19:37:46,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f57f0573a8210e131a21 2026-05-06 19:37:46,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:37:46,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f57f0573a8210e131a21 HTTP/1.1" 200 None 2026-05-06 19:37:46,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:37:46,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:37:46,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:37:46,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f57f0573a8210e131a21 HTTP/1.1" 200 None 2026-05-06 19:37:46,593 - lava_callback - ERROR - Error processing callback for node 69f8f57f0573a8210e131a21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35988 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:38:25,658 - lava_callback - INFO - Received callback for node 69f8f5a40573a8210e131a2b INFO: 172.21.0.1:49294 - "POST /node/69f8f5a40573a8210e131a2b HTTP/1.0" 202 Accepted 2026-05-06 19:38:25,663 - lava_callback - INFO - Starting async job submit for node 69f8f5a40573a8210e131a2b 2026-05-06 19:38:25,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:38:25,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f5a40573a8210e131a2b HTTP/1.1" 200 None 2026-05-06 19:38:25,702 - lava_callback - DEBUG - Processing node 69f8f5a40573a8210e131a2b: baseline-arm-baylibre 2026-05-06 19:38:25,702 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f5a40573a8210e131a2b 2026-05-06 19:38:25,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:38:25,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f5a40573a8210e131a2b HTTP/1.1" 200 None 2026-05-06 19:38:25,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:38:25,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-06 19:38:25,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:38:25,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f5a40573a8210e131a2b HTTP/1.1" 200 None 2026-05-06 19:38:25,747 - lava_callback - ERROR - Error processing callback for node 69f8f5a40573a8210e131a2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:39:05,643 - lava_callback - INFO - Received callback for node 69f8f5cb0573a8210e131a39 INFO: 172.21.0.1:59742 - "POST /node/69f8f5cb0573a8210e131a39 HTTP/1.0" 202 Accepted 2026-05-06 19:39:05,649 - lava_callback - INFO - Starting async job submit for node 69f8f5cb0573a8210e131a39 2026-05-06 19:39:05,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:39:05,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f5cb0573a8210e131a39 HTTP/1.1" 200 None 2026-05-06 19:39:05,664 - lava_callback - DEBUG - Processing node 69f8f5cb0573a8210e131a39: baseline-arm-baylibre 2026-05-06 19:39:05,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f5cb0573a8210e131a39 2026-05-06 19:39:05,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:39:05,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f5cb0573a8210e131a39 HTTP/1.1" 200 None 2026-05-06 19:39:05,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:39:05,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:39:05,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:39:05,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f5cb0573a8210e131a39 HTTP/1.1" 200 None 2026-05-06 19:39:05,727 - lava_callback - ERROR - Error processing callback for node 69f8f5cb0573a8210e131a39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:39:45,856 - lava_callback - INFO - Received callback for node 69f8f5f40573a8210e131a49 INFO: 172.21.0.1:51174 - "POST /node/69f8f5f40573a8210e131a49 HTTP/1.0" 202 Accepted 2026-05-06 19:39:45,862 - lava_callback - INFO - Starting async job submit for node 69f8f5f40573a8210e131a49 2026-05-06 19:39:45,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:39:45,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f5f40573a8210e131a49 HTTP/1.1" 200 None 2026-05-06 19:39:45,935 - lava_callback - DEBUG - Processing node 69f8f5f40573a8210e131a49: baseline-arm-baylibre 2026-05-06 19:39:45,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f5f40573a8210e131a49 2026-05-06 19:39:45,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:39:45,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f5f40573a8210e131a49 HTTP/1.1" 200 None 2026-05-06 19:39:45,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:39:45,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:39:45,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:39:45,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f5f40573a8210e131a49 HTTP/1.1" 200 None 2026-05-06 19:39:45,987 - lava_callback - ERROR - Error processing callback for node 69f8f5f40573a8210e131a49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:40:25,708 - lava_callback - INFO - Received callback for node 69f8f61b0573a8210e131a53 INFO: 172.21.0.1:58510 - "POST /node/69f8f61b0573a8210e131a53 HTTP/1.0" 202 Accepted 2026-05-06 19:40:25,714 - lava_callback - INFO - Starting async job submit for node 69f8f61b0573a8210e131a53 2026-05-06 19:40:25,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:40:25,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f61b0573a8210e131a53 HTTP/1.1" 200 None 2026-05-06 19:40:25,741 - lava_callback - DEBUG - Processing node 69f8f61b0573a8210e131a53: baseline-arm-baylibre 2026-05-06 19:40:25,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f61b0573a8210e131a53 2026-05-06 19:40:25,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:40:25,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f61b0573a8210e131a53 HTTP/1.1" 200 None 2026-05-06 19:40:25,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:40:25,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-06 19:40:25,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:40:25,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f61b0573a8210e131a53 HTTP/1.1" 200 None 2026-05-06 19:40:25,788 - lava_callback - ERROR - Error processing callback for node 69f8f61b0573a8210e131a53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:41:06,669 - lava_callback - INFO - Received callback for node 69f8f6460573a8210e131a5f INFO: 172.21.0.1:33486 - "POST /node/69f8f6460573a8210e131a5f HTTP/1.0" 202 Accepted 2026-05-06 19:41:06,674 - lava_callback - INFO - Starting async job submit for node 69f8f6460573a8210e131a5f 2026-05-06 19:41:06,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:41:06,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f6460573a8210e131a5f HTTP/1.1" 200 None 2026-05-06 19:41:06,691 - lava_callback - DEBUG - Processing node 69f8f6460573a8210e131a5f: baseline-arm-clabbe 2026-05-06 19:41:06,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f6460573a8210e131a5f 2026-05-06 19:41:06,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:41:06,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f6460573a8210e131a5f HTTP/1.1" 200 None 2026-05-06 19:41:06,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:41:06,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:41:06,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:41:06,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f6460573a8210e131a5f HTTP/1.1" 200 None 2026-05-06 19:41:06,745 - lava_callback - ERROR - Error processing callback for node 69f8f6460573a8210e131a5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:41:45,869 - lava_callback - INFO - Received callback for node 69f8f66b0573a8210e131a75 INFO: 172.21.0.1:48996 - "POST /node/69f8f66b0573a8210e131a75 HTTP/1.0" 202 Accepted 2026-05-06 19:41:45,874 - lava_callback - INFO - Starting async job submit for node 69f8f66b0573a8210e131a75 2026-05-06 19:41:45,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:41:45,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f66b0573a8210e131a75 HTTP/1.1" 200 None 2026-05-06 19:41:45,889 - lava_callback - DEBUG - Processing node 69f8f66b0573a8210e131a75: baseline-arm-baylibre 2026-05-06 19:41:45,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f66b0573a8210e131a75 2026-05-06 19:41:45,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:41:45,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f66b0573a8210e131a75 HTTP/1.1" 200 None 2026-05-06 19:41:45,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:41:45,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:41:45,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:41:45,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f66b0573a8210e131a75 HTTP/1.1" 200 None 2026-05-06 19:41:45,956 - lava_callback - ERROR - Error processing callback for node 69f8f66b0573a8210e131a75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:42:26,672 - lava_callback - INFO - Received callback for node 69f8f6960573a8210e131a7f INFO: 172.21.0.1:40846 - "POST /node/69f8f6960573a8210e131a7f HTTP/1.0" 202 Accepted 2026-05-06 19:42:26,678 - lava_callback - INFO - Starting async job submit for node 69f8f6960573a8210e131a7f 2026-05-06 19:42:26,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:42:26,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f6960573a8210e131a7f HTTP/1.1" 200 None 2026-05-06 19:42:26,698 - lava_callback - DEBUG - Processing node 69f8f6960573a8210e131a7f: baseline-arm-clabbe 2026-05-06 19:42:26,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f6960573a8210e131a7f 2026-05-06 19:42:26,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:42:26,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f6960573a8210e131a7f HTTP/1.1" 200 None 2026-05-06 19:42:26,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:42:26,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:42:26,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:42:26,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f6960573a8210e131a7f HTTP/1.1" 200 None 2026-05-06 19:42:26,743 - lava_callback - ERROR - Error processing callback for node 69f8f6960573a8210e131a7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:43:05,972 - lava_callback - INFO - Received callback for node 69f8f6bc0573a8210e131a8c INFO: 172.21.0.1:55292 - "POST /node/69f8f6bc0573a8210e131a8c HTTP/1.0" 202 Accepted 2026-05-06 19:43:05,977 - lava_callback - INFO - Starting async job submit for node 69f8f6bc0573a8210e131a8c 2026-05-06 19:43:05,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:43:05,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f6bc0573a8210e131a8c HTTP/1.1" 200 None 2026-05-06 19:43:05,992 - lava_callback - DEBUG - Processing node 69f8f6bc0573a8210e131a8c: baseline-arm-baylibre 2026-05-06 19:43:05,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f6bc0573a8210e131a8c 2026-05-06 19:43:05,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:43:06,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f6bc0573a8210e131a8c HTTP/1.1" 200 None 2026-05-06 19:43:06,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:43:06,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:43:06,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:43:06,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f6bc0573a8210e131a8c HTTP/1.1" 200 None 2026-05-06 19:43:06,063 - lava_callback - ERROR - Error processing callback for node 69f8f6bc0573a8210e131a8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37590 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:44:06,773 - lava_callback - INFO - Received callback for node 69f8f6f30573a8210e131a9f INFO: 172.21.0.1:37594 - "POST /node/69f8f6f30573a8210e131a9f HTTP/1.0" 202 Accepted 2026-05-06 19:44:06,778 - lava_callback - INFO - Starting async job submit for node 69f8f6f30573a8210e131a9f 2026-05-06 19:44:06,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:44:06,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f6f30573a8210e131a9f HTTP/1.1" 200 None 2026-05-06 19:44:06,794 - lava_callback - DEBUG - Processing node 69f8f6f30573a8210e131a9f: baseline-arm64-clabbe 2026-05-06 19:44:06,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f6f30573a8210e131a9f 2026-05-06 19:44:06,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:44:06,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f6f30573a8210e131a9f HTTP/1.1" 200 None 2026-05-06 19:44:06,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:44:06,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:44:06,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:44:06,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f6f30573a8210e131a9f HTTP/1.1" 200 None 2026-05-06 19:44:06,856 - lava_callback - ERROR - Error processing callback for node 69f8f6f30573a8210e131a9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46708 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:45:06,026 - lava_callback - INFO - Received callback for node 69f8f7360573a8210e131abb INFO: 172.21.0.1:42468 - "POST /node/69f8f7360573a8210e131abb HTTP/1.0" 202 Accepted 2026-05-06 19:45:06,032 - lava_callback - INFO - Starting async job submit for node 69f8f7360573a8210e131abb 2026-05-06 19:45:06,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:45:06,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f7360573a8210e131abb HTTP/1.1" 200 None 2026-05-06 19:45:06,047 - lava_callback - DEBUG - Processing node 69f8f7360573a8210e131abb: baseline-arm-baylibre 2026-05-06 19:45:06,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f7360573a8210e131abb 2026-05-06 19:45:06,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:45:06,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f7360573a8210e131abb HTTP/1.1" 200 None 2026-05-06 19:45:06,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:45:06,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-06 19:45:06,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:45:06,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f7360573a8210e131abb HTTP/1.1" 200 None 2026-05-06 19:45:06,098 - lava_callback - ERROR - Error processing callback for node 69f8f7360573a8210e131abb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:45:46,014 - lava_callback - INFO - Received callback for node 69f8f75d0573a8210e131acd INFO: 172.21.0.1:42236 - "POST /node/69f8f75d0573a8210e131acd HTTP/1.0" 202 Accepted 2026-05-06 19:45:46,020 - lava_callback - INFO - Starting async job submit for node 69f8f75d0573a8210e131acd 2026-05-06 19:45:46,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:45:46,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f75d0573a8210e131acd HTTP/1.1" 200 None 2026-05-06 19:45:46,035 - lava_callback - DEBUG - Processing node 69f8f75d0573a8210e131acd: baseline-arm-baylibre 2026-05-06 19:45:46,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f75d0573a8210e131acd 2026-05-06 19:45:46,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:45:46,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f75d0573a8210e131acd HTTP/1.1" 200 None 2026-05-06 19:45:46,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:45:46,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-06 19:45:46,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:45:46,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f75d0573a8210e131acd HTTP/1.1" 200 None 2026-05-06 19:45:46,088 - lava_callback - ERROR - Error processing callback for node 69f8f75d0573a8210e131acd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:46:26,933 - lava_callback - INFO - Received callback for node 69f8f7860573a8210e131ad8 INFO: 172.21.0.1:38112 - "POST /node/69f8f7860573a8210e131ad8 HTTP/1.0" 202 Accepted 2026-05-06 19:46:26,939 - lava_callback - INFO - Starting async job submit for node 69f8f7860573a8210e131ad8 2026-05-06 19:46:26,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:46:26,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f7860573a8210e131ad8 HTTP/1.1" 200 None 2026-05-06 19:46:26,979 - lava_callback - DEBUG - Processing node 69f8f7860573a8210e131ad8: baseline-arm-clabbe 2026-05-06 19:46:26,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f7860573a8210e131ad8 2026-05-06 19:46:26,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:46:26,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f7860573a8210e131ad8 HTTP/1.1" 200 None 2026-05-06 19:46:26,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:46:27,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:46:27,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:46:27,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f7860573a8210e131ad8 HTTP/1.1" 200 None 2026-05-06 19:46:27,033 - lava_callback - ERROR - Error processing callback for node 69f8f7860573a8210e131ad8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:47:46,923 - lava_callback - INFO - Received callback for node 69f8f7d40573a8210e131af2 INFO: 172.21.0.1:52902 - "POST /node/69f8f7d40573a8210e131af2 HTTP/1.0" 202 Accepted 2026-05-06 19:47:46,929 - lava_callback - INFO - Starting async job submit for node 69f8f7d40573a8210e131af2 2026-05-06 19:47:46,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:47:46,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f7d40573a8210e131af2 HTTP/1.1" 200 None 2026-05-06 19:47:46,945 - lava_callback - DEBUG - Processing node 69f8f7d40573a8210e131af2: baseline-arm-clabbe 2026-05-06 19:47:46,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f7d40573a8210e131af2 2026-05-06 19:47:46,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:47:46,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f7d40573a8210e131af2 HTTP/1.1" 200 None 2026-05-06 19:47:46,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:47:46,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:47:46,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:47:47,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f7d40573a8210e131af2 HTTP/1.1" 200 None 2026-05-06 19:47:47,011 - lava_callback - ERROR - Error processing callback for node 69f8f7d40573a8210e131af2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:49:07,054 - lava_callback - INFO - Received callback for node 69f8f8230573a8210e131b09 INFO: 172.21.0.1:44846 - "POST /node/69f8f8230573a8210e131b09 HTTP/1.0" 202 Accepted 2026-05-06 19:49:07,060 - lava_callback - INFO - Starting async job submit for node 69f8f8230573a8210e131b09 2026-05-06 19:49:07,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:49:07,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f8230573a8210e131b09 HTTP/1.1" 200 None 2026-05-06 19:49:07,075 - lava_callback - DEBUG - Processing node 69f8f8230573a8210e131b09: baseline-arm-clabbe 2026-05-06 19:49:07,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f8230573a8210e131b09 2026-05-06 19:49:07,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:49:07,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f8230573a8210e131b09 HTTP/1.1" 200 None 2026-05-06 19:49:07,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:49:07,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:49:07,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:49:07,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f8230573a8210e131b09 HTTP/1.1" 200 None 2026-05-06 19:49:07,121 - lava_callback - ERROR - Error processing callback for node 69f8f8230573a8210e131b09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60166 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:49:46,995 - lava_callback - INFO - Received callback for node 69f8f84a0573a8210e131b1a INFO: 172.21.0.1:60168 - "POST /node/69f8f84a0573a8210e131b1a HTTP/1.0" 202 Accepted 2026-05-06 19:49:47,000 - lava_callback - INFO - Starting async job submit for node 69f8f84a0573a8210e131b1a 2026-05-06 19:49:47,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:49:47,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f84a0573a8210e131b1a HTTP/1.1" 200 None 2026-05-06 19:49:47,016 - lava_callback - DEBUG - Processing node 69f8f84a0573a8210e131b1a: baseline-arm-clabbe 2026-05-06 19:49:47,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f84a0573a8210e131b1a 2026-05-06 19:49:47,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:49:47,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f84a0573a8210e131b1a HTTP/1.1" 200 None 2026-05-06 19:49:47,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:49:47,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-06 19:49:47,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:49:47,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f84a0573a8210e131b1a HTTP/1.1" 200 None 2026-05-06 19:49:47,071 - lava_callback - ERROR - Error processing callback for node 69f8f84a0573a8210e131b1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39292 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:50:27,093 - lava_callback - INFO - Received callback for node 69f8f8720573a8210e131b24 INFO: 172.21.0.1:39306 - "POST /node/69f8f8720573a8210e131b24 HTTP/1.0" 202 Accepted 2026-05-06 19:50:27,099 - lava_callback - INFO - Starting async job submit for node 69f8f8720573a8210e131b24 2026-05-06 19:50:27,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:50:27,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f8720573a8210e131b24 HTTP/1.1" 200 None 2026-05-06 19:50:27,115 - lava_callback - DEBUG - Processing node 69f8f8720573a8210e131b24: baseline-arm-clabbe 2026-05-06 19:50:27,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f8720573a8210e131b24 2026-05-06 19:50:27,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:50:27,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f8720573a8210e131b24 HTTP/1.1" 200 None 2026-05-06 19:50:27,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:50:27,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-06 19:50:27,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:50:27,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f8720573a8210e131b24 HTTP/1.1" 200 None 2026-05-06 19:50:27,170 - lava_callback - ERROR - Error processing callback for node 69f8f8720573a8210e131b24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:51:07,036 - lava_callback - INFO - Received callback for node 69f8f8a70573a8210e131b39 INFO: 172.21.0.1:47716 - "POST /node/69f8f8a70573a8210e131b39 HTTP/1.0" 202 Accepted 2026-05-06 19:51:07,042 - lava_callback - INFO - Starting async job submit for node 69f8f8a70573a8210e131b39 2026-05-06 19:51:07,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:51:07,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f8a70573a8210e131b39 HTTP/1.1" 200 None 2026-05-06 19:51:07,058 - lava_callback - DEBUG - Processing node 69f8f8a70573a8210e131b39: baseline-arm64-clabbe 2026-05-06 19:51:07,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f8a70573a8210e131b39 2026-05-06 19:51:07,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:51:07,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f8a70573a8210e131b39 HTTP/1.1" 200 None 2026-05-06 19:51:07,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:51:07,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:51:07,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:51:07,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f8a70573a8210e131b39 HTTP/1.1" 200 None 2026-05-06 19:51:07,126 - lava_callback - ERROR - Error processing callback for node 69f8f8a70573a8210e131b39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:52:27,146 - lava_callback - INFO - Received callback for node 69f8f8ec0573a8210e131b52 INFO: 172.21.0.1:50796 - "POST /node/69f8f8ec0573a8210e131b52 HTTP/1.0" 202 Accepted 2026-05-06 19:52:27,154 - lava_callback - INFO - Starting async job submit for node 69f8f8ec0573a8210e131b52 2026-05-06 19:52:27,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:52:27,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f8ec0573a8210e131b52 HTTP/1.1" 200 None 2026-05-06 19:52:27,192 - lava_callback - DEBUG - Processing node 69f8f8ec0573a8210e131b52: baseline-arm-clabbe 2026-05-06 19:52:27,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f8ec0573a8210e131b52 2026-05-06 19:52:27,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:52:27,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f8ec0573a8210e131b52 HTTP/1.1" 200 None 2026-05-06 19:52:27,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:52:27,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-06 19:52:27,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:52:27,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f8ec0573a8210e131b52 HTTP/1.1" 200 None 2026-05-06 19:52:27,254 - lava_callback - ERROR - Error processing callback for node 69f8f8ec0573a8210e131b52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:53:07,123 - lava_callback - INFO - Received callback for node 69f8f9140573a8210e131b5e INFO: 172.21.0.1:60426 - "POST /node/69f8f9140573a8210e131b5e HTTP/1.0" 202 Accepted 2026-05-06 19:53:07,129 - lava_callback - INFO - Starting async job submit for node 69f8f9140573a8210e131b5e 2026-05-06 19:53:07,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:07,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f9140573a8210e131b5e HTTP/1.1" 200 None 2026-05-06 19:53:07,146 - lava_callback - DEBUG - Processing node 69f8f9140573a8210e131b5e: baseline-arm-clabbe 2026-05-06 19:53:07,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f9140573a8210e131b5e 2026-05-06 19:53:07,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:07,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f9140573a8210e131b5e HTTP/1.1" 200 None 2026-05-06 19:53:07,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:07,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:53:07,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:07,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f9140573a8210e131b5e HTTP/1.1" 200 None 2026-05-06 19:53:07,196 - lava_callback - ERROR - Error processing callback for node 69f8f9140573a8210e131b5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:53:21,940 - lava_callback - INFO - Received callback for node 69fb9bafdf29cd80ecaa3b13 INFO: 172.21.0.1:60114 - "POST /node/69fb9bafdf29cd80ecaa3b13 HTTP/1.0" 202 Accepted 2026-05-06 19:53:21,946 - lava_callback - INFO - Starting async job submit for node 69fb9bafdf29cd80ecaa3b13 2026-05-06 19:53:21,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:21,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9bafdf29cd80ecaa3b13 HTTP/1.1" 200 None 2026-05-06 19:53:21,982 - lava_callback - DEBUG - Processing node 69fb9bafdf29cd80ecaa3b13: baseline-arm 2026-05-06 19:53:22,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 19:53:22,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 19:53:22,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fb9bafdf29cd80ecaa3b13/log.txt.gz 2026-05-06 19:53:22,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 19:53:22,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 19:53:22,482 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fb9bafdf29cd80ecaa3b13/lava-logs.yaml 2026-05-06 19:53:22,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 19:53:22,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 19:53:22,581 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fb9bafdf29cd80ecaa3b13/lava_callback.json.gz 2026-05-06 19:53:22,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:22,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9bafdf29cd80ecaa3b13 HTTP/1.1" 200 None 2026-05-06 19:53:22,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:22,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a63df29cd80ecaa02a8 HTTP/1.1" 200 None 2026-05-06 19:53:22,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:22,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb9bafdf29cd80ecaa3b13 HTTP/1.1" 200 None 2026-05-06 19:53:22,656 - lava_callback - INFO - Completed processing callback for node 69fb9bafdf29cd80ecaa3b13 2026-05-06 19:53:26,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:26,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:53:47,207 - lava_callback - INFO - Received callback for node 69f8f93b0573a8210e131b6d INFO: 172.21.0.1:53334 - "POST /node/69f8f93b0573a8210e131b6d HTTP/1.0" 202 Accepted 2026-05-06 19:53:47,212 - lava_callback - INFO - Starting async job submit for node 69f8f93b0573a8210e131b6d 2026-05-06 19:53:47,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:47,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f93b0573a8210e131b6d HTTP/1.1" 200 None 2026-05-06 19:53:47,228 - lava_callback - DEBUG - Processing node 69f8f93b0573a8210e131b6d: baseline-arm-clabbe 2026-05-06 19:53:47,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f93b0573a8210e131b6d 2026-05-06 19:53:47,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:47,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f93b0573a8210e131b6d HTTP/1.1" 200 None 2026-05-06 19:53:47,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:47,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-06 19:53:47,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:53:47,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f93b0573a8210e131b6d HTTP/1.1" 200 None 2026-05-06 19:53:47,279 - lava_callback - ERROR - Error processing callback for node 69f8f93b0573a8210e131b6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39472 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:54:47,247 - lava_callback - INFO - Received callback for node 69f8f9710573a8210e131b79 INFO: 172.21.0.1:39474 - "POST /node/69f8f9710573a8210e131b79 HTTP/1.0" 202 Accepted 2026-05-06 19:54:47,253 - lava_callback - INFO - Starting async job submit for node 69f8f9710573a8210e131b79 2026-05-06 19:54:47,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:54:47,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f9710573a8210e131b79 HTTP/1.1" 200 None 2026-05-06 19:54:47,268 - lava_callback - DEBUG - Processing node 69f8f9710573a8210e131b79: baseline-arm64-clabbe 2026-05-06 19:54:47,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f9710573a8210e131b79 2026-05-06 19:54:47,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:54:47,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f9710573a8210e131b79 HTTP/1.1" 200 None 2026-05-06 19:54:47,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:54:47,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:54:47,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:54:47,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f9710573a8210e131b79 HTTP/1.1" 200 None 2026-05-06 19:54:47,318 - lava_callback - ERROR - Error processing callback for node 69f8f9710573a8210e131b79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:55:47,339 - lava_callback - INFO - Received callback for node 69f8f9b60573a8210e131b9d INFO: 172.21.0.1:41336 - "POST /node/69f8f9b60573a8210e131b9d HTTP/1.0" 202 Accepted 2026-05-06 19:55:47,345 - lava_callback - INFO - Starting async job submit for node 69f8f9b60573a8210e131b9d 2026-05-06 19:55:47,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:55:47,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f9b60573a8210e131b9d HTTP/1.1" 200 None 2026-05-06 19:55:47,361 - lava_callback - DEBUG - Processing node 69f8f9b60573a8210e131b9d: baseline-arm-clabbe 2026-05-06 19:55:47,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f9b60573a8210e131b9d 2026-05-06 19:55:47,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:55:47,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f9b60573a8210e131b9d HTTP/1.1" 200 None 2026-05-06 19:55:47,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:55:47,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-06 19:55:47,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:55:47,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f9b60573a8210e131b9d HTTP/1.1" 200 None 2026-05-06 19:55:47,424 - lava_callback - ERROR - Error processing callback for node 69f8f9b60573a8210e131b9d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:56:27,291 - lava_callback - INFO - Received callback for node 69f8f9dd0573a8210e131baa INFO: 172.21.0.1:36620 - "POST /node/69f8f9dd0573a8210e131baa HTTP/1.0" 202 Accepted 2026-05-06 19:56:27,297 - lava_callback - INFO - Starting async job submit for node 69f8f9dd0573a8210e131baa 2026-05-06 19:56:27,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:56:27,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f9dd0573a8210e131baa HTTP/1.1" 200 None 2026-05-06 19:56:27,322 - lava_callback - DEBUG - Processing node 69f8f9dd0573a8210e131baa: baseline-arm-clabbe 2026-05-06 19:56:27,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8f9dd0573a8210e131baa 2026-05-06 19:56:27,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:56:27,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f9dd0573a8210e131baa HTTP/1.1" 200 None 2026-05-06 19:56:27,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:56:27,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:56:27,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:56:27,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f9dd0573a8210e131baa HTTP/1.1" 200 None 2026-05-06 19:56:27,371 - lava_callback - ERROR - Error processing callback for node 69f8f9dd0573a8210e131baa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:58:07,352 - lava_callback - INFO - Received callback for node 69f8fa400573a8210e131bbf INFO: 172.21.0.1:60508 - "POST /node/69f8fa400573a8210e131bbf HTTP/1.0" 202 Accepted 2026-05-06 19:58:07,357 - lava_callback - INFO - Starting async job submit for node 69f8fa400573a8210e131bbf 2026-05-06 19:58:07,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:58:07,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fa400573a8210e131bbf HTTP/1.1" 200 None 2026-05-06 19:58:07,397 - lava_callback - DEBUG - Processing node 69f8fa400573a8210e131bbf: baseline-arm-clabbe 2026-05-06 19:58:07,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8fa400573a8210e131bbf 2026-05-06 19:58:07,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:58:07,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fa400573a8210e131bbf HTTP/1.1" 200 None 2026-05-06 19:58:07,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:58:07,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 19:58:07,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:58:07,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8fa400573a8210e131bbf HTTP/1.1" 200 None 2026-05-06 19:58:07,484 - lava_callback - ERROR - Error processing callback for node 69f8fa400573a8210e131bbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57568 - "GET / HTTP/1.0" 200 OK 2026-05-06 19:59:07,429 - lava_callback - INFO - Received callback for node 69f8fa760573a8210e131bd4 INFO: 172.21.0.1:57572 - "POST /node/69f8fa760573a8210e131bd4 HTTP/1.0" 202 Accepted 2026-05-06 19:59:07,435 - lava_callback - INFO - Starting async job submit for node 69f8fa760573a8210e131bd4 2026-05-06 19:59:07,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:59:07,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fa760573a8210e131bd4 HTTP/1.1" 200 None 2026-05-06 19:59:07,450 - lava_callback - DEBUG - Processing node 69f8fa760573a8210e131bd4: baseline-arm64-clabbe 2026-05-06 19:59:07,451 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8fa760573a8210e131bd4 2026-05-06 19:59:07,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:59:07,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fa760573a8210e131bd4 HTTP/1.1" 200 None 2026-05-06 19:59:07,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:59:07,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 19:59:07,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 19:59:07,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8fa760573a8210e131bd4 HTTP/1.1" 200 None 2026-05-06 19:59:07,544 - lava_callback - ERROR - Error processing callback for node 69f8fa760573a8210e131bd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53192 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:01:47,590 - lava_callback - INFO - Received callback for node 69f8fb1c0573a8210e131c1e INFO: 172.21.0.1:53202 - "POST /node/69f8fb1c0573a8210e131c1e HTTP/1.0" 202 Accepted 2026-05-06 20:01:47,595 - lava_callback - INFO - Starting async job submit for node 69f8fb1c0573a8210e131c1e 2026-05-06 20:01:47,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:01:47,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fb1c0573a8210e131c1e HTTP/1.1" 200 None 2026-05-06 20:01:47,633 - lava_callback - DEBUG - Processing node 69f8fb1c0573a8210e131c1e: baseline-arm64-clabbe 2026-05-06 20:01:47,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8fb1c0573a8210e131c1e 2026-05-06 20:01:47,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:01:47,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fb1c0573a8210e131c1e HTTP/1.1" 200 None 2026-05-06 20:01:47,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:01:47,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 20:01:47,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:01:47,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8fb1c0573a8210e131c1e HTTP/1.1" 200 None 2026-05-06 20:01:47,725 - lava_callback - ERROR - Error processing callback for node 69f8fb1c0573a8210e131c1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38184 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:03:07,650 - lava_callback - INFO - Received callback for node 69f8fb6f0573a8210e131c38 INFO: 172.21.0.1:38190 - "POST /node/69f8fb6f0573a8210e131c38 HTTP/1.0" 202 Accepted 2026-05-06 20:03:07,656 - lava_callback - INFO - Starting async job submit for node 69f8fb6f0573a8210e131c38 2026-05-06 20:03:07,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:03:07,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fb6f0573a8210e131c38 HTTP/1.1" 200 None 2026-05-06 20:03:07,671 - lava_callback - DEBUG - Processing node 69f8fb6f0573a8210e131c38: baseline-arm64-clabbe 2026-05-06 20:03:07,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8fb6f0573a8210e131c38 2026-05-06 20:03:07,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:03:07,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fb6f0573a8210e131c38 HTTP/1.1" 200 None 2026-05-06 20:03:07,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:03:07,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-06 20:03:07,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:03:07,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8fb6f0573a8210e131c38 HTTP/1.1" 200 None 2026-05-06 20:03:07,729 - lava_callback - ERROR - Error processing callback for node 69f8fb6f0573a8210e131c38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:04:27,652 - lava_callback - INFO - Received callback for node 69f8fbb50573a8210e131c5b INFO: 172.21.0.1:38206 - "POST /node/69f8fbb50573a8210e131c5b HTTP/1.0" 202 Accepted 2026-05-06 20:04:27,657 - lava_callback - INFO - Starting async job submit for node 69f8fbb50573a8210e131c5b 2026-05-06 20:04:27,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:04:27,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fbb50573a8210e131c5b HTTP/1.1" 200 None 2026-05-06 20:04:27,681 - lava_callback - DEBUG - Processing node 69f8fbb50573a8210e131c5b: baseline-arm-clabbe 2026-05-06 20:04:27,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8fbb50573a8210e131c5b 2026-05-06 20:04:27,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:04:27,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fbb50573a8210e131c5b HTTP/1.1" 200 None 2026-05-06 20:04:27,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:04:27,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 20:04:27,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:04:27,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8fbb50573a8210e131c5b HTTP/1.1" 200 None 2026-05-06 20:04:27,775 - lava_callback - ERROR - Error processing callback for node 69f8fbb50573a8210e131c5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39304 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:05:07,751 - lava_callback - INFO - Received callback for node 69f8fbdd0573a8210e131c67 INFO: 172.21.0.1:39318 - "POST /node/69f8fbdd0573a8210e131c67 HTTP/1.0" 202 Accepted 2026-05-06 20:05:07,757 - lava_callback - INFO - Starting async job submit for node 69f8fbdd0573a8210e131c67 2026-05-06 20:05:07,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:05:07,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fbdd0573a8210e131c67 HTTP/1.1" 200 None 2026-05-06 20:05:07,772 - lava_callback - DEBUG - Processing node 69f8fbdd0573a8210e131c67: baseline-arm-clabbe 2026-05-06 20:05:07,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8fbdd0573a8210e131c67 2026-05-06 20:05:07,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:05:07,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fbdd0573a8210e131c67 HTTP/1.1" 200 None 2026-05-06 20:05:07,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:05:07,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 20:05:07,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:05:07,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8fbdd0573a8210e131c67 HTTP/1.1" 200 None 2026-05-06 20:05:07,837 - lava_callback - ERROR - Error processing callback for node 69f8fbdd0573a8210e131c67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:05:27,739 - lava_callback - INFO - Received callback for node 69f8fc040573a8210e131c75 INFO: 172.21.0.1:59524 - "POST /node/69f8fc040573a8210e131c75 HTTP/1.0" 202 Accepted 2026-05-06 20:05:27,748 - lava_callback - INFO - Starting async job submit for node 69f8fc040573a8210e131c75 2026-05-06 20:05:27,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:05:27,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fc040573a8210e131c75 HTTP/1.1" 200 None 2026-05-06 20:05:27,764 - lava_callback - DEBUG - Processing node 69f8fc040573a8210e131c75: baseline-arm-clabbe 2026-05-06 20:05:27,764 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8fc040573a8210e131c75 2026-05-06 20:05:27,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:05:27,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fc040573a8210e131c75 HTTP/1.1" 200 None 2026-05-06 20:05:27,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:05:27,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 20:05:27,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:05:27,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8fc040573a8210e131c75 HTTP/1.1" 200 None 2026-05-06 20:05:27,824 - lava_callback - ERROR - Error processing callback for node 69f8fc040573a8210e131c75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:06:07,735 - lava_callback - INFO - Received callback for node 69f8fc2b0573a8210e131c82 INFO: 172.21.0.1:33464 - "POST /node/69f8fc2b0573a8210e131c82 HTTP/1.0" 202 Accepted 2026-05-06 20:06:07,741 - lava_callback - INFO - Starting async job submit for node 69f8fc2b0573a8210e131c82 2026-05-06 20:06:07,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:06:07,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fc2b0573a8210e131c82 HTTP/1.1" 200 None 2026-05-06 20:06:07,759 - lava_callback - DEBUG - Processing node 69f8fc2b0573a8210e131c82: baseline-arm-clabbe 2026-05-06 20:06:07,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8fc2b0573a8210e131c82 2026-05-06 20:06:07,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:06:07,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fc2b0573a8210e131c82 HTTP/1.1" 200 None 2026-05-06 20:06:07,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:06:07,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 20:06:07,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:06:07,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8fc2b0573a8210e131c82 HTTP/1.1" 200 None 2026-05-06 20:06:07,806 - lava_callback - ERROR - Error processing callback for node 69f8fc2b0573a8210e131c82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:06:47,745 - lava_callback - INFO - Received callback for node 69f8fc520573a8210e131c8e INFO: 172.21.0.1:43878 - "POST /node/69f8fc520573a8210e131c8e HTTP/1.0" 202 Accepted 2026-05-06 20:06:47,750 - lava_callback - INFO - Starting async job submit for node 69f8fc520573a8210e131c8e 2026-05-06 20:06:47,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:06:47,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fc520573a8210e131c8e HTTP/1.1" 200 None 2026-05-06 20:06:47,765 - lava_callback - DEBUG - Processing node 69f8fc520573a8210e131c8e: baseline-arm-clabbe 2026-05-06 20:06:47,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8fc520573a8210e131c8e 2026-05-06 20:06:47,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:06:47,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8fc520573a8210e131c8e HTTP/1.1" 200 None 2026-05-06 20:06:47,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:06:47,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-06 20:06:47,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:06:47,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8fc520573a8210e131c8e HTTP/1.1" 200 None 2026-05-06 20:06:47,842 - lava_callback - ERROR - Error processing callback for node 69f8fc520573a8210e131c8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:13:03,157 - lava_callback - INFO - Received callback for node 69fb9bb0df29cd80ecaa3b16 INFO: 172.21.0.1:45514 - "POST /node/69fb9bb0df29cd80ecaa3b16 HTTP/1.0" 202 Accepted 2026-05-06 20:13:03,164 - lava_callback - INFO - Starting async job submit for node 69fb9bb0df29cd80ecaa3b16 2026-05-06 20:13:03,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:13:03,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9bb0df29cd80ecaa3b16 HTTP/1.1" 200 None 2026-05-06 20:13:03,244 - lava_callback - DEBUG - Processing node 69fb9bb0df29cd80ecaa3b16: ltp-smoke 2026-05-06 20:13:03,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 20:13:03,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 20:13:03,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fb9bb0df29cd80ecaa3b16/log.txt.gz 2026-05-06 20:13:04,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 20:13:04,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 20:13:04,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fb9bb0df29cd80ecaa3b16/lava-logs.yaml 2026-05-06 20:13:04,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 20:13:04,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 20:13:04,568 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fb9bb0df29cd80ecaa3b16/lava_callback.json.gz 2026-05-06 20:13:04,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:13:04,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9bb0df29cd80ecaa3b16 HTTP/1.1" 200 None 2026-05-06 20:13:04,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:13:04,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a63df29cd80ecaa02a8 HTTP/1.1" 200 None 2026-05-06 20:13:04,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:13:04,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb9bb0df29cd80ecaa3b16 HTTP/1.1" 200 None 2026-05-06 20:13:04,954 - lava_callback - INFO - Completed processing callback for node 69fb9bb0df29cd80ecaa3b16 INFO: 172.21.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:13:26,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:13:26,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:20:27,965 - lava_callback - INFO - Received callback for node 69f8ff870573a8210e131d46 INFO: 172.21.0.1:57494 - "POST /node/69f8ff870573a8210e131d46 HTTP/1.0" 202 Accepted 2026-05-06 20:20:27,971 - lava_callback - INFO - Starting async job submit for node 69f8ff870573a8210e131d46 2026-05-06 20:20:27,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:20:27,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ff870573a8210e131d46 HTTP/1.1" 200 None 2026-05-06 20:20:27,986 - lava_callback - DEBUG - Processing node 69f8ff870573a8210e131d46: baseline-arm64-baylibre 2026-05-06 20:20:27,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f8ff870573a8210e131d46 2026-05-06 20:20:27,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:20:27,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ff870573a8210e131d46 HTTP/1.1" 200 None 2026-05-06 20:20:28,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:20:28,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-06 20:20:28,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:20:28,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ff870573a8210e131d46 HTTP/1.1" 200 None 2026-05-06 20:20:28,032 - lava_callback - ERROR - Error processing callback for node 69f8ff870573a8210e131d46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46988 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:23:28,080 - lava_callback - INFO - Received callback for node 69f9003c0573a8210e131d6b INFO: 172.21.0.1:46990 - "POST /node/69f9003c0573a8210e131d6b HTTP/1.0" 202 Accepted 2026-05-06 20:23:28,086 - lava_callback - INFO - Starting async job submit for node 69f9003c0573a8210e131d6b 2026-05-06 20:23:28,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:23:28,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9003c0573a8210e131d6b HTTP/1.1" 200 None 2026-05-06 20:23:28,103 - lava_callback - DEBUG - Processing node 69f9003c0573a8210e131d6b: baseline-arm64-baylibre 2026-05-06 20:23:28,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9003c0573a8210e131d6b 2026-05-06 20:23:28,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:23:28,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9003c0573a8210e131d6b HTTP/1.1" 200 None 2026-05-06 20:23:28,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:23:28,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-06 20:23:28,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:23:28,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9003c0573a8210e131d6b HTTP/1.1" 200 None 2026-05-06 20:23:28,155 - lava_callback - ERROR - Error processing callback for node 69f9003c0573a8210e131d6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55416 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:25:08,134 - lava_callback - INFO - Received callback for node 69f900950573a8210e131d8d INFO: 172.21.0.1:55428 - "POST /node/69f900950573a8210e131d8d HTTP/1.0" 202 Accepted 2026-05-06 20:25:08,139 - lava_callback - INFO - Starting async job submit for node 69f900950573a8210e131d8d 2026-05-06 20:25:08,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:25:08,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f900950573a8210e131d8d HTTP/1.1" 200 None 2026-05-06 20:25:08,154 - lava_callback - DEBUG - Processing node 69f900950573a8210e131d8d: baseline-arm64-baylibre 2026-05-06 20:25:08,155 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f900950573a8210e131d8d 2026-05-06 20:25:08,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:25:08,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f900950573a8210e131d8d HTTP/1.1" 200 None 2026-05-06 20:25:08,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:25:08,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-06 20:25:08,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:25:08,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f900950573a8210e131d8d HTTP/1.1" 200 None 2026-05-06 20:25:08,200 - lava_callback - ERROR - Error processing callback for node 69f900950573a8210e131d8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49000 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:26:28,222 - lava_callback - INFO - Received callback for node 69f900f20573a8210e131daf INFO: 172.21.0.1:49016 - "POST /node/69f900f20573a8210e131daf HTTP/1.0" 202 Accepted 2026-05-06 20:26:28,228 - lava_callback - INFO - Starting async job submit for node 69f900f20573a8210e131daf 2026-05-06 20:26:28,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:26:28,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f900f20573a8210e131daf HTTP/1.1" 200 None 2026-05-06 20:26:28,254 - lava_callback - DEBUG - Processing node 69f900f20573a8210e131daf: baseline-arm64-baylibre 2026-05-06 20:26:28,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f900f20573a8210e131daf 2026-05-06 20:26:28,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:26:28,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f900f20573a8210e131daf HTTP/1.1" 200 None 2026-05-06 20:26:28,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:26:28,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-06 20:26:28,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:26:28,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f900f20573a8210e131daf HTTP/1.1" 200 None 2026-05-06 20:26:28,301 - lava_callback - ERROR - Error processing callback for node 69f900f20573a8210e131daf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:29:28,393 - lava_callback - INFO - Received callback for node 69f901a60573a8210e131dd4 INFO: 172.21.0.1:55414 - "POST /node/69f901a60573a8210e131dd4 HTTP/1.0" 202 Accepted 2026-05-06 20:29:28,399 - lava_callback - INFO - Starting async job submit for node 69f901a60573a8210e131dd4 2026-05-06 20:29:28,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:29:28,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f901a60573a8210e131dd4 HTTP/1.1" 200 None 2026-05-06 20:29:28,416 - lava_callback - DEBUG - Processing node 69f901a60573a8210e131dd4: baseline-arm64-baylibre 2026-05-06 20:29:28,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f901a60573a8210e131dd4 2026-05-06 20:29:28,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:29:28,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f901a60573a8210e131dd4 HTTP/1.1" 200 None 2026-05-06 20:29:28,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:29:28,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-06 20:29:28,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:29:28,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f901a60573a8210e131dd4 HTTP/1.1" 200 None 2026-05-06 20:29:28,479 - lava_callback - ERROR - Error processing callback for node 69f901a60573a8210e131dd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:30:43,954 - lava_callback - INFO - Received callback for node 69fba0d2df29cd80ecaa3b40 INFO: 172.21.0.1:59878 - "POST /node/69fba0d2df29cd80ecaa3b40 HTTP/1.0" 202 Accepted 2026-05-06 20:30:43,961 - lava_callback - INFO - Starting async job submit for node 69fba0d2df29cd80ecaa3b40 2026-05-06 20:30:44,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:30:44,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba0d2df29cd80ecaa3b40 HTTP/1.1" 200 None 2026-05-06 20:30:44,033 - lava_callback - DEBUG - Processing node 69fba0d2df29cd80ecaa3b40: ltp-smoke 2026-05-06 20:30:44,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 20:30:44,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 20:30:44,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fba0d2df29cd80ecaa3b40/log.txt.gz 2026-05-06 20:30:45,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 20:30:45,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 20:30:45,225 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fba0d2df29cd80ecaa3b40/lava-logs.yaml 2026-05-06 20:30:45,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 20:30:45,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 20:30:45,531 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fba0d2df29cd80ecaa3b40/lava_callback.json.gz 2026-05-06 20:30:45,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:30:45,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba0d2df29cd80ecaa3b40 HTTP/1.1" 200 None 2026-05-06 20:30:45,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:30:45,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a63df29cd80ecaa02a8 HTTP/1.1" 200 None 2026-05-06 20:30:45,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:30:45,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba0d2df29cd80ecaa3b40 HTTP/1.1" 200 None 2026-05-06 20:30:45,869 - lava_callback - INFO - Completed processing callback for node 69fba0d2df29cd80ecaa3b40 INFO: 172.21.0.1:59894 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:30:56,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:30:56,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:31:48,526 - lava_callback - INFO - Received callback for node 69f9021f0573a8210e131df9 INFO: 172.21.0.1:33270 - "POST /node/69f9021f0573a8210e131df9 HTTP/1.0" 202 Accepted 2026-05-06 20:31:48,531 - lava_callback - INFO - Starting async job submit for node 69f9021f0573a8210e131df9 2026-05-06 20:31:48,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:31:48,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9021f0573a8210e131df9 HTTP/1.1" 200 None 2026-05-06 20:31:48,546 - lava_callback - DEBUG - Processing node 69f9021f0573a8210e131df9: baseline-arm64-baylibre 2026-05-06 20:31:48,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9021f0573a8210e131df9 2026-05-06 20:31:48,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:31:48,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9021f0573a8210e131df9 HTTP/1.1" 200 None 2026-05-06 20:31:48,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:31:48,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-06 20:31:48,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:31:48,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9021f0573a8210e131df9 HTTP/1.1" 200 None 2026-05-06 20:31:48,602 - lava_callback - ERROR - Error processing callback for node 69f9021f0573a8210e131df9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:33:48,882 - lava_callback - INFO - Received callback for node 69f9029f0573a8210e131e23 INFO: 172.21.0.1:51494 - "POST /node/69f9029f0573a8210e131e23 HTTP/1.0" 202 Accepted 2026-05-06 20:33:48,887 - lava_callback - INFO - Starting async job submit for node 69f9029f0573a8210e131e23 2026-05-06 20:33:48,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:33:48,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9029f0573a8210e131e23 HTTP/1.1" 200 None 2026-05-06 20:33:48,907 - lava_callback - DEBUG - Processing node 69f9029f0573a8210e131e23: baseline-arm64-clabbe 2026-05-06 20:33:48,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9029f0573a8210e131e23 2026-05-06 20:33:48,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:33:48,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9029f0573a8210e131e23 HTTP/1.1" 200 None 2026-05-06 20:33:48,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:33:48,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-06 20:33:48,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:33:48,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9029f0573a8210e131e23 HTTP/1.1" 200 None 2026-05-06 20:33:48,951 - lava_callback - ERROR - Error processing callback for node 69f9029f0573a8210e131e23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34700 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:35:08,933 - lava_callback - INFO - Received callback for node 69f902f20573a8210e131e3d INFO: 172.21.0.1:34704 - "POST /node/69f902f20573a8210e131e3d HTTP/1.0" 202 Accepted 2026-05-06 20:35:08,938 - lava_callback - INFO - Starting async job submit for node 69f902f20573a8210e131e3d 2026-05-06 20:35:08,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:35:08,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f902f20573a8210e131e3d HTTP/1.1" 200 None 2026-05-06 20:35:08,962 - lava_callback - DEBUG - Processing node 69f902f20573a8210e131e3d: baseline-arm64-clabbe 2026-05-06 20:35:08,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f902f20573a8210e131e3d 2026-05-06 20:35:08,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:35:08,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f902f20573a8210e131e3d HTTP/1.1" 200 None 2026-05-06 20:35:08,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:35:08,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-06 20:35:08,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:35:09,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f902f20573a8210e131e3d HTTP/1.1" 200 None 2026-05-06 20:35:09,008 - lava_callback - ERROR - Error processing callback for node 69f902f20573a8210e131e3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:39:49,028 - lava_callback - INFO - Received callback for node 69f904070573a8210e131e6c INFO: 172.21.0.1:47482 - "POST /node/69f904070573a8210e131e6c HTTP/1.0" 202 Accepted 2026-05-06 20:39:49,034 - lava_callback - INFO - Starting async job submit for node 69f904070573a8210e131e6c 2026-05-06 20:39:49,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:39:49,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f904070573a8210e131e6c HTTP/1.1" 200 None 2026-05-06 20:39:49,057 - lava_callback - DEBUG - Processing node 69f904070573a8210e131e6c: baseline-arm64-clabbe 2026-05-06 20:39:49,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f904070573a8210e131e6c 2026-05-06 20:39:49,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:39:49,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f904070573a8210e131e6c HTTP/1.1" 200 None 2026-05-06 20:39:49,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:39:49,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-06 20:39:49,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:39:49,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f904070573a8210e131e6c HTTP/1.1" 200 None 2026-05-06 20:39:49,111 - lava_callback - ERROR - Error processing callback for node 69f904070573a8210e131e6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:41:49,111 - lava_callback - INFO - Received callback for node 69f9047e0573a8210e131e91 INFO: 172.21.0.1:53250 - "POST /node/69f9047e0573a8210e131e91 HTTP/1.0" 202 Accepted 2026-05-06 20:41:49,121 - lava_callback - INFO - Starting async job submit for node 69f9047e0573a8210e131e91 2026-05-06 20:41:49,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:41:49,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9047e0573a8210e131e91 HTTP/1.1" 200 None 2026-05-06 20:41:49,150 - lava_callback - DEBUG - Processing node 69f9047e0573a8210e131e91: baseline-arm64-clabbe 2026-05-06 20:41:49,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9047e0573a8210e131e91 2026-05-06 20:41:49,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:41:49,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9047e0573a8210e131e91 HTTP/1.1" 200 None 2026-05-06 20:41:49,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:41:49,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-06 20:41:49,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:41:49,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9047e0573a8210e131e91 HTTP/1.1" 200 None 2026-05-06 20:41:49,212 - lava_callback - ERROR - Error processing callback for node 69f9047e0573a8210e131e91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52548 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:44:49,248 - lava_callback - INFO - Received callback for node 69f905330573a8210e131eb5 INFO: 172.21.0.1:52560 - "POST /node/69f905330573a8210e131eb5 HTTP/1.0" 202 Accepted 2026-05-06 20:44:49,254 - lava_callback - INFO - Starting async job submit for node 69f905330573a8210e131eb5 2026-05-06 20:44:49,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:44:49,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f905330573a8210e131eb5 HTTP/1.1" 200 None 2026-05-06 20:44:49,275 - lava_callback - DEBUG - Processing node 69f905330573a8210e131eb5: baseline-arm64-clabbe 2026-05-06 20:44:49,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f905330573a8210e131eb5 2026-05-06 20:44:49,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:44:49,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f905330573a8210e131eb5 HTTP/1.1" 200 None 2026-05-06 20:44:49,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:44:49,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-06 20:44:49,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:44:49,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f905330573a8210e131eb5 HTTP/1.1" 200 None 2026-05-06 20:44:49,341 - lava_callback - ERROR - Error processing callback for node 69f905330573a8210e131eb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:47:49,320 - lava_callback - INFO - Received callback for node 69f905e70573a8210e131edb INFO: 172.21.0.1:41192 - "POST /node/69f905e70573a8210e131edb HTTP/1.0" 202 Accepted 2026-05-06 20:47:49,329 - lava_callback - INFO - Starting async job submit for node 69f905e70573a8210e131edb 2026-05-06 20:47:49,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:47:49,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f905e70573a8210e131edb HTTP/1.1" 200 None 2026-05-06 20:47:49,346 - lava_callback - DEBUG - Processing node 69f905e70573a8210e131edb: baseline-arm64-clabbe 2026-05-06 20:47:49,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f905e70573a8210e131edb 2026-05-06 20:47:49,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:47:49,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f905e70573a8210e131edb HTTP/1.1" 200 None 2026-05-06 20:47:49,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:47:49,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-06 20:47:49,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:47:49,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f905e70573a8210e131edb HTTP/1.1" 200 None 2026-05-06 20:47:49,403 - lava_callback - ERROR - Error processing callback for node 69f905e70573a8210e131edb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:48:44,226 - lava_callback - INFO - Received callback for node 69fba4f7df29cd80ecaa3b66 INFO: 172.21.0.1:41530 - "POST /node/69fba4f7df29cd80ecaa3b66 HTTP/1.0" 202 Accepted 2026-05-06 20:48:44,233 - lava_callback - INFO - Starting async job submit for node 69fba4f7df29cd80ecaa3b66 2026-05-06 20:48:44,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:48:44,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba4f7df29cd80ecaa3b66 HTTP/1.1" 200 None 2026-05-06 20:48:44,307 - lava_callback - DEBUG - Processing node 69fba4f7df29cd80ecaa3b66: ltp-smoke 2026-05-06 20:48:44,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 20:48:44,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 20:48:44,904 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fba4f7df29cd80ecaa3b66/log.txt.gz 2026-05-06 20:48:45,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 20:48:45,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 20:48:45,443 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fba4f7df29cd80ecaa3b66/lava-logs.yaml 2026-05-06 20:48:45,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 20:48:45,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 20:48:45,614 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fba4f7df29cd80ecaa3b66/lava_callback.json.gz 2026-05-06 20:48:45,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:48:45,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba4f7df29cd80ecaa3b66 HTTP/1.1" 200 None 2026-05-06 20:48:45,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:48:45,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a63df29cd80ecaa02a8 HTTP/1.1" 200 None 2026-05-06 20:48:45,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:48:45,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba4f7df29cd80ecaa3b66 HTTP/1.1" 200 None 2026-05-06 20:48:45,918 - lava_callback - INFO - Completed processing callback for node 69fba4f7df29cd80ecaa3b66 INFO: 172.21.0.1:41538 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:48:56,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:48:56,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:49:09,487 - lava_callback - INFO - Received callback for node 69f906380573a8210e131ef6 INFO: 172.21.0.1:60164 - "POST /node/69f906380573a8210e131ef6 HTTP/1.0" 202 Accepted 2026-05-06 20:49:09,492 - lava_callback - INFO - Starting async job submit for node 69f906380573a8210e131ef6 2026-05-06 20:49:09,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:49:09,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f906380573a8210e131ef6 HTTP/1.1" 200 None 2026-05-06 20:49:09,508 - lava_callback - DEBUG - Processing node 69f906380573a8210e131ef6: baseline-arm-baylibre 2026-05-06 20:49:09,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f906380573a8210e131ef6 2026-05-06 20:49:09,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:49:09,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f906380573a8210e131ef6 HTTP/1.1" 200 None 2026-05-06 20:49:09,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:49:09,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 20:49:09,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:49:09,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f906380573a8210e131ef6 HTTP/1.1" 200 None 2026-05-06 20:49:09,559 - lava_callback - ERROR - Error processing callback for node 69f906380573a8210e131ef6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41404 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:49:49,441 - lava_callback - INFO - Received callback for node 69f906600573a8210e131f03 INFO: 172.21.0.1:41410 - "POST /node/69f906600573a8210e131f03 HTTP/1.0" 202 Accepted 2026-05-06 20:49:49,449 - lava_callback - INFO - Starting async job submit for node 69f906600573a8210e131f03 2026-05-06 20:49:49,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:49:49,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f906600573a8210e131f03 HTTP/1.1" 200 None 2026-05-06 20:49:49,471 - lava_callback - DEBUG - Processing node 69f906600573a8210e131f03: baseline-arm-baylibre 2026-05-06 20:49:49,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f906600573a8210e131f03 2026-05-06 20:49:49,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:49:49,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f906600573a8210e131f03 HTTP/1.1" 200 None 2026-05-06 20:49:49,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:49:49,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 20:49:49,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:49:49,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f906600573a8210e131f03 HTTP/1.1" 200 None 2026-05-06 20:49:49,522 - lava_callback - ERROR - Error processing callback for node 69f906600573a8210e131f03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:50:29,740 - lava_callback - INFO - Received callback for node 69f906860573a8210e131f11 INFO: 172.21.0.1:37692 - "POST /node/69f906860573a8210e131f11 HTTP/1.0" 202 Accepted 2026-05-06 20:50:29,749 - lava_callback - INFO - Starting async job submit for node 69f906860573a8210e131f11 2026-05-06 20:50:29,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:50:29,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f906860573a8210e131f11 HTTP/1.1" 200 None 2026-05-06 20:50:29,766 - lava_callback - DEBUG - Processing node 69f906860573a8210e131f11: baseline-arm-baylibre 2026-05-06 20:50:29,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f906860573a8210e131f11 2026-05-06 20:50:29,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:50:29,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f906860573a8210e131f11 HTTP/1.1" 200 None 2026-05-06 20:50:29,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:50:29,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 20:50:29,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:50:29,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f906860573a8210e131f11 HTTP/1.1" 200 None 2026-05-06 20:50:29,816 - lava_callback - ERROR - Error processing callback for node 69f906860573a8210e131f11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:51:09,543 - lava_callback - INFO - Received callback for node 69f906ac0573a8210e131f1f INFO: 172.21.0.1:48192 - "POST /node/69f906ac0573a8210e131f1f HTTP/1.0" 202 Accepted 2026-05-06 20:51:09,548 - lava_callback - INFO - Starting async job submit for node 69f906ac0573a8210e131f1f 2026-05-06 20:51:09,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:51:09,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f906ac0573a8210e131f1f HTTP/1.1" 200 None 2026-05-06 20:51:09,564 - lava_callback - DEBUG - Processing node 69f906ac0573a8210e131f1f: baseline-arm-baylibre 2026-05-06 20:51:09,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f906ac0573a8210e131f1f 2026-05-06 20:51:09,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:51:09,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f906ac0573a8210e131f1f HTTP/1.1" 200 None 2026-05-06 20:51:09,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:51:09,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 20:51:09,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:51:09,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f906ac0573a8210e131f1f HTTP/1.1" 200 None 2026-05-06 20:51:09,623 - lava_callback - ERROR - Error processing callback for node 69f906ac0573a8210e131f1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:51:49,609 - lava_callback - INFO - Received callback for node 69f906d40573a8210e131f30 INFO: 172.21.0.1:39800 - "POST /node/69f906d40573a8210e131f30 HTTP/1.0" 202 Accepted 2026-05-06 20:51:49,615 - lava_callback - INFO - Starting async job submit for node 69f906d40573a8210e131f30 2026-05-06 20:51:49,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:51:49,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f906d40573a8210e131f30 HTTP/1.1" 200 None 2026-05-06 20:51:49,630 - lava_callback - DEBUG - Processing node 69f906d40573a8210e131f30: baseline-arm-baylibre 2026-05-06 20:51:49,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f906d40573a8210e131f30 2026-05-06 20:51:49,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:51:49,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f906d40573a8210e131f30 HTTP/1.1" 200 None 2026-05-06 20:51:49,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:51:49,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 20:51:49,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:51:49,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f906d40573a8210e131f30 HTTP/1.1" 200 None 2026-05-06 20:51:49,687 - lava_callback - ERROR - Error processing callback for node 69f906d40573a8210e131f30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50288 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:52:29,605 - lava_callback - INFO - Received callback for node 69f906f90573a8210e131f3b INFO: 172.21.0.1:50304 - "POST /node/69f906f90573a8210e131f3b HTTP/1.0" 202 Accepted 2026-05-06 20:52:29,614 - lava_callback - INFO - Starting async job submit for node 69f906f90573a8210e131f3b 2026-05-06 20:52:29,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:52:29,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f906f90573a8210e131f3b HTTP/1.1" 200 None 2026-05-06 20:52:29,636 - lava_callback - DEBUG - Processing node 69f906f90573a8210e131f3b: baseline-arm-baylibre 2026-05-06 20:52:29,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f906f90573a8210e131f3b 2026-05-06 20:52:29,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:52:29,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f906f90573a8210e131f3b HTTP/1.1" 200 None 2026-05-06 20:52:29,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:52:29,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 20:52:29,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:52:29,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f906f90573a8210e131f3b HTTP/1.1" 200 None 2026-05-06 20:52:29,700 - lava_callback - ERROR - Error processing callback for node 69f906f90573a8210e131f3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36814 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:55:10,020 - lava_callback - INFO - Received callback for node 69f907a70573a8210e131f50 INFO: 172.21.0.1:36824 - "POST /node/69f907a70573a8210e131f50 HTTP/1.0" 202 Accepted 2026-05-06 20:55:10,026 - lava_callback - INFO - Starting async job submit for node 69f907a70573a8210e131f50 2026-05-06 20:55:10,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:55:10,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f907a70573a8210e131f50 HTTP/1.1" 200 None 2026-05-06 20:55:10,042 - lava_callback - DEBUG - Processing node 69f907a70573a8210e131f50: baseline-arm-clabbe 2026-05-06 20:55:10,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f907a70573a8210e131f50 2026-05-06 20:55:10,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:55:10,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f907a70573a8210e131f50 HTTP/1.1" 200 None 2026-05-06 20:55:10,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:55:10,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 20:55:10,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:55:10,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f907a70573a8210e131f50 HTTP/1.1" 200 None 2026-05-06 20:55:10,090 - lava_callback - ERROR - Error processing callback for node 69f907a70573a8210e131f50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:57:29,955 - lava_callback - INFO - Received callback for node 69f9082c0573a8210e131f77 INFO: 172.21.0.1:43198 - "POST /node/69f9082c0573a8210e131f77 HTTP/1.0" 202 Accepted 2026-05-06 20:57:29,960 - lava_callback - INFO - Starting async job submit for node 69f9082c0573a8210e131f77 2026-05-06 20:57:29,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:57:29,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9082c0573a8210e131f77 HTTP/1.1" 200 None 2026-05-06 20:57:29,976 - lava_callback - DEBUG - Processing node 69f9082c0573a8210e131f77: baseline-arm-baylibre 2026-05-06 20:57:29,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9082c0573a8210e131f77 2026-05-06 20:57:29,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:57:29,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9082c0573a8210e131f77 HTTP/1.1" 200 None 2026-05-06 20:57:29,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:57:30,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-06 20:57:30,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:57:30,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9082c0573a8210e131f77 HTTP/1.1" 200 None 2026-05-06 20:57:30,033 - lava_callback - ERROR - Error processing callback for node 69f9082c0573a8210e131f77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:58:29,990 - lava_callback - INFO - Received callback for node 69f908690573a8210e131f88 INFO: 172.21.0.1:46706 - "POST /node/69f908690573a8210e131f88 HTTP/1.0" 202 Accepted 2026-05-06 20:58:29,995 - lava_callback - INFO - Starting async job submit for node 69f908690573a8210e131f88 2026-05-06 20:58:29,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:58:30,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f908690573a8210e131f88 HTTP/1.1" 200 None 2026-05-06 20:58:30,012 - lava_callback - DEBUG - Processing node 69f908690573a8210e131f88: baseline-arm-baylibre 2026-05-06 20:58:30,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f908690573a8210e131f88 2026-05-06 20:58:30,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:58:30,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f908690573a8210e131f88 HTTP/1.1" 200 None 2026-05-06 20:58:30,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:58:30,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-06 20:58:30,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:58:30,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f908690573a8210e131f88 HTTP/1.1" 200 None 2026-05-06 20:58:30,073 - lava_callback - ERROR - Error processing callback for node 69f908690573a8210e131f88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:59:10,209 - lava_callback - INFO - Received callback for node 69f9088f0573a8210e131f97 INFO: 172.21.0.1:33102 - "POST /node/69f9088f0573a8210e131f97 HTTP/1.0" 202 Accepted 2026-05-06 20:59:10,214 - lava_callback - INFO - Starting async job submit for node 69f9088f0573a8210e131f97 2026-05-06 20:59:10,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:59:10,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9088f0573a8210e131f97 HTTP/1.1" 200 None 2026-05-06 20:59:10,230 - lava_callback - DEBUG - Processing node 69f9088f0573a8210e131f97: baseline-arm-baylibre 2026-05-06 20:59:10,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9088f0573a8210e131f97 2026-05-06 20:59:10,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:59:10,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9088f0573a8210e131f97 HTTP/1.1" 200 None 2026-05-06 20:59:10,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:59:10,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-06 20:59:10,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:59:10,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9088f0573a8210e131f97 HTTP/1.1" 200 None 2026-05-06 20:59:10,286 - lava_callback - ERROR - Error processing callback for node 69f9088f0573a8210e131f97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45128 - "GET / HTTP/1.0" 200 OK 2026-05-06 20:59:49,840 - lava_callback - INFO - Received callback for node 69f908b70573a8210e131faa INFO: 172.21.0.1:35370 - "POST /node/69f908b70573a8210e131faa HTTP/1.0" 202 Accepted 2026-05-06 20:59:49,846 - lava_callback - INFO - Starting async job submit for node 69f908b70573a8210e131faa 2026-05-06 20:59:49,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:59:49,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f908b70573a8210e131faa HTTP/1.1" 200 None 2026-05-06 20:59:49,861 - lava_callback - DEBUG - Processing node 69f908b70573a8210e131faa: baseline-arm-clabbe 2026-05-06 20:59:49,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f908b70573a8210e131faa 2026-05-06 20:59:49,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:59:49,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f908b70573a8210e131faa HTTP/1.1" 200 None 2026-05-06 20:59:49,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:59:49,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 20:59:49,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 20:59:49,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f908b70573a8210e131faa HTTP/1.1" 200 None 2026-05-06 20:59:49,908 - lava_callback - ERROR - Error processing callback for node 69f908b70573a8210e131faa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:00:10,049 - lava_callback - INFO - Received callback for node 69f908d80573a8210e131fb3 INFO: 172.21.0.1:44284 - "POST /node/69f908d80573a8210e131fb3 HTTP/1.0" 202 Accepted 2026-05-06 21:00:10,055 - lava_callback - INFO - Starting async job submit for node 69f908d80573a8210e131fb3 2026-05-06 21:00:10,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:00:10,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f908d80573a8210e131fb3 HTTP/1.1" 200 None 2026-05-06 21:00:10,073 - lava_callback - DEBUG - Processing node 69f908d80573a8210e131fb3: baseline-arm-baylibre 2026-05-06 21:00:10,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f908d80573a8210e131fb3 2026-05-06 21:00:10,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:00:10,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f908d80573a8210e131fb3 HTTP/1.1" 200 None 2026-05-06 21:00:10,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:00:10,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-06 21:00:10,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:00:10,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f908d80573a8210e131fb3 HTTP/1.1" 200 None 2026-05-06 21:00:10,130 - lava_callback - ERROR - Error processing callback for node 69f908d80573a8210e131fb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:01:09,885 - lava_callback - INFO - Received callback for node 69f909000573a8210e131fc3 INFO: 172.21.0.1:55848 - "POST /node/69f909000573a8210e131fc3 HTTP/1.0" 202 Accepted 2026-05-06 21:01:09,890 - lava_callback - INFO - Starting async job submit for node 69f909000573a8210e131fc3 2026-05-06 21:01:09,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:01:09,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f909000573a8210e131fc3 HTTP/1.1" 200 None 2026-05-06 21:01:09,907 - lava_callback - DEBUG - Processing node 69f909000573a8210e131fc3: baseline-arm-clabbe 2026-05-06 21:01:09,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f909000573a8210e131fc3 2026-05-06 21:01:09,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:01:09,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f909000573a8210e131fc3 HTTP/1.1" 200 None 2026-05-06 21:01:09,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:55860 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:01:09,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:01:09,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:01:09,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f909000573a8210e131fc3 HTTP/1.1" 200 None 2026-05-06 21:01:09,953 - lava_callback - ERROR - Error processing callback for node 69f909000573a8210e131fc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48884 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:01:30,175 - lava_callback - INFO - Received callback for node 69f909220573a8210e131fd5 INFO: 172.21.0.1:51170 - "POST /node/69f909220573a8210e131fd5 HTTP/1.0" 202 Accepted 2026-05-06 21:01:30,181 - lava_callback - INFO - Starting async job submit for node 69f909220573a8210e131fd5 2026-05-06 21:01:30,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:01:30,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f909220573a8210e131fd5 HTTP/1.1" 200 None 2026-05-06 21:01:30,198 - lava_callback - DEBUG - Processing node 69f909220573a8210e131fd5: baseline-arm-baylibre 2026-05-06 21:01:30,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f909220573a8210e131fd5 2026-05-06 21:01:30,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:01:30,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f909220573a8210e131fd5 HTTP/1.1" 200 None 2026-05-06 21:01:30,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:01:30,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-06 21:01:30,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:01:30,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f909220573a8210e131fd5 HTTP/1.1" 200 None 2026-05-06 21:01:30,254 - lava_callback - ERROR - Error processing callback for node 69f909220573a8210e131fd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:02:09,935 - lava_callback - INFO - Received callback for node 69f909490573a8210e131fe0 INFO: 172.21.0.1:47166 - "POST /node/69f909490573a8210e131fe0 HTTP/1.0" 202 Accepted 2026-05-06 21:02:09,941 - lava_callback - INFO - Starting async job submit for node 69f909490573a8210e131fe0 2026-05-06 21:02:09,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47168 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:02:09,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f909490573a8210e131fe0 HTTP/1.1" 200 None 2026-05-06 21:02:09,961 - lava_callback - DEBUG - Processing node 69f909490573a8210e131fe0: baseline-arm-clabbe 2026-05-06 21:02:09,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f909490573a8210e131fe0 2026-05-06 21:02:09,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:02:09,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f909490573a8210e131fe0 HTTP/1.1" 200 None 2026-05-06 21:02:09,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:02:10,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:02:10,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:02:10,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f909490573a8210e131fe0 HTTP/1.1" 200 None 2026-05-06 21:02:10,031 - lava_callback - ERROR - Error processing callback for node 69f909490573a8210e131fe0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60562 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:02:50,263 - lava_callback - INFO - Received callback for node 69f9096c0573a8210e131ff1 INFO: 172.21.0.1:39558 - "POST /node/69f9096c0573a8210e131ff1 HTTP/1.0" 202 Accepted 2026-05-06 21:02:50,272 - lava_callback - INFO - Starting async job submit for node 69f9096c0573a8210e131ff1 2026-05-06 21:02:50,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:02:50,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9096c0573a8210e131ff1 HTTP/1.1" 200 None 2026-05-06 21:02:50,287 - lava_callback - DEBUG - Processing node 69f9096c0573a8210e131ff1: baseline-arm-baylibre 2026-05-06 21:02:50,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9096c0573a8210e131ff1 2026-05-06 21:02:50,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:02:50,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9096c0573a8210e131ff1 HTTP/1.1" 200 None 2026-05-06 21:02:50,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:02:50,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-06 21:02:50,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:02:50,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9096c0573a8210e131ff1 HTTP/1.1" 200 None 2026-05-06 21:02:50,340 - lava_callback - ERROR - Error processing callback for node 69f9096c0573a8210e131ff1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59462 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:04:30,091 - lava_callback - INFO - Received callback for node 69f909db0573a8210e13201c INFO: 172.21.0.1:44978 - "POST /node/69f909db0573a8210e13201c HTTP/1.0" 202 Accepted 2026-05-06 21:04:30,097 - lava_callback - INFO - Starting async job submit for node 69f909db0573a8210e13201c 2026-05-06 21:04:30,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:04:30,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f909db0573a8210e13201c HTTP/1.1" 200 None 2026-05-06 21:04:30,116 - lava_callback - DEBUG - Processing node 69f909db0573a8210e13201c: baseline-arm-clabbe 2026-05-06 21:04:30,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f909db0573a8210e13201c 2026-05-06 21:04:30,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:04:30,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f909db0573a8210e13201c HTTP/1.1" 200 None 2026-05-06 21:04:30,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:04:30,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-06 21:04:30,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:04:30,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f909db0573a8210e13201c HTTP/1.1" 200 None 2026-05-06 21:04:30,192 - lava_callback - ERROR - Error processing callback for node 69f909db0573a8210e13201c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46296 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:05:10,121 - lava_callback - INFO - Received callback for node 69f90a000573a8210e13202a INFO: 172.21.0.1:46300 - "POST /node/69f90a000573a8210e13202a HTTP/1.0" 202 Accepted 2026-05-06 21:05:10,127 - lava_callback - INFO - Starting async job submit for node 69f90a000573a8210e13202a 2026-05-06 21:05:10,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:05:10,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90a000573a8210e13202a HTTP/1.1" 200 None 2026-05-06 21:05:10,144 - lava_callback - DEBUG - Processing node 69f90a000573a8210e13202a: baseline-arm-clabbe 2026-05-06 21:05:10,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90a000573a8210e13202a 2026-05-06 21:05:10,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:05:10,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90a000573a8210e13202a HTTP/1.1" 200 None 2026-05-06 21:05:10,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:05:10,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:05:10,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:05:10,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90a000573a8210e13202a HTTP/1.1" 200 None 2026-05-06 21:05:10,216 - lava_callback - ERROR - Error processing callback for node 69f90a000573a8210e13202a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38928 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:05:50,133 - lava_callback - INFO - Received callback for node 69f90a260573a8210e132036 INFO: 172.21.0.1:33186 - "POST /node/69f90a260573a8210e132036 HTTP/1.0" 202 Accepted 2026-05-06 21:05:50,140 - lava_callback - INFO - Starting async job submit for node 69f90a260573a8210e132036 2026-05-06 21:05:50,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:05:50,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90a260573a8210e132036 HTTP/1.1" 200 None 2026-05-06 21:05:50,156 - lava_callback - DEBUG - Processing node 69f90a260573a8210e132036: baseline-arm-clabbe 2026-05-06 21:05:50,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90a260573a8210e132036 2026-05-06 21:05:50,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:05:50,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90a260573a8210e132036 HTTP/1.1" 200 None 2026-05-06 21:05:50,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:05:50,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-06 21:05:50,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:05:50,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90a260573a8210e132036 HTTP/1.1" 200 None 2026-05-06 21:05:50,225 - lava_callback - ERROR - Error processing callback for node 69f90a260573a8210e132036: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:06:30,027 - lava_callback - INFO - Received callback for node 69f90a4a0573a8210e132043 INFO: 172.21.0.1:38718 - "POST /node/69f90a4a0573a8210e132043 HTTP/1.0" 202 Accepted 2026-05-06 21:06:30,034 - lava_callback - INFO - Starting async job submit for node 69f90a4a0573a8210e132043 2026-05-06 21:06:30,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:06:30,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90a4a0573a8210e132043 HTTP/1.1" 200 None 2026-05-06 21:06:30,076 - lava_callback - DEBUG - Processing node 69f90a4a0573a8210e132043: baseline-arm-clabbe 2026-05-06 21:06:30,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90a4a0573a8210e132043 2026-05-06 21:06:30,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:06:30,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90a4a0573a8210e132043 HTTP/1.1" 200 None 2026-05-06 21:06:30,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:06:30,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-06 21:06:30,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:06:30,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90a4a0573a8210e132043 HTTP/1.1" 200 None 2026-05-06 21:06:30,150 - lava_callback - ERROR - Error processing callback for node 69f90a4a0573a8210e132043: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:06:54,979 - lava_callback - INFO - Received callback for node 69fbad4cdf29cd80ecaa3d70 INFO: 172.21.0.1:32928 - "POST /node/69fbad4cdf29cd80ecaa3d70 HTTP/1.0" 202 Accepted 2026-05-06 21:06:54,988 - lava_callback - INFO - Starting async job submit for node 69fbad4cdf29cd80ecaa3d70 2026-05-06 21:06:55,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:06:55,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad4cdf29cd80ecaa3d70 HTTP/1.1" 200 None 2026-05-06 21:06:55,064 - lava_callback - DEBUG - Processing node 69fbad4cdf29cd80ecaa3d70: baseline-arm64 2026-05-06 21:06:55,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:06:55,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:06:55,303 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4cdf29cd80ecaa3d70/log.txt.gz 2026-05-06 21:06:55,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:06:55,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:06:55,557 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4cdf29cd80ecaa3d70/lava-logs.yaml 2026-05-06 21:06:55,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:06:55,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:06:55,673 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4cdf29cd80ecaa3d70/lava_callback.json.gz 2026-05-06 21:06:55,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:06:55,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad4cdf29cd80ecaa3d70 HTTP/1.1" 200 None 2026-05-06 21:06:55,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:06:55,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:06:55,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:06:55,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad4cdf29cd80ecaa3d70 HTTP/1.1" 200 None 2026-05-06 21:06:55,752 - lava_callback - INFO - Completed processing callback for node 69fbad4cdf29cd80ecaa3d70 2026-05-06 21:06:56,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:06:56,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32944 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:07:02,510 - lava_callback - INFO - Received callback for node 69fbad66df29cd80ecaa3dd6 INFO: 172.21.0.1:60172 - "POST /node/69fbad66df29cd80ecaa3dd6 HTTP/1.0" 202 Accepted 2026-05-06 21:07:02,524 - lava_callback - INFO - Starting async job submit for node 69fbad66df29cd80ecaa3dd6 2026-05-06 21:07:02,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:02,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad66df29cd80ecaa3dd6 HTTP/1.1" 200 None 2026-05-06 21:07:02,548 - lava_callback - DEBUG - Processing node 69fbad66df29cd80ecaa3dd6: baseline-nfs-arm64 2026-05-06 21:07:02,550 - lava_callback - WARNING - Failed to upload log 2026-05-06 21:07:02,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:02,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:02,665 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad66df29cd80ecaa3dd6/lava-logs.yaml 2026-05-06 21:07:02,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:02,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:02,769 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad66df29cd80ecaa3dd6/lava_callback.json.gz 2026-05-06 21:07:02,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:02,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad66df29cd80ecaa3dd6 HTTP/1.1" 200 None 2026-05-06 21:07:02,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:02,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:07:02,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:02,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad66df29cd80ecaa3dd6 HTTP/1.1" 200 None 2026-05-06 21:07:02,912 - lava_callback - INFO - Completed processing callback for node 69fbad66df29cd80ecaa3dd6 INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:07:10,159 - lava_callback - INFO - Received callback for node 69f90a700573a8210e132050 INFO: 172.21.0.1:55162 - "POST /node/69f90a700573a8210e132050 HTTP/1.0" 202 Accepted 2026-05-06 21:07:10,165 - lava_callback - INFO - Starting async job submit for node 69f90a700573a8210e132050 2026-05-06 21:07:10,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:10,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90a700573a8210e132050 HTTP/1.1" 200 None 2026-05-06 21:07:10,182 - lava_callback - DEBUG - Processing node 69f90a700573a8210e132050: baseline-arm-clabbe 2026-05-06 21:07:10,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90a700573a8210e132050 2026-05-06 21:07:10,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:10,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90a700573a8210e132050 HTTP/1.1" 200 None 2026-05-06 21:07:10,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:10,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-06 21:07:10,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:10,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90a700573a8210e132050 HTTP/1.1" 200 None 2026-05-06 21:07:10,294 - lava_callback - ERROR - Error processing callback for node 69f90a700573a8210e132050: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:07:22,714 - lava_callback - INFO - Received callback for node 69fbad57df29cd80ecaa3d93 INFO: 172.21.0.1:55350 - "POST /node/69fbad57df29cd80ecaa3d93 HTTP/1.0" 202 Accepted 2026-05-06 21:07:22,721 - lava_callback - INFO - Starting async job submit for node 69fbad57df29cd80ecaa3d93 2026-05-06 21:07:22,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:22,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad57df29cd80ecaa3d93 HTTP/1.1" 200 None 2026-05-06 21:07:22,757 - lava_callback - DEBUG - Processing node 69fbad57df29cd80ecaa3d93: baseline-arm64 2026-05-06 21:07:22,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:22,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:22,990 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad57df29cd80ecaa3d93/log.txt.gz 2026-05-06 21:07:23,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:23,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:23,264 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad57df29cd80ecaa3d93/lava-logs.yaml 2026-05-06 21:07:23,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:23,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:23,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad57df29cd80ecaa3d93/lava_callback.json.gz 2026-05-06 21:07:23,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:23,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad57df29cd80ecaa3d93 HTTP/1.1" 200 None 2026-05-06 21:07:23,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:23,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:07:23,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:23,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad57df29cd80ecaa3d93 HTTP/1.1" 200 None 2026-05-06 21:07:23,529 - lava_callback - INFO - Completed processing callback for node 69fbad57df29cd80ecaa3d93 2026-05-06 21:07:25,267 - lava_callback - INFO - Received callback for node 69fba962df29cd80ecaa3c40 INFO: 172.21.0.1:55354 - "POST /node/69fba962df29cd80ecaa3c40 HTTP/1.0" 202 Accepted 2026-05-06 21:07:25,274 - lava_callback - INFO - Starting async job submit for node 69fba962df29cd80ecaa3c40 2026-05-06 21:07:25,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:25,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba962df29cd80ecaa3c40 HTTP/1.1" 200 None 2026-05-06 21:07:25,364 - lava_callback - DEBUG - Processing node 69fba962df29cd80ecaa3c40: ltp-smoke 2026-05-06 21:07:25,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:25,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:25,948 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fba962df29cd80ecaa3c40/log.txt.gz 2026-05-06 21:07:26,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:26,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-06 21:07:26,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55358 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:07:26,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:26,540 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fba962df29cd80ecaa3c40/lava-logs.yaml 2026-05-06 21:07:26,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:26,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:26,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fba962df29cd80ecaa3c40/lava_callback.json.gz 2026-05-06 21:07:26,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:26,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba962df29cd80ecaa3c40 HTTP/1.1" 200 None 2026-05-06 21:07:26,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:26,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a63df29cd80ecaa02a8 HTTP/1.1" 200 None 2026-05-06 21:07:26,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:26,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba962df29cd80ecaa3c40 HTTP/1.1" 200 None 2026-05-06 21:07:27,027 - lava_callback - INFO - Completed processing callback for node 69fba962df29cd80ecaa3c40 2026-05-06 21:07:34,656 - lava_callback - INFO - Received callback for node 69fbad55df29cd80ecaa3d8b INFO: 172.21.0.1:51322 - "POST /node/69fbad55df29cd80ecaa3d8b HTTP/1.0" 202 Accepted 2026-05-06 21:07:34,662 - lava_callback - INFO - Starting async job submit for node 69fbad55df29cd80ecaa3d8b 2026-05-06 21:07:34,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:34,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad55df29cd80ecaa3d8b HTTP/1.1" 200 None 2026-05-06 21:07:34,698 - lava_callback - DEBUG - Processing node 69fbad55df29cd80ecaa3d8b: baseline-arm64 2026-05-06 21:07:35,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:35,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:35,193 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad55df29cd80ecaa3d8b/log.txt.gz 2026-05-06 21:07:35,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:35,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:35,601 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad55df29cd80ecaa3d8b/lava-logs.yaml 2026-05-06 21:07:35,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:35,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:35,756 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad55df29cd80ecaa3d8b/lava_callback.json.gz 2026-05-06 21:07:35,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:35,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad55df29cd80ecaa3d8b HTTP/1.1" 200 None 2026-05-06 21:07:35,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:35,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:07:35,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:35,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad55df29cd80ecaa3d8b HTTP/1.1" 200 None 2026-05-06 21:07:35,871 - lava_callback - INFO - Completed processing callback for node 69fbad55df29cd80ecaa3d8b 2026-05-06 21:07:36,431 - lava_callback - INFO - Received callback for node 69fbad54df29cd80ecaa3d88 INFO: 172.21.0.1:51332 - "POST /node/69fbad54df29cd80ecaa3d88 HTTP/1.0" 202 Accepted 2026-05-06 21:07:36,438 - lava_callback - INFO - Starting async job submit for node 69fbad54df29cd80ecaa3d88 2026-05-06 21:07:36,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:36,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad54df29cd80ecaa3d88 HTTP/1.1" 200 None 2026-05-06 21:07:36,477 - lava_callback - DEBUG - Processing node 69fbad54df29cd80ecaa3d88: baseline-arm64 INFO: 172.21.0.1:51346 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:07:36,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:36,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:36,943 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad54df29cd80ecaa3d88/log.txt.gz 2026-05-06 21:07:37,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:37,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:37,345 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad54df29cd80ecaa3d88/lava-logs.yaml 2026-05-06 21:07:37,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:37,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:37,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad54df29cd80ecaa3d88/lava_callback.json.gz 2026-05-06 21:07:37,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:37,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad54df29cd80ecaa3d88 HTTP/1.1" 200 None 2026-05-06 21:07:37,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:37,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:07:37,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:37,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad54df29cd80ecaa3d88 HTTP/1.1" 200 None 2026-05-06 21:07:37,588 - lava_callback - INFO - Completed processing callback for node 69fbad54df29cd80ecaa3d88 2026-05-06 21:07:40,616 - lava_callback - INFO - Received callback for node 69fbad4ddf29cd80ecaa3d76 INFO: 172.21.0.1:51024 - "POST /node/69fbad4ddf29cd80ecaa3d76 HTTP/1.0" 202 Accepted 2026-05-06 21:07:40,622 - lava_callback - INFO - Starting async job submit for node 69fbad4ddf29cd80ecaa3d76 2026-05-06 21:07:40,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:40,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad4ddf29cd80ecaa3d76 HTTP/1.1" 200 None 2026-05-06 21:07:40,658 - lava_callback - DEBUG - Processing node 69fbad4ddf29cd80ecaa3d76: baseline-arm64 2026-05-06 21:07:40,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:41,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:41,018 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4ddf29cd80ecaa3d76/log.txt.gz 2026-05-06 21:07:41,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:41,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:41,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4ddf29cd80ecaa3d76/lava-logs.yaml 2026-05-06 21:07:41,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:41,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:41,430 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4ddf29cd80ecaa3d76/lava_callback.json.gz 2026-05-06 21:07:41,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:41,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad4ddf29cd80ecaa3d76 HTTP/1.1" 200 None 2026-05-06 21:07:41,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:41,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:07:41,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:41,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad4ddf29cd80ecaa3d76 HTTP/1.1" 200 None 2026-05-06 21:07:41,504 - lava_callback - INFO - Completed processing callback for node 69fbad4ddf29cd80ecaa3d76 INFO: 172.21.0.1:51032 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:07:46,565 - lava_callback - INFO - Received callback for node 69fbad4fdf29cd80ecaa3d7c INFO: 172.21.0.1:51042 - "POST /node/69fbad4fdf29cd80ecaa3d7c HTTP/1.0" 202 Accepted 2026-05-06 21:07:46,572 - lava_callback - INFO - Starting async job submit for node 69fbad4fdf29cd80ecaa3d7c 2026-05-06 21:07:46,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:46,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad4fdf29cd80ecaa3d7c HTTP/1.1" 200 None 2026-05-06 21:07:46,615 - lava_callback - DEBUG - Processing node 69fbad4fdf29cd80ecaa3d7c: baseline-arm64 2026-05-06 21:07:46,774 - lava_callback - WARNING - Failed to upload log 2026-05-06 21:07:46,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:46,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:46,954 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4fdf29cd80ecaa3d7c/lava-logs.yaml 2026-05-06 21:07:46,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:47,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:47,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4fdf29cd80ecaa3d7c/lava_callback.json.gz 2026-05-06 21:07:47,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:47,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad4fdf29cd80ecaa3d7c HTTP/1.1" 200 None 2026-05-06 21:07:47,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:47,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:07:47,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:47,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad4fdf29cd80ecaa3d7c HTTP/1.1" 200 None 2026-05-06 21:07:47,213 - lava_callback - INFO - Completed processing callback for node 69fbad4fdf29cd80ecaa3d7c 2026-05-06 21:07:47,893 - lava_callback - INFO - Received callback for node 69fbad50df29cd80ecaa3d7f INFO: 172.21.0.1:51046 - "POST /node/69fbad50df29cd80ecaa3d7f HTTP/1.0" 202 Accepted 2026-05-06 21:07:47,902 - lava_callback - INFO - Starting async job submit for node 69fbad50df29cd80ecaa3d7f 2026-05-06 21:07:47,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:47,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad50df29cd80ecaa3d7f HTTP/1.1" 200 None 2026-05-06 21:07:47,947 - lava_callback - DEBUG - Processing node 69fbad50df29cd80ecaa3d7f: baseline-arm64 2026-05-06 21:07:48,146 - lava_callback - WARNING - Failed to upload log 2026-05-06 21:07:48,255 - lava_callback - INFO - Received callback for node 69fbad52df29cd80ecaa3d85 INFO: 172.21.0.1:51050 - "POST /node/69fbad52df29cd80ecaa3d85 HTTP/1.0" 202 Accepted 2026-05-06 21:07:48,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:48,262 - lava_callback - INFO - Starting async job submit for node 69fbad52df29cd80ecaa3d85 2026-05-06 21:07:48,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:48,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad52df29cd80ecaa3d85 HTTP/1.1" 200 None 2026-05-06 21:07:48,309 - lava_callback - DEBUG - Processing node 69fbad52df29cd80ecaa3d85: baseline-arm64 2026-05-06 21:07:48,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:48,488 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad50df29cd80ecaa3d7f/lava-logs.yaml 2026-05-06 21:07:48,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:48,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:48,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:48,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad50df29cd80ecaa3d7f/lava_callback.json.gz 2026-05-06 21:07:48,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:48,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad50df29cd80ecaa3d7f HTTP/1.1" 200 None 2026-05-06 21:07:48,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:48,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:07:48,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:48,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:48,808 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad52df29cd80ecaa3d85/log.txt.gz 2026-05-06 21:07:48,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad50df29cd80ecaa3d7f HTTP/1.1" 200 None 2026-05-06 21:07:49,058 - lava_callback - INFO - Completed processing callback for node 69fbad50df29cd80ecaa3d7f 2026-05-06 21:07:49,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:49,201 - lava_callback - INFO - Received callback for node 69fbad5bdf29cd80ecaa3d9f INFO: 172.21.0.1:51056 - "POST /node/69fbad5bdf29cd80ecaa3d9f HTTP/1.0" 202 Accepted 2026-05-06 21:07:49,208 - lava_callback - INFO - Starting async job submit for node 69fbad5bdf29cd80ecaa3d9f 2026-05-06 21:07:49,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:49,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:49,235 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad52df29cd80ecaa3d85/lava-logs.yaml 2026-05-06 21:07:49,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:49,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad5bdf29cd80ecaa3d9f HTTP/1.1" 200 None 2026-05-06 21:07:49,253 - lava_callback - DEBUG - Processing node 69fbad5bdf29cd80ecaa3d9f: baseline-arm64 2026-05-06 21:07:49,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:49,397 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad52df29cd80ecaa3d85/lava_callback.json.gz 2026-05-06 21:07:49,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:49,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad52df29cd80ecaa3d85 HTTP/1.1" 200 None 2026-05-06 21:07:49,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:49,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:49,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:07:49,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:49,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad52df29cd80ecaa3d85 HTTP/1.1" 200 None 2026-05-06 21:07:49,665 - lava_callback - INFO - Completed processing callback for node 69fbad52df29cd80ecaa3d85 2026-05-06 21:07:49,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:49,751 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad5bdf29cd80ecaa3d9f/log.txt.gz 2026-05-06 21:07:49,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:50,007 - lava_callback - INFO - Received callback for node 69f90a960573a8210e132062 INFO: 172.21.0.1:36656 - "POST /node/69f90a960573a8210e132062 HTTP/1.0" 202 Accepted 2026-05-06 21:07:50,012 - lava_callback - INFO - Starting async job submit for node 69f90a960573a8210e132062 2026-05-06 21:07:50,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:50,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90a960573a8210e132062 HTTP/1.1" 200 None 2026-05-06 21:07:50,028 - lava_callback - DEBUG - Processing node 69f90a960573a8210e132062: baseline-arm-clabbe 2026-05-06 21:07:50,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90a960573a8210e132062 2026-05-06 21:07:50,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:50,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90a960573a8210e132062 HTTP/1.1" 200 None 2026-05-06 21:07:50,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:50,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-06 21:07:50,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:50,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:50,093 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad5bdf29cd80ecaa3d9f/lava-logs.yaml 2026-05-06 21:07:50,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90a960573a8210e132062 HTTP/1.1" 200 None 2026-05-06 21:07:50,100 - lava_callback - ERROR - Error processing callback for node 69f90a960573a8210e132062: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 21:07:50,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:07:50,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:07:50,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad5bdf29cd80ecaa3d9f/lava_callback.json.gz 2026-05-06 21:07:50,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:50,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad5bdf29cd80ecaa3d9f HTTP/1.1" 200 None 2026-05-06 21:07:50,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:50,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:07:50,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:50,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad5bdf29cd80ecaa3d9f HTTP/1.1" 200 None 2026-05-06 21:07:50,325 - lava_callback - INFO - Completed processing callback for node 69fbad5bdf29cd80ecaa3d9f 2026-05-06 21:07:56,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:07:56,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41242 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:08:07,637 - lava_callback - INFO - Received callback for node 69fbad5ddf29cd80ecaa3dbc INFO: 172.21.0.1:41254 - "POST /node/69fbad5ddf29cd80ecaa3dbc HTTP/1.0" 202 Accepted 2026-05-06 21:08:07,643 - lava_callback - INFO - Starting async job submit for node 69fbad5ddf29cd80ecaa3dbc 2026-05-06 21:08:07,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:07,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad5ddf29cd80ecaa3dbc HTTP/1.1" 200 None 2026-05-06 21:08:07,683 - lava_callback - DEBUG - Processing node 69fbad5ddf29cd80ecaa3dbc: baseline-arm64 2026-05-06 21:08:08,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:08,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:08,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad5ddf29cd80ecaa3dbc/log.txt.gz 2026-05-06 21:08:08,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:08,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:08,636 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad5ddf29cd80ecaa3dbc/lava-logs.yaml 2026-05-06 21:08:08,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:08,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:08,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad5ddf29cd80ecaa3dbc/lava_callback.json.gz 2026-05-06 21:08:08,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:08,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad5ddf29cd80ecaa3dbc HTTP/1.1" 200 None 2026-05-06 21:08:08,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:08,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:08,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:08,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad5ddf29cd80ecaa3dbc HTTP/1.1" 200 None 2026-05-06 21:08:08,834 - lava_callback - INFO - Completed processing callback for node 69fbad5ddf29cd80ecaa3dbc 2026-05-06 21:08:09,980 - lava_callback - INFO - Received callback for node 69fbad58df29cd80ecaa3d96 INFO: 172.21.0.1:54252 - "POST /node/69fbad58df29cd80ecaa3d96 HTTP/1.0" 202 Accepted 2026-05-06 21:08:09,986 - lava_callback - INFO - Starting async job submit for node 69fbad58df29cd80ecaa3d96 2026-05-06 21:08:10,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:10,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad58df29cd80ecaa3d96 HTTP/1.1" 200 None 2026-05-06 21:08:10,024 - lava_callback - DEBUG - Processing node 69fbad58df29cd80ecaa3d96: baseline-arm64 INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:08:10,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:10,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:10,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad58df29cd80ecaa3d96/log.txt.gz 2026-05-06 21:08:10,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:10,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:10,621 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad58df29cd80ecaa3d96/lava-logs.yaml 2026-05-06 21:08:10,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:10,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:10,716 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad58df29cd80ecaa3d96/lava_callback.json.gz 2026-05-06 21:08:10,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:10,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad58df29cd80ecaa3d96 HTTP/1.1" 200 None 2026-05-06 21:08:10,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:10,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:10,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:10,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad58df29cd80ecaa3d96 HTTP/1.1" 200 None 2026-05-06 21:08:10,812 - lava_callback - INFO - Completed processing callback for node 69fbad58df29cd80ecaa3d96 2026-05-06 21:08:13,895 - lava_callback - INFO - Received callback for node 69fbad65df29cd80ecaa3dd1 INFO: 172.21.0.1:54270 - "POST /node/69fbad65df29cd80ecaa3dd1 HTTP/1.0" 202 Accepted 2026-05-06 21:08:13,902 - lava_callback - INFO - Starting async job submit for node 69fbad65df29cd80ecaa3dd1 2026-05-06 21:08:13,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:13,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad65df29cd80ecaa3dd1 HTTP/1.1" 200 None 2026-05-06 21:08:13,940 - lava_callback - DEBUG - Processing node 69fbad65df29cd80ecaa3dd1: baseline-nfs-arm64 2026-05-06 21:08:14,388 - lava_callback - INFO - Received callback for node 69fbad56df29cd80ecaa3d90 INFO: 172.21.0.1:54286 - "POST /node/69fbad56df29cd80ecaa3d90 HTTP/1.0" 202 Accepted 2026-05-06 21:08:14,410 - lava_callback - INFO - Starting async job submit for node 69fbad56df29cd80ecaa3d90 2026-05-06 21:08:14,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:14,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:14,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad56df29cd80ecaa3d90 HTTP/1.1" 200 None 2026-05-06 21:08:14,583 - lava_callback - DEBUG - Processing node 69fbad56df29cd80ecaa3d90: baseline-arm64 2026-05-06 21:08:14,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:14,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad65df29cd80ecaa3dd1/log.txt.gz INFO: 172.21.0.1:54298 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 21:08:15,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:15,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:15,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:15,537 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad56df29cd80ecaa3d90/log.txt.gz 2026-05-06 21:08:15,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:15,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad65df29cd80ecaa3dd1/lava-logs.yaml 2026-05-06 21:08:15,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:15,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:15,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:15,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad65df29cd80ecaa3dd1/lava_callback.json.gz 2026-05-06 21:08:15,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:15,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad65df29cd80ecaa3dd1 HTTP/1.1" 200 None 2026-05-06 21:08:15,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:15,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:15,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:15,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad65df29cd80ecaa3dd1 HTTP/1.1" 200 None 2026-05-06 21:08:15,963 - lava_callback - INFO - Completed processing callback for node 69fbad65df29cd80ecaa3dd1 2026-05-06 21:08:16,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:16,065 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad56df29cd80ecaa3d90/lava-logs.yaml 2026-05-06 21:08:16,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:16,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:16,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad56df29cd80ecaa3d90/lava_callback.json.gz 2026-05-06 21:08:16,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:16,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad56df29cd80ecaa3d90 HTTP/1.1" 200 None 2026-05-06 21:08:16,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:16,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:16,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:16,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad56df29cd80ecaa3d90 HTTP/1.1" 200 None 2026-05-06 21:08:16,435 - lava_callback - INFO - Completed processing callback for node 69fbad56df29cd80ecaa3d90 INFO: 172.21.0.1:54312 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:08:18,933 - lava_callback - INFO - Received callback for node 69fbad5adf29cd80ecaa3d9c INFO: 172.21.0.1:54326 - "POST /node/69fbad5adf29cd80ecaa3d9c HTTP/1.0" 202 Accepted 2026-05-06 21:08:18,939 - lava_callback - INFO - Starting async job submit for node 69fbad5adf29cd80ecaa3d9c 2026-05-06 21:08:18,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:18,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad5adf29cd80ecaa3d9c HTTP/1.1" 200 None 2026-05-06 21:08:18,980 - lava_callback - DEBUG - Processing node 69fbad5adf29cd80ecaa3d9c: baseline-arm64 2026-05-06 21:08:19,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:19,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:19,331 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad5adf29cd80ecaa3d9c/log.txt.gz 2026-05-06 21:08:19,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:19,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:19,635 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad5adf29cd80ecaa3d9c/lava-logs.yaml 2026-05-06 21:08:19,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:19,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:19,744 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad5adf29cd80ecaa3d9c/lava_callback.json.gz 2026-05-06 21:08:19,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:19,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad5adf29cd80ecaa3d9c HTTP/1.1" 200 None 2026-05-06 21:08:19,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:19,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:19,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:19,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad5adf29cd80ecaa3d9c HTTP/1.1" 200 None 2026-05-06 21:08:19,818 - lava_callback - INFO - Completed processing callback for node 69fbad5adf29cd80ecaa3d9c 2026-05-06 21:08:20,579 - lava_callback - INFO - Received callback for node 69fbad6adf29cd80ecaa3de3 INFO: 172.21.0.1:39814 - "POST /node/69fbad6adf29cd80ecaa3de3 HTTP/1.0" 202 Accepted 2026-05-06 21:08:20,585 - lava_callback - INFO - Starting async job submit for node 69fbad6adf29cd80ecaa3de3 2026-05-06 21:08:20,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:20,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad6adf29cd80ecaa3de3 HTTP/1.1" 200 None 2026-05-06 21:08:20,624 - lava_callback - DEBUG - Processing node 69fbad6adf29cd80ecaa3de3: baseline-nfs-arm64 2026-05-06 21:08:20,648 - lava_callback - INFO - Received callback for node 69fbad4cdf29cd80ecaa3d73 INFO: 172.21.0.1:39818 - "POST /node/69fbad4cdf29cd80ecaa3d73 HTTP/1.0" 202 Accepted 2026-05-06 21:08:20,660 - lava_callback - INFO - Starting async job submit for node 69fbad4cdf29cd80ecaa3d73 2026-05-06 21:08:20,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:20,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad4cdf29cd80ecaa3d73 HTTP/1.1" 200 None 2026-05-06 21:08:20,818 - lava_callback - DEBUG - Processing node 69fbad4cdf29cd80ecaa3d73: baseline-arm64 2026-05-06 21:08:21,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:21,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:21,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:21,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:21,362 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4cdf29cd80ecaa3d73/log.txt.gz 2026-05-06 21:08:21,368 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad6adf29cd80ecaa3de3/log.txt.gz 2026-05-06 21:08:21,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:21,692 - lava_callback - INFO - Received callback for node 69fbad64df29cd80ecaa3dce 2026-05-06 21:08:21,712 - lava_callback - INFO - Starting async job submit for node 69fbad64df29cd80ecaa3dce INFO: 172.21.0.1:39826 - "POST /node/69fbad64df29cd80ecaa3dce HTTP/1.0" 202 Accepted 2026-05-06 21:08:21,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:21,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:21,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad64df29cd80ecaa3dce HTTP/1.1" 200 None 2026-05-06 21:08:21,780 - lava_callback - DEBUG - Processing node 69fbad64df29cd80ecaa3dce: baseline-nfs-arm64 2026-05-06 21:08:21,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:21,900 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4cdf29cd80ecaa3d73/lava-logs.yaml 2026-05-06 21:08:21,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:21,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:22,002 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad6adf29cd80ecaa3de3/lava-logs.yaml 2026-05-06 21:08:22,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:22,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:22,258 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4cdf29cd80ecaa3d73/lava_callback.json.gz 2026-05-06 21:08:22,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:22,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:22,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad6adf29cd80ecaa3de3/lava_callback.json.gz 2026-05-06 21:08:22,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad4cdf29cd80ecaa3d73 HTTP/1.1" 200 None 2026-05-06 21:08:22,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:22,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:22,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:22,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad6adf29cd80ecaa3de3 HTTP/1.1" 200 None 2026-05-06 21:08:22,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:22,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:22,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:22,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:22,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:22,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad4cdf29cd80ecaa3d73 HTTP/1.1" 200 None 2026-05-06 21:08:22,500 - lava_callback - INFO - Completed processing callback for node 69fbad4cdf29cd80ecaa3d73 2026-05-06 21:08:22,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:22,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad6adf29cd80ecaa3de3 HTTP/1.1" 200 None 2026-05-06 21:08:22,581 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad64df29cd80ecaa3dce/log.txt.gz 2026-05-06 21:08:22,596 - lava_callback - INFO - Completed processing callback for node 69fbad6adf29cd80ecaa3de3 2026-05-06 21:08:22,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:23,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:23,148 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad64df29cd80ecaa3dce/lava-logs.yaml 2026-05-06 21:08:23,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:23,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:23,278 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad64df29cd80ecaa3dce/lava_callback.json.gz 2026-05-06 21:08:23,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:23,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad64df29cd80ecaa3dce HTTP/1.1" 200 None 2026-05-06 21:08:23,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:23,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:23,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:23,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad64df29cd80ecaa3dce HTTP/1.1" 200 None 2026-05-06 21:08:23,383 - lava_callback - INFO - Completed processing callback for node 69fbad64df29cd80ecaa3dce 2026-05-06 21:08:26,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:26,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:08:30,116 - lava_callback - INFO - Received callback for node 69f90abb0573a8210e13206b INFO: 172.21.0.1:43978 - "POST /node/69f90abb0573a8210e13206b HTTP/1.0" 202 Accepted 2026-05-06 21:08:30,121 - lava_callback - INFO - Starting async job submit for node 69f90abb0573a8210e13206b 2026-05-06 21:08:30,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:30,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90abb0573a8210e13206b HTTP/1.1" 200 None 2026-05-06 21:08:30,137 - lava_callback - DEBUG - Processing node 69f90abb0573a8210e13206b: baseline-arm-clabbe 2026-05-06 21:08:30,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90abb0573a8210e13206b 2026-05-06 21:08:30,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:30,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90abb0573a8210e13206b HTTP/1.1" 200 None 2026-05-06 21:08:30,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:30,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-06 21:08:30,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:30,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90abb0573a8210e13206b HTTP/1.1" 200 None 2026-05-06 21:08:30,186 - lava_callback - ERROR - Error processing callback for node 69f90abb0573a8210e13206b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 21:08:30,347 - lava_callback - INFO - Received callback for node 69fbad4edf29cd80ecaa3d79 INFO: 172.21.0.1:43990 - "POST /node/69fbad4edf29cd80ecaa3d79 HTTP/1.0" 202 Accepted 2026-05-06 21:08:30,354 - lava_callback - INFO - Starting async job submit for node 69fbad4edf29cd80ecaa3d79 2026-05-06 21:08:30,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:30,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad4edf29cd80ecaa3d79 HTTP/1.1" 200 None 2026-05-06 21:08:30,391 - lava_callback - DEBUG - Processing node 69fbad4edf29cd80ecaa3d79: baseline-arm64 2026-05-06 21:08:30,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:30,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:30,723 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4edf29cd80ecaa3d79/log.txt.gz 2026-05-06 21:08:30,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:31,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:31,018 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4edf29cd80ecaa3d79/lava-logs.yaml 2026-05-06 21:08:31,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:31,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:31,115 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad4edf29cd80ecaa3d79/lava_callback.json.gz 2026-05-06 21:08:31,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:31,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad4edf29cd80ecaa3d79 HTTP/1.1" 200 None 2026-05-06 21:08:31,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:31,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:31,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:31,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad4edf29cd80ecaa3d79 HTTP/1.1" 200 None 2026-05-06 21:08:31,195 - lava_callback - INFO - Completed processing callback for node 69fbad4edf29cd80ecaa3d79 INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:08:37,913 - lava_callback - INFO - Received callback for node 69fbad90df29cd80ecaa3e74 INFO: 172.21.0.1:44014 - "POST /node/69fbad90df29cd80ecaa3e74 HTTP/1.0" 202 Accepted 2026-05-06 21:08:37,919 - lava_callback - INFO - Starting async job submit for node 69fbad90df29cd80ecaa3e74 2026-05-06 21:08:37,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:37,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad90df29cd80ecaa3e74 HTTP/1.1" 200 None 2026-05-06 21:08:37,954 - lava_callback - DEBUG - Processing node 69fbad90df29cd80ecaa3e74: baseline-arm64-pengutronix 2026-05-06 21:08:38,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:38,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:38,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbad90df29cd80ecaa3e74/log.txt.gz 2026-05-06 21:08:38,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:38,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:38,693 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbad90df29cd80ecaa3e74/lava-logs.yaml 2026-05-06 21:08:38,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:38,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:38,820 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbad90df29cd80ecaa3e74/lava_callback.json.gz 2026-05-06 21:08:38,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:38,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad90df29cd80ecaa3e74 HTTP/1.1" 200 None 2026-05-06 21:08:38,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:38,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:38,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:38,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad90df29cd80ecaa3e74 HTTP/1.1" 200 None 2026-05-06 21:08:38,899 - lava_callback - INFO - Completed processing callback for node 69fbad90df29cd80ecaa3e74 2026-05-06 21:08:39,073 - lava_callback - INFO - Received callback for node 69fbad8fdf29cd80ecaa3e71 INFO: 172.21.0.1:44026 - "POST /node/69fbad8fdf29cd80ecaa3e71 HTTP/1.0" 202 Accepted 2026-05-06 21:08:39,083 - lava_callback - INFO - Starting async job submit for node 69fbad8fdf29cd80ecaa3e71 2026-05-06 21:08:39,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:39,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad8fdf29cd80ecaa3e71 HTTP/1.1" 200 None 2026-05-06 21:08:39,126 - lava_callback - DEBUG - Processing node 69fbad8fdf29cd80ecaa3e71: baseline-arm64-pengutronix 2026-05-06 21:08:39,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:39,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:39,387 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbad8fdf29cd80ecaa3e71/log.txt.gz 2026-05-06 21:08:39,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:39,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:39,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbad8fdf29cd80ecaa3e71/lava-logs.yaml 2026-05-06 21:08:39,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:39,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:39,696 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbad8fdf29cd80ecaa3e71/lava_callback.json.gz 2026-05-06 21:08:39,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:39,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad8fdf29cd80ecaa3e71 HTTP/1.1" 200 None 2026-05-06 21:08:39,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:39,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:39,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:39,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad8fdf29cd80ecaa3e71 HTTP/1.1" 200 None 2026-05-06 21:08:39,832 - lava_callback - INFO - Completed processing callback for node 69fbad8fdf29cd80ecaa3e71 2026-05-06 21:08:44,431 - lava_callback - INFO - Received callback for node 69fbad61df29cd80ecaa3dc8 INFO: 172.21.0.1:55990 - "POST /node/69fbad61df29cd80ecaa3dc8 HTTP/1.0" 202 Accepted 2026-05-06 21:08:44,437 - lava_callback - INFO - Starting async job submit for node 69fbad61df29cd80ecaa3dc8 2026-05-06 21:08:44,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:44,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad61df29cd80ecaa3dc8 HTTP/1.1" 200 None 2026-05-06 21:08:44,484 - lava_callback - DEBUG - Processing node 69fbad61df29cd80ecaa3dc8: baseline-nfs-arm64 2026-05-06 21:08:44,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:44,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:44,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad61df29cd80ecaa3dc8/log.txt.gz 2026-05-06 21:08:45,110 - lava_callback - INFO - Received callback for node 69fbad78df29cd80ecaa3e0a INFO: 172.21.0.1:55994 - "POST /node/69fbad78df29cd80ecaa3e0a HTTP/1.0" 202 Accepted 2026-05-06 21:08:45,122 - lava_callback - INFO - Starting async job submit for node 69fbad78df29cd80ecaa3e0a 2026-05-06 21:08:45,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:45,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:45,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad78df29cd80ecaa3e0a HTTP/1.1" 200 None 2026-05-06 21:08:45,161 - lava_callback - DEBUG - Processing node 69fbad78df29cd80ecaa3e0a: baseline-arm64-broonie 2026-05-06 21:08:45,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:45,344 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad61df29cd80ecaa3dc8/lava-logs.yaml 2026-05-06 21:08:45,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:45,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:45,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:45,470 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad78df29cd80ecaa3e0a/log.txt.gz 2026-05-06 21:08:45,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:45,520 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad61df29cd80ecaa3dc8/lava_callback.json.gz 2026-05-06 21:08:45,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:45,578 - lava_callback - INFO - Received callback for node 69fbad91df29cd80ecaa3e77 INFO: 172.21.0.1:56010 - "POST /node/69fbad91df29cd80ecaa3e77 HTTP/1.0" 202 Accepted 2026-05-06 21:08:45,587 - lava_callback - INFO - Starting async job submit for node 69fbad91df29cd80ecaa3e77 2026-05-06 21:08:45,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:45,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad61df29cd80ecaa3dc8 HTTP/1.1" 200 None 2026-05-06 21:08:45,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:45,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:45,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad91df29cd80ecaa3e77 HTTP/1.1" 200 None 2026-05-06 21:08:45,665 - lava_callback - DEBUG - Processing node 69fbad91df29cd80ecaa3e77: baseline-arm64-pengutronix 2026-05-06 21:08:45,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:45,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:45,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:45,932 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad78df29cd80ecaa3e0a/lava-logs.yaml 2026-05-06 21:08:45,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad61df29cd80ecaa3dc8 HTTP/1.1" 200 None 2026-05-06 21:08:45,936 - lava_callback - INFO - Completed processing callback for node 69fbad61df29cd80ecaa3dc8 2026-05-06 21:08:45,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:45,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:46,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:46,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbad91df29cd80ecaa3e77/log.txt.gz 2026-05-06 21:08:46,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:46,119 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad78df29cd80ecaa3e0a/lava_callback.json.gz 2026-05-06 21:08:46,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:46,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:46,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad78df29cd80ecaa3e0a HTTP/1.1" 200 None 2026-05-06 21:08:46,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:46,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:46,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:46,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad78df29cd80ecaa3e0a HTTP/1.1" 200 None 2026-05-06 21:08:46,269 - lava_callback - INFO - Completed processing callback for node 69fbad78df29cd80ecaa3e0a 2026-05-06 21:08:46,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:46,379 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbad91df29cd80ecaa3e77/lava-logs.yaml 2026-05-06 21:08:46,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:46,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:46,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbad91df29cd80ecaa3e77/lava_callback.json.gz 2026-05-06 21:08:46,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:08:46,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad91df29cd80ecaa3e77 HTTP/1.1" 200 None 2026-05-06 21:08:46,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:46,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:46,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:46,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad91df29cd80ecaa3e77 HTTP/1.1" 200 None 2026-05-06 21:08:46,555 - lava_callback - INFO - Completed processing callback for node 69fbad91df29cd80ecaa3e77 2026-05-06 21:08:46,683 - lava_callback - INFO - Received callback for node 69fbad80df29cd80ecaa3e3e INFO: 172.21.0.1:56028 - "POST /node/69fbad80df29cd80ecaa3e3e HTTP/1.0" 202 Accepted 2026-05-06 21:08:46,690 - lava_callback - INFO - Starting async job submit for node 69fbad80df29cd80ecaa3e3e 2026-05-06 21:08:46,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:46,717 - lava_callback - INFO - Received callback for node 69fbad8edf29cd80ecaa3e63 INFO: 172.21.0.1:56030 - "POST /node/69fbad8edf29cd80ecaa3e63 HTTP/1.0" 202 Accepted 2026-05-06 21:08:46,723 - lava_callback - INFO - Starting async job submit for node 69fbad8edf29cd80ecaa3e63 2026-05-06 21:08:46,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:46,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad80df29cd80ecaa3e3e HTTP/1.1" 200 None 2026-05-06 21:08:46,752 - lava_callback - DEBUG - Processing node 69fbad80df29cd80ecaa3e3e: baseline-arm64-broonie 2026-05-06 21:08:46,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad8edf29cd80ecaa3e63 HTTP/1.1" 200 None 2026-05-06 21:08:46,827 - lava_callback - DEBUG - Processing node 69fbad8edf29cd80ecaa3e63: baseline-arm64-kontron 2026-05-06 21:08:47,070 - lava_callback - INFO - Received callback for node 69fbad67df29cd80ecaa3dda INFO: 172.21.0.1:56044 - "POST /node/69fbad67df29cd80ecaa3dda HTTP/1.0" 202 Accepted 2026-05-06 21:08:47,194 - lava_callback - INFO - Starting async job submit for node 69fbad67df29cd80ecaa3dda 2026-05-06 21:08:47,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:47,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:47,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad67df29cd80ecaa3dda HTTP/1.1" 200 None 2026-05-06 21:08:47,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:47,361 - lava_callback - DEBUG - Processing node 69fbad67df29cd80ecaa3dda: baseline-nfs-arm64 2026-05-06 21:08:47,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:47,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:47,580 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fbad8edf29cd80ecaa3e63/log.txt.gz 2026-05-06 21:08:47,586 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad80df29cd80ecaa3e3e/log.txt.gz 2026-05-06 21:08:47,977 - lava_callback - INFO - Received callback for node 69fbad69df29cd80ecaa3de0 2026-05-06 21:08:48,052 - lava_callback - INFO - Starting async job submit for node 69fbad69df29cd80ecaa3de0 INFO: 172.21.0.1:56046 - "POST /node/69fbad69df29cd80ecaa3de0 HTTP/1.0" 202 Accepted 2026-05-06 21:08:48,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:48,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:48,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:48,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:48,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad69df29cd80ecaa3de0 HTTP/1.1" 200 None 2026-05-06 21:08:48,142 - lava_callback - DEBUG - Processing node 69fbad69df29cd80ecaa3de0: baseline-nfs-arm64 2026-05-06 21:08:48,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:48,286 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad67df29cd80ecaa3dda/log.txt.gz 2026-05-06 21:08:48,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:48,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:48,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad80df29cd80ecaa3e3e/lava-logs.yaml 2026-05-06 21:08:48,460 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fbad8edf29cd80ecaa3e63/lava-logs.yaml 2026-05-06 21:08:48,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:48,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:48,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:48,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:48,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:48,820 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad69df29cd80ecaa3de0/log.txt.gz 2026-05-06 21:08:48,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:48,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:48,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fbad8edf29cd80ecaa3e63/lava_callback.json.gz 2026-05-06 21:08:48,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:48,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:48,950 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad80df29cd80ecaa3e3e/lava_callback.json.gz 2026-05-06 21:08:48,978 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad67df29cd80ecaa3dda/lava-logs.yaml 2026-05-06 21:08:49,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:49,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad8edf29cd80ecaa3e63 HTTP/1.1" 200 None 2026-05-06 21:08:49,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:49,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:49,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad80df29cd80ecaa3e3e HTTP/1.1" 200 None 2026-05-06 21:08:49,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:49,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:49,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:49,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:49,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:49,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:49,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad8edf29cd80ecaa3e63 HTTP/1.1" 200 None 2026-05-06 21:08:49,181 - lava_callback - INFO - Completed processing callback for node 69fbad8edf29cd80ecaa3e63 2026-05-06 21:08:49,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad80df29cd80ecaa3e3e HTTP/1.1" 200 None 2026-05-06 21:08:49,252 - lava_callback - INFO - Completed processing callback for node 69fbad80df29cd80ecaa3e3e 2026-05-06 21:08:49,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:49,304 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad67df29cd80ecaa3dda/lava_callback.json.gz 2026-05-06 21:08:49,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:49,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad67df29cd80ecaa3dda HTTP/1.1" 200 None 2026-05-06 21:08:49,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:49,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:49,358 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad69df29cd80ecaa3de0/lava-logs.yaml 2026-05-06 21:08:49,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:49,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:49,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:49,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad67df29cd80ecaa3dda HTTP/1.1" 200 None 2026-05-06 21:08:49,409 - lava_callback - INFO - Completed processing callback for node 69fbad67df29cd80ecaa3dda 2026-05-06 21:08:49,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:49,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad69df29cd80ecaa3de0/lava_callback.json.gz 2026-05-06 21:08:49,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:49,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad69df29cd80ecaa3de0 HTTP/1.1" 200 None 2026-05-06 21:08:49,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:49,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:49,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:49,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad69df29cd80ecaa3de0 HTTP/1.1" 200 None 2026-05-06 21:08:49,610 - lava_callback - INFO - Completed processing callback for node 69fbad69df29cd80ecaa3de0 2026-05-06 21:08:51,418 - lava_callback - INFO - Received callback for node 69fbad93df29cd80ecaa3e7d INFO: 172.21.0.1:52464 - "POST /node/69fbad93df29cd80ecaa3e7d HTTP/1.0" 202 Accepted 2026-05-06 21:08:51,425 - lava_callback - INFO - Starting async job submit for node 69fbad93df29cd80ecaa3e7d 2026-05-06 21:08:51,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:51,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad93df29cd80ecaa3e7d HTTP/1.1" 200 None 2026-05-06 21:08:51,468 - lava_callback - DEBUG - Processing node 69fbad93df29cd80ecaa3e7d: baseline-arm64-foundriesio 2026-05-06 21:08:51,850 - lava_callback - INFO - Received callback for node 69fbad6cdf29cd80ecaa3de7 INFO: 172.21.0.1:52466 - "POST /node/69fbad6cdf29cd80ecaa3de7 HTTP/1.0" 202 Accepted 2026-05-06 21:08:51,868 - lava_callback - INFO - Starting async job submit for node 69fbad6cdf29cd80ecaa3de7 2026-05-06 21:08:51,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:51,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:52,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad6cdf29cd80ecaa3de7 HTTP/1.1" 200 None 2026-05-06 21:08:52,002 - lava_callback - DEBUG - Processing node 69fbad6cdf29cd80ecaa3de7: baseline-nfs-arm64 2026-05-06 21:08:52,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:52,205 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbad93df29cd80ecaa3e7d/log.txt.gz 2026-05-06 21:08:52,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:52,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:52,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:52,890 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad6cdf29cd80ecaa3de7/log.txt.gz 2026-05-06 21:08:52,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:52,955 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbad93df29cd80ecaa3e7d/lava-logs.yaml 2026-05-06 21:08:53,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:53,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:53,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:53,266 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbad93df29cd80ecaa3e7d/lava_callback.json.gz 2026-05-06 21:08:53,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:53,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad93df29cd80ecaa3e7d HTTP/1.1" 200 None 2026-05-06 21:08:53,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:53,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:53,337 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad6cdf29cd80ecaa3de7/lava-logs.yaml 2026-05-06 21:08:53,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:53,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:53,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:53,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad93df29cd80ecaa3e7d HTTP/1.1" 200 None 2026-05-06 21:08:53,370 - lava_callback - INFO - Completed processing callback for node 69fbad93df29cd80ecaa3e7d 2026-05-06 21:08:53,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:53,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad6cdf29cd80ecaa3de7/lava_callback.json.gz 2026-05-06 21:08:53,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:53,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad6cdf29cd80ecaa3de7 HTTP/1.1" 200 None 2026-05-06 21:08:53,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:53,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:53,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:53,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad6cdf29cd80ecaa3de7 HTTP/1.1" 200 None 2026-05-06 21:08:53,573 - lava_callback - INFO - Completed processing callback for node 69fbad6cdf29cd80ecaa3de7 2026-05-06 21:08:54,296 - lava_callback - INFO - Received callback for node 69fbad83df29cd80ecaa3e44 INFO: 172.21.0.1:52476 - "POST /node/69fbad83df29cd80ecaa3e44 HTTP/1.0" 202 Accepted 2026-05-06 21:08:54,302 - lava_callback - INFO - Starting async job submit for node 69fbad83df29cd80ecaa3e44 2026-05-06 21:08:54,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:54,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad83df29cd80ecaa3e44 HTTP/1.1" 200 None 2026-05-06 21:08:54,347 - lava_callback - DEBUG - Processing node 69fbad83df29cd80ecaa3e44: baseline-arm64-broonie 2026-05-06 21:08:54,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:54,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:54,684 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad83df29cd80ecaa3e44/log.txt.gz 2026-05-06 21:08:54,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:54,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:54,965 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad83df29cd80ecaa3e44/lava-logs.yaml 2026-05-06 21:08:54,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:55,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:55,058 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad83df29cd80ecaa3e44/lava_callback.json.gz 2026-05-06 21:08:55,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:55,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad83df29cd80ecaa3e44 HTTP/1.1" 200 None 2026-05-06 21:08:55,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:55,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:55,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:55,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad83df29cd80ecaa3e44 HTTP/1.1" 200 None 2026-05-06 21:08:55,134 - lava_callback - INFO - Completed processing callback for node 69fbad83df29cd80ecaa3e44 2026-05-06 21:08:55,654 - lava_callback - INFO - Received callback for node 69fbad5fdf29cd80ecaa3dc2 INFO: 172.21.0.1:52486 - "POST /node/69fbad5fdf29cd80ecaa3dc2 HTTP/1.0" 202 Accepted 2026-05-06 21:08:55,661 - lava_callback - INFO - Starting async job submit for node 69fbad5fdf29cd80ecaa3dc2 2026-05-06 21:08:55,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:55,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad5fdf29cd80ecaa3dc2 HTTP/1.1" 200 None 2026-05-06 21:08:55,705 - lava_callback - DEBUG - Processing node 69fbad5fdf29cd80ecaa3dc2: baseline-nfs-arm64 2026-05-06 21:08:56,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:56,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:56,114 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad5fdf29cd80ecaa3dc2/log.txt.gz 2026-05-06 21:08:56,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:08:56,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:56,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-06 21:08:56,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:56,479 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad5fdf29cd80ecaa3dc2/lava-logs.yaml 2026-05-06 21:08:56,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52500 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:08:56,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:08:56,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad5fdf29cd80ecaa3dc2/lava_callback.json.gz 2026-05-06 21:08:56,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:56,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad5fdf29cd80ecaa3dc2 HTTP/1.1" 200 None 2026-05-06 21:08:56,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:56,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:08:56,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:08:56,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad5fdf29cd80ecaa3dc2 HTTP/1.1" 200 None 2026-05-06 21:08:56,654 - lava_callback - INFO - Completed processing callback for node 69fbad5fdf29cd80ecaa3dc2 INFO: 172.21.0.1:52028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:09:10,741 - lava_callback - INFO - Received callback for node 69f90ae10573a8210e132079 INFO: 172.21.0.1:52522 - "POST /node/69f90ae10573a8210e132079 HTTP/1.0" 202 Accepted 2026-05-06 21:09:10,746 - lava_callback - INFO - Starting async job submit for node 69f90ae10573a8210e132079 2026-05-06 21:09:10,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:10,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ae10573a8210e132079 HTTP/1.1" 200 None 2026-05-06 21:09:10,761 - lava_callback - DEBUG - Processing node 69f90ae10573a8210e132079: baseline-arm-baylibre 2026-05-06 21:09:10,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90ae10573a8210e132079 2026-05-06 21:09:10,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:10,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ae10573a8210e132079 HTTP/1.1" 200 None 2026-05-06 21:09:10,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:10,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:09:10,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:10,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90ae10573a8210e132079 HTTP/1.1" 200 None 2026-05-06 21:09:10,813 - lava_callback - ERROR - Error processing callback for node 69f90ae10573a8210e132079: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 21:09:13,128 - lava_callback - INFO - Received callback for node 69fbad7cdf29cd80ecaa3e33 INFO: 172.21.0.1:52532 - "POST /node/69fbad7cdf29cd80ecaa3e33 HTTP/1.0" 202 Accepted 2026-05-06 21:09:13,134 - lava_callback - INFO - Starting async job submit for node 69fbad7cdf29cd80ecaa3e33 2026-05-06 21:09:13,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:13,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad7cdf29cd80ecaa3e33 HTTP/1.1" 200 None 2026-05-06 21:09:13,177 - lava_callback - DEBUG - Processing node 69fbad7cdf29cd80ecaa3e33: baseline-arm64-broonie 2026-05-06 21:09:13,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:13,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:13,566 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad7cdf29cd80ecaa3e33/log.txt.gz 2026-05-06 21:09:13,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:14,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:14,072 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad7cdf29cd80ecaa3e33/lava-logs.yaml 2026-05-06 21:09:14,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:14,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:14,168 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad7cdf29cd80ecaa3e33/lava_callback.json.gz 2026-05-06 21:09:14,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:14,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad7cdf29cd80ecaa3e33 HTTP/1.1" 200 None 2026-05-06 21:09:14,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:14,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:09:14,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:14,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad7cdf29cd80ecaa3e33 HTTP/1.1" 200 None 2026-05-06 21:09:14,247 - lava_callback - INFO - Completed processing callback for node 69fbad7cdf29cd80ecaa3e33 2026-05-06 21:09:14,566 - lava_callback - INFO - Received callback for node 69fbad7ddf29cd80ecaa3e36 INFO: 172.21.0.1:52534 - "POST /node/69fbad7ddf29cd80ecaa3e36 HTTP/1.0" 202 Accepted 2026-05-06 21:09:14,572 - lava_callback - INFO - Starting async job submit for node 69fbad7ddf29cd80ecaa3e36 2026-05-06 21:09:14,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:14,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad7ddf29cd80ecaa3e36 HTTP/1.1" 200 None 2026-05-06 21:09:14,611 - lava_callback - DEBUG - Processing node 69fbad7ddf29cd80ecaa3e36: baseline-arm64-broonie 2026-05-06 21:09:14,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:14,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:14,996 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad7ddf29cd80ecaa3e36/log.txt.gz 2026-05-06 21:09:15,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52540 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 21:09:15,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:15,307 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad7ddf29cd80ecaa3e36/lava-logs.yaml 2026-05-06 21:09:15,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:15,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:15,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad7ddf29cd80ecaa3e36/lava_callback.json.gz 2026-05-06 21:09:15,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:15,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad7ddf29cd80ecaa3e36 HTTP/1.1" 200 None 2026-05-06 21:09:15,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:15,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:09:15,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:15,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad7ddf29cd80ecaa3e36 HTTP/1.1" 200 None 2026-05-06 21:09:15,478 - lava_callback - INFO - Completed processing callback for node 69fbad7ddf29cd80ecaa3e36 2026-05-06 21:09:15,968 - lava_callback - INFO - Received callback for node 69fbad81df29cd80ecaa3e41 INFO: 172.21.0.1:52550 - "POST /node/69fbad81df29cd80ecaa3e41 HTTP/1.0" 202 Accepted 2026-05-06 21:09:15,974 - lava_callback - INFO - Starting async job submit for node 69fbad81df29cd80ecaa3e41 2026-05-06 21:09:15,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:16,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad81df29cd80ecaa3e41 HTTP/1.1" 200 None 2026-05-06 21:09:16,020 - lava_callback - DEBUG - Processing node 69fbad81df29cd80ecaa3e41: baseline-arm64-broonie 2026-05-06 21:09:16,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:16,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:16,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad81df29cd80ecaa3e41/log.txt.gz INFO: 172.21.0.1:52566 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:09:16,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:16,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:16,658 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad81df29cd80ecaa3e41/lava-logs.yaml 2026-05-06 21:09:16,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:16,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:16,764 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad81df29cd80ecaa3e41/lava_callback.json.gz 2026-05-06 21:09:16,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:16,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad81df29cd80ecaa3e41 HTTP/1.1" 200 None 2026-05-06 21:09:16,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:16,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:09:16,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:16,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad81df29cd80ecaa3e41 HTTP/1.1" 200 None 2026-05-06 21:09:16,840 - lava_callback - INFO - Completed processing callback for node 69fbad81df29cd80ecaa3e41 2026-05-06 21:09:21,914 - lava_callback - INFO - Received callback for node 69fbad8adf29cd80ecaa3e56 INFO: 172.21.0.1:47716 - "POST /node/69fbad8adf29cd80ecaa3e56 HTTP/1.0" 202 Accepted 2026-05-06 21:09:21,920 - lava_callback - INFO - Starting async job submit for node 69fbad8adf29cd80ecaa3e56 2026-05-06 21:09:21,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:21,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad8adf29cd80ecaa3e56 HTTP/1.1" 200 None 2026-05-06 21:09:21,957 - lava_callback - DEBUG - Processing node 69fbad8adf29cd80ecaa3e56: baseline-arm64-clabbe 2026-05-06 21:09:22,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:22,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:22,288 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fbad8adf29cd80ecaa3e56/log.txt.gz 2026-05-06 21:09:22,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:22,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:22,588 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fbad8adf29cd80ecaa3e56/lava-logs.yaml 2026-05-06 21:09:22,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:22,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:22,710 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fbad8adf29cd80ecaa3e56/lava_callback.json.gz 2026-05-06 21:09:22,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:22,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad8adf29cd80ecaa3e56 HTTP/1.1" 200 None 2026-05-06 21:09:22,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:22,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:09:22,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:22,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad8adf29cd80ecaa3e56 HTTP/1.1" 200 None 2026-05-06 21:09:22,791 - lava_callback - INFO - Completed processing callback for node 69fbad8adf29cd80ecaa3e56 2026-05-06 21:09:24,941 - lava_callback - INFO - Received callback for node 69fbad85df29cd80ecaa3e47 INFO: 172.21.0.1:47724 - "POST /node/69fbad85df29cd80ecaa3e47 HTTP/1.0" 202 Accepted 2026-05-06 21:09:24,947 - lava_callback - INFO - Starting async job submit for node 69fbad85df29cd80ecaa3e47 2026-05-06 21:09:24,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:24,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad85df29cd80ecaa3e47 HTTP/1.1" 200 None 2026-05-06 21:09:24,985 - lava_callback - DEBUG - Processing node 69fbad85df29cd80ecaa3e47: baseline-arm64-broonie 2026-05-06 21:09:25,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:25,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:25,315 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad85df29cd80ecaa3e47/log.txt.gz 2026-05-06 21:09:25,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:25,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:25,603 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad85df29cd80ecaa3e47/lava-logs.yaml 2026-05-06 21:09:25,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:25,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:25,703 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad85df29cd80ecaa3e47/lava_callback.json.gz 2026-05-06 21:09:25,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:25,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad85df29cd80ecaa3e47 HTTP/1.1" 200 None 2026-05-06 21:09:25,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:25,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:09:25,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:25,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad85df29cd80ecaa3e47 HTTP/1.1" 200 None 2026-05-06 21:09:25,799 - lava_callback - INFO - Completed processing callback for node 69fbad85df29cd80ecaa3e47 2026-05-06 21:09:26,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:26,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:09:29,544 - lava_callback - INFO - Received callback for node 69fbadffdf29cd80ecaa3fac INFO: 172.21.0.1:47752 - "POST /node/69fbadffdf29cd80ecaa3fac HTTP/1.0" 202 Accepted 2026-05-06 21:09:29,550 - lava_callback - INFO - Starting async job submit for node 69fbadffdf29cd80ecaa3fac 2026-05-06 21:09:29,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:29,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbadffdf29cd80ecaa3fac HTTP/1.1" 200 None 2026-05-06 21:09:29,567 - lava_callback - DEBUG - Processing node 69fbadffdf29cd80ecaa3fac: baseline-nfs-arm64 2026-05-06 21:09:29,568 - lava_callback - WARNING - Failed to upload log 2026-05-06 21:09:29,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:29,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:29,641 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbadffdf29cd80ecaa3fac/lava-logs.yaml 2026-05-06 21:09:29,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:09:29,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:09:29,722 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbadffdf29cd80ecaa3fac/lava_callback.json.gz 2026-05-06 21:09:29,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:29,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbadffdf29cd80ecaa3fac HTTP/1.1" 200 None 2026-05-06 21:09:29,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:29,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:09:29,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:29,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbadffdf29cd80ecaa3fac HTTP/1.1" 200 None 2026-05-06 21:09:29,772 - lava_callback - INFO - Completed processing callback for node 69fbadffdf29cd80ecaa3fac INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41362 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:09:50,586 - lava_callback - INFO - Received callback for node 69f90b090573a8210e132088 INFO: 172.21.0.1:57460 - "POST /node/69f90b090573a8210e132088 HTTP/1.0" 202 Accepted 2026-05-06 21:09:50,591 - lava_callback - INFO - Starting async job submit for node 69f90b090573a8210e132088 2026-05-06 21:09:50,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:50,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90b090573a8210e132088 HTTP/1.1" 200 None 2026-05-06 21:09:50,628 - lava_callback - DEBUG - Processing node 69f90b090573a8210e132088: baseline-arm-baylibre 2026-05-06 21:09:50,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90b090573a8210e132088 2026-05-06 21:09:50,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:50,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90b090573a8210e132088 HTTP/1.1" 200 None 2026-05-06 21:09:50,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:50,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:09:50,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:50,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90b090573a8210e132088 HTTP/1.1" 200 None 2026-05-06 21:09:50,678 - lava_callback - ERROR - Error processing callback for node 69f90b090573a8210e132088: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 21:09:56,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:09:56,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:10:05,120 - lava_callback - INFO - Received callback for node 69fbad7adf29cd80ecaa3e30 INFO: 172.21.0.1:55332 - "POST /node/69fbad7adf29cd80ecaa3e30 HTTP/1.0" 202 Accepted 2026-05-06 21:10:05,126 - lava_callback - INFO - Starting async job submit for node 69fbad7adf29cd80ecaa3e30 2026-05-06 21:10:05,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:05,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad7adf29cd80ecaa3e30 HTTP/1.1" 200 None 2026-05-06 21:10:05,181 - lava_callback - DEBUG - Processing node 69fbad7adf29cd80ecaa3e30: baseline-arm64-broonie 2026-05-06 21:10:05,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:10:05,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:10:05,520 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad7adf29cd80ecaa3e30/log.txt.gz 2026-05-06 21:10:05,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:10:05,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:10:05,806 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad7adf29cd80ecaa3e30/lava-logs.yaml 2026-05-06 21:10:05,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:10:05,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:10:05,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad7adf29cd80ecaa3e30/lava_callback.json.gz 2026-05-06 21:10:05,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:05,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad7adf29cd80ecaa3e30 HTTP/1.1" 200 None 2026-05-06 21:10:05,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:05,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:10:05,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:06,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad7adf29cd80ecaa3e30 HTTP/1.1" 200 None 2026-05-06 21:10:06,021 - lava_callback - INFO - Completed processing callback for node 69fbad7adf29cd80ecaa3e30 INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:10:26,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:26,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:10:30,673 - lava_callback - INFO - Received callback for node 69f90b3a0573a8210e132096 INFO: 172.21.0.1:46648 - "POST /node/69f90b3a0573a8210e132096 HTTP/1.0" 202 Accepted 2026-05-06 21:10:30,678 - lava_callback - INFO - Starting async job submit for node 69f90b3a0573a8210e132096 2026-05-06 21:10:30,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:30,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90b3a0573a8210e132096 HTTP/1.1" 200 None 2026-05-06 21:10:30,694 - lava_callback - DEBUG - Processing node 69f90b3a0573a8210e132096: baseline-arm-baylibre 2026-05-06 21:10:30,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90b3a0573a8210e132096 2026-05-06 21:10:30,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:30,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90b3a0573a8210e132096 HTTP/1.1" 200 None 2026-05-06 21:10:30,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:30,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:10:30,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:30,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90b3a0573a8210e132096 HTTP/1.1" 200 None 2026-05-06 21:10:30,738 - lava_callback - ERROR - Error processing callback for node 69f90b3a0573a8210e132096: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54040 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:10:48,846 - lava_callback - INFO - Received callback for node 69fbad51df29cd80ecaa3d82 INFO: 172.21.0.1:54056 - "POST /node/69fbad51df29cd80ecaa3d82 HTTP/1.0" 202 Accepted 2026-05-06 21:10:48,851 - lava_callback - INFO - Starting async job submit for node 69fbad51df29cd80ecaa3d82 2026-05-06 21:10:48,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:48,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad51df29cd80ecaa3d82 HTTP/1.1" 200 None 2026-05-06 21:10:48,894 - lava_callback - DEBUG - Processing node 69fbad51df29cd80ecaa3d82: baseline-arm64 2026-05-06 21:10:49,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:10:49,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:10:49,359 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad51df29cd80ecaa3d82/log.txt.gz 2026-05-06 21:10:49,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:10:49,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:10:49,724 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad51df29cd80ecaa3d82/lava-logs.yaml 2026-05-06 21:10:49,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:10:49,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:10:49,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad51df29cd80ecaa3d82/lava_callback.json.gz 2026-05-06 21:10:49,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:49,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad51df29cd80ecaa3d82 HTTP/1.1" 200 None 2026-05-06 21:10:49,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:49,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:10:49,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:49,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad51df29cd80ecaa3d82 HTTP/1.1" 200 None 2026-05-06 21:10:50,026 - lava_callback - INFO - Completed processing callback for node 69fbad51df29cd80ecaa3d82 2026-05-06 21:10:56,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:56,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-06 21:10:56,477 - lava_callback - INFO - Received callback for node 69fbad60df29cd80ecaa3dc5 INFO: 172.21.0.1:50532 - "POST /node/69fbad60df29cd80ecaa3dc5 HTTP/1.0" 202 Accepted 2026-05-06 21:10:56,483 - lava_callback - INFO - Starting async job submit for node 69fbad60df29cd80ecaa3dc5 2026-05-06 21:10:56,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50548 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:10:56,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad60df29cd80ecaa3dc5 HTTP/1.1" 200 None 2026-05-06 21:10:56,519 - lava_callback - DEBUG - Processing node 69fbad60df29cd80ecaa3dc5: baseline-nfs-arm64 2026-05-06 21:10:56,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:10:57,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:10:57,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad60df29cd80ecaa3dc5/log.txt.gz 2026-05-06 21:10:57,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:10:57,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:10:57,438 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad60df29cd80ecaa3dc5/lava-logs.yaml 2026-05-06 21:10:57,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:10:57,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:10:57,559 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad60df29cd80ecaa3dc5/lava_callback.json.gz 2026-05-06 21:10:57,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:57,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad60df29cd80ecaa3dc5 HTTP/1.1" 200 None 2026-05-06 21:10:57,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:57,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:10:57,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:10:57,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad60df29cd80ecaa3dc5 HTTP/1.1" 200 None 2026-05-06 21:10:57,627 - lava_callback - INFO - Completed processing callback for node 69fbad60df29cd80ecaa3dc5 2026-05-06 21:11:05,032 - lava_callback - INFO - Received callback for node 69fbad7edf29cd80ecaa3e3b INFO: 172.21.0.1:43908 - "POST /node/69fbad7edf29cd80ecaa3e3b HTTP/1.0" 202 Accepted 2026-05-06 21:11:05,038 - lava_callback - INFO - Starting async job submit for node 69fbad7edf29cd80ecaa3e3b 2026-05-06 21:11:05,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:11:05,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad7edf29cd80ecaa3e3b HTTP/1.1" 200 None 2026-05-06 21:11:05,076 - lava_callback - DEBUG - Processing node 69fbad7edf29cd80ecaa3e3b: baseline-arm64-broonie 2026-05-06 21:11:05,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:11:05,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:11:05,465 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad7edf29cd80ecaa3e3b/log.txt.gz 2026-05-06 21:11:05,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:11:05,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:11:05,797 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad7edf29cd80ecaa3e3b/lava-logs.yaml 2026-05-06 21:11:05,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:11:05,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:11:05,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fbad7edf29cd80ecaa3e3b/lava_callback.json.gz 2026-05-06 21:11:05,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:11:05,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad7edf29cd80ecaa3e3b HTTP/1.1" 200 None 2026-05-06 21:11:05,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:11:05,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:11:05,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:11:05,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad7edf29cd80ecaa3e3b HTTP/1.1" 200 None 2026-05-06 21:11:05,994 - lava_callback - INFO - Completed processing callback for node 69fbad7edf29cd80ecaa3e3b INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:11:26,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:11:26,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:11:30,655 - lava_callback - INFO - Received callback for node 69f90b770573a8210e1320a9 INFO: 172.21.0.1:47266 - "POST /node/69f90b770573a8210e1320a9 HTTP/1.0" 202 Accepted 2026-05-06 21:11:30,660 - lava_callback - INFO - Starting async job submit for node 69f90b770573a8210e1320a9 2026-05-06 21:11:30,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:11:30,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90b770573a8210e1320a9 HTTP/1.1" 200 None 2026-05-06 21:11:30,683 - lava_callback - DEBUG - Processing node 69f90b770573a8210e1320a9: baseline-arm-baylibre 2026-05-06 21:11:30,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90b770573a8210e1320a9 2026-05-06 21:11:30,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:11:30,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90b770573a8210e1320a9 HTTP/1.1" 200 None 2026-05-06 21:11:30,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:11:30,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:11:30,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:11:30,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90b770573a8210e1320a9 HTTP/1.1" 200 None 2026-05-06 21:11:30,728 - lava_callback - ERROR - Error processing callback for node 69f90b770573a8210e1320a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:12:10,736 - lava_callback - INFO - Received callback for node 69f90ba00573a8210e1320ba INFO: 172.21.0.1:58656 - "POST /node/69f90ba00573a8210e1320ba HTTP/1.0" 202 Accepted 2026-05-06 21:12:10,741 - lava_callback - INFO - Starting async job submit for node 69f90ba00573a8210e1320ba 2026-05-06 21:12:10,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:12:10,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ba00573a8210e1320ba HTTP/1.1" 200 None 2026-05-06 21:12:10,756 - lava_callback - DEBUG - Processing node 69f90ba00573a8210e1320ba: baseline-arm-baylibre 2026-05-06 21:12:10,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90ba00573a8210e1320ba 2026-05-06 21:12:10,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:12:10,764 - lava_callback - INFO - Received callback for node 69fbad5edf29cd80ecaa3dbf INFO: 172.21.0.1:58668 - "POST /node/69fbad5edf29cd80ecaa3dbf HTTP/1.0" 202 Accepted 2026-05-06 21:12:10,772 - lava_callback - INFO - Starting async job submit for node 69fbad5edf29cd80ecaa3dbf 2026-05-06 21:12:10,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ba00573a8210e1320ba HTTP/1.1" 200 None 2026-05-06 21:12:10,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:12:10,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:12:10,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad5edf29cd80ecaa3dbf HTTP/1.1" 200 None 2026-05-06 21:12:10,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:12:10,824 - lava_callback - DEBUG - Processing node 69fbad5edf29cd80ecaa3dbf: baseline-arm64 2026-05-06 21:12:10,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:12:10,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90ba00573a8210e1320ba HTTP/1.1" 200 None 2026-05-06 21:12:10,937 - lava_callback - ERROR - Error processing callback for node 69f90ba00573a8210e1320ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 21:12:11,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:12:11,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:12:11,409 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad5edf29cd80ecaa3dbf/log.txt.gz 2026-05-06 21:12:11,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:12:11,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:12:11,810 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad5edf29cd80ecaa3dbf/lava-logs.yaml 2026-05-06 21:12:11,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:12:11,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:12:11,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad5edf29cd80ecaa3dbf/lava_callback.json.gz DEBUG: Setup failed for 69fbad5edf29cd80ecaa3dbf. Transitting job node result: incomplete -> fail 2026-05-06 21:12:12,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:12:12,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad5edf29cd80ecaa3dbf HTTP/1.1" 200 None 2026-05-06 21:12:12,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:12:12,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:12:12,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:12:12,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad5edf29cd80ecaa3dbf HTTP/1.1" 200 None 2026-05-06 21:12:12,124 - lava_callback - INFO - Completed processing callback for node 69fbad5edf29cd80ecaa3dbf 2026-05-06 21:12:14,484 - lava_callback - INFO - Received callback for node 69fbae69df29cd80ecaa400b INFO: 172.21.0.1:58670 - "POST /node/69fbae69df29cd80ecaa400b HTTP/1.0" 202 Accepted 2026-05-06 21:12:14,490 - lava_callback - INFO - Starting async job submit for node 69fbae69df29cd80ecaa400b 2026-05-06 21:12:14,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:12:14,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbae69df29cd80ecaa400b HTTP/1.1" 200 None 2026-05-06 21:12:14,535 - lava_callback - DEBUG - Processing node 69fbae69df29cd80ecaa400b: baseline-arm64 2026-05-06 21:12:14,670 - lava_callback - WARNING - Failed to upload log 2026-05-06 21:12:14,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:12:15,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:12:15,032 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbae69df29cd80ecaa400b/lava-logs.yaml 2026-05-06 21:12:15,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:12:15,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:12:15,126 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbae69df29cd80ecaa400b/lava_callback.json.gz 2026-05-06 21:12:15,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:58686 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 21:12:15,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbae69df29cd80ecaa400b HTTP/1.1" 200 None 2026-05-06 21:12:15,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:12:15,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:12:15,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:12:15,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbae69df29cd80ecaa400b HTTP/1.1" 200 None 2026-05-06 21:12:15,300 - lava_callback - INFO - Completed processing callback for node 69fbae69df29cd80ecaa400b INFO: 172.21.0.1:58698 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:12:26,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:12:26,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:13:14,216 - lava_callback - INFO - Received callback for node 69fbaeb3df29cd80ecaa4040 INFO: 172.21.0.1:34168 - "POST /node/69fbaeb3df29cd80ecaa4040 HTTP/1.0" 202 Accepted 2026-05-06 21:13:14,223 - lava_callback - INFO - Starting async job submit for node 69fbaeb3df29cd80ecaa4040 2026-05-06 21:13:14,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:13:14,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaeb3df29cd80ecaa4040 HTTP/1.1" 200 None 2026-05-06 21:13:14,276 - lava_callback - DEBUG - Processing node 69fbaeb3df29cd80ecaa4040: baseline-arm64 2026-05-06 21:13:14,416 - lava_callback - WARNING - Failed to upload log 2026-05-06 21:13:14,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:13:14,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:13:14,627 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbaeb3df29cd80ecaa4040/lava-logs.yaml 2026-05-06 21:13:14,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:13:14,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:13:14,725 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbaeb3df29cd80ecaa4040/lava_callback.json.gz 2026-05-06 21:13:14,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:13:14,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaeb3df29cd80ecaa4040 HTTP/1.1" 200 None 2026-05-06 21:13:14,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:13:14,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:13:14,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:13:14,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbaeb3df29cd80ecaa4040 HTTP/1.1" 200 None 2026-05-06 21:13:14,884 - lava_callback - INFO - Completed processing callback for node 69fbaeb3df29cd80ecaa4040 INFO: 172.21.0.1:34184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:13:26,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:13:26,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-06 21:13:30,830 - lava_callback - INFO - Received callback for node 69f90bef0573a8210e1320ca INFO: 172.21.0.1:39346 - "POST /node/69f90bef0573a8210e1320ca HTTP/1.0" 202 Accepted 2026-05-06 21:13:30,835 - lava_callback - INFO - Starting async job submit for node 69f90bef0573a8210e1320ca 2026-05-06 21:13:30,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:13:30,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90bef0573a8210e1320ca HTTP/1.1" 200 None 2026-05-06 21:13:30,850 - lava_callback - DEBUG - Processing node 69f90bef0573a8210e1320ca: baseline-arm-baylibre 2026-05-06 21:13:30,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90bef0573a8210e1320ca 2026-05-06 21:13:30,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:13:30,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90bef0573a8210e1320ca HTTP/1.1" 200 None 2026-05-06 21:13:30,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:13:30,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:13:30,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:13:30,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90bef0573a8210e1320ca HTTP/1.1" 200 None 2026-05-06 21:13:30,911 - lava_callback - ERROR - Error processing callback for node 69f90bef0573a8210e1320ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:14:30,900 - lava_callback - INFO - Received callback for node 69f90c2d0573a8210e1320db INFO: 172.21.0.1:56698 - "POST /node/69f90c2d0573a8210e1320db HTTP/1.0" 202 Accepted 2026-05-06 21:14:30,906 - lava_callback - INFO - Starting async job submit for node 69f90c2d0573a8210e1320db 2026-05-06 21:14:30,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:14:30,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90c2d0573a8210e1320db HTTP/1.1" 200 None 2026-05-06 21:14:30,921 - lava_callback - DEBUG - Processing node 69f90c2d0573a8210e1320db: baseline-arm-baylibre 2026-05-06 21:14:30,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90c2d0573a8210e1320db 2026-05-06 21:14:30,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:14:30,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90c2d0573a8210e1320db HTTP/1.1" 200 None 2026-05-06 21:14:30,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:14:30,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:14:30,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:14:30,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90c2d0573a8210e1320db HTTP/1.1" 200 None 2026-05-06 21:14:30,975 - lava_callback - ERROR - Error processing callback for node 69f90c2d0573a8210e1320db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:15:30,980 - lava_callback - INFO - Received callback for node 69f90c660573a8210e1320e8 INFO: 172.21.0.1:52400 - "POST /node/69f90c660573a8210e1320e8 HTTP/1.0" 202 Accepted 2026-05-06 21:15:30,985 - lava_callback - INFO - Starting async job submit for node 69f90c660573a8210e1320e8 2026-05-06 21:15:30,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:15:31,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90c660573a8210e1320e8 HTTP/1.1" 200 None 2026-05-06 21:15:31,007 - lava_callback - DEBUG - Processing node 69f90c660573a8210e1320e8: baseline-arm-baylibre 2026-05-06 21:15:31,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90c660573a8210e1320e8 2026-05-06 21:15:31,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:15:31,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90c660573a8210e1320e8 HTTP/1.1" 200 None 2026-05-06 21:15:31,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:15:31,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:15:31,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:15:31,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90c660573a8210e1320e8 HTTP/1.1" 200 None 2026-05-06 21:15:31,054 - lava_callback - ERROR - Error processing callback for node 69f90c660573a8210e1320e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:16:30,914 - lava_callback - INFO - Received callback for node 69f90ca30573a8210e1320f6 INFO: 172.21.0.1:42264 - "POST /node/69f90ca30573a8210e1320f6 HTTP/1.0" 202 Accepted 2026-05-06 21:16:30,919 - lava_callback - INFO - Starting async job submit for node 69f90ca30573a8210e1320f6 2026-05-06 21:16:30,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:16:30,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ca30573a8210e1320f6 HTTP/1.1" 200 None 2026-05-06 21:16:30,935 - lava_callback - DEBUG - Processing node 69f90ca30573a8210e1320f6: baseline-arm-baylibre 2026-05-06 21:16:30,935 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90ca30573a8210e1320f6 2026-05-06 21:16:30,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:16:30,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ca30573a8210e1320f6 HTTP/1.1" 200 None 2026-05-06 21:16:30,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:16:30,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:16:30,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:16:30,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90ca30573a8210e1320f6 HTTP/1.1" 200 None 2026-05-06 21:16:30,984 - lava_callback - ERROR - Error processing callback for node 69f90ca30573a8210e1320f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45398 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:17:24,185 - lava_callback - INFO - Received callback for node 69fbad93df29cd80ecaa3e7a INFO: 172.21.0.1:55168 - "POST /node/69fbad93df29cd80ecaa3e7a HTTP/1.0" 202 Accepted 2026-05-06 21:17:24,191 - lava_callback - INFO - Starting async job submit for node 69fbad93df29cd80ecaa3e7a 2026-05-06 21:17:24,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:24,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad93df29cd80ecaa3e7a HTTP/1.1" 200 None 2026-05-06 21:17:24,265 - lava_callback - DEBUG - Processing node 69fbad93df29cd80ecaa3e7a: baseline-arm64-foundriesio 2026-05-06 21:17:24,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:17:25,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:17:25,016 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbad93df29cd80ecaa3e7a/log.txt.gz 2026-05-06 21:17:25,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:17:25,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:17:25,611 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbad93df29cd80ecaa3e7a/lava-logs.yaml 2026-05-06 21:17:25,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:17:25,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:17:25,739 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbad93df29cd80ecaa3e7a/lava_callback.json.gz 2026-05-06 21:17:25,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:25,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad93df29cd80ecaa3e7a HTTP/1.1" 200 None 2026-05-06 21:17:25,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:25,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:17:25,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:25,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad93df29cd80ecaa3e7a HTTP/1.1" 200 None 2026-05-06 21:17:25,874 - lava_callback - INFO - Completed processing callback for node 69fbad93df29cd80ecaa3e7a INFO: 172.21.0.1:55184 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:17:26,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:26,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-06 21:17:28,782 - lava_callback - INFO - Received callback for node 69fbad59df29cd80ecaa3d99 INFO: 172.21.0.1:55198 - "POST /node/69fbad59df29cd80ecaa3d99 HTTP/1.0" 202 Accepted 2026-05-06 21:17:28,788 - lava_callback - INFO - Starting async job submit for node 69fbad59df29cd80ecaa3d99 2026-05-06 21:17:28,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:28,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad59df29cd80ecaa3d99 HTTP/1.1" 200 None 2026-05-06 21:17:28,826 - lava_callback - DEBUG - Processing node 69fbad59df29cd80ecaa3d99: baseline-arm64 2026-05-06 21:17:29,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:17:29,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:17:29,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad59df29cd80ecaa3d99/log.txt.gz 2026-05-06 21:17:29,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:17:29,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:17:29,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad59df29cd80ecaa3d99/lava-logs.yaml 2026-05-06 21:17:29,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:17:29,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:17:29,922 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbad59df29cd80ecaa3d99/lava_callback.json.gz 2026-05-06 21:17:29,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:29,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad59df29cd80ecaa3d99 HTTP/1.1" 200 None 2026-05-06 21:17:29,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:30,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:17:30,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:30,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad59df29cd80ecaa3d99 HTTP/1.1" 200 None 2026-05-06 21:17:30,100 - lava_callback - INFO - Completed processing callback for node 69fbad59df29cd80ecaa3d99 2026-05-06 21:17:31,008 - lava_callback - INFO - Received callback for node 69f90ce60573a8210e132108 INFO: 172.21.0.1:45904 - "POST /node/69f90ce60573a8210e132108 HTTP/1.0" 202 Accepted 2026-05-06 21:17:31,014 - lava_callback - INFO - Starting async job submit for node 69f90ce60573a8210e132108 2026-05-06 21:17:31,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:31,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ce60573a8210e132108 HTTP/1.1" 200 None 2026-05-06 21:17:31,029 - lava_callback - DEBUG - Processing node 69f90ce60573a8210e132108: baseline-arm64-baylibre 2026-05-06 21:17:31,030 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90ce60573a8210e132108 2026-05-06 21:17:31,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:31,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ce60573a8210e132108 HTTP/1.1" 200 None 2026-05-06 21:17:31,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:31,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:17:31,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:31,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90ce60573a8210e132108 HTTP/1.1" 200 None 2026-05-06 21:17:31,075 - lava_callback - ERROR - Error processing callback for node 69f90ce60573a8210e132108: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56524 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:17:54,713 - lava_callback - INFO - Received callback for node 69fbafbddf29cd80ecaa40b0 INFO: 172.21.0.1:57318 - "POST /node/69fbafbddf29cd80ecaa40b0 HTTP/1.0" 202 Accepted 2026-05-06 21:17:54,720 - lava_callback - INFO - Starting async job submit for node 69fbafbddf29cd80ecaa40b0 2026-05-06 21:17:54,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:54,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbafbddf29cd80ecaa40b0 HTTP/1.1" 200 None 2026-05-06 21:17:54,753 - lava_callback - DEBUG - Processing node 69fbafbddf29cd80ecaa40b0: baseline-arm64 2026-05-06 21:17:55,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:17:55,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:17:55,270 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbafbddf29cd80ecaa40b0/log.txt.gz 2026-05-06 21:17:55,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:17:55,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:17:55,840 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbafbddf29cd80ecaa40b0/lava-logs.yaml 2026-05-06 21:17:55,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:17:55,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:17:55,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbafbddf29cd80ecaa40b0/lava_callback.json.gz 2026-05-06 21:17:55,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:56,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbafbddf29cd80ecaa40b0 HTTP/1.1" 200 None 2026-05-06 21:17:56,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:56,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:17:56,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:56,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbafbddf29cd80ecaa40b0 HTTP/1.1" 200 None 2026-05-06 21:17:56,041 - lava_callback - INFO - Completed processing callback for node 69fbafbddf29cd80ecaa40b0 INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:17:56,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:56,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-06 21:17:59,778 - lava_callback - INFO - Received callback for node 69fbad68df29cd80ecaa3ddd INFO: 172.21.0.1:56650 - "POST /node/69fbad68df29cd80ecaa3ddd HTTP/1.0" 202 Accepted 2026-05-06 21:17:59,785 - lava_callback - INFO - Starting async job submit for node 69fbad68df29cd80ecaa3ddd 2026-05-06 21:17:59,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:17:59,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad68df29cd80ecaa3ddd HTTP/1.1" 200 None 2026-05-06 21:17:59,826 - lava_callback - DEBUG - Processing node 69fbad68df29cd80ecaa3ddd: baseline-nfs-arm64 2026-05-06 21:18:00,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:18:00,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:18:00,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad68df29cd80ecaa3ddd/log.txt.gz 2026-05-06 21:18:00,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:18:00,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:18:00,989 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad68df29cd80ecaa3ddd/lava-logs.yaml 2026-05-06 21:18:01,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:18:01,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:18:01,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad68df29cd80ecaa3ddd/lava_callback.json.gz 2026-05-06 21:18:01,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:18:01,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad68df29cd80ecaa3ddd HTTP/1.1" 200 None 2026-05-06 21:18:01,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:18:01,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:18:01,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:18:01,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad68df29cd80ecaa3ddd HTTP/1.1" 200 None 2026-05-06 21:18:01,492 - lava_callback - INFO - Completed processing callback for node 69fbad68df29cd80ecaa3ddd INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:18:26,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:18:26,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59830 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:18:51,118 - lava_callback - INFO - Received callback for node 69f90d300573a8210e13212e INFO: 172.21.0.1:53188 - "POST /node/69f90d300573a8210e13212e HTTP/1.0" 202 Accepted 2026-05-06 21:18:51,123 - lava_callback - INFO - Starting async job submit for node 69f90d300573a8210e13212e 2026-05-06 21:18:51,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:18:51,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90d300573a8210e13212e HTTP/1.1" 200 None 2026-05-06 21:18:51,139 - lava_callback - DEBUG - Processing node 69f90d300573a8210e13212e: baseline-arm-baylibre 2026-05-06 21:18:51,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90d300573a8210e13212e 2026-05-06 21:18:51,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:18:51,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90d300573a8210e13212e HTTP/1.1" 200 None 2026-05-06 21:18:51,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:18:51,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:18:51,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:18:51,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90d300573a8210e13212e HTTP/1.1" 200 None 2026-05-06 21:18:51,193 - lava_callback - ERROR - Error processing callback for node 69f90d300573a8210e13212e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45194 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:19:30,748 - lava_callback - INFO - Received callback for node 69f90d5c0573a8210e13213d INFO: 172.21.0.1:42290 - "POST /node/69f90d5c0573a8210e13213d HTTP/1.0" 202 Accepted 2026-05-06 21:19:30,753 - lava_callback - INFO - Starting async job submit for node 69f90d5c0573a8210e13213d 2026-05-06 21:19:30,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:19:30,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90d5c0573a8210e13213d HTTP/1.1" 200 None 2026-05-06 21:19:30,771 - lava_callback - DEBUG - Processing node 69f90d5c0573a8210e13213d: baseline-arm-clabbe 2026-05-06 21:19:30,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90d5c0573a8210e13213d 2026-05-06 21:19:30,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:19:30,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90d5c0573a8210e13213d HTTP/1.1" 200 None 2026-05-06 21:19:30,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:19:30,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:19:30,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:19:30,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90d5c0573a8210e13213d HTTP/1.1" 200 None 2026-05-06 21:19:30,815 - lava_callback - ERROR - Error processing callback for node 69f90d5c0573a8210e13213d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:19:39,840 - lava_callback - INFO - Received callback for node 69fbb03edf29cd80ecaa40f4 INFO: 172.21.0.1:32936 - "POST /node/69fbb03edf29cd80ecaa40f4 HTTP/1.0" 202 Accepted 2026-05-06 21:19:39,846 - lava_callback - INFO - Starting async job submit for node 69fbb03edf29cd80ecaa40f4 2026-05-06 21:19:39,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:19:39,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb03edf29cd80ecaa40f4 HTTP/1.1" 200 None 2026-05-06 21:19:39,881 - lava_callback - DEBUG - Processing node 69fbb03edf29cd80ecaa40f4: baseline-arm64-pengutronix 2026-05-06 21:19:40,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:19:40,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:19:40,166 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbb03edf29cd80ecaa40f4/log.txt.gz 2026-05-06 21:19:40,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:19:40,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:19:40,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbb03edf29cd80ecaa40f4/lava-logs.yaml 2026-05-06 21:19:40,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:19:40,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:19:40,550 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fbb03edf29cd80ecaa40f4/lava_callback.json.gz 2026-05-06 21:19:40,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:19:40,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb03edf29cd80ecaa40f4 HTTP/1.1" 200 None 2026-05-06 21:19:40,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:19:40,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:19:40,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:19:40,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb03edf29cd80ecaa40f4 HTTP/1.1" 200 None 2026-05-06 21:19:40,644 - lava_callback - INFO - Completed processing callback for node 69fbb03edf29cd80ecaa40f4 INFO: 172.21.0.1:32950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:19:56,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:19:56,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60486 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:20:10,337 - lava_callback - INFO - Received callback for node 69fbb07adf29cd80ecaa4119 INFO: 172.21.0.1:60492 - "POST /node/69fbb07adf29cd80ecaa4119 HTTP/1.0" 202 Accepted 2026-05-06 21:20:10,345 - lava_callback - INFO - Starting async job submit for node 69fbb07adf29cd80ecaa4119 2026-05-06 21:20:10,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:10,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb07adf29cd80ecaa4119 HTTP/1.1" 200 None 2026-05-06 21:20:10,381 - lava_callback - DEBUG - Processing node 69fbb07adf29cd80ecaa4119: baseline-nfs-arm64 2026-05-06 21:20:10,383 - lava_callback - WARNING - Failed to upload log 2026-05-06 21:20:10,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:20:10,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:20:10,486 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbb07adf29cd80ecaa4119/lava-logs.yaml 2026-05-06 21:20:10,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:20:10,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:20:10,560 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbb07adf29cd80ecaa4119/lava_callback.json.gz 2026-05-06 21:20:10,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:10,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb07adf29cd80ecaa4119 HTTP/1.1" 200 None 2026-05-06 21:20:10,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:10,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:20:10,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:10,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb07adf29cd80ecaa4119 HTTP/1.1" 200 None 2026-05-06 21:20:10,623 - lava_callback - INFO - Completed processing callback for node 69fbb07adf29cd80ecaa4119 2026-05-06 21:20:11,164 - lava_callback - INFO - Received callback for node 69f90d810573a8210e13214c INFO: 172.21.0.1:60494 - "POST /node/69f90d810573a8210e13214c HTTP/1.0" 202 Accepted 2026-05-06 21:20:11,169 - lava_callback - INFO - Starting async job submit for node 69f90d810573a8210e13214c 2026-05-06 21:20:11,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:11,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90d810573a8210e13214c HTTP/1.1" 200 None 2026-05-06 21:20:11,184 - lava_callback - DEBUG - Processing node 69f90d810573a8210e13214c: baseline-arm-baylibre 2026-05-06 21:20:11,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90d810573a8210e13214c 2026-05-06 21:20:11,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:11,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90d810573a8210e13214c HTTP/1.1" 200 None 2026-05-06 21:20:11,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:11,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:20:11,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:11,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90d810573a8210e13214c HTTP/1.1" 200 None 2026-05-06 21:20:11,237 - lava_callback - ERROR - Error processing callback for node 69f90d810573a8210e13214c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:20:26,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:26,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:20:51,134 - lava_callback - INFO - Received callback for node 69f90db00573a8210e13215c INFO: 172.21.0.1:46078 - "POST /node/69f90db00573a8210e13215c HTTP/1.0" 202 Accepted 2026-05-06 21:20:51,140 - lava_callback - INFO - Starting async job submit for node 69f90db00573a8210e13215c 2026-05-06 21:20:51,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:51,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90db00573a8210e13215c HTTP/1.1" 200 None 2026-05-06 21:20:51,156 - lava_callback - DEBUG - Processing node 69f90db00573a8210e13215c: baseline-arm64-baylibre 2026-05-06 21:20:51,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90db00573a8210e13215c 2026-05-06 21:20:51,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:51,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90db00573a8210e13215c HTTP/1.1" 200 None 2026-05-06 21:20:51,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:51,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:20:51,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:20:51,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90db00573a8210e13215c HTTP/1.1" 200 None 2026-05-06 21:20:51,211 - lava_callback - ERROR - Error processing callback for node 69f90db00573a8210e13215c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58382 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:22:11,251 - lava_callback - INFO - Received callback for node 69f90dfc0573a8210e132185 INFO: 172.21.0.1:58388 - "POST /node/69f90dfc0573a8210e132185 HTTP/1.0" 202 Accepted 2026-05-06 21:22:11,257 - lava_callback - INFO - Starting async job submit for node 69f90dfc0573a8210e132185 2026-05-06 21:22:11,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:22:11,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90dfc0573a8210e132185 HTTP/1.1" 200 None 2026-05-06 21:22:11,272 - lava_callback - DEBUG - Processing node 69f90dfc0573a8210e132185: baseline-arm-baylibre 2026-05-06 21:22:11,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90dfc0573a8210e132185 2026-05-06 21:22:11,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:22:11,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90dfc0573a8210e132185 HTTP/1.1" 200 None 2026-05-06 21:22:11,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:22:11,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:22:11,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:22:11,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90dfc0573a8210e132185 HTTP/1.1" 200 None 2026-05-06 21:22:11,325 - lava_callback - ERROR - Error processing callback for node 69f90dfc0573a8210e132185: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38560 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:23:11,296 - lava_callback - INFO - Received callback for node 69f90e2b0573a8210e132195 INFO: 172.21.0.1:38574 - "POST /node/69f90e2b0573a8210e132195 HTTP/1.0" 202 Accepted 2026-05-06 21:23:11,301 - lava_callback - INFO - Starting async job submit for node 69f90e2b0573a8210e132195 2026-05-06 21:23:11,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:23:11,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90e2b0573a8210e132195 HTTP/1.1" 200 None 2026-05-06 21:23:11,317 - lava_callback - DEBUG - Processing node 69f90e2b0573a8210e132195: baseline-arm64-baylibre 2026-05-06 21:23:11,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90e2b0573a8210e132195 2026-05-06 21:23:11,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:23:11,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90e2b0573a8210e132195 HTTP/1.1" 200 None 2026-05-06 21:23:11,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:23:11,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:23:11,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:23:11,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90e2b0573a8210e132195 HTTP/1.1" 200 None 2026-05-06 21:23:11,375 - lava_callback - ERROR - Error processing callback for node 69f90e2b0573a8210e132195: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:24:10,871 - lava_callback - INFO - Received callback for node 69f90e770573a8210e1321ba INFO: 172.21.0.1:48728 - "POST /node/69f90e770573a8210e1321ba HTTP/1.0" 202 Accepted 2026-05-06 21:24:10,877 - lava_callback - INFO - Starting async job submit for node 69f90e770573a8210e1321ba 2026-05-06 21:24:10,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:24:10,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90e770573a8210e1321ba HTTP/1.1" 200 None 2026-05-06 21:24:10,891 - lava_callback - DEBUG - Processing node 69f90e770573a8210e1321ba: baseline-arm-clabbe 2026-05-06 21:24:10,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90e770573a8210e1321ba 2026-05-06 21:24:10,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:24:10,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90e770573a8210e1321ba HTTP/1.1" 200 None 2026-05-06 21:24:10,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:24:10,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:24:10,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:24:10,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90e770573a8210e1321ba HTTP/1.1" 200 None 2026-05-06 21:24:10,968 - lava_callback - ERROR - Error processing callback for node 69f90e770573a8210e1321ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33874 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:24:50,819 - lava_callback - INFO - Received callback for node 69f90ea00573a8210e1321cb INFO: 172.21.0.1:54404 - "POST /node/69f90ea00573a8210e1321cb HTTP/1.0" 202 Accepted 2026-05-06 21:24:50,824 - lava_callback - INFO - Starting async job submit for node 69f90ea00573a8210e1321cb 2026-05-06 21:24:50,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:24:50,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ea00573a8210e1321cb HTTP/1.1" 200 None 2026-05-06 21:24:50,847 - lava_callback - DEBUG - Processing node 69f90ea00573a8210e1321cb: baseline-arm-clabbe 2026-05-06 21:24:50,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90ea00573a8210e1321cb 2026-05-06 21:24:50,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:24:50,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ea00573a8210e1321cb HTTP/1.1" 200 None 2026-05-06 21:24:50,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:24:50,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:24:50,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:24:50,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90ea00573a8210e1321cb HTTP/1.1" 200 None 2026-05-06 21:24:50,895 - lava_callback - ERROR - Error processing callback for node 69f90ea00573a8210e1321cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:25:28,471 - lava_callback - INFO - Received callback for node 69fbb0e1df29cd80ecaa414f INFO: 172.21.0.1:35020 - "POST /node/69fbb0e1df29cd80ecaa414f HTTP/1.0" 202 Accepted 2026-05-06 21:25:28,476 - lava_callback - INFO - Starting async job submit for node 69fbb0e1df29cd80ecaa414f 2026-05-06 21:25:28,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:25:28,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb0e1df29cd80ecaa414f HTTP/1.1" 200 None 2026-05-06 21:25:28,508 - lava_callback - DEBUG - Processing node 69fbb0e1df29cd80ecaa414f: baseline-arm64 2026-05-06 21:25:28,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:25:29,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:25:29,125 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb0e1df29cd80ecaa414f/log.txt.gz 2026-05-06 21:25:29,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:25:29,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:25:29,663 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb0e1df29cd80ecaa414f/lava-logs.yaml 2026-05-06 21:25:29,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:25:29,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:25:29,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb0e1df29cd80ecaa414f/lava_callback.json.gz 2026-05-06 21:25:29,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:25:29,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb0e1df29cd80ecaa414f HTTP/1.1" 200 None 2026-05-06 21:25:29,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:25:29,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:25:29,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:25:29,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb0e1df29cd80ecaa414f HTTP/1.1" 200 None 2026-05-06 21:25:29,953 - lava_callback - INFO - Completed processing callback for node 69fbb0e1df29cd80ecaa414f INFO: 172.21.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:25:50,995 - lava_callback - INFO - Received callback for node 69f90ec80573a8210e1321df INFO: 172.21.0.1:55548 - "POST /node/69f90ec80573a8210e1321df HTTP/1.0" 202 Accepted 2026-05-06 21:25:51,001 - lava_callback - INFO - Starting async job submit for node 69f90ec80573a8210e1321df 2026-05-06 21:25:51,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:25:51,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ec80573a8210e1321df HTTP/1.1" 200 None 2026-05-06 21:25:51,016 - lava_callback - DEBUG - Processing node 69f90ec80573a8210e1321df: baseline-arm-clabbe 2026-05-06 21:25:51,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90ec80573a8210e1321df 2026-05-06 21:25:51,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:25:51,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ec80573a8210e1321df HTTP/1.1" 200 None 2026-05-06 21:25:51,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:25:51,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:25:51,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:25:51,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90ec80573a8210e1321df HTTP/1.1" 200 None 2026-05-06 21:25:51,062 - lava_callback - ERROR - Error processing callback for node 69f90ec80573a8210e1321df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55556 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:25:56,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:25:56,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36632 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:26:31,528 - lava_callback - INFO - Received callback for node 69f90ef70573a8210e1321f1 INFO: 172.21.0.1:34208 - "POST /node/69f90ef70573a8210e1321f1 HTTP/1.0" 202 Accepted 2026-05-06 21:26:31,534 - lava_callback - INFO - Starting async job submit for node 69f90ef70573a8210e1321f1 2026-05-06 21:26:31,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:26:31,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ef70573a8210e1321f1 HTTP/1.1" 200 None 2026-05-06 21:26:31,551 - lava_callback - DEBUG - Processing node 69f90ef70573a8210e1321f1: baseline-arm64-baylibre 2026-05-06 21:26:31,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90ef70573a8210e1321f1 2026-05-06 21:26:31,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:26:31,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90ef70573a8210e1321f1 HTTP/1.1" 200 None 2026-05-06 21:26:31,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:26:31,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:26:31,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:26:31,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90ef70573a8210e1321f1 HTTP/1.1" 200 None 2026-05-06 21:26:31,595 - lava_callback - ERROR - Error processing callback for node 69f90ef70573a8210e1321f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:26:55,983 - lava_callback - INFO - Received callback for node 69fbad63df29cd80ecaa3dcb INFO: 172.21.0.1:46682 - "POST /node/69fbad63df29cd80ecaa3dcb HTTP/1.0" 202 Accepted 2026-05-06 21:26:55,992 - lava_callback - INFO - Starting async job submit for node 69fbad63df29cd80ecaa3dcb 2026-05-06 21:26:56,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:26:56,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad63df29cd80ecaa3dcb HTTP/1.1" 200 None 2026-05-06 21:26:56,051 - lava_callback - DEBUG - Processing node 69fbad63df29cd80ecaa3dcb: baseline-nfs-arm64 INFO: 172.21.0.1:46698 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:26:57,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:26:57,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:26:57,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad63df29cd80ecaa3dcb/log.txt.gz 2026-05-06 21:26:57,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:26:58,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:26:58,140 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad63df29cd80ecaa3dcb/lava-logs.yaml 2026-05-06 21:26:58,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:26:58,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:26:58,300 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbad63df29cd80ecaa3dcb/lava_callback.json.gz DEBUG: Setup failed for 69fbad63df29cd80ecaa3dcb. Transitting job node result: incomplete -> fail 2026-05-06 21:26:58,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:26:58,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad63df29cd80ecaa3dcb HTTP/1.1" 200 None 2026-05-06 21:26:58,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:26:58,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:26:58,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:26:58,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad63df29cd80ecaa3dcb HTTP/1.1" 200 None 2026-05-06 21:26:58,535 - lava_callback - INFO - Completed processing callback for node 69fbad63df29cd80ecaa3dcb INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37322 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:27:26,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:27:26,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54302 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:27:54,753 - lava_callback - INFO - Received callback for node 69fbb212df29cd80ecaa41e2 INFO: 172.21.0.1:37968 - "POST /node/69fbb212df29cd80ecaa41e2 HTTP/1.0" 202 Accepted 2026-05-06 21:27:54,760 - lava_callback - INFO - Starting async job submit for node 69fbb212df29cd80ecaa41e2 2026-05-06 21:27:54,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:27:54,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb212df29cd80ecaa41e2 HTTP/1.1" 200 None 2026-05-06 21:27:54,803 - lava_callback - DEBUG - Processing node 69fbb212df29cd80ecaa41e2: baseline-arm64 2026-05-06 21:27:54,934 - lava_callback - WARNING - Failed to upload log 2026-05-06 21:27:55,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:27:55,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:27:55,301 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb212df29cd80ecaa41e2/lava-logs.yaml 2026-05-06 21:27:55,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:27:55,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:27:55,409 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb212df29cd80ecaa41e2/lava_callback.json.gz 2026-05-06 21:27:55,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:27:55,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb212df29cd80ecaa41e2 HTTP/1.1" 200 None 2026-05-06 21:27:55,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:27:55,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:27:55,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:27:55,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb212df29cd80ecaa41e2 HTTP/1.1" 200 None 2026-05-06 21:27:55,567 - lava_callback - INFO - Completed processing callback for node 69fbb212df29cd80ecaa41e2 INFO: 172.21.0.1:37984 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:27:56,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:27:56,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:28:51,620 - lava_callback - INFO - Received callback for node 69f90f870573a8210e132226 INFO: 172.21.0.1:42480 - "POST /node/69f90f870573a8210e132226 HTTP/1.0" 202 Accepted 2026-05-06 21:28:51,625 - lava_callback - INFO - Starting async job submit for node 69f90f870573a8210e132226 2026-05-06 21:28:51,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:28:51,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90f870573a8210e132226 HTTP/1.1" 200 None 2026-05-06 21:28:51,640 - lava_callback - DEBUG - Processing node 69f90f870573a8210e132226: baseline-arm64-baylibre 2026-05-06 21:28:51,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90f870573a8210e132226 2026-05-06 21:28:51,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:28:51,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90f870573a8210e132226 HTTP/1.1" 200 None 2026-05-06 21:28:51,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:28:51,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:28:51,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:28:51,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90f870573a8210e132226 HTTP/1.1" 200 None 2026-05-06 21:28:51,688 - lava_callback - ERROR - Error processing callback for node 69f90f870573a8210e132226: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40284 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:30:11,207 - lava_callback - INFO - Received callback for node 69f90fd20573a8210e132247 INFO: 172.21.0.1:40298 - "POST /node/69f90fd20573a8210e132247 HTTP/1.0" 202 Accepted 2026-05-06 21:30:11,212 - lava_callback - INFO - Starting async job submit for node 69f90fd20573a8210e132247 2026-05-06 21:30:11,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:11,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90fd20573a8210e132247 HTTP/1.1" 200 None 2026-05-06 21:30:11,235 - lava_callback - DEBUG - Processing node 69f90fd20573a8210e132247: baseline-arm-clabbe 2026-05-06 21:30:11,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f90fd20573a8210e132247 2026-05-06 21:30:11,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:11,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f90fd20573a8210e132247 HTTP/1.1" 200 None 2026-05-06 21:30:11,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:11,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:30:11,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:11,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f90fd20573a8210e132247 HTTP/1.1" 200 None 2026-05-06 21:30:11,315 - lava_callback - ERROR - Error processing callback for node 69f90fd20573a8210e132247: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-06 21:30:11,455 - lava_callback - INFO - Received callback for node 69fbb2aadf29cd80ecaa422e INFO: 172.21.0.1:40312 - "POST /node/69fbb2aadf29cd80ecaa422e HTTP/1.0" 202 Accepted 2026-05-06 21:30:11,462 - lava_callback - INFO - Starting async job submit for node 69fbb2aadf29cd80ecaa422e 2026-05-06 21:30:11,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:11,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb2aadf29cd80ecaa422e HTTP/1.1" 200 None 2026-05-06 21:30:11,517 - lava_callback - DEBUG - Processing node 69fbb2aadf29cd80ecaa422e: baseline-arm64 2026-05-06 21:30:11,682 - lava_callback - WARNING - Failed to upload log 2026-05-06 21:30:11,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:30:11,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:30:11,912 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb2aadf29cd80ecaa422e/lava-logs.yaml 2026-05-06 21:30:11,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:30:12,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:30:12,009 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb2aadf29cd80ecaa422e/lava_callback.json.gz 2026-05-06 21:30:12,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:12,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb2aadf29cd80ecaa422e HTTP/1.1" 200 None 2026-05-06 21:30:12,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:12,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:30:12,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:12,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb2aadf29cd80ecaa422e HTTP/1.1" 200 None 2026-05-06 21:30:12,170 - lava_callback - INFO - Completed processing callback for node 69fbb2aadf29cd80ecaa422e INFO: 172.21.0.1:40326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48140 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:30:26,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:26,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:30:51,729 - lava_callback - INFO - Received callback for node 69f910010573a8210e13225b INFO: 172.21.0.1:58308 - "POST /node/69f910010573a8210e13225b HTTP/1.0" 202 Accepted 2026-05-06 21:30:51,735 - lava_callback - INFO - Starting async job submit for node 69f910010573a8210e13225b 2026-05-06 21:30:51,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:51,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f910010573a8210e13225b HTTP/1.1" 200 None 2026-05-06 21:30:51,751 - lava_callback - DEBUG - Processing node 69f910010573a8210e13225b: baseline-arm64-baylibre 2026-05-06 21:30:51,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f910010573a8210e13225b 2026-05-06 21:30:51,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:51,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f910010573a8210e13225b HTTP/1.1" 200 None 2026-05-06 21:30:51,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:51,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:30:51,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:30:51,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f910010573a8210e13225b HTTP/1.1" 200 None 2026-05-06 21:30:51,818 - lava_callback - ERROR - Error processing callback for node 69f910010573a8210e13225b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:32:11,244 - lava_callback - INFO - Received callback for node 69f9104e0573a8210e132279 INFO: 172.21.0.1:55784 - "POST /node/69f9104e0573a8210e132279 HTTP/1.0" 202 Accepted 2026-05-06 21:32:11,249 - lava_callback - INFO - Starting async job submit for node 69f9104e0573a8210e132279 2026-05-06 21:32:11,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:32:11,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9104e0573a8210e132279 HTTP/1.1" 200 None 2026-05-06 21:32:11,287 - lava_callback - DEBUG - Processing node 69f9104e0573a8210e132279: baseline-arm-clabbe 2026-05-06 21:32:11,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9104e0573a8210e132279 2026-05-06 21:32:11,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:32:11,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9104e0573a8210e132279 HTTP/1.1" 200 None 2026-05-06 21:32:11,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:32:11,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:32:11,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:32:11,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9104e0573a8210e132279 HTTP/1.1" 200 None 2026-05-06 21:32:11,342 - lava_callback - ERROR - Error processing callback for node 69f9104e0573a8210e132279: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54572 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:32:51,223 - lava_callback - INFO - Received callback for node 69f910750573a8210e132291 INFO: 172.21.0.1:51678 - "POST /node/69f910750573a8210e132291 HTTP/1.0" 202 Accepted 2026-05-06 21:32:51,229 - lava_callback - INFO - Starting async job submit for node 69f910750573a8210e132291 2026-05-06 21:32:51,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:32:51,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f910750573a8210e132291 HTTP/1.1" 200 None 2026-05-06 21:32:51,246 - lava_callback - DEBUG - Processing node 69f910750573a8210e132291: baseline-arm-clabbe 2026-05-06 21:32:51,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f910750573a8210e132291 2026-05-06 21:32:51,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:32:51,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f910750573a8210e132291 HTTP/1.1" 200 None 2026-05-06 21:32:51,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:32:51,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:32:51,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:32:51,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f910750573a8210e132291 HTTP/1.1" 200 None 2026-05-06 21:32:51,313 - lava_callback - ERROR - Error processing callback for node 69f910750573a8210e132291: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:33:04,586 - lava_callback - INFO - Received callback for node 69fbb1cbdf29cd80ecaa41b9 INFO: 172.21.0.1:45058 - "POST /node/69fbb1cbdf29cd80ecaa41b9 HTTP/1.0" 202 Accepted 2026-05-06 21:33:04,593 - lava_callback - INFO - Starting async job submit for node 69fbb1cbdf29cd80ecaa41b9 2026-05-06 21:33:04,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:33:04,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb1cbdf29cd80ecaa41b9 HTTP/1.1" 200 None 2026-05-06 21:33:04,644 - lava_callback - DEBUG - Processing node 69fbb1cbdf29cd80ecaa41b9: baseline-arm64 2026-05-06 21:33:05,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:33:05,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:33:05,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb1cbdf29cd80ecaa41b9/log.txt.gz 2026-05-06 21:33:05,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:33:05,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:33:05,696 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb1cbdf29cd80ecaa41b9/lava-logs.yaml 2026-05-06 21:33:05,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:33:05,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:33:05,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb1cbdf29cd80ecaa41b9/lava_callback.json.gz DEBUG: Setup failed for 69fbb1cbdf29cd80ecaa41b9. Transitting job node result: incomplete -> fail 2026-05-06 21:33:05,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:33:05,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb1cbdf29cd80ecaa41b9 HTTP/1.1" 200 None 2026-05-06 21:33:05,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:33:05,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:33:05,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:33:05,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb1cbdf29cd80ecaa41b9 HTTP/1.1" 200 None 2026-05-06 21:33:06,080 - lava_callback - INFO - Completed processing callback for node 69fbb1cbdf29cd80ecaa41b9 INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49512 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:33:26,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:33:26,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:33:51,313 - lava_callback - INFO - Received callback for node 69f910ad0573a8210e1322af INFO: 172.21.0.1:55758 - "POST /node/69f910ad0573a8210e1322af HTTP/1.0" 202 Accepted 2026-05-06 21:33:51,319 - lava_callback - INFO - Starting async job submit for node 69f910ad0573a8210e1322af 2026-05-06 21:33:51,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:33:51,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f910ad0573a8210e1322af HTTP/1.1" 200 None 2026-05-06 21:33:51,336 - lava_callback - DEBUG - Processing node 69f910ad0573a8210e1322af: baseline-arm64-clabbe 2026-05-06 21:33:51,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f910ad0573a8210e1322af 2026-05-06 21:33:51,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:33:51,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f910ad0573a8210e1322af HTTP/1.1" 200 None 2026-05-06 21:33:51,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:33:51,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:33:51,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:33:51,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f910ad0573a8210e1322af HTTP/1.1" 200 None 2026-05-06 21:33:51,382 - lava_callback - ERROR - Error processing callback for node 69f910ad0573a8210e1322af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:34:51,441 - lava_callback - INFO - Received callback for node 69f910f30573a8210e1322c6 INFO: 172.21.0.1:45322 - "POST /node/69f910f30573a8210e1322c6 HTTP/1.0" 202 Accepted 2026-05-06 21:34:51,447 - lava_callback - INFO - Starting async job submit for node 69f910f30573a8210e1322c6 2026-05-06 21:34:51,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:34:51,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f910f30573a8210e1322c6 HTTP/1.1" 200 None 2026-05-06 21:34:51,462 - lava_callback - DEBUG - Processing node 69f910f30573a8210e1322c6: baseline-arm-clabbe 2026-05-06 21:34:51,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f910f30573a8210e1322c6 2026-05-06 21:34:51,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:34:51,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f910f30573a8210e1322c6 HTTP/1.1" 200 None 2026-05-06 21:34:51,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:34:51,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:34:51,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:34:51,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f910f30573a8210e1322c6 HTTP/1.1" 200 None 2026-05-06 21:34:51,517 - lava_callback - ERROR - Error processing callback for node 69f910f30573a8210e1322c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:35:35,363 - lava_callback - INFO - Received callback for node 69fbb3f1df29cd80ecaa42c0 INFO: 172.21.0.1:44872 - "POST /node/69fbb3f1df29cd80ecaa42c0 HTTP/1.0" 202 Accepted 2026-05-06 21:35:35,369 - lava_callback - INFO - Starting async job submit for node 69fbb3f1df29cd80ecaa42c0 2026-05-06 21:35:35,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:35:35,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb3f1df29cd80ecaa42c0 HTTP/1.1" 200 None 2026-05-06 21:35:35,405 - lava_callback - DEBUG - Processing node 69fbb3f1df29cd80ecaa42c0: baseline-arm64-foundriesio 2026-05-06 21:35:35,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:35:35,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:35:35,912 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbb3f1df29cd80ecaa42c0/log.txt.gz 2026-05-06 21:35:36,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:35:36,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:35:36,196 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbb3f1df29cd80ecaa42c0/lava-logs.yaml 2026-05-06 21:35:36,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:35:36,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:35:36,347 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fbb3f1df29cd80ecaa42c0/lava_callback.json.gz 2026-05-06 21:35:36,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:35:36,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb3f1df29cd80ecaa42c0 HTTP/1.1" 200 None 2026-05-06 21:35:36,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:35:36,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:35:36,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:35:36,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb3f1df29cd80ecaa42c0 HTTP/1.1" 200 None 2026-05-06 21:35:36,431 - lava_callback - INFO - Completed processing callback for node 69fbb3f1df29cd80ecaa42c0 INFO: 172.21.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:35:51,393 - lava_callback - INFO - Received callback for node 69f9112e0573a8210e1322dc INFO: 172.21.0.1:38684 - "POST /node/69f9112e0573a8210e1322dc HTTP/1.0" 202 Accepted 2026-05-06 21:35:51,399 - lava_callback - INFO - Starting async job submit for node 69f9112e0573a8210e1322dc 2026-05-06 21:35:51,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:35:51,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9112e0573a8210e1322dc HTTP/1.1" 200 None 2026-05-06 21:35:51,414 - lava_callback - DEBUG - Processing node 69f9112e0573a8210e1322dc: baseline-arm64-clabbe 2026-05-06 21:35:51,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9112e0573a8210e1322dc 2026-05-06 21:35:51,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:35:51,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9112e0573a8210e1322dc HTTP/1.1" 200 None 2026-05-06 21:35:51,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:35:51,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:35:51,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:35:51,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9112e0573a8210e1322dc HTTP/1.1" 200 None 2026-05-06 21:35:51,462 - lava_callback - ERROR - Error processing callback for node 69f9112e0573a8210e1322dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:35:56,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:35:56,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58316 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:37:11,510 - lava_callback - INFO - Received callback for node 69f911830573a8210e132301 INFO: 172.21.0.1:58330 - "POST /node/69f911830573a8210e132301 HTTP/1.0" 202 Accepted 2026-05-06 21:37:11,516 - lava_callback - INFO - Starting async job submit for node 69f911830573a8210e132301 2026-05-06 21:37:11,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:37:11,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f911830573a8210e132301 HTTP/1.1" 200 None 2026-05-06 21:37:11,531 - lava_callback - DEBUG - Processing node 69f911830573a8210e132301: baseline-arm64-clabbe 2026-05-06 21:37:11,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f911830573a8210e132301 2026-05-06 21:37:11,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:37:11,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f911830573a8210e132301 HTTP/1.1" 200 None 2026-05-06 21:37:11,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:37:11,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:37:11,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:37:11,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f911830573a8210e132301 HTTP/1.1" 200 None 2026-05-06 21:37:11,577 - lava_callback - ERROR - Error processing callback for node 69f911830573a8210e132301: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57398 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:38:31,526 - lava_callback - INFO - Received callback for node 69f911cb0573a8210e13231d INFO: 172.21.0.1:53536 - "POST /node/69f911cb0573a8210e13231d HTTP/1.0" 202 Accepted 2026-05-06 21:38:31,531 - lava_callback - INFO - Starting async job submit for node 69f911cb0573a8210e13231d 2026-05-06 21:38:31,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:38:31,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f911cb0573a8210e13231d HTTP/1.1" 200 None 2026-05-06 21:38:31,547 - lava_callback - DEBUG - Processing node 69f911cb0573a8210e13231d: baseline-arm-clabbe 2026-05-06 21:38:31,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f911cb0573a8210e13231d 2026-05-06 21:38:31,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:38:31,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f911cb0573a8210e13231d HTTP/1.1" 200 None 2026-05-06 21:38:31,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:38:31,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:38:31,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:38:31,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f911cb0573a8210e13231d HTTP/1.1" 200 None 2026-05-06 21:38:31,603 - lava_callback - ERROR - Error processing callback for node 69f911cb0573a8210e13231d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:39:11,522 - lava_callback - INFO - Received callback for node 69f911f30573a8210e13232d INFO: 172.21.0.1:53354 - "POST /node/69f911f30573a8210e13232d HTTP/1.0" 202 Accepted 2026-05-06 21:39:11,527 - lava_callback - INFO - Starting async job submit for node 69f911f30573a8210e13232d 2026-05-06 21:39:11,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:39:11,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f911f30573a8210e13232d HTTP/1.1" 200 None 2026-05-06 21:39:11,547 - lava_callback - DEBUG - Processing node 69f911f30573a8210e13232d: baseline-arm-clabbe 2026-05-06 21:39:11,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f911f30573a8210e13232d 2026-05-06 21:39:11,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:39:11,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f911f30573a8210e13232d HTTP/1.1" 200 None 2026-05-06 21:39:11,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:39:11,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-06 21:39:11,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:39:11,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f911f30573a8210e13232d HTTP/1.1" 200 None 2026-05-06 21:39:11,594 - lava_callback - ERROR - Error processing callback for node 69f911f30573a8210e13232d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:40:11,610 - lava_callback - INFO - Received callback for node 69f912290573a8210e132340 INFO: 172.21.0.1:60962 - "POST /node/69f912290573a8210e132340 HTTP/1.0" 202 Accepted 2026-05-06 21:40:11,616 - lava_callback - INFO - Starting async job submit for node 69f912290573a8210e132340 2026-05-06 21:40:11,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:40:11,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f912290573a8210e132340 HTTP/1.1" 200 None 2026-05-06 21:40:11,631 - lava_callback - DEBUG - Processing node 69f912290573a8210e132340: baseline-arm64-clabbe 2026-05-06 21:40:11,631 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f912290573a8210e132340 2026-05-06 21:40:11,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:40:11,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f912290573a8210e132340 HTTP/1.1" 200 None 2026-05-06 21:40:11,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:40:11,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:40:11,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:40:11,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f912290573a8210e132340 HTTP/1.1" 200 None 2026-05-06 21:40:11,683 - lava_callback - ERROR - Error processing callback for node 69f912290573a8210e132340: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:41:31,680 - lava_callback - INFO - Received callback for node 69f9127e0573a8210e132365 INFO: 172.21.0.1:37656 - "POST /node/69f9127e0573a8210e132365 HTTP/1.0" 202 Accepted 2026-05-06 21:41:31,686 - lava_callback - INFO - Starting async job submit for node 69f9127e0573a8210e132365 2026-05-06 21:41:31,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:41:31,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9127e0573a8210e132365 HTTP/1.1" 200 None 2026-05-06 21:41:31,700 - lava_callback - DEBUG - Processing node 69f9127e0573a8210e132365: baseline-arm64-clabbe 2026-05-06 21:41:31,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9127e0573a8210e132365 2026-05-06 21:41:31,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:41:31,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9127e0573a8210e132365 HTTP/1.1" 200 None 2026-05-06 21:41:31,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:41:31,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:41:31,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:41:31,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9127e0573a8210e132365 HTTP/1.1" 200 None 2026-05-06 21:41:31,769 - lava_callback - ERROR - Error processing callback for node 69f9127e0573a8210e132365: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:42:43,559 - lava_callback - INFO - Received callback for node 69fbb5aadf29cd80ecaa438f INFO: 172.21.0.1:44502 - "POST /node/69fbb5aadf29cd80ecaa438f HTTP/1.0" 202 Accepted 2026-05-06 21:42:43,565 - lava_callback - INFO - Starting async job submit for node 69fbb5aadf29cd80ecaa438f 2026-05-06 21:42:43,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:42:43,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb5aadf29cd80ecaa438f HTTP/1.1" 200 None 2026-05-06 21:42:43,583 - lava_callback - DEBUG - Processing node 69fbb5aadf29cd80ecaa438f: baseline-nfs-arm64 2026-05-06 21:42:43,584 - lava_callback - WARNING - Failed to upload log 2026-05-06 21:42:43,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:42:43,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:42:43,678 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbb5aadf29cd80ecaa438f/lava-logs.yaml 2026-05-06 21:42:43,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:42:43,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:42:43,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbb5aadf29cd80ecaa438f/lava_callback.json.gz 2026-05-06 21:42:43,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:42:43,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb5aadf29cd80ecaa438f HTTP/1.1" 200 None 2026-05-06 21:42:43,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:42:43,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:42:43,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:42:43,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb5aadf29cd80ecaa438f HTTP/1.1" 200 None 2026-05-06 21:42:43,841 - lava_callback - INFO - Completed processing callback for node 69fbb5aadf29cd80ecaa438f INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:42:51,695 - lava_callback - INFO - Received callback for node 69f912d20573a8210e132387 INFO: 172.21.0.1:54360 - "POST /node/69f912d20573a8210e132387 HTTP/1.0" 202 Accepted 2026-05-06 21:42:51,701 - lava_callback - INFO - Starting async job submit for node 69f912d20573a8210e132387 2026-05-06 21:42:51,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:42:51,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f912d20573a8210e132387 HTTP/1.1" 200 None 2026-05-06 21:42:51,715 - lava_callback - DEBUG - Processing node 69f912d20573a8210e132387: baseline-arm64-clabbe 2026-05-06 21:42:51,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f912d20573a8210e132387 2026-05-06 21:42:51,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:42:51,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f912d20573a8210e132387 HTTP/1.1" 200 None 2026-05-06 21:42:51,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:42:51,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:42:51,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:42:51,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f912d20573a8210e132387 HTTP/1.1" 200 None 2026-05-06 21:42:51,760 - lava_callback - ERROR - Error processing callback for node 69f912d20573a8210e132387: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:42:56,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:42:56,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54796 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:44:12,534 - lava_callback - INFO - Received callback for node 69f9131d0573a8210e1323a7 INFO: 172.21.0.1:54800 - "POST /node/69f9131d0573a8210e1323a7 HTTP/1.0" 202 Accepted 2026-05-06 21:44:12,540 - lava_callback - INFO - Starting async job submit for node 69f9131d0573a8210e1323a7 2026-05-06 21:44:12,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:44:12,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9131d0573a8210e1323a7 HTTP/1.1" 200 None 2026-05-06 21:44:12,555 - lava_callback - DEBUG - Processing node 69f9131d0573a8210e1323a7: baseline-arm64-baylibre 2026-05-06 21:44:12,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9131d0573a8210e1323a7 2026-05-06 21:44:12,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:44:12,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9131d0573a8210e1323a7 HTTP/1.1" 200 None 2026-05-06 21:44:12,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:44:12,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:44:12,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:44:12,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9131d0573a8210e1323a7 HTTP/1.1" 200 None 2026-05-06 21:44:12,601 - lava_callback - ERROR - Error processing callback for node 69f9131d0573a8210e1323a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42190 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:45:32,466 - lava_callback - INFO - Received callback for node 69f9136e0573a8210e1323ce INFO: 172.21.0.1:49970 - "POST /node/69f9136e0573a8210e1323ce HTTP/1.0" 202 Accepted 2026-05-06 21:45:32,472 - lava_callback - INFO - Starting async job submit for node 69f9136e0573a8210e1323ce 2026-05-06 21:45:32,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:45:32,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9136e0573a8210e1323ce HTTP/1.1" 200 None 2026-05-06 21:45:32,487 - lava_callback - DEBUG - Processing node 69f9136e0573a8210e1323ce: baseline-arm64-baylibre 2026-05-06 21:45:32,487 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9136e0573a8210e1323ce 2026-05-06 21:45:32,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:45:32,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9136e0573a8210e1323ce HTTP/1.1" 200 None 2026-05-06 21:45:32,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:45:32,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:45:32,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:45:32,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9136e0573a8210e1323ce HTTP/1.1" 200 None 2026-05-06 21:45:32,544 - lava_callback - ERROR - Error processing callback for node 69f9136e0573a8210e1323ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 21:46:15,405 - lava_callback - INFO - Received callback for node 69fbb428df29cd80ecaa42da INFO: 172.21.0.1:39104 - "POST /node/69fbb428df29cd80ecaa42da HTTP/1.0" 202 Accepted 2026-05-06 21:46:15,411 - lava_callback - INFO - Starting async job submit for node 69fbb428df29cd80ecaa42da 2026-05-06 21:46:15,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:46:15,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb428df29cd80ecaa42da HTTP/1.1" 200 None 2026-05-06 21:46:15,456 - lava_callback - DEBUG - Processing node 69fbb428df29cd80ecaa42da: baseline-arm64 2026-05-06 21:46:15,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:46:16,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:46:16,055 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb428df29cd80ecaa42da/log.txt.gz 2026-05-06 21:46:16,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39108 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:46:16,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:46:16,540 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb428df29cd80ecaa42da/lava-logs.yaml 2026-05-06 21:46:16,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:46:16,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:46:16,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb428df29cd80ecaa42da/lava_callback.json.gz 2026-05-06 21:46:16,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:46:16,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb428df29cd80ecaa42da HTTP/1.1" 200 None 2026-05-06 21:46:16,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:46:16,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:46:16,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:46:16,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb428df29cd80ecaa42da HTTP/1.1" 200 None 2026-05-06 21:46:16,847 - lava_callback - INFO - Completed processing callback for node 69fbb428df29cd80ecaa42da INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:46:26,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:46:26,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53506 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:46:52,582 - lava_callback - INFO - Received callback for node 69f913c10573a8210e1323f7 INFO: 172.21.0.1:39112 - "POST /node/69f913c10573a8210e1323f7 HTTP/1.0" 202 Accepted 2026-05-06 21:46:52,588 - lava_callback - INFO - Starting async job submit for node 69f913c10573a8210e1323f7 2026-05-06 21:46:52,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:46:52,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f913c10573a8210e1323f7 HTTP/1.1" 200 None 2026-05-06 21:46:52,605 - lava_callback - DEBUG - Processing node 69f913c10573a8210e1323f7: baseline-arm64-baylibre 2026-05-06 21:46:52,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f913c10573a8210e1323f7 2026-05-06 21:46:52,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:46:52,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f913c10573a8210e1323f7 HTTP/1.1" 200 None 2026-05-06 21:46:52,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:46:52,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:46:52,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:46:52,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f913c10573a8210e1323f7 HTTP/1.1" 200 None 2026-05-06 21:46:52,652 - lava_callback - ERROR - Error processing callback for node 69f913c10573a8210e1323f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54570 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:48:12,627 - lava_callback - INFO - Received callback for node 69f914130573a8210e132411 INFO: 172.21.0.1:54576 - "POST /node/69f914130573a8210e132411 HTTP/1.0" 202 Accepted 2026-05-06 21:48:12,632 - lava_callback - INFO - Starting async job submit for node 69f914130573a8210e132411 2026-05-06 21:48:12,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:48:12,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f914130573a8210e132411 HTTP/1.1" 200 None 2026-05-06 21:48:12,647 - lava_callback - DEBUG - Processing node 69f914130573a8210e132411: baseline-arm64-baylibre 2026-05-06 21:48:12,647 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f914130573a8210e132411 2026-05-06 21:48:12,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:48:12,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f914130573a8210e132411 HTTP/1.1" 200 None 2026-05-06 21:48:12,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:48:12,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:48:12,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:48:12,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f914130573a8210e132411 HTTP/1.1" 200 None 2026-05-06 21:48:12,695 - lava_callback - ERROR - Error processing callback for node 69f914130573a8210e132411: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54438 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:49:04,891 - lava_callback - INFO - Received callback for node 69fbb4c5df29cd80ecaa432d INFO: 172.21.0.1:51606 - "POST /node/69fbb4c5df29cd80ecaa432d HTTP/1.0" 202 Accepted 2026-05-06 21:49:04,898 - lava_callback - INFO - Starting async job submit for node 69fbb4c5df29cd80ecaa432d 2026-05-06 21:49:04,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:49:04,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb4c5df29cd80ecaa432d HTTP/1.1" 200 None 2026-05-06 21:49:04,938 - lava_callback - DEBUG - Processing node 69fbb4c5df29cd80ecaa432d: baseline-nfs-arm64 2026-05-06 21:49:05,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:49:05,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:49:05,560 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbb4c5df29cd80ecaa432d/log.txt.gz 2026-05-06 21:49:05,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:49:06,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:49:06,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbb4c5df29cd80ecaa432d/lava-logs.yaml 2026-05-06 21:49:06,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:49:06,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:49:06,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbb4c5df29cd80ecaa432d/lava_callback.json.gz 2026-05-06 21:49:06,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:49:06,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb4c5df29cd80ecaa432d HTTP/1.1" 200 None 2026-05-06 21:49:06,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:49:06,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:49:06,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:49:06,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb4c5df29cd80ecaa432d HTTP/1.1" 200 None 2026-05-06 21:49:06,336 - lava_callback - INFO - Completed processing callback for node 69fbb4c5df29cd80ecaa432d INFO: 172.21.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:49:26,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:49:26,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-06 21:49:32,718 - lava_callback - INFO - Received callback for node 69f914690573a8210e132437 INFO: 172.21.0.1:46304 - "POST /node/69f914690573a8210e132437 HTTP/1.0" 202 Accepted 2026-05-06 21:49:32,727 - lava_callback - INFO - Starting async job submit for node 69f914690573a8210e132437 2026-05-06 21:49:32,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:49:32,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f914690573a8210e132437 HTTP/1.1" 200 None 2026-05-06 21:49:32,751 - lava_callback - DEBUG - Processing node 69f914690573a8210e132437: baseline-arm64-baylibre 2026-05-06 21:49:32,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f914690573a8210e132437 2026-05-06 21:49:32,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:49:32,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f914690573a8210e132437 HTTP/1.1" 200 None 2026-05-06 21:49:32,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:49:32,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:49:32,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:49:32,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f914690573a8210e132437 HTTP/1.1" 200 None 2026-05-06 21:49:32,810 - lava_callback - ERROR - Error processing callback for node 69f914690573a8210e132437: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:50:43,187 - lava_callback - INFO - Received callback for node 69fbb6d7df29cd80ecaa4420 INFO: 172.21.0.1:43346 - "POST /node/69fbb6d7df29cd80ecaa4420 HTTP/1.0" 202 Accepted 2026-05-06 21:50:43,194 - lava_callback - INFO - Starting async job submit for node 69fbb6d7df29cd80ecaa4420 2026-05-06 21:50:43,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:50:43,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb6d7df29cd80ecaa4420 HTTP/1.1" 200 None 2026-05-06 21:50:43,227 - lava_callback - DEBUG - Processing node 69fbb6d7df29cd80ecaa4420: baseline-arm64 2026-05-06 21:50:43,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:50:43,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:50:43,705 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb6d7df29cd80ecaa4420/log.txt.gz 2026-05-06 21:50:43,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:50:44,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:50:44,115 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb6d7df29cd80ecaa4420/lava-logs.yaml 2026-05-06 21:50:44,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:50:44,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:50:44,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb6d7df29cd80ecaa4420/lava_callback.json.gz 2026-05-06 21:50:44,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:50:44,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb6d7df29cd80ecaa4420 HTTP/1.1" 200 None 2026-05-06 21:50:44,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:50:44,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:50:44,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:50:44,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb6d7df29cd80ecaa4420 HTTP/1.1" 200 None 2026-05-06 21:50:44,381 - lava_callback - INFO - Completed processing callback for node 69fbb6d7df29cd80ecaa4420 INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:50:52,836 - lava_callback - INFO - Received callback for node 69f914ba0573a8210e13245a INFO: 172.21.0.1:57472 - "POST /node/69f914ba0573a8210e13245a HTTP/1.0" 202 Accepted 2026-05-06 21:50:52,841 - lava_callback - INFO - Starting async job submit for node 69f914ba0573a8210e13245a 2026-05-06 21:50:52,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:50:52,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f914ba0573a8210e13245a HTTP/1.1" 200 None 2026-05-06 21:50:52,857 - lava_callback - DEBUG - Processing node 69f914ba0573a8210e13245a: baseline-arm64-baylibre 2026-05-06 21:50:52,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f914ba0573a8210e13245a 2026-05-06 21:50:52,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:50:52,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f914ba0573a8210e13245a HTTP/1.1" 200 None 2026-05-06 21:50:52,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:50:52,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:50:52,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:50:52,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f914ba0573a8210e13245a HTTP/1.1" 200 None 2026-05-06 21:50:52,902 - lava_callback - ERROR - Error processing callback for node 69f914ba0573a8210e13245a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:50:56,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:50:56,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53044 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:52:32,907 - lava_callback - INFO - Received callback for node 69f915120573a8210e13247b INFO: 172.21.0.1:40804 - "POST /node/69f915120573a8210e13247b HTTP/1.0" 202 Accepted 2026-05-06 21:52:32,912 - lava_callback - INFO - Starting async job submit for node 69f915120573a8210e13247b 2026-05-06 21:52:32,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:52:32,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f915120573a8210e13247b HTTP/1.1" 200 None 2026-05-06 21:52:32,928 - lava_callback - DEBUG - Processing node 69f915120573a8210e13247b: baseline-arm64-baylibre 2026-05-06 21:52:32,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f915120573a8210e13247b 2026-05-06 21:52:32,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:52:32,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f915120573a8210e13247b HTTP/1.1" 200 None 2026-05-06 21:52:32,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:52:32,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:52:32,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:52:32,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f915120573a8210e13247b HTTP/1.1" 200 None 2026-05-06 21:52:32,986 - lava_callback - ERROR - Error processing callback for node 69f915120573a8210e13247b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:53:52,928 - lava_callback - INFO - Received callback for node 69f915620573a8210e1324a1 INFO: 172.21.0.1:56096 - "POST /node/69f915620573a8210e1324a1 HTTP/1.0" 202 Accepted 2026-05-06 21:53:52,933 - lava_callback - INFO - Starting async job submit for node 69f915620573a8210e1324a1 2026-05-06 21:53:52,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:53:52,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f915620573a8210e1324a1 HTTP/1.1" 200 None 2026-05-06 21:53:52,963 - lava_callback - DEBUG - Processing node 69f915620573a8210e1324a1: baseline-arm64-baylibre 2026-05-06 21:53:52,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f915620573a8210e1324a1 2026-05-06 21:53:52,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:53:52,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f915620573a8210e1324a1 HTTP/1.1" 200 None 2026-05-06 21:53:52,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:53:52,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:53:52,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:53:53,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f915620573a8210e1324a1 HTTP/1.1" 200 None 2026-05-06 21:53:53,017 - lava_callback - ERROR - Error processing callback for node 69f915620573a8210e1324a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:54:35,618 - lava_callback - INFO - Received callback for node 69fbb855df29cd80ecaa44d5 INFO: 172.21.0.1:37062 - "POST /node/69fbb855df29cd80ecaa44d5 HTTP/1.0" 202 Accepted 2026-05-06 21:54:35,626 - lava_callback - INFO - Starting async job submit for node 69fbb855df29cd80ecaa44d5 2026-05-06 21:54:35,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:54:35,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb855df29cd80ecaa44d5 HTTP/1.1" 200 None 2026-05-06 21:54:35,670 - lava_callback - DEBUG - Processing node 69fbb855df29cd80ecaa44d5: baseline-arm64 2026-05-06 21:54:35,804 - lava_callback - WARNING - Failed to upload log 2026-05-06 21:54:35,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:54:36,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:54:36,005 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb855df29cd80ecaa44d5/lava-logs.yaml 2026-05-06 21:54:36,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:54:36,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:54:36,089 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb855df29cd80ecaa44d5/lava_callback.json.gz 2026-05-06 21:54:36,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:54:36,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb855df29cd80ecaa44d5 HTTP/1.1" 200 None 2026-05-06 21:54:36,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:54:36,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:54:36,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:54:36,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb855df29cd80ecaa44d5 HTTP/1.1" 200 None 2026-05-06 21:54:36,237 - lava_callback - INFO - Completed processing callback for node 69fbb855df29cd80ecaa44d5 INFO: 172.21.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:54:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:54:56,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59570 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:55:12,953 - lava_callback - INFO - Received callback for node 69f915b90573a8210e1324c3 INFO: 172.21.0.1:59578 - "POST /node/69f915b90573a8210e1324c3 HTTP/1.0" 202 Accepted 2026-05-06 21:55:12,959 - lava_callback - INFO - Starting async job submit for node 69f915b90573a8210e1324c3 2026-05-06 21:55:12,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:55:12,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f915b90573a8210e1324c3 HTTP/1.1" 200 None 2026-05-06 21:55:12,976 - lava_callback - DEBUG - Processing node 69f915b90573a8210e1324c3: baseline-arm64-baylibre 2026-05-06 21:55:12,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f915b90573a8210e1324c3 2026-05-06 21:55:12,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:55:13,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f915b90573a8210e1324c3 HTTP/1.1" 200 None 2026-05-06 21:55:13,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:55:13,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:55:13,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:55:13,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f915b90573a8210e1324c3 HTTP/1.1" 200 None 2026-05-06 21:55:13,070 - lava_callback - ERROR - Error processing callback for node 69f915b90573a8210e1324c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:56:33,099 - lava_callback - INFO - Received callback for node 69f916090573a8210e1324e3 INFO: 172.21.0.1:59752 - "POST /node/69f916090573a8210e1324e3 HTTP/1.0" 202 Accepted 2026-05-06 21:56:33,105 - lava_callback - INFO - Starting async job submit for node 69f916090573a8210e1324e3 2026-05-06 21:56:33,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:56:33,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f916090573a8210e1324e3 HTTP/1.1" 200 None 2026-05-06 21:56:33,128 - lava_callback - DEBUG - Processing node 69f916090573a8210e1324e3: baseline-arm64-baylibre 2026-05-06 21:56:33,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f916090573a8210e1324e3 2026-05-06 21:56:33,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:56:33,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f916090573a8210e1324e3 HTTP/1.1" 200 None 2026-05-06 21:56:33,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:56:33,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:56:33,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:56:33,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f916090573a8210e1324e3 HTTP/1.1" 200 None 2026-05-06 21:56:33,175 - lava_callback - ERROR - Error processing callback for node 69f916090573a8210e1324e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:57:13,090 - lava_callback - INFO - Received callback for node 69fbb8f5df29cd80ecaa4519 INFO: 172.21.0.1:52092 - "POST /node/69fbb8f5df29cd80ecaa4519 HTTP/1.0" 202 Accepted 2026-05-06 21:57:13,098 - lava_callback - INFO - Starting async job submit for node 69fbb8f5df29cd80ecaa4519 2026-05-06 21:57:13,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:57:13,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb8f5df29cd80ecaa4519 HTTP/1.1" 200 None 2026-05-06 21:57:13,147 - lava_callback - DEBUG - Processing node 69fbb8f5df29cd80ecaa4519: baseline-arm64 2026-05-06 21:57:13,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:57:13,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:57:13,428 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb8f5df29cd80ecaa4519/log.txt.gz 2026-05-06 21:57:13,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:57:13,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:57:13,663 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb8f5df29cd80ecaa4519/lava-logs.yaml 2026-05-06 21:57:13,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 21:57:13,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 21:57:13,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb8f5df29cd80ecaa4519/lava_callback.json.gz 2026-05-06 21:57:13,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:57:13,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb8f5df29cd80ecaa4519 HTTP/1.1" 200 None 2026-05-06 21:57:13,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:57:13,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 21:57:13,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:57:13,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb8f5df29cd80ecaa4519 HTTP/1.1" 200 None 2026-05-06 21:57:13,949 - lava_callback - INFO - Completed processing callback for node 69fbb8f5df29cd80ecaa4519 INFO: 172.21.0.1:52094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34920 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:57:26,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:57:26,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:58:12,391 - lava_callback - INFO - Received callback for node 69f916630573a8210e132503 INFO: 172.21.0.1:52304 - "POST /node/69f916630573a8210e132503 HTTP/1.0" 202 Accepted 2026-05-06 21:58:12,397 - lava_callback - INFO - Starting async job submit for node 69f916630573a8210e132503 2026-05-06 21:58:12,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:58:12,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f916630573a8210e132503 HTTP/1.1" 200 None 2026-05-06 21:58:12,444 - lava_callback - DEBUG - Processing node 69f916630573a8210e132503: baseline-arm64-clabbe 2026-05-06 21:58:12,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f916630573a8210e132503 2026-05-06 21:58:12,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:58:12,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f916630573a8210e132503 HTTP/1.1" 200 None 2026-05-06 21:58:12,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:58:12,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:58:12,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:58:12,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f916630573a8210e132503 HTTP/1.1" 200 None 2026-05-06 21:58:12,520 - lava_callback - ERROR - Error processing callback for node 69f916630573a8210e132503: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37284 - "GET / HTTP/1.0" 200 OK 2026-05-06 21:59:33,208 - lava_callback - INFO - Received callback for node 69f916b00573a8210e13252b INFO: 172.21.0.1:52648 - "POST /node/69f916b00573a8210e13252b HTTP/1.0" 202 Accepted 2026-05-06 21:59:33,213 - lava_callback - INFO - Starting async job submit for node 69f916b00573a8210e13252b 2026-05-06 21:59:33,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:59:33,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f916b00573a8210e13252b HTTP/1.1" 200 None 2026-05-06 21:59:33,228 - lava_callback - DEBUG - Processing node 69f916b00573a8210e13252b: baseline-arm64-baylibre 2026-05-06 21:59:33,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f916b00573a8210e13252b 2026-05-06 21:59:33,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:59:33,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f916b00573a8210e13252b HTTP/1.1" 200 None 2026-05-06 21:59:33,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:59:33,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 21:59:33,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 21:59:33,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f916b00573a8210e13252b HTTP/1.1" 200 None 2026-05-06 21:59:33,275 - lava_callback - ERROR - Error processing callback for node 69f916b00573a8210e13252b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48158 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:00:52,446 - lava_callback - INFO - Received callback for node 69f9170b0573a8210e132555 INFO: 172.21.0.1:52800 - "POST /node/69f9170b0573a8210e132555 HTTP/1.0" 202 Accepted 2026-05-06 22:00:52,453 - lava_callback - INFO - Starting async job submit for node 69f9170b0573a8210e132555 2026-05-06 22:00:52,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:00:52,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9170b0573a8210e132555 HTTP/1.1" 200 None 2026-05-06 22:00:52,470 - lava_callback - DEBUG - Processing node 69f9170b0573a8210e132555: baseline-arm64-clabbe 2026-05-06 22:00:52,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9170b0573a8210e132555 2026-05-06 22:00:52,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:00:52,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9170b0573a8210e132555 HTTP/1.1" 200 None 2026-05-06 22:00:52,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:00:52,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 22:00:52,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:00:52,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9170b0573a8210e132555 HTTP/1.1" 200 None 2026-05-06 22:00:52,530 - lava_callback - ERROR - Error processing callback for node 69f9170b0573a8210e132555: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:02:13,359 - lava_callback - INFO - Received callback for node 69f9175e0573a8210e132575 INFO: 172.21.0.1:34096 - "POST /node/69f9175e0573a8210e132575 HTTP/1.0" 202 Accepted 2026-05-06 22:02:13,364 - lava_callback - INFO - Starting async job submit for node 69f9175e0573a8210e132575 2026-05-06 22:02:13,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:02:13,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9175e0573a8210e132575 HTTP/1.1" 200 None 2026-05-06 22:02:13,422 - lava_callback - DEBUG - Processing node 69f9175e0573a8210e132575: baseline-arm64-baylibre 2026-05-06 22:02:13,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9175e0573a8210e132575 2026-05-06 22:02:13,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:02:13,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9175e0573a8210e132575 HTTP/1.1" 200 None 2026-05-06 22:02:13,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:02:13,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 22:02:13,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:02:13,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9175e0573a8210e132575 HTTP/1.1" 200 None 2026-05-06 22:02:13,511 - lava_callback - ERROR - Error processing callback for node 69f9175e0573a8210e132575: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60072 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:03:52,561 - lava_callback - INFO - Received callback for node 69f917b90573a8210e13259e INFO: 172.21.0.1:34614 - "POST /node/69f917b90573a8210e13259e HTTP/1.0" 202 Accepted 2026-05-06 22:03:52,567 - lava_callback - INFO - Starting async job submit for node 69f917b90573a8210e13259e 2026-05-06 22:03:52,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:03:52,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f917b90573a8210e13259e HTTP/1.1" 200 None 2026-05-06 22:03:52,582 - lava_callback - DEBUG - Processing node 69f917b90573a8210e13259e: baseline-arm64-clabbe 2026-05-06 22:03:52,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f917b90573a8210e13259e 2026-05-06 22:03:52,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:03:52,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f917b90573a8210e13259e HTTP/1.1" 200 None 2026-05-06 22:03:52,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:03:52,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 22:03:52,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:03:52,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f917b90573a8210e13259e HTTP/1.1" 200 None 2026-05-06 22:03:52,635 - lava_callback - ERROR - Error processing callback for node 69f917b90573a8210e13259e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:05:12,507 - lava_callback - INFO - Received callback for node 69f9180e0573a8210e1325b6 INFO: 172.21.0.1:37166 - "POST /node/69f9180e0573a8210e1325b6 HTTP/1.0" 202 Accepted 2026-05-06 22:05:12,513 - lava_callback - INFO - Starting async job submit for node 69f9180e0573a8210e1325b6 2026-05-06 22:05:12,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:05:12,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9180e0573a8210e1325b6 HTTP/1.1" 200 None 2026-05-06 22:05:12,534 - lava_callback - DEBUG - Processing node 69f9180e0573a8210e1325b6: baseline-arm64-clabbe 2026-05-06 22:05:12,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9180e0573a8210e1325b6 2026-05-06 22:05:12,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:05:12,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9180e0573a8210e1325b6 HTTP/1.1" 200 None 2026-05-06 22:05:12,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:05:12,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 22:05:12,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:05:12,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9180e0573a8210e1325b6 HTTP/1.1" 200 None 2026-05-06 22:05:12,582 - lava_callback - ERROR - Error processing callback for node 69f9180e0573a8210e1325b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:06:32,642 - lava_callback - INFO - Received callback for node 69f918630573a8210e1325db INFO: 172.21.0.1:33826 - "POST /node/69f918630573a8210e1325db HTTP/1.0" 202 Accepted 2026-05-06 22:06:32,648 - lava_callback - INFO - Starting async job submit for node 69f918630573a8210e1325db 2026-05-06 22:06:32,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:06:32,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f918630573a8210e1325db HTTP/1.1" 200 None 2026-05-06 22:06:32,675 - lava_callback - DEBUG - Processing node 69f918630573a8210e1325db: baseline-arm64-clabbe 2026-05-06 22:06:32,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f918630573a8210e1325db 2026-05-06 22:06:32,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:06:32,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f918630573a8210e1325db HTTP/1.1" 200 None 2026-05-06 22:06:32,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:06:32,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 22:06:32,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:06:32,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f918630573a8210e1325db HTTP/1.1" 200 None 2026-05-06 22:06:32,721 - lava_callback - ERROR - Error processing callback for node 69f918630573a8210e1325db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:06:45,755 - lava_callback - INFO - Received callback for node 69fbb9bbdf29cd80ecaa4572 INFO: 172.21.0.1:39066 - "POST /node/69fbb9bbdf29cd80ecaa4572 HTTP/1.0" 202 Accepted 2026-05-06 22:06:45,762 - lava_callback - INFO - Starting async job submit for node 69fbb9bbdf29cd80ecaa4572 2026-05-06 22:06:45,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:06:45,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb9bbdf29cd80ecaa4572 HTTP/1.1" 200 None 2026-05-06 22:06:45,813 - lava_callback - DEBUG - Processing node 69fbb9bbdf29cd80ecaa4572: baseline-arm64 2026-05-06 22:06:46,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:06:46,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:06:46,335 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb9bbdf29cd80ecaa4572/log.txt.gz INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:06:46,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:06:46,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:06:46,785 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb9bbdf29cd80ecaa4572/lava-logs.yaml 2026-05-06 22:06:46,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:06:46,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:06:46,924 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbb9bbdf29cd80ecaa4572/lava_callback.json.gz DEBUG: Setup failed for 69fbb9bbdf29cd80ecaa4572. Transitting job node result: incomplete -> fail 2026-05-06 22:06:47,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:06:47,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb9bbdf29cd80ecaa4572 HTTP/1.1" 200 None 2026-05-06 22:06:47,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:06:47,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 22:06:47,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:06:47,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb9bbdf29cd80ecaa4572 HTTP/1.1" 200 None 2026-05-06 22:06:47,172 - lava_callback - INFO - Completed processing callback for node 69fbb9bbdf29cd80ecaa4572 INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:06:56,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:06:56,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60886 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:07:10,578 - lava_callback - INFO - Received callback for node 69fbbaa4df29cd80ecaa45d5 INFO: 172.21.0.1:45700 - "POST /node/69fbbaa4df29cd80ecaa45d5 HTTP/1.0" 202 Accepted 2026-05-06 22:07:10,584 - lava_callback - INFO - Starting async job submit for node 69fbbaa4df29cd80ecaa45d5 2026-05-06 22:07:10,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:07:10,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbbaa4df29cd80ecaa45d5 HTTP/1.1" 200 None 2026-05-06 22:07:10,616 - lava_callback - DEBUG - Processing node 69fbbaa4df29cd80ecaa45d5: baseline-arm64 2026-05-06 22:07:10,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:45708 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:07:11,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:07:11,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbbaa4df29cd80ecaa45d5/log.txt.gz 2026-05-06 22:07:11,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:07:11,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:07:11,463 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbbaa4df29cd80ecaa45d5/lava-logs.yaml 2026-05-06 22:07:11,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:07:11,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:07:11,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbbaa4df29cd80ecaa45d5/lava_callback.json.gz 2026-05-06 22:07:11,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:07:11,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbbaa4df29cd80ecaa45d5 HTTP/1.1" 200 None 2026-05-06 22:07:11,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:07:11,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 22:07:11,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:07:11,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbbaa4df29cd80ecaa45d5 HTTP/1.1" 200 None 2026-05-06 22:07:11,742 - lava_callback - INFO - Completed processing callback for node 69fbbaa4df29cd80ecaa45d5 INFO: 172.21.0.1:45712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35334 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:07:26,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:07:26,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:08:12,747 - lava_callback - INFO - Received callback for node 69f918b80573a8210e1325fc INFO: 172.21.0.1:46670 - "POST /node/69f918b80573a8210e1325fc HTTP/1.0" 202 Accepted 2026-05-06 22:08:12,753 - lava_callback - INFO - Starting async job submit for node 69f918b80573a8210e1325fc 2026-05-06 22:08:12,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:08:12,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f918b80573a8210e1325fc HTTP/1.1" 200 None 2026-05-06 22:08:12,770 - lava_callback - DEBUG - Processing node 69f918b80573a8210e1325fc: baseline-arm64-clabbe 2026-05-06 22:08:12,770 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f918b80573a8210e1325fc 2026-05-06 22:08:12,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:08:12,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f918b80573a8210e1325fc HTTP/1.1" 200 None 2026-05-06 22:08:12,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:08:12,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 22:08:12,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:08:12,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f918b80573a8210e1325fc HTTP/1.1" 200 None 2026-05-06 22:08:12,819 - lava_callback - ERROR - Error processing callback for node 69f918b80573a8210e1325fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:09:32,719 - lava_callback - INFO - Received callback for node 69f9190e0573a8210e13261d INFO: 172.21.0.1:36962 - "POST /node/69f9190e0573a8210e13261d HTTP/1.0" 202 Accepted 2026-05-06 22:09:32,724 - lava_callback - INFO - Starting async job submit for node 69f9190e0573a8210e13261d 2026-05-06 22:09:32,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:09:32,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9190e0573a8210e13261d HTTP/1.1" 200 None 2026-05-06 22:09:32,740 - lava_callback - DEBUG - Processing node 69f9190e0573a8210e13261d: baseline-arm64-clabbe 2026-05-06 22:09:32,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9190e0573a8210e13261d 2026-05-06 22:09:32,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:09:32,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9190e0573a8210e13261d HTTP/1.1" 200 None 2026-05-06 22:09:32,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:09:32,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 22:09:32,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:09:32,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9190e0573a8210e13261d HTTP/1.1" 200 None 2026-05-06 22:09:32,807 - lava_callback - ERROR - Error processing callback for node 69f9190e0573a8210e13261d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:10:46,262 - lava_callback - INFO - Received callback for node 69fbb7c4df29cd80ecaa4491 INFO: 172.21.0.1:48408 - "POST /node/69fbb7c4df29cd80ecaa4491 HTTP/1.0" 202 Accepted 2026-05-06 22:10:46,270 - lava_callback - INFO - Starting async job submit for node 69fbb7c4df29cd80ecaa4491 2026-05-06 22:10:46,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:10:46,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb7c4df29cd80ecaa4491 HTTP/1.1" 200 None 2026-05-06 22:10:46,328 - lava_callback - DEBUG - Processing node 69fbb7c4df29cd80ecaa4491: baseline-nfs-arm64 INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:10:47,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:10:47,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:10:47,723 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbb7c4df29cd80ecaa4491/log.txt.gz 2026-05-06 22:10:48,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:10:48,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:10:48,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbb7c4df29cd80ecaa4491/lava-logs.yaml 2026-05-06 22:10:48,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:10:48,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:10:48,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbb7c4df29cd80ecaa4491/lava_callback.json.gz DEBUG: Setup failed for 69fbb7c4df29cd80ecaa4491. Transitting job node result: incomplete -> fail 2026-05-06 22:10:48,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:10:48,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb7c4df29cd80ecaa4491 HTTP/1.1" 200 None 2026-05-06 22:10:48,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:10:48,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 22:10:48,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:10:48,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb7c4df29cd80ecaa4491 HTTP/1.1" 200 None 2026-05-06 22:10:48,944 - lava_callback - INFO - Completed processing callback for node 69fbb7c4df29cd80ecaa4491 2026-05-06 22:10:52,792 - lava_callback - INFO - Received callback for node 69f919600573a8210e132647 INFO: 172.21.0.1:44162 - "POST /node/69f919600573a8210e132647 HTTP/1.0" 202 Accepted 2026-05-06 22:10:52,799 - lava_callback - INFO - Starting async job submit for node 69f919600573a8210e132647 2026-05-06 22:10:52,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:10:52,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f919600573a8210e132647 HTTP/1.1" 200 None 2026-05-06 22:10:52,816 - lava_callback - DEBUG - Processing node 69f919600573a8210e132647: baseline-arm64-clabbe 2026-05-06 22:10:52,816 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f919600573a8210e132647 2026-05-06 22:10:52,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:10:52,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f919600573a8210e132647 HTTP/1.1" 200 None 2026-05-06 22:10:52,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:10:52,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 22:10:52,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:10:52,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f919600573a8210e132647 HTTP/1.1" 200 None 2026-05-06 22:10:52,876 - lava_callback - ERROR - Error processing callback for node 69f919600573a8210e132647: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:10:56,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:10:56,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 22:11:16,410 - lava_callback - INFO - Received callback for node 69fbba09df29cd80ecaa4594 INFO: 172.21.0.1:40496 - "POST /node/69fbba09df29cd80ecaa4594 HTTP/1.0" 202 Accepted 2026-05-06 22:11:16,417 - lava_callback - INFO - Starting async job submit for node 69fbba09df29cd80ecaa4594 2026-05-06 22:11:16,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:11:16,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbba09df29cd80ecaa4594 HTTP/1.1" 200 None 2026-05-06 22:11:16,478 - lava_callback - DEBUG - Processing node 69fbba09df29cd80ecaa4594: baseline-arm64 INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:11:17,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:11:17,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:11:17,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbba09df29cd80ecaa4594/log.txt.gz 2026-05-06 22:11:17,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:11:17,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:11:17,717 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbba09df29cd80ecaa4594/lava-logs.yaml 2026-05-06 22:11:17,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:11:17,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:11:17,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbba09df29cd80ecaa4594/lava_callback.json.gz 2026-05-06 22:11:17,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:11:17,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbba09df29cd80ecaa4594 HTTP/1.1" 200 None 2026-05-06 22:11:17,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:11:17,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 22:11:17,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:11:17,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbba09df29cd80ecaa4594 HTTP/1.1" 200 None 2026-05-06 22:11:17,990 - lava_callback - INFO - Completed processing callback for node 69fbba09df29cd80ecaa4594 INFO: 172.21.0.1:57874 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:11:26,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:11:26,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:12:12,917 - lava_callback - INFO - Received callback for node 69f919b50573a8210e132669 INFO: 172.21.0.1:47582 - "POST /node/69f919b50573a8210e132669 HTTP/1.0" 202 Accepted 2026-05-06 22:12:12,922 - lava_callback - INFO - Starting async job submit for node 69f919b50573a8210e132669 2026-05-06 22:12:12,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:12:12,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f919b50573a8210e132669 HTTP/1.1" 200 None 2026-05-06 22:12:12,940 - lava_callback - DEBUG - Processing node 69f919b50573a8210e132669: baseline-arm64-clabbe 2026-05-06 22:12:12,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f919b50573a8210e132669 2026-05-06 22:12:12,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:12:12,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f919b50573a8210e132669 HTTP/1.1" 200 None 2026-05-06 22:12:12,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:12:12,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-06 22:12:12,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:12:12,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f919b50573a8210e132669 HTTP/1.1" 200 None 2026-05-06 22:12:12,995 - lava_callback - ERROR - Error processing callback for node 69f919b50573a8210e132669: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:13:05,680 - lava_callback - INFO - Received callback for node 69fbba5edf29cd80ecaa45b2 INFO: 172.21.0.1:37958 - "POST /node/69fbba5edf29cd80ecaa45b2 HTTP/1.0" 202 Accepted 2026-05-06 22:13:05,687 - lava_callback - INFO - Starting async job submit for node 69fbba5edf29cd80ecaa45b2 2026-05-06 22:13:05,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:13:05,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbba5edf29cd80ecaa45b2 HTTP/1.1" 200 None 2026-05-06 22:13:05,727 - lava_callback - DEBUG - Processing node 69fbba5edf29cd80ecaa45b2: baseline-nfs-arm64 2026-05-06 22:13:06,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:13:06,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:13:06,387 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbba5edf29cd80ecaa45b2/log.txt.gz INFO: 172.21.0.1:37974 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:13:06,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:13:06,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:13:06,831 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbba5edf29cd80ecaa45b2/lava-logs.yaml 2026-05-06 22:13:06,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:13:06,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:13:06,958 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbba5edf29cd80ecaa45b2/lava_callback.json.gz 2026-05-06 22:13:06,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:13:06,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbba5edf29cd80ecaa45b2 HTTP/1.1" 200 None 2026-05-06 22:13:06,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:13:07,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 22:13:07,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:13:07,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbba5edf29cd80ecaa45b2 HTTP/1.1" 200 None 2026-05-06 22:13:07,079 - lava_callback - INFO - Completed processing callback for node 69fbba5edf29cd80ecaa45b2 INFO: 172.21.0.1:38934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33430 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:13:27,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:13:27,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:14:05,323 - lava_callback - INFO - Received callback for node 69fbbb7edf29cd80ecaa45fe INFO: 172.21.0.1:40636 - "POST /node/69fbbb7edf29cd80ecaa45fe HTTP/1.0" 202 Accepted 2026-05-06 22:14:05,331 - lava_callback - INFO - Starting async job submit for node 69fbbb7edf29cd80ecaa45fe 2026-05-06 22:14:05,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:14:05,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbbb7edf29cd80ecaa45fe HTTP/1.1" 200 None 2026-05-06 22:14:05,381 - lava_callback - DEBUG - Processing node 69fbbb7edf29cd80ecaa45fe: baseline-arm64 2026-05-06 22:14:05,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:14:06,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:14:06,063 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbbb7edf29cd80ecaa45fe/log.txt.gz 2026-05-06 22:14:06,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:14:06,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:14:06,455 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbbb7edf29cd80ecaa45fe/lava-logs.yaml 2026-05-06 22:14:06,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40644 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:14:06,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:14:06,626 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbbb7edf29cd80ecaa45fe/lava_callback.json.gz DEBUG: Setup failed for 69fbbb7edf29cd80ecaa45fe. Transitting job node result: incomplete -> fail 2026-05-06 22:14:06,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:14:06,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbbb7edf29cd80ecaa45fe HTTP/1.1" 200 None 2026-05-06 22:14:06,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:14:06,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 22:14:06,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:14:06,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbbb7edf29cd80ecaa45fe HTTP/1.1" 200 None 2026-05-06 22:14:06,833 - lava_callback - INFO - Completed processing callback for node 69fbbb7edf29cd80ecaa45fe INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:14:27,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:14:27,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56748 - "GET /node/693e22c7407f32424eb579df%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51130 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:23:56,877 - lava_callback - INFO - Received callback for node 69fbbcbedf29cd80ecaa4658 INFO: 172.21.0.1:51134 - "POST /node/69fbbcbedf29cd80ecaa4658 HTTP/1.0" 202 Accepted 2026-05-06 22:23:56,887 - lava_callback - INFO - Starting async job submit for node 69fbbcbedf29cd80ecaa4658 2026-05-06 22:23:56,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:23:56,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbbcbedf29cd80ecaa4658 HTTP/1.1" 200 None 2026-05-06 22:23:56,936 - lava_callback - DEBUG - Processing node 69fbbcbedf29cd80ecaa4658: baseline-arm64 2026-05-06 22:23:57,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:23:57,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:23:57,650 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbbcbedf29cd80ecaa4658/log.txt.gz 2026-05-06 22:23:57,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:23:58,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:23:58,070 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbbcbedf29cd80ecaa4658/lava-logs.yaml 2026-05-06 22:23:58,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:23:58,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:23:58,189 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fbbcbedf29cd80ecaa4658/lava_callback.json.gz 2026-05-06 22:23:58,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:23:58,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbbcbedf29cd80ecaa4658 HTTP/1.1" 200 None 2026-05-06 22:23:58,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:23:58,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 22:23:58,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:23:58,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbbcbedf29cd80ecaa4658 HTTP/1.1" 200 None 2026-05-06 22:23:58,304 - lava_callback - INFO - Completed processing callback for node 69fbbcbedf29cd80ecaa4658 INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:24:27,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:24:27,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:24:54,684 - lava_callback - INFO - Received callback for node 69f91ca30573a8210e132726 INFO: 172.21.0.1:55324 - "POST /node/69f91ca30573a8210e132726 HTTP/1.0" 202 Accepted 2026-05-06 22:24:54,689 - lava_callback - INFO - Starting async job submit for node 69f91ca30573a8210e132726 2026-05-06 22:24:54,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:24:54,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91ca30573a8210e132726 HTTP/1.1" 200 None 2026-05-06 22:24:54,704 - lava_callback - DEBUG - Processing node 69f91ca30573a8210e132726: baseline-arm64-baylibre 2026-05-06 22:24:54,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f91ca30573a8210e132726 2026-05-06 22:24:54,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:24:54,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91ca30573a8210e132726 HTTP/1.1" 200 None 2026-05-06 22:24:54,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:24:54,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 22:24:54,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:24:54,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f91ca30573a8210e132726 HTTP/1.1" 200 None 2026-05-06 22:24:54,759 - lava_callback - ERROR - Error processing callback for node 69f91ca30573a8210e132726: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:26:06,313 - lava_callback - INFO - Received callback for node 69fbbd14df29cd80ecaa467d INFO: 172.21.0.1:39784 - "POST /node/69fbbd14df29cd80ecaa467d HTTP/1.0" 202 Accepted 2026-05-06 22:26:06,320 - lava_callback - INFO - Starting async job submit for node 69fbbd14df29cd80ecaa467d 2026-05-06 22:26:06,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:26:06,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbbd14df29cd80ecaa467d HTTP/1.1" 200 None 2026-05-06 22:26:06,378 - lava_callback - DEBUG - Processing node 69fbbd14df29cd80ecaa467d: baseline-nfs-arm64 INFO: 172.21.0.1:39800 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:26:06,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:26:07,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:26:07,047 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbbd14df29cd80ecaa467d/log.txt.gz 2026-05-06 22:26:07,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:26:07,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:26:07,580 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbbd14df29cd80ecaa467d/lava-logs.yaml 2026-05-06 22:26:07,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:26:07,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:26:07,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbbd14df29cd80ecaa467d/lava_callback.json.gz 2026-05-06 22:26:07,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:26:07,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbbd14df29cd80ecaa467d HTTP/1.1" 200 None 2026-05-06 22:26:07,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:26:07,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 22:26:07,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:26:07,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbbd14df29cd80ecaa467d HTTP/1.1" 200 None 2026-05-06 22:26:07,903 - lava_callback - INFO - Completed processing callback for node 69fbbd14df29cd80ecaa467d INFO: 172.21.0.1:45630 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:26:14,647 - lava_callback - INFO - Received callback for node 69f91cf90573a8210e13274a INFO: 172.21.0.1:45638 - "POST /node/69f91cf90573a8210e13274a HTTP/1.0" 202 Accepted 2026-05-06 22:26:14,653 - lava_callback - INFO - Starting async job submit for node 69f91cf90573a8210e13274a 2026-05-06 22:26:14,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:26:14,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91cf90573a8210e13274a HTTP/1.1" 200 None 2026-05-06 22:26:14,676 - lava_callback - DEBUG - Processing node 69f91cf90573a8210e13274a: baseline-arm64-baylibre 2026-05-06 22:26:14,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f91cf90573a8210e13274a 2026-05-06 22:26:14,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:26:14,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91cf90573a8210e13274a HTTP/1.1" 200 None 2026-05-06 22:26:14,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:26:14,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 22:26:14,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:26:14,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f91cf90573a8210e13274a HTTP/1.1" 200 None 2026-05-06 22:26:14,733 - lava_callback - ERROR - Error processing callback for node 69f91cf90573a8210e13274a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53352 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:26:27,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:26:27,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:27:54,714 - lava_callback - INFO - Received callback for node 69f91d560573a8210e132777 INFO: 172.21.0.1:40146 - "POST /node/69f91d560573a8210e132777 HTTP/1.0" 202 Accepted 2026-05-06 22:27:54,720 - lava_callback - INFO - Starting async job submit for node 69f91d560573a8210e132777 2026-05-06 22:27:54,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:27:54,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91d560573a8210e132777 HTTP/1.1" 200 None 2026-05-06 22:27:54,742 - lava_callback - DEBUG - Processing node 69f91d560573a8210e132777: baseline-arm64-baylibre 2026-05-06 22:27:54,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f91d560573a8210e132777 2026-05-06 22:27:54,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:27:54,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91d560573a8210e132777 HTTP/1.1" 200 None 2026-05-06 22:27:54,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:27:54,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 22:27:54,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:27:54,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f91d560573a8210e132777 HTTP/1.1" 200 None 2026-05-06 22:27:54,798 - lava_callback - ERROR - Error processing callback for node 69f91d560573a8210e132777: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:29:14,827 - lava_callback - INFO - Received callback for node 69f91dac0573a8210e1327a1 INFO: 172.21.0.1:45704 - "POST /node/69f91dac0573a8210e1327a1 HTTP/1.0" 202 Accepted 2026-05-06 22:29:14,833 - lava_callback - INFO - Starting async job submit for node 69f91dac0573a8210e1327a1 2026-05-06 22:29:14,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:29:14,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91dac0573a8210e1327a1 HTTP/1.1" 200 None 2026-05-06 22:29:14,853 - lava_callback - DEBUG - Processing node 69f91dac0573a8210e1327a1: baseline-arm64-baylibre 2026-05-06 22:29:14,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f91dac0573a8210e1327a1 2026-05-06 22:29:14,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:29:14,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91dac0573a8210e1327a1 HTTP/1.1" 200 None 2026-05-06 22:29:14,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:29:14,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 22:29:14,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:29:14,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f91dac0573a8210e1327a1 HTTP/1.1" 200 None 2026-05-06 22:29:14,902 - lava_callback - ERROR - Error processing callback for node 69f91dac0573a8210e1327a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45482 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:30:45,108 - lava_callback - INFO - Received callback for node 69fbbc71df29cd80ecaa4634 INFO: 172.21.0.1:52984 - "POST /node/69fbbc71df29cd80ecaa4634 HTTP/1.0" 202 Accepted 2026-05-06 22:30:45,117 - lava_callback - INFO - Starting async job submit for node 69fbbc71df29cd80ecaa4634 2026-05-06 22:30:45,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:30:45,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbbc71df29cd80ecaa4634 HTTP/1.1" 200 None 2026-05-06 22:30:45,177 - lava_callback - DEBUG - Processing node 69fbbc71df29cd80ecaa4634: baseline-nfs-arm64 2026-05-06 22:30:46,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:30:46,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:30:46,446 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbbc71df29cd80ecaa4634/log.txt.gz INFO: 172.21.0.1:52998 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:30:47,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:30:47,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:30:47,416 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbbc71df29cd80ecaa4634/lava-logs.yaml 2026-05-06 22:30:47,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:30:47,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:30:47,600 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbbc71df29cd80ecaa4634/lava_callback.json.gz DEBUG: Setup failed for 69fbbc71df29cd80ecaa4634. Transitting job node result: incomplete -> fail 2026-05-06 22:30:47,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:30:47,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbbc71df29cd80ecaa4634 HTTP/1.1" 200 None 2026-05-06 22:30:47,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:30:47,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 22:30:47,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:30:47,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbbc71df29cd80ecaa4634 HTTP/1.1" 200 None 2026-05-06 22:30:47,832 - lava_callback - INFO - Completed processing callback for node 69fbbc71df29cd80ecaa4634 2026-05-06 22:30:54,958 - lava_callback - INFO - Received callback for node 69f91e0d0573a8210e1327d0 INFO: 172.21.0.1:51292 - "POST /node/69f91e0d0573a8210e1327d0 HTTP/1.0" 202 Accepted 2026-05-06 22:30:54,966 - lava_callback - INFO - Starting async job submit for node 69f91e0d0573a8210e1327d0 2026-05-06 22:30:54,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:30:54,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91e0d0573a8210e1327d0 HTTP/1.1" 200 None 2026-05-06 22:30:54,984 - lava_callback - DEBUG - Processing node 69f91e0d0573a8210e1327d0: baseline-arm64-baylibre 2026-05-06 22:30:54,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f91e0d0573a8210e1327d0 2026-05-06 22:30:54,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:30:55,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91e0d0573a8210e1327d0 HTTP/1.1" 200 None 2026-05-06 22:30:55,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:30:55,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 22:30:55,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:30:55,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f91e0d0573a8210e1327d0 HTTP/1.1" 200 None 2026-05-06 22:30:55,034 - lava_callback - ERROR - Error processing callback for node 69f91e0d0573a8210e1327d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51306 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:30:57,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:30:57,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:32:14,988 - lava_callback - INFO - Received callback for node 69f91e600573a8210e1327f5 INFO: 172.21.0.1:43188 - "POST /node/69f91e600573a8210e1327f5 HTTP/1.0" 202 Accepted 2026-05-06 22:32:14,994 - lava_callback - INFO - Starting async job submit for node 69f91e600573a8210e1327f5 2026-05-06 22:32:14,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:32:15,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91e600573a8210e1327f5 HTTP/1.1" 200 None 2026-05-06 22:32:15,009 - lava_callback - DEBUG - Processing node 69f91e600573a8210e1327f5: baseline-arm64-baylibre 2026-05-06 22:32:15,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f91e600573a8210e1327f5 2026-05-06 22:32:15,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:32:15,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91e600573a8210e1327f5 HTTP/1.1" 200 None 2026-05-06 22:32:15,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:32:15,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 22:32:15,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:32:15,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f91e600573a8210e1327f5 HTTP/1.1" 200 None 2026-05-06 22:32:15,068 - lava_callback - ERROR - Error processing callback for node 69f91e600573a8210e1327f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56872 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:33:53,691 - lava_callback - INFO - Received callback for node 69f91ebb0573a8210e132820 INFO: 172.21.0.1:49898 - "POST /node/69f91ebb0573a8210e132820 HTTP/1.0" 202 Accepted 2026-05-06 22:33:53,697 - lava_callback - INFO - Starting async job submit for node 69f91ebb0573a8210e132820 2026-05-06 22:33:53,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:33:53,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91ebb0573a8210e132820 HTTP/1.1" 200 None 2026-05-06 22:33:53,713 - lava_callback - DEBUG - Processing node 69f91ebb0573a8210e132820: baseline-arm64-clabbe 2026-05-06 22:33:53,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f91ebb0573a8210e132820 2026-05-06 22:33:53,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:33:53,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91ebb0573a8210e132820 HTTP/1.1" 200 None 2026-05-06 22:33:53,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:33:53,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 22:33:53,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:33:53,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f91ebb0573a8210e132820 HTTP/1.1" 200 None 2026-05-06 22:33:53,764 - lava_callback - ERROR - Error processing callback for node 69f91ebb0573a8210e132820: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59448 - "GET /node/69b20df0b0f5558b5d7ccb4e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:35:13,836 - lava_callback - INFO - Received callback for node 69f91f100573a8210e13284d INFO: 172.21.0.1:45770 - "POST /node/69f91f100573a8210e13284d HTTP/1.0" 202 Accepted 2026-05-06 22:35:13,842 - lava_callback - INFO - Starting async job submit for node 69f91f100573a8210e13284d 2026-05-06 22:35:13,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:35:13,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91f100573a8210e13284d HTTP/1.1" 200 None 2026-05-06 22:35:13,861 - lava_callback - DEBUG - Processing node 69f91f100573a8210e13284d: baseline-arm64-clabbe 2026-05-06 22:35:13,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f91f100573a8210e13284d 2026-05-06 22:35:13,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:35:13,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91f100573a8210e13284d HTTP/1.1" 200 None 2026-05-06 22:35:13,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:35:13,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 22:35:13,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:35:13,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f91f100573a8210e13284d HTTP/1.1" 200 None 2026-05-06 22:35:13,915 - lava_callback - ERROR - Error processing callback for node 69f91f100573a8210e13284d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54382 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:36:33,855 - lava_callback - INFO - Received callback for node 69f91f680573a8210e132879 INFO: 172.21.0.1:57222 - "POST /node/69f91f680573a8210e132879 HTTP/1.0" 202 Accepted 2026-05-06 22:36:33,860 - lava_callback - INFO - Starting async job submit for node 69f91f680573a8210e132879 2026-05-06 22:36:33,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:36:33,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91f680573a8210e132879 HTTP/1.1" 200 None 2026-05-06 22:36:33,875 - lava_callback - DEBUG - Processing node 69f91f680573a8210e132879: baseline-arm64-clabbe 2026-05-06 22:36:33,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f91f680573a8210e132879 2026-05-06 22:36:33,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:36:33,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91f680573a8210e132879 HTTP/1.1" 200 None 2026-05-06 22:36:33,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:36:33,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 22:36:33,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:36:33,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f91f680573a8210e132879 HTTP/1.1" 200 None 2026-05-06 22:36:33,930 - lava_callback - ERROR - Error processing callback for node 69f91f680573a8210e132879: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:37:53,975 - lava_callback - INFO - Received callback for node 69f91fbd0573a8210e1328a8 INFO: 172.21.0.1:50196 - "POST /node/69f91fbd0573a8210e1328a8 HTTP/1.0" 202 Accepted 2026-05-06 22:37:53,980 - lava_callback - INFO - Starting async job submit for node 69f91fbd0573a8210e1328a8 2026-05-06 22:37:53,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:37:53,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91fbd0573a8210e1328a8 HTTP/1.1" 200 None 2026-05-06 22:37:53,995 - lava_callback - DEBUG - Processing node 69f91fbd0573a8210e1328a8: baseline-arm64-clabbe 2026-05-06 22:37:53,996 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f91fbd0573a8210e1328a8 2026-05-06 22:37:53,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:37:54,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f91fbd0573a8210e1328a8 HTTP/1.1" 200 None 2026-05-06 22:37:54,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:37:54,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 22:37:54,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:37:54,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f91fbd0573a8210e1328a8 HTTP/1.1" 200 None 2026-05-06 22:37:54,041 - lava_callback - ERROR - Error processing callback for node 69f91fbd0573a8210e1328a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:39:33,991 - lava_callback - INFO - Received callback for node 69f920130573a8210e1328d7 INFO: 172.21.0.1:41450 - "POST /node/69f920130573a8210e1328d7 HTTP/1.0" 202 Accepted 2026-05-06 22:39:33,996 - lava_callback - INFO - Starting async job submit for node 69f920130573a8210e1328d7 2026-05-06 22:39:33,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:39:34,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f920130573a8210e1328d7 HTTP/1.1" 200 None 2026-05-06 22:39:34,011 - lava_callback - DEBUG - Processing node 69f920130573a8210e1328d7: baseline-arm64-clabbe 2026-05-06 22:39:34,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f920130573a8210e1328d7 2026-05-06 22:39:34,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:39:34,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f920130573a8210e1328d7 HTTP/1.1" 200 None 2026-05-06 22:39:34,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:39:34,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 22:39:34,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:39:34,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f920130573a8210e1328d7 HTTP/1.1" 200 None 2026-05-06 22:39:34,058 - lava_callback - ERROR - Error processing callback for node 69f920130573a8210e1328d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:40:54,036 - lava_callback - INFO - Received callback for node 69f9206d0573a8210e132901 INFO: 172.21.0.1:46200 - "POST /node/69f9206d0573a8210e132901 HTTP/1.0" 202 Accepted 2026-05-06 22:40:54,041 - lava_callback - INFO - Starting async job submit for node 69f9206d0573a8210e132901 2026-05-06 22:40:54,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:40:54,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9206d0573a8210e132901 HTTP/1.1" 200 None 2026-05-06 22:40:54,057 - lava_callback - DEBUG - Processing node 69f9206d0573a8210e132901: baseline-arm64-clabbe 2026-05-06 22:40:54,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9206d0573a8210e132901 2026-05-06 22:40:54,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:40:54,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9206d0573a8210e132901 HTTP/1.1" 200 None 2026-05-06 22:40:54,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:40:54,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-06 22:40:54,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:40:54,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9206d0573a8210e132901 HTTP/1.1" 200 None 2026-05-06 22:40:54,103 - lava_callback - ERROR - Error processing callback for node 69f9206d0573a8210e132901: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:42:35,698 - lava_callback - INFO - Received callback for node 69f920d10573a8210e132928 INFO: 172.21.0.1:35446 - "POST /node/69f920d10573a8210e132928 HTTP/1.0" 202 Accepted 2026-05-06 22:42:35,703 - lava_callback - INFO - Starting async job submit for node 69f920d10573a8210e132928 2026-05-06 22:42:35,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:42:35,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f920d10573a8210e132928 HTTP/1.1" 200 None 2026-05-06 22:42:35,723 - lava_callback - DEBUG - Processing node 69f920d10573a8210e132928: baseline-arm-baylibre 2026-05-06 22:42:35,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f920d10573a8210e132928 2026-05-06 22:42:35,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:42:35,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f920d10573a8210e132928 HTTP/1.1" 200 None 2026-05-06 22:42:35,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:42:35,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 22:42:35,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:42:35,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f920d10573a8210e132928 HTTP/1.1" 200 None 2026-05-06 22:42:35,768 - lava_callback - ERROR - Error processing callback for node 69f920d10573a8210e132928: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:43:35,583 - lava_callback - INFO - Received callback for node 69f9210e0573a8210e13293a INFO: 172.21.0.1:38394 - "POST /node/69f9210e0573a8210e13293a HTTP/1.0" 202 Accepted 2026-05-06 22:43:35,592 - lava_callback - INFO - Starting async job submit for node 69f9210e0573a8210e13293a 2026-05-06 22:43:35,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:43:35,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9210e0573a8210e13293a HTTP/1.1" 200 None 2026-05-06 22:43:35,615 - lava_callback - DEBUG - Processing node 69f9210e0573a8210e13293a: baseline-arm-baylibre 2026-05-06 22:43:35,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9210e0573a8210e13293a 2026-05-06 22:43:35,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:43:35,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9210e0573a8210e13293a HTTP/1.1" 200 None 2026-05-06 22:43:35,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:43:35,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 22:43:35,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:43:35,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9210e0573a8210e13293a HTTP/1.1" 200 None 2026-05-06 22:43:35,676 - lava_callback - ERROR - Error processing callback for node 69f9210e0573a8210e13293a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38598 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 22:44:15,641 - lava_callback - INFO - Received callback for node 69f921340573a8210e13294b INFO: 172.21.0.1:38612 - "POST /node/69f921340573a8210e13294b HTTP/1.0" 202 Accepted 2026-05-06 22:44:15,647 - lava_callback - INFO - Starting async job submit for node 69f921340573a8210e13294b 2026-05-06 22:44:15,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:44:15,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f921340573a8210e13294b HTTP/1.1" 200 None 2026-05-06 22:44:15,668 - lava_callback - DEBUG - Processing node 69f921340573a8210e13294b: baseline-arm-baylibre 2026-05-06 22:44:15,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f921340573a8210e13294b 2026-05-06 22:44:15,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:44:15,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f921340573a8210e13294b HTTP/1.1" 200 None 2026-05-06 22:44:15,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:44:15,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 22:44:15,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:44:15,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f921340573a8210e13294b HTTP/1.1" 200 None 2026-05-06 22:44:15,727 - lava_callback - ERROR - Error processing callback for node 69f921340573a8210e13294b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 22:46:15,706 - lava_callback - INFO - Received callback for node 69f921a90573a8210e13297c INFO: 172.21.0.1:51126 - "POST /node/69f921a90573a8210e13297c HTTP/1.0" 202 Accepted 2026-05-06 22:46:15,711 - lava_callback - INFO - Starting async job submit for node 69f921a90573a8210e13297c 2026-05-06 22:46:15,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:46:15,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f921a90573a8210e13297c HTTP/1.1" 200 None 2026-05-06 22:46:15,725 - lava_callback - DEBUG - Processing node 69f921a90573a8210e13297c: baseline-arm-baylibre 2026-05-06 22:46:15,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f921a90573a8210e13297c 2026-05-06 22:46:15,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:46:15,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f921a90573a8210e13297c HTTP/1.1" 200 None 2026-05-06 22:46:15,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:46:15,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 22:46:15,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:46:15,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f921a90573a8210e13297c HTTP/1.1" 200 None 2026-05-06 22:46:15,780 - lava_callback - ERROR - Error processing callback for node 69f921a90573a8210e13297c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42684 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:48:14,316 - lava_callback - INFO - Received callback for node 69f922230573a8210e1329aa INFO: 172.21.0.1:42696 - "POST /node/69f922230573a8210e1329aa HTTP/1.0" 202 Accepted 2026-05-06 22:48:14,321 - lava_callback - INFO - Starting async job submit for node 69f922230573a8210e1329aa 2026-05-06 22:48:14,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:48:14,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f922230573a8210e1329aa HTTP/1.1" 200 None 2026-05-06 22:48:14,343 - lava_callback - DEBUG - Processing node 69f922230573a8210e1329aa: baseline-arm-clabbe 2026-05-06 22:48:14,343 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f922230573a8210e1329aa 2026-05-06 22:48:14,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:48:14,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f922230573a8210e1329aa HTTP/1.1" 200 None 2026-05-06 22:48:14,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:48:14,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 22:48:14,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:48:14,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f922230573a8210e1329aa HTTP/1.1" 200 None 2026-05-06 22:48:14,388 - lava_callback - ERROR - Error processing callback for node 69f922230573a8210e1329aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51384 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:48:54,286 - lava_callback - INFO - Received callback for node 69f9224c0573a8210e1329dd INFO: 172.21.0.1:39936 - "POST /node/69f9224c0573a8210e1329dd HTTP/1.0" 202 Accepted 2026-05-06 22:48:54,292 - lava_callback - INFO - Starting async job submit for node 69f9224c0573a8210e1329dd 2026-05-06 22:48:54,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:48:54,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9224c0573a8210e1329dd HTTP/1.1" 200 None 2026-05-06 22:48:54,307 - lava_callback - DEBUG - Processing node 69f9224c0573a8210e1329dd: baseline-arm-clabbe 2026-05-06 22:48:54,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9224c0573a8210e1329dd 2026-05-06 22:48:54,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:48:54,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9224c0573a8210e1329dd HTTP/1.1" 200 None 2026-05-06 22:48:54,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:48:54,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 22:48:54,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:48:54,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9224c0573a8210e1329dd HTTP/1.1" 200 None 2026-05-06 22:48:54,353 - lava_callback - ERROR - Error processing callback for node 69f9224c0573a8210e1329dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:50:56,041 - lava_callback - INFO - Received callback for node 69f922bb0573a8210e132a1e INFO: 172.21.0.1:55334 - "POST /node/69f922bb0573a8210e132a1e HTTP/1.0" 202 Accepted 2026-05-06 22:50:56,047 - lava_callback - INFO - Starting async job submit for node 69f922bb0573a8210e132a1e 2026-05-06 22:50:56,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:50:56,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f922bb0573a8210e132a1e HTTP/1.1" 200 None 2026-05-06 22:50:56,066 - lava_callback - DEBUG - Processing node 69f922bb0573a8210e132a1e: baseline-arm-baylibre 2026-05-06 22:50:56,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f922bb0573a8210e132a1e 2026-05-06 22:50:56,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:50:56,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f922bb0573a8210e132a1e HTTP/1.1" 200 None 2026-05-06 22:50:56,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:50:56,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 22:50:56,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:50:56,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f922bb0573a8210e132a1e HTTP/1.1" 200 None 2026-05-06 22:50:56,131 - lava_callback - ERROR - Error processing callback for node 69f922bb0573a8210e132a1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 22:51:15,966 - lava_callback - INFO - Received callback for node 69f922e10573a8210e132a34 INFO: 172.21.0.1:53798 - "POST /node/69f922e10573a8210e132a34 HTTP/1.0" 202 Accepted 2026-05-06 22:51:15,972 - lava_callback - INFO - Starting async job submit for node 69f922e10573a8210e132a34 2026-05-06 22:51:15,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:51:15,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f922e10573a8210e132a34 HTTP/1.1" 200 None 2026-05-06 22:51:15,988 - lava_callback - DEBUG - Processing node 69f922e10573a8210e132a34: baseline-arm-baylibre 2026-05-06 22:51:15,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f922e10573a8210e132a34 2026-05-06 22:51:15,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:51:16,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f922e10573a8210e132a34 HTTP/1.1" 200 None 2026-05-06 22:51:16,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:51:16,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 22:51:16,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:51:16,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f922e10573a8210e132a34 HTTP/1.1" 200 None 2026-05-06 22:51:16,047 - lava_callback - ERROR - Error processing callback for node 69f922e10573a8210e132a34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:55:54,618 - lava_callback - INFO - Received callback for node 69f923f10573a8210e132a96 INFO: 172.21.0.1:45308 - "POST /node/69f923f10573a8210e132a96 HTTP/1.0" 202 Accepted 2026-05-06 22:55:54,624 - lava_callback - INFO - Starting async job submit for node 69f923f10573a8210e132a96 2026-05-06 22:55:54,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:55:54,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f923f10573a8210e132a96 HTTP/1.1" 200 None 2026-05-06 22:55:54,639 - lava_callback - DEBUG - Processing node 69f923f10573a8210e132a96: baseline-arm-clabbe 2026-05-06 22:55:54,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f923f10573a8210e132a96 2026-05-06 22:55:54,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:55:54,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f923f10573a8210e132a96 HTTP/1.1" 200 None 2026-05-06 22:55:54,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:55:54,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 22:55:54,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:55:54,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f923f10573a8210e132a96 HTTP/1.1" 200 None 2026-05-06 22:55:54,712 - lava_callback - ERROR - Error processing callback for node 69f923f10573a8210e132a96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:56:07,310 - lava_callback - INFO - Received callback for node 69fbc266df29cd80ecaa47fa INFO: 172.21.0.1:42400 - "POST /node/69fbc266df29cd80ecaa47fa HTTP/1.0" 202 Accepted 2026-05-06 22:56:07,318 - lava_callback - INFO - Starting async job submit for node 69fbc266df29cd80ecaa47fa 2026-05-06 22:56:07,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:56:07,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc266df29cd80ecaa47fa HTTP/1.1" 200 None 2026-05-06 22:56:07,380 - lava_callback - DEBUG - Processing node 69fbc266df29cd80ecaa47fa: baseline-nfs-arm64 2026-05-06 22:56:08,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:56:08,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:56:08,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbc266df29cd80ecaa47fa/log.txt.gz 2026-05-06 22:56:09,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:56:09,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:56:09,649 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbc266df29cd80ecaa47fa/lava-logs.yaml 2026-05-06 22:56:09,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:56:09,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:56:09,833 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fbc266df29cd80ecaa47fa/lava_callback.json.gz DEBUG: Setup failed for 69fbc266df29cd80ecaa47fa. Transitting job node result: incomplete -> fail 2026-05-06 22:56:09,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:56:09,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc266df29cd80ecaa47fa HTTP/1.1" 200 None 2026-05-06 22:56:09,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:56:09,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-06 22:56:09,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:56:09,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc266df29cd80ecaa47fa HTTP/1.1" 200 None 2026-05-06 22:56:10,070 - lava_callback - INFO - Completed processing callback for node 69fbc266df29cd80ecaa47fa INFO: 172.21.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:56:27,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:56:27,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-06 22:56:34,628 - lava_callback - INFO - Received callback for node 69f924180573a8210e132aa5 INFO: 172.21.0.1:42462 - "POST /node/69f924180573a8210e132aa5 HTTP/1.0" 202 Accepted 2026-05-06 22:56:34,633 - lava_callback - INFO - Starting async job submit for node 69f924180573a8210e132aa5 2026-05-06 22:56:34,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:56:34,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f924180573a8210e132aa5 HTTP/1.1" 200 None 2026-05-06 22:56:34,649 - lava_callback - DEBUG - Processing node 69f924180573a8210e132aa5: baseline-arm-clabbe 2026-05-06 22:56:34,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f924180573a8210e132aa5 2026-05-06 22:56:34,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:56:34,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f924180573a8210e132aa5 HTTP/1.1" 200 None 2026-05-06 22:56:34,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:56:34,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 22:56:34,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:56:34,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f924180573a8210e132aa5 HTTP/1.1" 200 None 2026-05-06 22:56:34,694 - lava_callback - ERROR - Error processing callback for node 69f924180573a8210e132aa5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44534 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:57:04,109 - lava_callback - INFO - Received callback for node 69fb8563df29cd80ecaa36d9 INFO: 172.21.0.1:50580 - "POST /node/69fb8563df29cd80ecaa36d9 HTTP/1.0" 202 Accepted 2026-05-06 22:57:04,115 - lava_callback - INFO - Starting async job submit for node 69fb8563df29cd80ecaa36d9 2026-05-06 22:57:04,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:04,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8563df29cd80ecaa36d9 HTTP/1.1" 200 None 2026-05-06 22:57:04,147 - lava_callback - DEBUG - Processing node 69fb8563df29cd80ecaa36d9: baseline-x86 2026-05-06 22:57:04,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:57:04,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:57:04,532 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fb8563df29cd80ecaa36d9/log.txt.gz 2026-05-06 22:57:04,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:57:04,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:57:04,840 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fb8563df29cd80ecaa36d9/lava-logs.yaml 2026-05-06 22:57:04,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-06 22:57:04,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-06 22:57:04,948 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fb8563df29cd80ecaa36d9/lava_callback.json.gz 2026-05-06 22:57:04,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:04,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8563df29cd80ecaa36d9 HTTP/1.1" 200 None 2026-05-06 22:57:04,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:05,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a9adf29cd80ecaa02d1 HTTP/1.1" 200 None 2026-05-06 22:57:05,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:05,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8563df29cd80ecaa36d9 HTTP/1.1" 200 None 2026-05-06 22:57:05,029 - lava_callback - INFO - Completed processing callback for node 69fb8563df29cd80ecaa36d9 INFO: 172.21.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49682 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:57:14,701 - lava_callback - INFO - Received callback for node 69f9243f0573a8210e132ab3 INFO: 172.21.0.1:49688 - "POST /node/69f9243f0573a8210e132ab3 HTTP/1.0" 202 Accepted 2026-05-06 22:57:14,707 - lava_callback - INFO - Starting async job submit for node 69f9243f0573a8210e132ab3 2026-05-06 22:57:14,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:14,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9243f0573a8210e132ab3 HTTP/1.1" 200 None 2026-05-06 22:57:14,721 - lava_callback - DEBUG - Processing node 69f9243f0573a8210e132ab3: baseline-arm-clabbe 2026-05-06 22:57:14,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9243f0573a8210e132ab3 2026-05-06 22:57:14,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:14,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9243f0573a8210e132ab3 HTTP/1.1" 200 None 2026-05-06 22:57:14,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:14,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 22:57:14,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:14,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9243f0573a8210e132ab3 HTTP/1.1" 200 None 2026-05-06 22:57:14,767 - lava_callback - ERROR - Error processing callback for node 69f9243f0573a8210e132ab3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:57:27,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:27,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:57:54,602 - lava_callback - INFO - Received callback for node 69f924670573a8210e132ac4 INFO: 172.21.0.1:37962 - "POST /node/69f924670573a8210e132ac4 HTTP/1.0" 202 Accepted 2026-05-06 22:57:54,607 - lava_callback - INFO - Starting async job submit for node 69f924670573a8210e132ac4 2026-05-06 22:57:54,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:54,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f924670573a8210e132ac4 HTTP/1.1" 200 None 2026-05-06 22:57:54,623 - lava_callback - DEBUG - Processing node 69f924670573a8210e132ac4: baseline-arm-clabbe 2026-05-06 22:57:54,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f924670573a8210e132ac4 2026-05-06 22:57:54,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:54,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f924670573a8210e132ac4 HTTP/1.1" 200 None 2026-05-06 22:57:54,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:54,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 22:57:54,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:57:54,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f924670573a8210e132ac4 HTTP/1.1" 200 None 2026-05-06 22:57:54,716 - lava_callback - ERROR - Error processing callback for node 69f924670573a8210e132ac4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:58:34,723 - lava_callback - INFO - Received callback for node 69f9248e0573a8210e132ad0 INFO: 172.21.0.1:56662 - "POST /node/69f9248e0573a8210e132ad0 HTTP/1.0" 202 Accepted 2026-05-06 22:58:34,730 - lava_callback - INFO - Starting async job submit for node 69f9248e0573a8210e132ad0 2026-05-06 22:58:34,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:58:34,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9248e0573a8210e132ad0 HTTP/1.1" 200 None 2026-05-06 22:58:34,754 - lava_callback - DEBUG - Processing node 69f9248e0573a8210e132ad0: baseline-arm-clabbe 2026-05-06 22:58:34,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9248e0573a8210e132ad0 2026-05-06 22:58:34,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:58:34,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9248e0573a8210e132ad0 HTTP/1.1" 200 None 2026-05-06 22:58:34,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:58:34,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 22:58:34,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:58:34,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9248e0573a8210e132ad0 HTTP/1.1" 200 None 2026-05-06 22:58:34,808 - lava_callback - ERROR - Error processing callback for node 69f9248e0573a8210e132ad0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55660 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:59:14,734 - lava_callback - INFO - Received callback for node 69f924b60573a8210e132add INFO: 172.21.0.1:55672 - "POST /node/69f924b60573a8210e132add HTTP/1.0" 202 Accepted 2026-05-06 22:59:14,742 - lava_callback - INFO - Starting async job submit for node 69f924b60573a8210e132add 2026-05-06 22:59:14,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:59:14,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f924b60573a8210e132add HTTP/1.1" 200 None 2026-05-06 22:59:14,764 - lava_callback - DEBUG - Processing node 69f924b60573a8210e132add: baseline-arm-clabbe 2026-05-06 22:59:14,764 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f924b60573a8210e132add 2026-05-06 22:59:14,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:59:14,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f924b60573a8210e132add HTTP/1.1" 200 None 2026-05-06 22:59:14,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:59:14,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-06 22:59:14,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:59:14,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f924b60573a8210e132add HTTP/1.1" 200 None 2026-05-06 22:59:14,814 - lava_callback - ERROR - Error processing callback for node 69f924b60573a8210e132add: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK 2026-05-06 22:59:54,795 - lava_callback - INFO - Received callback for node 69f924dd0573a8210e132aee INFO: 172.21.0.1:33624 - "POST /node/69f924dd0573a8210e132aee HTTP/1.0" 202 Accepted 2026-05-06 22:59:54,801 - lava_callback - INFO - Starting async job submit for node 69f924dd0573a8210e132aee 2026-05-06 22:59:54,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:59:54,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f924dd0573a8210e132aee HTTP/1.1" 200 None 2026-05-06 22:59:54,816 - lava_callback - DEBUG - Processing node 69f924dd0573a8210e132aee: baseline-arm-clabbe 2026-05-06 22:59:54,816 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f924dd0573a8210e132aee 2026-05-06 22:59:54,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:59:54,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f924dd0573a8210e132aee HTTP/1.1" 200 None 2026-05-06 22:59:54,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:59:54,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 22:59:54,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 22:59:54,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f924dd0573a8210e132aee HTTP/1.1" 200 None 2026-05-06 22:59:54,874 - lava_callback - ERROR - Error processing callback for node 69f924dd0573a8210e132aee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:00:34,865 - lava_callback - INFO - Received callback for node 69f925040573a8210e132afa INFO: 172.21.0.1:57574 - "POST /node/69f925040573a8210e132afa HTTP/1.0" 202 Accepted 2026-05-06 23:00:34,871 - lava_callback - INFO - Starting async job submit for node 69f925040573a8210e132afa 2026-05-06 23:00:34,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:00:34,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f925040573a8210e132afa HTTP/1.1" 200 None 2026-05-06 23:00:34,886 - lava_callback - DEBUG - Processing node 69f925040573a8210e132afa: baseline-arm-clabbe 2026-05-06 23:00:34,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f925040573a8210e132afa 2026-05-06 23:00:34,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:00:34,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f925040573a8210e132afa HTTP/1.1" 200 None 2026-05-06 23:00:34,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:00:34,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 23:00:34,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:00:34,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f925040573a8210e132afa HTTP/1.1" 200 None 2026-05-06 23:00:34,932 - lava_callback - ERROR - Error processing callback for node 69f925040573a8210e132afa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:01:14,880 - lava_callback - INFO - Received callback for node 69f9252b0573a8210e132b0a INFO: 172.21.0.1:53126 - "POST /node/69f9252b0573a8210e132b0a HTTP/1.0" 202 Accepted 2026-05-06 23:01:14,885 - lava_callback - INFO - Starting async job submit for node 69f9252b0573a8210e132b0a 2026-05-06 23:01:14,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:01:14,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9252b0573a8210e132b0a HTTP/1.1" 200 None 2026-05-06 23:01:14,901 - lava_callback - DEBUG - Processing node 69f9252b0573a8210e132b0a: baseline-arm-clabbe 2026-05-06 23:01:14,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9252b0573a8210e132b0a 2026-05-06 23:01:14,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:53134 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 23:01:15,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9252b0573a8210e132b0a HTTP/1.1" 200 None 2026-05-06 23:01:15,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:01:15,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 23:01:15,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:01:15,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9252b0573a8210e132b0a HTTP/1.1" 200 None 2026-05-06 23:01:15,984 - lava_callback - ERROR - Error processing callback for node 69f9252b0573a8210e132b0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:01:54,844 - lava_callback - INFO - Received callback for node 69f925520573a8210e132b1f INFO: 172.21.0.1:46286 - "POST /node/69f925520573a8210e132b1f HTTP/1.0" 202 Accepted 2026-05-06 23:01:54,850 - lava_callback - INFO - Starting async job submit for node 69f925520573a8210e132b1f 2026-05-06 23:01:54,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:01:54,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f925520573a8210e132b1f HTTP/1.1" 200 None 2026-05-06 23:01:54,864 - lava_callback - DEBUG - Processing node 69f925520573a8210e132b1f: baseline-arm-clabbe 2026-05-06 23:01:54,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f925520573a8210e132b1f 2026-05-06 23:01:54,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:01:54,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f925520573a8210e132b1f HTTP/1.1" 200 None 2026-05-06 23:01:54,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:01:54,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 23:01:54,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:01:54,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f925520573a8210e132b1f HTTP/1.1" 200 None 2026-05-06 23:01:54,921 - lava_callback - ERROR - Error processing callback for node 69f925520573a8210e132b1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33062 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:02:34,937 - lava_callback - INFO - Received callback for node 69f925790573a8210e132b29 INFO: 172.21.0.1:55496 - "POST /node/69f925790573a8210e132b29 HTTP/1.0" 202 Accepted 2026-05-06 23:02:34,942 - lava_callback - INFO - Starting async job submit for node 69f925790573a8210e132b29 2026-05-06 23:02:34,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:02:34,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f925790573a8210e132b29 HTTP/1.1" 200 None 2026-05-06 23:02:34,958 - lava_callback - DEBUG - Processing node 69f925790573a8210e132b29: baseline-arm-clabbe 2026-05-06 23:02:34,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f925790573a8210e132b29 2026-05-06 23:02:34,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:02:34,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f925790573a8210e132b29 HTTP/1.1" 200 None 2026-05-06 23:02:34,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:02:34,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 23:02:34,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:02:35,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f925790573a8210e132b29 HTTP/1.1" 200 None 2026-05-06 23:02:35,008 - lava_callback - ERROR - Error processing callback for node 69f925790573a8210e132b29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:03:14,900 - lava_callback - INFO - Received callback for node 69f925a00573a8210e132b3b INFO: 172.21.0.1:52552 - "POST /node/69f925a00573a8210e132b3b HTTP/1.0" 202 Accepted 2026-05-06 23:03:14,906 - lava_callback - INFO - Starting async job submit for node 69f925a00573a8210e132b3b 2026-05-06 23:03:14,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:03:14,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f925a00573a8210e132b3b HTTP/1.1" 200 None 2026-05-06 23:03:14,923 - lava_callback - DEBUG - Processing node 69f925a00573a8210e132b3b: baseline-arm-clabbe 2026-05-06 23:03:14,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f925a00573a8210e132b3b 2026-05-06 23:03:14,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:03:14,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f925a00573a8210e132b3b HTTP/1.1" 200 None 2026-05-06 23:03:14,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:03:14,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 23:03:14,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:03:14,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f925a00573a8210e132b3b HTTP/1.1" 200 None 2026-05-06 23:03:14,975 - lava_callback - ERROR - Error processing callback for node 69f925a00573a8210e132b3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:04:55,077 - lava_callback - INFO - Received callback for node 69f926020573a8210e132b51 INFO: 172.21.0.1:47480 - "POST /node/69f926020573a8210e132b51 HTTP/1.0" 202 Accepted 2026-05-06 23:04:55,085 - lava_callback - INFO - Starting async job submit for node 69f926020573a8210e132b51 2026-05-06 23:04:55,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:04:55,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f926020573a8210e132b51 HTTP/1.1" 200 None 2026-05-06 23:04:55,107 - lava_callback - DEBUG - Processing node 69f926020573a8210e132b51: baseline-arm-clabbe 2026-05-06 23:04:55,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f926020573a8210e132b51 2026-05-06 23:04:55,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:04:55,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f926020573a8210e132b51 HTTP/1.1" 200 None 2026-05-06 23:04:55,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:04:55,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 23:04:55,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:04:55,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f926020573a8210e132b51 HTTP/1.1" 200 None 2026-05-06 23:04:55,178 - lava_callback - ERROR - Error processing callback for node 69f926020573a8210e132b51: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58964 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:05:35,247 - lava_callback - INFO - Received callback for node 69f9262a0573a8210e132b65 INFO: 172.21.0.1:59918 - "POST /node/69f9262a0573a8210e132b65 HTTP/1.0" 202 Accepted 2026-05-06 23:05:35,255 - lava_callback - INFO - Starting async job submit for node 69f9262a0573a8210e132b65 2026-05-06 23:05:35,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:05:35,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9262a0573a8210e132b65 HTTP/1.1" 200 None 2026-05-06 23:05:35,270 - lava_callback - DEBUG - Processing node 69f9262a0573a8210e132b65: baseline-arm-clabbe 2026-05-06 23:05:35,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9262a0573a8210e132b65 2026-05-06 23:05:35,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:05:35,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9262a0573a8210e132b65 HTTP/1.1" 200 None 2026-05-06 23:05:35,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:05:35,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-06 23:05:35,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:05:35,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9262a0573a8210e132b65 HTTP/1.1" 200 None 2026-05-06 23:05:35,321 - lava_callback - ERROR - Error processing callback for node 69f9262a0573a8210e132b65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:06:16,970 - lava_callback - INFO - Received callback for node 69f926540573a8210e132b81 INFO: 172.21.0.1:57892 - "POST /node/69f926540573a8210e132b81 HTTP/1.0" 202 Accepted 2026-05-06 23:06:16,976 - lava_callback - INFO - Starting async job submit for node 69f926540573a8210e132b81 2026-05-06 23:06:16,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:06:16,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f926540573a8210e132b81 HTTP/1.1" 200 None 2026-05-06 23:06:16,990 - lava_callback - DEBUG - Processing node 69f926540573a8210e132b81: baseline-arm64-baylibre 2026-05-06 23:06:16,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f926540573a8210e132b81 2026-05-06 23:06:16,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:06:17,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f926540573a8210e132b81 HTTP/1.1" 200 None 2026-05-06 23:06:17,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:06:17,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:06:17,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:06:17,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f926540573a8210e132b81 HTTP/1.1" 200 None 2026-05-06 23:06:17,045 - lava_callback - ERROR - Error processing callback for node 69f926540573a8210e132b81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:07:36,923 - lava_callback - INFO - Received callback for node 69f926a60573a8210e132bda INFO: 172.21.0.1:47536 - "POST /node/69f926a60573a8210e132bda HTTP/1.0" 202 Accepted 2026-05-06 23:07:36,928 - lava_callback - INFO - Starting async job submit for node 69f926a60573a8210e132bda 2026-05-06 23:07:36,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:07:36,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f926a60573a8210e132bda HTTP/1.1" 200 None 2026-05-06 23:07:36,944 - lava_callback - DEBUG - Processing node 69f926a60573a8210e132bda: baseline-arm64-baylibre 2026-05-06 23:07:36,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f926a60573a8210e132bda 2026-05-06 23:07:36,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:07:36,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f926a60573a8210e132bda HTTP/1.1" 200 None 2026-05-06 23:07:36,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:07:36,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:07:36,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:07:36,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f926a60573a8210e132bda HTTP/1.1" 200 None 2026-05-06 23:07:36,997 - lava_callback - ERROR - Error processing callback for node 69f926a60573a8210e132bda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:08:57,142 - lava_callback - INFO - Received callback for node 69f926f30573a8210e132c0f INFO: 172.21.0.1:56294 - "POST /node/69f926f30573a8210e132c0f HTTP/1.0" 202 Accepted 2026-05-06 23:08:57,148 - lava_callback - INFO - Starting async job submit for node 69f926f30573a8210e132c0f 2026-05-06 23:08:57,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:08:57,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f926f30573a8210e132c0f HTTP/1.1" 200 None 2026-05-06 23:08:57,162 - lava_callback - DEBUG - Processing node 69f926f30573a8210e132c0f: baseline-arm64-baylibre 2026-05-06 23:08:57,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f926f30573a8210e132c0f 2026-05-06 23:08:57,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:08:57,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f926f30573a8210e132c0f HTTP/1.1" 200 None 2026-05-06 23:08:57,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:08:57,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:08:57,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:08:57,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f926f30573a8210e132c0f HTTP/1.1" 200 None 2026-05-06 23:08:57,207 - lava_callback - ERROR - Error processing callback for node 69f926f30573a8210e132c0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:09:56,998 - lava_callback - INFO - Received callback for node 69f9273f0573a8210e132c61 INFO: 172.21.0.1:59896 - "POST /node/69f9273f0573a8210e132c61 HTTP/1.0" 202 Accepted 2026-05-06 23:09:57,005 - lava_callback - INFO - Starting async job submit for node 69f9273f0573a8210e132c61 2026-05-06 23:09:57,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:09:57,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9273f0573a8210e132c61 HTTP/1.1" 200 None 2026-05-06 23:09:57,025 - lava_callback - DEBUG - Processing node 69f9273f0573a8210e132c61: baseline-arm64-baylibre 2026-05-06 23:09:57,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9273f0573a8210e132c61 2026-05-06 23:09:57,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:09:57,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9273f0573a8210e132c61 HTTP/1.1" 200 None 2026-05-06 23:09:57,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:09:57,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:09:57,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:09:57,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9273f0573a8210e132c61 HTTP/1.1" 200 None 2026-05-06 23:09:57,077 - lava_callback - ERROR - Error processing callback for node 69f9273f0573a8210e132c61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35048 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:11:17,126 - lava_callback - INFO - Received callback for node 69f927900573a8210e132c92 INFO: 172.21.0.1:35052 - "POST /node/69f927900573a8210e132c92 HTTP/1.0" 202 Accepted 2026-05-06 23:11:17,132 - lava_callback - INFO - Starting async job submit for node 69f927900573a8210e132c92 2026-05-06 23:11:17,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:11:17,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f927900573a8210e132c92 HTTP/1.1" 200 None 2026-05-06 23:11:17,151 - lava_callback - DEBUG - Processing node 69f927900573a8210e132c92: baseline-arm64-baylibre 2026-05-06 23:11:17,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f927900573a8210e132c92 2026-05-06 23:11:17,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:11:17,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f927900573a8210e132c92 HTTP/1.1" 200 None 2026-05-06 23:11:17,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:11:17,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:11:17,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:11:17,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f927900573a8210e132c92 HTTP/1.1" 200 None 2026-05-06 23:11:17,196 - lava_callback - ERROR - Error processing callback for node 69f927900573a8210e132c92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59680 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:12:57,384 - lava_callback - INFO - Received callback for node 69f927e40573a8210e132cbc INFO: 172.21.0.1:59684 - "POST /node/69f927e40573a8210e132cbc HTTP/1.0" 202 Accepted 2026-05-06 23:12:57,390 - lava_callback - INFO - Starting async job submit for node 69f927e40573a8210e132cbc 2026-05-06 23:12:57,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:12:57,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f927e40573a8210e132cbc HTTP/1.1" 200 None 2026-05-06 23:12:57,421 - lava_callback - DEBUG - Processing node 69f927e40573a8210e132cbc: baseline-arm64-baylibre 2026-05-06 23:12:57,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f927e40573a8210e132cbc 2026-05-06 23:12:57,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:12:57,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f927e40573a8210e132cbc HTTP/1.1" 200 None 2026-05-06 23:12:57,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:12:57,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:12:57,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:12:57,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f927e40573a8210e132cbc HTTP/1.1" 200 None 2026-05-06 23:12:57,473 - lava_callback - ERROR - Error processing callback for node 69f927e40573a8210e132cbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:15:37,327 - lava_callback - INFO - Received callback for node 69f928870573a8210e132d10 INFO: 172.21.0.1:56074 - "POST /node/69f928870573a8210e132d10 HTTP/1.0" 202 Accepted 2026-05-06 23:15:37,332 - lava_callback - INFO - Starting async job submit for node 69f928870573a8210e132d10 2026-05-06 23:15:37,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:15:37,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f928870573a8210e132d10 HTTP/1.1" 200 None 2026-05-06 23:15:37,348 - lava_callback - DEBUG - Processing node 69f928870573a8210e132d10: baseline-arm64-baylibre 2026-05-06 23:15:37,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f928870573a8210e132d10 2026-05-06 23:15:37,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:15:37,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f928870573a8210e132d10 HTTP/1.1" 200 None 2026-05-06 23:15:37,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:15:37,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:15:37,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:15:37,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f928870573a8210e132d10 HTTP/1.1" 200 None 2026-05-06 23:15:37,399 - lava_callback - ERROR - Error processing callback for node 69f928870573a8210e132d10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:16:57,446 - lava_callback - INFO - Received callback for node 69f928d50573a8210e132d43 INFO: 172.21.0.1:36870 - "POST /node/69f928d50573a8210e132d43 HTTP/1.0" 202 Accepted 2026-05-06 23:16:57,451 - lava_callback - INFO - Starting async job submit for node 69f928d50573a8210e132d43 2026-05-06 23:16:57,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:16:57,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f928d50573a8210e132d43 HTTP/1.1" 200 None 2026-05-06 23:16:57,472 - lava_callback - DEBUG - Processing node 69f928d50573a8210e132d43: baseline-arm64-baylibre 2026-05-06 23:16:57,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f928d50573a8210e132d43 2026-05-06 23:16:57,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:16:57,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f928d50573a8210e132d43 HTTP/1.1" 200 None 2026-05-06 23:16:57,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:16:57,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:16:57,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:16:57,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f928d50573a8210e132d43 HTTP/1.1" 200 None 2026-05-06 23:16:57,543 - lava_callback - ERROR - Error processing callback for node 69f928d50573a8210e132d43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:18:17,553 - lava_callback - INFO - Received callback for node 69f929240573a8210e132d6b INFO: 172.21.0.1:57760 - "POST /node/69f929240573a8210e132d6b HTTP/1.0" 202 Accepted 2026-05-06 23:18:17,559 - lava_callback - INFO - Starting async job submit for node 69f929240573a8210e132d6b 2026-05-06 23:18:17,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:18:17,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f929240573a8210e132d6b HTTP/1.1" 200 None 2026-05-06 23:18:17,582 - lava_callback - DEBUG - Processing node 69f929240573a8210e132d6b: baseline-arm64-baylibre 2026-05-06 23:18:17,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f929240573a8210e132d6b 2026-05-06 23:18:17,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:18:17,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f929240573a8210e132d6b HTTP/1.1" 200 None 2026-05-06 23:18:17,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:18:17,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:18:17,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:18:17,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f929240573a8210e132d6b HTTP/1.1" 200 None 2026-05-06 23:18:17,626 - lava_callback - ERROR - Error processing callback for node 69f929240573a8210e132d6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:19:35,652 - lava_callback - INFO - Received callback for node 69f9297f0573a8210e132d9e INFO: 172.21.0.1:57982 - "POST /node/69f9297f0573a8210e132d9e HTTP/1.0" 202 Accepted 2026-05-06 23:19:35,658 - lava_callback - INFO - Starting async job submit for node 69f9297f0573a8210e132d9e 2026-05-06 23:19:35,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:19:35,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9297f0573a8210e132d9e HTTP/1.1" 200 None 2026-05-06 23:19:35,673 - lava_callback - DEBUG - Processing node 69f9297f0573a8210e132d9e: baseline-arm64-clabbe 2026-05-06 23:19:35,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9297f0573a8210e132d9e 2026-05-06 23:19:35,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:19:35,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9297f0573a8210e132d9e HTTP/1.1" 200 None 2026-05-06 23:19:35,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:19:35,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:19:35,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:19:35,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9297f0573a8210e132d9e HTTP/1.1" 200 None 2026-05-06 23:19:35,719 - lava_callback - ERROR - Error processing callback for node 69f9297f0573a8210e132d9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:25:57,938 - lava_callback - INFO - Received callback for node 69f92afe0573a8210e132eb0 INFO: 172.21.0.1:34422 - "POST /node/69f92afe0573a8210e132eb0 HTTP/1.0" 202 Accepted 2026-05-06 23:25:57,944 - lava_callback - INFO - Starting async job submit for node 69f92afe0573a8210e132eb0 2026-05-06 23:25:57,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:25:57,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92afe0573a8210e132eb0 HTTP/1.1" 200 None 2026-05-06 23:25:57,964 - lava_callback - DEBUG - Processing node 69f92afe0573a8210e132eb0: baseline-arm64-baylibre 2026-05-06 23:25:57,965 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92afe0573a8210e132eb0 2026-05-06 23:25:57,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:25:57,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92afe0573a8210e132eb0 HTTP/1.1" 200 None 2026-05-06 23:25:57,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:25:58,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 23:25:58,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:25:58,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92afe0573a8210e132eb0 HTTP/1.1" 200 None 2026-05-06 23:25:58,032 - lava_callback - ERROR - Error processing callback for node 69f92afe0573a8210e132eb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49420 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:27:18,009 - lava_callback - INFO - Received callback for node 69f92b530573a8210e132eda INFO: 172.21.0.1:49426 - "POST /node/69f92b530573a8210e132eda HTTP/1.0" 202 Accepted 2026-05-06 23:27:18,015 - lava_callback - INFO - Starting async job submit for node 69f92b530573a8210e132eda 2026-05-06 23:27:18,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:27:18,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92b530573a8210e132eda HTTP/1.1" 200 None 2026-05-06 23:27:18,031 - lava_callback - DEBUG - Processing node 69f92b530573a8210e132eda: baseline-arm64-baylibre 2026-05-06 23:27:18,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92b530573a8210e132eda 2026-05-06 23:27:18,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:27:18,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92b530573a8210e132eda HTTP/1.1" 200 None 2026-05-06 23:27:18,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:27:18,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 23:27:18,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:27:18,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92b530573a8210e132eda HTTP/1.1" 200 None 2026-05-06 23:27:18,078 - lava_callback - ERROR - Error processing callback for node 69f92b530573a8210e132eda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:28:58,133 - lava_callback - INFO - Received callback for node 69f92ba40573a8210e132efe INFO: 172.21.0.1:51070 - "POST /node/69f92ba40573a8210e132efe HTTP/1.0" 202 Accepted 2026-05-06 23:28:58,140 - lava_callback - INFO - Starting async job submit for node 69f92ba40573a8210e132efe 2026-05-06 23:28:58,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:28:58,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92ba40573a8210e132efe HTTP/1.1" 200 None 2026-05-06 23:28:58,156 - lava_callback - DEBUG - Processing node 69f92ba40573a8210e132efe: baseline-arm64-baylibre 2026-05-06 23:28:58,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92ba40573a8210e132efe 2026-05-06 23:28:58,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:28:58,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92ba40573a8210e132efe HTTP/1.1" 200 None 2026-05-06 23:28:58,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:28:58,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 23:28:58,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:28:58,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92ba40573a8210e132efe HTTP/1.1" 200 None 2026-05-06 23:28:58,220 - lava_callback - ERROR - Error processing callback for node 69f92ba40573a8210e132efe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:30:18,154 - lava_callback - INFO - Received callback for node 69f92bf50573a8210e132f29 INFO: 172.21.0.1:46636 - "POST /node/69f92bf50573a8210e132f29 HTTP/1.0" 202 Accepted 2026-05-06 23:30:18,159 - lava_callback - INFO - Starting async job submit for node 69f92bf50573a8210e132f29 2026-05-06 23:30:18,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:30:18,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92bf50573a8210e132f29 HTTP/1.1" 200 None 2026-05-06 23:30:18,175 - lava_callback - DEBUG - Processing node 69f92bf50573a8210e132f29: baseline-arm64-baylibre 2026-05-06 23:30:18,176 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92bf50573a8210e132f29 2026-05-06 23:30:18,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:30:18,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92bf50573a8210e132f29 HTTP/1.1" 200 None 2026-05-06 23:30:18,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:30:18,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 23:30:18,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:30:18,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92bf50573a8210e132f29 HTTP/1.1" 200 None 2026-05-06 23:30:18,232 - lava_callback - ERROR - Error processing callback for node 69f92bf50573a8210e132f29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:32:38,286 - lava_callback - INFO - Received callback for node 69f92c930573a8210e132f78 INFO: 172.21.0.1:46616 - "POST /node/69f92c930573a8210e132f78 HTTP/1.0" 202 Accepted 2026-05-06 23:32:38,294 - lava_callback - INFO - Starting async job submit for node 69f92c930573a8210e132f78 2026-05-06 23:32:38,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:32:38,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92c930573a8210e132f78 HTTP/1.1" 200 None 2026-05-06 23:32:38,315 - lava_callback - DEBUG - Processing node 69f92c930573a8210e132f78: baseline-arm64-baylibre 2026-05-06 23:32:38,316 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92c930573a8210e132f78 2026-05-06 23:32:38,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:32:38,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92c930573a8210e132f78 HTTP/1.1" 200 None 2026-05-06 23:32:38,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:32:38,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 23:32:38,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:32:38,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92c930573a8210e132f78 HTTP/1.1" 200 None 2026-05-06 23:32:38,375 - lava_callback - ERROR - Error processing callback for node 69f92c930573a8210e132f78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34398 - "GET /node/69f48af5ec4729f146b4305b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47352 - "GET /node/699341c531166481c8dee357%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56118 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:36:56,332 - lava_callback - INFO - Received callback for node 69f92d8e0573a8210e132ffe INFO: 172.21.0.1:47620 - "POST /node/69f92d8e0573a8210e132ffe HTTP/1.0" 202 Accepted 2026-05-06 23:36:56,337 - lava_callback - INFO - Starting async job submit for node 69f92d8e0573a8210e132ffe 2026-05-06 23:36:56,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:36:56,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92d8e0573a8210e132ffe HTTP/1.1" 200 None 2026-05-06 23:36:56,352 - lava_callback - DEBUG - Processing node 69f92d8e0573a8210e132ffe: baseline-arm64-clabbe 2026-05-06 23:36:56,353 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92d8e0573a8210e132ffe 2026-05-06 23:36:56,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:36:56,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92d8e0573a8210e132ffe HTTP/1.1" 200 None 2026-05-06 23:36:56,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:36:56,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 23:36:56,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:36:56,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92d8e0573a8210e132ffe HTTP/1.1" 200 None 2026-05-06 23:36:56,398 - lava_callback - ERROR - Error processing callback for node 69f92d8e0573a8210e132ffe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47392 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:38:36,362 - lava_callback - INFO - Received callback for node 69f92de50573a8210e13302c INFO: 172.21.0.1:39806 - "POST /node/69f92de50573a8210e13302c HTTP/1.0" 202 Accepted 2026-05-06 23:38:36,368 - lava_callback - INFO - Starting async job submit for node 69f92de50573a8210e13302c 2026-05-06 23:38:36,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:38:36,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92de50573a8210e13302c HTTP/1.1" 200 None 2026-05-06 23:38:36,382 - lava_callback - DEBUG - Processing node 69f92de50573a8210e13302c: baseline-arm64-clabbe 2026-05-06 23:38:36,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92de50573a8210e13302c 2026-05-06 23:38:36,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:38:36,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92de50573a8210e13302c HTTP/1.1" 200 None 2026-05-06 23:38:36,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:38:36,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 23:38:36,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:38:36,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92de50573a8210e13302c HTTP/1.1" 200 None 2026-05-06 23:38:36,427 - lava_callback - ERROR - Error processing callback for node 69f92de50573a8210e13302c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:39:56,415 - lava_callback - INFO - Received callback for node 69f92e3a0573a8210e13304d INFO: 172.21.0.1:47466 - "POST /node/69f92e3a0573a8210e13304d HTTP/1.0" 202 Accepted 2026-05-06 23:39:56,421 - lava_callback - INFO - Starting async job submit for node 69f92e3a0573a8210e13304d 2026-05-06 23:39:56,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:39:56,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92e3a0573a8210e13304d HTTP/1.1" 200 None 2026-05-06 23:39:56,438 - lava_callback - DEBUG - Processing node 69f92e3a0573a8210e13304d: baseline-arm64-clabbe 2026-05-06 23:39:56,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92e3a0573a8210e13304d 2026-05-06 23:39:56,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:39:56,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92e3a0573a8210e13304d HTTP/1.1" 200 None 2026-05-06 23:39:56,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:39:56,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 23:39:56,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:39:56,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92e3a0573a8210e13304d HTTP/1.1" 200 None 2026-05-06 23:39:56,484 - lava_callback - ERROR - Error processing callback for node 69f92e3a0573a8210e13304d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-06 23:41:16,473 - lava_callback - INFO - Received callback for node 69f92e8f0573a8210e13307a INFO: 172.21.0.1:57494 - "POST /node/69f92e8f0573a8210e13307a HTTP/1.0" 202 Accepted 2026-05-06 23:41:16,478 - lava_callback - INFO - Starting async job submit for node 69f92e8f0573a8210e13307a 2026-05-06 23:41:16,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:41:16,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92e8f0573a8210e13307a HTTP/1.1" 200 None 2026-05-06 23:41:16,542 - lava_callback - DEBUG - Processing node 69f92e8f0573a8210e13307a: baseline-arm64-clabbe 2026-05-06 23:41:16,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92e8f0573a8210e13307a 2026-05-06 23:41:16,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:41:16,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92e8f0573a8210e13307a HTTP/1.1" 200 None 2026-05-06 23:41:16,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:41:16,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 23:41:16,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:41:16,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92e8f0573a8210e13307a HTTP/1.1" 200 None 2026-05-06 23:41:16,615 - lava_callback - ERROR - Error processing callback for node 69f92e8f0573a8210e13307a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:42:36,542 - lava_callback - INFO - Received callback for node 69f92ee30573a8210e1330a5 INFO: 172.21.0.1:56810 - "POST /node/69f92ee30573a8210e1330a5 HTTP/1.0" 202 Accepted 2026-05-06 23:42:36,548 - lava_callback - INFO - Starting async job submit for node 69f92ee30573a8210e1330a5 2026-05-06 23:42:36,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:42:36,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92ee30573a8210e1330a5 HTTP/1.1" 200 None 2026-05-06 23:42:36,590 - lava_callback - DEBUG - Processing node 69f92ee30573a8210e1330a5: baseline-arm64-clabbe 2026-05-06 23:42:36,590 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92ee30573a8210e1330a5 2026-05-06 23:42:36,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:42:36,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92ee30573a8210e1330a5 HTTP/1.1" 200 None 2026-05-06 23:42:36,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:42:36,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 23:42:36,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:42:36,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92ee30573a8210e1330a5 HTTP/1.1" 200 None 2026-05-06 23:42:36,636 - lava_callback - ERROR - Error processing callback for node 69f92ee30573a8210e1330a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:43:56,571 - lava_callback - INFO - Received callback for node 69f92f340573a8210e1330d4 INFO: 172.21.0.1:45558 - "POST /node/69f92f340573a8210e1330d4 HTTP/1.0" 202 Accepted 2026-05-06 23:43:56,577 - lava_callback - INFO - Starting async job submit for node 69f92f340573a8210e1330d4 2026-05-06 23:43:56,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:43:56,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92f340573a8210e1330d4 HTTP/1.1" 200 None 2026-05-06 23:43:56,592 - lava_callback - DEBUG - Processing node 69f92f340573a8210e1330d4: baseline-arm64-clabbe 2026-05-06 23:43:56,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92f340573a8210e1330d4 2026-05-06 23:43:56,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:43:56,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92f340573a8210e1330d4 HTTP/1.1" 200 None 2026-05-06 23:43:56,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:43:56,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-06 23:43:56,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:43:56,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92f340573a8210e1330d4 HTTP/1.1" 200 None 2026-05-06 23:43:56,638 - lava_callback - ERROR - Error processing callback for node 69f92f340573a8210e1330d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET /node/69f71b7687005b7b22f0deec%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:45:16,654 - lava_callback - INFO - Received callback for node 69f92f860573a8210e133104 INFO: 172.21.0.1:48990 - "POST /node/69f92f860573a8210e133104 HTTP/1.0" 202 Accepted 2026-05-06 23:45:16,661 - lava_callback - INFO - Starting async job submit for node 69f92f860573a8210e133104 2026-05-06 23:45:16,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:45:16,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92f860573a8210e133104 HTTP/1.1" 200 None 2026-05-06 23:45:16,676 - lava_callback - DEBUG - Processing node 69f92f860573a8210e133104: baseline-arm64-clabbe 2026-05-06 23:45:16,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92f860573a8210e133104 2026-05-06 23:45:16,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:45:16,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92f860573a8210e133104 HTTP/1.1" 200 None 2026-05-06 23:45:16,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:45:16,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:45:16,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:45:16,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92f860573a8210e133104 HTTP/1.1" 200 None 2026-05-06 23:45:16,745 - lava_callback - ERROR - Error processing callback for node 69f92f860573a8210e133104: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:46:39,209 - lava_callback - INFO - Received callback for node 69f92fd00573a8210e133124 INFO: 172.21.0.1:39312 - "POST /node/69f92fd00573a8210e133124 HTTP/1.0" 202 Accepted 2026-05-06 23:46:39,215 - lava_callback - INFO - Starting async job submit for node 69f92fd00573a8210e133124 2026-05-06 23:46:39,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:46:39,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92fd00573a8210e133124 HTTP/1.1" 200 None 2026-05-06 23:46:39,230 - lava_callback - DEBUG - Processing node 69f92fd00573a8210e133124: baseline-arm64-baylibre 2026-05-06 23:46:39,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f92fd00573a8210e133124 2026-05-06 23:46:39,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:46:39,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f92fd00573a8210e133124 HTTP/1.1" 200 None 2026-05-06 23:46:39,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:46:39,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:46:39,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:46:39,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f92fd00573a8210e133124 HTTP/1.1" 200 None 2026-05-06 23:46:39,275 - lava_callback - ERROR - Error processing callback for node 69f92fd00573a8210e133124: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:47:56,787 - lava_callback - INFO - Received callback for node 69f930260573a8210e133151 INFO: 172.21.0.1:33348 - "POST /node/69f930260573a8210e133151 HTTP/1.0" 202 Accepted 2026-05-06 23:47:56,793 - lava_callback - INFO - Starting async job submit for node 69f930260573a8210e133151 2026-05-06 23:47:56,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:47:56,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f930260573a8210e133151 HTTP/1.1" 200 None 2026-05-06 23:47:56,808 - lava_callback - DEBUG - Processing node 69f930260573a8210e133151: baseline-arm64-clabbe 2026-05-06 23:47:56,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f930260573a8210e133151 2026-05-06 23:47:56,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:47:56,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f930260573a8210e133151 HTTP/1.1" 200 None 2026-05-06 23:47:56,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:47:56,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:47:56,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:47:56,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f930260573a8210e133151 HTTP/1.1" 200 None 2026-05-06 23:47:56,859 - lava_callback - ERROR - Error processing callback for node 69f930260573a8210e133151: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:49:36,846 - lava_callback - INFO - Received callback for node 69f9307b0573a8210e13317c INFO: 172.21.0.1:44938 - "POST /node/69f9307b0573a8210e13317c HTTP/1.0" 202 Accepted 2026-05-06 23:49:36,851 - lava_callback - INFO - Starting async job submit for node 69f9307b0573a8210e13317c 2026-05-06 23:49:36,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:49:36,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9307b0573a8210e13317c HTTP/1.1" 200 None 2026-05-06 23:49:36,869 - lava_callback - DEBUG - Processing node 69f9307b0573a8210e13317c: baseline-arm64-clabbe 2026-05-06 23:49:36,869 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9307b0573a8210e13317c 2026-05-06 23:49:36,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:49:36,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9307b0573a8210e13317c HTTP/1.1" 200 None 2026-05-06 23:49:36,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:49:36,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:49:36,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:49:36,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9307b0573a8210e13317c HTTP/1.1" 200 None 2026-05-06 23:49:36,914 - lava_callback - ERROR - Error processing callback for node 69f9307b0573a8210e13317c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:50:56,868 - lava_callback - INFO - Received callback for node 69f930d00573a8210e1331ab INFO: 172.21.0.1:48948 - "POST /node/69f930d00573a8210e1331ab HTTP/1.0" 202 Accepted 2026-05-06 23:50:56,873 - lava_callback - INFO - Starting async job submit for node 69f930d00573a8210e1331ab 2026-05-06 23:50:56,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:50:56,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f930d00573a8210e1331ab HTTP/1.1" 200 None 2026-05-06 23:50:56,891 - lava_callback - DEBUG - Processing node 69f930d00573a8210e1331ab: baseline-arm64-clabbe 2026-05-06 23:50:56,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f930d00573a8210e1331ab 2026-05-06 23:50:56,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:50:56,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f930d00573a8210e1331ab HTTP/1.1" 200 None 2026-05-06 23:50:56,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:50:56,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:50:56,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:50:56,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f930d00573a8210e1331ab HTTP/1.1" 200 None 2026-05-06 23:50:56,936 - lava_callback - ERROR - Error processing callback for node 69f930d00573a8210e1331ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET /node/699037b2985e4efca431cfbf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:52:16,943 - lava_callback - INFO - Received callback for node 69f931280573a8210e1331d7 INFO: 172.21.0.1:48988 - "POST /node/69f931280573a8210e1331d7 HTTP/1.0" 202 Accepted 2026-05-06 23:52:16,948 - lava_callback - INFO - Starting async job submit for node 69f931280573a8210e1331d7 2026-05-06 23:52:16,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:52:16,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f931280573a8210e1331d7 HTTP/1.1" 200 None 2026-05-06 23:52:16,964 - lava_callback - DEBUG - Processing node 69f931280573a8210e1331d7: baseline-arm64-clabbe 2026-05-06 23:52:16,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f931280573a8210e1331d7 2026-05-06 23:52:16,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:52:16,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f931280573a8210e1331d7 HTTP/1.1" 200 None 2026-05-06 23:52:16,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:52:17,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:52:17,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:52:17,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f931280573a8210e1331d7 HTTP/1.1" 200 None 2026-05-06 23:52:17,020 - lava_callback - ERROR - Error processing callback for node 69f931280573a8210e1331d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:53:37,134 - lava_callback - INFO - Received callback for node 69f9317c0573a8210e133227 INFO: 172.21.0.1:57686 - "POST /node/69f9317c0573a8210e133227 HTTP/1.0" 202 Accepted 2026-05-06 23:53:37,140 - lava_callback - INFO - Starting async job submit for node 69f9317c0573a8210e133227 2026-05-06 23:53:37,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:53:37,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9317c0573a8210e133227 HTTP/1.1" 200 None 2026-05-06 23:53:37,155 - lava_callback - DEBUG - Processing node 69f9317c0573a8210e133227: baseline-arm64-clabbe 2026-05-06 23:53:37,155 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9317c0573a8210e133227 2026-05-06 23:53:37,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:53:37,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9317c0573a8210e133227 HTTP/1.1" 200 None 2026-05-06 23:53:37,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:53:37,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:53:37,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:53:37,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9317c0573a8210e133227 HTTP/1.1" 200 None 2026-05-06 23:53:37,204 - lava_callback - ERROR - Error processing callback for node 69f9317c0573a8210e133227: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:55:17,078 - lava_callback - INFO - Received callback for node 69f931d10573a8210e13326c INFO: 172.21.0.1:60800 - "POST /node/69f931d10573a8210e13326c HTTP/1.0" 202 Accepted 2026-05-06 23:55:17,083 - lava_callback - INFO - Starting async job submit for node 69f931d10573a8210e13326c 2026-05-06 23:55:17,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:55:17,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f931d10573a8210e13326c HTTP/1.1" 200 None 2026-05-06 23:55:17,123 - lava_callback - DEBUG - Processing node 69f931d10573a8210e13326c: baseline-arm64-clabbe 2026-05-06 23:55:17,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f931d10573a8210e13326c 2026-05-06 23:55:17,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:55:17,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f931d10573a8210e13326c HTTP/1.1" 200 None 2026-05-06 23:55:17,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:55:17,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:55:17,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:55:17,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f931d10573a8210e13326c HTTP/1.1" 200 None 2026-05-06 23:55:17,175 - lava_callback - ERROR - Error processing callback for node 69f931d10573a8210e13326c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:56:37,080 - lava_callback - INFO - Received callback for node 69f932240573a8210e1332af INFO: 172.21.0.1:43872 - "POST /node/69f932240573a8210e1332af HTTP/1.0" 202 Accepted 2026-05-06 23:56:37,085 - lava_callback - INFO - Starting async job submit for node 69f932240573a8210e1332af 2026-05-06 23:56:37,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:56:37,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f932240573a8210e1332af HTTP/1.1" 200 None 2026-05-06 23:56:37,102 - lava_callback - DEBUG - Processing node 69f932240573a8210e1332af: baseline-arm64-clabbe 2026-05-06 23:56:37,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f932240573a8210e1332af 2026-05-06 23:56:37,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:56:37,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f932240573a8210e1332af HTTP/1.1" 200 None 2026-05-06 23:56:37,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:56:37,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:56:37,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:56:37,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f932240573a8210e1332af HTTP/1.1" 200 None 2026-05-06 23:56:37,150 - lava_callback - ERROR - Error processing callback for node 69f932240573a8210e1332af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44550 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:57:57,150 - lava_callback - INFO - Received callback for node 69f932740573a8210e1332e8 INFO: 172.21.0.1:44556 - "POST /node/69f932740573a8210e1332e8 HTTP/1.0" 202 Accepted 2026-05-06 23:57:57,156 - lava_callback - INFO - Starting async job submit for node 69f932740573a8210e1332e8 2026-05-06 23:57:57,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:57:57,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f932740573a8210e1332e8 HTTP/1.1" 200 None 2026-05-06 23:57:57,171 - lava_callback - DEBUG - Processing node 69f932740573a8210e1332e8: baseline-arm64-clabbe 2026-05-06 23:57:57,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f932740573a8210e1332e8 2026-05-06 23:57:57,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:57:57,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f932740573a8210e1332e8 HTTP/1.1" 200 None 2026-05-06 23:57:57,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:57:57,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:57:57,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:57:57,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f932740573a8210e1332e8 HTTP/1.1" 200 None 2026-05-06 23:57:57,224 - lava_callback - ERROR - Error processing callback for node 69f932740573a8210e1332e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK 2026-05-06 23:59:17,209 - lava_callback - INFO - Received callback for node 69f932c70573a8210e13330a INFO: 172.21.0.1:48632 - "POST /node/69f932c70573a8210e13330a HTTP/1.0" 202 Accepted 2026-05-06 23:59:17,217 - lava_callback - INFO - Starting async job submit for node 69f932c70573a8210e13330a 2026-05-06 23:59:17,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:59:17,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f932c70573a8210e13330a HTTP/1.1" 200 None 2026-05-06 23:59:17,233 - lava_callback - DEBUG - Processing node 69f932c70573a8210e13330a: baseline-arm64-clabbe 2026-05-06 23:59:17,233 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f932c70573a8210e13330a 2026-05-06 23:59:17,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:59:17,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f932c70573a8210e13330a HTTP/1.1" 200 None 2026-05-06 23:59:17,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:59:17,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-06 23:59:17,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 23:59:17,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f932c70573a8210e13330a HTTP/1.1" 200 None 2026-05-06 23:59:17,283 - lava_callback - ERROR - Error processing callback for node 69f932c70573a8210e13330a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:00:37,282 - lava_callback - INFO - Received callback for node 69f933200573a8210e133337 INFO: 172.21.0.1:47520 - "POST /node/69f933200573a8210e133337 HTTP/1.0" 202 Accepted 2026-05-07 00:00:37,289 - lava_callback - INFO - Starting async job submit for node 69f933200573a8210e133337 2026-05-07 00:00:37,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:00:37,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f933200573a8210e133337 HTTP/1.1" 200 None 2026-05-07 00:00:37,310 - lava_callback - DEBUG - Processing node 69f933200573a8210e133337: baseline-arm64-clabbe 2026-05-07 00:00:37,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f933200573a8210e133337 2026-05-07 00:00:37,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:00:37,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f933200573a8210e133337 HTTP/1.1" 200 None 2026-05-07 00:00:37,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:00:37,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-07 00:00:37,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:00:37,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f933200573a8210e133337 HTTP/1.1" 200 None 2026-05-07 00:00:37,378 - lava_callback - ERROR - Error processing callback for node 69f933200573a8210e133337: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:01:59,888 - lava_callback - INFO - Received callback for node 69f9336e0573a8210e133363 INFO: 172.21.0.1:55132 - "POST /node/69f9336e0573a8210e133363 HTTP/1.0" 202 Accepted 2026-05-07 00:01:59,894 - lava_callback - INFO - Starting async job submit for node 69f9336e0573a8210e133363 2026-05-07 00:01:59,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:01:59,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9336e0573a8210e133363 HTTP/1.1" 200 None 2026-05-07 00:01:59,909 - lava_callback - DEBUG - Processing node 69f9336e0573a8210e133363: baseline-arm64-baylibre 2026-05-07 00:01:59,910 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9336e0573a8210e133363 2026-05-07 00:01:59,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:01:59,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9336e0573a8210e133363 HTTP/1.1" 200 None 2026-05-07 00:01:59,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:01:59,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-07 00:01:59,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:01:59,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9336e0573a8210e133363 HTTP/1.1" 200 None 2026-05-07 00:01:59,957 - lava_callback - ERROR - Error processing callback for node 69f9336e0573a8210e133363: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56716 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:03:37,402 - lava_callback - INFO - Received callback for node 69f933c70573a8210e13338f INFO: 172.21.0.1:56728 - "POST /node/69f933c70573a8210e13338f HTTP/1.0" 202 Accepted 2026-05-07 00:03:37,408 - lava_callback - INFO - Starting async job submit for node 69f933c70573a8210e13338f 2026-05-07 00:03:37,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:03:37,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f933c70573a8210e13338f HTTP/1.1" 200 None 2026-05-07 00:03:37,423 - lava_callback - DEBUG - Processing node 69f933c70573a8210e13338f: baseline-arm64-clabbe 2026-05-07 00:03:37,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f933c70573a8210e13338f 2026-05-07 00:03:37,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:03:37,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f933c70573a8210e13338f HTTP/1.1" 200 None 2026-05-07 00:03:37,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:03:37,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-07 00:03:37,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:03:37,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f933c70573a8210e13338f HTTP/1.1" 200 None 2026-05-07 00:03:37,485 - lava_callback - ERROR - Error processing callback for node 69f933c70573a8210e13338f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:04:57,784 - lava_callback - INFO - Received callback for node 69f9341e0573a8210e1333bb INFO: 172.21.0.1:36882 - "POST /node/69f9341e0573a8210e1333bb HTTP/1.0" 202 Accepted 2026-05-07 00:04:57,789 - lava_callback - INFO - Starting async job submit for node 69f9341e0573a8210e1333bb 2026-05-07 00:04:57,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:04:57,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9341e0573a8210e1333bb HTTP/1.1" 200 None 2026-05-07 00:04:57,805 - lava_callback - DEBUG - Processing node 69f9341e0573a8210e1333bb: baseline-arm64-clabbe 2026-05-07 00:04:57,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9341e0573a8210e1333bb 2026-05-07 00:04:57,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:04:57,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9341e0573a8210e1333bb HTTP/1.1" 200 None 2026-05-07 00:04:57,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:04:57,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-07 00:04:57,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:04:57,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9341e0573a8210e1333bb HTTP/1.1" 200 None 2026-05-07 00:04:57,853 - lava_callback - ERROR - Error processing callback for node 69f9341e0573a8210e1333bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41892 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:06:17,476 - lava_callback - INFO - Received callback for node 69f934760573a8210e1333e6 INFO: 172.21.0.1:41906 - "POST /node/69f934760573a8210e1333e6 HTTP/1.0" 202 Accepted 2026-05-07 00:06:17,482 - lava_callback - INFO - Starting async job submit for node 69f934760573a8210e1333e6 2026-05-07 00:06:17,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:06:17,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f934760573a8210e1333e6 HTTP/1.1" 200 None 2026-05-07 00:06:17,497 - lava_callback - DEBUG - Processing node 69f934760573a8210e1333e6: baseline-arm64-clabbe 2026-05-07 00:06:17,497 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f934760573a8210e1333e6 2026-05-07 00:06:17,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:06:17,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f934760573a8210e1333e6 HTTP/1.1" 200 None 2026-05-07 00:06:17,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:06:17,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-07 00:06:17,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:06:17,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f934760573a8210e1333e6 HTTP/1.1" 200 None 2026-05-07 00:06:17,569 - lava_callback - ERROR - Error processing callback for node 69f934760573a8210e1333e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41022 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:07:40,367 - lava_callback - INFO - Received callback for node 69f934c60573a8210e133403 INFO: 172.21.0.1:41738 - "POST /node/69f934c60573a8210e133403 HTTP/1.0" 202 Accepted 2026-05-07 00:07:40,373 - lava_callback - INFO - Starting async job submit for node 69f934c60573a8210e133403 2026-05-07 00:07:40,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:07:40,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f934c60573a8210e133403 HTTP/1.1" 200 None 2026-05-07 00:07:40,389 - lava_callback - DEBUG - Processing node 69f934c60573a8210e133403: baseline-arm64-baylibre 2026-05-07 00:07:40,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f934c60573a8210e133403 2026-05-07 00:07:40,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:07:40,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f934c60573a8210e133403 HTTP/1.1" 200 None 2026-05-07 00:07:40,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:07:40,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-07 00:07:40,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:07:40,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f934c60573a8210e133403 HTTP/1.1" 200 None 2026-05-07 00:07:40,440 - lava_callback - ERROR - Error processing callback for node 69f934c60573a8210e133403: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33616 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:09:17,564 - lava_callback - INFO - Received callback for node 69f935240573a8210e13342d INFO: 172.21.0.1:33630 - "POST /node/69f935240573a8210e13342d HTTP/1.0" 202 Accepted 2026-05-07 00:09:17,569 - lava_callback - INFO - Starting async job submit for node 69f935240573a8210e13342d 2026-05-07 00:09:17,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:09:17,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f935240573a8210e13342d HTTP/1.1" 200 None 2026-05-07 00:09:17,608 - lava_callback - DEBUG - Processing node 69f935240573a8210e13342d: baseline-arm64-clabbe 2026-05-07 00:09:17,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f935240573a8210e13342d 2026-05-07 00:09:17,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:09:17,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f935240573a8210e13342d HTTP/1.1" 200 None 2026-05-07 00:09:17,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:09:17,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-07 00:09:17,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:09:17,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f935240573a8210e13342d HTTP/1.1" 200 None 2026-05-07 00:09:17,690 - lava_callback - ERROR - Error processing callback for node 69f935240573a8210e13342d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:10:57,644 - lava_callback - INFO - Received callback for node 69f9357c0573a8210e133455 INFO: 172.21.0.1:38672 - "POST /node/69f9357c0573a8210e133455 HTTP/1.0" 202 Accepted 2026-05-07 00:10:57,649 - lava_callback - INFO - Starting async job submit for node 69f9357c0573a8210e133455 2026-05-07 00:10:57,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:10:57,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9357c0573a8210e133455 HTTP/1.1" 200 None 2026-05-07 00:10:57,674 - lava_callback - DEBUG - Processing node 69f9357c0573a8210e133455: baseline-arm64-clabbe 2026-05-07 00:10:57,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f9357c0573a8210e133455 2026-05-07 00:10:57,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:10:57,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9357c0573a8210e133455 HTTP/1.1" 200 None 2026-05-07 00:10:57,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:10:57,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-07 00:10:57,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:10:57,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9357c0573a8210e133455 HTTP/1.1" 200 None 2026-05-07 00:10:57,731 - lava_callback - ERROR - Error processing callback for node 69f9357c0573a8210e133455: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49474 - "GET / HTTP/1.0" 200 OK 2026-05-07 00:12:17,672 - lava_callback - INFO - Received callback for node 69f935d10573a8210e133480 INFO: 172.21.0.1:49482 - "POST /node/69f935d10573a8210e133480 HTTP/1.0" 202 Accepted 2026-05-07 00:12:17,681 - lava_callback - INFO - Starting async job submit for node 69f935d10573a8210e133480 2026-05-07 00:12:17,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:12:17,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f935d10573a8210e133480 HTTP/1.1" 200 None 2026-05-07 00:12:17,704 - lava_callback - DEBUG - Processing node 69f935d10573a8210e133480: baseline-arm64-clabbe 2026-05-07 00:12:17,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f935d10573a8210e133480 2026-05-07 00:12:17,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:12:17,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f935d10573a8210e133480 HTTP/1.1" 200 None 2026-05-07 00:12:17,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:12:17,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-07 00:12:17,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-07 00:12:17,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f935d10573a8210e133480 HTTP/1.1" 200 None 2026-05-07 00:12:17,788 - lava_callback - ERROR - Error processing callback for node 69f935d10573a8210e133480: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]