INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45106 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60740 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:24:31,183 - lava_callback - INFO - Received callback for node 69fb6b2adf29cd80ecaa02e7 2026-05-08 16:24:31,193 - lava_callback - INFO - Starting async job submit for node 69fb6b2adf29cd80ecaa02e7 INFO: 172.20.0.1:46220 - "POST /node/69fb6b2adf29cd80ecaa02e7 HTTP/1.0" 202 Accepted 2026-05-08 16:24:31,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:24:31,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6b2adf29cd80ecaa02e7 HTTP/1.1" 200 None 2026-05-08 16:24:31,226 - lava_callback - DEBUG - Processing node 69fb6b2adf29cd80ecaa02e7: baseline-arm64-baylibre 2026-05-08 16:24:31,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6b2adf29cd80ecaa02e7 2026-05-08 16:24:31,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:24:31,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6b2adf29cd80ecaa02e7 HTTP/1.1" 200 None 2026-05-08 16:24:31,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:24:31,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:24:31,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:24:31,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6b2adf29cd80ecaa02e7 HTTP/1.1" 200 None 2026-05-08 16:24:31,294 - lava_callback - ERROR - Error processing callback for node 69fb6b2adf29cd80ecaa02e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34446 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:25:31,126 - lava_callback - INFO - Received callback for node 69fb6b78df29cd80ecaa0304 INFO: 172.20.0.1:48406 - "POST /node/69fb6b78df29cd80ecaa0304 HTTP/1.0" 202 Accepted 2026-05-08 16:25:31,134 - lava_callback - INFO - Starting async job submit for node 69fb6b78df29cd80ecaa0304 2026-05-08 16:25:31,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:25:31,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6b78df29cd80ecaa0304 HTTP/1.1" 200 None 2026-05-08 16:25:31,149 - lava_callback - DEBUG - Processing node 69fb6b78df29cd80ecaa0304: baseline-arm64-baylibre 2026-05-08 16:25:31,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6b78df29cd80ecaa0304 2026-05-08 16:25:31,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:25:31,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6b78df29cd80ecaa0304 HTTP/1.1" 200 None 2026-05-08 16:25:31,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:25:31,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:25:31,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:25:31,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6b78df29cd80ecaa0304 HTTP/1.1" 200 None 2026-05-08 16:25:31,195 - lava_callback - ERROR - Error processing callback for node 69fb6b78df29cd80ecaa0304: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35288 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:27:11,351 - lava_callback - INFO - Received callback for node 69fb6bdddf29cd80ecaa0328 INFO: 172.20.0.1:39514 - "POST /node/69fb6bdddf29cd80ecaa0328 HTTP/1.0" 202 Accepted 2026-05-08 16:27:11,356 - lava_callback - INFO - Starting async job submit for node 69fb6bdddf29cd80ecaa0328 2026-05-08 16:27:11,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:27:11,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6bdddf29cd80ecaa0328 HTTP/1.1" 200 None 2026-05-08 16:27:11,375 - lava_callback - DEBUG - Processing node 69fb6bdddf29cd80ecaa0328: baseline-arm64-baylibre 2026-05-08 16:27:11,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6bdddf29cd80ecaa0328 2026-05-08 16:27:11,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:27:11,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6bdddf29cd80ecaa0328 HTTP/1.1" 200 None 2026-05-08 16:27:11,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:27:11,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:27:11,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:27:11,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6bdddf29cd80ecaa0328 HTTP/1.1" 200 None 2026-05-08 16:27:11,430 - lava_callback - ERROR - Error processing callback for node 69fb6bdddf29cd80ecaa0328: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33530 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:28:31,338 - lava_callback - INFO - Received callback for node 69fb6c29df29cd80ecaa0348 INFO: 172.20.0.1:35202 - "POST /node/69fb6c29df29cd80ecaa0348 HTTP/1.0" 202 Accepted 2026-05-08 16:28:31,344 - lava_callback - INFO - Starting async job submit for node 69fb6c29df29cd80ecaa0348 2026-05-08 16:28:31,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:28:31,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6c29df29cd80ecaa0348 HTTP/1.1" 200 None 2026-05-08 16:28:31,358 - lava_callback - DEBUG - Processing node 69fb6c29df29cd80ecaa0348: baseline-arm64-baylibre 2026-05-08 16:28:31,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6c29df29cd80ecaa0348 2026-05-08 16:28:31,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:28:31,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6c29df29cd80ecaa0348 HTTP/1.1" 200 None 2026-05-08 16:28:31,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:28:31,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:28:31,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:28:31,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6c29df29cd80ecaa0348 HTTP/1.1" 200 None 2026-05-08 16:28:31,405 - lava_callback - ERROR - Error processing callback for node 69fb6c29df29cd80ecaa0348: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37966 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:29:51,456 - lava_callback - INFO - Received callback for node 69fb6c76df29cd80ecaa0370 INFO: 172.20.0.1:37976 - "POST /node/69fb6c76df29cd80ecaa0370 HTTP/1.0" 202 Accepted 2026-05-08 16:29:51,461 - lava_callback - INFO - Starting async job submit for node 69fb6c76df29cd80ecaa0370 2026-05-08 16:29:51,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:29:51,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6c76df29cd80ecaa0370 HTTP/1.1" 200 None 2026-05-08 16:29:51,480 - lava_callback - DEBUG - Processing node 69fb6c76df29cd80ecaa0370: baseline-arm64-baylibre 2026-05-08 16:29:51,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6c76df29cd80ecaa0370 2026-05-08 16:29:51,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:29:51,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6c76df29cd80ecaa0370 HTTP/1.1" 200 None 2026-05-08 16:29:51,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:29:51,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:29:51,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:29:51,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6c76df29cd80ecaa0370 HTTP/1.1" 200 None 2026-05-08 16:29:51,526 - lava_callback - ERROR - Error processing callback for node 69fb6c76df29cd80ecaa0370: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48948 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:31:11,461 - lava_callback - INFO - Received callback for node 69fb6cc0df29cd80ecaa0391 INFO: 172.20.0.1:45646 - "POST /node/69fb6cc0df29cd80ecaa0391 HTTP/1.0" 202 Accepted 2026-05-08 16:31:11,467 - lava_callback - INFO - Starting async job submit for node 69fb6cc0df29cd80ecaa0391 2026-05-08 16:31:11,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:31:11,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6cc0df29cd80ecaa0391 HTTP/1.1" 200 None 2026-05-08 16:31:11,482 - lava_callback - DEBUG - Processing node 69fb6cc0df29cd80ecaa0391: baseline-arm64-baylibre 2026-05-08 16:31:11,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6cc0df29cd80ecaa0391 2026-05-08 16:31:11,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:31:11,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6cc0df29cd80ecaa0391 HTTP/1.1" 200 None 2026-05-08 16:31:11,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:31:11,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:31:11,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:31:11,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6cc0df29cd80ecaa0391 HTTP/1.1" 200 None 2026-05-08 16:31:11,538 - lava_callback - ERROR - Error processing callback for node 69fb6cc0df29cd80ecaa0391: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52280 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:32:31,581 - lava_callback - INFO - Received callback for node 69fb6d0cdf29cd80ecaa03b5 INFO: 172.20.0.1:60044 - "POST /node/69fb6d0cdf29cd80ecaa03b5 HTTP/1.0" 202 Accepted 2026-05-08 16:32:31,586 - lava_callback - INFO - Starting async job submit for node 69fb6d0cdf29cd80ecaa03b5 2026-05-08 16:32:31,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:32:31,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6d0cdf29cd80ecaa03b5 HTTP/1.1" 200 None 2026-05-08 16:32:31,609 - lava_callback - DEBUG - Processing node 69fb6d0cdf29cd80ecaa03b5: baseline-arm64-baylibre 2026-05-08 16:32:31,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6d0cdf29cd80ecaa03b5 2026-05-08 16:32:31,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:32:31,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6d0cdf29cd80ecaa03b5 HTTP/1.1" 200 None 2026-05-08 16:32:31,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:32:31,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:32:31,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:32:31,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6d0cdf29cd80ecaa03b5 HTTP/1.1" 200 None 2026-05-08 16:32:31,664 - lava_callback - ERROR - Error processing callback for node 69fb6d0cdf29cd80ecaa03b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52002 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:33:31,600 - lava_callback - INFO - Received callback for node 69fb6d59df29cd80ecaa03e2 INFO: 172.20.0.1:40898 - "POST /node/69fb6d59df29cd80ecaa03e2 HTTP/1.0" 202 Accepted 2026-05-08 16:33:31,606 - lava_callback - INFO - Starting async job submit for node 69fb6d59df29cd80ecaa03e2 2026-05-08 16:33:31,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:33:31,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6d59df29cd80ecaa03e2 HTTP/1.1" 200 None 2026-05-08 16:33:31,637 - lava_callback - DEBUG - Processing node 69fb6d59df29cd80ecaa03e2: baseline-arm64-baylibre 2026-05-08 16:33:31,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6d59df29cd80ecaa03e2 2026-05-08 16:33:31,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:33:31,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6d59df29cd80ecaa03e2 HTTP/1.1" 200 None 2026-05-08 16:33:31,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:33:31,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:33:31,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:33:31,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6d59df29cd80ecaa03e2 HTTP/1.1" 200 None 2026-05-08 16:33:31,684 - lava_callback - ERROR - Error processing callback for node 69fb6d59df29cd80ecaa03e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57882 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:34:51,969 - lava_callback - INFO - Received callback for node 69fb6da4df29cd80ecaa0402 INFO: 172.20.0.1:57884 - "POST /node/69fb6da4df29cd80ecaa0402 HTTP/1.0" 202 Accepted 2026-05-08 16:34:51,975 - lava_callback - INFO - Starting async job submit for node 69fb6da4df29cd80ecaa0402 2026-05-08 16:34:51,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:34:51,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6da4df29cd80ecaa0402 HTTP/1.1" 200 None 2026-05-08 16:34:51,991 - lava_callback - DEBUG - Processing node 69fb6da4df29cd80ecaa0402: baseline-arm64-baylibre 2026-05-08 16:34:51,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6da4df29cd80ecaa0402 2026-05-08 16:34:51,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:34:52,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6da4df29cd80ecaa0402 HTTP/1.1" 200 None 2026-05-08 16:34:52,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:34:52,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:34:52,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:34:52,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6da4df29cd80ecaa0402 HTTP/1.1" 200 None 2026-05-08 16:34:52,042 - lava_callback - ERROR - Error processing callback for node 69fb6da4df29cd80ecaa0402: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43612 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:36:11,766 - lava_callback - INFO - Received callback for node 69fb6deedf29cd80ecaa0423 INFO: 172.20.0.1:55096 - "POST /node/69fb6deedf29cd80ecaa0423 HTTP/1.0" 202 Accepted 2026-05-08 16:36:11,773 - lava_callback - INFO - Starting async job submit for node 69fb6deedf29cd80ecaa0423 2026-05-08 16:36:11,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:36:11,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6deedf29cd80ecaa0423 HTTP/1.1" 200 None 2026-05-08 16:36:11,790 - lava_callback - DEBUG - Processing node 69fb6deedf29cd80ecaa0423: baseline-arm64-baylibre 2026-05-08 16:36:11,790 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6deedf29cd80ecaa0423 2026-05-08 16:36:11,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:36:11,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6deedf29cd80ecaa0423 HTTP/1.1" 200 None 2026-05-08 16:36:11,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:36:11,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:36:11,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:36:11,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6deedf29cd80ecaa0423 HTTP/1.1" 200 None 2026-05-08 16:36:11,852 - lava_callback - ERROR - Error processing callback for node 69fb6deedf29cd80ecaa0423: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58590 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:36:55,212 - lava_callback - INFO - Received callback for node 69fe111ae4d4e78cd76adf47 INFO: 172.20.0.1:58600 - "POST /node/69fe111ae4d4e78cd76adf47 HTTP/1.0" 202 Accepted 2026-05-08 16:36:55,219 - lava_callback - INFO - Starting async job submit for node 69fe111ae4d4e78cd76adf47 2026-05-08 16:36:55,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:36:55,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe111ae4d4e78cd76adf47 HTTP/1.1" 200 None 2026-05-08 16:36:55,240 - lava_callback - DEBUG - Processing node 69fe111ae4d4e78cd76adf47: baseline-arm 2026-05-08 16:36:55,246 - lava_callback - WARNING - Failed to upload log 2026-05-08 16:36:55,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:36:55,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:36:55,386 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111ae4d4e78cd76adf47/lava-logs.yaml 2026-05-08 16:36:55,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:36:55,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:36:55,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111ae4d4e78cd76adf47/lava_callback.json.gz 2026-05-08 16:36:55,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:36:55,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe111ae4d4e78cd76adf47 HTTP/1.1" 200 None 2026-05-08 16:36:55,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:36:55,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:36:55,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:36:55,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe111ae4d4e78cd76adf47 HTTP/1.1" 200 None 2026-05-08 16:36:55,516 - lava_callback - INFO - Completed processing callback for node 69fe111ae4d4e78cd76adf47 INFO: 172.20.0.1:58608 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:37:01,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:01,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33690 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:37:31,862 - lava_callback - INFO - Received callback for node 69fb6e3adf29cd80ecaa044c INFO: 172.20.0.1:45224 - "POST /node/69fb6e3adf29cd80ecaa044c HTTP/1.0" 202 Accepted 2026-05-08 16:37:31,868 - lava_callback - INFO - Starting async job submit for node 69fb6e3adf29cd80ecaa044c 2026-05-08 16:37:31,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:31,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6e3adf29cd80ecaa044c HTTP/1.1" 200 None 2026-05-08 16:37:31,884 - lava_callback - DEBUG - Processing node 69fb6e3adf29cd80ecaa044c: baseline-arm64-baylibre 2026-05-08 16:37:31,884 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6e3adf29cd80ecaa044c 2026-05-08 16:37:31,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:31,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6e3adf29cd80ecaa044c HTTP/1.1" 200 None 2026-05-08 16:37:31,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:31,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:37:31,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:31,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6e3adf29cd80ecaa044c HTTP/1.1" 200 None 2026-05-08 16:37:31,938 - lava_callback - ERROR - Error processing callback for node 69fb6e3adf29cd80ecaa044c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45232 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:37:40,720 - lava_callback - INFO - Received callback for node 69fe111ce4d4e78cd76adf50 INFO: 172.20.0.1:57656 - "POST /node/69fe111ce4d4e78cd76adf50 HTTP/1.0" 202 Accepted 2026-05-08 16:37:40,726 - lava_callback - INFO - Starting async job submit for node 69fe111ce4d4e78cd76adf50 2026-05-08 16:37:40,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:40,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe111ce4d4e78cd76adf50 HTTP/1.1" 200 None 2026-05-08 16:37:40,764 - lava_callback - DEBUG - Processing node 69fe111ce4d4e78cd76adf50: baseline-arm 2026-05-08 16:37:41,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:37:41,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:37:41,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111ce4d4e78cd76adf50/log.txt.gz 2026-05-08 16:37:41,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:37:41,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:37:41,433 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111ce4d4e78cd76adf50/lava-logs.yaml 2026-05-08 16:37:41,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:37:41,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:37:41,548 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111ce4d4e78cd76adf50/lava_callback.json.gz 2026-05-08 16:37:41,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:41,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe111ce4d4e78cd76adf50 HTTP/1.1" 200 None 2026-05-08 16:37:41,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:41,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:37:41,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:41,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe111ce4d4e78cd76adf50 HTTP/1.1" 200 None 2026-05-08 16:37:41,634 - lava_callback - INFO - Completed processing callback for node 69fe111ce4d4e78cd76adf50 2026-05-08 16:37:44,249 - lava_callback - INFO - Received callback for node 69fe10d1e4d4e78cd76adf03 INFO: 172.20.0.1:57668 - "POST /node/69fe10d1e4d4e78cd76adf03 HTTP/1.0" 202 Accepted 2026-05-08 16:37:44,255 - lava_callback - INFO - Starting async job submit for node 69fe10d1e4d4e78cd76adf03 2026-05-08 16:37:44,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:44,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe10d1e4d4e78cd76adf03 HTTP/1.1" 200 None 2026-05-08 16:37:44,294 - lava_callback - DEBUG - Processing node 69fe10d1e4d4e78cd76adf03: baseline-arm 2026-05-08 16:37:44,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:37:44,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:37:44,619 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fe10d1e4d4e78cd76adf03/log.txt.gz 2026-05-08 16:37:44,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:37:44,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:37:44,877 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe10d1e4d4e78cd76adf03/lava-logs.yaml 2026-05-08 16:37:44,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:37:44,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:37:45,001 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe10d1e4d4e78cd76adf03/lava_callback.json.gz 2026-05-08 16:37:45,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:45,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe10d1e4d4e78cd76adf03 HTTP/1.1" 200 None 2026-05-08 16:37:45,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:45,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d2be4d4e78cd76adccc HTTP/1.1" 200 None 2026-05-08 16:37:45,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:45,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe10d1e4d4e78cd76adf03 HTTP/1.1" 200 None 2026-05-08 16:37:45,114 - lava_callback - INFO - Completed processing callback for node 69fe10d1e4d4e78cd76adf03 INFO: 172.20.0.1:57682 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:37:48,721 - lava_callback - INFO - Received callback for node 69fe111de4d4e78cd76adf53 INFO: 172.20.0.1:57694 - "POST /node/69fe111de4d4e78cd76adf53 HTTP/1.0" 202 Accepted 2026-05-08 16:37:48,774 - lava_callback - INFO - Starting async job submit for node 69fe111de4d4e78cd76adf53 2026-05-08 16:37:48,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:48,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe111de4d4e78cd76adf53 HTTP/1.1" 200 None 2026-05-08 16:37:48,808 - lava_callback - DEBUG - Processing node 69fe111de4d4e78cd76adf53: baseline-arm 2026-05-08 16:37:48,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:37:49,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:37:49,040 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111de4d4e78cd76adf53/log.txt.gz 2026-05-08 16:37:49,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:37:49,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:37:49,282 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111de4d4e78cd76adf53/lava-logs.yaml 2026-05-08 16:37:49,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:37:49,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:37:49,370 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111de4d4e78cd76adf53/lava_callback.json.gz 2026-05-08 16:37:49,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:49,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe111de4d4e78cd76adf53 HTTP/1.1" 200 None 2026-05-08 16:37:49,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:49,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:37:49,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:37:49,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe111de4d4e78cd76adf53 HTTP/1.1" 200 None 2026-05-08 16:37:49,458 - lava_callback - INFO - Completed processing callback for node 69fe111de4d4e78cd76adf53 INFO: 172.20.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41346 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:38:01,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:01,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38234 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:38:13,766 - lava_callback - INFO - Received callback for node 69fe1119e4d4e78cd76adf44 INFO: 172.20.0.1:55050 - "POST /node/69fe1119e4d4e78cd76adf44 HTTP/1.0" 202 Accepted 2026-05-08 16:38:13,772 - lava_callback - INFO - Starting async job submit for node 69fe1119e4d4e78cd76adf44 2026-05-08 16:38:13,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:13,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1119e4d4e78cd76adf44 HTTP/1.1" 200 None 2026-05-08 16:38:13,819 - lava_callback - DEBUG - Processing node 69fe1119e4d4e78cd76adf44: baseline-arm 2026-05-08 16:38:14,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:14,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:14,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fe1119e4d4e78cd76adf44/log.txt.gz 2026-05-08 16:38:14,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:14,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:14,438 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe1119e4d4e78cd76adf44/lava-logs.yaml 2026-05-08 16:38:14,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:14,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:14,540 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe1119e4d4e78cd76adf44/lava_callback.json.gz 2026-05-08 16:38:14,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:14,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1119e4d4e78cd76adf44 HTTP/1.1" 200 None 2026-05-08 16:38:14,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:14,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:38:14,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:14,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1119e4d4e78cd76adf44 HTTP/1.1" 200 None 2026-05-08 16:38:14,620 - lava_callback - INFO - Completed processing callback for node 69fe1119e4d4e78cd76adf44 INFO: 172.20.0.1:55056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55070 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:38:23,363 - lava_callback - INFO - Received callback for node 69fe113fe4d4e78cd76adfe1 INFO: 172.20.0.1:42202 - "POST /node/69fe113fe4d4e78cd76adfe1 HTTP/1.0" 202 Accepted 2026-05-08 16:38:23,409 - lava_callback - INFO - Starting async job submit for node 69fe113fe4d4e78cd76adfe1 2026-05-08 16:38:23,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:23,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe113fe4d4e78cd76adfe1 HTTP/1.1" 200 None 2026-05-08 16:38:23,446 - lava_callback - DEBUG - Processing node 69fe113fe4d4e78cd76adfe1: baseline-arm-pengutronix 2026-05-08 16:38:23,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:23,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:23,663 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe113fe4d4e78cd76adfe1/log.txt.gz 2026-05-08 16:38:23,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:23,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:23,841 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe113fe4d4e78cd76adfe1/lava-logs.yaml 2026-05-08 16:38:23,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:23,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:23,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe113fe4d4e78cd76adfe1/lava_callback.json.gz 2026-05-08 16:38:23,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:23,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe113fe4d4e78cd76adfe1 HTTP/1.1" 200 None 2026-05-08 16:38:23,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:23,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:38:23,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:24,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe113fe4d4e78cd76adfe1 HTTP/1.1" 200 None 2026-05-08 16:38:24,017 - lava_callback - INFO - Completed processing callback for node 69fe113fe4d4e78cd76adfe1 INFO: 172.20.0.1:42216 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:38:28,740 - lava_callback - INFO - Received callback for node 69fe113ce4d4e78cd76adfd8 INFO: 172.20.0.1:42218 - "POST /node/69fe113ce4d4e78cd76adfd8 HTTP/1.0" 202 Accepted 2026-05-08 16:38:28,749 - lava_callback - INFO - Starting async job submit for node 69fe113ce4d4e78cd76adfd8 2026-05-08 16:38:28,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:28,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe113ce4d4e78cd76adfd8 HTTP/1.1" 200 None 2026-05-08 16:38:28,782 - lava_callback - DEBUG - Processing node 69fe113ce4d4e78cd76adfd8: baseline-arm-pengutronix 2026-05-08 16:38:28,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:29,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:29,006 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe113ce4d4e78cd76adfd8/log.txt.gz 2026-05-08 16:38:29,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:29,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:29,314 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe113ce4d4e78cd76adfd8/lava-logs.yaml 2026-05-08 16:38:29,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:29,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:29,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe113ce4d4e78cd76adfd8/lava_callback.json.gz 2026-05-08 16:38:29,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:29,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe113ce4d4e78cd76adfd8 HTTP/1.1" 200 None 2026-05-08 16:38:29,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:29,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:38:29,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:29,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe113ce4d4e78cd76adfd8 HTTP/1.1" 200 None 2026-05-08 16:38:29,505 - lava_callback - INFO - Completed processing callback for node 69fe113ce4d4e78cd76adfd8 2026-05-08 16:38:30,128 - lava_callback - INFO - Received callback for node 69fe113de4d4e78cd76adfdb INFO: 172.20.0.1:46460 - "POST /node/69fe113de4d4e78cd76adfdb HTTP/1.0" 202 Accepted 2026-05-08 16:38:30,134 - lava_callback - INFO - Starting async job submit for node 69fe113de4d4e78cd76adfdb 2026-05-08 16:38:30,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:30,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe113de4d4e78cd76adfdb HTTP/1.1" 200 None 2026-05-08 16:38:30,179 - lava_callback - DEBUG - Processing node 69fe113de4d4e78cd76adfdb: baseline-arm-pengutronix 2026-05-08 16:38:30,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:30,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:30,438 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe113de4d4e78cd76adfdb/log.txt.gz 2026-05-08 16:38:30,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:30,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:30,670 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe113de4d4e78cd76adfdb/lava-logs.yaml 2026-05-08 16:38:30,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:30,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:30,780 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe113de4d4e78cd76adfdb/lava_callback.json.gz 2026-05-08 16:38:30,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:30,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe113de4d4e78cd76adfdb HTTP/1.1" 200 None 2026-05-08 16:38:30,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:30,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:38:30,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:30,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe113de4d4e78cd76adfdb HTTP/1.1" 200 None 2026-05-08 16:38:30,857 - lava_callback - INFO - Completed processing callback for node 69fe113de4d4e78cd76adfdb 2026-05-08 16:38:31,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:31,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-08 16:38:32,067 - lava_callback - INFO - Received callback for node 69fe111be4d4e78cd76adf4a INFO: 172.20.0.1:46466 - "POST /node/69fe111be4d4e78cd76adf4a HTTP/1.0" 202 Accepted 2026-05-08 16:38:32,114 - lava_callback - INFO - Starting async job submit for node 69fe111be4d4e78cd76adf4a 2026-05-08 16:38:32,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:32,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe111be4d4e78cd76adf4a HTTP/1.1" 200 None 2026-05-08 16:38:32,149 - lava_callback - DEBUG - Processing node 69fe111be4d4e78cd76adf4a: baseline-arm 2026-05-08 16:38:32,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:32,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:32,402 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111be4d4e78cd76adf4a/log.txt.gz 2026-05-08 16:38:32,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:32,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:32,592 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111be4d4e78cd76adf4a/lava-logs.yaml 2026-05-08 16:38:32,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:32,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:32,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111be4d4e78cd76adf4a/lava_callback.json.gz 2026-05-08 16:38:32,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:32,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe111be4d4e78cd76adf4a HTTP/1.1" 200 None 2026-05-08 16:38:32,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:32,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:38:32,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:32,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe111be4d4e78cd76adf4a HTTP/1.1" 200 None 2026-05-08 16:38:32,759 - lava_callback - INFO - Completed processing callback for node 69fe111be4d4e78cd76adf4a INFO: 172.20.0.1:46472 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:38:46,513 - lava_callback - INFO - Received callback for node 69fe1130e4d4e78cd76adf85 INFO: 172.20.0.1:47710 - "POST /node/69fe1130e4d4e78cd76adf85 HTTP/1.0" 202 Accepted 2026-05-08 16:38:46,520 - lava_callback - INFO - Starting async job submit for node 69fe1130e4d4e78cd76adf85 INFO: 172.20.0.1:47718 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:38:46,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:46,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1130e4d4e78cd76adf85 HTTP/1.1" 200 None 2026-05-08 16:38:46,566 - lava_callback - DEBUG - Processing node 69fe1130e4d4e78cd76adf85: baseline-arm-clabbe 2026-05-08 16:38:46,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:46,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:46,944 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fe1130e4d4e78cd76adf85/log.txt.gz 2026-05-08 16:38:47,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:47,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:47,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fe1130e4d4e78cd76adf85/lava-logs.yaml 2026-05-08 16:38:47,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:47,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:47,340 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fe1130e4d4e78cd76adf85/lava_callback.json.gz 2026-05-08 16:38:47,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:47,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1130e4d4e78cd76adf85 HTTP/1.1" 200 None 2026-05-08 16:38:47,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:47,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:38:47,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:47,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1130e4d4e78cd76adf85 HTTP/1.1" 200 None 2026-05-08 16:38:47,410 - lava_callback - INFO - Completed processing callback for node 69fe1130e4d4e78cd76adf85 2026-05-08 16:38:47,976 - lava_callback - INFO - Received callback for node 69fe1139e4d4e78cd76adfcd INFO: 172.20.0.1:47720 - "POST /node/69fe1139e4d4e78cd76adfcd HTTP/1.0" 202 Accepted 2026-05-08 16:38:47,982 - lava_callback - INFO - Starting async job submit for node 69fe1139e4d4e78cd76adfcd 2026-05-08 16:38:48,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:48,009 - lava_callback - INFO - Received callback for node 69fe112ce4d4e78cd76adf75 2026-05-08 16:38:48,017 - lava_callback - INFO - Starting async job submit for node 69fe112ce4d4e78cd76adf75 INFO: 172.20.0.1:47726 - "POST /node/69fe112ce4d4e78cd76adf75 HTTP/1.0" 202 Accepted 2026-05-08 16:38:48,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:48,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1139e4d4e78cd76adfcd HTTP/1.1" 200 None 2026-05-08 16:38:48,058 - lava_callback - DEBUG - Processing node 69fe1139e4d4e78cd76adfcd: baseline-arm-kontron 2026-05-08 16:38:48,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe112ce4d4e78cd76adf75 HTTP/1.1" 200 None 2026-05-08 16:38:48,119 - lava_callback - DEBUG - Processing node 69fe112ce4d4e78cd76adf75: baseline-arm-broonie 2026-05-08 16:38:48,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:48,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:48,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:48,756 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fe1139e4d4e78cd76adfcd/log.txt.gz 2026-05-08 16:38:48,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:48,812 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fe112ce4d4e78cd76adf75/log.txt.gz 2026-05-08 16:38:48,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:49,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:49,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:49,215 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fe1139e4d4e78cd76adfcd/lava-logs.yaml 2026-05-08 16:38:49,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:49,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:49,282 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fe112ce4d4e78cd76adf75/lava-logs.yaml 2026-05-08 16:38:49,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:38:49,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:49,316 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fe1139e4d4e78cd76adfcd/lava_callback.json.gz 2026-05-08 16:38:49,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:49,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1139e4d4e78cd76adfcd HTTP/1.1" 200 None 2026-05-08 16:38:49,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:49,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:38:49,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fe112ce4d4e78cd76adf75/lava_callback.json.gz 2026-05-08 16:38:49,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:38:49,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:49,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:49,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe112ce4d4e78cd76adf75 HTTP/1.1" 200 None 2026-05-08 16:38:49,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:49,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1139e4d4e78cd76adfcd HTTP/1.1" 200 None 2026-05-08 16:38:49,504 - lava_callback - INFO - Completed processing callback for node 69fe1139e4d4e78cd76adfcd 2026-05-08 16:38:49,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:38:49,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:49,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe112ce4d4e78cd76adf75 HTTP/1.1" 200 None 2026-05-08 16:38:49,562 - lava_callback - INFO - Completed processing callback for node 69fe112ce4d4e78cd76adf75 INFO: 172.20.0.1:54576 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:38:54,537 - lava_callback - INFO - Received callback for node 69fb6e8fdf29cd80ecaa047b INFO: 172.20.0.1:54588 - "POST /node/69fb6e8fdf29cd80ecaa047b HTTP/1.0" 202 Accepted 2026-05-08 16:38:54,542 - lava_callback - INFO - Starting async job submit for node 69fb6e8fdf29cd80ecaa047b 2026-05-08 16:38:54,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:54,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6e8fdf29cd80ecaa047b HTTP/1.1" 200 None 2026-05-08 16:38:54,557 - lava_callback - DEBUG - Processing node 69fb6e8fdf29cd80ecaa047b: baseline-arm64-clabbe 2026-05-08 16:38:54,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6e8fdf29cd80ecaa047b 2026-05-08 16:38:54,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:54,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6e8fdf29cd80ecaa047b HTTP/1.1" 200 None 2026-05-08 16:38:54,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:54,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:38:54,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:38:54,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6e8fdf29cd80ecaa047b HTTP/1.1" 200 None 2026-05-08 16:38:54,617 - lava_callback - ERROR - Error processing callback for node 69fb6e8fdf29cd80ecaa047b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54604 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:39:01,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:01,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:32808 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:39:07,946 - lava_callback - INFO - Received callback for node 69fe1138e4d4e78cd76adfca INFO: 172.20.0.1:32822 - "POST /node/69fe1138e4d4e78cd76adfca HTTP/1.0" 202 Accepted 2026-05-08 16:39:07,956 - lava_callback - INFO - Starting async job submit for node 69fe1138e4d4e78cd76adfca 2026-05-08 16:39:08,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:08,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1138e4d4e78cd76adfca HTTP/1.1" 200 None 2026-05-08 16:39:08,033 - lava_callback - DEBUG - Processing node 69fe1138e4d4e78cd76adfca: baseline-arm-kontron 2026-05-08 16:39:08,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:08,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:08,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fe1138e4d4e78cd76adfca/log.txt.gz 2026-05-08 16:39:08,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:09,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:09,112 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fe1138e4d4e78cd76adfca/lava-logs.yaml 2026-05-08 16:39:09,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:09,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:09,267 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fe1138e4d4e78cd76adfca/lava_callback.json.gz 2026-05-08 16:39:09,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:09,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1138e4d4e78cd76adfca HTTP/1.1" 200 None 2026-05-08 16:39:09,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:09,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:39:09,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:09,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1138e4d4e78cd76adfca HTTP/1.1" 200 None 2026-05-08 16:39:09,417 - lava_callback - INFO - Completed processing callback for node 69fe1138e4d4e78cd76adfca INFO: 172.20.0.1:41182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55144 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:39:31,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:31,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53478 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:39:37,383 - lava_callback - INFO - Received callback for node 69fe1131e4d4e78cd76adf89 INFO: 172.20.0.1:53490 - "POST /node/69fe1131e4d4e78cd76adf89 HTTP/1.0" 202 Accepted 2026-05-08 16:39:37,390 - lava_callback - INFO - Starting async job submit for node 69fe1131e4d4e78cd76adf89 2026-05-08 16:39:37,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:37,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1131e4d4e78cd76adf89 HTTP/1.1" 200 None 2026-05-08 16:39:37,439 - lava_callback - DEBUG - Processing node 69fe1131e4d4e78cd76adf89: baseline-arm-clabbe 2026-05-08 16:39:37,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:37,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:37,747 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fe1131e4d4e78cd76adf89/log.txt.gz 2026-05-08 16:39:37,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:37,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:37,996 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fe1131e4d4e78cd76adf89/lava-logs.yaml 2026-05-08 16:39:38,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:38,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:38,098 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fe1131e4d4e78cd76adf89/lava_callback.json.gz 2026-05-08 16:39:38,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:38,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1131e4d4e78cd76adf89 HTTP/1.1" 200 None 2026-05-08 16:39:38,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:38,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:39:38,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:38,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1131e4d4e78cd76adf89 HTTP/1.1" 200 None 2026-05-08 16:39:38,171 - lava_callback - INFO - Completed processing callback for node 69fe1131e4d4e78cd76adf89 2026-05-08 16:39:45,312 - lava_callback - INFO - Received callback for node 69fe115be4d4e78cd76ae02c INFO: 172.20.0.1:38416 - "POST /node/69fe115be4d4e78cd76ae02c HTTP/1.0" 202 Accepted 2026-05-08 16:39:45,319 - lava_callback - INFO - Starting async job submit for node 69fe115be4d4e78cd76ae02c 2026-05-08 16:39:45,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:45,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe115be4d4e78cd76ae02c HTTP/1.1" 200 None 2026-05-08 16:39:45,357 - lava_callback - DEBUG - Processing node 69fe115be4d4e78cd76ae02c: ltp-dio 2026-05-08 16:39:45,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:45,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:45,829 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69fe115be4d4e78cd76ae02c/log.txt.gz 2026-05-08 16:39:46,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:46,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:46,177 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69fe115be4d4e78cd76ae02c/lava-logs.yaml 2026-05-08 16:39:46,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:46,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:46,336 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69fe115be4d4e78cd76ae02c/lava_callback.json.gz 2026-05-08 16:39:46,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:46,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe115be4d4e78cd76ae02c HTTP/1.1" 200 None 2026-05-08 16:39:46,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:46,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:39:46,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:46,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe115be4d4e78cd76ae02c HTTP/1.1" 200 None 2026-05-08 16:39:46,421 - lava_callback - INFO - Completed processing callback for node 69fe115be4d4e78cd76ae02c INFO: 172.20.0.1:38432 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:39:46,825 - lava_callback - INFO - Received callback for node 69fe11abe4d4e78cd76ae0d8 INFO: 172.20.0.1:38446 - "POST /node/69fe11abe4d4e78cd76ae0d8 HTTP/1.0" 202 Accepted 2026-05-08 16:39:46,835 - lava_callback - INFO - Starting async job submit for node 69fe11abe4d4e78cd76ae0d8 2026-05-08 16:39:46,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:46,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe11abe4d4e78cd76ae0d8 HTTP/1.1" 200 None 2026-05-08 16:39:46,878 - lava_callback - DEBUG - Processing node 69fe11abe4d4e78cd76ae0d8: baseline-x86 2026-05-08 16:39:47,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:47,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:47,238 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fe11abe4d4e78cd76ae0d8/log.txt.gz 2026-05-08 16:39:47,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:47,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:47,472 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fe11abe4d4e78cd76ae0d8/lava-logs.yaml 2026-05-08 16:39:47,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:47,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:47,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fe11abe4d4e78cd76ae0d8/lava_callback.json.gz 2026-05-08 16:39:47,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:47,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe11abe4d4e78cd76ae0d8 HTTP/1.1" 200 None 2026-05-08 16:39:47,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:47,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d56e4d4e78cd76adcf2 HTTP/1.1" 200 None 2026-05-08 16:39:47,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:47,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe11abe4d4e78cd76ae0d8 HTTP/1.1" 200 None 2026-05-08 16:39:47,657 - lava_callback - INFO - Completed processing callback for node 69fe11abe4d4e78cd76ae0d8 INFO: 172.20.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33038 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:39:57,852 - lava_callback - INFO - Received callback for node 69fe11a8e4d4e78cd76ae0cf INFO: 172.20.0.1:33044 - "POST /node/69fe11a8e4d4e78cd76ae0cf HTTP/1.0" 202 Accepted 2026-05-08 16:39:57,860 - lava_callback - INFO - Starting async job submit for node 69fe11a8e4d4e78cd76ae0cf 2026-05-08 16:39:57,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:57,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe11a8e4d4e78cd76ae0cf HTTP/1.1" 200 None 2026-05-08 16:39:57,902 - lava_callback - DEBUG - Processing node 69fe11a8e4d4e78cd76ae0cf: baseline-x86 2026-05-08 16:39:58,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:58,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:58,230 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fe11a8e4d4e78cd76ae0cf/log.txt.gz 2026-05-08 16:39:58,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:58,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:58,501 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fe11a8e4d4e78cd76ae0cf/lava-logs.yaml 2026-05-08 16:39:58,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:39:58,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:39:58,627 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fe11a8e4d4e78cd76ae0cf/lava_callback.json.gz 2026-05-08 16:39:58,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:58,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe11a8e4d4e78cd76ae0cf HTTP/1.1" 200 None 2026-05-08 16:39:58,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:58,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d56e4d4e78cd76adcf2 HTTP/1.1" 200 None 2026-05-08 16:39:58,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:39:58,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe11a8e4d4e78cd76ae0cf HTTP/1.1" 200 None 2026-05-08 16:39:58,710 - lava_callback - INFO - Completed processing callback for node 69fe11a8e4d4e78cd76ae0cf 2026-05-08 16:40:01,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:01,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:56892 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:40:12,048 - lava_callback - INFO - Received callback for node 69fb6ed8df29cd80ecaa049c INFO: 172.20.0.1:58610 - "POST /node/69fb6ed8df29cd80ecaa049c HTTP/1.0" 202 Accepted 2026-05-08 16:40:12,054 - lava_callback - INFO - Starting async job submit for node 69fb6ed8df29cd80ecaa049c 2026-05-08 16:40:12,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:12,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6ed8df29cd80ecaa049c HTTP/1.1" 200 None 2026-05-08 16:40:12,070 - lava_callback - DEBUG - Processing node 69fb6ed8df29cd80ecaa049c: baseline-arm64-baylibre 2026-05-08 16:40:12,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6ed8df29cd80ecaa049c 2026-05-08 16:40:12,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:12,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6ed8df29cd80ecaa049c HTTP/1.1" 200 None 2026-05-08 16:40:12,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:12,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:40:12,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:12,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6ed8df29cd80ecaa049c HTTP/1.1" 200 None 2026-05-08 16:40:12,120 - lava_callback - ERROR - Error processing callback for node 69fb6ed8df29cd80ecaa049c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58622 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:40:22,168 - lava_callback - INFO - Received callback for node 69fe11a9e4d4e78cd76ae0d2 INFO: 172.20.0.1:60836 - "POST /node/69fe11a9e4d4e78cd76ae0d2 HTTP/1.0" 202 Accepted 2026-05-08 16:40:22,174 - lava_callback - INFO - Starting async job submit for node 69fe11a9e4d4e78cd76ae0d2 2026-05-08 16:40:22,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:22,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe11a9e4d4e78cd76ae0d2 HTTP/1.1" 200 None 2026-05-08 16:40:22,226 - lava_callback - DEBUG - Processing node 69fe11a9e4d4e78cd76ae0d2: baseline-x86 2026-05-08 16:40:22,314 - lava_callback - INFO - Received callback for node 69fe1136e4d4e78cd76adfc2 INFO: 172.20.0.1:60840 - "POST /node/69fe1136e4d4e78cd76adfc2 HTTP/1.0" 202 Accepted 2026-05-08 16:40:22,341 - lava_callback - INFO - Starting async job submit for node 69fe1136e4d4e78cd76adfc2 2026-05-08 16:40:22,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:22,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1136e4d4e78cd76adfc2 HTTP/1.1" 200 None 2026-05-08 16:40:22,498 - lava_callback - DEBUG - Processing node 69fe1136e4d4e78cd76adfc2: baseline-arm-clabbe 2026-05-08 16:40:22,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:40:22,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:40:22,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:40:22,800 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fe11a9e4d4e78cd76ae0d2/log.txt.gz 2026-05-08 16:40:22,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:40:22,885 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fe1136e4d4e78cd76adfc2/log.txt.gz 2026-05-08 16:40:23,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:40:23,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:40:23,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:40:23,291 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fe1136e4d4e78cd76adfc2/lava-logs.yaml 2026-05-08 16:40:23,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:40:23,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:40:23,303 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fe11a9e4d4e78cd76ae0d2/lava-logs.yaml 2026-05-08 16:40:23,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:40:23,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:40:23,431 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fe1136e4d4e78cd76adfc2/lava_callback.json.gz 2026-05-08 16:40:23,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:40:23,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:23,468 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fe11a9e4d4e78cd76ae0d2/lava_callback.json.gz 2026-05-08 16:40:23,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:23,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1136e4d4e78cd76adfc2 HTTP/1.1" 200 None 2026-05-08 16:40:23,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:23,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe11a9e4d4e78cd76ae0d2 HTTP/1.1" 200 None 2026-05-08 16:40:23,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:23,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:40:23,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d56e4d4e78cd76adcf2 HTTP/1.1" 200 None 2026-05-08 16:40:23,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:23,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:23,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1136e4d4e78cd76adfc2 HTTP/1.1" 200 None 2026-05-08 16:40:23,622 - lava_callback - INFO - Completed processing callback for node 69fe1136e4d4e78cd76adfc2 2026-05-08 16:40:23,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe11a9e4d4e78cd76ae0d2 HTTP/1.1" 200 None 2026-05-08 16:40:23,653 - lava_callback - INFO - Completed processing callback for node 69fe11a9e4d4e78cd76ae0d2 INFO: 172.20.0.1:60842 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:40:31,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:40:31,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60846 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:41:34,777 - lava_callback - INFO - Received callback for node 69fb6f2bdf29cd80ecaa04c7 INFO: 172.20.0.1:51218 - "POST /node/69fb6f2bdf29cd80ecaa04c7 HTTP/1.0" 202 Accepted 2026-05-08 16:41:34,783 - lava_callback - INFO - Starting async job submit for node 69fb6f2bdf29cd80ecaa04c7 2026-05-08 16:41:34,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:41:34,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6f2bdf29cd80ecaa04c7 HTTP/1.1" 200 None 2026-05-08 16:41:34,798 - lava_callback - DEBUG - Processing node 69fb6f2bdf29cd80ecaa04c7: baseline-arm64-clabbe 2026-05-08 16:41:34,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6f2bdf29cd80ecaa04c7 2026-05-08 16:41:34,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:41:34,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6f2bdf29cd80ecaa04c7 HTTP/1.1" 200 None 2026-05-08 16:41:34,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:41:34,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:41:34,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:41:34,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6f2bdf29cd80ecaa04c7 HTTP/1.1" 200 None 2026-05-08 16:41:34,856 - lava_callback - ERROR - Error processing callback for node 69fb6f2bdf29cd80ecaa04c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37972 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:42:09,443 - lava_callback - INFO - Received callback for node 69fe1168e4d4e78cd76ae048 INFO: 172.20.0.1:37976 - "POST /node/69fe1168e4d4e78cd76ae048 HTTP/1.0" 202 Accepted 2026-05-08 16:42:09,450 - lava_callback - INFO - Starting async job submit for node 69fe1168e4d4e78cd76ae048 2026-05-08 16:42:09,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:42:09,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1168e4d4e78cd76ae048 HTTP/1.1" 200 None 2026-05-08 16:42:09,493 - lava_callback - DEBUG - Processing node 69fe1168e4d4e78cd76ae048: ltp-syscalls 2026-05-08 16:42:10,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:42:10,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:42:10,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fe1168e4d4e78cd76ae048/log.txt.gz 2026-05-08 16:42:10,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:42:11,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:42:11,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fe1168e4d4e78cd76ae048/lava-logs.yaml 2026-05-08 16:42:11,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:42:11,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:42:11,193 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fe1168e4d4e78cd76ae048/lava_callback.json.gz 2026-05-08 16:42:11,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:42:11,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1168e4d4e78cd76ae048 HTTP/1.1" 200 None 2026-05-08 16:42:11,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:42:11,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:42:11,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:42:11,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1168e4d4e78cd76ae048 HTTP/1.1" 200 None 2026-05-08 16:42:11,269 - lava_callback - INFO - Completed processing callback for node 69fe1168e4d4e78cd76ae048 INFO: 172.20.0.1:48464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40972 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:42:31,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:42:31,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56038 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:42:54,831 - lava_callback - INFO - Received callback for node 69fb6f78df29cd80ecaa04f9 INFO: 172.20.0.1:56046 - "POST /node/69fb6f78df29cd80ecaa04f9 HTTP/1.0" 202 Accepted 2026-05-08 16:42:54,837 - lava_callback - INFO - Starting async job submit for node 69fb6f78df29cd80ecaa04f9 2026-05-08 16:42:54,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:42:54,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6f78df29cd80ecaa04f9 HTTP/1.1" 200 None 2026-05-08 16:42:54,851 - lava_callback - DEBUG - Processing node 69fb6f78df29cd80ecaa04f9: baseline-arm64-clabbe 2026-05-08 16:42:54,851 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6f78df29cd80ecaa04f9 2026-05-08 16:42:54,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:42:54,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6f78df29cd80ecaa04f9 HTTP/1.1" 200 None 2026-05-08 16:42:54,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:42:54,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:42:54,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:42:54,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6f78df29cd80ecaa04f9 HTTP/1.1" 200 None 2026-05-08 16:42:54,915 - lava_callback - ERROR - Error processing callback for node 69fb6f78df29cd80ecaa04f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47990 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:43:54,858 - lava_callback - INFO - Received callback for node 69fb6fc5df29cd80ecaa0515 INFO: 172.20.0.1:47994 - "POST /node/69fb6fc5df29cd80ecaa0515 HTTP/1.0" 202 Accepted 2026-05-08 16:43:54,864 - lava_callback - INFO - Starting async job submit for node 69fb6fc5df29cd80ecaa0515 2026-05-08 16:43:54,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:43:54,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6fc5df29cd80ecaa0515 HTTP/1.1" 200 None 2026-05-08 16:43:54,886 - lava_callback - DEBUG - Processing node 69fb6fc5df29cd80ecaa0515: baseline-arm64-clabbe 2026-05-08 16:43:54,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb6fc5df29cd80ecaa0515 2026-05-08 16:43:54,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:43:54,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6fc5df29cd80ecaa0515 HTTP/1.1" 200 None 2026-05-08 16:43:54,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:43:54,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:43:54,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:43:54,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb6fc5df29cd80ecaa0515 HTTP/1.1" 200 None 2026-05-08 16:43:54,935 - lava_callback - ERROR - Error processing callback for node 69fb6fc5df29cd80ecaa0515: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51500 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:45:14,922 - lava_callback - INFO - Received callback for node 69fb7011df29cd80ecaa0547 INFO: 172.20.0.1:41976 - "POST /node/69fb7011df29cd80ecaa0547 HTTP/1.0" 202 Accepted 2026-05-08 16:45:14,928 - lava_callback - INFO - Starting async job submit for node 69fb7011df29cd80ecaa0547 2026-05-08 16:45:14,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:45:14,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7011df29cd80ecaa0547 HTTP/1.1" 200 None 2026-05-08 16:45:14,954 - lava_callback - DEBUG - Processing node 69fb7011df29cd80ecaa0547: baseline-arm64-clabbe 2026-05-08 16:45:14,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7011df29cd80ecaa0547 2026-05-08 16:45:14,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:45:14,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7011df29cd80ecaa0547 HTTP/1.1" 200 None 2026-05-08 16:45:14,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:45:14,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:45:14,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:45:15,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7011df29cd80ecaa0547 HTTP/1.1" 200 None 2026-05-08 16:45:15,011 - lava_callback - ERROR - Error processing callback for node 69fb7011df29cd80ecaa0547: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42496 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:46:35,129 - lava_callback - INFO - Received callback for node 69fb705cdf29cd80ecaa0564 INFO: 172.20.0.1:32872 - "POST /node/69fb705cdf29cd80ecaa0564 HTTP/1.0" 202 Accepted 2026-05-08 16:46:35,135 - lava_callback - INFO - Starting async job submit for node 69fb705cdf29cd80ecaa0564 2026-05-08 16:46:35,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:46:35,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb705cdf29cd80ecaa0564 HTTP/1.1" 200 None 2026-05-08 16:46:35,150 - lava_callback - DEBUG - Processing node 69fb705cdf29cd80ecaa0564: baseline-arm64-clabbe 2026-05-08 16:46:35,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb705cdf29cd80ecaa0564 2026-05-08 16:46:35,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:46:35,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb705cdf29cd80ecaa0564 HTTP/1.1" 200 None 2026-05-08 16:46:35,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:46:35,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:46:35,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:46:35,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb705cdf29cd80ecaa0564 HTTP/1.1" 200 None 2026-05-08 16:46:35,200 - lava_callback - ERROR - Error processing callback for node 69fb705cdf29cd80ecaa0564: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38924 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:47:55,021 - lava_callback - INFO - Received callback for node 69fb70a9df29cd80ecaa0590 INFO: 172.20.0.1:38940 - "POST /node/69fb70a9df29cd80ecaa0590 HTTP/1.0" 202 Accepted 2026-05-08 16:47:55,027 - lava_callback - INFO - Starting async job submit for node 69fb70a9df29cd80ecaa0590 2026-05-08 16:47:55,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:47:55,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb70a9df29cd80ecaa0590 HTTP/1.1" 200 None 2026-05-08 16:47:55,044 - lava_callback - DEBUG - Processing node 69fb70a9df29cd80ecaa0590: baseline-arm64-clabbe 2026-05-08 16:47:55,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb70a9df29cd80ecaa0590 2026-05-08 16:47:55,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:47:55,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb70a9df29cd80ecaa0590 HTTP/1.1" 200 None 2026-05-08 16:47:55,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:47:55,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:47:55,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:47:55,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb70a9df29cd80ecaa0590 HTTP/1.1" 200 None 2026-05-08 16:47:55,104 - lava_callback - ERROR - Error processing callback for node 69fb70a9df29cd80ecaa0590: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59918 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 16:48:15,547 - lava_callback - INFO - Received callback for node 69fe13c7e4d4e78cd76ae2db INFO: 172.20.0.1:59926 - "POST /node/69fe13c7e4d4e78cd76ae2db HTTP/1.0" 202 Accepted 2026-05-08 16:48:15,553 - lava_callback - INFO - Starting async job submit for node 69fe13c7e4d4e78cd76ae2db 2026-05-08 16:48:15,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:48:15,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe13c7e4d4e78cd76ae2db HTTP/1.1" 200 None 2026-05-08 16:48:15,572 - lava_callback - DEBUG - Processing node 69fe13c7e4d4e78cd76ae2db: baseline-arm 2026-05-08 16:48:15,577 - lava_callback - WARNING - Failed to upload log 2026-05-08 16:48:15,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:48:15,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:48:15,674 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe13c7e4d4e78cd76ae2db/lava-logs.yaml 2026-05-08 16:48:15,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:48:15,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:48:15,780 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe13c7e4d4e78cd76ae2db/lava_callback.json.gz 2026-05-08 16:48:15,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:48:15,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe13c7e4d4e78cd76ae2db HTTP/1.1" 200 None 2026-05-08 16:48:15,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:48:15,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 16:48:15,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:48:15,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe13c7e4d4e78cd76ae2db HTTP/1.1" 200 None 2026-05-08 16:48:15,853 - lava_callback - INFO - Completed processing callback for node 69fe13c7e4d4e78cd76ae2db INFO: 172.20.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43668 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:48:31,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:48:31,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52982 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:49:15,038 - lava_callback - INFO - Received callback for node 69fb70f4df29cd80ecaa05c6 INFO: 172.20.0.1:53370 - "POST /node/69fb70f4df29cd80ecaa05c6 HTTP/1.0" 202 Accepted 2026-05-08 16:49:15,044 - lava_callback - INFO - Starting async job submit for node 69fb70f4df29cd80ecaa05c6 2026-05-08 16:49:15,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:49:15,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb70f4df29cd80ecaa05c6 HTTP/1.1" 200 None 2026-05-08 16:49:15,060 - lava_callback - DEBUG - Processing node 69fb70f4df29cd80ecaa05c6: baseline-arm64-clabbe 2026-05-08 16:49:15,060 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb70f4df29cd80ecaa05c6 2026-05-08 16:49:15,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:49:15,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb70f4df29cd80ecaa05c6 HTTP/1.1" 200 None 2026-05-08 16:49:15,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:49:15,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:49:15,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:49:15,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb70f4df29cd80ecaa05c6 HTTP/1.1" 200 None 2026-05-08 16:49:15,107 - lava_callback - ERROR - Error processing callback for node 69fb70f4df29cd80ecaa05c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44844 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:50:15,057 - lava_callback - INFO - Received callback for node 69fb7141df29cd80ecaa05f1 INFO: 172.20.0.1:33328 - "POST /node/69fb7141df29cd80ecaa05f1 HTTP/1.0" 202 Accepted 2026-05-08 16:50:15,063 - lava_callback - INFO - Starting async job submit for node 69fb7141df29cd80ecaa05f1 2026-05-08 16:50:15,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:50:15,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7141df29cd80ecaa05f1 HTTP/1.1" 200 None 2026-05-08 16:50:15,077 - lava_callback - DEBUG - Processing node 69fb7141df29cd80ecaa05f1: baseline-arm64-clabbe 2026-05-08 16:50:15,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7141df29cd80ecaa05f1 2026-05-08 16:50:15,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:50:15,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7141df29cd80ecaa05f1 HTTP/1.1" 200 None 2026-05-08 16:50:15,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:50:15,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:50:15,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:50:15,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7141df29cd80ecaa05f1 HTTP/1.1" 200 None 2026-05-08 16:50:15,123 - lava_callback - ERROR - Error processing callback for node 69fb7141df29cd80ecaa05f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45542 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:51:35,166 - lava_callback - INFO - Received callback for node 69fb718edf29cd80ecaa0611 INFO: 172.20.0.1:34166 - "POST /node/69fb718edf29cd80ecaa0611 HTTP/1.0" 202 Accepted 2026-05-08 16:51:35,175 - lava_callback - INFO - Starting async job submit for node 69fb718edf29cd80ecaa0611 2026-05-08 16:51:35,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:51:35,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb718edf29cd80ecaa0611 HTTP/1.1" 200 None 2026-05-08 16:51:35,201 - lava_callback - DEBUG - Processing node 69fb718edf29cd80ecaa0611: baseline-arm64-clabbe 2026-05-08 16:51:35,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb718edf29cd80ecaa0611 2026-05-08 16:51:35,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:51:35,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb718edf29cd80ecaa0611 HTTP/1.1" 200 None 2026-05-08 16:51:35,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:51:35,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:51:35,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:51:35,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb718edf29cd80ecaa0611 HTTP/1.1" 200 None 2026-05-08 16:51:35,262 - lava_callback - ERROR - Error processing callback for node 69fb718edf29cd80ecaa0611: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34352 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:52:55,153 - lava_callback - INFO - Received callback for node 69fb71dbdf29cd80ecaa0639 INFO: 172.20.0.1:34364 - "POST /node/69fb71dbdf29cd80ecaa0639 HTTP/1.0" 202 Accepted 2026-05-08 16:52:55,158 - lava_callback - INFO - Starting async job submit for node 69fb71dbdf29cd80ecaa0639 2026-05-08 16:52:55,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:52:55,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb71dbdf29cd80ecaa0639 HTTP/1.1" 200 None 2026-05-08 16:52:55,178 - lava_callback - DEBUG - Processing node 69fb71dbdf29cd80ecaa0639: baseline-arm64-clabbe 2026-05-08 16:52:55,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb71dbdf29cd80ecaa0639 2026-05-08 16:52:55,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:52:55,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb71dbdf29cd80ecaa0639 HTTP/1.1" 200 None 2026-05-08 16:52:55,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:52:55,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:52:55,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:52:55,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb71dbdf29cd80ecaa0639 HTTP/1.1" 200 None 2026-05-08 16:52:55,235 - lava_callback - ERROR - Error processing callback for node 69fb71dbdf29cd80ecaa0639: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54498 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 16:54:15,233 - lava_callback - INFO - Received callback for node 69fb7229df29cd80ecaa0668 INFO: 172.20.0.1:54500 - "POST /node/69fb7229df29cd80ecaa0668 HTTP/1.0" 202 Accepted 2026-05-08 16:54:15,239 - lava_callback - INFO - Starting async job submit for node 69fb7229df29cd80ecaa0668 2026-05-08 16:54:15,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:54:15,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7229df29cd80ecaa0668 HTTP/1.1" 200 None 2026-05-08 16:54:15,255 - lava_callback - DEBUG - Processing node 69fb7229df29cd80ecaa0668: baseline-arm64-clabbe 2026-05-08 16:54:15,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7229df29cd80ecaa0668 2026-05-08 16:54:15,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:54:15,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7229df29cd80ecaa0668 HTTP/1.1" 200 None 2026-05-08 16:54:15,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:54:15,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 16:54:15,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:54:15,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7229df29cd80ecaa0668 HTTP/1.1" 200 None 2026-05-08 16:54:15,309 - lava_callback - ERROR - Error processing callback for node 69fb7229df29cd80ecaa0668: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49942 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:54:53,312 - lava_callback - INFO - Received callback for node 69fe11aae4d4e78cd76ae0d5 INFO: 172.20.0.1:49950 - "POST /node/69fe11aae4d4e78cd76ae0d5 HTTP/1.0" 202 Accepted 2026-05-08 16:54:53,334 - lava_callback - INFO - Starting async job submit for node 69fe11aae4d4e78cd76ae0d5 2026-05-08 16:54:53,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:54:53,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe11aae4d4e78cd76ae0d5 HTTP/1.1" 200 None 2026-05-08 16:54:53,452 - lava_callback - DEBUG - Processing node 69fe11aae4d4e78cd76ae0d5: baseline-x86 2026-05-08 16:54:54,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:54:55,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:54:55,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fe11aae4d4e78cd76ae0d5/log.txt.gz 2026-05-08 16:54:55,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:54:56,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:54:56,241 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fe11aae4d4e78cd76ae0d5/lava-logs.yaml 2026-05-08 16:54:56,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:49952 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:54:56,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:54:56,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fe11aae4d4e78cd76ae0d5/lava_callback.json.gz DEBUG: Setup failed for 69fe11aae4d4e78cd76ae0d5. Transitting job node result: incomplete -> fail 2026-05-08 16:54:56,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:54:56,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe11aae4d4e78cd76ae0d5 HTTP/1.1" 200 None 2026-05-08 16:54:56,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:54:56,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d56e4d4e78cd76adcf2 HTTP/1.1" 200 None 2026-05-08 16:54:56,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:54:56,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe11aae4d4e78cd76ae0d5 HTTP/1.1" 200 None 2026-05-08 16:54:56,964 - lava_callback - INFO - Completed processing callback for node 69fe11aae4d4e78cd76ae0d5 2026-05-08 16:55:01,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:01,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47782 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:55:13,067 - lava_callback - INFO - Received callback for node 69fb726bdf29cd80ecaa067c INFO: 172.20.0.1:39484 - "POST /node/69fb726bdf29cd80ecaa067c HTTP/1.0" 202 Accepted 2026-05-08 16:55:13,078 - lava_callback - INFO - Starting async job submit for node 69fb726bdf29cd80ecaa067c 2026-05-08 16:55:13,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:13,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb726bdf29cd80ecaa067c HTTP/1.1" 200 None 2026-05-08 16:55:13,119 - lava_callback - DEBUG - Processing node 69fb726bdf29cd80ecaa067c: baseline-arm-baylibre 2026-05-08 16:55:13,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb726bdf29cd80ecaa067c 2026-05-08 16:55:13,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:13,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb726bdf29cd80ecaa067c HTTP/1.1" 200 None 2026-05-08 16:55:13,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:13,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 16:55:13,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:13,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb726bdf29cd80ecaa067c HTTP/1.1" 200 None 2026-05-08 16:55:13,218 - lava_callback - ERROR - Error processing callback for node 69fb726bdf29cd80ecaa067c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39508 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:55:24,401 - lava_callback - INFO - Received callback for node 69fe10d3e4d4e78cd76adf06 INFO: 172.20.0.1:47776 - "POST /node/69fe10d3e4d4e78cd76adf06 HTTP/1.0" 202 Accepted 2026-05-08 16:55:24,414 - lava_callback - INFO - Starting async job submit for node 69fe10d3e4d4e78cd76adf06 2026-05-08 16:55:24,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:24,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe10d3e4d4e78cd76adf06 HTTP/1.1" 200 None 2026-05-08 16:55:24,560 - lava_callback - DEBUG - Processing node 69fe10d3e4d4e78cd76adf06: ltp-smoke 2026-05-08 16:55:25,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:55:25,683 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:55:25,685 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe10d3e4d4e78cd76adf06/log.txt.gz 2026-05-08 16:55:26,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 16:55:26,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:55:26,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe10d3e4d4e78cd76adf06/lava-logs.yaml 2026-05-08 16:55:26,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:47792 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:55:26,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 16:55:26,816 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe10d3e4d4e78cd76adf06/lava_callback.json.gz 2026-05-08 16:55:27,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:27,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe10d3e4d4e78cd76adf06 HTTP/1.1" 200 None 2026-05-08 16:55:27,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:27,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d2be4d4e78cd76adccc HTTP/1.1" 200 None 2026-05-08 16:55:27,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:27,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe10d3e4d4e78cd76adf06 HTTP/1.1" 200 None 2026-05-08 16:55:27,374 - lava_callback - INFO - Completed processing callback for node 69fe10d3e4d4e78cd76adf06 2026-05-08 16:55:31,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:31,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51676 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:55:52,818 - lava_callback - INFO - Received callback for node 69fb7291df29cd80ecaa0688 INFO: 172.20.0.1:51690 - "POST /node/69fb7291df29cd80ecaa0688 HTTP/1.0" 202 Accepted 2026-05-08 16:55:52,824 - lava_callback - INFO - Starting async job submit for node 69fb7291df29cd80ecaa0688 2026-05-08 16:55:52,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:52,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7291df29cd80ecaa0688 HTTP/1.1" 200 None 2026-05-08 16:55:52,839 - lava_callback - DEBUG - Processing node 69fb7291df29cd80ecaa0688: baseline-arm-baylibre 2026-05-08 16:55:52,839 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7291df29cd80ecaa0688 2026-05-08 16:55:52,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:52,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7291df29cd80ecaa0688 HTTP/1.1" 200 None 2026-05-08 16:55:52,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:52,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 16:55:52,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:55:52,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7291df29cd80ecaa0688 HTTP/1.1" 200 None 2026-05-08 16:55:52,884 - lava_callback - ERROR - Error processing callback for node 69fb7291df29cd80ecaa0688: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37592 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:56:33,005 - lava_callback - INFO - Received callback for node 69fb72b7df29cd80ecaa0698 INFO: 172.20.0.1:49218 - "POST /node/69fb72b7df29cd80ecaa0698 HTTP/1.0" 202 Accepted 2026-05-08 16:56:33,011 - lava_callback - INFO - Starting async job submit for node 69fb72b7df29cd80ecaa0698 2026-05-08 16:56:33,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:56:33,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb72b7df29cd80ecaa0698 HTTP/1.1" 200 None 2026-05-08 16:56:33,029 - lava_callback - DEBUG - Processing node 69fb72b7df29cd80ecaa0698: baseline-arm-baylibre 2026-05-08 16:56:33,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb72b7df29cd80ecaa0698 2026-05-08 16:56:33,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:56:33,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb72b7df29cd80ecaa0698 HTTP/1.1" 200 None 2026-05-08 16:56:33,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:56:33,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 16:56:33,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:56:33,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb72b7df29cd80ecaa0698 HTTP/1.1" 200 None 2026-05-08 16:56:33,096 - lava_callback - ERROR - Error processing callback for node 69fb72b7df29cd80ecaa0698: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35278 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:57:12,884 - lava_callback - INFO - Received callback for node 69fb72dedf29cd80ecaa06a4 INFO: 172.20.0.1:52310 - "POST /node/69fb72dedf29cd80ecaa06a4 HTTP/1.0" 202 Accepted 2026-05-08 16:57:12,894 - lava_callback - INFO - Starting async job submit for node 69fb72dedf29cd80ecaa06a4 2026-05-08 16:57:12,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:57:12,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb72dedf29cd80ecaa06a4 HTTP/1.1" 200 None 2026-05-08 16:57:12,916 - lava_callback - DEBUG - Processing node 69fb72dedf29cd80ecaa06a4: baseline-arm-baylibre 2026-05-08 16:57:12,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb72dedf29cd80ecaa06a4 2026-05-08 16:57:12,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:57:12,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb72dedf29cd80ecaa06a4 HTTP/1.1" 200 None 2026-05-08 16:57:12,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:57:12,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 16:57:12,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:57:12,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb72dedf29cd80ecaa06a4 HTTP/1.1" 200 None 2026-05-08 16:57:12,973 - lava_callback - ERROR - Error processing callback for node 69fb72dedf29cd80ecaa06a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60220 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:57:52,955 - lava_callback - INFO - Received callback for node 69fb7305df29cd80ecaa06af INFO: 172.20.0.1:60228 - "POST /node/69fb7305df29cd80ecaa06af HTTP/1.0" 202 Accepted 2026-05-08 16:57:52,961 - lava_callback - INFO - Starting async job submit for node 69fb7305df29cd80ecaa06af 2026-05-08 16:57:52,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:57:52,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7305df29cd80ecaa06af HTTP/1.1" 200 None 2026-05-08 16:57:52,987 - lava_callback - DEBUG - Processing node 69fb7305df29cd80ecaa06af: baseline-arm-baylibre 2026-05-08 16:57:52,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7305df29cd80ecaa06af 2026-05-08 16:57:52,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:57:53,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7305df29cd80ecaa06af HTTP/1.1" 200 None 2026-05-08 16:57:53,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:57:53,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 16:57:53,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:57:53,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7305df29cd80ecaa06af HTTP/1.1" 200 None 2026-05-08 16:57:53,035 - lava_callback - ERROR - Error processing callback for node 69fb7305df29cd80ecaa06af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42990 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:58:32,970 - lava_callback - INFO - Received callback for node 69fb732bdf29cd80ecaa06ba INFO: 172.20.0.1:57490 - "POST /node/69fb732bdf29cd80ecaa06ba HTTP/1.0" 202 Accepted 2026-05-08 16:58:32,979 - lava_callback - INFO - Starting async job submit for node 69fb732bdf29cd80ecaa06ba 2026-05-08 16:58:32,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:58:33,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb732bdf29cd80ecaa06ba HTTP/1.1" 200 None 2026-05-08 16:58:33,006 - lava_callback - DEBUG - Processing node 69fb732bdf29cd80ecaa06ba: baseline-arm-baylibre 2026-05-08 16:58:33,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb732bdf29cd80ecaa06ba 2026-05-08 16:58:33,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:58:33,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb732bdf29cd80ecaa06ba HTTP/1.1" 200 None 2026-05-08 16:58:33,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:58:33,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 16:58:33,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:58:33,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb732bdf29cd80ecaa06ba HTTP/1.1" 200 None 2026-05-08 16:58:33,081 - lava_callback - ERROR - Error processing callback for node 69fb732bdf29cd80ecaa06ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53750 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 16:59:15,462 - lava_callback - INFO - Received callback for node 69fb7354df29cd80ecaa06c6 INFO: 172.20.0.1:53756 - "POST /node/69fb7354df29cd80ecaa06c6 HTTP/1.0" 202 Accepted 2026-05-08 16:59:15,472 - lava_callback - INFO - Starting async job submit for node 69fb7354df29cd80ecaa06c6 2026-05-08 16:59:15,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:59:15,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7354df29cd80ecaa06c6 HTTP/1.1" 200 None 2026-05-08 16:59:15,505 - lava_callback - DEBUG - Processing node 69fb7354df29cd80ecaa06c6: baseline-arm-clabbe 2026-05-08 16:59:15,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7354df29cd80ecaa06c6 2026-05-08 16:59:15,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:59:15,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7354df29cd80ecaa06c6 HTTP/1.1" 200 None 2026-05-08 16:59:15,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:59:15,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 16:59:15,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:59:15,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7354df29cd80ecaa06c6 HTTP/1.1" 200 None 2026-05-08 16:59:15,605 - lava_callback - ERROR - Error processing callback for node 69fb7354df29cd80ecaa06c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41354 - "GET / HTTP/1.0" 200 OK 2026-05-08 16:59:55,313 - lava_callback - INFO - Received callback for node 69fb737bdf29cd80ecaa06d0 INFO: 172.20.0.1:41358 - "POST /node/69fb737bdf29cd80ecaa06d0 HTTP/1.0" 202 Accepted 2026-05-08 16:59:55,319 - lava_callback - INFO - Starting async job submit for node 69fb737bdf29cd80ecaa06d0 2026-05-08 16:59:55,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:59:55,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb737bdf29cd80ecaa06d0 HTTP/1.1" 200 None 2026-05-08 16:59:55,335 - lava_callback - DEBUG - Processing node 69fb737bdf29cd80ecaa06d0: baseline-arm-clabbe 2026-05-08 16:59:55,335 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb737bdf29cd80ecaa06d0 2026-05-08 16:59:55,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:59:55,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb737bdf29cd80ecaa06d0 HTTP/1.1" 200 None 2026-05-08 16:59:55,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:59:55,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 16:59:55,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 16:59:55,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb737bdf29cd80ecaa06d0 HTTP/1.1" 200 None 2026-05-08 16:59:55,388 - lava_callback - ERROR - Error processing callback for node 69fb737bdf29cd80ecaa06d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60010 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:00:33,130 - lava_callback - INFO - Received callback for node 69fb739edf29cd80ecaa06da INFO: 172.20.0.1:58432 - "POST /node/69fb739edf29cd80ecaa06da HTTP/1.0" 202 Accepted 2026-05-08 17:00:33,138 - lava_callback - INFO - Starting async job submit for node 69fb739edf29cd80ecaa06da 2026-05-08 17:00:33,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:00:33,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb739edf29cd80ecaa06da HTTP/1.1" 200 None 2026-05-08 17:00:33,159 - lava_callback - DEBUG - Processing node 69fb739edf29cd80ecaa06da: baseline-arm-baylibre 2026-05-08 17:00:33,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb739edf29cd80ecaa06da 2026-05-08 17:00:33,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:00:33,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb739edf29cd80ecaa06da HTTP/1.1" 200 None 2026-05-08 17:00:33,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:00:33,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 17:00:33,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:00:33,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb739edf29cd80ecaa06da HTTP/1.1" 200 None 2026-05-08 17:00:33,220 - lava_callback - ERROR - Error processing callback for node 69fb739edf29cd80ecaa06da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40360 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:00:53,120 - lava_callback - INFO - Received callback for node 69fb73c3df29cd80ecaa06e6 INFO: 172.20.0.1:40366 - "POST /node/69fb73c3df29cd80ecaa06e6 HTTP/1.0" 202 Accepted 2026-05-08 17:00:53,126 - lava_callback - INFO - Starting async job submit for node 69fb73c3df29cd80ecaa06e6 2026-05-08 17:00:53,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:00:53,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb73c3df29cd80ecaa06e6 HTTP/1.1" 200 None 2026-05-08 17:00:53,141 - lava_callback - DEBUG - Processing node 69fb73c3df29cd80ecaa06e6: baseline-arm-baylibre 2026-05-08 17:00:53,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb73c3df29cd80ecaa06e6 2026-05-08 17:00:53,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:00:53,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb73c3df29cd80ecaa06e6 HTTP/1.1" 200 None 2026-05-08 17:00:53,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:00:53,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 17:00:53,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:00:53,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb73c3df29cd80ecaa06e6 HTTP/1.1" 200 None 2026-05-08 17:00:53,188 - lava_callback - ERROR - Error processing callback for node 69fb73c3df29cd80ecaa06e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40378 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:01:00,565 - lava_callback - INFO - Received callback for node 69fe111be4d4e78cd76adf4d INFO: 172.20.0.1:39600 - "POST /node/69fe111be4d4e78cd76adf4d HTTP/1.0" 202 Accepted 2026-05-08 17:01:00,572 - lava_callback - INFO - Starting async job submit for node 69fe111be4d4e78cd76adf4d 2026-05-08 17:01:00,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:01:00,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe111be4d4e78cd76adf4d HTTP/1.1" 200 None 2026-05-08 17:01:00,666 - lava_callback - DEBUG - Processing node 69fe111be4d4e78cd76adf4d: baseline-arm 2026-05-08 17:01:01,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:01:01,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:01:01,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111be4d4e78cd76adf4d/log.txt.gz 2026-05-08 17:01:01,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:01:02,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:01:02,176 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111be4d4e78cd76adf4d/lava-logs.yaml 2026-05-08 17:01:02,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:01:02,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:01:02,326 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe111be4d4e78cd76adf4d/lava_callback.json.gz DEBUG: Setup failed for 69fe111be4d4e78cd76adf4d. Transitting job node result: incomplete -> fail 2026-05-08 17:01:02,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:01:02,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe111be4d4e78cd76adf4d HTTP/1.1" 200 None 2026-05-08 17:01:02,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:01:02,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 17:01:02,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:01:02,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe111be4d4e78cd76adf4d HTTP/1.1" 200 None 2026-05-08 17:01:02,613 - lava_callback - INFO - Completed processing callback for node 69fe111be4d4e78cd76adf4d INFO: 172.20.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34298 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:01:31,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:01:31,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 17:01:33,145 - lava_callback - INFO - Received callback for node 69fb73e8df29cd80ecaa06ef INFO: 172.20.0.1:57560 - "POST /node/69fb73e8df29cd80ecaa06ef HTTP/1.0" 202 Accepted 2026-05-08 17:01:33,151 - lava_callback - INFO - Starting async job submit for node 69fb73e8df29cd80ecaa06ef 2026-05-08 17:01:33,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:01:33,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb73e8df29cd80ecaa06ef HTTP/1.1" 200 None 2026-05-08 17:01:33,166 - lava_callback - DEBUG - Processing node 69fb73e8df29cd80ecaa06ef: baseline-arm-baylibre 2026-05-08 17:01:33,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb73e8df29cd80ecaa06ef 2026-05-08 17:01:33,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:01:33,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb73e8df29cd80ecaa06ef HTTP/1.1" 200 None 2026-05-08 17:01:33,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:01:33,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 17:01:33,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:01:33,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb73e8df29cd80ecaa06ef HTTP/1.1" 200 None 2026-05-08 17:01:33,211 - lava_callback - ERROR - Error processing callback for node 69fb73e8df29cd80ecaa06ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53322 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:02:13,216 - lava_callback - INFO - Received callback for node 69fb740ddf29cd80ecaa06fc INFO: 172.20.0.1:60934 - "POST /node/69fb740ddf29cd80ecaa06fc HTTP/1.0" 202 Accepted 2026-05-08 17:02:13,223 - lava_callback - INFO - Starting async job submit for node 69fb740ddf29cd80ecaa06fc 2026-05-08 17:02:13,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:02:13,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb740ddf29cd80ecaa06fc HTTP/1.1" 200 None 2026-05-08 17:02:13,242 - lava_callback - DEBUG - Processing node 69fb740ddf29cd80ecaa06fc: baseline-arm-baylibre 2026-05-08 17:02:13,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb740ddf29cd80ecaa06fc 2026-05-08 17:02:13,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:02:13,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb740ddf29cd80ecaa06fc HTTP/1.1" 200 None 2026-05-08 17:02:13,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:02:13,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 17:02:13,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:02:13,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb740ddf29cd80ecaa06fc HTTP/1.1" 200 None 2026-05-08 17:02:13,300 - lava_callback - ERROR - Error processing callback for node 69fb740ddf29cd80ecaa06fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40388 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:02:53,238 - lava_callback - INFO - Received callback for node 69fb7434df29cd80ecaa0706 INFO: 172.20.0.1:40392 - "POST /node/69fb7434df29cd80ecaa0706 HTTP/1.0" 202 Accepted 2026-05-08 17:02:53,244 - lava_callback - INFO - Starting async job submit for node 69fb7434df29cd80ecaa0706 2026-05-08 17:02:53,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:02:53,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7434df29cd80ecaa0706 HTTP/1.1" 200 None 2026-05-08 17:02:53,261 - lava_callback - DEBUG - Processing node 69fb7434df29cd80ecaa0706: baseline-arm-baylibre 2026-05-08 17:02:53,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7434df29cd80ecaa0706 2026-05-08 17:02:53,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:02:53,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7434df29cd80ecaa0706 HTTP/1.1" 200 None 2026-05-08 17:02:53,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:02:53,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 17:02:53,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:02:53,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7434df29cd80ecaa0706 HTTP/1.1" 200 None 2026-05-08 17:02:53,323 - lava_callback - ERROR - Error processing callback for node 69fb7434df29cd80ecaa0706: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50410 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:03:26,239 - lava_callback - INFO - Received callback for node 69fe113ee4d4e78cd76adfde INFO: 172.20.0.1:56408 - "POST /node/69fe113ee4d4e78cd76adfde HTTP/1.0" 202 Accepted 2026-05-08 17:03:26,289 - lava_callback - INFO - Starting async job submit for node 69fe113ee4d4e78cd76adfde 2026-05-08 17:03:26,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:03:26,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe113ee4d4e78cd76adfde HTTP/1.1" 200 None 2026-05-08 17:03:26,343 - lava_callback - DEBUG - Processing node 69fe113ee4d4e78cd76adfde: baseline-arm-pengutronix 2026-05-08 17:03:26,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:03:26,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:03:26,520 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe113ee4d4e78cd76adfde/log.txt.gz INFO: 172.20.0.1:56414 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:03:26,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:03:26,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:03:26,699 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe113ee4d4e78cd76adfde/lava-logs.yaml 2026-05-08 17:03:26,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:03:26,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:03:26,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe113ee4d4e78cd76adfde/lava_callback.json.gz DEBUG: Setup failed for 69fe113ee4d4e78cd76adfde. Transitting job node result: incomplete -> fail 2026-05-08 17:03:26,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:03:26,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe113ee4d4e78cd76adfde HTTP/1.1" 200 None 2026-05-08 17:03:26,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:03:26,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 17:03:26,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:03:26,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe113ee4d4e78cd76adfde HTTP/1.1" 200 None 2026-05-08 17:03:27,002 - lava_callback - INFO - Completed processing callback for node 69fe113ee4d4e78cd76adfde 2026-05-08 17:03:31,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:03:31,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 17:03:35,593 - lava_callback - INFO - Received callback for node 69fb745bdf29cd80ecaa0712 INFO: 172.20.0.1:58356 - "POST /node/69fb745bdf29cd80ecaa0712 HTTP/1.0" 202 Accepted 2026-05-08 17:03:35,600 - lava_callback - INFO - Starting async job submit for node 69fb745bdf29cd80ecaa0712 2026-05-08 17:03:35,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:03:35,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb745bdf29cd80ecaa0712 HTTP/1.1" 200 None 2026-05-08 17:03:35,619 - lava_callback - DEBUG - Processing node 69fb745bdf29cd80ecaa0712: baseline-arm-clabbe 2026-05-08 17:03:35,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb745bdf29cd80ecaa0712 2026-05-08 17:03:35,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:03:35,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb745bdf29cd80ecaa0712 HTTP/1.1" 200 None 2026-05-08 17:03:35,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:03:35,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 17:03:35,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:03:35,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb745bdf29cd80ecaa0712 HTTP/1.1" 200 None 2026-05-08 17:03:35,669 - lava_callback - ERROR - Error processing callback for node 69fb745bdf29cd80ecaa0712: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45856 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:04:13,323 - lava_callback - INFO - Received callback for node 69fb7480df29cd80ecaa071e INFO: 172.20.0.1:59042 - "POST /node/69fb7480df29cd80ecaa071e HTTP/1.0" 202 Accepted 2026-05-08 17:04:13,329 - lava_callback - INFO - Starting async job submit for node 69fb7480df29cd80ecaa071e 2026-05-08 17:04:13,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:04:13,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7480df29cd80ecaa071e HTTP/1.1" 200 None 2026-05-08 17:04:13,346 - lava_callback - DEBUG - Processing node 69fb7480df29cd80ecaa071e: baseline-arm-baylibre 2026-05-08 17:04:13,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7480df29cd80ecaa071e 2026-05-08 17:04:13,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:04:13,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7480df29cd80ecaa071e HTTP/1.1" 200 None 2026-05-08 17:04:13,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:04:13,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 17:04:13,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:04:13,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7480df29cd80ecaa071e HTTP/1.1" 200 None 2026-05-08 17:04:13,393 - lava_callback - ERROR - Error processing callback for node 69fb7480df29cd80ecaa071e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43338 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:04:55,617 - lava_callback - INFO - Received callback for node 69fb74a9df29cd80ecaa0731 INFO: 172.20.0.1:43354 - "POST /node/69fb74a9df29cd80ecaa0731 HTTP/1.0" 202 Accepted 2026-05-08 17:04:55,626 - lava_callback - INFO - Starting async job submit for node 69fb74a9df29cd80ecaa0731 2026-05-08 17:04:55,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:04:55,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb74a9df29cd80ecaa0731 HTTP/1.1" 200 None 2026-05-08 17:04:55,649 - lava_callback - DEBUG - Processing node 69fb74a9df29cd80ecaa0731: baseline-arm-clabbe 2026-05-08 17:04:55,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb74a9df29cd80ecaa0731 2026-05-08 17:04:55,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:04:55,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb74a9df29cd80ecaa0731 HTTP/1.1" 200 None 2026-05-08 17:04:55,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:04:55,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 17:04:55,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:04:55,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb74a9df29cd80ecaa0731 HTTP/1.1" 200 None 2026-05-08 17:04:55,708 - lava_callback - ERROR - Error processing callback for node 69fb74a9df29cd80ecaa0731: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49180 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:05:35,633 - lava_callback - INFO - Received callback for node 69fb74d1df29cd80ecaa073b INFO: 172.20.0.1:54290 - "POST /node/69fb74d1df29cd80ecaa073b HTTP/1.0" 202 Accepted 2026-05-08 17:05:35,641 - lava_callback - INFO - Starting async job submit for node 69fb74d1df29cd80ecaa073b 2026-05-08 17:05:35,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:05:35,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb74d1df29cd80ecaa073b HTTP/1.1" 200 None 2026-05-08 17:05:35,657 - lava_callback - DEBUG - Processing node 69fb74d1df29cd80ecaa073b: baseline-arm-clabbe 2026-05-08 17:05:35,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb74d1df29cd80ecaa073b 2026-05-08 17:05:35,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:05:35,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb74d1df29cd80ecaa073b HTTP/1.1" 200 None 2026-05-08 17:05:35,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:05:35,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 17:05:35,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:05:35,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb74d1df29cd80ecaa073b HTTP/1.1" 200 None 2026-05-08 17:05:35,723 - lava_callback - ERROR - Error processing callback for node 69fb74d1df29cd80ecaa073b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43598 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 17:06:15,678 - lava_callback - INFO - Received callback for node 69fb74f8df29cd80ecaa0751 INFO: 172.20.0.1:43606 - "POST /node/69fb74f8df29cd80ecaa0751 HTTP/1.0" 202 Accepted 2026-05-08 17:06:15,685 - lava_callback - INFO - Starting async job submit for node 69fb74f8df29cd80ecaa0751 2026-05-08 17:06:15,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:06:15,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb74f8df29cd80ecaa0751 HTTP/1.1" 200 None 2026-05-08 17:06:15,717 - lava_callback - DEBUG - Processing node 69fb74f8df29cd80ecaa0751: baseline-arm-clabbe 2026-05-08 17:06:15,717 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb74f8df29cd80ecaa0751 2026-05-08 17:06:15,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:06:15,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb74f8df29cd80ecaa0751 HTTP/1.1" 200 None 2026-05-08 17:06:15,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:06:15,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 17:06:15,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:06:15,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb74f8df29cd80ecaa0751 HTTP/1.1" 200 None 2026-05-08 17:06:15,786 - lava_callback - ERROR - Error processing callback for node 69fb74f8df29cd80ecaa0751: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56924 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:06:55,688 - lava_callback - INFO - Received callback for node 69fb751edf29cd80ecaa076d INFO: 172.20.0.1:56938 - "POST /node/69fb751edf29cd80ecaa076d HTTP/1.0" 202 Accepted 2026-05-08 17:06:55,693 - lava_callback - INFO - Starting async job submit for node 69fb751edf29cd80ecaa076d 2026-05-08 17:06:55,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:06:55,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb751edf29cd80ecaa076d HTTP/1.1" 200 None 2026-05-08 17:06:55,716 - lava_callback - DEBUG - Processing node 69fb751edf29cd80ecaa076d: baseline-arm-clabbe 2026-05-08 17:06:55,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb751edf29cd80ecaa076d 2026-05-08 17:06:55,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:06:55,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb751edf29cd80ecaa076d HTTP/1.1" 200 None 2026-05-08 17:06:55,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:06:55,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 17:06:55,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:06:55,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb751edf29cd80ecaa076d HTTP/1.1" 200 None 2026-05-08 17:06:55,762 - lava_callback - ERROR - Error processing callback for node 69fb751edf29cd80ecaa076d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46442 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:07:35,777 - lava_callback - INFO - Received callback for node 69fb7548df29cd80ecaa0779 INFO: 172.20.0.1:38356 - "POST /node/69fb7548df29cd80ecaa0779 HTTP/1.0" 202 Accepted 2026-05-08 17:07:35,783 - lava_callback - INFO - Starting async job submit for node 69fb7548df29cd80ecaa0779 2026-05-08 17:07:35,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:07:35,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7548df29cd80ecaa0779 HTTP/1.1" 200 None 2026-05-08 17:07:35,798 - lava_callback - DEBUG - Processing node 69fb7548df29cd80ecaa0779: baseline-arm-clabbe 2026-05-08 17:07:35,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7548df29cd80ecaa0779 2026-05-08 17:07:35,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:07:35,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7548df29cd80ecaa0779 HTTP/1.1" 200 None 2026-05-08 17:07:35,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:07:35,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 17:07:35,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:07:35,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7548df29cd80ecaa0779 HTTP/1.1" 200 None 2026-05-08 17:07:35,859 - lava_callback - ERROR - Error processing callback for node 69fb7548df29cd80ecaa0779: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50760 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 17:08:15,733 - lava_callback - INFO - Received callback for node 69fb756fdf29cd80ecaa0785 INFO: 172.20.0.1:50770 - "POST /node/69fb756fdf29cd80ecaa0785 HTTP/1.0" 202 Accepted 2026-05-08 17:08:15,739 - lava_callback - INFO - Starting async job submit for node 69fb756fdf29cd80ecaa0785 2026-05-08 17:08:15,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:08:15,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb756fdf29cd80ecaa0785 HTTP/1.1" 200 None 2026-05-08 17:08:15,756 - lava_callback - DEBUG - Processing node 69fb756fdf29cd80ecaa0785: baseline-arm-clabbe 2026-05-08 17:08:15,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb756fdf29cd80ecaa0785 2026-05-08 17:08:15,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:08:15,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb756fdf29cd80ecaa0785 HTTP/1.1" 200 None 2026-05-08 17:08:15,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:08:15,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 17:08:15,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:08:15,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb756fdf29cd80ecaa0785 HTTP/1.1" 200 None 2026-05-08 17:08:15,821 - lava_callback - ERROR - Error processing callback for node 69fb756fdf29cd80ecaa0785: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50802 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:08:55,791 - lava_callback - INFO - Received callback for node 69fb7596df29cd80ecaa0792 INFO: 172.20.0.1:50804 - "POST /node/69fb7596df29cd80ecaa0792 HTTP/1.0" 202 Accepted 2026-05-08 17:08:55,800 - lava_callback - INFO - Starting async job submit for node 69fb7596df29cd80ecaa0792 2026-05-08 17:08:55,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:08:55,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7596df29cd80ecaa0792 HTTP/1.1" 200 None 2026-05-08 17:08:55,818 - lava_callback - DEBUG - Processing node 69fb7596df29cd80ecaa0792: baseline-arm-clabbe 2026-05-08 17:08:55,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7596df29cd80ecaa0792 2026-05-08 17:08:55,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:08:55,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7596df29cd80ecaa0792 HTTP/1.1" 200 None 2026-05-08 17:08:55,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:08:55,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 17:08:55,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:08:55,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7596df29cd80ecaa0792 HTTP/1.1" 200 None 2026-05-08 17:08:55,877 - lava_callback - ERROR - Error processing callback for node 69fb7596df29cd80ecaa0792: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33204 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:09:35,765 - lava_callback - INFO - Received callback for node 69fb75bedf29cd80ecaa079d INFO: 172.20.0.1:38712 - "POST /node/69fb75bedf29cd80ecaa079d HTTP/1.0" 202 Accepted 2026-05-08 17:09:35,771 - lava_callback - INFO - Starting async job submit for node 69fb75bedf29cd80ecaa079d 2026-05-08 17:09:35,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:09:35,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb75bedf29cd80ecaa079d HTTP/1.1" 200 None 2026-05-08 17:09:35,790 - lava_callback - DEBUG - Processing node 69fb75bedf29cd80ecaa079d: baseline-arm-clabbe 2026-05-08 17:09:35,790 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb75bedf29cd80ecaa079d 2026-05-08 17:09:35,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:09:35,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb75bedf29cd80ecaa079d HTTP/1.1" 200 None 2026-05-08 17:09:35,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:09:35,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 17:09:35,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:09:35,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb75bedf29cd80ecaa079d HTTP/1.1" 200 None 2026-05-08 17:09:35,850 - lava_callback - ERROR - Error processing callback for node 69fb75bedf29cd80ecaa079d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47848 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:10:13,876 - lava_callback - INFO - Received callback for node 69fb75e9df29cd80ecaa07ad INFO: 172.20.0.1:44288 - "POST /node/69fb75e9df29cd80ecaa07ad HTTP/1.0" 202 Accepted 2026-05-08 17:10:13,883 - lava_callback - INFO - Starting async job submit for node 69fb75e9df29cd80ecaa07ad 2026-05-08 17:10:13,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:10:13,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb75e9df29cd80ecaa07ad HTTP/1.1" 200 None 2026-05-08 17:10:13,898 - lava_callback - DEBUG - Processing node 69fb75e9df29cd80ecaa07ad: baseline-arm64-baylibre 2026-05-08 17:10:13,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb75e9df29cd80ecaa07ad 2026-05-08 17:10:13,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:10:13,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb75e9df29cd80ecaa07ad HTTP/1.1" 200 None 2026-05-08 17:10:13,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:10:13,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 17:10:13,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:10:13,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb75e9df29cd80ecaa07ad HTTP/1.1" 200 None 2026-05-08 17:10:13,954 - lava_callback - ERROR - Error processing callback for node 69fb75e9df29cd80ecaa07ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50658 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:11:33,822 - lava_callback - INFO - Received callback for node 69fb7632df29cd80ecaa07e1 INFO: 172.20.0.1:51538 - "POST /node/69fb7632df29cd80ecaa07e1 HTTP/1.0" 202 Accepted 2026-05-08 17:11:33,830 - lava_callback - INFO - Starting async job submit for node 69fb7632df29cd80ecaa07e1 2026-05-08 17:11:33,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:11:33,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7632df29cd80ecaa07e1 HTTP/1.1" 200 None 2026-05-08 17:11:33,850 - lava_callback - DEBUG - Processing node 69fb7632df29cd80ecaa07e1: baseline-arm64-baylibre 2026-05-08 17:11:33,851 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7632df29cd80ecaa07e1 2026-05-08 17:11:33,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:11:33,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7632df29cd80ecaa07e1 HTTP/1.1" 200 None 2026-05-08 17:11:33,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:11:33,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 17:11:33,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:11:33,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7632df29cd80ecaa07e1 HTTP/1.1" 200 None 2026-05-08 17:11:33,916 - lava_callback - ERROR - Error processing callback for node 69fb7632df29cd80ecaa07e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52624 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:12:33,747 - lava_callback - INFO - Received callback for node 69fb767ddf29cd80ecaa080c INFO: 172.20.0.1:57192 - "POST /node/69fb767ddf29cd80ecaa080c HTTP/1.0" 202 Accepted 2026-05-08 17:12:33,755 - lava_callback - INFO - Starting async job submit for node 69fb767ddf29cd80ecaa080c 2026-05-08 17:12:33,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:12:33,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb767ddf29cd80ecaa080c HTTP/1.1" 200 None 2026-05-08 17:12:33,774 - lava_callback - DEBUG - Processing node 69fb767ddf29cd80ecaa080c: baseline-arm64-baylibre 2026-05-08 17:12:33,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb767ddf29cd80ecaa080c 2026-05-08 17:12:33,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:12:33,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb767ddf29cd80ecaa080c HTTP/1.1" 200 None 2026-05-08 17:12:33,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:12:33,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 17:12:33,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:12:33,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb767ddf29cd80ecaa080c HTTP/1.1" 200 None 2026-05-08 17:12:33,854 - lava_callback - ERROR - Error processing callback for node 69fb767ddf29cd80ecaa080c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49366 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:13:40,618 - lava_callback - INFO - Received callback for node 69fe1996e4d4e78cd76b0d38 INFO: 172.20.0.1:42054 - "POST /node/69fe1996e4d4e78cd76b0d38 HTTP/1.0" 202 Accepted 2026-05-08 17:13:40,630 - lava_callback - INFO - Starting async job submit for node 69fe1996e4d4e78cd76b0d38 2026-05-08 17:13:40,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:40,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1996e4d4e78cd76b0d38 HTTP/1.1" 200 None 2026-05-08 17:13:40,690 - lava_callback - DEBUG - Processing node 69fe1996e4d4e78cd76b0d38: baseline-arm64 2026-05-08 17:13:40,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:13:41,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:13:41,058 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe1996e4d4e78cd76b0d38/log.txt.gz 2026-05-08 17:13:41,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:13:41,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:13:41,462 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe1996e4d4e78cd76b0d38/lava-logs.yaml 2026-05-08 17:13:41,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:13:41,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:13:41,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe1996e4d4e78cd76b0d38/lava_callback.json.gz 2026-05-08 17:13:41,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:41,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1996e4d4e78cd76b0d38 HTTP/1.1" 200 None 2026-05-08 17:13:41,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:41,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:13:41,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:41,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1996e4d4e78cd76b0d38 HTTP/1.1" 200 None 2026-05-08 17:13:41,713 - lava_callback - INFO - Completed processing callback for node 69fe1996e4d4e78cd76b0d38 2026-05-08 17:13:43,878 - lava_callback - INFO - Received callback for node 69fe19a2e4d4e78cd76b0d59 INFO: 172.20.0.1:42058 - "POST /node/69fe19a2e4d4e78cd76b0d59 HTTP/1.0" 202 Accepted 2026-05-08 17:13:43,885 - lava_callback - INFO - Starting async job submit for node 69fe19a2e4d4e78cd76b0d59 2026-05-08 17:13:43,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:43,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a2e4d4e78cd76b0d59 HTTP/1.1" 200 None 2026-05-08 17:13:43,970 - lava_callback - DEBUG - Processing node 69fe19a2e4d4e78cd76b0d59: baseline-arm64 2026-05-08 17:13:44,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:13:44,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:13:44,286 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a2e4d4e78cd76b0d59/log.txt.gz 2026-05-08 17:13:44,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:13:44,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:13:44,591 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a2e4d4e78cd76b0d59/lava-logs.yaml 2026-05-08 17:13:44,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:13:44,650 - lava_callback - INFO - Received callback for node 69fe19b0e4d4e78cd76b0da0 INFO: 172.20.0.1:42070 - "POST /node/69fe19b0e4d4e78cd76b0da0 HTTP/1.0" 202 Accepted 2026-05-08 17:13:44,659 - lava_callback - INFO - Starting async job submit for node 69fe19b0e4d4e78cd76b0da0 2026-05-08 17:13:44,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:44,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b0e4d4e78cd76b0da0 HTTP/1.1" 200 None 2026-05-08 17:13:44,678 - lava_callback - DEBUG - Processing node 69fe19b0e4d4e78cd76b0da0: baseline-nfs-arm64 2026-05-08 17:13:44,680 - lava_callback - WARNING - Failed to upload log 2026-05-08 17:13:44,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:13:44,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:13:44,712 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a2e4d4e78cd76b0d59/lava_callback.json.gz 2026-05-08 17:13:44,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:44,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a2e4d4e78cd76b0d59 HTTP/1.1" 200 None 2026-05-08 17:13:44,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:44,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:13:44,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b0e4d4e78cd76b0da0/lava-logs.yaml 2026-05-08 17:13:44,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:13:44,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:13:44,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:44,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19a2e4d4e78cd76b0d59 HTTP/1.1" 200 None 2026-05-08 17:13:44,800 - lava_callback - INFO - Completed processing callback for node 69fe19a2e4d4e78cd76b0d59 2026-05-08 17:13:44,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:13:44,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b0e4d4e78cd76b0da0/lava_callback.json.gz 2026-05-08 17:13:44,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:44,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b0e4d4e78cd76b0da0 HTTP/1.1" 200 None 2026-05-08 17:13:44,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:45,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:13:45,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:45,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19b0e4d4e78cd76b0da0 HTTP/1.1" 200 None 2026-05-08 17:13:45,072 - lava_callback - INFO - Completed processing callback for node 69fe19b0e4d4e78cd76b0da0 INFO: 172.20.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60960 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:13:54,385 - lava_callback - INFO - Received callback for node 69fb76cddf29cd80ecaa0839 INFO: 172.20.0.1:60966 - "POST /node/69fb76cddf29cd80ecaa0839 HTTP/1.0" 202 Accepted 2026-05-08 17:13:54,394 - lava_callback - INFO - Starting async job submit for node 69fb76cddf29cd80ecaa0839 2026-05-08 17:13:54,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:54,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb76cddf29cd80ecaa0839 HTTP/1.1" 200 None 2026-05-08 17:13:54,417 - lava_callback - DEBUG - Processing node 69fb76cddf29cd80ecaa0839: baseline-arm64-baylibre 2026-05-08 17:13:54,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb76cddf29cd80ecaa0839 2026-05-08 17:13:54,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:54,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb76cddf29cd80ecaa0839 HTTP/1.1" 200 None 2026-05-08 17:13:54,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:54,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 17:13:54,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:13:54,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb76cddf29cd80ecaa0839 HTTP/1.1" 200 None 2026-05-08 17:13:54,489 - lava_callback - ERROR - Error processing callback for node 69fb76cddf29cd80ecaa0839: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60974 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:14:01,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:01,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55418 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:14:09,195 - lava_callback - INFO - Received callback for node 69fe199ae4d4e78cd76b0d44 INFO: 172.20.0.1:55432 - "POST /node/69fe199ae4d4e78cd76b0d44 HTTP/1.0" 202 Accepted 2026-05-08 17:14:09,202 - lava_callback - INFO - Starting async job submit for node 69fe199ae4d4e78cd76b0d44 2026-05-08 17:14:09,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:09,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe199ae4d4e78cd76b0d44 HTTP/1.1" 200 None 2026-05-08 17:14:09,248 - lava_callback - DEBUG - Processing node 69fe199ae4d4e78cd76b0d44: baseline-arm64 2026-05-08 17:14:09,468 - lava_callback - WARNING - Failed to upload log 2026-05-08 17:14:09,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:09,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:09,748 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199ae4d4e78cd76b0d44/lava-logs.yaml 2026-05-08 17:14:09,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:09,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:09,867 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199ae4d4e78cd76b0d44/lava_callback.json.gz 2026-05-08 17:14:09,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:09,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe199ae4d4e78cd76b0d44 HTTP/1.1" 200 None 2026-05-08 17:14:09,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:09,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:09,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:09,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe199ae4d4e78cd76b0d44 HTTP/1.1" 200 None 2026-05-08 17:14:10,061 - lava_callback - INFO - Completed processing callback for node 69fe199ae4d4e78cd76b0d44 2026-05-08 17:14:10,617 - lava_callback - INFO - Received callback for node 69fe199be4d4e78cd76b0d47 INFO: 172.20.0.1:58254 - "POST /node/69fe199be4d4e78cd76b0d47 HTTP/1.0" 202 Accepted 2026-05-08 17:14:10,624 - lava_callback - INFO - Starting async job submit for node 69fe199be4d4e78cd76b0d47 2026-05-08 17:14:10,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:10,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe199be4d4e78cd76b0d47 HTTP/1.1" 200 None 2026-05-08 17:14:10,684 - lava_callback - DEBUG - Processing node 69fe199be4d4e78cd76b0d47: baseline-arm64 2026-05-08 17:14:10,877 - lava_callback - WARNING - Failed to upload log 2026-05-08 17:14:10,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:11,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:11,139 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199be4d4e78cd76b0d47/lava-logs.yaml 2026-05-08 17:14:11,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:11,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:11,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199be4d4e78cd76b0d47/lava_callback.json.gz 2026-05-08 17:14:11,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:11,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe199be4d4e78cd76b0d47 HTTP/1.1" 200 None 2026-05-08 17:14:11,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:11,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:11,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:11,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe199be4d4e78cd76b0d47 HTTP/1.1" 200 None 2026-05-08 17:14:11,427 - lava_callback - INFO - Completed processing callback for node 69fe199be4d4e78cd76b0d47 2026-05-08 17:14:11,850 - lava_callback - INFO - Received callback for node 69fe19a1e4d4e78cd76b0d56 INFO: 172.20.0.1:58258 - "POST /node/69fe19a1e4d4e78cd76b0d56 HTTP/1.0" 202 Accepted 2026-05-08 17:14:11,857 - lava_callback - INFO - Starting async job submit for node 69fe19a1e4d4e78cd76b0d56 2026-05-08 17:14:11,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:11,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a1e4d4e78cd76b0d56 HTTP/1.1" 200 None 2026-05-08 17:14:11,902 - lava_callback - DEBUG - Processing node 69fe19a1e4d4e78cd76b0d56: baseline-arm64 2026-05-08 17:14:12,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:12,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:12,696 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a1e4d4e78cd76b0d56/log.txt.gz 2026-05-08 17:14:13,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:13,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:13,247 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a1e4d4e78cd76b0d56/lava-logs.yaml 2026-05-08 17:14:13,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:13,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:13,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a1e4d4e78cd76b0d56/lava_callback.json.gz 2026-05-08 17:14:13,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:13,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a1e4d4e78cd76b0d56 HTTP/1.1" 200 None 2026-05-08 17:14:13,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:13,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:13,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:13,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19a1e4d4e78cd76b0d56 HTTP/1.1" 200 None 2026-05-08 17:14:13,497 - lava_callback - INFO - Completed processing callback for node 69fe19a1e4d4e78cd76b0d56 INFO: 172.20.0.1:58270 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 17:14:15,636 - lava_callback - INFO - Received callback for node 69fe19a3e4d4e78cd76b0d5c INFO: 172.20.0.1:58284 - "POST /node/69fe19a3e4d4e78cd76b0d5c HTTP/1.0" 202 Accepted 2026-05-08 17:14:15,644 - lava_callback - INFO - Starting async job submit for node 69fe19a3e4d4e78cd76b0d5c 2026-05-08 17:14:15,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:15,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a3e4d4e78cd76b0d5c HTTP/1.1" 200 None 2026-05-08 17:14:15,685 - lava_callback - DEBUG - Processing node 69fe19a3e4d4e78cd76b0d5c: baseline-arm64 2026-05-08 17:14:15,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:16,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:16,035 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a3e4d4e78cd76b0d5c/log.txt.gz 2026-05-08 17:14:16,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:16,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:16,391 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a3e4d4e78cd76b0d5c/lava-logs.yaml 2026-05-08 17:14:16,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:58300 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:14:16,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:16,506 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a3e4d4e78cd76b0d5c/lava_callback.json.gz 2026-05-08 17:14:16,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:16,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a3e4d4e78cd76b0d5c HTTP/1.1" 200 None 2026-05-08 17:14:16,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:16,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:16,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:16,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19a3e4d4e78cd76b0d5c HTTP/1.1" 200 None 2026-05-08 17:14:16,592 - lava_callback - INFO - Completed processing callback for node 69fe19a3e4d4e78cd76b0d5c 2026-05-08 17:14:17,630 - lava_callback - INFO - Received callback for node 69fe199de4d4e78cd76b0d4d INFO: 172.20.0.1:58304 - "POST /node/69fe199de4d4e78cd76b0d4d HTTP/1.0" 202 Accepted 2026-05-08 17:14:17,641 - lava_callback - INFO - Starting async job submit for node 69fe199de4d4e78cd76b0d4d 2026-05-08 17:14:17,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:17,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe199de4d4e78cd76b0d4d HTTP/1.1" 200 None 2026-05-08 17:14:17,694 - lava_callback - DEBUG - Processing node 69fe199de4d4e78cd76b0d4d: baseline-arm64 2026-05-08 17:14:17,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:18,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:18,086 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199de4d4e78cd76b0d4d/log.txt.gz 2026-05-08 17:14:18,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:18,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:18,392 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199de4d4e78cd76b0d4d/lava-logs.yaml 2026-05-08 17:14:18,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:18,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:18,522 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199de4d4e78cd76b0d4d/lava_callback.json.gz 2026-05-08 17:14:18,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:18,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe199de4d4e78cd76b0d4d HTTP/1.1" 200 None 2026-05-08 17:14:18,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:18,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:18,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:18,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe199de4d4e78cd76b0d4d HTTP/1.1" 200 None 2026-05-08 17:14:18,610 - lava_callback - INFO - Completed processing callback for node 69fe199de4d4e78cd76b0d4d 2026-05-08 17:14:19,116 - lava_callback - INFO - Received callback for node 69fe1998e4d4e78cd76b0d3e INFO: 172.20.0.1:58314 - "POST /node/69fe1998e4d4e78cd76b0d3e HTTP/1.0" 202 Accepted 2026-05-08 17:14:19,126 - lava_callback - INFO - Starting async job submit for node 69fe1998e4d4e78cd76b0d3e 2026-05-08 17:14:19,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:19,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1998e4d4e78cd76b0d3e HTTP/1.1" 200 None 2026-05-08 17:14:19,177 - lava_callback - DEBUG - Processing node 69fe1998e4d4e78cd76b0d3e: baseline-arm64 2026-05-08 17:14:19,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:19,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:19,596 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe1998e4d4e78cd76b0d3e/log.txt.gz 2026-05-08 17:14:19,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:19,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:19,903 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe1998e4d4e78cd76b0d3e/lava-logs.yaml 2026-05-08 17:14:19,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:19,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:20,000 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe1998e4d4e78cd76b0d3e/lava_callback.json.gz 2026-05-08 17:14:20,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:20,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1998e4d4e78cd76b0d3e HTTP/1.1" 200 None 2026-05-08 17:14:20,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:20,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:20,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:20,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1998e4d4e78cd76b0d3e HTTP/1.1" 200 None 2026-05-08 17:14:20,082 - lava_callback - INFO - Completed processing callback for node 69fe1998e4d4e78cd76b0d3e 2026-05-08 17:14:22,481 - lava_callback - INFO - Received callback for node 69fe19a0e4d4e78cd76b0d53 INFO: 172.20.0.1:50422 - "POST /node/69fe19a0e4d4e78cd76b0d53 HTTP/1.0" 202 Accepted 2026-05-08 17:14:22,488 - lava_callback - INFO - Starting async job submit for node 69fe19a0e4d4e78cd76b0d53 2026-05-08 17:14:22,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:22,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a0e4d4e78cd76b0d53 HTTP/1.1" 200 None 2026-05-08 17:14:22,526 - lava_callback - DEBUG - Processing node 69fe19a0e4d4e78cd76b0d53: baseline-arm64 2026-05-08 17:14:22,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:23,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:23,024 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a0e4d4e78cd76b0d53/log.txt.gz 2026-05-08 17:14:23,235 - lava_callback - INFO - Received callback for node 69fe1997e4d4e78cd76b0d3b INFO: 172.20.0.1:50426 - "POST /node/69fe1997e4d4e78cd76b0d3b HTTP/1.0" 202 Accepted 2026-05-08 17:14:23,253 - lava_callback - INFO - Starting async job submit for node 69fe1997e4d4e78cd76b0d3b 2026-05-08 17:14:23,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:23,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:23,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1997e4d4e78cd76b0d3b HTTP/1.1" 200 None 2026-05-08 17:14:23,311 - lava_callback - DEBUG - Processing node 69fe1997e4d4e78cd76b0d3b: baseline-arm64 2026-05-08 17:14:23,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:23,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a0e4d4e78cd76b0d53/lava-logs.yaml 2026-05-08 17:14:23,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:23,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:23,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:23,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe1997e4d4e78cd76b0d3b/log.txt.gz 2026-05-08 17:14:23,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:23,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a0e4d4e78cd76b0d53/lava_callback.json.gz 2026-05-08 17:14:23,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:23,898 - lava_callback - INFO - Received callback for node 69fe199ee4d4e78cd76b0d50 2026-05-08 17:14:23,933 - lava_callback - INFO - Starting async job submit for node 69fe199ee4d4e78cd76b0d50 2026-05-08 17:14:23,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:50440 - "POST /node/69fe199ee4d4e78cd76b0d50 HTTP/1.0" 202 Accepted 2026-05-08 17:14:23,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a0e4d4e78cd76b0d53 HTTP/1.1" 200 None 2026-05-08 17:14:23,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:23,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:24,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:24,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:24,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe199ee4d4e78cd76b0d50 HTTP/1.1" 200 None 2026-05-08 17:14:24,039 - lava_callback - DEBUG - Processing node 69fe199ee4d4e78cd76b0d50: baseline-arm64 2026-05-08 17:14:24,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19a0e4d4e78cd76b0d53 HTTP/1.1" 200 None 2026-05-08 17:14:24,122 - lava_callback - INFO - Completed processing callback for node 69fe19a0e4d4e78cd76b0d53 2026-05-08 17:14:24,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:24,233 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe1997e4d4e78cd76b0d3b/lava-logs.yaml 2026-05-08 17:14:24,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:24,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:24,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe1997e4d4e78cd76b0d3b/lava_callback.json.gz 2026-05-08 17:14:24,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:24,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:24,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1997e4d4e78cd76b0d3b HTTP/1.1" 200 None 2026-05-08 17:14:24,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:24,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:24,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:24,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1997e4d4e78cd76b0d3b HTTP/1.1" 200 None 2026-05-08 17:14:24,659 - lava_callback - INFO - Completed processing callback for node 69fe1997e4d4e78cd76b0d3b 2026-05-08 17:14:24,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:24,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199ee4d4e78cd76b0d50/log.txt.gz 2026-05-08 17:14:25,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:25,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:25,203 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199ee4d4e78cd76b0d50/lava-logs.yaml 2026-05-08 17:14:25,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:25,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:25,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199ee4d4e78cd76b0d50/lava_callback.json.gz 2026-05-08 17:14:25,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:25,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe199ee4d4e78cd76b0d50 HTTP/1.1" 200 None 2026-05-08 17:14:25,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:25,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:25,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:25,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe199ee4d4e78cd76b0d50 HTTP/1.1" 200 None 2026-05-08 17:14:25,371 - lava_callback - INFO - Completed processing callback for node 69fe199ee4d4e78cd76b0d50 2026-05-08 17:14:25,905 - lava_callback - INFO - Received callback for node 69fe19a6e4d4e78cd76b0d85 INFO: 172.20.0.1:50444 - "POST /node/69fe19a6e4d4e78cd76b0d85 HTTP/1.0" 202 Accepted 2026-05-08 17:14:25,912 - lava_callback - INFO - Starting async job submit for node 69fe19a6e4d4e78cd76b0d85 2026-05-08 17:14:25,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:25,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a6e4d4e78cd76b0d85 HTTP/1.1" 200 None 2026-05-08 17:14:25,955 - lava_callback - DEBUG - Processing node 69fe19a6e4d4e78cd76b0d85: baseline-arm64 2026-05-08 17:14:26,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:26,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:26,357 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a6e4d4e78cd76b0d85/log.txt.gz INFO: 172.20.0.1:50450 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:14:26,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:26,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:26,657 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a6e4d4e78cd76b0d85/lava-logs.yaml 2026-05-08 17:14:26,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:26,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:26,755 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a6e4d4e78cd76b0d85/lava_callback.json.gz 2026-05-08 17:14:26,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:26,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a6e4d4e78cd76b0d85 HTTP/1.1" 200 None 2026-05-08 17:14:26,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:26,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:26,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:26,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19a6e4d4e78cd76b0d85 HTTP/1.1" 200 None 2026-05-08 17:14:26,826 - lava_callback - INFO - Completed processing callback for node 69fe19a6e4d4e78cd76b0d85 2026-05-08 17:14:28,547 - lava_callback - INFO - Received callback for node 69fe1998e4d4e78cd76b0d41 INFO: 172.20.0.1:50452 - "POST /node/69fe1998e4d4e78cd76b0d41 HTTP/1.0" 202 Accepted 2026-05-08 17:14:28,557 - lava_callback - INFO - Starting async job submit for node 69fe1998e4d4e78cd76b0d41 2026-05-08 17:14:28,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:28,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1998e4d4e78cd76b0d41 HTTP/1.1" 200 None 2026-05-08 17:14:28,597 - lava_callback - DEBUG - Processing node 69fe1998e4d4e78cd76b0d41: baseline-arm64 2026-05-08 17:14:28,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:28,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:28,913 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe1998e4d4e78cd76b0d41/log.txt.gz 2026-05-08 17:14:29,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:29,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:29,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe1998e4d4e78cd76b0d41/lava-logs.yaml 2026-05-08 17:14:29,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:29,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:29,331 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe1998e4d4e78cd76b0d41/lava_callback.json.gz 2026-05-08 17:14:29,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:29,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1998e4d4e78cd76b0d41 HTTP/1.1" 200 None 2026-05-08 17:14:29,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:29,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:29,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:29,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1998e4d4e78cd76b0d41 HTTP/1.1" 200 None 2026-05-08 17:14:29,409 - lava_callback - INFO - Completed processing callback for node 69fe1998e4d4e78cd76b0d41 2026-05-08 17:14:31,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:31,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-08 17:14:35,738 - lava_callback - INFO - Received callback for node 69fe19a7e4d4e78cd76b0d88 INFO: 172.20.0.1:47256 - "POST /node/69fe19a7e4d4e78cd76b0d88 HTTP/1.0" 202 Accepted 2026-05-08 17:14:35,744 - lava_callback - INFO - Starting async job submit for node 69fe19a7e4d4e78cd76b0d88 2026-05-08 17:14:35,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:35,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a7e4d4e78cd76b0d88 HTTP/1.1" 200 None 2026-05-08 17:14:35,780 - lava_callback - DEBUG - Processing node 69fe19a7e4d4e78cd76b0d88: baseline-arm64 2026-05-08 17:14:36,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:36,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:36,172 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a7e4d4e78cd76b0d88/log.txt.gz 2026-05-08 17:14:36,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:47268 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:14:36,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:36,568 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a7e4d4e78cd76b0d88/lava-logs.yaml 2026-05-08 17:14:36,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:36,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:36,678 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a7e4d4e78cd76b0d88/lava_callback.json.gz 2026-05-08 17:14:36,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:36,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a7e4d4e78cd76b0d88 HTTP/1.1" 200 None 2026-05-08 17:14:36,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:36,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:36,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:36,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19a7e4d4e78cd76b0d88 HTTP/1.1" 200 None 2026-05-08 17:14:36,767 - lava_callback - INFO - Completed processing callback for node 69fe19a7e4d4e78cd76b0d88 2026-05-08 17:14:41,757 - lava_callback - INFO - Received callback for node 69fe19a5e4d4e78cd76b0d62 INFO: 172.20.0.1:46258 - "POST /node/69fe19a5e4d4e78cd76b0d62 HTTP/1.0" 202 Accepted 2026-05-08 17:14:41,766 - lava_callback - INFO - Starting async job submit for node 69fe19a5e4d4e78cd76b0d62 2026-05-08 17:14:41,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:41,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a5e4d4e78cd76b0d62 HTTP/1.1" 200 None 2026-05-08 17:14:41,804 - lava_callback - DEBUG - Processing node 69fe19a5e4d4e78cd76b0d62: baseline-arm64 2026-05-08 17:14:42,084 - lava_callback - INFO - Received callback for node 69fe19aee4d4e78cd76b0d9a INFO: 172.20.0.1:46260 - "POST /node/69fe19aee4d4e78cd76b0d9a HTTP/1.0" 202 Accepted 2026-05-08 17:14:42,092 - lava_callback - INFO - Starting async job submit for node 69fe19aee4d4e78cd76b0d9a 2026-05-08 17:14:42,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:42,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:42,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19aee4d4e78cd76b0d9a HTTP/1.1" 200 None 2026-05-08 17:14:42,134 - lava_callback - DEBUG - Processing node 69fe19aee4d4e78cd76b0d9a: baseline-nfs-arm64 2026-05-08 17:14:42,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:42,261 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a5e4d4e78cd76b0d62/log.txt.gz 2026-05-08 17:14:42,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:42,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:42,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:42,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a5e4d4e78cd76b0d62/lava-logs.yaml 2026-05-08 17:14:42,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:42,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:42,943 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19aee4d4e78cd76b0d9a/log.txt.gz 2026-05-08 17:14:43,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:43,042 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a5e4d4e78cd76b0d62/lava_callback.json.gz 2026-05-08 17:14:43,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:43,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a5e4d4e78cd76b0d62 HTTP/1.1" 200 None 2026-05-08 17:14:43,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:43,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:43,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:43,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19a5e4d4e78cd76b0d62 HTTP/1.1" 200 None 2026-05-08 17:14:43,354 - lava_callback - INFO - Completed processing callback for node 69fe19a5e4d4e78cd76b0d62 2026-05-08 17:14:43,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:43,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:43,593 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19aee4d4e78cd76b0d9a/lava-logs.yaml 2026-05-08 17:14:43,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:43,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:43,735 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19aee4d4e78cd76b0d9a/lava_callback.json.gz 2026-05-08 17:14:43,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:43,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19aee4d4e78cd76b0d9a HTTP/1.1" 200 None 2026-05-08 17:14:43,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:43,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:43,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:43,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19aee4d4e78cd76b0d9a HTTP/1.1" 200 None 2026-05-08 17:14:43,825 - lava_callback - INFO - Completed processing callback for node 69fe19aee4d4e78cd76b0d9a INFO: 172.20.0.1:46264 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:14:48,640 - lava_callback - INFO - Received callback for node 69fe19b4e4d4e78cd76b0da9 INFO: 172.20.0.1:46268 - "POST /node/69fe19b4e4d4e78cd76b0da9 HTTP/1.0" 202 Accepted 2026-05-08 17:14:48,648 - lava_callback - INFO - Starting async job submit for node 69fe19b4e4d4e78cd76b0da9 2026-05-08 17:14:48,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:48,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b4e4d4e78cd76b0da9 HTTP/1.1" 200 None 2026-05-08 17:14:48,691 - lava_callback - DEBUG - Processing node 69fe19b4e4d4e78cd76b0da9: baseline-nfs-arm64 2026-05-08 17:14:49,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:49,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:49,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b4e4d4e78cd76b0da9/log.txt.gz 2026-05-08 17:14:49,340 - lava_callback - INFO - Received callback for node 69fe19dae4d4e78cd76b0e2b INFO: 172.20.0.1:46284 - "POST /node/69fe19dae4d4e78cd76b0e2b HTTP/1.0" 202 Accepted 2026-05-08 17:14:49,349 - lava_callback - INFO - Starting async job submit for node 69fe19dae4d4e78cd76b0e2b 2026-05-08 17:14:49,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:49,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:49,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19dae4d4e78cd76b0e2b HTTP/1.1" 200 None 2026-05-08 17:14:49,392 - lava_callback - DEBUG - Processing node 69fe19dae4d4e78cd76b0e2b: baseline-arm64-kontron 2026-05-08 17:14:49,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:49,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:49,803 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b4e4d4e78cd76b0da9/lava-logs.yaml 2026-05-08 17:14:49,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:49,881 - lava_callback - INFO - Received callback for node 69fe19afe4d4e78cd76b0d9d INFO: 172.20.0.1:44320 - "POST /node/69fe19afe4d4e78cd76b0d9d HTTP/1.0" 202 Accepted 2026-05-08 17:14:49,889 - lava_callback - INFO - Starting async job submit for node 69fe19afe4d4e78cd76b0d9d 2026-05-08 17:14:49,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:49,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:49,917 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b4e4d4e78cd76b0da9/lava_callback.json.gz 2026-05-08 17:14:49,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:49,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19afe4d4e78cd76b0d9d HTTP/1.1" 200 None 2026-05-08 17:14:49,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b4e4d4e78cd76b0da9 HTTP/1.1" 200 None 2026-05-08 17:14:49,960 - lava_callback - DEBUG - Processing node 69fe19afe4d4e78cd76b0d9d: baseline-nfs-arm64 2026-05-08 17:14:49,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:49,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:50,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fe19dae4d4e78cd76b0e2b/log.txt.gz 2026-05-08 17:14:50,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:50,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:50,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19b4e4d4e78cd76b0da9 HTTP/1.1" 200 None 2026-05-08 17:14:50,396 - lava_callback - INFO - Completed processing callback for node 69fe19b4e4d4e78cd76b0da9 2026-05-08 17:14:50,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:50,581 - lava_callback - INFO - Received callback for node 69fe19b1e4d4e78cd76b0da3 INFO: 172.20.0.1:44324 - "POST /node/69fe19b1e4d4e78cd76b0da3 HTTP/1.0" 202 Accepted 2026-05-08 17:14:50,602 - lava_callback - INFO - Starting async job submit for node 69fe19b1e4d4e78cd76b0da3 2026-05-08 17:14:50,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:50,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:50,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b1e4d4e78cd76b0da3 HTTP/1.1" 200 None 2026-05-08 17:14:50,771 - lava_callback - DEBUG - Processing node 69fe19b1e4d4e78cd76b0da3: baseline-nfs-arm64 2026-05-08 17:14:50,953 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fe19dae4d4e78cd76b0e2b/lava-logs.yaml 2026-05-08 17:14:51,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:51,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:44336 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:14:51,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:51,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:51,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fe19dae4d4e78cd76b0e2b/lava_callback.json.gz 2026-05-08 17:14:51,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:51,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19dae4d4e78cd76b0e2b HTTP/1.1" 200 None 2026-05-08 17:14:51,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:51,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:51,450 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19afe4d4e78cd76b0d9d/log.txt.gz 2026-05-08 17:14:51,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:51,515 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b1e4d4e78cd76b0da3/log.txt.gz 2026-05-08 17:14:51,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:51,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:51,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19dae4d4e78cd76b0e2b HTTP/1.1" 200 None 2026-05-08 17:14:51,757 - lava_callback - INFO - Completed processing callback for node 69fe19dae4d4e78cd76b0e2b 2026-05-08 17:14:52,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:52,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:52,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:52,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b1e4d4e78cd76b0da3/lava-logs.yaml 2026-05-08 17:14:52,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:52,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:52,272 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19afe4d4e78cd76b0d9d/lava-logs.yaml 2026-05-08 17:14:52,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:52,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:52,359 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b1e4d4e78cd76b0da3/lava_callback.json.gz 2026-05-08 17:14:52,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:52,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:52,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19afe4d4e78cd76b0d9d/lava_callback.json.gz 2026-05-08 17:14:52,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:52,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b1e4d4e78cd76b0da3 HTTP/1.1" 200 None 2026-05-08 17:14:52,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:52,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19afe4d4e78cd76b0d9d HTTP/1.1" 200 None 2026-05-08 17:14:52,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:52,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:52,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:52,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:52,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:52,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19b1e4d4e78cd76b0da3 HTTP/1.1" 200 None 2026-05-08 17:14:52,488 - lava_callback - INFO - Completed processing callback for node 69fe19b1e4d4e78cd76b0da3 2026-05-08 17:14:52,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19afe4d4e78cd76b0d9d HTTP/1.1" 200 None 2026-05-08 17:14:52,508 - lava_callback - INFO - Completed processing callback for node 69fe19afe4d4e78cd76b0d9d 2026-05-08 17:14:56,410 - lava_callback - INFO - Received callback for node 69fe19b6e4d4e78cd76b0daf INFO: 172.20.0.1:44346 - "POST /node/69fe19b6e4d4e78cd76b0daf HTTP/1.0" 202 Accepted 2026-05-08 17:14:56,416 - lava_callback - INFO - Starting async job submit for node 69fe19b6e4d4e78cd76b0daf 2026-05-08 17:14:56,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:56,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b6e4d4e78cd76b0daf HTTP/1.1" 200 None 2026-05-08 17:14:56,454 - lava_callback - DEBUG - Processing node 69fe19b6e4d4e78cd76b0daf: baseline-nfs-arm64 INFO: 172.20.0.1:44360 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:14:56,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:57,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:57,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b6e4d4e78cd76b0daf/log.txt.gz 2026-05-08 17:14:57,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:57,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:57,494 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b6e4d4e78cd76b0daf/lava-logs.yaml 2026-05-08 17:14:57,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:14:57,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:14:57,637 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b6e4d4e78cd76b0daf/lava_callback.json.gz 2026-05-08 17:14:57,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:57,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b6e4d4e78cd76b0daf HTTP/1.1" 200 None 2026-05-08 17:14:57,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:57,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:14:57,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:14:57,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19b6e4d4e78cd76b0daf HTTP/1.1" 200 None 2026-05-08 17:14:57,719 - lava_callback - INFO - Completed processing callback for node 69fe19b6e4d4e78cd76b0daf 2026-05-08 17:15:01,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:01,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-08 17:15:03,680 - lava_callback - INFO - Received callback for node 69fe19dfe4d4e78cd76b0e3b INFO: 172.20.0.1:40188 - "POST /node/69fe19dfe4d4e78cd76b0e3b HTTP/1.0" 202 Accepted 2026-05-08 17:15:03,687 - lava_callback - INFO - Starting async job submit for node 69fe19dfe4d4e78cd76b0e3b 2026-05-08 17:15:03,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:03,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19dfe4d4e78cd76b0e3b HTTP/1.1" 200 None 2026-05-08 17:15:03,730 - lava_callback - DEBUG - Processing node 69fe19dfe4d4e78cd76b0e3b: baseline-arm64-foundriesio 2026-05-08 17:15:04,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:04,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:04,101 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe19dfe4d4e78cd76b0e3b/log.txt.gz 2026-05-08 17:15:04,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:04,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:04,367 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe19dfe4d4e78cd76b0e3b/lava-logs.yaml 2026-05-08 17:15:04,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:04,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:04,481 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe19dfe4d4e78cd76b0e3b/lava_callback.json.gz 2026-05-08 17:15:04,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:04,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19dfe4d4e78cd76b0e3b HTTP/1.1" 200 None 2026-05-08 17:15:04,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:04,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:15:04,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:04,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19dfe4d4e78cd76b0e3b HTTP/1.1" 200 None 2026-05-08 17:15:04,589 - lava_callback - INFO - Completed processing callback for node 69fe19dfe4d4e78cd76b0e3b 2026-05-08 17:15:05,604 - lava_callback - INFO - Received callback for node 69fe19dce4d4e78cd76b0e31 INFO: 172.20.0.1:40196 - "POST /node/69fe19dce4d4e78cd76b0e31 HTTP/1.0" 202 Accepted 2026-05-08 17:15:05,613 - lava_callback - INFO - Starting async job submit for node 69fe19dce4d4e78cd76b0e31 2026-05-08 17:15:05,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:05,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19dce4d4e78cd76b0e31 HTTP/1.1" 200 None 2026-05-08 17:15:05,651 - lava_callback - DEBUG - Processing node 69fe19dce4d4e78cd76b0e31: baseline-arm64-pengutronix 2026-05-08 17:15:05,821 - lava_callback - INFO - Received callback for node 69fe19ace4d4e78cd76b0d94 INFO: 172.20.0.1:40212 - "POST /node/69fe19ace4d4e78cd76b0d94 HTTP/1.0" 202 Accepted 2026-05-08 17:15:05,843 - lava_callback - INFO - Starting async job submit for node 69fe19ace4d4e78cd76b0d94 2026-05-08 17:15:05,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:05,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:05,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19ace4d4e78cd76b0d94 HTTP/1.1" 200 None 2026-05-08 17:15:05,898 - lava_callback - DEBUG - Processing node 69fe19ace4d4e78cd76b0d94: baseline-nfs-arm64 2026-05-08 17:15:06,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:06,056 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fe19dce4d4e78cd76b0e31/log.txt.gz 2026-05-08 17:15:06,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:06,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:40224 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:15:06,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:06,523 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19ace4d4e78cd76b0d94/log.txt.gz 2026-05-08 17:15:06,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:06,588 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fe19dce4d4e78cd76b0e31/lava-logs.yaml 2026-05-08 17:15:06,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:06,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:06,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:06,812 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fe19dce4d4e78cd76b0e31/lava_callback.json.gz 2026-05-08 17:15:06,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:06,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19dce4d4e78cd76b0e31 HTTP/1.1" 200 None 2026-05-08 17:15:06,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:06,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:06,871 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19ace4d4e78cd76b0d94/lava-logs.yaml 2026-05-08 17:15:06,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:15:06,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:06,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:06,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19dce4d4e78cd76b0e31 HTTP/1.1" 200 None 2026-05-08 17:15:06,908 - lava_callback - INFO - Completed processing callback for node 69fe19dce4d4e78cd76b0e31 2026-05-08 17:15:07,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:07,012 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19ace4d4e78cd76b0d94/lava_callback.json.gz 2026-05-08 17:15:07,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:07,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19ace4d4e78cd76b0d94 HTTP/1.1" 200 None 2026-05-08 17:15:07,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:07,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:15:07,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:07,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19ace4d4e78cd76b0d94 HTTP/1.1" 200 None 2026-05-08 17:15:07,115 - lava_callback - INFO - Completed processing callback for node 69fe19ace4d4e78cd76b0d94 2026-05-08 17:15:11,431 - lava_callback - INFO - Received callback for node 69fe19dde4d4e78cd76b0e34 INFO: 172.20.0.1:43896 - "POST /node/69fe19dde4d4e78cd76b0e34 HTTP/1.0" 202 Accepted 2026-05-08 17:15:11,437 - lava_callback - INFO - Starting async job submit for node 69fe19dde4d4e78cd76b0e34 2026-05-08 17:15:11,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:11,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19dde4d4e78cd76b0e34 HTTP/1.1" 200 None 2026-05-08 17:15:11,471 - lava_callback - DEBUG - Processing node 69fe19dde4d4e78cd76b0e34: baseline-arm64-pengutronix 2026-05-08 17:15:11,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:11,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:11,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fe19dde4d4e78cd76b0e34/log.txt.gz 2026-05-08 17:15:11,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:12,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:12,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fe19dde4d4e78cd76b0e34/lava-logs.yaml 2026-05-08 17:15:12,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:12,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:12,200 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fe19dde4d4e78cd76b0e34/lava_callback.json.gz 2026-05-08 17:15:12,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:12,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19dde4d4e78cd76b0e34 HTTP/1.1" 200 None 2026-05-08 17:15:12,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:12,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:15:12,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:12,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19dde4d4e78cd76b0e34 HTTP/1.1" 200 None 2026-05-08 17:15:12,298 - lava_callback - INFO - Completed processing callback for node 69fe19dde4d4e78cd76b0e34 INFO: 172.20.0.1:43912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43916 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:15:19,204 - lava_callback - INFO - Received callback for node 69fe19dee4d4e78cd76b0e37 INFO: 172.20.0.1:43920 - "POST /node/69fe19dee4d4e78cd76b0e37 HTTP/1.0" 202 Accepted 2026-05-08 17:15:19,211 - lava_callback - INFO - Starting async job submit for node 69fe19dee4d4e78cd76b0e37 2026-05-08 17:15:19,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:19,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19dee4d4e78cd76b0e37 HTTP/1.1" 200 None 2026-05-08 17:15:19,247 - lava_callback - DEBUG - Processing node 69fe19dee4d4e78cd76b0e37: baseline-arm64-pengutronix 2026-05-08 17:15:19,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:19,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:19,546 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fe19dee4d4e78cd76b0e37/log.txt.gz 2026-05-08 17:15:19,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:19,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:19,826 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fe19dee4d4e78cd76b0e37/lava-logs.yaml 2026-05-08 17:15:19,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:19,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:19,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fe19dee4d4e78cd76b0e37/lava_callback.json.gz 2026-05-08 17:15:19,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:19,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19dee4d4e78cd76b0e37 HTTP/1.1" 200 None 2026-05-08 17:15:19,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:19,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:15:19,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:20,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19dee4d4e78cd76b0e37 HTTP/1.1" 200 None 2026-05-08 17:15:20,015 - lava_callback - INFO - Completed processing callback for node 69fe19dee4d4e78cd76b0e37 2026-05-08 17:15:21,770 - lava_callback - INFO - Received callback for node 69fe1a17e4d4e78cd76b0f01 INFO: 172.20.0.1:50136 - "POST /node/69fe1a17e4d4e78cd76b0f01 HTTP/1.0" 202 Accepted 2026-05-08 17:15:21,776 - lava_callback - INFO - Starting async job submit for node 69fe1a17e4d4e78cd76b0f01 2026-05-08 17:15:21,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:21,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1a17e4d4e78cd76b0f01 HTTP/1.1" 200 None 2026-05-08 17:15:21,798 - lava_callback - DEBUG - Processing node 69fe1a17e4d4e78cd76b0f01: baseline-arm 2026-05-08 17:15:21,803 - lava_callback - WARNING - Failed to upload log 2026-05-08 17:15:21,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:21,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:21,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe1a17e4d4e78cd76b0f01/lava-logs.yaml 2026-05-08 17:15:21,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:21,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:21,964 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe1a17e4d4e78cd76b0f01/lava_callback.json.gz 2026-05-08 17:15:21,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:21,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1a17e4d4e78cd76b0f01 HTTP/1.1" 200 None 2026-05-08 17:15:21,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:21,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 17:15:21,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:22,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1a17e4d4e78cd76b0f01 HTTP/1.1" 200 None 2026-05-08 17:15:22,017 - lava_callback - INFO - Completed processing callback for node 69fe1a17e4d4e78cd76b0f01 2026-05-08 17:15:23,541 - lava_callback - INFO - Received callback for node 69fe19aae4d4e78cd76b0d8e INFO: 172.20.0.1:50140 - "POST /node/69fe19aae4d4e78cd76b0d8e HTTP/1.0" 202 Accepted 2026-05-08 17:15:23,550 - lava_callback - INFO - Starting async job submit for node 69fe19aae4d4e78cd76b0d8e 2026-05-08 17:15:23,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:23,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19aae4d4e78cd76b0d8e HTTP/1.1" 200 None 2026-05-08 17:15:23,588 - lava_callback - DEBUG - Processing node 69fe19aae4d4e78cd76b0d8e: baseline-nfs-arm64 2026-05-08 17:15:23,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:23,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:23,987 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19aae4d4e78cd76b0d8e/log.txt.gz 2026-05-08 17:15:24,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:24,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:24,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19aae4d4e78cd76b0d8e/lava-logs.yaml 2026-05-08 17:15:24,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:24,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:24,487 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19aae4d4e78cd76b0d8e/lava_callback.json.gz 2026-05-08 17:15:24,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:24,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19aae4d4e78cd76b0d8e HTTP/1.1" 200 None 2026-05-08 17:15:24,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:24,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:15:24,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:24,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19aae4d4e78cd76b0d8e HTTP/1.1" 200 None 2026-05-08 17:15:24,570 - lava_callback - INFO - Completed processing callback for node 69fe19aae4d4e78cd76b0d8e INFO: 172.20.0.1:50142 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:15:31,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:31,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-08 17:15:33,994 - lava_callback - INFO - Received callback for node 69fb7723df29cd80ecaa0862 INFO: 172.20.0.1:36460 - "POST /node/69fb7723df29cd80ecaa0862 HTTP/1.0" 202 Accepted 2026-05-08 17:15:34,000 - lava_callback - INFO - Starting async job submit for node 69fb7723df29cd80ecaa0862 2026-05-08 17:15:34,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:34,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7723df29cd80ecaa0862 HTTP/1.1" 200 None 2026-05-08 17:15:34,027 - lava_callback - DEBUG - Processing node 69fb7723df29cd80ecaa0862: baseline-arm64-baylibre 2026-05-08 17:15:34,028 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7723df29cd80ecaa0862 2026-05-08 17:15:34,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:34,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7723df29cd80ecaa0862 HTTP/1.1" 200 None 2026-05-08 17:15:34,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:34,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 17:15:34,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:34,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7723df29cd80ecaa0862 HTTP/1.1" 200 None 2026-05-08 17:15:34,076 - lava_callback - ERROR - Error processing callback for node 69fb7723df29cd80ecaa0862: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45150 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:15:50,531 - lava_callback - INFO - Received callback for node 69fe19cde4d4e78cd76b0e04 INFO: 172.20.0.1:50692 - "POST /node/69fe19cde4d4e78cd76b0e04 HTTP/1.0" 202 Accepted 2026-05-08 17:15:50,541 - lava_callback - INFO - Starting async job submit for node 69fe19cde4d4e78cd76b0e04 2026-05-08 17:15:50,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:50,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19cde4d4e78cd76b0e04 HTTP/1.1" 200 None 2026-05-08 17:15:50,585 - lava_callback - DEBUG - Processing node 69fe19cde4d4e78cd76b0e04: baseline-arm64-broonie 2026-05-08 17:15:50,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:50,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:50,981 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19cde4d4e78cd76b0e04/log.txt.gz 2026-05-08 17:15:51,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:50704 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:15:51,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:51,544 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19cde4d4e78cd76b0e04/lava-logs.yaml 2026-05-08 17:15:51,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:15:51,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:15:51,658 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19cde4d4e78cd76b0e04/lava_callback.json.gz 2026-05-08 17:15:51,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:51,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19cde4d4e78cd76b0e04 HTTP/1.1" 200 None 2026-05-08 17:15:51,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:51,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:15:51,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:15:51,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19cde4d4e78cd76b0e04 HTTP/1.1" 200 None 2026-05-08 17:15:51,738 - lava_callback - INFO - Completed processing callback for node 69fe19cde4d4e78cd76b0e04 INFO: 172.20.0.1:50710 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:16:01,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:01,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45044 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:16:11,492 - lava_callback - INFO - Received callback for node 69fe19d6e4d4e78cd76b0e1b INFO: 172.20.0.1:56248 - "POST /node/69fe19d6e4d4e78cd76b0e1b HTTP/1.0" 202 Accepted 2026-05-08 17:16:11,498 - lava_callback - INFO - Starting async job submit for node 69fe19d6e4d4e78cd76b0e1b 2026-05-08 17:16:11,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:11,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d6e4d4e78cd76b0e1b HTTP/1.1" 200 None 2026-05-08 17:16:11,535 - lava_callback - DEBUG - Processing node 69fe19d6e4d4e78cd76b0e1b: baseline-arm64-clabbe 2026-05-08 17:16:11,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:16:11,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:16:11,836 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fe19d6e4d4e78cd76b0e1b/log.txt.gz 2026-05-08 17:16:11,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:16:12,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:16:12,136 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fe19d6e4d4e78cd76b0e1b/lava-logs.yaml 2026-05-08 17:16:12,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:16:12,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:16:12,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fe19d6e4d4e78cd76b0e1b/lava_callback.json.gz 2026-05-08 17:16:12,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:12,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d6e4d4e78cd76b0e1b HTTP/1.1" 200 None 2026-05-08 17:16:12,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:12,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:16:12,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:12,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19d6e4d4e78cd76b0e1b HTTP/1.1" 200 None 2026-05-08 17:16:12,341 - lava_callback - INFO - Completed processing callback for node 69fe19d6e4d4e78cd76b0e1b INFO: 172.20.0.1:56250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54894 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:16:31,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:31,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48014 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:16:48,655 - lava_callback - INFO - Received callback for node 69fe19c8e4d4e78cd76b0df8 INFO: 172.20.0.1:48030 - "POST /node/69fe19c8e4d4e78cd76b0df8 HTTP/1.0" 202 Accepted 2026-05-08 17:16:48,666 - lava_callback - INFO - Starting async job submit for node 69fe19c8e4d4e78cd76b0df8 2026-05-08 17:16:48,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:48,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19c8e4d4e78cd76b0df8 HTTP/1.1" 200 None 2026-05-08 17:16:48,707 - lava_callback - DEBUG - Processing node 69fe19c8e4d4e78cd76b0df8: baseline-arm64-broonie 2026-05-08 17:16:49,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:16:49,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:16:49,119 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19c8e4d4e78cd76b0df8/log.txt.gz 2026-05-08 17:16:49,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:16:49,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:16:49,437 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19c8e4d4e78cd76b0df8/lava-logs.yaml 2026-05-08 17:16:49,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:16:49,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:16:49,552 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19c8e4d4e78cd76b0df8/lava_callback.json.gz 2026-05-08 17:16:49,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:49,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19c8e4d4e78cd76b0df8 HTTP/1.1" 200 None 2026-05-08 17:16:49,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:49,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:16:49,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:49,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19c8e4d4e78cd76b0df8 HTTP/1.1" 200 None 2026-05-08 17:16:49,626 - lava_callback - INFO - Completed processing callback for node 69fe19c8e4d4e78cd76b0df8 INFO: 172.20.0.1:34150 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:16:53,993 - lava_callback - INFO - Received callback for node 69fb7778df29cd80ecaa0886 INFO: 172.20.0.1:34156 - "POST /node/69fb7778df29cd80ecaa0886 HTTP/1.0" 202 Accepted 2026-05-08 17:16:53,999 - lava_callback - INFO - Starting async job submit for node 69fb7778df29cd80ecaa0886 2026-05-08 17:16:54,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:54,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7778df29cd80ecaa0886 HTTP/1.1" 200 None 2026-05-08 17:16:54,015 - lava_callback - DEBUG - Processing node 69fb7778df29cd80ecaa0886: baseline-arm64-baylibre 2026-05-08 17:16:54,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7778df29cd80ecaa0886 2026-05-08 17:16:54,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:54,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7778df29cd80ecaa0886 HTTP/1.1" 200 None 2026-05-08 17:16:54,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:54,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 17:16:54,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:16:54,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7778df29cd80ecaa0886 HTTP/1.1" 200 None 2026-05-08 17:16:54,067 - lava_callback - ERROR - Error processing callback for node 69fb7778df29cd80ecaa0886: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34162 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:17:01,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:17:01,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37554 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:17:16,798 - lava_callback - INFO - Received callback for node 69fe19e0e4d4e78cd76b0e3e INFO: 172.20.0.1:37562 - "POST /node/69fe19e0e4d4e78cd76b0e3e HTTP/1.0" 202 Accepted 2026-05-08 17:17:16,812 - lava_callback - INFO - Starting async job submit for node 69fe19e0e4d4e78cd76b0e3e 2026-05-08 17:17:16,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:17:16,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19e0e4d4e78cd76b0e3e HTTP/1.1" 200 None 2026-05-08 17:17:16,885 - lava_callback - DEBUG - Processing node 69fe19e0e4d4e78cd76b0e3e: baseline-arm64-foundriesio 2026-05-08 17:17:17,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:17:17,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:17:17,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe19e0e4d4e78cd76b0e3e/log.txt.gz 2026-05-08 17:17:18,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:17:18,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:17:18,462 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe19e0e4d4e78cd76b0e3e/lava-logs.yaml 2026-05-08 17:17:18,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:17:18,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:17:18,664 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe19e0e4d4e78cd76b0e3e/lava_callback.json.gz DEBUG: 69fe19e0e4d4e78cd76b0e3e Transitting job node result: pass -> incomplete 2026-05-08 17:17:18,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:17:18,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19e0e4d4e78cd76b0e3e HTTP/1.1" 200 None 2026-05-08 17:17:18,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:17:18,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:17:18,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:17:18,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19e0e4d4e78cd76b0e3e HTTP/1.1" 200 None 2026-05-08 17:17:18,765 - lava_callback - INFO - Completed processing callback for node 69fe19e0e4d4e78cd76b0e3e 2026-05-08 17:17:24,924 - lava_callback - INFO - Received callback for node 69fe19cae4d4e78cd76b0dfe INFO: 172.20.0.1:47338 - "POST /node/69fe19cae4d4e78cd76b0dfe HTTP/1.0" 202 Accepted 2026-05-08 17:17:24,934 - lava_callback - INFO - Starting async job submit for node 69fe19cae4d4e78cd76b0dfe 2026-05-08 17:17:24,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:17:24,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19cae4d4e78cd76b0dfe HTTP/1.1" 200 None 2026-05-08 17:17:24,979 - lava_callback - DEBUG - Processing node 69fe19cae4d4e78cd76b0dfe: baseline-arm64-broonie 2026-05-08 17:17:25,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:17:25,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:17:25,418 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19cae4d4e78cd76b0dfe/log.txt.gz 2026-05-08 17:17:25,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:17:25,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:17:25,784 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19cae4d4e78cd76b0dfe/lava-logs.yaml 2026-05-08 17:17:25,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:17:25,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:17:25,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19cae4d4e78cd76b0dfe/lava_callback.json.gz 2026-05-08 17:17:25,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:17:25,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19cae4d4e78cd76b0dfe HTTP/1.1" 200 None 2026-05-08 17:17:25,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:17:25,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:17:25,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:17:25,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19cae4d4e78cd76b0dfe HTTP/1.1" 200 None 2026-05-08 17:17:25,972 - lava_callback - INFO - Completed processing callback for node 69fe19cae4d4e78cd76b0dfe INFO: 172.20.0.1:47340 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:17:31,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:17:31,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58400 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 17:18:16,155 - lava_callback - INFO - Received callback for node 69fb77cfdf29cd80ecaa08ab INFO: 172.20.0.1:58410 - "POST /node/69fb77cfdf29cd80ecaa08ab HTTP/1.0" 202 Accepted 2026-05-08 17:18:16,161 - lava_callback - INFO - Starting async job submit for node 69fb77cfdf29cd80ecaa08ab 2026-05-08 17:18:16,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:18:16,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb77cfdf29cd80ecaa08ab HTTP/1.1" 200 None 2026-05-08 17:18:16,177 - lava_callback - DEBUG - Processing node 69fb77cfdf29cd80ecaa08ab: baseline-arm64-clabbe 2026-05-08 17:18:16,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb77cfdf29cd80ecaa08ab 2026-05-08 17:18:16,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:18:16,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb77cfdf29cd80ecaa08ab HTTP/1.1" 200 None 2026-05-08 17:18:16,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:18:16,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 17:18:16,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:18:16,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb77cfdf29cd80ecaa08ab HTTP/1.1" 200 None 2026-05-08 17:18:16,224 - lava_callback - ERROR - Error processing callback for node 69fb77cfdf29cd80ecaa08ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44404 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:19:34,156 - lava_callback - INFO - Received callback for node 69fb7817df29cd80ecaa08c5 INFO: 172.20.0.1:60938 - "POST /node/69fb7817df29cd80ecaa08c5 HTTP/1.0" 202 Accepted 2026-05-08 17:19:34,162 - lava_callback - INFO - Starting async job submit for node 69fb7817df29cd80ecaa08c5 2026-05-08 17:19:34,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:19:34,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7817df29cd80ecaa08c5 HTTP/1.1" 200 None 2026-05-08 17:19:34,177 - lava_callback - DEBUG - Processing node 69fb7817df29cd80ecaa08c5: baseline-arm64-baylibre 2026-05-08 17:19:34,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7817df29cd80ecaa08c5 2026-05-08 17:19:34,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:19:34,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7817df29cd80ecaa08c5 HTTP/1.1" 200 None 2026-05-08 17:19:34,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:19:34,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-08 17:19:34,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:19:34,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7817df29cd80ecaa08c5 HTTP/1.1" 200 None 2026-05-08 17:19:34,230 - lava_callback - ERROR - Error processing callback for node 69fb7817df29cd80ecaa08c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39054 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:20:54,254 - lava_callback - INFO - Received callback for node 69fb7863df29cd80ecaa0902 INFO: 172.20.0.1:39064 - "POST /node/69fb7863df29cd80ecaa0902 HTTP/1.0" 202 Accepted 2026-05-08 17:20:54,260 - lava_callback - INFO - Starting async job submit for node 69fb7863df29cd80ecaa0902 2026-05-08 17:20:54,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:20:54,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7863df29cd80ecaa0902 HTTP/1.1" 200 None 2026-05-08 17:20:54,277 - lava_callback - DEBUG - Processing node 69fb7863df29cd80ecaa0902: baseline-arm64-baylibre 2026-05-08 17:20:54,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7863df29cd80ecaa0902 2026-05-08 17:20:54,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:20:54,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7863df29cd80ecaa0902 HTTP/1.1" 200 None 2026-05-08 17:20:54,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:20:54,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-08 17:20:54,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:20:54,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7863df29cd80ecaa0902 HTTP/1.1" 200 None 2026-05-08 17:20:54,368 - lava_callback - ERROR - Error processing callback for node 69fb7863df29cd80ecaa0902: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 17:20:55,301 - lava_callback - INFO - Received callback for node 69fe19a9e4d4e78cd76b0d8b INFO: 172.20.0.1:39066 - "POST /node/69fe19a9e4d4e78cd76b0d8b HTTP/1.0" 202 Accepted 2026-05-08 17:20:55,308 - lava_callback - INFO - Starting async job submit for node 69fe19a9e4d4e78cd76b0d8b 2026-05-08 17:20:55,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:20:55,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a9e4d4e78cd76b0d8b HTTP/1.1" 200 None 2026-05-08 17:20:55,364 - lava_callback - DEBUG - Processing node 69fe19a9e4d4e78cd76b0d8b: baseline-arm64 2026-05-08 17:20:55,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:20:55,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:20:55,944 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a9e4d4e78cd76b0d8b/log.txt.gz 2026-05-08 17:20:56,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:20:56,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:20:56,389 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a9e4d4e78cd76b0d8b/lava-logs.yaml 2026-05-08 17:20:56,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:39074 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:20:56,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:20:56,548 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a9e4d4e78cd76b0d8b/lava_callback.json.gz DEBUG: Setup failed for 69fe19a9e4d4e78cd76b0d8b. Transitting job node result: incomplete -> fail 2026-05-08 17:20:56,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:20:56,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a9e4d4e78cd76b0d8b HTTP/1.1" 200 None 2026-05-08 17:20:56,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:20:56,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:20:56,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:20:56,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19a9e4d4e78cd76b0d8b HTTP/1.1" 200 None 2026-05-08 17:20:56,836 - lava_callback - INFO - Completed processing callback for node 69fe19a9e4d4e78cd76b0d8b 2026-05-08 17:21:01,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:21:01,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45422 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:21:07,144 - lava_callback - INFO - Received callback for node 69fe19b5e4d4e78cd76b0dac INFO: 172.20.0.1:45434 - "POST /node/69fe19b5e4d4e78cd76b0dac HTTP/1.0" 202 Accepted 2026-05-08 17:21:07,154 - lava_callback - INFO - Starting async job submit for node 69fe19b5e4d4e78cd76b0dac 2026-05-08 17:21:07,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:21:07,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b5e4d4e78cd76b0dac HTTP/1.1" 200 None 2026-05-08 17:21:07,233 - lava_callback - DEBUG - Processing node 69fe19b5e4d4e78cd76b0dac: baseline-nfs-arm64 2026-05-08 17:21:07,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:21:08,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:21:08,077 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b5e4d4e78cd76b0dac/log.txt.gz 2026-05-08 17:21:08,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:21:08,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:21:08,700 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b5e4d4e78cd76b0dac/lava-logs.yaml 2026-05-08 17:21:08,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:21:08,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:21:08,846 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b5e4d4e78cd76b0dac/lava_callback.json.gz 2026-05-08 17:21:08,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:21:08,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b5e4d4e78cd76b0dac HTTP/1.1" 200 None 2026-05-08 17:21:08,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:21:08,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:21:08,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:21:09,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19b5e4d4e78cd76b0dac HTTP/1.1" 200 None 2026-05-08 17:21:09,020 - lava_callback - INFO - Completed processing callback for node 69fe19b5e4d4e78cd76b0dac INFO: 172.20.0.1:48042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44532 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:21:31,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:21:31,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37122 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:21:54,231 - lava_callback - INFO - Received callback for node 69fb78abdf29cd80ecaa0936 INFO: 172.20.0.1:37124 - "POST /node/69fb78abdf29cd80ecaa0936 HTTP/1.0" 202 Accepted 2026-05-08 17:21:54,238 - lava_callback - INFO - Starting async job submit for node 69fb78abdf29cd80ecaa0936 2026-05-08 17:21:54,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:21:54,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb78abdf29cd80ecaa0936 HTTP/1.1" 200 None 2026-05-08 17:21:54,270 - lava_callback - DEBUG - Processing node 69fb78abdf29cd80ecaa0936: baseline-arm64-baylibre 2026-05-08 17:21:54,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb78abdf29cd80ecaa0936 2026-05-08 17:21:54,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:21:54,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb78abdf29cd80ecaa0936 HTTP/1.1" 200 None 2026-05-08 17:21:54,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:21:54,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-08 17:21:54,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:21:54,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb78abdf29cd80ecaa0936 HTTP/1.1" 200 None 2026-05-08 17:21:54,322 - lava_callback - ERROR - Error processing callback for node 69fb78abdf29cd80ecaa0936: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49606 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:23:14,350 - lava_callback - INFO - Received callback for node 69fb78fcdf29cd80ecaa095b INFO: 172.20.0.1:49278 - "POST /node/69fb78fcdf29cd80ecaa095b HTTP/1.0" 202 Accepted 2026-05-08 17:23:14,356 - lava_callback - INFO - Starting async job submit for node 69fb78fcdf29cd80ecaa095b 2026-05-08 17:23:14,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:23:14,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb78fcdf29cd80ecaa095b HTTP/1.1" 200 None 2026-05-08 17:23:14,372 - lava_callback - DEBUG - Processing node 69fb78fcdf29cd80ecaa095b: baseline-arm64-baylibre 2026-05-08 17:23:14,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb78fcdf29cd80ecaa095b 2026-05-08 17:23:14,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:23:14,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb78fcdf29cd80ecaa095b HTTP/1.1" 200 None 2026-05-08 17:23:14,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:23:14,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-08 17:23:14,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:23:14,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb78fcdf29cd80ecaa095b HTTP/1.1" 200 None 2026-05-08 17:23:14,440 - lava_callback - ERROR - Error processing callback for node 69fb78fcdf29cd80ecaa095b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59534 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:24:34,421 - lava_callback - INFO - Received callback for node 69fb794bdf29cd80ecaa097b INFO: 172.20.0.1:53040 - "POST /node/69fb794bdf29cd80ecaa097b HTTP/1.0" 202 Accepted 2026-05-08 17:24:34,427 - lava_callback - INFO - Starting async job submit for node 69fb794bdf29cd80ecaa097b 2026-05-08 17:24:34,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:24:34,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb794bdf29cd80ecaa097b HTTP/1.1" 200 None 2026-05-08 17:24:34,446 - lava_callback - DEBUG - Processing node 69fb794bdf29cd80ecaa097b: baseline-arm64-baylibre 2026-05-08 17:24:34,446 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb794bdf29cd80ecaa097b 2026-05-08 17:24:34,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:24:34,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb794bdf29cd80ecaa097b HTTP/1.1" 200 None 2026-05-08 17:24:34,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:24:34,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-08 17:24:34,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:24:34,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb794bdf29cd80ecaa097b HTTP/1.1" 200 None 2026-05-08 17:24:34,498 - lava_callback - ERROR - Error processing callback for node 69fb794bdf29cd80ecaa097b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46442 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:25:54,512 - lava_callback - INFO - Received callback for node 69fb7999df29cd80ecaa09a1 INFO: 172.20.0.1:46444 - "POST /node/69fb7999df29cd80ecaa09a1 HTTP/1.0" 202 Accepted 2026-05-08 17:25:54,518 - lava_callback - INFO - Starting async job submit for node 69fb7999df29cd80ecaa09a1 2026-05-08 17:25:54,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:25:54,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7999df29cd80ecaa09a1 HTTP/1.1" 200 None 2026-05-08 17:25:54,534 - lava_callback - DEBUG - Processing node 69fb7999df29cd80ecaa09a1: baseline-arm64-baylibre 2026-05-08 17:25:54,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7999df29cd80ecaa09a1 2026-05-08 17:25:54,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:25:54,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7999df29cd80ecaa09a1 HTTP/1.1" 200 None 2026-05-08 17:25:54,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:25:54,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-08 17:25:54,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:25:54,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7999df29cd80ecaa09a1 HTTP/1.1" 200 None 2026-05-08 17:25:54,597 - lava_callback - ERROR - Error processing callback for node 69fb7999df29cd80ecaa09a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52402 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:27:16,569 - lava_callback - INFO - Received callback for node 69fb79eedf29cd80ecaa09c9 INFO: 172.20.0.1:52418 - "POST /node/69fb79eedf29cd80ecaa09c9 HTTP/1.0" 202 Accepted 2026-05-08 17:27:16,574 - lava_callback - INFO - Starting async job submit for node 69fb79eedf29cd80ecaa09c9 2026-05-08 17:27:16,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:27:16,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb79eedf29cd80ecaa09c9 HTTP/1.1" 200 None 2026-05-08 17:27:16,594 - lava_callback - DEBUG - Processing node 69fb79eedf29cd80ecaa09c9: baseline-arm64-clabbe 2026-05-08 17:27:16,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb79eedf29cd80ecaa09c9 2026-05-08 17:27:16,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:27:16,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb79eedf29cd80ecaa09c9 HTTP/1.1" 200 None 2026-05-08 17:27:16,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:27:16,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-08 17:27:16,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:27:16,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb79eedf29cd80ecaa09c9 HTTP/1.1" 200 None 2026-05-08 17:27:16,640 - lava_callback - ERROR - Error processing callback for node 69fb79eedf29cd80ecaa09c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51904 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:27:41,185 - lava_callback - INFO - Received callback for node 69fe1cbae4d4e78cd76b10b5 INFO: 172.20.0.1:45126 - "POST /node/69fe1cbae4d4e78cd76b10b5 HTTP/1.0" 202 Accepted 2026-05-08 17:27:41,191 - lava_callback - INFO - Starting async job submit for node 69fe1cbae4d4e78cd76b10b5 2026-05-08 17:27:41,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:27:41,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1cbae4d4e78cd76b10b5 HTTP/1.1" 200 None 2026-05-08 17:27:41,243 - lava_callback - DEBUG - Processing node 69fe1cbae4d4e78cd76b10b5: baseline-x86 2026-05-08 17:27:41,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:27:41,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:27:41,624 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fe1cbae4d4e78cd76b10b5/log.txt.gz 2026-05-08 17:27:41,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:27:41,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:27:41,927 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fe1cbae4d4e78cd76b10b5/lava-logs.yaml 2026-05-08 17:27:41,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:27:42,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:27:42,034 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fe1cbae4d4e78cd76b10b5/lava_callback.json.gz 2026-05-08 17:27:42,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:27:42,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1cbae4d4e78cd76b10b5 HTTP/1.1" 200 None 2026-05-08 17:27:42,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:27:42,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d56e4d4e78cd76adcf2 HTTP/1.1" 200 None 2026-05-08 17:27:42,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:27:42,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1cbae4d4e78cd76b10b5 HTTP/1.1" 200 None 2026-05-08 17:27:42,112 - lava_callback - INFO - Completed processing callback for node 69fe1cbae4d4e78cd76b10b5 INFO: 172.20.0.1:45140 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:27:47,395 - lava_callback - INFO - Received callback for node 69fe19cbe4d4e78cd76b0e01 INFO: 172.20.0.1:45156 - "POST /node/69fe19cbe4d4e78cd76b0e01 HTTP/1.0" 202 Accepted 2026-05-08 17:27:47,403 - lava_callback - INFO - Starting async job submit for node 69fe19cbe4d4e78cd76b0e01 2026-05-08 17:27:47,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:27:47,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19cbe4d4e78cd76b0e01 HTTP/1.1" 200 None 2026-05-08 17:27:47,459 - lava_callback - DEBUG - Processing node 69fe19cbe4d4e78cd76b0e01: baseline-arm64-broonie 2026-05-08 17:27:47,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:27:47,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:27:47,810 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19cbe4d4e78cd76b0e01/log.txt.gz 2026-05-08 17:27:47,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:27:48,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:27:48,125 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19cbe4d4e78cd76b0e01/lava-logs.yaml 2026-05-08 17:27:48,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:27:48,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:27:48,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19cbe4d4e78cd76b0e01/lava_callback.json.gz 2026-05-08 17:27:48,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:27:48,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19cbe4d4e78cd76b0e01 HTTP/1.1" 200 None 2026-05-08 17:27:48,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:27:48,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:27:48,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:27:48,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19cbe4d4e78cd76b0e01 HTTP/1.1" 200 None 2026-05-08 17:27:48,335 - lava_callback - INFO - Completed processing callback for node 69fe19cbe4d4e78cd76b0e01 INFO: 172.20.0.1:34396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34410 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:28:01,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:28:01,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49190 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:28:36,611 - lava_callback - INFO - Received callback for node 69fb7a40df29cd80ecaa09f4 INFO: 172.20.0.1:49202 - "POST /node/69fb7a40df29cd80ecaa09f4 HTTP/1.0" 202 Accepted 2026-05-08 17:28:36,616 - lava_callback - INFO - Starting async job submit for node 69fb7a40df29cd80ecaa09f4 2026-05-08 17:28:36,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:28:36,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7a40df29cd80ecaa09f4 HTTP/1.1" 200 None 2026-05-08 17:28:36,631 - lava_callback - DEBUG - Processing node 69fb7a40df29cd80ecaa09f4: baseline-arm64-clabbe 2026-05-08 17:28:36,631 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7a40df29cd80ecaa09f4 2026-05-08 17:28:36,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:28:36,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7a40df29cd80ecaa09f4 HTTP/1.1" 200 None 2026-05-08 17:28:36,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:28:36,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-08 17:28:36,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:28:36,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7a40df29cd80ecaa09f4 HTTP/1.1" 200 None 2026-05-08 17:28:36,689 - lava_callback - ERROR - Error processing callback for node 69fb7a40df29cd80ecaa09f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51838 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:29:56,657 - lava_callback - INFO - Received callback for node 69fb7a8ddf29cd80ecaa0a27 INFO: 172.20.0.1:51842 - "POST /node/69fb7a8ddf29cd80ecaa0a27 HTTP/1.0" 202 Accepted 2026-05-08 17:29:56,667 - lava_callback - INFO - Starting async job submit for node 69fb7a8ddf29cd80ecaa0a27 2026-05-08 17:29:56,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:29:56,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7a8ddf29cd80ecaa0a27 HTTP/1.1" 200 None 2026-05-08 17:29:56,682 - lava_callback - DEBUG - Processing node 69fb7a8ddf29cd80ecaa0a27: baseline-arm64-clabbe 2026-05-08 17:29:56,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7a8ddf29cd80ecaa0a27 2026-05-08 17:29:56,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:29:56,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7a8ddf29cd80ecaa0a27 HTTP/1.1" 200 None 2026-05-08 17:29:56,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:29:56,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-08 17:29:56,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:29:56,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7a8ddf29cd80ecaa0a27 HTTP/1.1" 200 None 2026-05-08 17:29:56,735 - lava_callback - ERROR - Error processing callback for node 69fb7a8ddf29cd80ecaa0a27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34120 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:31:16,689 - lava_callback - INFO - Received callback for node 69fb7ad5df29cd80ecaa0a5b INFO: 172.20.0.1:34126 - "POST /node/69fb7ad5df29cd80ecaa0a5b HTTP/1.0" 202 Accepted 2026-05-08 17:31:16,694 - lava_callback - INFO - Starting async job submit for node 69fb7ad5df29cd80ecaa0a5b 2026-05-08 17:31:16,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:31:16,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ad5df29cd80ecaa0a5b HTTP/1.1" 200 None 2026-05-08 17:31:16,714 - lava_callback - DEBUG - Processing node 69fb7ad5df29cd80ecaa0a5b: baseline-arm64-clabbe 2026-05-08 17:31:16,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7ad5df29cd80ecaa0a5b 2026-05-08 17:31:16,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:31:16,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7ad5df29cd80ecaa0a5b HTTP/1.1" 200 None 2026-05-08 17:31:16,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:31:16,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-08 17:31:16,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:31:16,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7ad5df29cd80ecaa0a5b HTTP/1.1" 200 None 2026-05-08 17:31:16,768 - lava_callback - ERROR - Error processing callback for node 69fb7ad5df29cd80ecaa0a5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46680 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:32:36,724 - lava_callback - INFO - Received callback for node 69fb7b26df29cd80ecaa0a8d INFO: 172.20.0.1:46692 - "POST /node/69fb7b26df29cd80ecaa0a8d HTTP/1.0" 202 Accepted 2026-05-08 17:32:36,729 - lava_callback - INFO - Starting async job submit for node 69fb7b26df29cd80ecaa0a8d 2026-05-08 17:32:36,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:32:36,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7b26df29cd80ecaa0a8d HTTP/1.1" 200 None 2026-05-08 17:32:36,745 - lava_callback - DEBUG - Processing node 69fb7b26df29cd80ecaa0a8d: baseline-arm64-clabbe 2026-05-08 17:32:36,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7b26df29cd80ecaa0a8d 2026-05-08 17:32:36,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:32:36,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7b26df29cd80ecaa0a8d HTTP/1.1" 200 None 2026-05-08 17:32:36,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:32:36,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-08 17:32:36,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:32:36,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7b26df29cd80ecaa0a8d HTTP/1.1" 200 None 2026-05-08 17:32:36,801 - lava_callback - ERROR - Error processing callback for node 69fb7b26df29cd80ecaa0a8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49408 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:33:17,218 - lava_callback - INFO - Received callback for node 69fe19ade4d4e78cd76b0d97 INFO: 172.20.0.1:49410 - "POST /node/69fe19ade4d4e78cd76b0d97 HTTP/1.0" 202 Accepted 2026-05-08 17:33:17,227 - lava_callback - INFO - Starting async job submit for node 69fe19ade4d4e78cd76b0d97 2026-05-08 17:33:17,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:33:17,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19ade4d4e78cd76b0d97 HTTP/1.1" 200 None 2026-05-08 17:33:17,290 - lava_callback - DEBUG - Processing node 69fe19ade4d4e78cd76b0d97: baseline-nfs-arm64 2026-05-08 17:33:18,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:33:18,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:33:18,751 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19ade4d4e78cd76b0d97/log.txt.gz 2026-05-08 17:33:19,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:33:19,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:33:19,552 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19ade4d4e78cd76b0d97/lava-logs.yaml 2026-05-08 17:33:19,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:33:19,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:33:19,733 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19ade4d4e78cd76b0d97/lava_callback.json.gz DEBUG: Setup failed for 69fe19ade4d4e78cd76b0d97. Transitting job node result: incomplete -> fail 2026-05-08 17:33:19,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:33:19,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19ade4d4e78cd76b0d97 HTTP/1.1" 200 None 2026-05-08 17:33:19,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:33:19,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:33:19,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:33:19,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19ade4d4e78cd76b0d97 HTTP/1.1" 200 None 2026-05-08 17:33:20,018 - lava_callback - INFO - Completed processing callback for node 69fe19ade4d4e78cd76b0d97 INFO: 172.20.0.1:37354 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:33:31,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:33:31,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43118 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:33:56,740 - lava_callback - INFO - Received callback for node 69fb7b75df29cd80ecaa0ab6 INFO: 172.20.0.1:43134 - "POST /node/69fb7b75df29cd80ecaa0ab6 HTTP/1.0" 202 Accepted 2026-05-08 17:33:56,747 - lava_callback - INFO - Starting async job submit for node 69fb7b75df29cd80ecaa0ab6 2026-05-08 17:33:56,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:33:56,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7b75df29cd80ecaa0ab6 HTTP/1.1" 200 None 2026-05-08 17:33:56,765 - lava_callback - DEBUG - Processing node 69fb7b75df29cd80ecaa0ab6: baseline-arm64-clabbe 2026-05-08 17:33:56,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7b75df29cd80ecaa0ab6 2026-05-08 17:33:56,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:33:56,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7b75df29cd80ecaa0ab6 HTTP/1.1" 200 None 2026-05-08 17:33:56,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:33:56,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-08 17:33:56,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:33:56,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7b75df29cd80ecaa0ab6 HTTP/1.1" 200 None 2026-05-08 17:33:56,821 - lava_callback - ERROR - Error processing callback for node 69fb7b75df29cd80ecaa0ab6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54924 - "GET /node/69933b7531166481c8ded51d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35482 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:35:16,829 - lava_callback - INFO - Received callback for node 69fb7bc2df29cd80ecaa0ad4 INFO: 172.20.0.1:35484 - "POST /node/69fb7bc2df29cd80ecaa0ad4 HTTP/1.0" 202 Accepted 2026-05-08 17:35:16,835 - lava_callback - INFO - Starting async job submit for node 69fb7bc2df29cd80ecaa0ad4 2026-05-08 17:35:16,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:35:16,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7bc2df29cd80ecaa0ad4 HTTP/1.1" 200 None 2026-05-08 17:35:16,849 - lava_callback - DEBUG - Processing node 69fb7bc2df29cd80ecaa0ad4: baseline-arm64-clabbe 2026-05-08 17:35:16,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7bc2df29cd80ecaa0ad4 2026-05-08 17:35:16,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:35:16,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7bc2df29cd80ecaa0ad4 HTTP/1.1" 200 None 2026-05-08 17:35:16,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:35:16,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 17:35:16,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:35:16,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7bc2df29cd80ecaa0ad4 HTTP/1.1" 200 None 2026-05-08 17:35:16,914 - lava_callback - ERROR - Error processing callback for node 69fb7bc2df29cd80ecaa0ad4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55988 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:36:36,869 - lava_callback - INFO - Received callback for node 69fb7c11df29cd80ecaa0afa INFO: 172.20.0.1:55998 - "POST /node/69fb7c11df29cd80ecaa0afa HTTP/1.0" 202 Accepted 2026-05-08 17:36:36,874 - lava_callback - INFO - Starting async job submit for node 69fb7c11df29cd80ecaa0afa 2026-05-08 17:36:36,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:36:36,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c11df29cd80ecaa0afa HTTP/1.1" 200 None 2026-05-08 17:36:36,893 - lava_callback - DEBUG - Processing node 69fb7c11df29cd80ecaa0afa: baseline-arm64-clabbe 2026-05-08 17:36:36,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c11df29cd80ecaa0afa 2026-05-08 17:36:36,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:36:36,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c11df29cd80ecaa0afa HTTP/1.1" 200 None 2026-05-08 17:36:36,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:36:36,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 17:36:36,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:36:36,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c11df29cd80ecaa0afa HTTP/1.1" 200 None 2026-05-08 17:36:36,940 - lava_callback - ERROR - Error processing callback for node 69fb7c11df29cd80ecaa0afa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46686 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:37:49,474 - lava_callback - INFO - Received callback for node 69fe19cfe4d4e78cd76b0e07 INFO: 172.20.0.1:46692 - "POST /node/69fe19cfe4d4e78cd76b0e07 HTTP/1.0" 202 Accepted 2026-05-08 17:37:49,481 - lava_callback - INFO - Starting async job submit for node 69fe19cfe4d4e78cd76b0e07 2026-05-08 17:37:49,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:37:49,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19cfe4d4e78cd76b0e07 HTTP/1.1" 200 None 2026-05-08 17:37:49,519 - lava_callback - DEBUG - Processing node 69fe19cfe4d4e78cd76b0e07: baseline-arm64-broonie 2026-05-08 17:37:49,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:37:49,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:37:49,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19cfe4d4e78cd76b0e07/log.txt.gz 2026-05-08 17:37:50,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:37:50,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:37:50,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19cfe4d4e78cd76b0e07/lava-logs.yaml 2026-05-08 17:37:50,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:37:50,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:37:50,347 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19cfe4d4e78cd76b0e07/lava_callback.json.gz 2026-05-08 17:37:50,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:37:50,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19cfe4d4e78cd76b0e07 HTTP/1.1" 200 None 2026-05-08 17:37:50,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:37:50,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:37:50,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:37:50,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19cfe4d4e78cd76b0e07 HTTP/1.1" 200 None 2026-05-08 17:37:50,421 - lava_callback - INFO - Completed processing callback for node 69fe19cfe4d4e78cd76b0e07 INFO: 172.20.0.1:52296 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:37:55,493 - lava_callback - INFO - Received callback for node 69fb7c70df29cd80ecaa0b43 INFO: 172.20.0.1:52302 - "POST /node/69fb7c70df29cd80ecaa0b43 HTTP/1.0" 202 Accepted 2026-05-08 17:37:55,499 - lava_callback - INFO - Starting async job submit for node 69fb7c70df29cd80ecaa0b43 2026-05-08 17:37:55,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:37:55,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c70df29cd80ecaa0b43 HTTP/1.1" 200 None 2026-05-08 17:37:55,540 - lava_callback - DEBUG - Processing node 69fb7c70df29cd80ecaa0b43: baseline-arm-baylibre 2026-05-08 17:37:55,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c70df29cd80ecaa0b43 2026-05-08 17:37:55,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:37:55,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c70df29cd80ecaa0b43 HTTP/1.1" 200 None 2026-05-08 17:37:55,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:37:55,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-08 17:37:55,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:37:55,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c70df29cd80ecaa0b43 HTTP/1.1" 200 None 2026-05-08 17:37:55,850 - lava_callback - ERROR - Error processing callback for node 69fb7c70df29cd80ecaa0b43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52306 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:37:57,020 - lava_callback - INFO - Received callback for node 69fb7c60df29cd80ecaa0b26 INFO: 172.20.0.1:52318 - "POST /node/69fb7c60df29cd80ecaa0b26 HTTP/1.0" 202 Accepted 2026-05-08 17:37:57,026 - lava_callback - INFO - Starting async job submit for node 69fb7c60df29cd80ecaa0b26 2026-05-08 17:37:57,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:37:57,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c60df29cd80ecaa0b26 HTTP/1.1" 200 None 2026-05-08 17:37:57,041 - lava_callback - DEBUG - Processing node 69fb7c60df29cd80ecaa0b26: baseline-arm64-clabbe 2026-05-08 17:37:57,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c60df29cd80ecaa0b26 2026-05-08 17:37:57,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:37:57,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c60df29cd80ecaa0b26 HTTP/1.1" 200 None 2026-05-08 17:37:57,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:37:57,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 17:37:57,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:37:57,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c60df29cd80ecaa0b26 HTTP/1.1" 200 None 2026-05-08 17:37:57,103 - lava_callback - ERROR - Error processing callback for node 69fb7c60df29cd80ecaa0b26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 17:38:01,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:01,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48736 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 17:38:15,156 - lava_callback - INFO - Received callback for node 69fb7c72df29cd80ecaa0b46 INFO: 172.20.0.1:48744 - "POST /node/69fb7c72df29cd80ecaa0b46 HTTP/1.0" 202 Accepted 2026-05-08 17:38:15,162 - lava_callback - INFO - Starting async job submit for node 69fb7c72df29cd80ecaa0b46 2026-05-08 17:38:15,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:15,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c72df29cd80ecaa0b46 HTTP/1.1" 200 None 2026-05-08 17:38:15,181 - lava_callback - DEBUG - Processing node 69fb7c72df29cd80ecaa0b46: baseline-arm-baylibre 2026-05-08 17:38:15,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c72df29cd80ecaa0b46 2026-05-08 17:38:15,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:15,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c72df29cd80ecaa0b46 HTTP/1.1" 200 None 2026-05-08 17:38:15,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:15,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-08 17:38:15,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:15,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c72df29cd80ecaa0b46 HTTP/1.1" 200 None 2026-05-08 17:38:15,237 - lava_callback - ERROR - Error processing callback for node 69fb7c72df29cd80ecaa0b46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 17:38:15,843 - lava_callback - INFO - Received callback for node 69fb7c73df29cd80ecaa0b49 INFO: 172.20.0.1:48758 - "POST /node/69fb7c73df29cd80ecaa0b49 HTTP/1.0" 202 Accepted 2026-05-08 17:38:15,850 - lava_callback - INFO - Starting async job submit for node 69fb7c73df29cd80ecaa0b49 2026-05-08 17:38:15,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:15,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c73df29cd80ecaa0b49 HTTP/1.1" 200 None 2026-05-08 17:38:15,870 - lava_callback - DEBUG - Processing node 69fb7c73df29cd80ecaa0b49: baseline-arm-baylibre 2026-05-08 17:38:15,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c73df29cd80ecaa0b49 2026-05-08 17:38:15,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:15,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c73df29cd80ecaa0b49 HTTP/1.1" 200 None 2026-05-08 17:38:15,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:15,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-08 17:38:15,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:15,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c73df29cd80ecaa0b49 HTTP/1.1" 200 None 2026-05-08 17:38:15,929 - lava_callback - ERROR - Error processing callback for node 69fb7c73df29cd80ecaa0b49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48766 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:38:16,581 - lava_callback - INFO - Received callback for node 69fb7c74df29cd80ecaa0b4c INFO: 172.20.0.1:48782 - "POST /node/69fb7c74df29cd80ecaa0b4c HTTP/1.0" 202 Accepted 2026-05-08 17:38:16,587 - lava_callback - INFO - Starting async job submit for node 69fb7c74df29cd80ecaa0b4c 2026-05-08 17:38:16,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:16,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c74df29cd80ecaa0b4c HTTP/1.1" 200 None 2026-05-08 17:38:16,602 - lava_callback - DEBUG - Processing node 69fb7c74df29cd80ecaa0b4c: baseline-arm-baylibre 2026-05-08 17:38:16,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c74df29cd80ecaa0b4c 2026-05-08 17:38:16,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:16,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c74df29cd80ecaa0b4c HTTP/1.1" 200 None 2026-05-08 17:38:16,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:16,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-08 17:38:16,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:16,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c74df29cd80ecaa0b4c HTTP/1.1" 200 None 2026-05-08 17:38:16,650 - lava_callback - ERROR - Error processing callback for node 69fb7c74df29cd80ecaa0b4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 17:38:16,914 - lava_callback - INFO - Received callback for node 69fb7c7fdf29cd80ecaa0b8f INFO: 172.20.0.1:48792 - "POST /node/69fb7c7fdf29cd80ecaa0b8f HTTP/1.0" 202 Accepted 2026-05-08 17:38:16,920 - lava_callback - INFO - Starting async job submit for node 69fb7c7fdf29cd80ecaa0b8f 2026-05-08 17:38:16,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:16,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c7fdf29cd80ecaa0b8f HTTP/1.1" 200 None 2026-05-08 17:38:16,935 - lava_callback - DEBUG - Processing node 69fb7c7fdf29cd80ecaa0b8f: baseline-arm-clabbe 2026-05-08 17:38:16,935 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c7fdf29cd80ecaa0b8f 2026-05-08 17:38:16,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:16,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c7fdf29cd80ecaa0b8f HTTP/1.1" 200 None 2026-05-08 17:38:16,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:16,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-08 17:38:16,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:16,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c7fdf29cd80ecaa0b8f HTTP/1.1" 200 None 2026-05-08 17:38:16,990 - lava_callback - ERROR - Error processing callback for node 69fb7c7fdf29cd80ecaa0b8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 17:38:17,252 - lava_callback - INFO - Received callback for node 69fb7c77df29cd80ecaa0b57 INFO: 172.20.0.1:48808 - "POST /node/69fb7c77df29cd80ecaa0b57 HTTP/1.0" 202 Accepted 2026-05-08 17:38:17,258 - lava_callback - INFO - Starting async job submit for node 69fb7c77df29cd80ecaa0b57 2026-05-08 17:38:17,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:17,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c77df29cd80ecaa0b57 HTTP/1.1" 200 None 2026-05-08 17:38:17,272 - lava_callback - DEBUG - Processing node 69fb7c77df29cd80ecaa0b57: baseline-arm-baylibre 2026-05-08 17:38:17,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c77df29cd80ecaa0b57 2026-05-08 17:38:17,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:17,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c77df29cd80ecaa0b57 HTTP/1.1" 200 None 2026-05-08 17:38:17,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:17,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-08 17:38:17,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:17,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c77df29cd80ecaa0b57 HTTP/1.1" 200 None 2026-05-08 17:38:17,318 - lava_callback - ERROR - Error processing callback for node 69fb7c77df29cd80ecaa0b57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 17:38:17,589 - lava_callback - INFO - Received callback for node 69fb7c83df29cd80ecaa0b9c INFO: 172.20.0.1:48814 - "POST /node/69fb7c83df29cd80ecaa0b9c HTTP/1.0" 202 Accepted 2026-05-08 17:38:17,595 - lava_callback - INFO - Starting async job submit for node 69fb7c83df29cd80ecaa0b9c 2026-05-08 17:38:17,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:17,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c83df29cd80ecaa0b9c HTTP/1.1" 200 None 2026-05-08 17:38:17,610 - lava_callback - DEBUG - Processing node 69fb7c83df29cd80ecaa0b9c: baseline-arm-clabbe 2026-05-08 17:38:17,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c83df29cd80ecaa0b9c 2026-05-08 17:38:17,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:17,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c83df29cd80ecaa0b9c HTTP/1.1" 200 None 2026-05-08 17:38:17,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:17,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-08 17:38:17,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:17,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c83df29cd80ecaa0b9c HTTP/1.1" 200 None 2026-05-08 17:38:17,668 - lava_callback - ERROR - Error processing callback for node 69fb7c83df29cd80ecaa0b9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 17:38:17,936 - lava_callback - INFO - Received callback for node 69fb7c78df29cd80ecaa0b5a INFO: 172.20.0.1:48822 - "POST /node/69fb7c78df29cd80ecaa0b5a HTTP/1.0" 202 Accepted 2026-05-08 17:38:17,942 - lava_callback - INFO - Starting async job submit for node 69fb7c78df29cd80ecaa0b5a 2026-05-08 17:38:17,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:17,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c78df29cd80ecaa0b5a HTTP/1.1" 200 None 2026-05-08 17:38:17,960 - lava_callback - DEBUG - Processing node 69fb7c78df29cd80ecaa0b5a: baseline-arm-baylibre 2026-05-08 17:38:17,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c78df29cd80ecaa0b5a 2026-05-08 17:38:17,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:17,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c78df29cd80ecaa0b5a HTTP/1.1" 200 None 2026-05-08 17:38:17,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:18,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-08 17:38:18,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:18,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c78df29cd80ecaa0b5a HTTP/1.1" 200 None 2026-05-08 17:38:18,034 - lava_callback - ERROR - Error processing callback for node 69fb7c78df29cd80ecaa0b5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 17:38:18,271 - lava_callback - INFO - Received callback for node 69fb7c84df29cd80ecaa0ba1 INFO: 172.20.0.1:48824 - "POST /node/69fb7c84df29cd80ecaa0ba1 HTTP/1.0" 202 Accepted 2026-05-08 17:38:18,277 - lava_callback - INFO - Starting async job submit for node 69fb7c84df29cd80ecaa0ba1 2026-05-08 17:38:18,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:18,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c84df29cd80ecaa0ba1 HTTP/1.1" 200 None 2026-05-08 17:38:18,298 - lava_callback - DEBUG - Processing node 69fb7c84df29cd80ecaa0ba1: baseline-arm-clabbe 2026-05-08 17:38:18,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c84df29cd80ecaa0ba1 2026-05-08 17:38:18,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:18,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c84df29cd80ecaa0ba1 HTTP/1.1" 200 None 2026-05-08 17:38:18,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:18,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-08 17:38:18,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:18,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c84df29cd80ecaa0ba1 HTTP/1.1" 200 None 2026-05-08 17:38:18,368 - lava_callback - ERROR - Error processing callback for node 69fb7c84df29cd80ecaa0ba1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 17:38:18,925 - lava_callback - INFO - Received callback for node 69fb7c85df29cd80ecaa0ba4 INFO: 172.20.0.1:48826 - "POST /node/69fb7c85df29cd80ecaa0ba4 HTTP/1.0" 202 Accepted 2026-05-08 17:38:18,935 - lava_callback - INFO - Starting async job submit for node 69fb7c85df29cd80ecaa0ba4 2026-05-08 17:38:18,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:18,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c85df29cd80ecaa0ba4 HTTP/1.1" 200 None 2026-05-08 17:38:18,956 - lava_callback - DEBUG - Processing node 69fb7c85df29cd80ecaa0ba4: baseline-arm-clabbe 2026-05-08 17:38:18,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c85df29cd80ecaa0ba4 2026-05-08 17:38:18,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:18,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c85df29cd80ecaa0ba4 HTTP/1.1" 200 None 2026-05-08 17:38:18,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:18,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-08 17:38:18,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:19,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c85df29cd80ecaa0ba4 HTTP/1.1" 200 None 2026-05-08 17:38:19,002 - lava_callback - ERROR - Error processing callback for node 69fb7c85df29cd80ecaa0ba4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 17:38:19,587 - lava_callback - INFO - Received callback for node 69fb7c85df29cd80ecaa0ba7 INFO: 172.20.0.1:48838 - "POST /node/69fb7c85df29cd80ecaa0ba7 HTTP/1.0" 202 Accepted 2026-05-08 17:38:19,592 - lava_callback - INFO - Starting async job submit for node 69fb7c85df29cd80ecaa0ba7 2026-05-08 17:38:19,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:19,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c85df29cd80ecaa0ba7 HTTP/1.1" 200 None 2026-05-08 17:38:19,607 - lava_callback - DEBUG - Processing node 69fb7c85df29cd80ecaa0ba7: baseline-arm-clabbe 2026-05-08 17:38:19,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c85df29cd80ecaa0ba7 2026-05-08 17:38:19,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:19,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c85df29cd80ecaa0ba7 HTTP/1.1" 200 None 2026-05-08 17:38:19,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:19,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-08 17:38:19,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:19,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c85df29cd80ecaa0ba7 HTTP/1.1" 200 None 2026-05-08 17:38:19,698 - lava_callback - ERROR - Error processing callback for node 69fb7c85df29cd80ecaa0ba7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 17:38:20,242 - lava_callback - INFO - Received callback for node 69fb7c87df29cd80ecaa0bad INFO: 172.20.0.1:35462 - "POST /node/69fb7c87df29cd80ecaa0bad HTTP/1.0" 202 Accepted 2026-05-08 17:38:20,251 - lava_callback - INFO - Starting async job submit for node 69fb7c87df29cd80ecaa0bad 2026-05-08 17:38:20,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:20,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c87df29cd80ecaa0bad HTTP/1.1" 200 None 2026-05-08 17:38:20,295 - lava_callback - DEBUG - Processing node 69fb7c87df29cd80ecaa0bad: baseline-arm-clabbe 2026-05-08 17:38:20,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7c87df29cd80ecaa0bad 2026-05-08 17:38:20,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:20,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7c87df29cd80ecaa0bad HTTP/1.1" 200 None 2026-05-08 17:38:20,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:20,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-08 17:38:20,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:38:20,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7c87df29cd80ecaa0bad HTTP/1.1" 200 None 2026-05-08 17:38:20,346 - lava_callback - ERROR - Error processing callback for node 69fb7c87df29cd80ecaa0bad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44612 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:39:16,977 - lava_callback - INFO - Received callback for node 69fb7cafdf29cd80ecaa0c27 INFO: 172.20.0.1:44626 - "POST /node/69fb7cafdf29cd80ecaa0c27 HTTP/1.0" 202 Accepted 2026-05-08 17:39:16,983 - lava_callback - INFO - Starting async job submit for node 69fb7cafdf29cd80ecaa0c27 2026-05-08 17:39:16,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:39:16,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cafdf29cd80ecaa0c27 HTTP/1.1" 200 None 2026-05-08 17:39:16,997 - lava_callback - DEBUG - Processing node 69fb7cafdf29cd80ecaa0c27: baseline-arm64-clabbe 2026-05-08 17:39:16,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7cafdf29cd80ecaa0c27 2026-05-08 17:39:16,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:39:17,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cafdf29cd80ecaa0c27 HTTP/1.1" 200 None 2026-05-08 17:39:17,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:39:17,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 17:39:17,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:39:17,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7cafdf29cd80ecaa0c27 HTTP/1.1" 200 None 2026-05-08 17:39:17,043 - lava_callback - ERROR - Error processing callback for node 69fb7cafdf29cd80ecaa0c27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39674 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:40:17,086 - lava_callback - INFO - Received callback for node 69fb7cf7df29cd80ecaa0cd4 INFO: 172.20.0.1:39676 - "POST /node/69fb7cf7df29cd80ecaa0cd4 HTTP/1.0" 202 Accepted 2026-05-08 17:40:17,091 - lava_callback - INFO - Starting async job submit for node 69fb7cf7df29cd80ecaa0cd4 2026-05-08 17:40:17,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:40:17,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cf7df29cd80ecaa0cd4 HTTP/1.1" 200 None 2026-05-08 17:40:17,116 - lava_callback - DEBUG - Processing node 69fb7cf7df29cd80ecaa0cd4: baseline-arm64-clabbe 2026-05-08 17:40:17,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb7cf7df29cd80ecaa0cd4 2026-05-08 17:40:17,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:40:17,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb7cf7df29cd80ecaa0cd4 HTTP/1.1" 200 None 2026-05-08 17:40:17,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:40:17,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 17:40:17,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:40:17,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb7cf7df29cd80ecaa0cd4 HTTP/1.1" 200 None 2026-05-08 17:40:17,191 - lava_callback - ERROR - Error processing callback for node 69fb7cf7df29cd80ecaa0cd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56626 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:44:27,084 - lava_callback - INFO - Received callback for node 69fe1ce7e4d4e78cd76b10cc INFO: 172.20.0.1:56630 - "POST /node/69fe1ce7e4d4e78cd76b10cc HTTP/1.0" 202 Accepted 2026-05-08 17:44:27,092 - lava_callback - INFO - Starting async job submit for node 69fe1ce7e4d4e78cd76b10cc 2026-05-08 17:44:27,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:44:27,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1ce7e4d4e78cd76b10cc HTTP/1.1" 200 None 2026-05-08 17:44:27,190 - lava_callback - DEBUG - Processing node 69fe1ce7e4d4e78cd76b10cc: ltp-smoke 2026-05-08 17:44:27,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:44:27,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:44:27,878 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe1ce7e4d4e78cd76b10cc/log.txt.gz 2026-05-08 17:44:28,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:44:28,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:44:28,327 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe1ce7e4d4e78cd76b10cc/lava-logs.yaml 2026-05-08 17:44:28,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:44:28,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:44:28,461 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe1ce7e4d4e78cd76b10cc/lava_callback.json.gz 2026-05-08 17:44:28,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:44:28,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1ce7e4d4e78cd76b10cc HTTP/1.1" 200 None 2026-05-08 17:44:28,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:44:28,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d2be4d4e78cd76adccc HTTP/1.1" 200 None 2026-05-08 17:44:28,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:44:28,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1ce7e4d4e78cd76b10cc HTTP/1.1" 200 None 2026-05-08 17:44:28,747 - lava_callback - INFO - Completed processing callback for node 69fe1ce7e4d4e78cd76b10cc 2026-05-08 17:44:31,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:44:31,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52366 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:44:56,277 - lava_callback - INFO - Received callback for node 69fe19a4e4d4e78cd76b0d5f INFO: 172.20.0.1:52370 - "POST /node/69fe19a4e4d4e78cd76b0d5f HTTP/1.0" 202 Accepted 2026-05-08 17:44:56,283 - lava_callback - INFO - Starting async job submit for node 69fe19a4e4d4e78cd76b0d5f 2026-05-08 17:44:56,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:44:56,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a4e4d4e78cd76b0d5f HTTP/1.1" 200 None 2026-05-08 17:44:56,322 - lava_callback - DEBUG - Processing node 69fe19a4e4d4e78cd76b0d5f: baseline-arm64 INFO: 172.20.0.1:52386 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:44:56,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:44:56,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:44:56,912 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a4e4d4e78cd76b0d5f/log.txt.gz 2026-05-08 17:44:57,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:44:57,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:44:57,370 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a4e4d4e78cd76b0d5f/lava-logs.yaml 2026-05-08 17:44:57,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:44:57,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:44:57,502 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe19a4e4d4e78cd76b0d5f/lava_callback.json.gz 2026-05-08 17:44:57,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:44:57,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19a4e4d4e78cd76b0d5f HTTP/1.1" 200 None 2026-05-08 17:44:57,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:44:57,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:44:57,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:44:57,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19a4e4d4e78cd76b0d5f HTTP/1.1" 200 None 2026-05-08 17:44:57,655 - lava_callback - INFO - Completed processing callback for node 69fe19a4e4d4e78cd76b0d5f 2026-05-08 17:45:01,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:45:01,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35210 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:50:21,612 - lava_callback - INFO - Received callback for node 69fe1e8be4d4e78cd76b11b1 INFO: 172.20.0.1:37330 - "POST /node/69fe1e8be4d4e78cd76b11b1 HTTP/1.0" 202 Accepted 2026-05-08 17:50:21,619 - lava_callback - INFO - Starting async job submit for node 69fe1e8be4d4e78cd76b11b1 2026-05-08 17:50:21,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:21,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1e8be4d4e78cd76b11b1 HTTP/1.1" 200 None 2026-05-08 17:50:21,689 - lava_callback - DEBUG - Processing node 69fe1e8be4d4e78cd76b11b1: baseline-arm 2026-05-08 17:50:22,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:50:22,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:50:22,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fe1e8be4d4e78cd76b11b1/log.txt.gz 2026-05-08 17:50:22,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:50:23,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:50:23,061 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe1e8be4d4e78cd76b11b1/lava-logs.yaml 2026-05-08 17:50:23,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:50:23,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:50:23,259 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe1e8be4d4e78cd76b11b1/lava_callback.json.gz DEBUG: Setup failed for 69fe1e8be4d4e78cd76b11b1. Transitting job node result: incomplete -> fail 2026-05-08 17:50:23,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:23,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1e8be4d4e78cd76b11b1 HTTP/1.1" 200 None 2026-05-08 17:50:23,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:23,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 17:50:23,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:23,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1e8be4d4e78cd76b11b1 HTTP/1.1" 200 None 2026-05-08 17:50:23,525 - lava_callback - INFO - Completed processing callback for node 69fe1e8be4d4e78cd76b11b1 INFO: 172.20.0.1:37346 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:50:31,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:32,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 17:50:34,848 - lava_callback - INFO - Received callback for node 69fe19b3e4d4e78cd76b0da6 INFO: 172.20.0.1:37732 - "POST /node/69fe19b3e4d4e78cd76b0da6 HTTP/1.0" 202 Accepted 2026-05-08 17:50:34,855 - lava_callback - INFO - Starting async job submit for node 69fe19b3e4d4e78cd76b0da6 2026-05-08 17:50:34,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:34,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b3e4d4e78cd76b0da6 HTTP/1.1" 200 None 2026-05-08 17:50:34,901 - lava_callback - DEBUG - Processing node 69fe19b3e4d4e78cd76b0da6: baseline-nfs-arm64 2026-05-08 17:50:35,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:50:35,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:50:35,682 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b3e4d4e78cd76b0da6/log.txt.gz 2026-05-08 17:50:35,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:50:36,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:50:36,126 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b3e4d4e78cd76b0da6/lava-logs.yaml 2026-05-08 17:50:36,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:50:36,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:50:36,259 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19b3e4d4e78cd76b0da6/lava_callback.json.gz 2026-05-08 17:50:36,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:36,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b3e4d4e78cd76b0da6 HTTP/1.1" 200 None 2026-05-08 17:50:36,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:36,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:50:36,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:36,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19b3e4d4e78cd76b0da6 HTTP/1.1" 200 None 2026-05-08 17:50:36,393 - lava_callback - INFO - Completed processing callback for node 69fe19b3e4d4e78cd76b0da6 INFO: 172.20.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41210 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:50:56,879 - lava_callback - INFO - Received callback for node 69fe2273e4d4e78cd76b13e8 INFO: 172.20.0.1:41224 - "POST /node/69fe2273e4d4e78cd76b13e8 HTTP/1.0" 202 Accepted 2026-05-08 17:50:56,885 - lava_callback - INFO - Starting async job submit for node 69fe2273e4d4e78cd76b13e8 2026-05-08 17:50:56,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:56,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2273e4d4e78cd76b13e8 HTTP/1.1" 200 None 2026-05-08 17:50:56,902 - lava_callback - DEBUG - Processing node 69fe2273e4d4e78cd76b13e8: baseline-nfs-arm64 2026-05-08 17:50:56,904 - lava_callback - WARNING - Failed to upload log 2026-05-08 17:50:56,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:50:57,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:50:57,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe2273e4d4e78cd76b13e8/lava-logs.yaml 2026-05-08 17:50:57,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:50:57,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:50:57,130 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe2273e4d4e78cd76b13e8/lava_callback.json.gz 2026-05-08 17:50:57,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:57,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2273e4d4e78cd76b13e8 HTTP/1.1" 200 None 2026-05-08 17:50:57,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:57,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:50:57,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:50:57,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2273e4d4e78cd76b13e8 HTTP/1.1" 200 None 2026-05-08 17:50:57,212 - lava_callback - INFO - Completed processing callback for node 69fe2273e4d4e78cd76b13e8 2026-05-08 17:51:02,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:51:02,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52146 - "GET /node/699370b5cebe99dd8e0690b3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34424 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 17:54:16,457 - lava_callback - INFO - Received callback for node 69fe2310e4d4e78cd76b1437 INFO: 172.20.0.1:34430 - "POST /node/69fe2310e4d4e78cd76b1437 HTTP/1.0" 202 Accepted 2026-05-08 17:54:16,464 - lava_callback - INFO - Starting async job submit for node 69fe2310e4d4e78cd76b1437 2026-05-08 17:54:16,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:54:16,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2310e4d4e78cd76b1437 HTTP/1.1" 200 None 2026-05-08 17:54:16,507 - lava_callback - DEBUG - Processing node 69fe2310e4d4e78cd76b1437: baseline-arm64 INFO: 172.20.0.1:34432 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:54:16,644 - lava_callback - WARNING - Failed to upload log 2026-05-08 17:54:16,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:54:16,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:54:16,844 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2310e4d4e78cd76b1437/lava-logs.yaml 2026-05-08 17:54:16,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:54:16,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:54:16,932 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2310e4d4e78cd76b1437/lava_callback.json.gz 2026-05-08 17:54:16,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:54:16,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2310e4d4e78cd76b1437 HTTP/1.1" 200 None 2026-05-08 17:54:16,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:54:16,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:54:16,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:54:17,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2310e4d4e78cd76b1437 HTTP/1.1" 200 None 2026-05-08 17:54:17,066 - lava_callback - INFO - Completed processing callback for node 69fe2310e4d4e78cd76b1437 INFO: 172.20.0.1:41694 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:54:32,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:54:32,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37428 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 17:55:16,212 - lava_callback - INFO - Received callback for node 69fb807edf29cd80ecaa3554 INFO: 172.20.0.1:37444 - "POST /node/69fb807edf29cd80ecaa3554 HTTP/1.0" 202 Accepted 2026-05-08 17:55:16,218 - lava_callback - INFO - Starting async job submit for node 69fb807edf29cd80ecaa3554 2026-05-08 17:55:16,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:55:16,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb807edf29cd80ecaa3554 HTTP/1.1" 200 None 2026-05-08 17:55:16,235 - lava_callback - DEBUG - Processing node 69fb807edf29cd80ecaa3554: baseline-arm64-baylibre 2026-05-08 17:55:16,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb807edf29cd80ecaa3554 2026-05-08 17:55:16,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:55:16,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb807edf29cd80ecaa3554 HTTP/1.1" 200 None 2026-05-08 17:55:16,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:55:16,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-08 17:55:16,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:55:16,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb807edf29cd80ecaa3554 HTTP/1.1" 200 None 2026-05-08 17:55:16,293 - lava_callback - ERROR - Error processing callback for node 69fb807edf29cd80ecaa3554: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35300 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:56:05,369 - lava_callback - INFO - Received callback for node 69fe2361e4d4e78cd76b145c INFO: 172.20.0.1:49858 - "POST /node/69fe2361e4d4e78cd76b145c HTTP/1.0" 202 Accepted 2026-05-08 17:56:05,380 - lava_callback - INFO - Starting async job submit for node 69fe2361e4d4e78cd76b145c 2026-05-08 17:56:05,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:05,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2361e4d4e78cd76b145c HTTP/1.1" 200 None 2026-05-08 17:56:05,441 - lava_callback - DEBUG - Processing node 69fe2361e4d4e78cd76b145c: baseline-arm64 2026-05-08 17:56:05,673 - lava_callback - WARNING - Failed to upload log 2026-05-08 17:56:05,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:56:05,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:56:05,973 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2361e4d4e78cd76b145c/lava-logs.yaml 2026-05-08 17:56:05,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:56:06,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:56:06,097 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2361e4d4e78cd76b145c/lava_callback.json.gz 2026-05-08 17:56:06,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:06,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2361e4d4e78cd76b145c HTTP/1.1" 200 None 2026-05-08 17:56:06,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:06,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 17:56:06,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:06,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2361e4d4e78cd76b145c HTTP/1.1" 200 None 2026-05-08 17:56:06,228 - lava_callback - INFO - Completed processing callback for node 69fe2361e4d4e78cd76b145c INFO: 172.20.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44626 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:56:18,699 - lava_callback - INFO - Received callback for node 69fe23b0e4d4e78cd76b1487 INFO: 172.20.0.1:44642 - "POST /node/69fe23b0e4d4e78cd76b1487 HTTP/1.0" 202 Accepted 2026-05-08 17:56:18,705 - lava_callback - INFO - Starting async job submit for node 69fe23b0e4d4e78cd76b1487 2026-05-08 17:56:18,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:18,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe23b0e4d4e78cd76b1487 HTTP/1.1" 200 None 2026-05-08 17:56:18,722 - lava_callback - DEBUG - Processing node 69fe23b0e4d4e78cd76b1487: baseline-arm 2026-05-08 17:56:18,727 - lava_callback - WARNING - Failed to upload log 2026-05-08 17:56:18,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:56:18,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:56:18,827 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe23b0e4d4e78cd76b1487/lava-logs.yaml 2026-05-08 17:56:18,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:56:18,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:56:18,908 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe23b0e4d4e78cd76b1487/lava_callback.json.gz 2026-05-08 17:56:18,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:18,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe23b0e4d4e78cd76b1487 HTTP/1.1" 200 None 2026-05-08 17:56:18,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:18,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 17:56:18,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:18,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe23b0e4d4e78cd76b1487 HTTP/1.1" 200 None 2026-05-08 17:56:18,968 - lava_callback - INFO - Completed processing callback for node 69fe23b0e4d4e78cd76b1487 INFO: 172.20.0.1:60290 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:56:29,035 - lava_callback - INFO - Received callback for node 69fe1f31e4d4e78cd76b120d INFO: 172.20.0.1:60304 - "POST /node/69fe1f31e4d4e78cd76b120d HTTP/1.0" 202 Accepted 2026-05-08 17:56:29,082 - lava_callback - INFO - Starting async job submit for node 69fe1f31e4d4e78cd76b120d 2026-05-08 17:56:29,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:29,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1f31e4d4e78cd76b120d HTTP/1.1" 200 None 2026-05-08 17:56:29,122 - lava_callback - DEBUG - Processing node 69fe1f31e4d4e78cd76b120d: baseline-arm-pengutronix 2026-05-08 17:56:29,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:56:29,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:56:29,325 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe1f31e4d4e78cd76b120d/log.txt.gz 2026-05-08 17:56:29,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:56:29,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:56:29,495 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe1f31e4d4e78cd76b120d/lava-logs.yaml 2026-05-08 17:56:29,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 17:56:29,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 17:56:29,571 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe1f31e4d4e78cd76b120d/lava_callback.json.gz DEBUG: Setup failed for 69fe1f31e4d4e78cd76b120d. Transitting job node result: incomplete -> fail 2026-05-08 17:56:29,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:29,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1f31e4d4e78cd76b120d HTTP/1.1" 200 None 2026-05-08 17:56:29,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:29,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 17:56:29,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:29,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1f31e4d4e78cd76b120d HTTP/1.1" 200 None 2026-05-08 17:56:29,729 - lava_callback - INFO - Completed processing callback for node 69fe1f31e4d4e78cd76b120d 2026-05-08 17:56:32,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:32,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49078 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:56:37,690 - lava_callback - INFO - Received callback for node 69fb80d2df29cd80ecaa358b INFO: 172.20.0.1:49084 - "POST /node/69fb80d2df29cd80ecaa358b HTTP/1.0" 202 Accepted 2026-05-08 17:56:37,695 - lava_callback - INFO - Starting async job submit for node 69fb80d2df29cd80ecaa358b 2026-05-08 17:56:37,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:37,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb80d2df29cd80ecaa358b HTTP/1.1" 200 None 2026-05-08 17:56:37,711 - lava_callback - DEBUG - Processing node 69fb80d2df29cd80ecaa358b: baseline-arm64-clabbe 2026-05-08 17:56:37,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb80d2df29cd80ecaa358b 2026-05-08 17:56:37,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:37,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb80d2df29cd80ecaa358b HTTP/1.1" 200 None 2026-05-08 17:56:37,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:37,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-08 17:56:37,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:56:37,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb80d2df29cd80ecaa358b HTTP/1.1" 200 None 2026-05-08 17:56:37,756 - lava_callback - ERROR - Error processing callback for node 69fb80d2df29cd80ecaa358b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54720 - "GET / HTTP/1.0" 200 OK 2026-05-08 17:58:37,710 - lava_callback - INFO - Received callback for node 69fb8146df29cd80ecaa35b2 INFO: 172.20.0.1:54726 - "POST /node/69fb8146df29cd80ecaa35b2 HTTP/1.0" 202 Accepted 2026-05-08 17:58:37,717 - lava_callback - INFO - Starting async job submit for node 69fb8146df29cd80ecaa35b2 2026-05-08 17:58:37,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:58:37,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8146df29cd80ecaa35b2 HTTP/1.1" 200 None 2026-05-08 17:58:37,738 - lava_callback - DEBUG - Processing node 69fb8146df29cd80ecaa35b2: baseline-arm64-clabbe 2026-05-08 17:58:37,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8146df29cd80ecaa35b2 2026-05-08 17:58:37,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:58:37,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8146df29cd80ecaa35b2 HTTP/1.1" 200 None 2026-05-08 17:58:37,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:58:37,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-08 17:58:37,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 17:58:37,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8146df29cd80ecaa35b2 HTTP/1.1" 200 None 2026-05-08 17:58:37,796 - lava_callback - ERROR - Error processing callback for node 69fb8146df29cd80ecaa35b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59526 - "GET /node/6993d3a33e9ba49307713952%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60000 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:00:37,746 - lava_callback - INFO - Received callback for node 69fb81bcdf29cd80ecaa35e2 INFO: 172.20.0.1:60006 - "POST /node/69fb81bcdf29cd80ecaa35e2 HTTP/1.0" 202 Accepted 2026-05-08 18:00:37,754 - lava_callback - INFO - Starting async job submit for node 69fb81bcdf29cd80ecaa35e2 2026-05-08 18:00:37,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:00:37,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb81bcdf29cd80ecaa35e2 HTTP/1.1" 200 None 2026-05-08 18:00:37,785 - lava_callback - DEBUG - Processing node 69fb81bcdf29cd80ecaa35e2: baseline-arm64-clabbe 2026-05-08 18:00:37,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb81bcdf29cd80ecaa35e2 2026-05-08 18:00:37,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:00:37,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb81bcdf29cd80ecaa35e2 HTTP/1.1" 200 None 2026-05-08 18:00:37,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:00:37,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-08 18:00:37,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:00:37,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb81bcdf29cd80ecaa35e2 HTTP/1.1" 200 None 2026-05-08 18:00:37,841 - lava_callback - ERROR - Error processing callback for node 69fb81bcdf29cd80ecaa35e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:01:57,818 - lava_callback - INFO - Received callback for node 69fb8209df29cd80ecaa3609 INFO: 172.20.0.1:41444 - "POST /node/69fb8209df29cd80ecaa3609 HTTP/1.0" 202 Accepted 2026-05-08 18:01:57,824 - lava_callback - INFO - Starting async job submit for node 69fb8209df29cd80ecaa3609 2026-05-08 18:01:57,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:01:57,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8209df29cd80ecaa3609 HTTP/1.1" 200 None 2026-05-08 18:01:57,839 - lava_callback - DEBUG - Processing node 69fb8209df29cd80ecaa3609: baseline-arm64-clabbe 2026-05-08 18:01:57,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8209df29cd80ecaa3609 2026-05-08 18:01:57,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:01:57,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8209df29cd80ecaa3609 HTTP/1.1" 200 None 2026-05-08 18:01:57,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:01:57,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-08 18:01:57,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:01:57,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8209df29cd80ecaa3609 HTTP/1.1" 200 None 2026-05-08 18:01:57,885 - lava_callback - ERROR - Error processing callback for node 69fb8209df29cd80ecaa3609: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33416 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:06:13,698 - lava_callback - INFO - Received callback for node 69fe24bee4d4e78cd76b1512 INFO: 172.20.0.1:41546 - "POST /node/69fe24bee4d4e78cd76b1512 HTTP/1.0" 202 Accepted 2026-05-08 18:06:13,707 - lava_callback - INFO - Starting async job submit for node 69fe24bee4d4e78cd76b1512 2026-05-08 18:06:13,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:06:13,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe24bee4d4e78cd76b1512 HTTP/1.1" 200 None 2026-05-08 18:06:13,782 - lava_callback - DEBUG - Processing node 69fe24bee4d4e78cd76b1512: baseline-arm64-foundriesio 2026-05-08 18:06:15,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:41550 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 18:06:15,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:06:15,216 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe24bee4d4e78cd76b1512/log.txt.gz 2026-05-08 18:06:15,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:06:16,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:06:16,153 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe24bee4d4e78cd76b1512/lava-logs.yaml 2026-05-08 18:06:16,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:06:16,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:06:16,311 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe24bee4d4e78cd76b1512/lava_callback.json.gz DEBUG: Setup failed for 69fe24bee4d4e78cd76b1512. Transitting job node result: incomplete -> fail 2026-05-08 18:06:16,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:06:16,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe24bee4d4e78cd76b1512 HTTP/1.1" 200 None INFO: 172.20.0.1:41566 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:06:16,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:06:16,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 18:06:16,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:06:16,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe24bee4d4e78cd76b1512 HTTP/1.1" 200 None 2026-05-08 18:06:16,691 - lava_callback - INFO - Completed processing callback for node 69fe24bee4d4e78cd76b1512 2026-05-08 18:06:18,069 - lava_callback - INFO - Received callback for node 69fb830edf29cd80ecaa3635 INFO: 172.20.0.1:41576 - "POST /node/69fb830edf29cd80ecaa3635 HTTP/1.0" 202 Accepted 2026-05-08 18:06:18,075 - lava_callback - INFO - Starting async job submit for node 69fb830edf29cd80ecaa3635 2026-05-08 18:06:18,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:06:18,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb830edf29cd80ecaa3635 HTTP/1.1" 200 None 2026-05-08 18:06:18,094 - lava_callback - DEBUG - Processing node 69fb830edf29cd80ecaa3635: baseline-arm64-clabbe 2026-05-08 18:06:18,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb830edf29cd80ecaa3635 2026-05-08 18:06:18,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:06:18,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb830edf29cd80ecaa3635 HTTP/1.1" 200 None 2026-05-08 18:06:18,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:06:18,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-08 18:06:18,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:06:18,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb830edf29cd80ecaa3635 HTTP/1.1" 200 None 2026-05-08 18:06:18,145 - lava_callback - ERROR - Error processing callback for node 69fb830edf29cd80ecaa3635: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58016 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:06:32,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:06:32,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35676 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:07:38,072 - lava_callback - INFO - Received callback for node 69fb835fdf29cd80ecaa3652 INFO: 172.20.0.1:35684 - "POST /node/69fb835fdf29cd80ecaa3652 HTTP/1.0" 202 Accepted 2026-05-08 18:07:38,078 - lava_callback - INFO - Starting async job submit for node 69fb835fdf29cd80ecaa3652 2026-05-08 18:07:38,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:07:38,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb835fdf29cd80ecaa3652 HTTP/1.1" 200 None 2026-05-08 18:07:38,093 - lava_callback - DEBUG - Processing node 69fb835fdf29cd80ecaa3652: baseline-arm64-clabbe 2026-05-08 18:07:38,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb835fdf29cd80ecaa3652 2026-05-08 18:07:38,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:07:38,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb835fdf29cd80ecaa3652 HTTP/1.1" 200 None 2026-05-08 18:07:38,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:07:38,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-08 18:07:38,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:07:38,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb835fdf29cd80ecaa3652 HTTP/1.1" 200 None 2026-05-08 18:07:38,140 - lava_callback - ERROR - Error processing callback for node 69fb835fdf29cd80ecaa3652: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59870 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:15:10,174 - lava_callback - INFO - Received callback for node 69fe2662e4d4e78cd76b15f2 INFO: 172.20.0.1:60964 - "POST /node/69fe2662e4d4e78cd76b15f2 HTTP/1.0" 202 Accepted 2026-05-08 18:15:10,181 - lava_callback - INFO - Starting async job submit for node 69fe2662e4d4e78cd76b15f2 2026-05-08 18:15:10,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:15:10,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2662e4d4e78cd76b15f2 HTTP/1.1" 200 None 2026-05-08 18:15:10,235 - lava_callback - DEBUG - Processing node 69fe2662e4d4e78cd76b15f2: baseline-arm64 2026-05-08 18:15:10,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:15:10,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:15:10,671 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2662e4d4e78cd76b15f2/log.txt.gz 2026-05-08 18:15:10,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:15:11,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:15:11,118 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2662e4d4e78cd76b15f2/lava-logs.yaml 2026-05-08 18:15:11,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:15:11,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:15:11,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2662e4d4e78cd76b15f2/lava_callback.json.gz DEBUG: Setup failed for 69fe2662e4d4e78cd76b15f2. Transitting job node result: incomplete -> fail 2026-05-08 18:15:11,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:15:11,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2662e4d4e78cd76b15f2 HTTP/1.1" 200 None 2026-05-08 18:15:11,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:15:11,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 18:15:11,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:15:11,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2662e4d4e78cd76b15f2 HTTP/1.1" 200 None 2026-05-08 18:15:11,507 - lava_callback - INFO - Completed processing callback for node 69fe2662e4d4e78cd76b15f2 INFO: 172.20.0.1:60970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37316 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:15:32,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:15:32,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42066 - "GET /node/68f0bafd5a0218f5f94ff137%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52002 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:42:26,160 - lava_callback - INFO - Received callback for node 69fe29e9e4d4e78cd76b1792 INFO: 172.20.0.1:53446 - "POST /node/69fe29e9e4d4e78cd76b1792 HTTP/1.0" 202 Accepted 2026-05-08 18:42:26,168 - lava_callback - INFO - Starting async job submit for node 69fe29e9e4d4e78cd76b1792 2026-05-08 18:42:26,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:42:26,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe29e9e4d4e78cd76b1792 HTTP/1.1" 200 None 2026-05-08 18:42:26,226 - lava_callback - DEBUG - Processing node 69fe29e9e4d4e78cd76b1792: baseline-nfs-arm64 INFO: 172.20.0.1:53454 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:42:27,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:42:27,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:42:27,606 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe29e9e4d4e78cd76b1792/log.txt.gz 2026-05-08 18:42:28,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:42:28,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:42:28,405 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe29e9e4d4e78cd76b1792/lava-logs.yaml 2026-05-08 18:42:28,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:42:28,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:42:28,563 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe29e9e4d4e78cd76b1792/lava_callback.json.gz DEBUG: Setup failed for 69fe29e9e4d4e78cd76b1792. Transitting job node result: incomplete -> fail 2026-05-08 18:42:28,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:42:28,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe29e9e4d4e78cd76b1792 HTTP/1.1" 200 None 2026-05-08 18:42:28,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:42:28,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 18:42:28,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:42:28,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe29e9e4d4e78cd76b1792 HTTP/1.1" 200 None 2026-05-08 18:42:28,854 - lava_callback - INFO - Completed processing callback for node 69fe29e9e4d4e78cd76b1792 2026-05-08 18:42:32,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:42:32,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41186 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:45:46,879 - lava_callback - INFO - Received callback for node 69fe2f43e4d4e78cd76b1a2c INFO: 172.20.0.1:41196 - "POST /node/69fe2f43e4d4e78cd76b1a2c HTTP/1.0" 202 Accepted 2026-05-08 18:45:46,885 - lava_callback - INFO - Starting async job submit for node 69fe2f43e4d4e78cd76b1a2c 2026-05-08 18:45:46,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:45:46,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2f43e4d4e78cd76b1a2c HTTP/1.1" 200 None 2026-05-08 18:45:46,908 - lava_callback - DEBUG - Processing node 69fe2f43e4d4e78cd76b1a2c: baseline-nfs-arm64 2026-05-08 18:45:46,909 - lava_callback - WARNING - Failed to upload log 2026-05-08 18:45:46,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:45:46,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:45:46,988 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe2f43e4d4e78cd76b1a2c/lava-logs.yaml 2026-05-08 18:45:46,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:45:47,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:45:47,075 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe2f43e4d4e78cd76b1a2c/lava_callback.json.gz 2026-05-08 18:45:47,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:45:47,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2f43e4d4e78cd76b1a2c HTTP/1.1" 200 None 2026-05-08 18:45:47,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:45:47,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 18:45:47,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:45:47,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2f43e4d4e78cd76b1a2c HTTP/1.1" 200 None 2026-05-08 18:45:47,126 - lava_callback - INFO - Completed processing callback for node 69fe2f43e4d4e78cd76b1a2c INFO: 172.20.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49868 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:46:02,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:46:02,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36432 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:47:38,430 - lava_callback - INFO - Received callback for node 69fe2f90e4d4e78cd76b1a56 INFO: 172.20.0.1:36440 - "POST /node/69fe2f90e4d4e78cd76b1a56 HTTP/1.0" 202 Accepted 2026-05-08 18:47:38,438 - lava_callback - INFO - Starting async job submit for node 69fe2f90e4d4e78cd76b1a56 2026-05-08 18:47:38,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:47:38,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2f90e4d4e78cd76b1a56 HTTP/1.1" 200 None 2026-05-08 18:47:38,500 - lava_callback - DEBUG - Processing node 69fe2f90e4d4e78cd76b1a56: baseline-arm64 2026-05-08 18:47:38,646 - lava_callback - WARNING - Failed to upload log 2026-05-08 18:47:38,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:47:38,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:47:38,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2f90e4d4e78cd76b1a56/lava-logs.yaml 2026-05-08 18:47:38,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:47:38,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:47:38,934 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2f90e4d4e78cd76b1a56/lava_callback.json.gz 2026-05-08 18:47:38,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:47:38,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2f90e4d4e78cd76b1a56 HTTP/1.1" 200 None 2026-05-08 18:47:38,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:47:39,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 18:47:39,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:47:39,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2f90e4d4e78cd76b1a56 HTTP/1.1" 200 None 2026-05-08 18:47:39,096 - lava_callback - INFO - Completed processing callback for node 69fe2f90e4d4e78cd76b1a56 INFO: 172.20.0.1:37628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53332 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:47:59,062 - lava_callback - INFO - Received callback for node 69fb8ccfdf29cd80ecaa37a1 INFO: 172.20.0.1:53334 - "POST /node/69fb8ccfdf29cd80ecaa37a1 HTTP/1.0" 202 Accepted 2026-05-08 18:47:59,067 - lava_callback - INFO - Starting async job submit for node 69fb8ccfdf29cd80ecaa37a1 2026-05-08 18:47:59,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:47:59,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8ccfdf29cd80ecaa37a1 HTTP/1.1" 200 None 2026-05-08 18:47:59,083 - lava_callback - DEBUG - Processing node 69fb8ccfdf29cd80ecaa37a1: baseline-arm-baylibre 2026-05-08 18:47:59,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8ccfdf29cd80ecaa37a1 2026-05-08 18:47:59,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:47:59,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8ccfdf29cd80ecaa37a1 HTTP/1.1" 200 None 2026-05-08 18:47:59,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:47:59,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 18:47:59,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:47:59,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8ccfdf29cd80ecaa37a1 HTTP/1.1" 200 None 2026-05-08 18:47:59,142 - lava_callback - ERROR - Error processing callback for node 69fb8ccfdf29cd80ecaa37a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 18:48:02,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:48:02,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35874 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:49:19,803 - lava_callback - INFO - Received callback for node 69fb8d28df29cd80ecaa37ae INFO: 172.20.0.1:40864 - "POST /node/69fb8d28df29cd80ecaa37ae HTTP/1.0" 202 Accepted 2026-05-08 18:49:19,808 - lava_callback - INFO - Starting async job submit for node 69fb8d28df29cd80ecaa37ae 2026-05-08 18:49:19,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:49:19,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8d28df29cd80ecaa37ae HTTP/1.1" 200 None 2026-05-08 18:49:19,823 - lava_callback - DEBUG - Processing node 69fb8d28df29cd80ecaa37ae: baseline-arm-clabbe 2026-05-08 18:49:19,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8d28df29cd80ecaa37ae 2026-05-08 18:49:19,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:49:19,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8d28df29cd80ecaa37ae HTTP/1.1" 200 None 2026-05-08 18:49:19,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:49:19,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-08 18:49:19,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:49:19,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8d28df29cd80ecaa37ae HTTP/1.1" 200 None 2026-05-08 18:49:19,871 - lava_callback - ERROR - Error processing callback for node 69fb8d28df29cd80ecaa37ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 18:49:20,619 - lava_callback - INFO - Received callback for node 69fe2fe3e4d4e78cd76b1a9e INFO: 172.20.0.1:40878 - "POST /node/69fe2fe3e4d4e78cd76b1a9e HTTP/1.0" 202 Accepted 2026-05-08 18:49:20,627 - lava_callback - INFO - Starting async job submit for node 69fe2fe3e4d4e78cd76b1a9e 2026-05-08 18:49:20,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:49:20,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2fe3e4d4e78cd76b1a9e HTTP/1.1" 200 None 2026-05-08 18:49:20,706 - lava_callback - DEBUG - Processing node 69fe2fe3e4d4e78cd76b1a9e: baseline-arm64 2026-05-08 18:49:20,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:49:21,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:49:21,015 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2fe3e4d4e78cd76b1a9e/log.txt.gz 2026-05-08 18:49:21,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:49:21,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:49:21,243 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2fe3e4d4e78cd76b1a9e/lava-logs.yaml 2026-05-08 18:49:21,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:49:21,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:49:21,347 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2fe3e4d4e78cd76b1a9e/lava_callback.json.gz 2026-05-08 18:49:21,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:49:21,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2fe3e4d4e78cd76b1a9e HTTP/1.1" 200 None 2026-05-08 18:49:21,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:49:21,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 18:49:21,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:49:21,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2fe3e4d4e78cd76b1a9e HTTP/1.1" 200 None 2026-05-08 18:49:21,487 - lava_callback - INFO - Completed processing callback for node 69fe2fe3e4d4e78cd76b1a9e INFO: 172.20.0.1:40886 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:49:32,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:49:32,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58148 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:50:51,484 - lava_callback - INFO - Received callback for node 69fe2e0de4d4e78cd76b1995 INFO: 172.20.0.1:35264 - "POST /node/69fe2e0de4d4e78cd76b1995 HTTP/1.0" 202 Accepted 2026-05-08 18:50:51,491 - lava_callback - INFO - Starting async job submit for node 69fe2e0de4d4e78cd76b1995 2026-05-08 18:50:51,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:50:51,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2e0de4d4e78cd76b1995 HTTP/1.1" 200 None 2026-05-08 18:50:51,535 - lava_callback - DEBUG - Processing node 69fe2e0de4d4e78cd76b1995: baseline-arm64 2026-05-08 18:50:52,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:50:52,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:50:52,277 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2e0de4d4e78cd76b1995/log.txt.gz 2026-05-08 18:50:52,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:50:52,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:50:52,810 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2e0de4d4e78cd76b1995/lava-logs.yaml 2026-05-08 18:50:52,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:50:52,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:50:52,937 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe2e0de4d4e78cd76b1995/lava_callback.json.gz INFO: 172.20.0.1:35270 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:50:52,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:50:52,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2e0de4d4e78cd76b1995 HTTP/1.1" 200 None 2026-05-08 18:50:52,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:50:52,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 18:50:52,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:50:53,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2e0de4d4e78cd76b1995 HTTP/1.1" 200 None 2026-05-08 18:50:53,071 - lava_callback - INFO - Completed processing callback for node 69fe2e0de4d4e78cd76b1995 INFO: 172.20.0.1:35272 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:51:02,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:51:02,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57414 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:52:12,278 - lava_callback - INFO - Received callback for node 69fda2abe98225c4a2046e09 INFO: 172.20.0.1:52616 - "POST /node/69fda2abe98225c4a2046e09 HTTP/1.0" 202 Accepted 2026-05-08 18:52:12,284 - lava_callback - INFO - Starting async job submit for node 69fda2abe98225c4a2046e09 2026-05-08 18:52:12,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:52:12,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2abe98225c4a2046e09 HTTP/1.1" 200 None 2026-05-08 18:52:12,327 - lava_callback - DEBUG - Processing node 69fda2abe98225c4a2046e09: baseline-arm64-broonie 2026-05-08 18:52:12,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:52:12,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:52:12,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2abe98225c4a2046e09/log.txt.gz 2026-05-08 18:52:12,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:52:13,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:52:13,055 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2abe98225c4a2046e09/lava-logs.yaml 2026-05-08 18:52:13,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:52:13,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:52:13,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2abe98225c4a2046e09/lava_callback.json.gz 2026-05-08 18:52:13,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:52:13,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2abe98225c4a2046e09 HTTP/1.1" 200 None 2026-05-08 18:52:13,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:52:13,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 18:52:13,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:52:13,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2abe98225c4a2046e09 HTTP/1.1" 200 None 2026-05-08 18:52:13,248 - lava_callback - INFO - Completed processing callback for node 69fda2abe98225c4a2046e09 INFO: 172.20.0.1:52620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51010 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:52:32,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:52:32,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53062 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:52:59,814 - lava_callback - INFO - Received callback for node 69fb8e05df29cd80ecaa37c2 INFO: 172.20.0.1:42092 - "POST /node/69fb8e05df29cd80ecaa37c2 HTTP/1.0" 202 Accepted 2026-05-08 18:52:59,819 - lava_callback - INFO - Starting async job submit for node 69fb8e05df29cd80ecaa37c2 2026-05-08 18:52:59,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:52:59,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8e05df29cd80ecaa37c2 HTTP/1.1" 200 None 2026-05-08 18:52:59,834 - lava_callback - DEBUG - Processing node 69fb8e05df29cd80ecaa37c2: baseline-arm-clabbe 2026-05-08 18:52:59,835 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8e05df29cd80ecaa37c2 2026-05-08 18:52:59,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:52:59,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8e05df29cd80ecaa37c2 HTTP/1.1" 200 None 2026-05-08 18:52:59,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:52:59,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-08 18:52:59,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:52:59,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8e05df29cd80ecaa37c2 HTTP/1.1" 200 None 2026-05-08 18:52:59,881 - lava_callback - ERROR - Error processing callback for node 69fb8e05df29cd80ecaa37c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60392 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:53:39,807 - lava_callback - INFO - Received callback for node 69fb8e2ddf29cd80ecaa37d0 INFO: 172.20.0.1:46032 - "POST /node/69fb8e2ddf29cd80ecaa37d0 HTTP/1.0" 202 Accepted 2026-05-08 18:53:39,813 - lava_callback - INFO - Starting async job submit for node 69fb8e2ddf29cd80ecaa37d0 2026-05-08 18:53:39,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:53:39,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8e2ddf29cd80ecaa37d0 HTTP/1.1" 200 None 2026-05-08 18:53:39,829 - lava_callback - DEBUG - Processing node 69fb8e2ddf29cd80ecaa37d0: baseline-arm-clabbe 2026-05-08 18:53:39,829 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8e2ddf29cd80ecaa37d0 2026-05-08 18:53:39,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:53:39,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8e2ddf29cd80ecaa37d0 HTTP/1.1" 200 None 2026-05-08 18:53:39,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:53:39,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-08 18:53:39,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:53:39,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8e2ddf29cd80ecaa37d0 HTTP/1.1" 200 None 2026-05-08 18:53:39,876 - lava_callback - ERROR - Error processing callback for node 69fb8e2ddf29cd80ecaa37d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46044 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:53:52,569 - lava_callback - INFO - Received callback for node 69fdfc08e98225c4a20496ff INFO: 172.20.0.1:56374 - "POST /node/69fdfc08e98225c4a20496ff HTTP/1.0" 202 Accepted 2026-05-08 18:53:52,575 - lava_callback - INFO - Starting async job submit for node 69fdfc08e98225c4a20496ff 2026-05-08 18:53:52,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:53:52,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdfc08e98225c4a20496ff HTTP/1.1" 200 None 2026-05-08 18:53:52,615 - lava_callback - DEBUG - Processing node 69fdfc08e98225c4a20496ff: baseline-arm64-broonie 2026-05-08 18:53:52,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:53:52,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:53:52,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fdfc08e98225c4a20496ff/log.txt.gz INFO: 172.20.0.1:56390 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:53:53,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:53:53,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:53:53,294 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fdfc08e98225c4a20496ff/lava-logs.yaml 2026-05-08 18:53:53,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:53:53,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:53:53,418 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fdfc08e98225c4a20496ff/lava_callback.json.gz 2026-05-08 18:53:53,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:53:53,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdfc08e98225c4a20496ff HTTP/1.1" 200 None 2026-05-08 18:53:53,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:53:53,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 18:53:53,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:53:53,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdfc08e98225c4a20496ff HTTP/1.1" 200 None 2026-05-08 18:53:53,499 - lava_callback - INFO - Completed processing callback for node 69fdfc08e98225c4a20496ff INFO: 172.20.0.1:56396 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:54:02,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:54:02,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54398 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:54:59,906 - lava_callback - INFO - Received callback for node 69fb8e79df29cd80ecaa37f1 INFO: 172.20.0.1:38296 - "POST /node/69fb8e79df29cd80ecaa37f1 HTTP/1.0" 202 Accepted 2026-05-08 18:54:59,912 - lava_callback - INFO - Starting async job submit for node 69fb8e79df29cd80ecaa37f1 2026-05-08 18:54:59,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:54:59,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8e79df29cd80ecaa37f1 HTTP/1.1" 200 None 2026-05-08 18:54:59,927 - lava_callback - DEBUG - Processing node 69fb8e79df29cd80ecaa37f1: baseline-arm-clabbe 2026-05-08 18:54:59,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8e79df29cd80ecaa37f1 2026-05-08 18:54:59,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:54:59,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8e79df29cd80ecaa37f1 HTTP/1.1" 200 None 2026-05-08 18:54:59,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:54:59,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-08 18:54:59,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:54:59,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8e79df29cd80ecaa37f1 HTTP/1.1" 200 None 2026-05-08 18:54:59,977 - lava_callback - ERROR - Error processing callback for node 69fb8e79df29cd80ecaa37f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47938 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 18:55:16,397 - lava_callback - INFO - Received callback for node 69fe3075e4d4e78cd76b1ae6 INFO: 172.20.0.1:47954 - "POST /node/69fe3075e4d4e78cd76b1ae6 HTTP/1.0" 202 Accepted 2026-05-08 18:55:16,406 - lava_callback - INFO - Starting async job submit for node 69fe3075e4d4e78cd76b1ae6 2026-05-08 18:55:16,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:55:16,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3075e4d4e78cd76b1ae6 HTTP/1.1" 200 None 2026-05-08 18:55:16,480 - lava_callback - DEBUG - Processing node 69fe3075e4d4e78cd76b1ae6: baseline-arm64-foundriesio INFO: 172.20.0.1:47966 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:55:17,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:55:17,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:55:17,856 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe3075e4d4e78cd76b1ae6/log.txt.gz 2026-05-08 18:55:18,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:55:18,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:55:18,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe3075e4d4e78cd76b1ae6/lava-logs.yaml 2026-05-08 18:55:18,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:55:18,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:55:18,901 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe3075e4d4e78cd76b1ae6/lava_callback.json.gz DEBUG: 69fe3075e4d4e78cd76b1ae6 Transitting job node result: pass -> incomplete 2026-05-08 18:55:18,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:55:18,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3075e4d4e78cd76b1ae6 HTTP/1.1" 200 None 2026-05-08 18:55:18,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:55:18,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 18:55:18,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:55:19,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3075e4d4e78cd76b1ae6 HTTP/1.1" 200 None 2026-05-08 18:55:19,011 - lava_callback - INFO - Completed processing callback for node 69fe3075e4d4e78cd76b1ae6 INFO: 172.20.0.1:53404 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:55:32,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:55:32,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44892 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:55:52,464 - lava_callback - INFO - Received callback for node 69fe19c7e4d4e78cd76b0df1 INFO: 172.20.0.1:52040 - "POST /node/69fe19c7e4d4e78cd76b0df1 HTTP/1.0" 202 Accepted 2026-05-08 18:55:52,470 - lava_callback - INFO - Starting async job submit for node 69fe19c7e4d4e78cd76b0df1 2026-05-08 18:55:52,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:55:52,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19c7e4d4e78cd76b0df1 HTTP/1.1" 200 None 2026-05-08 18:55:52,516 - lava_callback - DEBUG - Processing node 69fe19c7e4d4e78cd76b0df1: baseline-arm64-broonie 2026-05-08 18:55:52,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:55:53,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:55:53,017 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19c7e4d4e78cd76b0df1/log.txt.gz INFO: 172.20.0.1:52052 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:55:53,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:55:53,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:55:53,352 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19c7e4d4e78cd76b0df1/lava-logs.yaml 2026-05-08 18:55:53,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:55:53,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:55:53,500 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19c7e4d4e78cd76b0df1/lava_callback.json.gz 2026-05-08 18:55:53,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:55:53,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19c7e4d4e78cd76b0df1 HTTP/1.1" 200 None 2026-05-08 18:55:53,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:55:53,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 18:55:53,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:55:53,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19c7e4d4e78cd76b0df1 HTTP/1.1" 200 None 2026-05-08 18:55:53,582 - lava_callback - INFO - Completed processing callback for node 69fe19c7e4d4e78cd76b0df1 INFO: 172.20.0.1:52062 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:56:02,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:56:02,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39188 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:56:59,958 - lava_callback - INFO - Received callback for node 69fb8ef0df29cd80ecaa3820 INFO: 172.20.0.1:45434 - "POST /node/69fb8ef0df29cd80ecaa3820 HTTP/1.0" 202 Accepted 2026-05-08 18:56:59,963 - lava_callback - INFO - Starting async job submit for node 69fb8ef0df29cd80ecaa3820 2026-05-08 18:56:59,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:56:59,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8ef0df29cd80ecaa3820 HTTP/1.1" 200 None 2026-05-08 18:56:59,979 - lava_callback - DEBUG - Processing node 69fb8ef0df29cd80ecaa3820: baseline-arm-clabbe 2026-05-08 18:56:59,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8ef0df29cd80ecaa3820 2026-05-08 18:56:59,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:56:59,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8ef0df29cd80ecaa3820 HTTP/1.1" 200 None 2026-05-08 18:56:59,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:57:00,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 18:57:00,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:57:00,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8ef0df29cd80ecaa3820 HTTP/1.1" 200 None 2026-05-08 18:57:00,029 - lava_callback - ERROR - Error processing callback for node 69fb8ef0df29cd80ecaa3820: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55706 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:57:33,419 - lava_callback - INFO - Received callback for node 69fe2ebfe4d4e78cd76b19dd INFO: 172.20.0.1:60274 - "POST /node/69fe2ebfe4d4e78cd76b19dd HTTP/1.0" 202 Accepted 2026-05-08 18:57:33,426 - lava_callback - INFO - Starting async job submit for node 69fe2ebfe4d4e78cd76b19dd 2026-05-08 18:57:33,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:57:33,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2ebfe4d4e78cd76b19dd HTTP/1.1" 200 None 2026-05-08 18:57:33,488 - lava_callback - DEBUG - Processing node 69fe2ebfe4d4e78cd76b19dd: baseline-arm 2026-05-08 18:57:33,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:57:34,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:57:34,040 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fe2ebfe4d4e78cd76b19dd/log.txt.gz 2026-05-08 18:57:34,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:57:34,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:57:34,530 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe2ebfe4d4e78cd76b19dd/lava-logs.yaml 2026-05-08 18:57:34,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:57:34,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:57:34,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe2ebfe4d4e78cd76b19dd/lava_callback.json.gz DEBUG: Setup failed for 69fe2ebfe4d4e78cd76b19dd. Transitting job node result: incomplete -> fail 2026-05-08 18:57:34,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:57:34,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2ebfe4d4e78cd76b19dd HTTP/1.1" 200 None 2026-05-08 18:57:34,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:57:34,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 18:57:34,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:57:34,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2ebfe4d4e78cd76b19dd HTTP/1.1" 200 None 2026-05-08 18:57:34,996 - lava_callback - INFO - Completed processing callback for node 69fe2ebfe4d4e78cd76b19dd INFO: 172.20.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33888 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:57:51,139 - lava_callback - INFO - Received callback for node 69fe2e07e4d4e78cd76b1991 INFO: 172.20.0.1:39968 - "POST /node/69fe2e07e4d4e78cd76b1991 HTTP/1.0" 202 Accepted 2026-05-08 18:57:51,151 - lava_callback - INFO - Starting async job submit for node 69fe2e07e4d4e78cd76b1991 2026-05-08 18:57:51,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:57:51,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2e07e4d4e78cd76b1991 HTTP/1.1" 200 None 2026-05-08 18:57:51,227 - lava_callback - DEBUG - Processing node 69fe2e07e4d4e78cd76b1991: ltp-smoke 2026-05-08 18:57:51,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:57:51,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:57:51,794 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe2e07e4d4e78cd76b1991/log.txt.gz 2026-05-08 18:57:52,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:57:52,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:57:52,251 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe2e07e4d4e78cd76b1991/lava-logs.yaml 2026-05-08 18:57:52,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:57:52,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:57:52,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe2e07e4d4e78cd76b1991/lava_callback.json.gz 2026-05-08 18:57:52,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:57:52,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2e07e4d4e78cd76b1991 HTTP/1.1" 200 None 2026-05-08 18:57:52,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:57:52,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d2be4d4e78cd76adccc HTTP/1.1" 200 None 2026-05-08 18:57:52,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:57:52,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2e07e4d4e78cd76b1991 HTTP/1.1" 200 None 2026-05-08 18:57:52,747 - lava_callback - INFO - Completed processing callback for node 69fe2e07e4d4e78cd76b1991 INFO: 172.20.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39984 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:57:59,973 - lava_callback - INFO - Received callback for node 69fb8f2ddf29cd80ecaa382f INFO: 172.20.0.1:39666 - "POST /node/69fb8f2ddf29cd80ecaa382f HTTP/1.0" 202 Accepted 2026-05-08 18:57:59,979 - lava_callback - INFO - Starting async job submit for node 69fb8f2ddf29cd80ecaa382f 2026-05-08 18:57:59,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:57:59,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8f2ddf29cd80ecaa382f HTTP/1.1" 200 None 2026-05-08 18:57:59,995 - lava_callback - DEBUG - Processing node 69fb8f2ddf29cd80ecaa382f: baseline-arm-clabbe 2026-05-08 18:57:59,995 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8f2ddf29cd80ecaa382f 2026-05-08 18:57:59,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:00,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8f2ddf29cd80ecaa382f HTTP/1.1" 200 None 2026-05-08 18:58:00,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:00,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 18:58:00,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:00,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8f2ddf29cd80ecaa382f HTTP/1.1" 200 None 2026-05-08 18:58:00,055 - lava_callback - ERROR - Error processing callback for node 69fb8f2ddf29cd80ecaa382f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 18:58:02,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:02,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41076 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:58:27,359 - lava_callback - INFO - Received callback for node 69fe322fe4d4e78cd76b1c06 INFO: 172.20.0.1:41078 - "POST /node/69fe322fe4d4e78cd76b1c06 HTTP/1.0" 202 Accepted 2026-05-08 18:58:27,365 - lava_callback - INFO - Starting async job submit for node 69fe322fe4d4e78cd76b1c06 2026-05-08 18:58:27,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:27,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe322fe4d4e78cd76b1c06 HTTP/1.1" 200 None 2026-05-08 18:58:27,382 - lava_callback - DEBUG - Processing node 69fe322fe4d4e78cd76b1c06: baseline-nfs-arm64 2026-05-08 18:58:27,383 - lava_callback - WARNING - Failed to upload log 2026-05-08 18:58:27,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:58:27,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:58:27,477 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe322fe4d4e78cd76b1c06/lava-logs.yaml 2026-05-08 18:58:27,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:58:27,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:58:27,556 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe322fe4d4e78cd76b1c06/lava_callback.json.gz 2026-05-08 18:58:27,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:27,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe322fe4d4e78cd76b1c06 HTTP/1.1" 200 None 2026-05-08 18:58:27,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:27,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 18:58:27,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:27,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe322fe4d4e78cd76b1c06 HTTP/1.1" 200 None 2026-05-08 18:58:27,615 - lava_callback - INFO - Completed processing callback for node 69fe322fe4d4e78cd76b1c06 2026-05-08 18:58:32,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:32,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51528 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:58:39,937 - lava_callback - INFO - Received callback for node 69fb8f59df29cd80ecaa383d INFO: 172.20.0.1:60658 - "POST /node/69fb8f59df29cd80ecaa383d HTTP/1.0" 202 Accepted 2026-05-08 18:58:39,943 - lava_callback - INFO - Starting async job submit for node 69fb8f59df29cd80ecaa383d 2026-05-08 18:58:39,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:39,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8f59df29cd80ecaa383d HTTP/1.1" 200 None 2026-05-08 18:58:39,971 - lava_callback - DEBUG - Processing node 69fb8f59df29cd80ecaa383d: baseline-arm-clabbe 2026-05-08 18:58:39,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8f59df29cd80ecaa383d 2026-05-08 18:58:39,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:39,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8f59df29cd80ecaa383d HTTP/1.1" 200 None 2026-05-08 18:58:39,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:39,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-08 18:58:40,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:58:40,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8f59df29cd80ecaa383d HTTP/1.1" 200 None 2026-05-08 18:58:40,020 - lava_callback - ERROR - Error processing callback for node 69fb8f59df29cd80ecaa383d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57624 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:59:11,521 - lava_callback - INFO - Received callback for node 69fe30b3e4d4e78cd76b1b0b INFO: 172.20.0.1:54246 - "POST /node/69fe30b3e4d4e78cd76b1b0b HTTP/1.0" 202 Accepted 2026-05-08 18:59:11,528 - lava_callback - INFO - Starting async job submit for node 69fe30b3e4d4e78cd76b1b0b 2026-05-08 18:59:11,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:59:11,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe30b3e4d4e78cd76b1b0b HTTP/1.1" 200 None 2026-05-08 18:59:11,584 - lava_callback - DEBUG - Processing node 69fe30b3e4d4e78cd76b1b0b: baseline-arm64 2026-05-08 18:59:11,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:59:12,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:59:12,040 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe30b3e4d4e78cd76b1b0b/log.txt.gz 2026-05-08 18:59:12,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:59:12,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:59:12,398 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe30b3e4d4e78cd76b1b0b/lava-logs.yaml 2026-05-08 18:59:12,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 18:59:12,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 18:59:12,527 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe30b3e4d4e78cd76b1b0b/lava_callback.json.gz DEBUG: Setup failed for 69fe30b3e4d4e78cd76b1b0b. Transitting job node result: incomplete -> fail 2026-05-08 18:59:12,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:59:12,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe30b3e4d4e78cd76b1b0b HTTP/1.1" 200 None 2026-05-08 18:59:12,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:59:12,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 18:59:12,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:59:12,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe30b3e4d4e78cd76b1b0b HTTP/1.1" 200 None 2026-05-08 18:59:12,733 - lava_callback - INFO - Completed processing callback for node 69fe30b3e4d4e78cd76b1b0b INFO: 172.20.0.1:54260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54276 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:59:20,068 - lava_callback - INFO - Received callback for node 69fb8f7edf29cd80ecaa384d INFO: 172.20.0.1:60524 - "POST /node/69fb8f7edf29cd80ecaa384d HTTP/1.0" 202 Accepted 2026-05-08 18:59:20,074 - lava_callback - INFO - Starting async job submit for node 69fb8f7edf29cd80ecaa384d 2026-05-08 18:59:20,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:59:20,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8f7edf29cd80ecaa384d HTTP/1.1" 200 None 2026-05-08 18:59:20,095 - lava_callback - DEBUG - Processing node 69fb8f7edf29cd80ecaa384d: baseline-arm-clabbe 2026-05-08 18:59:20,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8f7edf29cd80ecaa384d 2026-05-08 18:59:20,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:59:20,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8f7edf29cd80ecaa384d HTTP/1.1" 200 None 2026-05-08 18:59:20,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:59:20,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 18:59:20,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:59:20,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8f7edf29cd80ecaa384d HTTP/1.1" 200 None 2026-05-08 18:59:20,184 - lava_callback - ERROR - Error processing callback for node 69fb8f7edf29cd80ecaa384d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60534 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:59:32,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:59:32,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56082 - "GET / HTTP/1.0" 200 OK 2026-05-08 18:59:59,977 - lava_callback - INFO - Received callback for node 69fb8fa5df29cd80ecaa3858 INFO: 172.20.0.1:41580 - "POST /node/69fb8fa5df29cd80ecaa3858 HTTP/1.0" 202 Accepted 2026-05-08 18:59:59,983 - lava_callback - INFO - Starting async job submit for node 69fb8fa5df29cd80ecaa3858 2026-05-08 18:59:59,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 18:59:59,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8fa5df29cd80ecaa3858 HTTP/1.1" 200 None 2026-05-08 19:00:00,000 - lava_callback - DEBUG - Processing node 69fb8fa5df29cd80ecaa3858: baseline-arm-clabbe 2026-05-08 19:00:00,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8fa5df29cd80ecaa3858 2026-05-08 19:00:00,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:00:00,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8fa5df29cd80ecaa3858 HTTP/1.1" 200 None 2026-05-08 19:00:00,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:00:00,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 19:00:00,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:00:00,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8fa5df29cd80ecaa3858 HTTP/1.1" 200 None 2026-05-08 19:00:00,050 - lava_callback - ERROR - Error processing callback for node 69fb8fa5df29cd80ecaa3858: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40258 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:01:00,194 - lava_callback - INFO - Received callback for node 69fb8fe1df29cd80ecaa3868 INFO: 172.20.0.1:37446 - "POST /node/69fb8fe1df29cd80ecaa3868 HTTP/1.0" 202 Accepted 2026-05-08 19:01:00,200 - lava_callback - INFO - Starting async job submit for node 69fb8fe1df29cd80ecaa3868 2026-05-08 19:01:00,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:01:00,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8fe1df29cd80ecaa3868 HTTP/1.1" 200 None 2026-05-08 19:01:00,228 - lava_callback - DEBUG - Processing node 69fb8fe1df29cd80ecaa3868: baseline-arm-clabbe 2026-05-08 19:01:00,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb8fe1df29cd80ecaa3868 2026-05-08 19:01:00,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:01:00,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb8fe1df29cd80ecaa3868 HTTP/1.1" 200 None 2026-05-08 19:01:00,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:01:00,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 19:01:00,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:01:00,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb8fe1df29cd80ecaa3868 HTTP/1.1" 200 None 2026-05-08 19:01:00,274 - lava_callback - ERROR - Error processing callback for node 69fb8fe1df29cd80ecaa3868: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47170 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:01:27,402 - lava_callback - INFO - Received callback for node 69fe32cae4d4e78cd76b1c6c INFO: 172.20.0.1:47178 - "POST /node/69fe32cae4d4e78cd76b1c6c HTTP/1.0" 202 Accepted 2026-05-08 19:01:27,409 - lava_callback - INFO - Starting async job submit for node 69fe32cae4d4e78cd76b1c6c 2026-05-08 19:01:27,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:01:27,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe32cae4d4e78cd76b1c6c HTTP/1.1" 200 None 2026-05-08 19:01:27,453 - lava_callback - DEBUG - Processing node 69fe32cae4d4e78cd76b1c6c: baseline-arm64 2026-05-08 19:01:27,611 - lava_callback - WARNING - Failed to upload log 2026-05-08 19:01:27,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:01:27,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:01:27,843 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe32cae4d4e78cd76b1c6c/lava-logs.yaml 2026-05-08 19:01:27,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:01:27,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:01:27,970 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe32cae4d4e78cd76b1c6c/lava_callback.json.gz 2026-05-08 19:01:28,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:01:28,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe32cae4d4e78cd76b1c6c HTTP/1.1" 200 None 2026-05-08 19:01:28,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:01:28,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 19:01:28,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:01:28,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe32cae4d4e78cd76b1c6c HTTP/1.1" 200 None 2026-05-08 19:01:28,147 - lava_callback - INFO - Completed processing callback for node 69fe32cae4d4e78cd76b1c6c 2026-05-08 19:01:32,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:01:32,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44742 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:02:00,521 - lava_callback - INFO - Received callback for node 69fb901ddf29cd80ecaa3876 INFO: 172.20.0.1:51044 - "POST /node/69fb901ddf29cd80ecaa3876 HTTP/1.0" 202 Accepted 2026-05-08 19:02:00,530 - lava_callback - INFO - Starting async job submit for node 69fb901ddf29cd80ecaa3876 2026-05-08 19:02:00,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:02:00,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb901ddf29cd80ecaa3876 HTTP/1.1" 200 None 2026-05-08 19:02:00,549 - lava_callback - DEBUG - Processing node 69fb901ddf29cd80ecaa3876: baseline-arm-clabbe 2026-05-08 19:02:00,549 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb901ddf29cd80ecaa3876 2026-05-08 19:02:00,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:02:00,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb901ddf29cd80ecaa3876 HTTP/1.1" 200 None 2026-05-08 19:02:00,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:02:00,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 19:02:00,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:02:00,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb901ddf29cd80ecaa3876 HTTP/1.1" 200 None 2026-05-08 19:02:00,612 - lava_callback - ERROR - Error processing callback for node 69fb901ddf29cd80ecaa3876: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41008 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:04:26,694 - lava_callback - INFO - Received callback for node 69fe3370e4d4e78cd76b1cbb INFO: 172.20.0.1:41018 - "POST /node/69fe3370e4d4e78cd76b1cbb HTTP/1.0" 202 Accepted 2026-05-08 19:04:26,701 - lava_callback - INFO - Starting async job submit for node 69fe3370e4d4e78cd76b1cbb 2026-05-08 19:04:26,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:04:26,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3370e4d4e78cd76b1cbb HTTP/1.1" 200 None 2026-05-08 19:04:26,752 - lava_callback - DEBUG - Processing node 69fe3370e4d4e78cd76b1cbb: baseline-arm64 2026-05-08 19:04:26,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:04:27,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:04:27,048 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe3370e4d4e78cd76b1cbb/log.txt.gz 2026-05-08 19:04:27,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:04:27,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:04:27,259 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe3370e4d4e78cd76b1cbb/lava-logs.yaml 2026-05-08 19:04:27,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:04:27,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:04:27,365 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe3370e4d4e78cd76b1cbb/lava_callback.json.gz 2026-05-08 19:04:27,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:04:27,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3370e4d4e78cd76b1cbb HTTP/1.1" 200 None 2026-05-08 19:04:27,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:04:27,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 19:04:27,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:04:27,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3370e4d4e78cd76b1cbb HTTP/1.1" 200 None 2026-05-08 19:04:27,499 - lava_callback - INFO - Completed processing callback for node 69fe3370e4d4e78cd76b1cbb 2026-05-08 19:04:32,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:04:32,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56400 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:09:13,015 - lava_callback - INFO - Received callback for node 69fe3040e4d4e78cd76b1acc INFO: 172.20.0.1:34410 - "POST /node/69fe3040e4d4e78cd76b1acc HTTP/1.0" 202 Accepted 2026-05-08 19:09:13,061 - lava_callback - INFO - Starting async job submit for node 69fe3040e4d4e78cd76b1acc 2026-05-08 19:09:13,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:09:13,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3040e4d4e78cd76b1acc HTTP/1.1" 200 None 2026-05-08 19:09:13,100 - lava_callback - DEBUG - Processing node 69fe3040e4d4e78cd76b1acc: baseline-arm-pengutronix 2026-05-08 19:09:13,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:09:13,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:09:13,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe3040e4d4e78cd76b1acc/log.txt.gz 2026-05-08 19:09:13,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:09:13,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:09:13,510 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe3040e4d4e78cd76b1acc/lava-logs.yaml 2026-05-08 19:09:13,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:09:13,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:09:13,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe3040e4d4e78cd76b1acc/lava_callback.json.gz DEBUG: Setup failed for 69fe3040e4d4e78cd76b1acc. Transitting job node result: incomplete -> fail 2026-05-08 19:09:13,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:09:13,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3040e4d4e78cd76b1acc HTTP/1.1" 200 None 2026-05-08 19:09:13,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:09:13,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 19:09:13,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:09:13,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3040e4d4e78cd76b1acc HTTP/1.1" 200 None 2026-05-08 19:09:13,775 - lava_callback - INFO - Completed processing callback for node 69fe3040e4d4e78cd76b1acc INFO: 172.20.0.1:34412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58666 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:09:32,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:09:32,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42228 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:12:38,237 - lava_callback - INFO - Received callback for node 69fe3559e4d4e78cd76b1de7 INFO: 172.20.0.1:42230 - "POST /node/69fe3559e4d4e78cd76b1de7 HTTP/1.0" 202 Accepted 2026-05-08 19:12:38,248 - lava_callback - INFO - Starting async job submit for node 69fe3559e4d4e78cd76b1de7 2026-05-08 19:12:38,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:12:38,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3559e4d4e78cd76b1de7 HTTP/1.1" 200 None 2026-05-08 19:12:38,301 - lava_callback - DEBUG - Processing node 69fe3559e4d4e78cd76b1de7: baseline-arm64-foundriesio 2026-05-08 19:12:38,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:12:38,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:12:38,871 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe3559e4d4e78cd76b1de7/log.txt.gz 2026-05-08 19:12:39,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:12:39,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:12:39,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe3559e4d4e78cd76b1de7/lava-logs.yaml 2026-05-08 19:12:39,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:12:39,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:12:39,392 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fe3559e4d4e78cd76b1de7/lava_callback.json.gz 2026-05-08 19:12:39,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:12:39,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3559e4d4e78cd76b1de7 HTTP/1.1" 200 None 2026-05-08 19:12:39,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:12:39,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 19:12:39,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:12:39,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3559e4d4e78cd76b1de7 HTTP/1.1" 200 None 2026-05-08 19:12:39,481 - lava_callback - INFO - Completed processing callback for node 69fe3559e4d4e78cd76b1de7 INFO: 172.20.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43356 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:13:02,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:13:02,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55216 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:21:12,095 - lava_callback - INFO - Received callback for node 69fe35e3e4d4e78cd76b1e2c INFO: 172.20.0.1:36216 - "POST /node/69fe35e3e4d4e78cd76b1e2c HTTP/1.0" 202 Accepted 2026-05-08 19:21:12,102 - lava_callback - INFO - Starting async job submit for node 69fe35e3e4d4e78cd76b1e2c 2026-05-08 19:21:12,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:21:12,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe35e3e4d4e78cd76b1e2c HTTP/1.1" 200 None 2026-05-08 19:21:12,153 - lava_callback - DEBUG - Processing node 69fe35e3e4d4e78cd76b1e2c: baseline-arm64 2026-05-08 19:21:12,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:21:12,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:21:12,603 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe35e3e4d4e78cd76b1e2c/log.txt.gz 2026-05-08 19:21:12,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:21:13,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:21:13,068 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe35e3e4d4e78cd76b1e2c/lava-logs.yaml 2026-05-08 19:21:13,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:21:13,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:21:13,193 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe35e3e4d4e78cd76b1e2c/lava_callback.json.gz DEBUG: Setup failed for 69fe35e3e4d4e78cd76b1e2c. Transitting job node result: incomplete -> fail 2026-05-08 19:21:13,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:21:13,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe35e3e4d4e78cd76b1e2c HTTP/1.1" 200 None 2026-05-08 19:21:13,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:21:13,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 19:21:13,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:21:13,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe35e3e4d4e78cd76b1e2c HTTP/1.1" 200 None 2026-05-08 19:21:13,407 - lava_callback - INFO - Completed processing callback for node 69fe35e3e4d4e78cd76b1e2c INFO: 172.20.0.1:36232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38950 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:21:32,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:21:32,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38608 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:30:45,218 - lava_callback - INFO - Received callback for node 69fe35b8e4d4e78cd76b1e16 INFO: 172.20.0.1:41242 - "POST /node/69fe35b8e4d4e78cd76b1e16 HTTP/1.0" 202 Accepted 2026-05-08 19:30:45,225 - lava_callback - INFO - Starting async job submit for node 69fe35b8e4d4e78cd76b1e16 2026-05-08 19:30:45,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:30:45,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe35b8e4d4e78cd76b1e16 HTTP/1.1" 200 None 2026-05-08 19:30:45,300 - lava_callback - DEBUG - Processing node 69fe35b8e4d4e78cd76b1e16: baseline-arm 2026-05-08 19:30:45,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:30:46,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:30:46,005 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fe35b8e4d4e78cd76b1e16/log.txt.gz 2026-05-08 19:30:46,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:30:46,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:30:46,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fe35b8e4d4e78cd76b1e16/lava-logs.yaml INFO: 172.20.0.1:41244 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:30:46,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:30:46,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:30:46,647 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fe35b8e4d4e78cd76b1e16/lava_callback.json.gz DEBUG: Setup failed for 69fe35b8e4d4e78cd76b1e16. Transitting job node result: incomplete -> fail 2026-05-08 19:30:46,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:30:46,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe35b8e4d4e78cd76b1e16 HTTP/1.1" 200 None 2026-05-08 19:30:46,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:30:46,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 19:30:46,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:30:46,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe35b8e4d4e78cd76b1e16 HTTP/1.1" 200 None 2026-05-08 19:30:46,941 - lava_callback - INFO - Completed processing callback for node 69fe35b8e4d4e78cd76b1e16 INFO: 172.20.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51620 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:31:02,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:31:02,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58462 - "GET /node/69efd9218305534e9723d166%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56178 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:33:21,538 - lava_callback - INFO - Received callback for node 69fb9776df29cd80ecaa396a INFO: 172.20.0.1:45844 - "POST /node/69fb9776df29cd80ecaa396a HTTP/1.0" 202 Accepted 2026-05-08 19:33:21,544 - lava_callback - INFO - Starting async job submit for node 69fb9776df29cd80ecaa396a 2026-05-08 19:33:21,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:33:21,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9776df29cd80ecaa396a HTTP/1.1" 200 None 2026-05-08 19:33:21,559 - lava_callback - DEBUG - Processing node 69fb9776df29cd80ecaa396a: baseline-arm64-baylibre 2026-05-08 19:33:21,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb9776df29cd80ecaa396a 2026-05-08 19:33:21,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:33:21,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9776df29cd80ecaa396a HTTP/1.1" 200 None 2026-05-08 19:33:21,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:33:21,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 19:33:21,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:33:21,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb9776df29cd80ecaa396a HTTP/1.1" 200 None 2026-05-08 19:33:21,605 - lava_callback - ERROR - Error processing callback for node 69fb9776df29cd80ecaa396a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39870 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:34:34,519 - lava_callback - INFO - Received callback for node 69fe3637e4d4e78cd76b1e54 INFO: 172.20.0.1:47938 - "POST /node/69fe3637e4d4e78cd76b1e54 HTTP/1.0" 202 Accepted 2026-05-08 19:34:34,566 - lava_callback - INFO - Starting async job submit for node 69fe3637e4d4e78cd76b1e54 2026-05-08 19:34:34,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:34:34,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3637e4d4e78cd76b1e54 HTTP/1.1" 200 None 2026-05-08 19:34:34,614 - lava_callback - DEBUG - Processing node 69fe3637e4d4e78cd76b1e54: baseline-arm-pengutronix 2026-05-08 19:34:34,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:34:34,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:34:34,844 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe3637e4d4e78cd76b1e54/log.txt.gz 2026-05-08 19:34:34,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:34:35,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:34:35,062 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe3637e4d4e78cd76b1e54/lava-logs.yaml 2026-05-08 19:34:35,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:34:35,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:34:35,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fe3637e4d4e78cd76b1e54/lava_callback.json.gz DEBUG: Setup failed for 69fe3637e4d4e78cd76b1e54. Transitting job node result: incomplete -> fail 2026-05-08 19:34:35,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:34:35,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3637e4d4e78cd76b1e54 HTTP/1.1" 200 None 2026-05-08 19:34:35,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:34:35,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 19:34:35,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:34:35,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3637e4d4e78cd76b1e54 HTTP/1.1" 200 None 2026-05-08 19:34:35,312 - lava_callback - INFO - Completed processing callback for node 69fe3637e4d4e78cd76b1e54 INFO: 172.20.0.1:47954 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:34:41,555 - lava_callback - INFO - Received callback for node 69fb97c2df29cd80ecaa398a INFO: 172.20.0.1:41730 - "POST /node/69fb97c2df29cd80ecaa398a HTTP/1.0" 202 Accepted 2026-05-08 19:34:41,560 - lava_callback - INFO - Starting async job submit for node 69fb97c2df29cd80ecaa398a 2026-05-08 19:34:41,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:34:41,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb97c2df29cd80ecaa398a HTTP/1.1" 200 None 2026-05-08 19:34:41,575 - lava_callback - DEBUG - Processing node 69fb97c2df29cd80ecaa398a: baseline-arm64-baylibre 2026-05-08 19:34:41,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb97c2df29cd80ecaa398a 2026-05-08 19:34:41,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:34:41,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb97c2df29cd80ecaa398a HTTP/1.1" 200 None 2026-05-08 19:34:41,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:34:41,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 19:34:41,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:34:41,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb97c2df29cd80ecaa398a HTTP/1.1" 200 None 2026-05-08 19:34:41,631 - lava_callback - ERROR - Error processing callback for node 69fb97c2df29cd80ecaa398a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54918 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:35:02,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:35:02,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54596 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:35:31,111 - lava_callback - INFO - Received callback for node 69fe35dce4d4e78cd76b1e29 INFO: 172.20.0.1:55348 - "POST /node/69fe35dce4d4e78cd76b1e29 HTTP/1.0" 202 Accepted 2026-05-08 19:35:31,121 - lava_callback - INFO - Starting async job submit for node 69fe35dce4d4e78cd76b1e29 2026-05-08 19:35:31,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:35:31,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe35dce4d4e78cd76b1e29 HTTP/1.1" 200 None 2026-05-08 19:35:31,210 - lava_callback - DEBUG - Processing node 69fe35dce4d4e78cd76b1e29: ltp-smoke 2026-05-08 19:35:31,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:35:32,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:35:32,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe35dce4d4e78cd76b1e29/log.txt.gz 2026-05-08 19:35:32,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:35:32,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:35:32,414 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe35dce4d4e78cd76b1e29/lava-logs.yaml 2026-05-08 19:35:32,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:35:32,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:35:32,537 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe35dce4d4e78cd76b1e29/lava_callback.json.gz 2026-05-08 19:35:32,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:35:32,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe35dce4d4e78cd76b1e29 HTTP/1.1" 200 None 2026-05-08 19:35:32,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:35:32,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d2be4d4e78cd76adccc HTTP/1.1" 200 None 2026-05-08 19:35:32,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:35:32,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe35dce4d4e78cd76b1e29 HTTP/1.1" 200 None 2026-05-08 19:35:32,878 - lava_callback - INFO - Completed processing callback for node 69fe35dce4d4e78cd76b1e29 INFO: 172.20.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40176 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:36:01,671 - lava_callback - INFO - Received callback for node 69fb981edf29cd80ecaa39b0 INFO: 172.20.0.1:49658 - "POST /node/69fb981edf29cd80ecaa39b0 HTTP/1.0" 202 Accepted 2026-05-08 19:36:01,677 - lava_callback - INFO - Starting async job submit for node 69fb981edf29cd80ecaa39b0 2026-05-08 19:36:01,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:36:01,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb981edf29cd80ecaa39b0 HTTP/1.1" 200 None 2026-05-08 19:36:01,700 - lava_callback - DEBUG - Processing node 69fb981edf29cd80ecaa39b0: baseline-arm64-baylibre 2026-05-08 19:36:01,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb981edf29cd80ecaa39b0 2026-05-08 19:36:01,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:36:01,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb981edf29cd80ecaa39b0 HTTP/1.1" 200 None 2026-05-08 19:36:01,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:36:01,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 19:36:01,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:36:01,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb981edf29cd80ecaa39b0 HTTP/1.1" 200 None 2026-05-08 19:36:01,752 - lava_callback - ERROR - Error processing callback for node 69fb981edf29cd80ecaa39b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 19:36:02,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:36:02,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37984 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:37:21,765 - lava_callback - INFO - Received callback for node 69fb986edf29cd80ecaa39d5 INFO: 172.20.0.1:37840 - "POST /node/69fb986edf29cd80ecaa39d5 HTTP/1.0" 202 Accepted 2026-05-08 19:37:21,771 - lava_callback - INFO - Starting async job submit for node 69fb986edf29cd80ecaa39d5 2026-05-08 19:37:21,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:37:21,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb986edf29cd80ecaa39d5 HTTP/1.1" 200 None 2026-05-08 19:37:21,799 - lava_callback - DEBUG - Processing node 69fb986edf29cd80ecaa39d5: baseline-arm64-baylibre 2026-05-08 19:37:21,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb986edf29cd80ecaa39d5 2026-05-08 19:37:21,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:37:21,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb986edf29cd80ecaa39d5 HTTP/1.1" 200 None 2026-05-08 19:37:21,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:37:21,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 19:37:21,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:37:21,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb986edf29cd80ecaa39d5 HTTP/1.1" 200 None 2026-05-08 19:37:21,864 - lava_callback - ERROR - Error processing callback for node 69fb986edf29cd80ecaa39d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58896 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:39:01,838 - lava_callback - INFO - Received callback for node 69fb98d4df29cd80ecaa39f8 INFO: 172.20.0.1:53102 - "POST /node/69fb98d4df29cd80ecaa39f8 HTTP/1.0" 202 Accepted 2026-05-08 19:39:01,844 - lava_callback - INFO - Starting async job submit for node 69fb98d4df29cd80ecaa39f8 2026-05-08 19:39:01,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:39:01,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb98d4df29cd80ecaa39f8 HTTP/1.1" 200 None 2026-05-08 19:39:01,861 - lava_callback - DEBUG - Processing node 69fb98d4df29cd80ecaa39f8: baseline-arm64-baylibre 2026-05-08 19:39:01,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb98d4df29cd80ecaa39f8 2026-05-08 19:39:01,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:39:01,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb98d4df29cd80ecaa39f8 HTTP/1.1" 200 None 2026-05-08 19:39:01,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:39:01,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 19:39:01,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:39:01,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb98d4df29cd80ecaa39f8 HTTP/1.1" 200 None 2026-05-08 19:39:01,917 - lava_callback - ERROR - Error processing callback for node 69fb98d4df29cd80ecaa39f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50678 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:41:22,010 - lava_callback - INFO - Received callback for node 69fb994cdf29cd80ecaa3a1c INFO: 172.20.0.1:44952 - "POST /node/69fb994cdf29cd80ecaa3a1c HTTP/1.0" 202 Accepted 2026-05-08 19:41:22,016 - lava_callback - INFO - Starting async job submit for node 69fb994cdf29cd80ecaa3a1c 2026-05-08 19:41:22,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:41:22,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb994cdf29cd80ecaa3a1c HTTP/1.1" 200 None 2026-05-08 19:41:22,031 - lava_callback - DEBUG - Processing node 69fb994cdf29cd80ecaa3a1c: baseline-arm64-baylibre 2026-05-08 19:41:22,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb994cdf29cd80ecaa3a1c 2026-05-08 19:41:22,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:41:22,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb994cdf29cd80ecaa3a1c HTTP/1.1" 200 None 2026-05-08 19:41:22,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:41:22,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 19:41:22,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:41:22,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb994cdf29cd80ecaa3a1c HTTP/1.1" 200 None 2026-05-08 19:41:22,079 - lava_callback - ERROR - Error processing callback for node 69fb994cdf29cd80ecaa3a1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50022 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:42:41,830 - lava_callback - INFO - Received callback for node 69fb999edf29cd80ecaa3a41 INFO: 172.20.0.1:34706 - "POST /node/69fb999edf29cd80ecaa3a41 HTTP/1.0" 202 Accepted 2026-05-08 19:42:41,835 - lava_callback - INFO - Starting async job submit for node 69fb999edf29cd80ecaa3a41 2026-05-08 19:42:41,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:42:41,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb999edf29cd80ecaa3a41 HTTP/1.1" 200 None 2026-05-08 19:42:41,851 - lava_callback - DEBUG - Processing node 69fb999edf29cd80ecaa3a41: baseline-arm64-clabbe 2026-05-08 19:42:41,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb999edf29cd80ecaa3a41 2026-05-08 19:42:41,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:42:41,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb999edf29cd80ecaa3a41 HTTP/1.1" 200 None 2026-05-08 19:42:41,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:42:41,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 19:42:41,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:42:41,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb999edf29cd80ecaa3a41 HTTP/1.1" 200 None 2026-05-08 19:42:41,918 - lava_callback - ERROR - Error processing callback for node 69fb999edf29cd80ecaa3a41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38410 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:43:57,426 - lava_callback - INFO - Received callback for node 69fe3190e4d4e78cd76b1b7b INFO: 172.20.0.1:38426 - "POST /node/69fe3190e4d4e78cd76b1b7b HTTP/1.0" 202 Accepted 2026-05-08 19:43:57,437 - lava_callback - INFO - Starting async job submit for node 69fe3190e4d4e78cd76b1b7b 2026-05-08 19:43:57,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:43:57,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3190e4d4e78cd76b1b7b HTTP/1.1" 200 None 2026-05-08 19:43:57,498 - lava_callback - DEBUG - Processing node 69fe3190e4d4e78cd76b1b7b: baseline-nfs-arm64 2026-05-08 19:43:58,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:43:58,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:43:58,751 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe3190e4d4e78cd76b1b7b/log.txt.gz 2026-05-08 19:43:59,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:43:59,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:43:59,590 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe3190e4d4e78cd76b1b7b/lava-logs.yaml 2026-05-08 19:43:59,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:43:59,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:43:59,732 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe3190e4d4e78cd76b1b7b/lava_callback.json.gz DEBUG: Setup failed for 69fe3190e4d4e78cd76b1b7b. Transitting job node result: incomplete -> fail 2026-05-08 19:43:59,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:43:59,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3190e4d4e78cd76b1b7b HTTP/1.1" 200 None 2026-05-08 19:43:59,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:43:59,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 19:43:59,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:43:59,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3190e4d4e78cd76b1b7b HTTP/1.1" 200 None 2026-05-08 19:43:59,954 - lava_callback - INFO - Completed processing callback for node 69fe3190e4d4e78cd76b1b7b 2026-05-08 19:44:02,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:44:02,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58724 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:44:21,889 - lava_callback - INFO - Received callback for node 69fb9a06df29cd80ecaa3a6a INFO: 172.20.0.1:39740 - "POST /node/69fb9a06df29cd80ecaa3a6a HTTP/1.0" 202 Accepted 2026-05-08 19:44:21,895 - lava_callback - INFO - Starting async job submit for node 69fb9a06df29cd80ecaa3a6a 2026-05-08 19:44:21,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:44:21,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9a06df29cd80ecaa3a6a HTTP/1.1" 200 None 2026-05-08 19:44:21,912 - lava_callback - DEBUG - Processing node 69fb9a06df29cd80ecaa3a6a: baseline-arm64-clabbe 2026-05-08 19:44:21,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb9a06df29cd80ecaa3a6a 2026-05-08 19:44:21,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:44:21,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9a06df29cd80ecaa3a6a HTTP/1.1" 200 None 2026-05-08 19:44:21,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:44:21,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 19:44:21,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:44:21,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb9a06df29cd80ecaa3a6a HTTP/1.1" 200 None 2026-05-08 19:44:21,966 - lava_callback - ERROR - Error processing callback for node 69fb9a06df29cd80ecaa3a6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44930 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:45:41,864 - lava_callback - INFO - Received callback for node 69fb9a53df29cd80ecaa3a86 INFO: 172.20.0.1:44918 - "POST /node/69fb9a53df29cd80ecaa3a86 HTTP/1.0" 202 Accepted 2026-05-08 19:45:41,870 - lava_callback - INFO - Starting async job submit for node 69fb9a53df29cd80ecaa3a86 2026-05-08 19:45:41,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:45:41,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9a53df29cd80ecaa3a86 HTTP/1.1" 200 None 2026-05-08 19:45:41,886 - lava_callback - DEBUG - Processing node 69fb9a53df29cd80ecaa3a86: baseline-arm64-clabbe 2026-05-08 19:45:41,887 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb9a53df29cd80ecaa3a86 2026-05-08 19:45:41,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:45:41,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9a53df29cd80ecaa3a86 HTTP/1.1" 200 None 2026-05-08 19:45:41,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:45:41,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 19:45:41,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:45:41,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb9a53df29cd80ecaa3a86 HTTP/1.1" 200 None 2026-05-08 19:45:41,957 - lava_callback - ERROR - Error processing callback for node 69fb9a53df29cd80ecaa3a86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47204 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:47:21,930 - lava_callback - INFO - Received callback for node 69fb9abbdf29cd80ecaa3aaf INFO: 172.20.0.1:45234 - "POST /node/69fb9abbdf29cd80ecaa3aaf HTTP/1.0" 202 Accepted 2026-05-08 19:47:21,936 - lava_callback - INFO - Starting async job submit for node 69fb9abbdf29cd80ecaa3aaf 2026-05-08 19:47:21,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:47:21,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9abbdf29cd80ecaa3aaf HTTP/1.1" 200 None 2026-05-08 19:47:21,952 - lava_callback - DEBUG - Processing node 69fb9abbdf29cd80ecaa3aaf: baseline-arm64-clabbe 2026-05-08 19:47:21,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb9abbdf29cd80ecaa3aaf 2026-05-08 19:47:21,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:47:21,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9abbdf29cd80ecaa3aaf HTTP/1.1" 200 None 2026-05-08 19:47:21,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:47:21,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 19:47:21,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:47:22,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb9abbdf29cd80ecaa3aaf HTTP/1.1" 200 None 2026-05-08 19:47:22,007 - lava_callback - ERROR - Error processing callback for node 69fb9abbdf29cd80ecaa3aaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40860 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:48:42,017 - lava_callback - INFO - Received callback for node 69fb9b06df29cd80ecaa3acb INFO: 172.20.0.1:55984 - "POST /node/69fb9b06df29cd80ecaa3acb HTTP/1.0" 202 Accepted 2026-05-08 19:48:42,023 - lava_callback - INFO - Starting async job submit for node 69fb9b06df29cd80ecaa3acb 2026-05-08 19:48:42,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:48:42,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9b06df29cd80ecaa3acb HTTP/1.1" 200 None 2026-05-08 19:48:42,038 - lava_callback - DEBUG - Processing node 69fb9b06df29cd80ecaa3acb: baseline-arm64-clabbe 2026-05-08 19:48:42,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb9b06df29cd80ecaa3acb 2026-05-08 19:48:42,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:48:42,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9b06df29cd80ecaa3acb HTTP/1.1" 200 None 2026-05-08 19:48:42,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:48:42,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 19:48:42,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:48:42,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb9b06df29cd80ecaa3acb HTTP/1.1" 200 None 2026-05-08 19:48:42,086 - lava_callback - ERROR - Error processing callback for node 69fb9b06df29cd80ecaa3acb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54588 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:50:02,007 - lava_callback - INFO - Received callback for node 69fb9b56df29cd80ecaa3af0 INFO: 172.20.0.1:40224 - "POST /node/69fb9b56df29cd80ecaa3af0 HTTP/1.0" 202 Accepted 2026-05-08 19:50:02,012 - lava_callback - INFO - Starting async job submit for node 69fb9b56df29cd80ecaa3af0 2026-05-08 19:50:02,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:50:02,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9b56df29cd80ecaa3af0 HTTP/1.1" 200 None 2026-05-08 19:50:02,029 - lava_callback - DEBUG - Processing node 69fb9b56df29cd80ecaa3af0: baseline-arm64-clabbe 2026-05-08 19:50:02,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb9b56df29cd80ecaa3af0 2026-05-08 19:50:02,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:50:02,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb9b56df29cd80ecaa3af0 HTTP/1.1" 200 None 2026-05-08 19:50:02,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:50:02,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 19:50:02,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:50:02,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb9b56df29cd80ecaa3af0 HTTP/1.1" 200 None 2026-05-08 19:50:02,088 - lava_callback - ERROR - Error processing callback for node 69fb9b56df29cd80ecaa3af0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42834 - "GET /node/6986240f177ca0f097bd1c31%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52766 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:55:25,581 - lava_callback - INFO - Received callback for node 69fe2eefe4d4e78cd76b19f5 INFO: 172.20.0.1:35768 - "POST /node/69fe2eefe4d4e78cd76b19f5 HTTP/1.0" 202 Accepted 2026-05-08 19:55:25,588 - lava_callback - INFO - Starting async job submit for node 69fe2eefe4d4e78cd76b19f5 2026-05-08 19:55:25,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:55:25,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2eefe4d4e78cd76b19f5 HTTP/1.1" 200 None 2026-05-08 19:55:25,630 - lava_callback - DEBUG - Processing node 69fe2eefe4d4e78cd76b19f5: baseline-nfs-arm64 2026-05-08 19:55:26,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:55:26,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:55:26,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe2eefe4d4e78cd76b19f5/log.txt.gz INFO: 172.20.0.1:35784 - "GET / HTTP/1.0" 200 OK 2026-05-08 19:55:26,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:55:26,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:55:26,727 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe2eefe4d4e78cd76b19f5/lava-logs.yaml 2026-05-08 19:55:26,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 19:55:26,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 19:55:26,867 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe2eefe4d4e78cd76b19f5/lava_callback.json.gz 2026-05-08 19:55:26,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:55:26,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2eefe4d4e78cd76b19f5 HTTP/1.1" 200 None 2026-05-08 19:55:26,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:55:26,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 19:55:26,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:55:26,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2eefe4d4e78cd76b19f5 HTTP/1.1" 200 None 2026-05-08 19:55:26,992 - lava_callback - INFO - Completed processing callback for node 69fe2eefe4d4e78cd76b19f5 2026-05-08 19:55:32,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 19:55:32,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51716 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:04:08,675 - lava_callback - INFO - Received callback for node 69fe342fe4d4e78cd76b1d41 INFO: 172.20.0.1:51732 - "POST /node/69fe342fe4d4e78cd76b1d41 HTTP/1.0" 202 Accepted 2026-05-08 20:04:08,682 - lava_callback - INFO - Starting async job submit for node 69fe342fe4d4e78cd76b1d41 2026-05-08 20:04:08,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:04:08,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe342fe4d4e78cd76b1d41 HTTP/1.1" 200 None 2026-05-08 20:04:08,728 - lava_callback - DEBUG - Processing node 69fe342fe4d4e78cd76b1d41: baseline-arm64 2026-05-08 20:04:08,816 - lava_callback - INFO - Received callback for node 69fe3d08e4d4e78cd76b207d INFO: 172.20.0.1:51746 - "POST /node/69fe3d08e4d4e78cd76b207d HTTP/1.0" 202 Accepted 2026-05-08 20:04:08,856 - lava_callback - INFO - Starting async job submit for node 69fe3d08e4d4e78cd76b207d 2026-05-08 20:04:08,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:04:09,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3d08e4d4e78cd76b207d HTTP/1.1" 200 None 2026-05-08 20:04:09,097 - lava_callback - DEBUG - Processing node 69fe3d08e4d4e78cd76b207d: baseline-nfs-arm64 2026-05-08 20:04:09,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:04:09,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:04:09,983 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe342fe4d4e78cd76b1d41/log.txt.gz 2026-05-08 20:04:10,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:04:10,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:04:10,871 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe342fe4d4e78cd76b1d41/lava-logs.yaml 2026-05-08 20:04:10,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:04:10,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:04:11,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:04:11,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:04:11,009 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe3d08e4d4e78cd76b207d/log.txt.gz 2026-05-08 20:04:11,009 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe342fe4d4e78cd76b1d41/lava_callback.json.gz 2026-05-08 20:04:11,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:04:11,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe342fe4d4e78cd76b1d41 HTTP/1.1" 200 None 2026-05-08 20:04:11,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:04:11,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 20:04:11,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:04:11,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe342fe4d4e78cd76b1d41 HTTP/1.1" 200 None 2026-05-08 20:04:11,443 - lava_callback - INFO - Completed processing callback for node 69fe342fe4d4e78cd76b1d41 2026-05-08 20:04:11,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:04:11,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:04:11,977 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe3d08e4d4e78cd76b207d/lava-logs.yaml 2026-05-08 20:04:11,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:04:12,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:04:12,131 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe3d08e4d4e78cd76b207d/lava_callback.json.gz DEBUG: Setup failed for 69fe3d08e4d4e78cd76b207d. Transitting job node result: incomplete -> fail 2026-05-08 20:04:12,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:04:12,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3d08e4d4e78cd76b207d HTTP/1.1" 200 None 2026-05-08 20:04:12,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:04:12,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 20:04:12,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:04:12,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3d08e4d4e78cd76b207d HTTP/1.1" 200 None 2026-05-08 20:04:12,350 - lava_callback - INFO - Completed processing callback for node 69fe3d08e4d4e78cd76b207d INFO: 172.20.0.1:43220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35542 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:04:32,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:04:32,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40364 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:16:00,025 - lava_callback - INFO - Received callback for node 69fe3fb9e4d4e78cd76b20fe INFO: 172.20.0.1:48984 - "POST /node/69fe3fb9e4d4e78cd76b20fe HTTP/1.0" 202 Accepted 2026-05-08 20:16:00,032 - lava_callback - INFO - Starting async job submit for node 69fe3fb9e4d4e78cd76b20fe 2026-05-08 20:16:00,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:16:00,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3fb9e4d4e78cd76b20fe HTTP/1.1" 200 None 2026-05-08 20:16:00,073 - lava_callback - DEBUG - Processing node 69fe3fb9e4d4e78cd76b20fe: baseline-nfs-arm64 2026-05-08 20:16:00,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:16:00,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:16:00,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe3fb9e4d4e78cd76b20fe/log.txt.gz 2026-05-08 20:16:01,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:16:01,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:16:01,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe3fb9e4d4e78cd76b20fe/lava-logs.yaml 2026-05-08 20:16:01,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:16:01,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:16:01,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe3fb9e4d4e78cd76b20fe/lava_callback.json.gz 2026-05-08 20:16:01,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:16:01,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3fb9e4d4e78cd76b20fe HTTP/1.1" 200 None 2026-05-08 20:16:01,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:16:01,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 20:16:01,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:16:01,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3fb9e4d4e78cd76b20fe HTTP/1.1" 200 None 2026-05-08 20:16:01,458 - lava_callback - INFO - Completed processing callback for node 69fe3fb9e4d4e78cd76b20fe 2026-05-08 20:16:02,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:16:02,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57394 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:19:54,198 - lava_callback - INFO - Received callback for node 69fe41c1e4d4e78cd76b212c INFO: 172.20.0.1:48188 - "POST /node/69fe41c1e4d4e78cd76b212c HTTP/1.0" 202 Accepted 2026-05-08 20:19:54,204 - lava_callback - INFO - Starting async job submit for node 69fe41c1e4d4e78cd76b212c 2026-05-08 20:19:54,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:19:54,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe41c1e4d4e78cd76b212c HTTP/1.1" 200 None 2026-05-08 20:19:54,249 - lava_callback - DEBUG - Processing node 69fe41c1e4d4e78cd76b212c: baseline-arm64 INFO: 172.20.0.1:48198 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:19:54,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:19:54,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:19:54,904 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe41c1e4d4e78cd76b212c/log.txt.gz 2026-05-08 20:19:55,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:19:55,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:19:55,337 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe41c1e4d4e78cd76b212c/lava-logs.yaml 2026-05-08 20:19:55,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:19:55,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:19:55,478 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe41c1e4d4e78cd76b212c/lava_callback.json.gz 2026-05-08 20:19:55,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:19:55,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe41c1e4d4e78cd76b212c HTTP/1.1" 200 None 2026-05-08 20:19:55,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:19:55,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 20:19:55,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:19:55,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe41c1e4d4e78cd76b212c HTTP/1.1" 200 None 2026-05-08 20:19:55,650 - lava_callback - INFO - Completed processing callback for node 69fe41c1e4d4e78cd76b212c INFO: 172.20.0.1:48206 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:20:02,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:20:02,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37382 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:26:50,452 - lava_callback - INFO - Received callback for node 69fe448ce4d4e78cd76b2161 INFO: 172.20.0.1:44772 - "POST /node/69fe448ce4d4e78cd76b2161 HTTP/1.0" 202 Accepted 2026-05-08 20:26:50,459 - lava_callback - INFO - Starting async job submit for node 69fe448ce4d4e78cd76b2161 2026-05-08 20:26:50,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:26:50,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe448ce4d4e78cd76b2161 HTTP/1.1" 200 None 2026-05-08 20:26:50,512 - lava_callback - DEBUG - Processing node 69fe448ce4d4e78cd76b2161: baseline-nfs-arm64 2026-05-08 20:26:51,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:26:51,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:26:51,423 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe448ce4d4e78cd76b2161/log.txt.gz 2026-05-08 20:26:51,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:26:51,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:26:51,854 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe448ce4d4e78cd76b2161/lava-logs.yaml 2026-05-08 20:26:51,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 20:26:52,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 20:26:52,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe448ce4d4e78cd76b2161/lava_callback.json.gz 2026-05-08 20:26:52,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:26:52,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe448ce4d4e78cd76b2161 HTTP/1.1" 200 None 2026-05-08 20:26:52,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:26:52,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-08 20:26:52,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:26:52,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe448ce4d4e78cd76b2161 HTTP/1.1" 200 None 2026-05-08 20:26:52,172 - lava_callback - INFO - Completed processing callback for node 69fe448ce4d4e78cd76b2161 INFO: 172.20.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44782 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:27:02,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:27:02,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56938 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:39:05,258 - lava_callback - INFO - Received callback for node 69fba6dedf29cd80ecaa3b81 INFO: 172.20.0.1:40900 - "POST /node/69fba6dedf29cd80ecaa3b81 HTTP/1.0" 202 Accepted 2026-05-08 20:39:05,263 - lava_callback - INFO - Starting async job submit for node 69fba6dedf29cd80ecaa3b81 2026-05-08 20:39:05,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:39:05,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba6dedf29cd80ecaa3b81 HTTP/1.1" 200 None 2026-05-08 20:39:05,286 - lava_callback - DEBUG - Processing node 69fba6dedf29cd80ecaa3b81: baseline-arm-baylibre 2026-05-08 20:39:05,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba6dedf29cd80ecaa3b81 2026-05-08 20:39:05,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:39:05,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba6dedf29cd80ecaa3b81 HTTP/1.1" 200 None 2026-05-08 20:39:05,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:39:05,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:39:05,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:39:05,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba6dedf29cd80ecaa3b81 HTTP/1.1" 200 None 2026-05-08 20:39:05,340 - lava_callback - ERROR - Error processing callback for node 69fba6dedf29cd80ecaa3b81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47210 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:39:45,115 - lava_callback - INFO - Received callback for node 69fba703df29cd80ecaa3b92 INFO: 172.20.0.1:60410 - "POST /node/69fba703df29cd80ecaa3b92 HTTP/1.0" 202 Accepted 2026-05-08 20:39:45,120 - lava_callback - INFO - Starting async job submit for node 69fba703df29cd80ecaa3b92 2026-05-08 20:39:45,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:39:45,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba703df29cd80ecaa3b92 HTTP/1.1" 200 None 2026-05-08 20:39:45,135 - lava_callback - DEBUG - Processing node 69fba703df29cd80ecaa3b92: baseline-arm-baylibre 2026-05-08 20:39:45,136 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba703df29cd80ecaa3b92 2026-05-08 20:39:45,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:39:45,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba703df29cd80ecaa3b92 HTTP/1.1" 200 None 2026-05-08 20:39:45,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:39:45,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:39:45,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:39:45,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba703df29cd80ecaa3b92 HTTP/1.1" 200 None 2026-05-08 20:39:45,196 - lava_callback - ERROR - Error processing callback for node 69fba703df29cd80ecaa3b92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48022 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:41:05,196 - lava_callback - INFO - Received callback for node 69fba755df29cd80ecaa3b9f INFO: 172.20.0.1:56536 - "POST /node/69fba755df29cd80ecaa3b9f HTTP/1.0" 202 Accepted 2026-05-08 20:41:05,202 - lava_callback - INFO - Starting async job submit for node 69fba755df29cd80ecaa3b9f 2026-05-08 20:41:05,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:41:05,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba755df29cd80ecaa3b9f HTTP/1.1" 200 None 2026-05-08 20:41:05,225 - lava_callback - DEBUG - Processing node 69fba755df29cd80ecaa3b9f: baseline-arm-baylibre 2026-05-08 20:41:05,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba755df29cd80ecaa3b9f 2026-05-08 20:41:05,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:41:05,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba755df29cd80ecaa3b9f HTTP/1.1" 200 None 2026-05-08 20:41:05,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:41:05,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:41:05,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:41:05,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba755df29cd80ecaa3b9f HTTP/1.1" 200 None 2026-05-08 20:41:05,271 - lava_callback - ERROR - Error processing callback for node 69fba755df29cd80ecaa3b9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34384 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:43:05,438 - lava_callback - INFO - Received callback for node 69fba7cedf29cd80ecaa3baf INFO: 172.20.0.1:56960 - "POST /node/69fba7cedf29cd80ecaa3baf HTTP/1.0" 202 Accepted 2026-05-08 20:43:05,444 - lava_callback - INFO - Starting async job submit for node 69fba7cedf29cd80ecaa3baf 2026-05-08 20:43:05,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:43:05,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba7cedf29cd80ecaa3baf HTTP/1.1" 200 None 2026-05-08 20:43:05,459 - lava_callback - DEBUG - Processing node 69fba7cedf29cd80ecaa3baf: baseline-arm-baylibre 2026-05-08 20:43:05,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba7cedf29cd80ecaa3baf 2026-05-08 20:43:05,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:43:05,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba7cedf29cd80ecaa3baf HTTP/1.1" 200 None 2026-05-08 20:43:05,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:43:05,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:43:05,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:43:05,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba7cedf29cd80ecaa3baf HTTP/1.1" 200 None 2026-05-08 20:43:05,508 - lava_callback - ERROR - Error processing callback for node 69fba7cedf29cd80ecaa3baf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55588 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:44:05,365 - lava_callback - INFO - Received callback for node 69fba80bdf29cd80ecaa3bbe INFO: 172.20.0.1:47722 - "POST /node/69fba80bdf29cd80ecaa3bbe HTTP/1.0" 202 Accepted 2026-05-08 20:44:05,371 - lava_callback - INFO - Starting async job submit for node 69fba80bdf29cd80ecaa3bbe 2026-05-08 20:44:05,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:44:05,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba80bdf29cd80ecaa3bbe HTTP/1.1" 200 None 2026-05-08 20:44:05,400 - lava_callback - DEBUG - Processing node 69fba80bdf29cd80ecaa3bbe: baseline-arm-baylibre 2026-05-08 20:44:05,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba80bdf29cd80ecaa3bbe 2026-05-08 20:44:05,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:44:05,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba80bdf29cd80ecaa3bbe HTTP/1.1" 200 None 2026-05-08 20:44:05,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:44:05,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:44:05,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:44:05,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba80bdf29cd80ecaa3bbe HTTP/1.1" 200 None 2026-05-08 20:44:05,449 - lava_callback - ERROR - Error processing callback for node 69fba80bdf29cd80ecaa3bbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55264 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:44:45,729 - lava_callback - INFO - Received callback for node 69fba831df29cd80ecaa3bca INFO: 172.20.0.1:41756 - "POST /node/69fba831df29cd80ecaa3bca HTTP/1.0" 202 Accepted 2026-05-08 20:44:45,735 - lava_callback - INFO - Starting async job submit for node 69fba831df29cd80ecaa3bca 2026-05-08 20:44:45,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:44:45,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba831df29cd80ecaa3bca HTTP/1.1" 200 None 2026-05-08 20:44:45,750 - lava_callback - DEBUG - Processing node 69fba831df29cd80ecaa3bca: baseline-arm-baylibre 2026-05-08 20:44:45,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba831df29cd80ecaa3bca 2026-05-08 20:44:45,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:44:45,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba831df29cd80ecaa3bca HTTP/1.1" 200 None 2026-05-08 20:44:45,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:44:45,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:44:45,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:44:45,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba831df29cd80ecaa3bca HTTP/1.1" 200 None 2026-05-08 20:44:45,797 - lava_callback - ERROR - Error processing callback for node 69fba831df29cd80ecaa3bca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51846 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:48:04,584 - lava_callback - INFO - Received callback for node 69fba8f2df29cd80ecaa3c0c INFO: 172.20.0.1:60796 - "POST /node/69fba8f2df29cd80ecaa3c0c HTTP/1.0" 202 Accepted 2026-05-08 20:48:04,590 - lava_callback - INFO - Starting async job submit for node 69fba8f2df29cd80ecaa3c0c 2026-05-08 20:48:04,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:48:04,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba8f2df29cd80ecaa3c0c HTTP/1.1" 200 None 2026-05-08 20:48:04,619 - lava_callback - DEBUG - Processing node 69fba8f2df29cd80ecaa3c0c: baseline-arm-clabbe 2026-05-08 20:48:04,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba8f2df29cd80ecaa3c0c 2026-05-08 20:48:04,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:48:04,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba8f2df29cd80ecaa3c0c HTTP/1.1" 200 None 2026-05-08 20:48:04,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:48:04,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-08 20:48:04,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:48:04,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba8f2df29cd80ecaa3c0c HTTP/1.1" 200 None 2026-05-08 20:48:04,674 - lava_callback - ERROR - Error processing callback for node 69fba8f2df29cd80ecaa3c0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59210 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:48:44,557 - lava_callback - INFO - Received callback for node 69fba91bdf29cd80ecaa3c1d INFO: 172.20.0.1:33782 - "POST /node/69fba91bdf29cd80ecaa3c1d HTTP/1.0" 202 Accepted 2026-05-08 20:48:44,563 - lava_callback - INFO - Starting async job submit for node 69fba91bdf29cd80ecaa3c1d 2026-05-08 20:48:44,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:48:44,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba91bdf29cd80ecaa3c1d HTTP/1.1" 200 None 2026-05-08 20:48:44,583 - lava_callback - DEBUG - Processing node 69fba91bdf29cd80ecaa3c1d: baseline-arm-clabbe 2026-05-08 20:48:44,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba91bdf29cd80ecaa3c1d 2026-05-08 20:48:44,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:48:44,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba91bdf29cd80ecaa3c1d HTTP/1.1" 200 None 2026-05-08 20:48:44,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:48:44,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-08 20:48:44,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:48:44,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba91bdf29cd80ecaa3c1d HTTP/1.1" 200 None 2026-05-08 20:48:44,628 - lava_callback - ERROR - Error processing callback for node 69fba91bdf29cd80ecaa3c1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41940 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:49:24,585 - lava_callback - INFO - Received callback for node 69fba943df29cd80ecaa3c36 INFO: 172.20.0.1:48696 - "POST /node/69fba943df29cd80ecaa3c36 HTTP/1.0" 202 Accepted 2026-05-08 20:49:24,591 - lava_callback - INFO - Starting async job submit for node 69fba943df29cd80ecaa3c36 2026-05-08 20:49:24,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:49:24,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba943df29cd80ecaa3c36 HTTP/1.1" 200 None 2026-05-08 20:49:24,609 - lava_callback - DEBUG - Processing node 69fba943df29cd80ecaa3c36: baseline-arm-clabbe 2026-05-08 20:49:24,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba943df29cd80ecaa3c36 2026-05-08 20:49:24,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:49:24,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba943df29cd80ecaa3c36 HTTP/1.1" 200 None 2026-05-08 20:49:24,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:49:24,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-08 20:49:24,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:49:24,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba943df29cd80ecaa3c36 HTTP/1.1" 200 None 2026-05-08 20:49:24,669 - lava_callback - ERROR - Error processing callback for node 69fba943df29cd80ecaa3c36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50904 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:50:04,794 - lava_callback - INFO - Received callback for node 69fba96bdf29cd80ecaa3c43 INFO: 172.20.0.1:53060 - "POST /node/69fba96bdf29cd80ecaa3c43 HTTP/1.0" 202 Accepted 2026-05-08 20:50:04,800 - lava_callback - INFO - Starting async job submit for node 69fba96bdf29cd80ecaa3c43 2026-05-08 20:50:04,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:50:04,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba96bdf29cd80ecaa3c43 HTTP/1.1" 200 None 2026-05-08 20:50:04,815 - lava_callback - DEBUG - Processing node 69fba96bdf29cd80ecaa3c43: baseline-arm-clabbe 2026-05-08 20:50:04,816 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba96bdf29cd80ecaa3c43 2026-05-08 20:50:04,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:50:04,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba96bdf29cd80ecaa3c43 HTTP/1.1" 200 None 2026-05-08 20:50:04,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:50:04,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-08 20:50:04,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:50:04,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba96bdf29cd80ecaa3c43 HTTP/1.1" 200 None 2026-05-08 20:50:04,861 - lava_callback - ERROR - Error processing callback for node 69fba96bdf29cd80ecaa3c43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59472 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:50:44,672 - lava_callback - INFO - Received callback for node 69fba992df29cd80ecaa3c55 INFO: 172.20.0.1:38982 - "POST /node/69fba992df29cd80ecaa3c55 HTTP/1.0" 202 Accepted 2026-05-08 20:50:44,677 - lava_callback - INFO - Starting async job submit for node 69fba992df29cd80ecaa3c55 2026-05-08 20:50:44,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:50:44,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba992df29cd80ecaa3c55 HTTP/1.1" 200 None 2026-05-08 20:50:44,692 - lava_callback - DEBUG - Processing node 69fba992df29cd80ecaa3c55: baseline-arm-clabbe 2026-05-08 20:50:44,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba992df29cd80ecaa3c55 2026-05-08 20:50:44,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:50:44,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba992df29cd80ecaa3c55 HTTP/1.1" 200 None 2026-05-08 20:50:44,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:50:44,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-08 20:50:44,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:50:44,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba992df29cd80ecaa3c55 HTTP/1.1" 200 None 2026-05-08 20:50:44,737 - lava_callback - ERROR - Error processing callback for node 69fba992df29cd80ecaa3c55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36746 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:51:24,608 - lava_callback - INFO - Received callback for node 69fba9badf29cd80ecaa3c65 INFO: 172.20.0.1:55154 - "POST /node/69fba9badf29cd80ecaa3c65 HTTP/1.0" 202 Accepted 2026-05-08 20:51:24,614 - lava_callback - INFO - Starting async job submit for node 69fba9badf29cd80ecaa3c65 2026-05-08 20:51:24,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:51:24,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba9badf29cd80ecaa3c65 HTTP/1.1" 200 None 2026-05-08 20:51:24,637 - lava_callback - DEBUG - Processing node 69fba9badf29cd80ecaa3c65: baseline-arm-clabbe 2026-05-08 20:51:24,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba9badf29cd80ecaa3c65 2026-05-08 20:51:24,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:51:24,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba9badf29cd80ecaa3c65 HTTP/1.1" 200 None 2026-05-08 20:51:24,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:51:24,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-08 20:51:24,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:51:24,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba9badf29cd80ecaa3c65 HTTP/1.1" 200 None 2026-05-08 20:51:24,684 - lava_callback - ERROR - Error processing callback for node 69fba9badf29cd80ecaa3c65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57188 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:52:04,654 - lava_callback - INFO - Received callback for node 69fba9e2df29cd80ecaa3c6e INFO: 172.20.0.1:57738 - "POST /node/69fba9e2df29cd80ecaa3c6e HTTP/1.0" 202 Accepted 2026-05-08 20:52:04,660 - lava_callback - INFO - Starting async job submit for node 69fba9e2df29cd80ecaa3c6e 2026-05-08 20:52:04,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:52:04,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba9e2df29cd80ecaa3c6e HTTP/1.1" 200 None 2026-05-08 20:52:04,675 - lava_callback - DEBUG - Processing node 69fba9e2df29cd80ecaa3c6e: baseline-arm-clabbe 2026-05-08 20:52:04,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fba9e2df29cd80ecaa3c6e 2026-05-08 20:52:04,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:52:04,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fba9e2df29cd80ecaa3c6e HTTP/1.1" 200 None 2026-05-08 20:52:04,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:52:04,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:52:04,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:52:04,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fba9e2df29cd80ecaa3c6e HTTP/1.1" 200 None 2026-05-08 20:52:04,736 - lava_callback - ERROR - Error processing callback for node 69fba9e2df29cd80ecaa3c6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39794 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:52:44,727 - lava_callback - INFO - Received callback for node 69fbaa09df29cd80ecaa3c7e INFO: 172.20.0.1:60392 - "POST /node/69fbaa09df29cd80ecaa3c7e HTTP/1.0" 202 Accepted 2026-05-08 20:52:44,732 - lava_callback - INFO - Starting async job submit for node 69fbaa09df29cd80ecaa3c7e 2026-05-08 20:52:44,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:52:44,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaa09df29cd80ecaa3c7e HTTP/1.1" 200 None 2026-05-08 20:52:44,750 - lava_callback - DEBUG - Processing node 69fbaa09df29cd80ecaa3c7e: baseline-arm-clabbe 2026-05-08 20:52:44,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbaa09df29cd80ecaa3c7e 2026-05-08 20:52:44,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:52:44,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaa09df29cd80ecaa3c7e HTTP/1.1" 200 None 2026-05-08 20:52:44,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:52:44,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:52:44,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:52:44,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbaa09df29cd80ecaa3c7e HTTP/1.1" 200 None 2026-05-08 20:52:44,806 - lava_callback - ERROR - Error processing callback for node 69fbaa09df29cd80ecaa3c7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36148 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:53:24,760 - lava_callback - INFO - Received callback for node 69fbaa30df29cd80ecaa3c8c INFO: 172.20.0.1:41524 - "POST /node/69fbaa30df29cd80ecaa3c8c HTTP/1.0" 202 Accepted 2026-05-08 20:53:24,766 - lava_callback - INFO - Starting async job submit for node 69fbaa30df29cd80ecaa3c8c 2026-05-08 20:53:24,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:53:24,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaa30df29cd80ecaa3c8c HTTP/1.1" 200 None 2026-05-08 20:53:24,784 - lava_callback - DEBUG - Processing node 69fbaa30df29cd80ecaa3c8c: baseline-arm-clabbe 2026-05-08 20:53:24,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbaa30df29cd80ecaa3c8c 2026-05-08 20:53:24,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:53:24,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaa30df29cd80ecaa3c8c HTTP/1.1" 200 None 2026-05-08 20:53:24,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:53:24,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:53:24,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:53:24,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbaa30df29cd80ecaa3c8c HTTP/1.1" 200 None 2026-05-08 20:53:24,830 - lava_callback - ERROR - Error processing callback for node 69fbaa30df29cd80ecaa3c8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46718 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:54:04,718 - lava_callback - INFO - Received callback for node 69fbaa67df29cd80ecaa3c98 INFO: 172.20.0.1:51084 - "POST /node/69fbaa67df29cd80ecaa3c98 HTTP/1.0" 202 Accepted 2026-05-08 20:54:04,723 - lava_callback - INFO - Starting async job submit for node 69fbaa67df29cd80ecaa3c98 2026-05-08 20:54:04,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:54:04,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaa67df29cd80ecaa3c98 HTTP/1.1" 200 None 2026-05-08 20:54:04,738 - lava_callback - DEBUG - Processing node 69fbaa67df29cd80ecaa3c98: baseline-arm-clabbe 2026-05-08 20:54:04,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbaa67df29cd80ecaa3c98 2026-05-08 20:54:04,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:54:04,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaa67df29cd80ecaa3c98 HTTP/1.1" 200 None 2026-05-08 20:54:04,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:54:04,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:54:04,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:54:04,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbaa67df29cd80ecaa3c98 HTTP/1.1" 200 None 2026-05-08 20:54:04,815 - lava_callback - ERROR - Error processing callback for node 69fbaa67df29cd80ecaa3c98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40690 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:55:04,933 - lava_callback - INFO - Received callback for node 69fbaaa3df29cd80ecaa3ca5 INFO: 172.20.0.1:54658 - "POST /node/69fbaaa3df29cd80ecaa3ca5 HTTP/1.0" 202 Accepted 2026-05-08 20:55:04,939 - lava_callback - INFO - Starting async job submit for node 69fbaaa3df29cd80ecaa3ca5 2026-05-08 20:55:04,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:55:04,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaaa3df29cd80ecaa3ca5 HTTP/1.1" 200 None 2026-05-08 20:55:04,953 - lava_callback - DEBUG - Processing node 69fbaaa3df29cd80ecaa3ca5: baseline-arm-clabbe 2026-05-08 20:55:04,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbaaa3df29cd80ecaa3ca5 2026-05-08 20:55:04,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:55:04,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaaa3df29cd80ecaa3ca5 HTTP/1.1" 200 None 2026-05-08 20:55:04,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:55:04,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:55:04,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:55:05,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbaaa3df29cd80ecaa3ca5 HTTP/1.1" 200 None 2026-05-08 20:55:05,011 - lava_callback - ERROR - Error processing callback for node 69fbaaa3df29cd80ecaa3ca5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47218 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:57:04,925 - lava_callback - INFO - Received callback for node 69fbab1cdf29cd80ecaa3cb8 INFO: 172.20.0.1:34712 - "POST /node/69fbab1cdf29cd80ecaa3cb8 HTTP/1.0" 202 Accepted 2026-05-08 20:57:04,931 - lava_callback - INFO - Starting async job submit for node 69fbab1cdf29cd80ecaa3cb8 2026-05-08 20:57:04,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:57:04,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbab1cdf29cd80ecaa3cb8 HTTP/1.1" 200 None 2026-05-08 20:57:04,946 - lava_callback - DEBUG - Processing node 69fbab1cdf29cd80ecaa3cb8: baseline-arm-clabbe 2026-05-08 20:57:04,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbab1cdf29cd80ecaa3cb8 2026-05-08 20:57:04,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:57:04,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbab1cdf29cd80ecaa3cb8 HTTP/1.1" 200 None 2026-05-08 20:57:04,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:57:04,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:57:04,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:57:04,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbab1cdf29cd80ecaa3cb8 HTTP/1.1" 200 None 2026-05-08 20:57:04,992 - lava_callback - ERROR - Error processing callback for node 69fbab1cdf29cd80ecaa3cb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41268 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:57:46,185 - lava_callback - INFO - Received callback for node 69fbab3fdf29cd80ecaa3cc9 INFO: 172.20.0.1:51606 - "POST /node/69fbab3fdf29cd80ecaa3cc9 HTTP/1.0" 202 Accepted 2026-05-08 20:57:46,190 - lava_callback - INFO - Starting async job submit for node 69fbab3fdf29cd80ecaa3cc9 2026-05-08 20:57:46,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:57:46,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbab3fdf29cd80ecaa3cc9 HTTP/1.1" 200 None 2026-05-08 20:57:46,205 - lava_callback - DEBUG - Processing node 69fbab3fdf29cd80ecaa3cc9: baseline-arm-baylibre 2026-05-08 20:57:46,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbab3fdf29cd80ecaa3cc9 2026-05-08 20:57:46,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:57:46,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbab3fdf29cd80ecaa3cc9 HTTP/1.1" 200 None 2026-05-08 20:57:46,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:57:46,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:57:46,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:57:46,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbab3fdf29cd80ecaa3cc9 HTTP/1.1" 200 None 2026-05-08 20:57:46,251 - lava_callback - ERROR - Error processing callback for node 69fbab3fdf29cd80ecaa3cc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60700 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:58:46,130 - lava_callback - INFO - Received callback for node 69fbab79df29cd80ecaa3cd9 INFO: 172.20.0.1:41688 - "POST /node/69fbab79df29cd80ecaa3cd9 HTTP/1.0" 202 Accepted 2026-05-08 20:58:46,136 - lava_callback - INFO - Starting async job submit for node 69fbab79df29cd80ecaa3cd9 2026-05-08 20:58:46,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:58:46,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbab79df29cd80ecaa3cd9 HTTP/1.1" 200 None 2026-05-08 20:58:46,151 - lava_callback - DEBUG - Processing node 69fbab79df29cd80ecaa3cd9: baseline-arm-baylibre 2026-05-08 20:58:46,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbab79df29cd80ecaa3cd9 2026-05-08 20:58:46,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:58:46,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbab79df29cd80ecaa3cd9 HTTP/1.1" 200 None 2026-05-08 20:58:46,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:58:46,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:58:46,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:58:46,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbab79df29cd80ecaa3cd9 HTTP/1.1" 200 None 2026-05-08 20:58:46,197 - lava_callback - ERROR - Error processing callback for node 69fbab79df29cd80ecaa3cd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32854 - "GET / HTTP/1.0" 200 OK 2026-05-08 20:59:26,255 - lava_callback - INFO - Received callback for node 69fbaba2df29cd80ecaa3ce7 INFO: 172.20.0.1:42854 - "POST /node/69fbaba2df29cd80ecaa3ce7 HTTP/1.0" 202 Accepted 2026-05-08 20:59:26,260 - lava_callback - INFO - Starting async job submit for node 69fbaba2df29cd80ecaa3ce7 2026-05-08 20:59:26,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:59:26,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaba2df29cd80ecaa3ce7 HTTP/1.1" 200 None 2026-05-08 20:59:26,275 - lava_callback - DEBUG - Processing node 69fbaba2df29cd80ecaa3ce7: baseline-arm-baylibre 2026-05-08 20:59:26,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbaba2df29cd80ecaa3ce7 2026-05-08 20:59:26,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:59:26,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaba2df29cd80ecaa3ce7 HTTP/1.1" 200 None 2026-05-08 20:59:26,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:59:26,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 20:59:26,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 20:59:26,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbaba2df29cd80ecaa3ce7 HTTP/1.1" 200 None 2026-05-08 20:59:26,324 - lava_callback - ERROR - Error processing callback for node 69fbaba2df29cd80ecaa3ce7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44106 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:00:26,234 - lava_callback - INFO - Received callback for node 69fbabdedf29cd80ecaa3cf8 INFO: 172.20.0.1:42266 - "POST /node/69fbabdedf29cd80ecaa3cf8 HTTP/1.0" 202 Accepted 2026-05-08 21:00:26,240 - lava_callback - INFO - Starting async job submit for node 69fbabdedf29cd80ecaa3cf8 2026-05-08 21:00:26,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:00:26,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbabdedf29cd80ecaa3cf8 HTTP/1.1" 200 None 2026-05-08 21:00:26,255 - lava_callback - DEBUG - Processing node 69fbabdedf29cd80ecaa3cf8: baseline-arm-baylibre 2026-05-08 21:00:26,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbabdedf29cd80ecaa3cf8 2026-05-08 21:00:26,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:00:26,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbabdedf29cd80ecaa3cf8 HTTP/1.1" 200 None 2026-05-08 21:00:26,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:00:26,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:00:26,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:00:26,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbabdedf29cd80ecaa3cf8 HTTP/1.1" 200 None 2026-05-08 21:00:26,304 - lava_callback - ERROR - Error processing callback for node 69fbabdedf29cd80ecaa3cf8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35432 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:01:46,320 - lava_callback - INFO - Received callback for node 69fbac30df29cd80ecaa3d09 INFO: 172.20.0.1:37572 - "POST /node/69fbac30df29cd80ecaa3d09 HTTP/1.0" 202 Accepted 2026-05-08 21:01:46,325 - lava_callback - INFO - Starting async job submit for node 69fbac30df29cd80ecaa3d09 2026-05-08 21:01:46,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:01:46,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbac30df29cd80ecaa3d09 HTTP/1.1" 200 None 2026-05-08 21:01:46,349 - lava_callback - DEBUG - Processing node 69fbac30df29cd80ecaa3d09: baseline-arm-baylibre 2026-05-08 21:01:46,349 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbac30df29cd80ecaa3d09 2026-05-08 21:01:46,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:01:46,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbac30df29cd80ecaa3d09 HTTP/1.1" 200 None 2026-05-08 21:01:46,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:01:46,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:01:46,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:01:46,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbac30df29cd80ecaa3d09 HTTP/1.1" 200 None 2026-05-08 21:01:46,398 - lava_callback - ERROR - Error processing callback for node 69fbac30df29cd80ecaa3d09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42106 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:03:06,494 - lava_callback - INFO - Received callback for node 69fbac80df29cd80ecaa3d17 INFO: 172.20.0.1:44578 - "POST /node/69fbac80df29cd80ecaa3d17 HTTP/1.0" 202 Accepted 2026-05-08 21:03:06,501 - lava_callback - INFO - Starting async job submit for node 69fbac80df29cd80ecaa3d17 2026-05-08 21:03:06,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:44590 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:03:06,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbac80df29cd80ecaa3d17 HTTP/1.1" 200 None 2026-05-08 21:03:06,515 - lava_callback - DEBUG - Processing node 69fbac80df29cd80ecaa3d17: baseline-arm-baylibre 2026-05-08 21:03:06,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbac80df29cd80ecaa3d17 2026-05-08 21:03:06,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:03:06,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbac80df29cd80ecaa3d17 HTTP/1.1" 200 None 2026-05-08 21:03:06,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:03:06,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:03:06,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:03:06,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbac80df29cd80ecaa3d17 HTTP/1.1" 200 None 2026-05-08 21:03:06,578 - lava_callback - ERROR - Error processing callback for node 69fbac80df29cd80ecaa3d17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57682 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:03:46,422 - lava_callback - INFO - Received callback for node 69fbaca4df29cd80ecaa3d23 INFO: 172.20.0.1:41768 - "POST /node/69fbaca4df29cd80ecaa3d23 HTTP/1.0" 202 Accepted 2026-05-08 21:03:46,427 - lava_callback - INFO - Starting async job submit for node 69fbaca4df29cd80ecaa3d23 2026-05-08 21:03:46,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:03:46,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaca4df29cd80ecaa3d23 HTTP/1.1" 200 None 2026-05-08 21:03:46,451 - lava_callback - DEBUG - Processing node 69fbaca4df29cd80ecaa3d23: baseline-arm-baylibre 2026-05-08 21:03:46,451 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbaca4df29cd80ecaa3d23 2026-05-08 21:03:46,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:03:46,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaca4df29cd80ecaa3d23 HTTP/1.1" 200 None 2026-05-08 21:03:46,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:03:46,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:03:46,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:03:46,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbaca4df29cd80ecaa3d23 HTTP/1.1" 200 None 2026-05-08 21:03:46,498 - lava_callback - ERROR - Error processing callback for node 69fbaca4df29cd80ecaa3d23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47126 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:04:26,484 - lava_callback - INFO - Received callback for node 69fbaccbdf29cd80ecaa3d33 INFO: 172.20.0.1:59090 - "POST /node/69fbaccbdf29cd80ecaa3d33 HTTP/1.0" 202 Accepted 2026-05-08 21:04:26,490 - lava_callback - INFO - Starting async job submit for node 69fbaccbdf29cd80ecaa3d33 2026-05-08 21:04:26,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:04:26,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaccbdf29cd80ecaa3d33 HTTP/1.1" 200 None 2026-05-08 21:04:26,505 - lava_callback - DEBUG - Processing node 69fbaccbdf29cd80ecaa3d33: baseline-arm-baylibre 2026-05-08 21:04:26,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbaccbdf29cd80ecaa3d33 2026-05-08 21:04:26,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:04:26,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaccbdf29cd80ecaa3d33 HTTP/1.1" 200 None 2026-05-08 21:04:26,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:59098 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:04:26,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:04:26,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:04:26,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbaccbdf29cd80ecaa3d33 HTTP/1.1" 200 None 2026-05-08 21:04:26,552 - lava_callback - ERROR - Error processing callback for node 69fbaccbdf29cd80ecaa3d33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56868 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:05:06,464 - lava_callback - INFO - Received callback for node 69fbacf1df29cd80ecaa3d3f INFO: 172.20.0.1:37354 - "POST /node/69fbacf1df29cd80ecaa3d3f HTTP/1.0" 202 Accepted 2026-05-08 21:05:06,470 - lava_callback - INFO - Starting async job submit for node 69fbacf1df29cd80ecaa3d3f 2026-05-08 21:05:06,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:05:06,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbacf1df29cd80ecaa3d3f HTTP/1.1" 200 None 2026-05-08 21:05:06,509 - lava_callback - DEBUG - Processing node 69fbacf1df29cd80ecaa3d3f: baseline-arm-baylibre 2026-05-08 21:05:06,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbacf1df29cd80ecaa3d3f 2026-05-08 21:05:06,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:05:06,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbacf1df29cd80ecaa3d3f HTTP/1.1" 200 None 2026-05-08 21:05:06,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:37370 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:05:06,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:05:06,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:05:06,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbacf1df29cd80ecaa3d3f HTTP/1.1" 200 None 2026-05-08 21:05:06,555 - lava_callback - ERROR - Error processing callback for node 69fbacf1df29cd80ecaa3d3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40096 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:05:45,249 - lava_callback - INFO - Received callback for node 69fbad1adf29cd80ecaa3d4c INFO: 172.20.0.1:45558 - "POST /node/69fbad1adf29cd80ecaa3d4c HTTP/1.0" 202 Accepted 2026-05-08 21:05:45,254 - lava_callback - INFO - Starting async job submit for node 69fbad1adf29cd80ecaa3d4c 2026-05-08 21:05:45,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:05:45,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad1adf29cd80ecaa3d4c HTTP/1.1" 200 None 2026-05-08 21:05:45,270 - lava_callback - DEBUG - Processing node 69fbad1adf29cd80ecaa3d4c: baseline-arm-clabbe 2026-05-08 21:05:45,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad1adf29cd80ecaa3d4c 2026-05-08 21:05:45,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:05:45,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad1adf29cd80ecaa3d4c HTTP/1.1" 200 None 2026-05-08 21:05:45,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:05:45,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:05:45,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:05:45,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad1adf29cd80ecaa3d4c HTTP/1.1" 200 None 2026-05-08 21:05:45,323 - lava_callback - ERROR - Error processing callback for node 69fbad1adf29cd80ecaa3d4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43558 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:06:25,197 - lava_callback - INFO - Received callback for node 69fbad40df29cd80ecaa3d5f INFO: 172.20.0.1:51316 - "POST /node/69fbad40df29cd80ecaa3d5f HTTP/1.0" 202 Accepted 2026-05-08 21:06:25,203 - lava_callback - INFO - Starting async job submit for node 69fbad40df29cd80ecaa3d5f 2026-05-08 21:06:25,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:06:25,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad40df29cd80ecaa3d5f HTTP/1.1" 200 None 2026-05-08 21:06:25,220 - lava_callback - DEBUG - Processing node 69fbad40df29cd80ecaa3d5f: baseline-arm-clabbe 2026-05-08 21:06:25,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad40df29cd80ecaa3d5f 2026-05-08 21:06:25,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:06:25,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad40df29cd80ecaa3d5f HTTP/1.1" 200 None 2026-05-08 21:06:25,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:06:25,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:06:25,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:06:25,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad40df29cd80ecaa3d5f HTTP/1.1" 200 None 2026-05-08 21:06:25,268 - lava_callback - ERROR - Error processing callback for node 69fbad40df29cd80ecaa3d5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56104 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:07:06,575 - lava_callback - INFO - Received callback for node 69fbad6edf29cd80ecaa3dea INFO: 172.20.0.1:56112 - "POST /node/69fbad6edf29cd80ecaa3dea HTTP/1.0" 202 Accepted 2026-05-08 21:07:06,580 - lava_callback - INFO - Starting async job submit for node 69fbad6edf29cd80ecaa3dea 2026-05-08 21:07:06,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:06,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad6edf29cd80ecaa3dea HTTP/1.1" 200 None 2026-05-08 21:07:06,595 - lava_callback - DEBUG - Processing node 69fbad6edf29cd80ecaa3dea: baseline-arm64-baylibre 2026-05-08 21:07:06,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad6edf29cd80ecaa3dea 2026-05-08 21:07:06,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:06,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad6edf29cd80ecaa3dea HTTP/1.1" 200 None 2026-05-08 21:07:06,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:06,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-08 21:07:06,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:06,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad6edf29cd80ecaa3dea HTTP/1.1" 200 None 2026-05-08 21:07:06,644 - lava_callback - ERROR - Error processing callback for node 69fbad6edf29cd80ecaa3dea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 21:07:07,261 - lava_callback - INFO - Received callback for node 69fbad70df29cd80ecaa3df1 INFO: 172.20.0.1:56126 - "POST /node/69fbad70df29cd80ecaa3df1 HTTP/1.0" 202 Accepted 2026-05-08 21:07:07,267 - lava_callback - INFO - Starting async job submit for node 69fbad70df29cd80ecaa3df1 2026-05-08 21:07:07,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:07,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad70df29cd80ecaa3df1 HTTP/1.1" 200 None 2026-05-08 21:07:07,289 - lava_callback - DEBUG - Processing node 69fbad70df29cd80ecaa3df1: baseline-arm64-baylibre 2026-05-08 21:07:07,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad70df29cd80ecaa3df1 2026-05-08 21:07:07,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:07,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad70df29cd80ecaa3df1 HTTP/1.1" 200 None 2026-05-08 21:07:07,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:07,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-08 21:07:07,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:07,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad70df29cd80ecaa3df1 HTTP/1.1" 200 None 2026-05-08 21:07:07,334 - lava_callback - ERROR - Error processing callback for node 69fbad70df29cd80ecaa3df1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 21:07:07,951 - lava_callback - INFO - Received callback for node 69fbad71df29cd80ecaa3df7 INFO: 172.20.0.1:56134 - "POST /node/69fbad71df29cd80ecaa3df7 HTTP/1.0" 202 Accepted 2026-05-08 21:07:07,957 - lava_callback - INFO - Starting async job submit for node 69fbad71df29cd80ecaa3df7 2026-05-08 21:07:07,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:07,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad71df29cd80ecaa3df7 HTTP/1.1" 200 None 2026-05-08 21:07:07,972 - lava_callback - DEBUG - Processing node 69fbad71df29cd80ecaa3df7: baseline-arm64-baylibre 2026-05-08 21:07:07,972 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad71df29cd80ecaa3df7 2026-05-08 21:07:07,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:07,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad71df29cd80ecaa3df7 HTTP/1.1" 200 None 2026-05-08 21:07:07,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:08,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-08 21:07:08,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:08,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad71df29cd80ecaa3df7 HTTP/1.1" 200 None 2026-05-08 21:07:08,025 - lava_callback - ERROR - Error processing callback for node 69fbad71df29cd80ecaa3df7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 21:07:08,608 - lava_callback - INFO - Received callback for node 69fbad73df29cd80ecaa3dfe INFO: 172.20.0.1:56140 - "POST /node/69fbad73df29cd80ecaa3dfe HTTP/1.0" 202 Accepted 2026-05-08 21:07:08,613 - lava_callback - INFO - Starting async job submit for node 69fbad73df29cd80ecaa3dfe 2026-05-08 21:07:08,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:08,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad73df29cd80ecaa3dfe HTTP/1.1" 200 None 2026-05-08 21:07:08,628 - lava_callback - DEBUG - Processing node 69fbad73df29cd80ecaa3dfe: baseline-arm64-baylibre 2026-05-08 21:07:08,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad73df29cd80ecaa3dfe 2026-05-08 21:07:08,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:08,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad73df29cd80ecaa3dfe HTTP/1.1" 200 None 2026-05-08 21:07:08,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:08,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-08 21:07:08,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:08,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad73df29cd80ecaa3dfe HTTP/1.1" 200 None 2026-05-08 21:07:08,672 - lava_callback - ERROR - Error processing callback for node 69fbad73df29cd80ecaa3dfe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 21:07:09,253 - lava_callback - INFO - Received callback for node 69fbad75df29cd80ecaa3e02 INFO: 172.20.0.1:56146 - "POST /node/69fbad75df29cd80ecaa3e02 HTTP/1.0" 202 Accepted 2026-05-08 21:07:09,260 - lava_callback - INFO - Starting async job submit for node 69fbad75df29cd80ecaa3e02 2026-05-08 21:07:09,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:09,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad75df29cd80ecaa3e02 HTTP/1.1" 200 None 2026-05-08 21:07:09,275 - lava_callback - DEBUG - Processing node 69fbad75df29cd80ecaa3e02: baseline-arm64-baylibre 2026-05-08 21:07:09,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad75df29cd80ecaa3e02 2026-05-08 21:07:09,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:09,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad75df29cd80ecaa3e02 HTTP/1.1" 200 None 2026-05-08 21:07:09,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:09,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-08 21:07:09,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:09,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad75df29cd80ecaa3e02 HTTP/1.1" 200 None 2026-05-08 21:07:09,326 - lava_callback - ERROR - Error processing callback for node 69fbad75df29cd80ecaa3e02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 21:07:09,942 - lava_callback - INFO - Received callback for node 69fbad76df29cd80ecaa3e05 INFO: 172.20.0.1:57304 - "POST /node/69fbad76df29cd80ecaa3e05 HTTP/1.0" 202 Accepted 2026-05-08 21:07:09,948 - lava_callback - INFO - Starting async job submit for node 69fbad76df29cd80ecaa3e05 2026-05-08 21:07:09,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:09,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad76df29cd80ecaa3e05 HTTP/1.1" 200 None 2026-05-08 21:07:09,963 - lava_callback - DEBUG - Processing node 69fbad76df29cd80ecaa3e05: baseline-arm64-baylibre 2026-05-08 21:07:09,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad76df29cd80ecaa3e05 2026-05-08 21:07:09,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:09,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad76df29cd80ecaa3e05 HTTP/1.1" 200 None 2026-05-08 21:07:09,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:09,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-08 21:07:09,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:10,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad76df29cd80ecaa3e05 HTTP/1.1" 200 None 2026-05-08 21:07:10,016 - lava_callback - ERROR - Error processing callback for node 69fbad76df29cd80ecaa3e05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 21:07:10,604 - lava_callback - INFO - Received callback for node 69fbad65df29cd80ecaa3dd3 INFO: 172.20.0.1:57318 - "POST /node/69fbad65df29cd80ecaa3dd3 HTTP/1.0" 202 Accepted 2026-05-08 21:07:10,610 - lava_callback - INFO - Starting async job submit for node 69fbad65df29cd80ecaa3dd3 2026-05-08 21:07:10,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:10,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad65df29cd80ecaa3dd3 HTTP/1.1" 200 None 2026-05-08 21:07:10,626 - lava_callback - DEBUG - Processing node 69fbad65df29cd80ecaa3dd3: baseline-arm-baylibre 2026-05-08 21:07:10,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad65df29cd80ecaa3dd3 2026-05-08 21:07:10,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:10,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad65df29cd80ecaa3dd3 HTTP/1.1" 200 None 2026-05-08 21:07:10,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:10,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:07:10,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:10,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad65df29cd80ecaa3dd3 HTTP/1.1" 200 None 2026-05-08 21:07:10,675 - lava_callback - ERROR - Error processing callback for node 69fbad65df29cd80ecaa3dd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57348 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:07:25,304 - lava_callback - INFO - Received callback for node 69fbad86df29cd80ecaa3e4a INFO: 172.20.0.1:37866 - "POST /node/69fbad86df29cd80ecaa3e4a HTTP/1.0" 202 Accepted 2026-05-08 21:07:25,310 - lava_callback - INFO - Starting async job submit for node 69fbad86df29cd80ecaa3e4a 2026-05-08 21:07:25,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:25,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad86df29cd80ecaa3e4a HTTP/1.1" 200 None 2026-05-08 21:07:25,325 - lava_callback - DEBUG - Processing node 69fbad86df29cd80ecaa3e4a: baseline-arm64-clabbe 2026-05-08 21:07:25,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad86df29cd80ecaa3e4a 2026-05-08 21:07:25,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:25,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad86df29cd80ecaa3e4a HTTP/1.1" 200 None 2026-05-08 21:07:25,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:25,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-08 21:07:25,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:25,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad86df29cd80ecaa3e4a HTTP/1.1" 200 None 2026-05-08 21:07:25,371 - lava_callback - ERROR - Error processing callback for node 69fbad86df29cd80ecaa3e4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 21:07:25,993 - lava_callback - INFO - Received callback for node 69fbad88df29cd80ecaa3e4d INFO: 172.20.0.1:37876 - "POST /node/69fbad88df29cd80ecaa3e4d HTTP/1.0" 202 Accepted 2026-05-08 21:07:25,999 - lava_callback - INFO - Starting async job submit for node 69fbad88df29cd80ecaa3e4d 2026-05-08 21:07:26,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:26,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad88df29cd80ecaa3e4d HTTP/1.1" 200 None 2026-05-08 21:07:26,015 - lava_callback - DEBUG - Processing node 69fbad88df29cd80ecaa3e4d: baseline-arm64-clabbe 2026-05-08 21:07:26,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad88df29cd80ecaa3e4d 2026-05-08 21:07:26,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:26,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad88df29cd80ecaa3e4d HTTP/1.1" 200 None 2026-05-08 21:07:26,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:26,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-08 21:07:26,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:26,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad88df29cd80ecaa3e4d HTTP/1.1" 200 None 2026-05-08 21:07:26,062 - lava_callback - ERROR - Error processing callback for node 69fbad88df29cd80ecaa3e4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37892 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:07:26,690 - lava_callback - INFO - Received callback for node 69fbad88df29cd80ecaa3e50 INFO: 172.20.0.1:37896 - "POST /node/69fbad88df29cd80ecaa3e50 HTTP/1.0" 202 Accepted 2026-05-08 21:07:26,695 - lava_callback - INFO - Starting async job submit for node 69fbad88df29cd80ecaa3e50 2026-05-08 21:07:26,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:26,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad88df29cd80ecaa3e50 HTTP/1.1" 200 None 2026-05-08 21:07:26,711 - lava_callback - DEBUG - Processing node 69fbad88df29cd80ecaa3e50: baseline-arm64-clabbe 2026-05-08 21:07:26,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad88df29cd80ecaa3e50 2026-05-08 21:07:26,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:26,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad88df29cd80ecaa3e50 HTTP/1.1" 200 None 2026-05-08 21:07:26,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:26,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-08 21:07:26,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:26,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad88df29cd80ecaa3e50 HTTP/1.1" 200 None 2026-05-08 21:07:26,757 - lava_callback - ERROR - Error processing callback for node 69fbad88df29cd80ecaa3e50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 21:07:27,398 - lava_callback - INFO - Received callback for node 69fbad89df29cd80ecaa3e53 INFO: 172.20.0.1:37910 - "POST /node/69fbad89df29cd80ecaa3e53 HTTP/1.0" 202 Accepted 2026-05-08 21:07:27,404 - lava_callback - INFO - Starting async job submit for node 69fbad89df29cd80ecaa3e53 2026-05-08 21:07:27,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:27,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad89df29cd80ecaa3e53 HTTP/1.1" 200 None 2026-05-08 21:07:27,420 - lava_callback - DEBUG - Processing node 69fbad89df29cd80ecaa3e53: baseline-arm64-clabbe 2026-05-08 21:07:27,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad89df29cd80ecaa3e53 2026-05-08 21:07:27,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:27,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad89df29cd80ecaa3e53 HTTP/1.1" 200 None 2026-05-08 21:07:27,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:27,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-08 21:07:27,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:27,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad89df29cd80ecaa3e53 HTTP/1.1" 200 None 2026-05-08 21:07:27,480 - lava_callback - ERROR - Error processing callback for node 69fbad89df29cd80ecaa3e53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 21:07:28,050 - lava_callback - INFO - Received callback for node 69fbad8cdf29cd80ecaa3e60 INFO: 172.20.0.1:37916 - "POST /node/69fbad8cdf29cd80ecaa3e60 HTTP/1.0" 202 Accepted 2026-05-08 21:07:28,056 - lava_callback - INFO - Starting async job submit for node 69fbad8cdf29cd80ecaa3e60 2026-05-08 21:07:28,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:28,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad8cdf29cd80ecaa3e60 HTTP/1.1" 200 None 2026-05-08 21:07:28,071 - lava_callback - DEBUG - Processing node 69fbad8cdf29cd80ecaa3e60: baseline-arm64-clabbe 2026-05-08 21:07:28,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad8cdf29cd80ecaa3e60 2026-05-08 21:07:28,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:28,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad8cdf29cd80ecaa3e60 HTTP/1.1" 200 None 2026-05-08 21:07:28,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:28,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-08 21:07:28,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:28,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad8cdf29cd80ecaa3e60 HTTP/1.1" 200 None 2026-05-08 21:07:28,118 - lava_callback - ERROR - Error processing callback for node 69fbad8cdf29cd80ecaa3e60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 21:07:28,716 - lava_callback - INFO - Received callback for node 69fbad8bdf29cd80ecaa3e59 INFO: 172.20.0.1:37930 - "POST /node/69fbad8bdf29cd80ecaa3e59 HTTP/1.0" 202 Accepted 2026-05-08 21:07:28,723 - lava_callback - INFO - Starting async job submit for node 69fbad8bdf29cd80ecaa3e59 2026-05-08 21:07:28,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:28,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad8bdf29cd80ecaa3e59 HTTP/1.1" 200 None 2026-05-08 21:07:28,740 - lava_callback - DEBUG - Processing node 69fbad8bdf29cd80ecaa3e59: baseline-arm64-clabbe 2026-05-08 21:07:28,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad8bdf29cd80ecaa3e59 2026-05-08 21:07:28,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:28,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad8bdf29cd80ecaa3e59 HTTP/1.1" 200 None 2026-05-08 21:07:28,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:28,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-08 21:07:28,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:28,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad8bdf29cd80ecaa3e59 HTTP/1.1" 200 None 2026-05-08 21:07:28,788 - lava_callback - ERROR - Error processing callback for node 69fbad8bdf29cd80ecaa3e59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58712 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:07:45,260 - lava_callback - INFO - Received callback for node 69fbad8edf29cd80ecaa3e65 INFO: 172.20.0.1:47278 - "POST /node/69fbad8edf29cd80ecaa3e65 HTTP/1.0" 202 Accepted 2026-05-08 21:07:45,265 - lava_callback - INFO - Starting async job submit for node 69fbad8edf29cd80ecaa3e65 2026-05-08 21:07:45,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:45,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad8edf29cd80ecaa3e65 HTTP/1.1" 200 None 2026-05-08 21:07:45,280 - lava_callback - DEBUG - Processing node 69fbad8edf29cd80ecaa3e65: baseline-arm-clabbe 2026-05-08 21:07:45,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbad8edf29cd80ecaa3e65 2026-05-08 21:07:45,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:45,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbad8edf29cd80ecaa3e65 HTTP/1.1" 200 None 2026-05-08 21:07:45,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:45,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:07:45,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:07:45,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbad8edf29cd80ecaa3e65 HTTP/1.1" 200 None 2026-05-08 21:07:45,330 - lava_callback - ERROR - Error processing callback for node 69fbad8edf29cd80ecaa3e65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40568 - "GET /node/698af5b93b3beb19e7616e09%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38922 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:10:45,873 - lava_callback - INFO - Received callback for node 69fbae4adf29cd80ecaa3ff3 INFO: 172.20.0.1:53516 - "POST /node/69fbae4adf29cd80ecaa3ff3 HTTP/1.0" 202 Accepted 2026-05-08 21:10:45,878 - lava_callback - INFO - Starting async job submit for node 69fbae4adf29cd80ecaa3ff3 2026-05-08 21:10:45,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:10:45,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbae4adf29cd80ecaa3ff3 HTTP/1.1" 200 None 2026-05-08 21:10:45,894 - lava_callback - DEBUG - Processing node 69fbae4adf29cd80ecaa3ff3: baseline-arm-clabbe 2026-05-08 21:10:45,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbae4adf29cd80ecaa3ff3 2026-05-08 21:10:45,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:10:45,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbae4adf29cd80ecaa3ff3 HTTP/1.1" 200 None 2026-05-08 21:10:45,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:10:45,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:10:45,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:10:45,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbae4adf29cd80ecaa3ff3 HTTP/1.1" 200 None 2026-05-08 21:10:45,939 - lava_callback - ERROR - Error processing callback for node 69fbae4adf29cd80ecaa3ff3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43364 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:13:45,574 - lava_callback - INFO - Received callback for node 69fbaf03df29cd80ecaa406b INFO: 172.20.0.1:44700 - "POST /node/69fbaf03df29cd80ecaa406b HTTP/1.0" 202 Accepted 2026-05-08 21:13:45,580 - lava_callback - INFO - Starting async job submit for node 69fbaf03df29cd80ecaa406b 2026-05-08 21:13:45,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:13:45,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaf03df29cd80ecaa406b HTTP/1.1" 200 None 2026-05-08 21:13:45,595 - lava_callback - DEBUG - Processing node 69fbaf03df29cd80ecaa406b: baseline-arm-clabbe 2026-05-08 21:13:45,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbaf03df29cd80ecaa406b 2026-05-08 21:13:45,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:13:45,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaf03df29cd80ecaa406b HTTP/1.1" 200 None 2026-05-08 21:13:45,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:13:45,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:13:45,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:13:45,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbaf03df29cd80ecaa406b HTTP/1.1" 200 None 2026-05-08 21:13:45,644 - lava_callback - ERROR - Error processing callback for node 69fbaf03df29cd80ecaa406b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35648 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:14:25,541 - lava_callback - INFO - Received callback for node 69fbaf2adf29cd80ecaa4073 INFO: 172.20.0.1:60622 - "POST /node/69fbaf2adf29cd80ecaa4073 HTTP/1.0" 202 Accepted 2026-05-08 21:14:25,547 - lava_callback - INFO - Starting async job submit for node 69fbaf2adf29cd80ecaa4073 2026-05-08 21:14:25,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:14:25,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaf2adf29cd80ecaa4073 HTTP/1.1" 200 None 2026-05-08 21:14:25,563 - lava_callback - DEBUG - Processing node 69fbaf2adf29cd80ecaa4073: baseline-arm-clabbe 2026-05-08 21:14:25,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbaf2adf29cd80ecaa4073 2026-05-08 21:14:25,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:14:25,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaf2adf29cd80ecaa4073 HTTP/1.1" 200 None 2026-05-08 21:14:25,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:14:25,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:14:25,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:14:25,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbaf2adf29cd80ecaa4073 HTTP/1.1" 200 None 2026-05-08 21:14:25,627 - lava_callback - ERROR - Error processing callback for node 69fbaf2adf29cd80ecaa4073: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43072 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:15:05,639 - lava_callback - INFO - Received callback for node 69fbaf52df29cd80ecaa4080 INFO: 172.20.0.1:54062 - "POST /node/69fbaf52df29cd80ecaa4080 HTTP/1.0" 202 Accepted 2026-05-08 21:15:05,644 - lava_callback - INFO - Starting async job submit for node 69fbaf52df29cd80ecaa4080 2026-05-08 21:15:05,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:15:05,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaf52df29cd80ecaa4080 HTTP/1.1" 200 None 2026-05-08 21:15:05,678 - lava_callback - DEBUG - Processing node 69fbaf52df29cd80ecaa4080: baseline-arm-clabbe 2026-05-08 21:15:05,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbaf52df29cd80ecaa4080 2026-05-08 21:15:05,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:15:05,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbaf52df29cd80ecaa4080 HTTP/1.1" 200 None 2026-05-08 21:15:05,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:15:05,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:15:05,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:15:05,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbaf52df29cd80ecaa4080 HTTP/1.1" 200 None 2026-05-08 21:15:05,735 - lava_callback - ERROR - Error processing callback for node 69fbaf52df29cd80ecaa4080: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35670 - "GET /node/697b236b6291fd5f9aa8031c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48040 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:18:25,734 - lava_callback - INFO - Received callback for node 69fbb00bdf29cd80ecaa40e2 INFO: 172.20.0.1:39458 - "POST /node/69fbb00bdf29cd80ecaa40e2 HTTP/1.0" 202 Accepted 2026-05-08 21:18:25,741 - lava_callback - INFO - Starting async job submit for node 69fbb00bdf29cd80ecaa40e2 2026-05-08 21:18:25,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:18:25,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb00bdf29cd80ecaa40e2 HTTP/1.1" 200 None 2026-05-08 21:18:25,758 - lava_callback - DEBUG - Processing node 69fbb00bdf29cd80ecaa40e2: baseline-arm-clabbe 2026-05-08 21:18:25,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb00bdf29cd80ecaa40e2 2026-05-08 21:18:25,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:18:25,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb00bdf29cd80ecaa40e2 HTTP/1.1" 200 None 2026-05-08 21:18:25,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:18:25,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:18:25,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:18:25,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb00bdf29cd80ecaa40e2 HTTP/1.1" 200 None 2026-05-08 21:18:25,806 - lava_callback - ERROR - Error processing callback for node 69fbb00bdf29cd80ecaa40e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56842 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:21:25,796 - lava_callback - INFO - Received callback for node 69fbb0c2df29cd80ecaa4142 INFO: 172.20.0.1:50548 - "POST /node/69fbb0c2df29cd80ecaa4142 HTTP/1.0" 202 Accepted 2026-05-08 21:21:25,802 - lava_callback - INFO - Starting async job submit for node 69fbb0c2df29cd80ecaa4142 2026-05-08 21:21:25,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:21:25,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb0c2df29cd80ecaa4142 HTTP/1.1" 200 None 2026-05-08 21:21:25,822 - lava_callback - DEBUG - Processing node 69fbb0c2df29cd80ecaa4142: baseline-arm-clabbe 2026-05-08 21:21:25,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb0c2df29cd80ecaa4142 2026-05-08 21:21:25,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:21:25,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb0c2df29cd80ecaa4142 HTTP/1.1" 200 None 2026-05-08 21:21:25,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:21:25,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:21:25,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:21:25,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb0c2df29cd80ecaa4142 HTTP/1.1" 200 None 2026-05-08 21:21:25,866 - lava_callback - ERROR - Error processing callback for node 69fbb0c2df29cd80ecaa4142: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51720 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:22:18,110 - lava_callback - INFO - Received callback for node 69fe112ae4d4e78cd76adf72 INFO: 172.20.0.1:51724 - "POST /node/69fe112ae4d4e78cd76adf72 HTTP/1.0" 202 Accepted 2026-05-08 21:22:18,116 - lava_callback - INFO - Starting async job submit for node 69fe112ae4d4e78cd76adf72 2026-05-08 21:22:18,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:22:18,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe112ae4d4e78cd76adf72 HTTP/1.1" 200 None 2026-05-08 21:22:18,158 - lava_callback - DEBUG - Processing node 69fe112ae4d4e78cd76adf72: baseline-arm-broonie 2026-05-08 21:22:18,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:22:18,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:22:18,456 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fe112ae4d4e78cd76adf72/log.txt.gz 2026-05-08 21:22:18,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:22:18,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:22:18,708 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fe112ae4d4e78cd76adf72/lava-logs.yaml 2026-05-08 21:22:18,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:22:18,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:22:18,800 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fe112ae4d4e78cd76adf72/lava_callback.json.gz 2026-05-08 21:22:18,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:22:18,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe112ae4d4e78cd76adf72 HTTP/1.1" 200 None 2026-05-08 21:22:18,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:22:18,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:22:18,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:22:18,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe112ae4d4e78cd76adf72 HTTP/1.1" 200 None 2026-05-08 21:22:18,889 - lava_callback - INFO - Completed processing callback for node 69fe112ae4d4e78cd76adf72 INFO: 172.20.0.1:52354 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:22:32,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:22:32,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36710 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:25:18,153 - lava_callback - INFO - Received callback for node 69fe1154e4d4e78cd76ae015 INFO: 172.20.0.1:36714 - "POST /node/69fe1154e4d4e78cd76ae015 HTTP/1.0" 202 Accepted 2026-05-08 21:25:18,159 - lava_callback - INFO - Starting async job submit for node 69fe1154e4d4e78cd76ae015 2026-05-08 21:25:18,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:25:18,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1154e4d4e78cd76ae015 HTTP/1.1" 200 None 2026-05-08 21:25:18,204 - lava_callback - DEBUG - Processing node 69fe1154e4d4e78cd76ae015: ltp-cap_bounds 2026-05-08 21:25:18,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:25:18,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:25:18,722 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fe1154e4d4e78cd76ae015/log.txt.gz 2026-05-08 21:25:18,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:25:19,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:25:19,098 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fe1154e4d4e78cd76ae015/lava-logs.yaml 2026-05-08 21:25:19,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:25:19,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:25:19,224 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fe1154e4d4e78cd76ae015/lava_callback.json.gz 2026-05-08 21:25:19,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:25:19,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1154e4d4e78cd76ae015 HTTP/1.1" 200 None 2026-05-08 21:25:19,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:25:19,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:25:19,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:25:19,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1154e4d4e78cd76ae015 HTTP/1.1" 200 None 2026-05-08 21:25:19,314 - lava_callback - INFO - Completed processing callback for node 69fe1154e4d4e78cd76ae015 INFO: 172.20.0.1:55772 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:25:32,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:25:32,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55348 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:26:18,189 - lava_callback - INFO - Received callback for node 69fe1155e4d4e78cd76ae01c INFO: 172.20.0.1:55360 - "POST /node/69fe1155e4d4e78cd76ae01c HTTP/1.0" 202 Accepted 2026-05-08 21:26:18,195 - lava_callback - INFO - Starting async job submit for node 69fe1155e4d4e78cd76ae01c 2026-05-08 21:26:18,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:26:18,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1155e4d4e78cd76ae01c HTTP/1.1" 200 None 2026-05-08 21:26:18,248 - lava_callback - DEBUG - Processing node 69fe1155e4d4e78cd76ae01c: ltp-containers 2026-05-08 21:26:18,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:26:18,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:26:18,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69fe1155e4d4e78cd76ae01c/log.txt.gz 2026-05-08 21:26:18,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:26:19,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:26:19,085 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69fe1155e4d4e78cd76ae01c/lava-logs.yaml 2026-05-08 21:26:19,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:26:19,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:26:19,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69fe1155e4d4e78cd76ae01c/lava_callback.json.gz 2026-05-08 21:26:19,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:26:19,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1155e4d4e78cd76ae01c HTTP/1.1" 200 None 2026-05-08 21:26:19,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:26:19,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:26:19,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:26:19,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1155e4d4e78cd76ae01c HTTP/1.1" 200 None 2026-05-08 21:26:19,405 - lava_callback - INFO - Completed processing callback for node 69fe1155e4d4e78cd76ae01c INFO: 172.20.0.1:41880 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:26:32,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:26:32,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40274 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:28:58,317 - lava_callback - INFO - Received callback for node 69fe1157e4d4e78cd76ae022 INFO: 172.20.0.1:40286 - "POST /node/69fe1157e4d4e78cd76ae022 HTTP/1.0" 202 Accepted 2026-05-08 21:28:58,324 - lava_callback - INFO - Starting async job submit for node 69fe1157e4d4e78cd76ae022 2026-05-08 21:28:58,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:28:58,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1157e4d4e78cd76ae022 HTTP/1.1" 200 None 2026-05-08 21:28:58,382 - lava_callback - DEBUG - Processing node 69fe1157e4d4e78cd76ae022: ltp-controllers 2026-05-08 21:28:58,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:28:59,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:28:59,038 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69fe1157e4d4e78cd76ae022/log.txt.gz 2026-05-08 21:28:59,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:28:59,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:28:59,443 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69fe1157e4d4e78cd76ae022/lava-logs.yaml 2026-05-08 21:28:59,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:28:59,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:28:59,561 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69fe1157e4d4e78cd76ae022/lava_callback.json.gz 2026-05-08 21:28:59,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:28:59,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1157e4d4e78cd76ae022 HTTP/1.1" 200 None 2026-05-08 21:28:59,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:28:59,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:28:59,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:28:59,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1157e4d4e78cd76ae022 HTTP/1.1" 200 None 2026-05-08 21:28:59,643 - lava_callback - INFO - Completed processing callback for node 69fe1157e4d4e78cd76ae022 2026-05-08 21:29:02,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:29:02,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34926 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:29:19,226 - lava_callback - INFO - Received callback for node 69fe1159e4d4e78cd76ae029 INFO: 172.20.0.1:34940 - "POST /node/69fe1159e4d4e78cd76ae029 HTTP/1.0" 202 Accepted 2026-05-08 21:29:19,232 - lava_callback - INFO - Starting async job submit for node 69fe1159e4d4e78cd76ae029 2026-05-08 21:29:19,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:29:19,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1159e4d4e78cd76ae029 HTTP/1.1" 200 None 2026-05-08 21:29:19,273 - lava_callback - DEBUG - Processing node 69fe1159e4d4e78cd76ae029: ltp-cve 2026-05-08 21:29:19,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:29:19,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:29:19,746 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69fe1159e4d4e78cd76ae029/log.txt.gz 2026-05-08 21:29:19,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:29:20,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:29:20,117 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69fe1159e4d4e78cd76ae029/lava-logs.yaml 2026-05-08 21:29:20,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:29:20,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:29:20,255 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69fe1159e4d4e78cd76ae029/lava_callback.json.gz 2026-05-08 21:29:20,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:29:20,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1159e4d4e78cd76ae029 HTTP/1.1" 200 None 2026-05-08 21:29:20,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:29:20,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:29:20,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:29:20,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1159e4d4e78cd76ae029 HTTP/1.1" 200 None 2026-05-08 21:29:20,366 - lava_callback - INFO - Completed processing callback for node 69fe1159e4d4e78cd76ae029 INFO: 172.20.0.1:36718 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:29:32,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:29:32,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51334 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:30:19,056 - lava_callback - INFO - Received callback for node 69fe115de4d4e78cd76ae02f INFO: 172.20.0.1:51340 - "POST /node/69fe115de4d4e78cd76ae02f HTTP/1.0" 202 Accepted 2026-05-08 21:30:19,063 - lava_callback - INFO - Starting async job submit for node 69fe115de4d4e78cd76ae02f 2026-05-08 21:30:19,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:30:19,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe115de4d4e78cd76ae02f HTTP/1.1" 200 None 2026-05-08 21:30:19,103 - lava_callback - DEBUG - Processing node 69fe115de4d4e78cd76ae02f: ltp-fs_bind 2026-05-08 21:30:19,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:30:19,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:30:19,599 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fe115de4d4e78cd76ae02f/log.txt.gz 2026-05-08 21:30:19,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:30:20,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:30:20,033 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fe115de4d4e78cd76ae02f/lava-logs.yaml 2026-05-08 21:30:20,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:30:20,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:30:20,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fe115de4d4e78cd76ae02f/lava_callback.json.gz 2026-05-08 21:30:20,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:30:20,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe115de4d4e78cd76ae02f HTTP/1.1" 200 None 2026-05-08 21:30:20,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:30:20,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:30:20,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:30:20,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe115de4d4e78cd76ae02f HTTP/1.1" 200 None 2026-05-08 21:30:20,427 - lava_callback - INFO - Completed processing callback for node 69fe115de4d4e78cd76ae02f INFO: 172.20.0.1:47680 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:30:32,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:30:32,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43462 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:33:18,712 - lava_callback - INFO - Received callback for node 69fe1160e4d4e78cd76ae039 INFO: 172.20.0.1:43470 - "POST /node/69fe1160e4d4e78cd76ae039 HTTP/1.0" 202 Accepted 2026-05-08 21:33:18,718 - lava_callback - INFO - Starting async job submit for node 69fe1160e4d4e78cd76ae039 2026-05-08 21:33:18,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:18,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1160e4d4e78cd76ae039 HTTP/1.1" 200 None 2026-05-08 21:33:18,757 - lava_callback - DEBUG - Processing node 69fe1160e4d4e78cd76ae039: ltp-input 2026-05-08 21:33:19,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:33:19,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:33:19,258 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69fe1160e4d4e78cd76ae039/log.txt.gz 2026-05-08 21:33:19,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:33:19,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:33:19,708 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69fe1160e4d4e78cd76ae039/lava-logs.yaml 2026-05-08 21:33:19,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:33:19,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:33:19,862 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69fe1160e4d4e78cd76ae039/lava_callback.json.gz 2026-05-08 21:33:19,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:19,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1160e4d4e78cd76ae039 HTTP/1.1" 200 None 2026-05-08 21:33:19,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:19,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:33:19,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:19,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1160e4d4e78cd76ae039 HTTP/1.1" 200 None 2026-05-08 21:33:19,947 - lava_callback - INFO - Completed processing callback for node 69fe1160e4d4e78cd76ae039 2026-05-08 21:33:26,209 - lava_callback - INFO - Received callback for node 69fbb393df29cd80ecaa42a2 INFO: 172.20.0.1:54646 - "POST /node/69fbb393df29cd80ecaa42a2 HTTP/1.0" 202 Accepted 2026-05-08 21:33:26,214 - lava_callback - INFO - Starting async job submit for node 69fbb393df29cd80ecaa42a2 2026-05-08 21:33:26,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:26,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb393df29cd80ecaa42a2 HTTP/1.1" 200 None 2026-05-08 21:33:26,228 - lava_callback - DEBUG - Processing node 69fbb393df29cd80ecaa42a2: baseline-arm-clabbe 2026-05-08 21:33:26,229 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb393df29cd80ecaa42a2 2026-05-08 21:33:26,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:26,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb393df29cd80ecaa42a2 HTTP/1.1" 200 None 2026-05-08 21:33:26,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:26,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:33:26,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:26,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb393df29cd80ecaa42a2 HTTP/1.1" 200 None 2026-05-08 21:33:26,276 - lava_callback - ERROR - Error processing callback for node 69fbb393df29cd80ecaa42a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54648 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:33:32,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:32,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38070 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:33:38,651 - lava_callback - INFO - Received callback for node 69fe115fe4d4e78cd76ae036 INFO: 172.20.0.1:38082 - "POST /node/69fe115fe4d4e78cd76ae036 HTTP/1.0" 202 Accepted 2026-05-08 21:33:38,658 - lava_callback - INFO - Starting async job submit for node 69fe115fe4d4e78cd76ae036 2026-05-08 21:33:38,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:38,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe115fe4d4e78cd76ae036 HTTP/1.1" 200 None 2026-05-08 21:33:38,698 - lava_callback - DEBUG - Processing node 69fe115fe4d4e78cd76ae036: ltp-fsx 2026-05-08 21:33:39,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:33:39,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:33:39,284 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69fe115fe4d4e78cd76ae036/log.txt.gz 2026-05-08 21:33:39,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:33:39,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:33:39,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69fe115fe4d4e78cd76ae036/lava-logs.yaml 2026-05-08 21:33:39,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:33:39,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:33:39,792 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69fe115fe4d4e78cd76ae036/lava_callback.json.gz 2026-05-08 21:33:39,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:39,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe115fe4d4e78cd76ae036 HTTP/1.1" 200 None 2026-05-08 21:33:39,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:39,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:33:39,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:33:39,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe115fe4d4e78cd76ae036 HTTP/1.1" 200 None 2026-05-08 21:33:39,873 - lava_callback - INFO - Completed processing callback for node 69fe115fe4d4e78cd76ae036 INFO: 172.20.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47504 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:34:02,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:34:02,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 21:34:06,200 - lava_callback - INFO - Received callback for node 69fbb3b9df29cd80ecaa42ac INFO: 172.20.0.1:43114 - "POST /node/69fbb3b9df29cd80ecaa42ac HTTP/1.0" 202 Accepted 2026-05-08 21:34:06,206 - lava_callback - INFO - Starting async job submit for node 69fbb3b9df29cd80ecaa42ac 2026-05-08 21:34:06,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:34:06,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb3b9df29cd80ecaa42ac HTTP/1.1" 200 None 2026-05-08 21:34:06,221 - lava_callback - DEBUG - Processing node 69fbb3b9df29cd80ecaa42ac: baseline-arm-clabbe 2026-05-08 21:34:06,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb3b9df29cd80ecaa42ac 2026-05-08 21:34:06,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:34:06,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb3b9df29cd80ecaa42ac HTTP/1.1" 200 None 2026-05-08 21:34:06,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:34:06,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:34:06,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:34:06,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb3b9df29cd80ecaa42ac HTTP/1.1" 200 None 2026-05-08 21:34:06,267 - lava_callback - ERROR - Error processing callback for node 69fbb3b9df29cd80ecaa42ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47512 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:34:18,441 - lava_callback - INFO - Received callback for node 69fe1162e4d4e78cd76ae03c INFO: 172.20.0.1:47516 - "POST /node/69fe1162e4d4e78cd76ae03c HTTP/1.0" 202 Accepted 2026-05-08 21:34:18,447 - lava_callback - INFO - Starting async job submit for node 69fe1162e4d4e78cd76ae03c 2026-05-08 21:34:18,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:34:18,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1162e4d4e78cd76ae03c HTTP/1.1" 200 None 2026-05-08 21:34:18,492 - lava_callback - DEBUG - Processing node 69fe1162e4d4e78cd76ae03c: ltp-ipc 2026-05-08 21:34:18,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:34:18,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:34:18,983 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69fe1162e4d4e78cd76ae03c/log.txt.gz 2026-05-08 21:34:19,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:34:19,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:34:19,336 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69fe1162e4d4e78cd76ae03c/lava-logs.yaml 2026-05-08 21:34:19,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:34:19,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:34:19,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69fe1162e4d4e78cd76ae03c/lava_callback.json.gz 2026-05-08 21:34:19,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:34:19,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1162e4d4e78cd76ae03c HTTP/1.1" 200 None 2026-05-08 21:34:19,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:34:19,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:34:19,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:34:19,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1162e4d4e78cd76ae03c HTTP/1.1" 200 None 2026-05-08 21:34:19,533 - lava_callback - INFO - Completed processing callback for node 69fe1162e4d4e78cd76ae03c INFO: 172.20.0.1:41712 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:34:32,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:34:32,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39372 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:37:08,367 - lava_callback - INFO - Received callback for node 69fbb47ddf29cd80ecaa4306 INFO: 172.20.0.1:39374 - "POST /node/69fbb47ddf29cd80ecaa4306 HTTP/1.0" 202 Accepted 2026-05-08 21:37:08,373 - lava_callback - INFO - Starting async job submit for node 69fbb47ddf29cd80ecaa4306 2026-05-08 21:37:08,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:37:08,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb47ddf29cd80ecaa4306 HTTP/1.1" 200 None 2026-05-08 21:37:08,388 - lava_callback - DEBUG - Processing node 69fbb47ddf29cd80ecaa4306: baseline-arm64-baylibre 2026-05-08 21:37:08,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb47ddf29cd80ecaa4306 2026-05-08 21:37:08,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:37:08,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb47ddf29cd80ecaa4306 HTTP/1.1" 200 None 2026-05-08 21:37:08,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:37:08,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 21:37:08,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:37:08,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb47ddf29cd80ecaa4306 HTTP/1.1" 200 None 2026-05-08 21:37:08,450 - lava_callback - ERROR - Error processing callback for node 69fbb47ddf29cd80ecaa4306: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50692 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:37:18,544 - lava_callback - INFO - Received callback for node 69fe1163e4d4e78cd76ae03f INFO: 172.20.0.1:50706 - "POST /node/69fe1163e4d4e78cd76ae03f HTTP/1.0" 202 Accepted 2026-05-08 21:37:18,551 - lava_callback - INFO - Starting async job submit for node 69fe1163e4d4e78cd76ae03f 2026-05-08 21:37:18,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:37:18,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1163e4d4e78cd76ae03f HTTP/1.1" 200 None 2026-05-08 21:37:18,601 - lava_callback - DEBUG - Processing node 69fe1163e4d4e78cd76ae03f: ltp-pty 2026-05-08 21:37:18,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:37:19,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:37:19,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69fe1163e4d4e78cd76ae03f/log.txt.gz 2026-05-08 21:37:19,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:37:19,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:37:19,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69fe1163e4d4e78cd76ae03f/lava-logs.yaml 2026-05-08 21:37:19,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:37:19,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:37:19,671 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69fe1163e4d4e78cd76ae03f/lava_callback.json.gz 2026-05-08 21:37:19,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:37:19,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1163e4d4e78cd76ae03f HTTP/1.1" 200 None 2026-05-08 21:37:19,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:37:19,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:37:19,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:37:19,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1163e4d4e78cd76ae03f HTTP/1.1" 200 None 2026-05-08 21:37:19,745 - lava_callback - INFO - Completed processing callback for node 69fe1163e4d4e78cd76ae03f INFO: 172.20.0.1:56726 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:37:32,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:37:32,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45616 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:38:18,579 - lava_callback - INFO - Received callback for node 69fe1165e4d4e78cd76ae042 INFO: 172.20.0.1:45626 - "POST /node/69fe1165e4d4e78cd76ae042 HTTP/1.0" 202 Accepted 2026-05-08 21:38:18,587 - lava_callback - INFO - Starting async job submit for node 69fe1165e4d4e78cd76ae042 2026-05-08 21:38:18,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:38:18,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1165e4d4e78cd76ae042 HTTP/1.1" 200 None 2026-05-08 21:38:18,697 - lava_callback - DEBUG - Processing node 69fe1165e4d4e78cd76ae042: ltp-sched 2026-05-08 21:38:19,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:38:19,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:38:19,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69fe1165e4d4e78cd76ae042/log.txt.gz 2026-05-08 21:38:19,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:38:19,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:38:19,642 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69fe1165e4d4e78cd76ae042/lava-logs.yaml 2026-05-08 21:38:19,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:38:19,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:38:19,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69fe1165e4d4e78cd76ae042/lava_callback.json.gz 2026-05-08 21:38:19,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:38:19,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1165e4d4e78cd76ae042 HTTP/1.1" 200 None 2026-05-08 21:38:19,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:38:19,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:38:19,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:38:19,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1165e4d4e78cd76ae042 HTTP/1.1" 200 None 2026-05-08 21:38:19,902 - lava_callback - INFO - Completed processing callback for node 69fe1165e4d4e78cd76ae042 2026-05-08 21:38:20,176 - lava_callback - INFO - Received callback for node 69fe1166e4d4e78cd76ae045 INFO: 172.20.0.1:41684 - "POST /node/69fe1166e4d4e78cd76ae045 HTTP/1.0" 202 Accepted 2026-05-08 21:38:20,185 - lava_callback - INFO - Starting async job submit for node 69fe1166e4d4e78cd76ae045 2026-05-08 21:38:20,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:38:20,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1166e4d4e78cd76ae045 HTTP/1.1" 200 None 2026-05-08 21:38:20,228 - lava_callback - DEBUG - Processing node 69fe1166e4d4e78cd76ae045: ltp-smoke 2026-05-08 21:38:20,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:38:20,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:38:20,711 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe1166e4d4e78cd76ae045/log.txt.gz 2026-05-08 21:38:20,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:38:21,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:38:21,347 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe1166e4d4e78cd76ae045/lava-logs.yaml 2026-05-08 21:38:21,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:38:21,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:38:21,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fe1166e4d4e78cd76ae045/lava_callback.json.gz 2026-05-08 21:38:21,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:38:21,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1166e4d4e78cd76ae045 HTTP/1.1" 200 None 2026-05-08 21:38:21,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:38:21,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:38:21,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:38:21,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1166e4d4e78cd76ae045 HTTP/1.1" 200 None 2026-05-08 21:38:21,552 - lava_callback - INFO - Completed processing callback for node 69fe1166e4d4e78cd76ae045 INFO: 172.20.0.1:41688 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:38:32,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:38:32,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56978 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:39:48,513 - lava_callback - INFO - Received callback for node 69fbb516df29cd80ecaa434a INFO: 172.20.0.1:56988 - "POST /node/69fbb516df29cd80ecaa434a HTTP/1.0" 202 Accepted 2026-05-08 21:39:48,519 - lava_callback - INFO - Starting async job submit for node 69fbb516df29cd80ecaa434a 2026-05-08 21:39:48,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:39:48,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb516df29cd80ecaa434a HTTP/1.1" 200 None 2026-05-08 21:39:48,535 - lava_callback - DEBUG - Processing node 69fbb516df29cd80ecaa434a: baseline-arm64-baylibre 2026-05-08 21:39:48,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb516df29cd80ecaa434a 2026-05-08 21:39:48,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:39:48,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb516df29cd80ecaa434a HTTP/1.1" 200 None 2026-05-08 21:39:48,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:39:48,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 21:39:48,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:39:48,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb516df29cd80ecaa434a HTTP/1.1" 200 None 2026-05-08 21:39:48,597 - lava_callback - ERROR - Error processing callback for node 69fbb516df29cd80ecaa434a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59692 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:41:08,431 - lava_callback - INFO - Received callback for node 69fbb563df29cd80ecaa436f INFO: 172.20.0.1:59698 - "POST /node/69fbb563df29cd80ecaa436f HTTP/1.0" 202 Accepted 2026-05-08 21:41:08,437 - lava_callback - INFO - Starting async job submit for node 69fbb563df29cd80ecaa436f 2026-05-08 21:41:08,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:41:08,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb563df29cd80ecaa436f HTTP/1.1" 200 None 2026-05-08 21:41:08,452 - lava_callback - DEBUG - Processing node 69fbb563df29cd80ecaa436f: baseline-arm64-baylibre 2026-05-08 21:41:08,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb563df29cd80ecaa436f 2026-05-08 21:41:08,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:41:08,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb563df29cd80ecaa436f HTTP/1.1" 200 None 2026-05-08 21:41:08,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:41:08,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 21:41:08,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:41:08,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb563df29cd80ecaa436f HTTP/1.1" 200 None 2026-05-08 21:41:08,498 - lava_callback - ERROR - Error processing callback for node 69fbb563df29cd80ecaa436f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53546 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:41:18,875 - lava_callback - INFO - Received callback for node 69fe116ae4d4e78cd76ae054 INFO: 172.20.0.1:53556 - "POST /node/69fe116ae4d4e78cd76ae054 HTTP/1.0" 202 Accepted 2026-05-08 21:41:18,881 - lava_callback - INFO - Starting async job submit for node 69fe116ae4d4e78cd76ae054 2026-05-08 21:41:18,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:41:18,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe116ae4d4e78cd76ae054 HTTP/1.1" 200 None 2026-05-08 21:41:18,923 - lava_callback - DEBUG - Processing node 69fe116ae4d4e78cd76ae054: ltp-syscalls-ipc 2026-05-08 21:41:19,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:41:19,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:41:19,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fe116ae4d4e78cd76ae054/log.txt.gz INFO: 172.20.0.1:53566 - "GET /favicon.ico HTTP/1.0" 404 Not Found 2026-05-08 21:41:19,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:41:19,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:41:19,928 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fe116ae4d4e78cd76ae054/lava-logs.yaml 2026-05-08 21:41:19,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:41:20,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:41:20,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fe116ae4d4e78cd76ae054/lava_callback.json.gz 2026-05-08 21:41:20,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:41:20,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe116ae4d4e78cd76ae054 HTTP/1.1" 200 None 2026-05-08 21:41:20,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:41:20,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:41:20,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:41:20,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe116ae4d4e78cd76ae054 HTTP/1.1" 200 None 2026-05-08 21:41:20,140 - lava_callback - INFO - Completed processing callback for node 69fe116ae4d4e78cd76ae054 INFO: 172.20.0.1:39338 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:41:32,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:41:32,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49576 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:42:58,753 - lava_callback - INFO - Received callback for node 69fe116be4d4e78cd76ae057 INFO: 172.20.0.1:49578 - "POST /node/69fe116be4d4e78cd76ae057 HTTP/1.0" 202 Accepted 2026-05-08 21:42:58,760 - lava_callback - INFO - Starting async job submit for node 69fe116be4d4e78cd76ae057 2026-05-08 21:42:58,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:42:58,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe116be4d4e78cd76ae057 HTTP/1.1" 200 None 2026-05-08 21:42:58,806 - lava_callback - DEBUG - Processing node 69fe116be4d4e78cd76ae057: ltp-timers 2026-05-08 21:42:59,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:42:59,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:42:59,346 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69fe116be4d4e78cd76ae057/log.txt.gz 2026-05-08 21:42:59,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:42:59,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:42:59,703 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69fe116be4d4e78cd76ae057/lava-logs.yaml 2026-05-08 21:42:59,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 21:42:59,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 21:42:59,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69fe116be4d4e78cd76ae057/lava_callback.json.gz 2026-05-08 21:42:59,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:42:59,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe116be4d4e78cd76ae057 HTTP/1.1" 200 None 2026-05-08 21:42:59,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:42:59,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-08 21:42:59,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:42:59,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe116be4d4e78cd76ae057 HTTP/1.1" 200 None 2026-05-08 21:42:59,914 - lava_callback - INFO - Completed processing callback for node 69fe116be4d4e78cd76ae057 2026-05-08 21:43:02,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:43:02,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51620 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:43:28,598 - lava_callback - INFO - Received callback for node 69fbb5fddf29cd80ecaa43b9 INFO: 172.20.0.1:51630 - "POST /node/69fbb5fddf29cd80ecaa43b9 HTTP/1.0" 202 Accepted 2026-05-08 21:43:28,603 - lava_callback - INFO - Starting async job submit for node 69fbb5fddf29cd80ecaa43b9 2026-05-08 21:43:28,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:43:28,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb5fddf29cd80ecaa43b9 HTTP/1.1" 200 None 2026-05-08 21:43:28,619 - lava_callback - DEBUG - Processing node 69fbb5fddf29cd80ecaa43b9: baseline-arm64-baylibre 2026-05-08 21:43:28,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb5fddf29cd80ecaa43b9 2026-05-08 21:43:28,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:43:28,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb5fddf29cd80ecaa43b9 HTTP/1.1" 200 None 2026-05-08 21:43:28,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:43:28,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 21:43:28,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:43:28,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb5fddf29cd80ecaa43b9 HTTP/1.1" 200 None 2026-05-08 21:43:28,672 - lava_callback - ERROR - Error processing callback for node 69fbb5fddf29cd80ecaa43b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44360 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:44:48,653 - lava_callback - INFO - Received callback for node 69fbb64bdf29cd80ecaa43de INFO: 172.20.0.1:44372 - "POST /node/69fbb64bdf29cd80ecaa43de HTTP/1.0" 202 Accepted 2026-05-08 21:44:48,659 - lava_callback - INFO - Starting async job submit for node 69fbb64bdf29cd80ecaa43de 2026-05-08 21:44:48,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:44:48,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb64bdf29cd80ecaa43de HTTP/1.1" 200 None 2026-05-08 21:44:48,679 - lava_callback - DEBUG - Processing node 69fbb64bdf29cd80ecaa43de: baseline-arm64-baylibre 2026-05-08 21:44:48,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb64bdf29cd80ecaa43de 2026-05-08 21:44:48,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:44:48,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb64bdf29cd80ecaa43de HTTP/1.1" 200 None 2026-05-08 21:44:48,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:44:48,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 21:44:48,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:44:48,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb64bdf29cd80ecaa43de HTTP/1.1" 200 None 2026-05-08 21:44:48,727 - lava_callback - ERROR - Error processing callback for node 69fbb64bdf29cd80ecaa43de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59622 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:46:26,811 - lava_callback - INFO - Received callback for node 69fbb69ddf29cd80ecaa43fe INFO: 172.20.0.1:59628 - "POST /node/69fbb69ddf29cd80ecaa43fe HTTP/1.0" 202 Accepted 2026-05-08 21:46:26,816 - lava_callback - INFO - Starting async job submit for node 69fbb69ddf29cd80ecaa43fe 2026-05-08 21:46:26,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:46:26,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb69ddf29cd80ecaa43fe HTTP/1.1" 200 None 2026-05-08 21:46:26,831 - lava_callback - DEBUG - Processing node 69fbb69ddf29cd80ecaa43fe: baseline-arm64-clabbe 2026-05-08 21:46:26,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb69ddf29cd80ecaa43fe 2026-05-08 21:46:26,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:46:26,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb69ddf29cd80ecaa43fe HTTP/1.1" 200 None 2026-05-08 21:46:26,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:46:26,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 21:46:26,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:46:26,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb69ddf29cd80ecaa43fe HTTP/1.1" 200 None 2026-05-08 21:46:26,891 - lava_callback - ERROR - Error processing callback for node 69fbb69ddf29cd80ecaa43fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51302 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:48:46,967 - lava_callback - INFO - Received callback for node 69fbb739df29cd80ecaa444a INFO: 172.20.0.1:51304 - "POST /node/69fbb739df29cd80ecaa444a HTTP/1.0" 202 Accepted 2026-05-08 21:48:46,973 - lava_callback - INFO - Starting async job submit for node 69fbb739df29cd80ecaa444a 2026-05-08 21:48:46,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:48:46,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb739df29cd80ecaa444a HTTP/1.1" 200 None 2026-05-08 21:48:46,989 - lava_callback - DEBUG - Processing node 69fbb739df29cd80ecaa444a: baseline-arm64-clabbe 2026-05-08 21:48:46,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb739df29cd80ecaa444a 2026-05-08 21:48:46,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:48:47,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb739df29cd80ecaa444a HTTP/1.1" 200 None 2026-05-08 21:48:47,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:48:47,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 21:48:47,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:48:47,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb739df29cd80ecaa444a HTTP/1.1" 200 None 2026-05-08 21:48:47,048 - lava_callback - ERROR - Error processing callback for node 69fbb739df29cd80ecaa444a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43992 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:50:07,093 - lava_callback - INFO - Received callback for node 69fbb785df29cd80ecaa446b INFO: 172.20.0.1:43994 - "POST /node/69fbb785df29cd80ecaa446b HTTP/1.0" 202 Accepted 2026-05-08 21:50:07,099 - lava_callback - INFO - Starting async job submit for node 69fbb785df29cd80ecaa446b 2026-05-08 21:50:07,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:50:07,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb785df29cd80ecaa446b HTTP/1.1" 200 None 2026-05-08 21:50:07,114 - lava_callback - DEBUG - Processing node 69fbb785df29cd80ecaa446b: baseline-arm64-clabbe 2026-05-08 21:50:07,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb785df29cd80ecaa446b 2026-05-08 21:50:07,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:50:07,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb785df29cd80ecaa446b HTTP/1.1" 200 None 2026-05-08 21:50:07,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:50:07,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 21:50:07,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:50:07,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb785df29cd80ecaa446b HTTP/1.1" 200 None 2026-05-08 21:50:07,159 - lava_callback - ERROR - Error processing callback for node 69fbb785df29cd80ecaa446b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41942 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:52:47,083 - lava_callback - INFO - Received callback for node 69fbb81edf29cd80ecaa44b5 INFO: 172.20.0.1:41956 - "POST /node/69fbb81edf29cd80ecaa44b5 HTTP/1.0" 202 Accepted 2026-05-08 21:52:47,090 - lava_callback - INFO - Starting async job submit for node 69fbb81edf29cd80ecaa44b5 2026-05-08 21:52:47,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:52:47,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb81edf29cd80ecaa44b5 HTTP/1.1" 200 None 2026-05-08 21:52:47,108 - lava_callback - DEBUG - Processing node 69fbb81edf29cd80ecaa44b5: baseline-arm64-clabbe 2026-05-08 21:52:47,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb81edf29cd80ecaa44b5 2026-05-08 21:52:47,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:52:47,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb81edf29cd80ecaa44b5 HTTP/1.1" 200 None 2026-05-08 21:52:47,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:52:47,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 21:52:47,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:52:47,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb81edf29cd80ecaa44b5 HTTP/1.1" 200 None 2026-05-08 21:52:47,187 - lava_callback - ERROR - Error processing callback for node 69fbb81edf29cd80ecaa44b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37480 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:55:27,273 - lava_callback - INFO - Received callback for node 69fbb8bbdf29cd80ecaa44fa INFO: 172.20.0.1:37486 - "POST /node/69fbb8bbdf29cd80ecaa44fa HTTP/1.0" 202 Accepted 2026-05-08 21:55:27,279 - lava_callback - INFO - Starting async job submit for node 69fbb8bbdf29cd80ecaa44fa 2026-05-08 21:55:27,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:55:27,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb8bbdf29cd80ecaa44fa HTTP/1.1" 200 None 2026-05-08 21:55:27,295 - lava_callback - DEBUG - Processing node 69fbb8bbdf29cd80ecaa44fa: baseline-arm64-clabbe 2026-05-08 21:55:27,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb8bbdf29cd80ecaa44fa 2026-05-08 21:55:27,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:55:27,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb8bbdf29cd80ecaa44fa HTTP/1.1" 200 None 2026-05-08 21:55:27,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:55:27,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 21:55:27,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:55:27,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb8bbdf29cd80ecaa44fa HTTP/1.1" 200 None 2026-05-08 21:55:27,350 - lava_callback - ERROR - Error processing callback for node 69fbb8bbdf29cd80ecaa44fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47328 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:57:47,357 - lava_callback - INFO - Received callback for node 69fbb957df29cd80ecaa454c INFO: 172.20.0.1:47338 - "POST /node/69fbb957df29cd80ecaa454c HTTP/1.0" 202 Accepted 2026-05-08 21:57:47,363 - lava_callback - INFO - Starting async job submit for node 69fbb957df29cd80ecaa454c 2026-05-08 21:57:47,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:57:47,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb957df29cd80ecaa454c HTTP/1.1" 200 None 2026-05-08 21:57:47,389 - lava_callback - DEBUG - Processing node 69fbb957df29cd80ecaa454c: baseline-arm64-clabbe 2026-05-08 21:57:47,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb957df29cd80ecaa454c 2026-05-08 21:57:47,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:57:47,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb957df29cd80ecaa454c HTTP/1.1" 200 None 2026-05-08 21:57:47,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:57:47,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 21:57:47,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:57:47,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb957df29cd80ecaa454c HTTP/1.1" 200 None 2026-05-08 21:57:47,449 - lava_callback - ERROR - Error processing callback for node 69fbb957df29cd80ecaa454c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60550 - "GET / HTTP/1.0" 200 OK 2026-05-08 21:59:07,368 - lava_callback - INFO - Received callback for node 69fbb997df29cd80ecaa4566 INFO: 172.20.0.1:60564 - "POST /node/69fbb997df29cd80ecaa4566 HTTP/1.0" 202 Accepted 2026-05-08 21:59:07,382 - lava_callback - INFO - Starting async job submit for node 69fbb997df29cd80ecaa4566 2026-05-08 21:59:07,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:59:07,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb997df29cd80ecaa4566 HTTP/1.1" 200 None 2026-05-08 21:59:07,408 - lava_callback - DEBUG - Processing node 69fbb997df29cd80ecaa4566: baseline-arm-clabbe 2026-05-08 21:59:07,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbb997df29cd80ecaa4566 2026-05-08 21:59:07,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:59:07,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbb997df29cd80ecaa4566 HTTP/1.1" 200 None 2026-05-08 21:59:07,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:59:07,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 21:59:07,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 21:59:07,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbb997df29cd80ecaa4566 HTTP/1.1" 200 None 2026-05-08 21:59:07,477 - lava_callback - ERROR - Error processing callback for node 69fbb997df29cd80ecaa4566: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48392 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:25:10,944 - lava_callback - INFO - Received callback for node 69fbbfc5df29cd80ecaa46be INFO: 172.20.0.1:44832 - "POST /node/69fbbfc5df29cd80ecaa46be HTTP/1.0" 202 Accepted 2026-05-08 22:25:10,950 - lava_callback - INFO - Starting async job submit for node 69fbbfc5df29cd80ecaa46be 2026-05-08 22:25:10,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:25:10,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbbfc5df29cd80ecaa46be HTTP/1.1" 200 None 2026-05-08 22:25:10,966 - lava_callback - DEBUG - Processing node 69fbbfc5df29cd80ecaa46be: baseline-arm64-baylibre 2026-05-08 22:25:10,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbbfc5df29cd80ecaa46be 2026-05-08 22:25:10,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:25:10,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbbfc5df29cd80ecaa46be HTTP/1.1" 200 None 2026-05-08 22:25:10,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:25:10,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:25:10,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:25:11,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbbfc5df29cd80ecaa46be HTTP/1.1" 200 None 2026-05-08 22:25:11,011 - lava_callback - ERROR - Error processing callback for node 69fbbfc5df29cd80ecaa46be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42100 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:26:30,909 - lava_callback - INFO - Received callback for node 69fbc013df29cd80ecaa46de INFO: 172.20.0.1:48218 - "POST /node/69fbc013df29cd80ecaa46de HTTP/1.0" 202 Accepted 2026-05-08 22:26:30,915 - lava_callback - INFO - Starting async job submit for node 69fbc013df29cd80ecaa46de 2026-05-08 22:26:30,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:26:30,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc013df29cd80ecaa46de HTTP/1.1" 200 None 2026-05-08 22:26:30,931 - lava_callback - DEBUG - Processing node 69fbc013df29cd80ecaa46de: baseline-arm64-baylibre 2026-05-08 22:26:30,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc013df29cd80ecaa46de 2026-05-08 22:26:30,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:26:30,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc013df29cd80ecaa46de HTTP/1.1" 200 None 2026-05-08 22:26:30,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:26:30,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:26:30,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:26:30,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc013df29cd80ecaa46de HTTP/1.1" 200 None 2026-05-08 22:26:30,986 - lava_callback - ERROR - Error processing callback for node 69fbc013df29cd80ecaa46de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42324 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:27:50,970 - lava_callback - INFO - Received callback for node 69fbc060df29cd80ecaa4700 INFO: 172.20.0.1:40256 - "POST /node/69fbc060df29cd80ecaa4700 HTTP/1.0" 202 Accepted 2026-05-08 22:27:50,976 - lava_callback - INFO - Starting async job submit for node 69fbc060df29cd80ecaa4700 2026-05-08 22:27:50,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:27:50,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc060df29cd80ecaa4700 HTTP/1.1" 200 None 2026-05-08 22:27:50,991 - lava_callback - DEBUG - Processing node 69fbc060df29cd80ecaa4700: baseline-arm64-baylibre 2026-05-08 22:27:50,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc060df29cd80ecaa4700 2026-05-08 22:27:50,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:27:51,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc060df29cd80ecaa4700 HTTP/1.1" 200 None 2026-05-08 22:27:51,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:27:51,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:27:51,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:27:51,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc060df29cd80ecaa4700 HTTP/1.1" 200 None 2026-05-08 22:27:51,041 - lava_callback - ERROR - Error processing callback for node 69fbc060df29cd80ecaa4700: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37616 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:29:11,200 - lava_callback - INFO - Received callback for node 69fbc0abdf29cd80ecaa4723 INFO: 172.20.0.1:42984 - "POST /node/69fbc0abdf29cd80ecaa4723 HTTP/1.0" 202 Accepted 2026-05-08 22:29:11,206 - lava_callback - INFO - Starting async job submit for node 69fbc0abdf29cd80ecaa4723 2026-05-08 22:29:11,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:29:11,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc0abdf29cd80ecaa4723 HTTP/1.1" 200 None 2026-05-08 22:29:11,222 - lava_callback - DEBUG - Processing node 69fbc0abdf29cd80ecaa4723: baseline-arm64-baylibre 2026-05-08 22:29:11,222 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc0abdf29cd80ecaa4723 2026-05-08 22:29:11,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:29:11,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc0abdf29cd80ecaa4723 HTTP/1.1" 200 None 2026-05-08 22:29:11,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:29:11,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:29:11,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:29:11,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc0abdf29cd80ecaa4723 HTTP/1.1" 200 None 2026-05-08 22:29:11,330 - lava_callback - ERROR - Error processing callback for node 69fbc0abdf29cd80ecaa4723: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41942 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:30:31,150 - lava_callback - INFO - Received callback for node 69fbc0f7df29cd80ecaa4749 INFO: 172.20.0.1:35804 - "POST /node/69fbc0f7df29cd80ecaa4749 HTTP/1.0" 202 Accepted 2026-05-08 22:30:31,156 - lava_callback - INFO - Starting async job submit for node 69fbc0f7df29cd80ecaa4749 2026-05-08 22:30:31,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:30:31,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc0f7df29cd80ecaa4749 HTTP/1.1" 200 None 2026-05-08 22:30:31,171 - lava_callback - DEBUG - Processing node 69fbc0f7df29cd80ecaa4749: baseline-arm64-baylibre 2026-05-08 22:30:31,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc0f7df29cd80ecaa4749 2026-05-08 22:30:31,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:30:31,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc0f7df29cd80ecaa4749 HTTP/1.1" 200 None 2026-05-08 22:30:31,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:30:31,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:30:31,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:30:31,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc0f7df29cd80ecaa4749 HTTP/1.1" 200 None 2026-05-08 22:30:31,227 - lava_callback - ERROR - Error processing callback for node 69fbc0f7df29cd80ecaa4749: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55768 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:31:31,154 - lava_callback - INFO - Received callback for node 69fbc141df29cd80ecaa4770 INFO: 172.20.0.1:46372 - "POST /node/69fbc141df29cd80ecaa4770 HTTP/1.0" 202 Accepted 2026-05-08 22:31:31,160 - lava_callback - INFO - Starting async job submit for node 69fbc141df29cd80ecaa4770 2026-05-08 22:31:31,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:31:31,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc141df29cd80ecaa4770 HTTP/1.1" 200 None 2026-05-08 22:31:31,175 - lava_callback - DEBUG - Processing node 69fbc141df29cd80ecaa4770: baseline-arm64-baylibre 2026-05-08 22:31:31,176 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc141df29cd80ecaa4770 2026-05-08 22:31:31,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:31:31,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc141df29cd80ecaa4770 HTTP/1.1" 200 None 2026-05-08 22:31:31,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:31:31,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:31:31,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:31:31,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc141df29cd80ecaa4770 HTTP/1.1" 200 None 2026-05-08 22:31:31,234 - lava_callback - ERROR - Error processing callback for node 69fbc141df29cd80ecaa4770: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36662 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:32:51,273 - lava_callback - INFO - Received callback for node 69fbc18adf29cd80ecaa4792 INFO: 172.20.0.1:37018 - "POST /node/69fbc18adf29cd80ecaa4792 HTTP/1.0" 202 Accepted 2026-05-08 22:32:51,281 - lava_callback - INFO - Starting async job submit for node 69fbc18adf29cd80ecaa4792 2026-05-08 22:32:51,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:32:51,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc18adf29cd80ecaa4792 HTTP/1.1" 200 None 2026-05-08 22:32:51,301 - lava_callback - DEBUG - Processing node 69fbc18adf29cd80ecaa4792: baseline-arm64-baylibre 2026-05-08 22:32:51,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc18adf29cd80ecaa4792 2026-05-08 22:32:51,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:32:51,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc18adf29cd80ecaa4792 HTTP/1.1" 200 None 2026-05-08 22:32:51,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:32:51,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:32:51,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:32:51,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc18adf29cd80ecaa4792 HTTP/1.1" 200 None 2026-05-08 22:32:51,352 - lava_callback - ERROR - Error processing callback for node 69fbc18adf29cd80ecaa4792: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41446 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:34:11,353 - lava_callback - INFO - Received callback for node 69fbc1d7df29cd80ecaa47b5 INFO: 172.20.0.1:42886 - "POST /node/69fbc1d7df29cd80ecaa47b5 HTTP/1.0" 202 Accepted 2026-05-08 22:34:11,359 - lava_callback - INFO - Starting async job submit for node 69fbc1d7df29cd80ecaa47b5 2026-05-08 22:34:11,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:34:11,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc1d7df29cd80ecaa47b5 HTTP/1.1" 200 None 2026-05-08 22:34:11,374 - lava_callback - DEBUG - Processing node 69fbc1d7df29cd80ecaa47b5: baseline-arm64-baylibre 2026-05-08 22:34:11,374 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc1d7df29cd80ecaa47b5 2026-05-08 22:34:11,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:34:11,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc1d7df29cd80ecaa47b5 HTTP/1.1" 200 None 2026-05-08 22:34:11,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:34:11,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:34:11,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:34:11,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc1d7df29cd80ecaa47b5 HTTP/1.1" 200 None 2026-05-08 22:34:11,431 - lava_callback - ERROR - Error processing callback for node 69fbc1d7df29cd80ecaa47b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45608 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:35:31,389 - lava_callback - INFO - Received callback for node 69fbc223df29cd80ecaa47db INFO: 172.20.0.1:46028 - "POST /node/69fbc223df29cd80ecaa47db HTTP/1.0" 202 Accepted 2026-05-08 22:35:31,394 - lava_callback - INFO - Starting async job submit for node 69fbc223df29cd80ecaa47db 2026-05-08 22:35:31,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:35:31,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc223df29cd80ecaa47db HTTP/1.1" 200 None 2026-05-08 22:35:31,409 - lava_callback - DEBUG - Processing node 69fbc223df29cd80ecaa47db: baseline-arm64-baylibre 2026-05-08 22:35:31,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc223df29cd80ecaa47db 2026-05-08 22:35:31,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:35:31,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc223df29cd80ecaa47db HTTP/1.1" 200 None 2026-05-08 22:35:31,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:35:31,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:35:31,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:35:31,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc223df29cd80ecaa47db HTTP/1.1" 200 None 2026-05-08 22:35:31,454 - lava_callback - ERROR - Error processing callback for node 69fbc223df29cd80ecaa47db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39422 - "GET /node/693fafc80d8ce4018da9c04e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39974 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:37:51,609 - lava_callback - INFO - Received callback for node 69fbc2b7df29cd80ecaa481d INFO: 172.20.0.1:46116 - "POST /node/69fbc2b7df29cd80ecaa481d HTTP/1.0" 202 Accepted 2026-05-08 22:37:51,617 - lava_callback - INFO - Starting async job submit for node 69fbc2b7df29cd80ecaa481d 2026-05-08 22:37:51,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:37:51,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc2b7df29cd80ecaa481d HTTP/1.1" 200 None 2026-05-08 22:37:51,632 - lava_callback - DEBUG - Processing node 69fbc2b7df29cd80ecaa481d: baseline-arm64-baylibre 2026-05-08 22:37:51,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc2b7df29cd80ecaa481d 2026-05-08 22:37:51,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:37:51,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc2b7df29cd80ecaa481d HTTP/1.1" 200 None 2026-05-08 22:37:51,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:37:51,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:37:51,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:37:51,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc2b7df29cd80ecaa481d HTTP/1.1" 200 None 2026-05-08 22:37:51,699 - lava_callback - ERROR - Error processing callback for node 69fbc2b7df29cd80ecaa481d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60930 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:39:11,667 - lava_callback - INFO - Received callback for node 69fbc2ffdf29cd80ecaa483d INFO: 172.20.0.1:52742 - "POST /node/69fbc2ffdf29cd80ecaa483d HTTP/1.0" 202 Accepted 2026-05-08 22:39:11,681 - lava_callback - INFO - Starting async job submit for node 69fbc2ffdf29cd80ecaa483d 2026-05-08 22:39:11,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:39:11,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc2ffdf29cd80ecaa483d HTTP/1.1" 200 None 2026-05-08 22:39:11,711 - lava_callback - DEBUG - Processing node 69fbc2ffdf29cd80ecaa483d: baseline-arm64-baylibre 2026-05-08 22:39:11,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc2ffdf29cd80ecaa483d 2026-05-08 22:39:11,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:39:11,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc2ffdf29cd80ecaa483d HTTP/1.1" 200 None 2026-05-08 22:39:11,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:39:11,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:39:11,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:39:11,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc2ffdf29cd80ecaa483d HTTP/1.1" 200 None 2026-05-08 22:39:11,777 - lava_callback - ERROR - Error processing callback for node 69fbc2ffdf29cd80ecaa483d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45514 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:40:31,744 - lava_callback - INFO - Received callback for node 69fbc34cdf29cd80ecaa4867 INFO: 172.20.0.1:43816 - "POST /node/69fbc34cdf29cd80ecaa4867 HTTP/1.0" 202 Accepted 2026-05-08 22:40:31,750 - lava_callback - INFO - Starting async job submit for node 69fbc34cdf29cd80ecaa4867 2026-05-08 22:40:31,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:40:31,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc34cdf29cd80ecaa4867 HTTP/1.1" 200 None 2026-05-08 22:40:31,765 - lava_callback - DEBUG - Processing node 69fbc34cdf29cd80ecaa4867: baseline-arm64-baylibre 2026-05-08 22:40:31,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc34cdf29cd80ecaa4867 2026-05-08 22:40:31,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:40:31,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc34cdf29cd80ecaa4867 HTTP/1.1" 200 None 2026-05-08 22:40:31,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:40:31,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:40:31,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:40:31,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc34cdf29cd80ecaa4867 HTTP/1.1" 200 None 2026-05-08 22:40:31,816 - lava_callback - ERROR - Error processing callback for node 69fbc34cdf29cd80ecaa4867: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36598 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:41:31,725 - lava_callback - INFO - Received callback for node 69fbc397df29cd80ecaa4886 INFO: 172.20.0.1:55586 - "POST /node/69fbc397df29cd80ecaa4886 HTTP/1.0" 202 Accepted 2026-05-08 22:41:31,732 - lava_callback - INFO - Starting async job submit for node 69fbc397df29cd80ecaa4886 2026-05-08 22:41:31,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:41:31,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc397df29cd80ecaa4886 HTTP/1.1" 200 None 2026-05-08 22:41:31,757 - lava_callback - DEBUG - Processing node 69fbc397df29cd80ecaa4886: baseline-arm64-baylibre 2026-05-08 22:41:31,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc397df29cd80ecaa4886 2026-05-08 22:41:31,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:41:31,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc397df29cd80ecaa4886 HTTP/1.1" 200 None 2026-05-08 22:41:31,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:41:31,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:41:31,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:41:31,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc397df29cd80ecaa4886 HTTP/1.1" 200 None 2026-05-08 22:41:31,810 - lava_callback - ERROR - Error processing callback for node 69fbc397df29cd80ecaa4886: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55844 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:43:09,166 - lava_callback - INFO - Received callback for node 69fbc3ebdf29cd80ecaa48ac INFO: 172.20.0.1:55858 - "POST /node/69fbc3ebdf29cd80ecaa48ac HTTP/1.0" 202 Accepted 2026-05-08 22:43:09,172 - lava_callback - INFO - Starting async job submit for node 69fbc3ebdf29cd80ecaa48ac 2026-05-08 22:43:09,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:43:09,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc3ebdf29cd80ecaa48ac HTTP/1.1" 200 None 2026-05-08 22:43:09,187 - lava_callback - DEBUG - Processing node 69fbc3ebdf29cd80ecaa48ac: baseline-arm64-clabbe 2026-05-08 22:43:09,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc3ebdf29cd80ecaa48ac 2026-05-08 22:43:09,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:43:09,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc3ebdf29cd80ecaa48ac HTTP/1.1" 200 None 2026-05-08 22:43:09,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:43:09,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:43:09,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:43:09,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc3ebdf29cd80ecaa48ac HTTP/1.1" 200 None 2026-05-08 22:43:09,241 - lava_callback - ERROR - Error processing callback for node 69fbc3ebdf29cd80ecaa48ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46914 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:44:12,312 - lava_callback - INFO - Received callback for node 69fbc432df29cd80ecaa48ce INFO: 172.20.0.1:49688 - "POST /node/69fbc432df29cd80ecaa48ce HTTP/1.0" 202 Accepted 2026-05-08 22:44:12,317 - lava_callback - INFO - Starting async job submit for node 69fbc432df29cd80ecaa48ce 2026-05-08 22:44:12,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:44:12,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc432df29cd80ecaa48ce HTTP/1.1" 200 None 2026-05-08 22:44:12,338 - lava_callback - DEBUG - Processing node 69fbc432df29cd80ecaa48ce: baseline-arm64-baylibre 2026-05-08 22:44:12,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc432df29cd80ecaa48ce 2026-05-08 22:44:12,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:44:12,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc432df29cd80ecaa48ce HTTP/1.1" 200 None 2026-05-08 22:44:12,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:44:12,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:44:12,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:44:12,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc432df29cd80ecaa48ce HTTP/1.1" 200 None 2026-05-08 22:44:12,409 - lava_callback - ERROR - Error processing callback for node 69fbc432df29cd80ecaa48ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45528 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:45:31,972 - lava_callback - INFO - Received callback for node 69fbc47ddf29cd80ecaa48f1 INFO: 172.20.0.1:33608 - "POST /node/69fbc47ddf29cd80ecaa48f1 HTTP/1.0" 202 Accepted 2026-05-08 22:45:31,978 - lava_callback - INFO - Starting async job submit for node 69fbc47ddf29cd80ecaa48f1 2026-05-08 22:45:31,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:45:31,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc47ddf29cd80ecaa48f1 HTTP/1.1" 200 None 2026-05-08 22:45:31,998 - lava_callback - DEBUG - Processing node 69fbc47ddf29cd80ecaa48f1: baseline-arm64-baylibre 2026-05-08 22:45:31,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc47ddf29cd80ecaa48f1 2026-05-08 22:45:31,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:45:32,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc47ddf29cd80ecaa48f1 HTTP/1.1" 200 None 2026-05-08 22:45:32,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:45:32,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:45:32,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:45:32,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc47ddf29cd80ecaa48f1 HTTP/1.1" 200 None 2026-05-08 22:45:32,054 - lava_callback - ERROR - Error processing callback for node 69fbc47ddf29cd80ecaa48f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40448 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:46:49,285 - lava_callback - INFO - Received callback for node 69fbc4cddf29cd80ecaa4912 INFO: 172.20.0.1:40464 - "POST /node/69fbc4cddf29cd80ecaa4912 HTTP/1.0" 202 Accepted 2026-05-08 22:46:49,291 - lava_callback - INFO - Starting async job submit for node 69fbc4cddf29cd80ecaa4912 2026-05-08 22:46:49,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:46:49,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc4cddf29cd80ecaa4912 HTTP/1.1" 200 None 2026-05-08 22:46:49,306 - lava_callback - DEBUG - Processing node 69fbc4cddf29cd80ecaa4912: baseline-arm64-clabbe 2026-05-08 22:46:49,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc4cddf29cd80ecaa4912 2026-05-08 22:46:49,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:46:49,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc4cddf29cd80ecaa4912 HTTP/1.1" 200 None 2026-05-08 22:46:49,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:46:49,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:46:49,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:46:49,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc4cddf29cd80ecaa4912 HTTP/1.1" 200 None 2026-05-08 22:46:49,357 - lava_callback - ERROR - Error processing callback for node 69fbc4cddf29cd80ecaa4912: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50944 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:47:52,109 - lava_callback - INFO - Received callback for node 69fbc512df29cd80ecaa4935 INFO: 172.20.0.1:40836 - "POST /node/69fbc512df29cd80ecaa4935 HTTP/1.0" 202 Accepted 2026-05-08 22:47:52,119 - lava_callback - INFO - Starting async job submit for node 69fbc512df29cd80ecaa4935 2026-05-08 22:47:52,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:47:52,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc512df29cd80ecaa4935 HTTP/1.1" 200 None 2026-05-08 22:47:52,139 - lava_callback - DEBUG - Processing node 69fbc512df29cd80ecaa4935: baseline-arm64-baylibre 2026-05-08 22:47:52,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc512df29cd80ecaa4935 2026-05-08 22:47:52,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:47:52,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc512df29cd80ecaa4935 HTTP/1.1" 200 None 2026-05-08 22:47:52,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:47:52,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:47:52,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:47:52,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc512df29cd80ecaa4935 HTTP/1.1" 200 None 2026-05-08 22:47:52,227 - lava_callback - ERROR - Error processing callback for node 69fbc512df29cd80ecaa4935: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42498 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:49:09,372 - lava_callback - INFO - Received callback for node 69fbc561df29cd80ecaa495b INFO: 172.20.0.1:42514 - "POST /node/69fbc561df29cd80ecaa495b HTTP/1.0" 202 Accepted 2026-05-08 22:49:09,378 - lava_callback - INFO - Starting async job submit for node 69fbc561df29cd80ecaa495b 2026-05-08 22:49:09,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:49:09,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc561df29cd80ecaa495b HTTP/1.1" 200 None 2026-05-08 22:49:09,397 - lava_callback - DEBUG - Processing node 69fbc561df29cd80ecaa495b: baseline-arm64-clabbe 2026-05-08 22:49:09,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc561df29cd80ecaa495b 2026-05-08 22:49:09,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:49:09,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc561df29cd80ecaa495b HTTP/1.1" 200 None 2026-05-08 22:49:09,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:49:09,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:49:09,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:49:09,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc561df29cd80ecaa495b HTTP/1.1" 200 None 2026-05-08 22:49:09,455 - lava_callback - ERROR - Error processing callback for node 69fbc561df29cd80ecaa495b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41314 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:50:29,434 - lava_callback - INFO - Received callback for node 69fbc5aedf29cd80ecaa497c INFO: 172.20.0.1:41316 - "POST /node/69fbc5aedf29cd80ecaa497c HTTP/1.0" 202 Accepted 2026-05-08 22:50:29,439 - lava_callback - INFO - Starting async job submit for node 69fbc5aedf29cd80ecaa497c 2026-05-08 22:50:29,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:50:29,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc5aedf29cd80ecaa497c HTTP/1.1" 200 None 2026-05-08 22:50:29,454 - lava_callback - DEBUG - Processing node 69fbc5aedf29cd80ecaa497c: baseline-arm64-clabbe 2026-05-08 22:50:29,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc5aedf29cd80ecaa497c 2026-05-08 22:50:29,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:50:29,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc5aedf29cd80ecaa497c HTTP/1.1" 200 None 2026-05-08 22:50:29,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:50:29,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:50:29,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:50:29,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc5aedf29cd80ecaa497c HTTP/1.1" 200 None 2026-05-08 22:50:29,506 - lava_callback - ERROR - Error processing callback for node 69fbc5aedf29cd80ecaa497c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47528 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:51:52,684 - lava_callback - INFO - Received callback for node 69fbc5f3df29cd80ecaa499f INFO: 172.20.0.1:44086 - "POST /node/69fbc5f3df29cd80ecaa499f HTTP/1.0" 202 Accepted 2026-05-08 22:51:52,689 - lava_callback - INFO - Starting async job submit for node 69fbc5f3df29cd80ecaa499f 2026-05-08 22:51:52,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:51:52,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc5f3df29cd80ecaa499f HTTP/1.1" 200 None 2026-05-08 22:51:52,705 - lava_callback - DEBUG - Processing node 69fbc5f3df29cd80ecaa499f: baseline-arm64-baylibre 2026-05-08 22:51:52,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc5f3df29cd80ecaa499f 2026-05-08 22:51:52,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:51:52,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc5f3df29cd80ecaa499f HTTP/1.1" 200 None 2026-05-08 22:51:52,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:51:52,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:51:52,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:51:52,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc5f3df29cd80ecaa499f HTTP/1.1" 200 None 2026-05-08 22:51:52,751 - lava_callback - ERROR - Error processing callback for node 69fbc5f3df29cd80ecaa499f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43716 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:53:09,553 - lava_callback - INFO - Received callback for node 69fbc645df29cd80ecaa49c2 INFO: 172.20.0.1:43726 - "POST /node/69fbc645df29cd80ecaa49c2 HTTP/1.0" 202 Accepted 2026-05-08 22:53:09,559 - lava_callback - INFO - Starting async job submit for node 69fbc645df29cd80ecaa49c2 2026-05-08 22:53:09,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:53:09,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc645df29cd80ecaa49c2 HTTP/1.1" 200 None 2026-05-08 22:53:09,589 - lava_callback - DEBUG - Processing node 69fbc645df29cd80ecaa49c2: baseline-arm64-clabbe 2026-05-08 22:53:09,590 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc645df29cd80ecaa49c2 2026-05-08 22:53:09,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:53:09,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc645df29cd80ecaa49c2 HTTP/1.1" 200 None 2026-05-08 22:53:09,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:53:09,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:53:09,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:53:09,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc645df29cd80ecaa49c2 HTTP/1.1" 200 None 2026-05-08 22:53:09,646 - lava_callback - ERROR - Error processing callback for node 69fbc645df29cd80ecaa49c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59326 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:54:29,585 - lava_callback - INFO - Received callback for node 69fbc692df29cd80ecaa49ea INFO: 172.20.0.1:59328 - "POST /node/69fbc692df29cd80ecaa49ea HTTP/1.0" 202 Accepted 2026-05-08 22:54:29,591 - lava_callback - INFO - Starting async job submit for node 69fbc692df29cd80ecaa49ea 2026-05-08 22:54:29,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:54:29,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc692df29cd80ecaa49ea HTTP/1.1" 200 None 2026-05-08 22:54:29,608 - lava_callback - DEBUG - Processing node 69fbc692df29cd80ecaa49ea: baseline-arm64-clabbe 2026-05-08 22:54:29,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc692df29cd80ecaa49ea 2026-05-08 22:54:29,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:54:29,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc692df29cd80ecaa49ea HTTP/1.1" 200 None 2026-05-08 22:54:29,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:54:29,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:54:29,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:54:29,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc692df29cd80ecaa49ea HTTP/1.1" 200 None 2026-05-08 22:54:29,654 - lava_callback - ERROR - Error processing callback for node 69fbc692df29cd80ecaa49ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43590 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:55:32,532 - lava_callback - INFO - Received callback for node 69fbc6d9df29cd80ecaa4a03 INFO: 172.20.0.1:49410 - "POST /node/69fbc6d9df29cd80ecaa4a03 HTTP/1.0" 202 Accepted 2026-05-08 22:55:32,537 - lava_callback - INFO - Starting async job submit for node 69fbc6d9df29cd80ecaa4a03 2026-05-08 22:55:32,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:55:32,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc6d9df29cd80ecaa4a03 HTTP/1.1" 200 None 2026-05-08 22:55:32,577 - lava_callback - DEBUG - Processing node 69fbc6d9df29cd80ecaa4a03: baseline-arm64-baylibre 2026-05-08 22:55:32,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc6d9df29cd80ecaa4a03 2026-05-08 22:55:32,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:55:32,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc6d9df29cd80ecaa4a03 HTTP/1.1" 200 None 2026-05-08 22:55:32,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:55:32,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:55:32,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:55:32,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc6d9df29cd80ecaa4a03 HTTP/1.1" 200 None 2026-05-08 22:55:32,632 - lava_callback - ERROR - Error processing callback for node 69fbc6d9df29cd80ecaa4a03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53624 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:56:49,663 - lava_callback - INFO - Received callback for node 69fbc72bdf29cd80ecaa4a36 INFO: 172.20.0.1:53634 - "POST /node/69fbc72bdf29cd80ecaa4a36 HTTP/1.0" 202 Accepted 2026-05-08 22:56:49,669 - lava_callback - INFO - Starting async job submit for node 69fbc72bdf29cd80ecaa4a36 2026-05-08 22:56:49,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:56:49,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc72bdf29cd80ecaa4a36 HTTP/1.1" 200 None 2026-05-08 22:56:49,683 - lava_callback - DEBUG - Processing node 69fbc72bdf29cd80ecaa4a36: baseline-arm64-clabbe 2026-05-08 22:56:49,684 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc72bdf29cd80ecaa4a36 2026-05-08 22:56:49,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:56:49,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc72bdf29cd80ecaa4a36 HTTP/1.1" 200 None 2026-05-08 22:56:49,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:56:49,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:56:49,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:56:49,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc72bdf29cd80ecaa4a36 HTTP/1.1" 200 None 2026-05-08 22:56:49,728 - lava_callback - ERROR - Error processing callback for node 69fbc72bdf29cd80ecaa4a36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41622 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:58:09,729 - lava_callback - INFO - Received callback for node 69fbc779df29cd80ecaa4a62 INFO: 172.20.0.1:38480 - "POST /node/69fbc779df29cd80ecaa4a62 HTTP/1.0" 202 Accepted 2026-05-08 22:58:09,735 - lava_callback - INFO - Starting async job submit for node 69fbc779df29cd80ecaa4a62 2026-05-08 22:58:09,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:58:09,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc779df29cd80ecaa4a62 HTTP/1.1" 200 None 2026-05-08 22:58:09,750 - lava_callback - DEBUG - Processing node 69fbc779df29cd80ecaa4a62: baseline-arm64-clabbe 2026-05-08 22:58:09,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc779df29cd80ecaa4a62 2026-05-08 22:58:09,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:58:09,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc779df29cd80ecaa4a62 HTTP/1.1" 200 None 2026-05-08 22:58:09,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:58:09,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 22:58:09,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:58:09,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc779df29cd80ecaa4a62 HTTP/1.1" 200 None 2026-05-08 22:58:09,809 - lava_callback - ERROR - Error processing callback for node 69fbc779df29cd80ecaa4a62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50644 - "GET / HTTP/1.0" 200 OK 2026-05-08 22:59:12,725 - lava_callback - INFO - Received callback for node 69fbc7b3df29cd80ecaa4a83 INFO: 172.20.0.1:52646 - "POST /node/69fbc7b3df29cd80ecaa4a83 HTTP/1.0" 202 Accepted 2026-05-08 22:59:12,734 - lava_callback - INFO - Starting async job submit for node 69fbc7b3df29cd80ecaa4a83 2026-05-08 22:59:12,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:59:12,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc7b3df29cd80ecaa4a83 HTTP/1.1" 200 None 2026-05-08 22:59:12,762 - lava_callback - DEBUG - Processing node 69fbc7b3df29cd80ecaa4a83: baseline-arm-baylibre 2026-05-08 22:59:12,762 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc7b3df29cd80ecaa4a83 2026-05-08 22:59:12,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:59:12,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc7b3df29cd80ecaa4a83 HTTP/1.1" 200 None 2026-05-08 22:59:12,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:59:12,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 22:59:12,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 22:59:12,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc7b3df29cd80ecaa4a83 HTTP/1.1" 200 None 2026-05-08 22:59:12,812 - lava_callback - ERROR - Error processing callback for node 69fbc7b3df29cd80ecaa4a83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49124 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:00:09,997 - lava_callback - INFO - Received callback for node 69fbc7e9df29cd80ecaa4a99 INFO: 172.20.0.1:39516 - "POST /node/69fbc7e9df29cd80ecaa4a99 HTTP/1.0" 202 Accepted 2026-05-08 23:00:10,004 - lava_callback - INFO - Starting async job submit for node 69fbc7e9df29cd80ecaa4a99 2026-05-08 23:00:10,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:00:10,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc7e9df29cd80ecaa4a99 HTTP/1.1" 200 None 2026-05-08 23:00:10,022 - lava_callback - DEBUG - Processing node 69fbc7e9df29cd80ecaa4a99: baseline-arm64-clabbe 2026-05-08 23:00:10,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc7e9df29cd80ecaa4a99 2026-05-08 23:00:10,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:00:10,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc7e9df29cd80ecaa4a99 HTTP/1.1" 200 None 2026-05-08 23:00:10,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:00:10,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 23:00:10,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:00:10,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc7e9df29cd80ecaa4a99 HTTP/1.1" 200 None 2026-05-08 23:00:10,068 - lava_callback - ERROR - Error processing callback for node 69fbc7e9df29cd80ecaa4a99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52390 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:01:12,864 - lava_callback - INFO - Received callback for node 69fbc824df29cd80ecaa4abb INFO: 172.20.0.1:41910 - "POST /node/69fbc824df29cd80ecaa4abb HTTP/1.0" 202 Accepted 2026-05-08 23:01:12,870 - lava_callback - INFO - Starting async job submit for node 69fbc824df29cd80ecaa4abb 2026-05-08 23:01:12,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:01:12,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc824df29cd80ecaa4abb HTTP/1.1" 200 None 2026-05-08 23:01:12,885 - lava_callback - DEBUG - Processing node 69fbc824df29cd80ecaa4abb: baseline-arm-baylibre 2026-05-08 23:01:12,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc824df29cd80ecaa4abb 2026-05-08 23:01:12,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:01:12,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc824df29cd80ecaa4abb HTTP/1.1" 200 None 2026-05-08 23:01:12,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:01:12,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:01:12,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:01:12,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc824df29cd80ecaa4abb HTTP/1.1" 200 None 2026-05-08 23:01:12,930 - lava_callback - ERROR - Error processing callback for node 69fbc824df29cd80ecaa4abb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36820 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:01:49,878 - lava_callback - INFO - Received callback for node 69fbc85bdf29cd80ecaa4ad3 INFO: 172.20.0.1:51494 - "POST /node/69fbc85bdf29cd80ecaa4ad3 HTTP/1.0" 202 Accepted 2026-05-08 23:01:49,883 - lava_callback - INFO - Starting async job submit for node 69fbc85bdf29cd80ecaa4ad3 2026-05-08 23:01:49,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:01:49,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc85bdf29cd80ecaa4ad3 HTTP/1.1" 200 None 2026-05-08 23:01:49,905 - lava_callback - DEBUG - Processing node 69fbc85bdf29cd80ecaa4ad3: baseline-arm64-clabbe 2026-05-08 23:01:49,905 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc85bdf29cd80ecaa4ad3 2026-05-08 23:01:49,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:01:49,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc85bdf29cd80ecaa4ad3 HTTP/1.1" 200 None 2026-05-08 23:01:49,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:01:49,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 23:01:49,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:01:49,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc85bdf29cd80ecaa4ad3 HTTP/1.1" 200 None 2026-05-08 23:01:49,951 - lava_callback - ERROR - Error processing callback for node 69fbc85bdf29cd80ecaa4ad3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33108 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:02:52,911 - lava_callback - INFO - Received callback for node 69fbc893df29cd80ecaa4af3 INFO: 172.20.0.1:58740 - "POST /node/69fbc893df29cd80ecaa4af3 HTTP/1.0" 202 Accepted 2026-05-08 23:02:52,918 - lava_callback - INFO - Starting async job submit for node 69fbc893df29cd80ecaa4af3 2026-05-08 23:02:52,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:02:52,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc893df29cd80ecaa4af3 HTTP/1.1" 200 None 2026-05-08 23:02:52,938 - lava_callback - DEBUG - Processing node 69fbc893df29cd80ecaa4af3: baseline-arm-baylibre 2026-05-08 23:02:52,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc893df29cd80ecaa4af3 2026-05-08 23:02:52,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:02:52,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc893df29cd80ecaa4af3 HTTP/1.1" 200 None 2026-05-08 23:02:52,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:02:52,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:02:52,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:02:53,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc893df29cd80ecaa4af3 HTTP/1.1" 200 None 2026-05-08 23:02:53,011 - lava_callback - ERROR - Error processing callback for node 69fbc893df29cd80ecaa4af3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45202 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:03:49,866 - lava_callback - INFO - Received callback for node 69fbc8ccdf29cd80ecaa4b05 INFO: 172.20.0.1:34734 - "POST /node/69fbc8ccdf29cd80ecaa4b05 HTTP/1.0" 202 Accepted 2026-05-08 23:03:49,872 - lava_callback - INFO - Starting async job submit for node 69fbc8ccdf29cd80ecaa4b05 2026-05-08 23:03:49,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:03:49,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc8ccdf29cd80ecaa4b05 HTTP/1.1" 200 None 2026-05-08 23:03:49,887 - lava_callback - DEBUG - Processing node 69fbc8ccdf29cd80ecaa4b05: baseline-arm64-clabbe 2026-05-08 23:03:49,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc8ccdf29cd80ecaa4b05 2026-05-08 23:03:49,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:03:49,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc8ccdf29cd80ecaa4b05 HTTP/1.1" 200 None 2026-05-08 23:03:49,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:03:49,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 23:03:49,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:03:49,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc8ccdf29cd80ecaa4b05 HTTP/1.1" 200 None 2026-05-08 23:03:49,941 - lava_callback - ERROR - Error processing callback for node 69fbc8ccdf29cd80ecaa4b05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57318 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:04:53,000 - lava_callback - INFO - Received callback for node 69fbc906df29cd80ecaa4b27 INFO: 172.20.0.1:47356 - "POST /node/69fbc906df29cd80ecaa4b27 HTTP/1.0" 202 Accepted 2026-05-08 23:04:53,006 - lava_callback - INFO - Starting async job submit for node 69fbc906df29cd80ecaa4b27 2026-05-08 23:04:53,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:04:53,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc906df29cd80ecaa4b27 HTTP/1.1" 200 None 2026-05-08 23:04:53,021 - lava_callback - DEBUG - Processing node 69fbc906df29cd80ecaa4b27: baseline-arm-baylibre 2026-05-08 23:04:53,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc906df29cd80ecaa4b27 2026-05-08 23:04:53,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:04:53,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc906df29cd80ecaa4b27 HTTP/1.1" 200 None 2026-05-08 23:04:53,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:04:53,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:04:53,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:04:53,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc906df29cd80ecaa4b27 HTTP/1.1" 200 None 2026-05-08 23:04:53,082 - lava_callback - ERROR - Error processing callback for node 69fbc906df29cd80ecaa4b27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46412 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:05:49,963 - lava_callback - INFO - Received callback for node 69fbc93edf29cd80ecaa4b38 INFO: 172.20.0.1:34938 - "POST /node/69fbc93edf29cd80ecaa4b38 HTTP/1.0" 202 Accepted 2026-05-08 23:05:49,968 - lava_callback - INFO - Starting async job submit for node 69fbc93edf29cd80ecaa4b38 2026-05-08 23:05:49,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:05:49,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc93edf29cd80ecaa4b38 HTTP/1.1" 200 None 2026-05-08 23:05:49,984 - lava_callback - DEBUG - Processing node 69fbc93edf29cd80ecaa4b38: baseline-arm64-clabbe 2026-05-08 23:05:49,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc93edf29cd80ecaa4b38 2026-05-08 23:05:49,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:05:49,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc93edf29cd80ecaa4b38 HTTP/1.1" 200 None 2026-05-08 23:05:49,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:05:50,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 23:05:50,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:05:50,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc93edf29cd80ecaa4b38 HTTP/1.1" 200 None 2026-05-08 23:05:50,033 - lava_callback - ERROR - Error processing callback for node 69fbc93edf29cd80ecaa4b38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44898 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:07:10,075 - lava_callback - INFO - Received callback for node 69fbc98adf29cd80ecaa4b63 INFO: 172.20.0.1:32784 - "POST /node/69fbc98adf29cd80ecaa4b63 HTTP/1.0" 202 Accepted 2026-05-08 23:07:10,080 - lava_callback - INFO - Starting async job submit for node 69fbc98adf29cd80ecaa4b63 2026-05-08 23:07:10,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:07:10,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc98adf29cd80ecaa4b63 HTTP/1.1" 200 None 2026-05-08 23:07:10,095 - lava_callback - DEBUG - Processing node 69fbc98adf29cd80ecaa4b63: baseline-arm64-clabbe 2026-05-08 23:07:10,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc98adf29cd80ecaa4b63 2026-05-08 23:07:10,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:07:10,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc98adf29cd80ecaa4b63 HTTP/1.1" 200 None 2026-05-08 23:07:10,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:07:10,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 23:07:10,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:07:10,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc98adf29cd80ecaa4b63 HTTP/1.1" 200 None 2026-05-08 23:07:10,152 - lava_callback - ERROR - Error processing callback for node 69fbc98adf29cd80ecaa4b63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57224 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:08:10,064 - lava_callback - INFO - Received callback for node 69fbc9c8df29cd80ecaa4b83 INFO: 172.20.0.1:37944 - "POST /node/69fbc9c8df29cd80ecaa4b83 HTTP/1.0" 202 Accepted 2026-05-08 23:08:10,070 - lava_callback - INFO - Starting async job submit for node 69fbc9c8df29cd80ecaa4b83 2026-05-08 23:08:10,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:08:10,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc9c8df29cd80ecaa4b83 HTTP/1.1" 200 None 2026-05-08 23:08:10,085 - lava_callback - DEBUG - Processing node 69fbc9c8df29cd80ecaa4b83: baseline-arm-clabbe 2026-05-08 23:08:10,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc9c8df29cd80ecaa4b83 2026-05-08 23:08:10,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:08:10,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc9c8df29cd80ecaa4b83 HTTP/1.1" 200 None 2026-05-08 23:08:10,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:08:10,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:08:10,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:08:10,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc9c8df29cd80ecaa4b83 HTTP/1.1" 200 None 2026-05-08 23:08:10,129 - lava_callback - ERROR - Error processing callback for node 69fbc9c8df29cd80ecaa4b83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51586 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:08:50,082 - lava_callback - INFO - Received callback for node 69fbc9efdf29cd80ecaa4b94 INFO: 172.20.0.1:41204 - "POST /node/69fbc9efdf29cd80ecaa4b94 HTTP/1.0" 202 Accepted 2026-05-08 23:08:50,088 - lava_callback - INFO - Starting async job submit for node 69fbc9efdf29cd80ecaa4b94 2026-05-08 23:08:50,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:08:50,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc9efdf29cd80ecaa4b94 HTTP/1.1" 200 None 2026-05-08 23:08:50,103 - lava_callback - DEBUG - Processing node 69fbc9efdf29cd80ecaa4b94: baseline-arm-clabbe 2026-05-08 23:08:50,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbc9efdf29cd80ecaa4b94 2026-05-08 23:08:50,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:08:50,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbc9efdf29cd80ecaa4b94 HTTP/1.1" 200 None 2026-05-08 23:08:50,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:08:50,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:08:50,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:08:50,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbc9efdf29cd80ecaa4b94 HTTP/1.1" 200 None 2026-05-08 23:08:50,153 - lava_callback - ERROR - Error processing callback for node 69fbc9efdf29cd80ecaa4b94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52826 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:09:30,132 - lava_callback - INFO - Received callback for node 69fbca24df29cd80ecaa4ba5 INFO: 172.20.0.1:46476 - "POST /node/69fbca24df29cd80ecaa4ba5 HTTP/1.0" 202 Accepted 2026-05-08 23:09:30,139 - lava_callback - INFO - Starting async job submit for node 69fbca24df29cd80ecaa4ba5 2026-05-08 23:09:30,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:09:30,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbca24df29cd80ecaa4ba5 HTTP/1.1" 200 None 2026-05-08 23:09:30,158 - lava_callback - DEBUG - Processing node 69fbca24df29cd80ecaa4ba5: baseline-arm64-clabbe 2026-05-08 23:09:30,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbca24df29cd80ecaa4ba5 2026-05-08 23:09:30,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:09:30,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbca24df29cd80ecaa4ba5 HTTP/1.1" 200 None 2026-05-08 23:09:30,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:09:30,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 23:09:30,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:09:30,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbca24df29cd80ecaa4ba5 HTTP/1.1" 200 None 2026-05-08 23:09:30,219 - lava_callback - ERROR - Error processing callback for node 69fbca24df29cd80ecaa4ba5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46180 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:10:33,453 - lava_callback - INFO - Received callback for node 69fbca60df29cd80ecaa4bc8 INFO: 172.20.0.1:39748 - "POST /node/69fbca60df29cd80ecaa4bc8 HTTP/1.0" 202 Accepted 2026-05-08 23:10:33,460 - lava_callback - INFO - Starting async job submit for node 69fbca60df29cd80ecaa4bc8 2026-05-08 23:10:33,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:10:33,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbca60df29cd80ecaa4bc8 HTTP/1.1" 200 None 2026-05-08 23:10:33,478 - lava_callback - DEBUG - Processing node 69fbca60df29cd80ecaa4bc8: baseline-arm-baylibre 2026-05-08 23:10:33,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbca60df29cd80ecaa4bc8 2026-05-08 23:10:33,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:10:33,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbca60df29cd80ecaa4bc8 HTTP/1.1" 200 None 2026-05-08 23:10:33,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:10:33,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:10:33,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:10:33,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbca60df29cd80ecaa4bc8 HTTP/1.1" 200 None 2026-05-08 23:10:33,524 - lava_callback - ERROR - Error processing callback for node 69fbca60df29cd80ecaa4bc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45476 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:11:30,215 - lava_callback - INFO - Received callback for node 69fbca99df29cd80ecaa4bd8 INFO: 172.20.0.1:45094 - "POST /node/69fbca99df29cd80ecaa4bd8 HTTP/1.0" 202 Accepted 2026-05-08 23:11:30,221 - lava_callback - INFO - Starting async job submit for node 69fbca99df29cd80ecaa4bd8 2026-05-08 23:11:30,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:11:30,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbca99df29cd80ecaa4bd8 HTTP/1.1" 200 None 2026-05-08 23:11:30,236 - lava_callback - DEBUG - Processing node 69fbca99df29cd80ecaa4bd8: baseline-arm64-clabbe 2026-05-08 23:11:30,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbca99df29cd80ecaa4bd8 2026-05-08 23:11:30,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:11:30,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbca99df29cd80ecaa4bd8 HTTP/1.1" 200 None 2026-05-08 23:11:30,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:11:30,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 23:11:30,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:11:30,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbca99df29cd80ecaa4bd8 HTTP/1.1" 200 None 2026-05-08 23:11:30,290 - lava_callback - ERROR - Error processing callback for node 69fbca99df29cd80ecaa4bd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45148 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:12:33,409 - lava_callback - INFO - Received callback for node 69fbcad3df29cd80ecaa4bf6 INFO: 172.20.0.1:44262 - "POST /node/69fbcad3df29cd80ecaa4bf6 HTTP/1.0" 202 Accepted 2026-05-08 23:12:33,416 - lava_callback - INFO - Starting async job submit for node 69fbcad3df29cd80ecaa4bf6 2026-05-08 23:12:33,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:12:33,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcad3df29cd80ecaa4bf6 HTTP/1.1" 200 None 2026-05-08 23:12:33,436 - lava_callback - DEBUG - Processing node 69fbcad3df29cd80ecaa4bf6: baseline-arm-baylibre 2026-05-08 23:12:33,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcad3df29cd80ecaa4bf6 2026-05-08 23:12:33,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:12:33,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcad3df29cd80ecaa4bf6 HTTP/1.1" 200 None 2026-05-08 23:12:33,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:12:33,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:12:33,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:12:33,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcad3df29cd80ecaa4bf6 HTTP/1.1" 200 None 2026-05-08 23:12:33,499 - lava_callback - ERROR - Error processing callback for node 69fbcad3df29cd80ecaa4bf6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41934 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:13:30,348 - lava_callback - INFO - Received callback for node 69fbcb0bdf29cd80ecaa4c0c INFO: 172.20.0.1:57556 - "POST /node/69fbcb0bdf29cd80ecaa4c0c HTTP/1.0" 202 Accepted 2026-05-08 23:13:30,354 - lava_callback - INFO - Starting async job submit for node 69fbcb0bdf29cd80ecaa4c0c 2026-05-08 23:13:30,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:13:30,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcb0bdf29cd80ecaa4c0c HTTP/1.1" 200 None 2026-05-08 23:13:30,371 - lava_callback - DEBUG - Processing node 69fbcb0bdf29cd80ecaa4c0c: baseline-arm64-clabbe 2026-05-08 23:13:30,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcb0bdf29cd80ecaa4c0c 2026-05-08 23:13:30,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:13:30,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcb0bdf29cd80ecaa4c0c HTTP/1.1" 200 None 2026-05-08 23:13:30,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:13:30,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 23:13:30,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:13:30,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcb0bdf29cd80ecaa4c0c HTTP/1.1" 200 None 2026-05-08 23:13:30,423 - lava_callback - ERROR - Error processing callback for node 69fbcb0bdf29cd80ecaa4c0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46510 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:14:50,350 - lava_callback - INFO - Received callback for node 69fbcb56df29cd80ecaa4c27 INFO: 172.20.0.1:46486 - "POST /node/69fbcb56df29cd80ecaa4c27 HTTP/1.0" 202 Accepted 2026-05-08 23:14:50,356 - lava_callback - INFO - Starting async job submit for node 69fbcb56df29cd80ecaa4c27 2026-05-08 23:14:50,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:14:50,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcb56df29cd80ecaa4c27 HTTP/1.1" 200 None 2026-05-08 23:14:50,371 - lava_callback - DEBUG - Processing node 69fbcb56df29cd80ecaa4c27: baseline-arm64-clabbe 2026-05-08 23:14:50,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcb56df29cd80ecaa4c27 2026-05-08 23:14:50,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:14:50,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcb56df29cd80ecaa4c27 HTTP/1.1" 200 None 2026-05-08 23:14:50,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:14:50,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 23:14:50,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:14:50,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcb56df29cd80ecaa4c27 HTTP/1.1" 200 None 2026-05-08 23:14:50,419 - lava_callback - ERROR - Error processing callback for node 69fbcb56df29cd80ecaa4c27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53256 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:15:50,440 - lava_callback - INFO - Received callback for node 69fbcba1df29cd80ecaa4c4d INFO: 172.20.0.1:57174 - "POST /node/69fbcba1df29cd80ecaa4c4d HTTP/1.0" 202 Accepted 2026-05-08 23:15:50,445 - lava_callback - INFO - Starting async job submit for node 69fbcba1df29cd80ecaa4c4d 2026-05-08 23:15:50,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:15:50,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcba1df29cd80ecaa4c4d HTTP/1.1" 200 None 2026-05-08 23:15:50,469 - lava_callback - DEBUG - Processing node 69fbcba1df29cd80ecaa4c4d: baseline-arm64-clabbe 2026-05-08 23:15:50,469 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcba1df29cd80ecaa4c4d 2026-05-08 23:15:50,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:15:50,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcba1df29cd80ecaa4c4d HTTP/1.1" 200 None 2026-05-08 23:15:50,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:15:50,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 23:15:50,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:15:50,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcba1df29cd80ecaa4c4d HTTP/1.1" 200 None 2026-05-08 23:15:50,534 - lava_callback - ERROR - Error processing callback for node 69fbcba1df29cd80ecaa4c4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43310 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:16:50,511 - lava_callback - INFO - Received callback for node 69fbcbdedf29cd80ecaa4c69 INFO: 172.20.0.1:43168 - "POST /node/69fbcbdedf29cd80ecaa4c69 HTTP/1.0" 202 Accepted 2026-05-08 23:16:50,519 - lava_callback - INFO - Starting async job submit for node 69fbcbdedf29cd80ecaa4c69 2026-05-08 23:16:50,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:16:50,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcbdedf29cd80ecaa4c69 HTTP/1.1" 200 None 2026-05-08 23:16:50,538 - lava_callback - DEBUG - Processing node 69fbcbdedf29cd80ecaa4c69: baseline-arm-clabbe 2026-05-08 23:16:50,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcbdedf29cd80ecaa4c69 2026-05-08 23:16:50,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:16:50,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcbdedf29cd80ecaa4c69 HTTP/1.1" 200 None 2026-05-08 23:16:50,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:16:50,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:16:50,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:16:50,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcbdedf29cd80ecaa4c69 HTTP/1.1" 200 None 2026-05-08 23:16:50,606 - lava_callback - ERROR - Error processing callback for node 69fbcbdedf29cd80ecaa4c69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34320 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:17:33,758 - lava_callback - INFO - Received callback for node 69fbcbffdf29cd80ecaa4c76 INFO: 172.20.0.1:59022 - "POST /node/69fbcbffdf29cd80ecaa4c76 HTTP/1.0" 202 Accepted 2026-05-08 23:17:33,764 - lava_callback - INFO - Starting async job submit for node 69fbcbffdf29cd80ecaa4c76 2026-05-08 23:17:33,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:17:33,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcbffdf29cd80ecaa4c76 HTTP/1.1" 200 None 2026-05-08 23:17:33,786 - lava_callback - DEBUG - Processing node 69fbcbffdf29cd80ecaa4c76: baseline-arm-baylibre 2026-05-08 23:17:33,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcbffdf29cd80ecaa4c76 2026-05-08 23:17:33,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:17:33,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcbffdf29cd80ecaa4c76 HTTP/1.1" 200 None 2026-05-08 23:17:33,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:17:33,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:17:33,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:17:33,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcbffdf29cd80ecaa4c76 HTTP/1.1" 200 None 2026-05-08 23:17:33,850 - lava_callback - ERROR - Error processing callback for node 69fbcbffdf29cd80ecaa4c76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34114 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:18:13,709 - lava_callback - INFO - Received callback for node 69fbcc25df29cd80ecaa4c80 INFO: 172.20.0.1:56286 - "POST /node/69fbcc25df29cd80ecaa4c80 HTTP/1.0" 202 Accepted 2026-05-08 23:18:13,717 - lava_callback - INFO - Starting async job submit for node 69fbcc25df29cd80ecaa4c80 2026-05-08 23:18:13,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:18:13,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcc25df29cd80ecaa4c80 HTTP/1.1" 200 None 2026-05-08 23:18:13,741 - lava_callback - DEBUG - Processing node 69fbcc25df29cd80ecaa4c80: baseline-arm-baylibre 2026-05-08 23:18:13,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcc25df29cd80ecaa4c80 2026-05-08 23:18:13,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:18:13,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcc25df29cd80ecaa4c80 HTTP/1.1" 200 None 2026-05-08 23:18:13,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:18:13,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:18:13,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:18:13,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcc25df29cd80ecaa4c80 HTTP/1.1" 200 None 2026-05-08 23:18:13,803 - lava_callback - ERROR - Error processing callback for node 69fbcc25df29cd80ecaa4c80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41132 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:18:50,534 - lava_callback - INFO - Received callback for node 69fbcc4fdf29cd80ecaa4c8c INFO: 172.20.0.1:56522 - "POST /node/69fbcc4fdf29cd80ecaa4c8c HTTP/1.0" 202 Accepted 2026-05-08 23:18:50,540 - lava_callback - INFO - Starting async job submit for node 69fbcc4fdf29cd80ecaa4c8c 2026-05-08 23:18:50,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:18:50,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcc4fdf29cd80ecaa4c8c HTTP/1.1" 200 None 2026-05-08 23:18:50,562 - lava_callback - DEBUG - Processing node 69fbcc4fdf29cd80ecaa4c8c: baseline-arm-clabbe 2026-05-08 23:18:50,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcc4fdf29cd80ecaa4c8c 2026-05-08 23:18:50,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:18:50,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcc4fdf29cd80ecaa4c8c HTTP/1.1" 200 None 2026-05-08 23:18:50,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:18:50,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:18:50,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:18:50,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcc4fdf29cd80ecaa4c8c HTTP/1.1" 200 None 2026-05-08 23:18:50,634 - lava_callback - ERROR - Error processing callback for node 69fbcc4fdf29cd80ecaa4c8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44082 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:19:13,795 - lava_callback - INFO - Received callback for node 69fbcc70df29cd80ecaa4c9a INFO: 172.20.0.1:51820 - "POST /node/69fbcc70df29cd80ecaa4c9a HTTP/1.0" 202 Accepted 2026-05-08 23:19:13,801 - lava_callback - INFO - Starting async job submit for node 69fbcc70df29cd80ecaa4c9a 2026-05-08 23:19:13,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:19:13,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcc70df29cd80ecaa4c9a HTTP/1.1" 200 None 2026-05-08 23:19:13,815 - lava_callback - DEBUG - Processing node 69fbcc70df29cd80ecaa4c9a: baseline-arm-baylibre 2026-05-08 23:19:13,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcc70df29cd80ecaa4c9a 2026-05-08 23:19:13,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:19:13,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcc70df29cd80ecaa4c9a HTTP/1.1" 200 None 2026-05-08 23:19:13,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:19:13,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:19:13,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:19:13,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcc70df29cd80ecaa4c9a HTTP/1.1" 200 None 2026-05-08 23:19:13,867 - lava_callback - ERROR - Error processing callback for node 69fbcc70df29cd80ecaa4c9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60274 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:20:10,584 - lava_callback - INFO - Received callback for node 69fbcc99df29cd80ecaa4ca5 INFO: 172.20.0.1:40834 - "POST /node/69fbcc99df29cd80ecaa4ca5 HTTP/1.0" 202 Accepted 2026-05-08 23:20:10,589 - lava_callback - INFO - Starting async job submit for node 69fbcc99df29cd80ecaa4ca5 2026-05-08 23:20:10,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:20:10,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcc99df29cd80ecaa4ca5 HTTP/1.1" 200 None 2026-05-08 23:20:10,604 - lava_callback - DEBUG - Processing node 69fbcc99df29cd80ecaa4ca5: baseline-arm-clabbe 2026-05-08 23:20:10,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcc99df29cd80ecaa4ca5 2026-05-08 23:20:10,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:20:10,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcc99df29cd80ecaa4ca5 HTTP/1.1" 200 None 2026-05-08 23:20:10,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:20:10,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:20:10,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:20:10,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcc99df29cd80ecaa4ca5 HTTP/1.1" 200 None 2026-05-08 23:20:10,649 - lava_callback - ERROR - Error processing callback for node 69fbcc99df29cd80ecaa4ca5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38226 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:20:50,599 - lava_callback - INFO - Received callback for node 69fbccbfdf29cd80ecaa4cb1 INFO: 172.20.0.1:47078 - "POST /node/69fbccbfdf29cd80ecaa4cb1 HTTP/1.0" 202 Accepted 2026-05-08 23:20:50,605 - lava_callback - INFO - Starting async job submit for node 69fbccbfdf29cd80ecaa4cb1 2026-05-08 23:20:50,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:20:50,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbccbfdf29cd80ecaa4cb1 HTTP/1.1" 200 None 2026-05-08 23:20:50,620 - lava_callback - DEBUG - Processing node 69fbccbfdf29cd80ecaa4cb1: baseline-arm-clabbe 2026-05-08 23:20:50,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbccbfdf29cd80ecaa4cb1 2026-05-08 23:20:50,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:20:50,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbccbfdf29cd80ecaa4cb1 HTTP/1.1" 200 None 2026-05-08 23:20:50,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:20:50,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:20:50,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:20:50,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbccbfdf29cd80ecaa4cb1 HTTP/1.1" 200 None 2026-05-08 23:20:50,676 - lava_callback - ERROR - Error processing callback for node 69fbccbfdf29cd80ecaa4cb1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55876 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:21:14,133 - lava_callback - INFO - Received callback for node 69fbcce2df29cd80ecaa4cbe INFO: 172.20.0.1:41472 - "POST /node/69fbcce2df29cd80ecaa4cbe HTTP/1.0" 202 Accepted 2026-05-08 23:21:14,139 - lava_callback - INFO - Starting async job submit for node 69fbcce2df29cd80ecaa4cbe 2026-05-08 23:21:14,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:21:14,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcce2df29cd80ecaa4cbe HTTP/1.1" 200 None 2026-05-08 23:21:14,164 - lava_callback - DEBUG - Processing node 69fbcce2df29cd80ecaa4cbe: baseline-arm-baylibre 2026-05-08 23:21:14,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcce2df29cd80ecaa4cbe 2026-05-08 23:21:14,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:21:14,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcce2df29cd80ecaa4cbe HTTP/1.1" 200 None 2026-05-08 23:21:14,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:21:14,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:21:14,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:21:14,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcce2df29cd80ecaa4cbe HTTP/1.1" 200 None 2026-05-08 23:21:14,230 - lava_callback - ERROR - Error processing callback for node 69fbcce2df29cd80ecaa4cbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41522 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:21:53,945 - lava_callback - INFO - Received callback for node 69fbcd08df29cd80ecaa4ccb INFO: 172.20.0.1:35414 - "POST /node/69fbcd08df29cd80ecaa4ccb HTTP/1.0" 202 Accepted 2026-05-08 23:21:53,951 - lava_callback - INFO - Starting async job submit for node 69fbcd08df29cd80ecaa4ccb 2026-05-08 23:21:53,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:21:53,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcd08df29cd80ecaa4ccb HTTP/1.1" 200 None 2026-05-08 23:21:53,965 - lava_callback - DEBUG - Processing node 69fbcd08df29cd80ecaa4ccb: baseline-arm-baylibre 2026-05-08 23:21:53,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcd08df29cd80ecaa4ccb 2026-05-08 23:21:53,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:21:53,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcd08df29cd80ecaa4ccb HTTP/1.1" 200 None 2026-05-08 23:21:53,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:21:53,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:21:53,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:21:54,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcd08df29cd80ecaa4ccb HTTP/1.1" 200 None 2026-05-08 23:21:54,028 - lava_callback - ERROR - Error processing callback for node 69fbcd08df29cd80ecaa4ccb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37736 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:22:30,734 - lava_callback - INFO - Received callback for node 69fbcd32df29cd80ecaa4cd5 INFO: 172.20.0.1:43182 - "POST /node/69fbcd32df29cd80ecaa4cd5 HTTP/1.0" 202 Accepted 2026-05-08 23:22:30,740 - lava_callback - INFO - Starting async job submit for node 69fbcd32df29cd80ecaa4cd5 2026-05-08 23:22:30,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:22:30,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcd32df29cd80ecaa4cd5 HTTP/1.1" 200 None 2026-05-08 23:22:30,761 - lava_callback - DEBUG - Processing node 69fbcd32df29cd80ecaa4cd5: baseline-arm-clabbe 2026-05-08 23:22:30,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcd32df29cd80ecaa4cd5 2026-05-08 23:22:30,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:22:30,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcd32df29cd80ecaa4cd5 HTTP/1.1" 200 None 2026-05-08 23:22:30,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:22:30,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:22:30,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:22:30,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcd32df29cd80ecaa4cd5 HTTP/1.1" 200 None 2026-05-08 23:22:30,807 - lava_callback - ERROR - Error processing callback for node 69fbcd32df29cd80ecaa4cd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56636 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:23:14,024 - lava_callback - INFO - Received callback for node 69fbcd55df29cd80ecaa4ce0 INFO: 172.20.0.1:36484 - "POST /node/69fbcd55df29cd80ecaa4ce0 HTTP/1.0" 202 Accepted 2026-05-08 23:23:14,030 - lava_callback - INFO - Starting async job submit for node 69fbcd55df29cd80ecaa4ce0 2026-05-08 23:23:14,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:23:14,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcd55df29cd80ecaa4ce0 HTTP/1.1" 200 None 2026-05-08 23:23:14,046 - lava_callback - DEBUG - Processing node 69fbcd55df29cd80ecaa4ce0: baseline-arm-baylibre 2026-05-08 23:23:14,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcd55df29cd80ecaa4ce0 2026-05-08 23:23:14,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:23:14,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcd55df29cd80ecaa4ce0 HTTP/1.1" 200 None 2026-05-08 23:23:14,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:23:14,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:23:14,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:23:14,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcd55df29cd80ecaa4ce0 HTTP/1.1" 200 None 2026-05-08 23:23:14,105 - lava_callback - ERROR - Error processing callback for node 69fbcd55df29cd80ecaa4ce0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54758 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:23:50,765 - lava_callback - INFO - Received callback for node 69fbcd7cdf29cd80ecaa4cea INFO: 172.20.0.1:56468 - "POST /node/69fbcd7cdf29cd80ecaa4cea HTTP/1.0" 202 Accepted 2026-05-08 23:23:50,770 - lava_callback - INFO - Starting async job submit for node 69fbcd7cdf29cd80ecaa4cea 2026-05-08 23:23:50,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:23:50,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcd7cdf29cd80ecaa4cea HTTP/1.1" 200 None 2026-05-08 23:23:50,790 - lava_callback - DEBUG - Processing node 69fbcd7cdf29cd80ecaa4cea: baseline-arm-clabbe 2026-05-08 23:23:50,790 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcd7cdf29cd80ecaa4cea 2026-05-08 23:23:50,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:23:50,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcd7cdf29cd80ecaa4cea HTTP/1.1" 200 None 2026-05-08 23:23:50,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:23:50,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:23:50,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:23:50,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcd7cdf29cd80ecaa4cea HTTP/1.1" 200 None 2026-05-08 23:23:50,846 - lava_callback - ERROR - Error processing callback for node 69fbcd7cdf29cd80ecaa4cea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43032 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:24:30,781 - lava_callback - INFO - Received callback for node 69fbcda1df29cd80ecaa4cf7 INFO: 172.20.0.1:47112 - "POST /node/69fbcda1df29cd80ecaa4cf7 HTTP/1.0" 202 Accepted 2026-05-08 23:24:30,787 - lava_callback - INFO - Starting async job submit for node 69fbcda1df29cd80ecaa4cf7 2026-05-08 23:24:30,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:24:30,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcda1df29cd80ecaa4cf7 HTTP/1.1" 200 None 2026-05-08 23:24:30,822 - lava_callback - DEBUG - Processing node 69fbcda1df29cd80ecaa4cf7: baseline-arm-clabbe 2026-05-08 23:24:30,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcda1df29cd80ecaa4cf7 2026-05-08 23:24:30,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:24:30,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcda1df29cd80ecaa4cf7 HTTP/1.1" 200 None 2026-05-08 23:24:30,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:24:30,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:24:30,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:24:30,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcda1df29cd80ecaa4cf7 HTTP/1.1" 200 None 2026-05-08 23:24:30,889 - lava_callback - ERROR - Error processing callback for node 69fbcda1df29cd80ecaa4cf7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34326 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:25:10,825 - lava_callback - INFO - Received callback for node 69fbcdc6df29cd80ecaa4d01 INFO: 172.20.0.1:35772 - "POST /node/69fbcdc6df29cd80ecaa4d01 HTTP/1.0" 202 Accepted 2026-05-08 23:25:10,832 - lava_callback - INFO - Starting async job submit for node 69fbcdc6df29cd80ecaa4d01 2026-05-08 23:25:10,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:25:10,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcdc6df29cd80ecaa4d01 HTTP/1.1" 200 None 2026-05-08 23:25:10,848 - lava_callback - DEBUG - Processing node 69fbcdc6df29cd80ecaa4d01: baseline-arm-clabbe 2026-05-08 23:25:10,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcdc6df29cd80ecaa4d01 2026-05-08 23:25:10,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:25:10,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcdc6df29cd80ecaa4d01 HTTP/1.1" 200 None 2026-05-08 23:25:10,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:25:10,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:25:10,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:25:10,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcdc6df29cd80ecaa4d01 HTTP/1.1" 200 None 2026-05-08 23:25:10,908 - lava_callback - ERROR - Error processing callback for node 69fbcdc6df29cd80ecaa4d01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33714 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:25:50,876 - lava_callback - INFO - Received callback for node 69fbcdebdf29cd80ecaa4d0d INFO: 172.20.0.1:58782 - "POST /node/69fbcdebdf29cd80ecaa4d0d HTTP/1.0" 202 Accepted 2026-05-08 23:25:50,885 - lava_callback - INFO - Starting async job submit for node 69fbcdebdf29cd80ecaa4d0d 2026-05-08 23:25:50,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:25:50,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcdebdf29cd80ecaa4d0d HTTP/1.1" 200 None 2026-05-08 23:25:50,918 - lava_callback - DEBUG - Processing node 69fbcdebdf29cd80ecaa4d0d: baseline-arm-clabbe 2026-05-08 23:25:50,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcdebdf29cd80ecaa4d0d 2026-05-08 23:25:50,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:25:50,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcdebdf29cd80ecaa4d0d HTTP/1.1" 200 None 2026-05-08 23:25:50,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:25:50,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:25:50,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:25:50,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcdebdf29cd80ecaa4d0d HTTP/1.1" 200 None 2026-05-08 23:25:50,978 - lava_callback - ERROR - Error processing callback for node 69fbcdebdf29cd80ecaa4d0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53280 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:26:30,925 - lava_callback - INFO - Received callback for node 69fbce11df29cd80ecaa4d1c INFO: 172.20.0.1:37448 - "POST /node/69fbce11df29cd80ecaa4d1c HTTP/1.0" 202 Accepted 2026-05-08 23:26:30,930 - lava_callback - INFO - Starting async job submit for node 69fbce11df29cd80ecaa4d1c 2026-05-08 23:26:30,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:26:30,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbce11df29cd80ecaa4d1c HTTP/1.1" 200 None 2026-05-08 23:26:30,947 - lava_callback - DEBUG - Processing node 69fbce11df29cd80ecaa4d1c: baseline-arm-clabbe 2026-05-08 23:26:30,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbce11df29cd80ecaa4d1c 2026-05-08 23:26:30,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:26:30,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbce11df29cd80ecaa4d1c HTTP/1.1" 200 None 2026-05-08 23:26:30,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:26:30,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:26:30,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:26:30,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbce11df29cd80ecaa4d1c HTTP/1.1" 200 None 2026-05-08 23:26:30,992 - lava_callback - ERROR - Error processing callback for node 69fbce11df29cd80ecaa4d1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53200 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:26:54,372 - lava_callback - INFO - Received callback for node 69fbce32df29cd80ecaa4d29 INFO: 172.20.0.1:35928 - "POST /node/69fbce32df29cd80ecaa4d29 HTTP/1.0" 202 Accepted 2026-05-08 23:26:54,378 - lava_callback - INFO - Starting async job submit for node 69fbce32df29cd80ecaa4d29 2026-05-08 23:26:54,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:26:54,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbce32df29cd80ecaa4d29 HTTP/1.1" 200 None 2026-05-08 23:26:54,396 - lava_callback - DEBUG - Processing node 69fbce32df29cd80ecaa4d29: baseline-arm-baylibre 2026-05-08 23:26:54,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbce32df29cd80ecaa4d29 2026-05-08 23:26:54,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:26:54,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbce32df29cd80ecaa4d29 HTTP/1.1" 200 None 2026-05-08 23:26:54,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:26:54,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:26:54,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:26:54,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbce32df29cd80ecaa4d29 HTTP/1.1" 200 None 2026-05-08 23:26:54,442 - lava_callback - ERROR - Error processing callback for node 69fbce32df29cd80ecaa4d29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35180 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:27:34,206 - lava_callback - INFO - Received callback for node 69fbce57df29cd80ecaa4d33 INFO: 172.20.0.1:34890 - "POST /node/69fbce57df29cd80ecaa4d33 HTTP/1.0" 202 Accepted 2026-05-08 23:27:34,212 - lava_callback - INFO - Starting async job submit for node 69fbce57df29cd80ecaa4d33 2026-05-08 23:27:34,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:27:34,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbce57df29cd80ecaa4d33 HTTP/1.1" 200 None 2026-05-08 23:27:34,244 - lava_callback - DEBUG - Processing node 69fbce57df29cd80ecaa4d33: baseline-arm-baylibre 2026-05-08 23:27:34,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbce57df29cd80ecaa4d33 2026-05-08 23:27:34,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:27:34,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbce57df29cd80ecaa4d33 HTTP/1.1" 200 None 2026-05-08 23:27:34,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:27:34,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:27:34,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:27:34,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbce57df29cd80ecaa4d33 HTTP/1.1" 200 None 2026-05-08 23:27:34,299 - lava_callback - ERROR - Error processing callback for node 69fbce57df29cd80ecaa4d33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34002 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:28:10,944 - lava_callback - INFO - Received callback for node 69fbce80df29cd80ecaa4d3d INFO: 172.20.0.1:39848 - "POST /node/69fbce80df29cd80ecaa4d3d HTTP/1.0" 202 Accepted 2026-05-08 23:28:10,949 - lava_callback - INFO - Starting async job submit for node 69fbce80df29cd80ecaa4d3d 2026-05-08 23:28:10,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:28:10,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbce80df29cd80ecaa4d3d HTTP/1.1" 200 None 2026-05-08 23:28:10,963 - lava_callback - DEBUG - Processing node 69fbce80df29cd80ecaa4d3d: baseline-arm-clabbe 2026-05-08 23:28:10,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbce80df29cd80ecaa4d3d 2026-05-08 23:28:10,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:28:10,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbce80df29cd80ecaa4d3d HTTP/1.1" 200 None 2026-05-08 23:28:10,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:28:10,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:28:10,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:28:11,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbce80df29cd80ecaa4d3d HTTP/1.1" 200 None 2026-05-08 23:28:11,007 - lava_callback - ERROR - Error processing callback for node 69fbce80df29cd80ecaa4d3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39198 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:28:50,938 - lava_callback - INFO - Received callback for node 69fbcea5df29cd80ecaa4d4a INFO: 172.20.0.1:37328 - "POST /node/69fbcea5df29cd80ecaa4d4a HTTP/1.0" 202 Accepted 2026-05-08 23:28:50,945 - lava_callback - INFO - Starting async job submit for node 69fbcea5df29cd80ecaa4d4a 2026-05-08 23:28:50,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:28:50,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcea5df29cd80ecaa4d4a HTTP/1.1" 200 None 2026-05-08 23:28:50,965 - lava_callback - DEBUG - Processing node 69fbcea5df29cd80ecaa4d4a: baseline-arm-clabbe 2026-05-08 23:28:50,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcea5df29cd80ecaa4d4a 2026-05-08 23:28:50,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:28:50,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcea5df29cd80ecaa4d4a HTTP/1.1" 200 None 2026-05-08 23:28:50,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:28:50,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:28:50,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:28:51,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcea5df29cd80ecaa4d4a HTTP/1.1" 200 None 2026-05-08 23:28:51,019 - lava_callback - ERROR - Error processing callback for node 69fbcea5df29cd80ecaa4d4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38950 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:29:14,463 - lava_callback - INFO - Received callback for node 69fbcec6df29cd80ecaa4d57 INFO: 172.20.0.1:54712 - "POST /node/69fbcec6df29cd80ecaa4d57 HTTP/1.0" 202 Accepted 2026-05-08 23:29:14,468 - lava_callback - INFO - Starting async job submit for node 69fbcec6df29cd80ecaa4d57 2026-05-08 23:29:14,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:29:14,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcec6df29cd80ecaa4d57 HTTP/1.1" 200 None 2026-05-08 23:29:14,490 - lava_callback - DEBUG - Processing node 69fbcec6df29cd80ecaa4d57: baseline-arm-baylibre 2026-05-08 23:29:14,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcec6df29cd80ecaa4d57 2026-05-08 23:29:14,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:29:14,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcec6df29cd80ecaa4d57 HTTP/1.1" 200 None 2026-05-08 23:29:14,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:29:14,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:29:14,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:29:14,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcec6df29cd80ecaa4d57 HTTP/1.1" 200 None 2026-05-08 23:29:14,545 - lava_callback - ERROR - Error processing callback for node 69fbcec6df29cd80ecaa4d57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43530 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:30:10,910 - lava_callback - INFO - Received callback for node 69fbceeddf29cd80ecaa4d63 INFO: 172.20.0.1:56658 - "POST /node/69fbceeddf29cd80ecaa4d63 HTTP/1.0" 202 Accepted 2026-05-08 23:30:10,916 - lava_callback - INFO - Starting async job submit for node 69fbceeddf29cd80ecaa4d63 2026-05-08 23:30:10,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:30:10,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbceeddf29cd80ecaa4d63 HTTP/1.1" 200 None 2026-05-08 23:30:10,931 - lava_callback - DEBUG - Processing node 69fbceeddf29cd80ecaa4d63: baseline-arm-clabbe 2026-05-08 23:30:10,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbceeddf29cd80ecaa4d63 2026-05-08 23:30:10,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:30:10,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbceeddf29cd80ecaa4d63 HTTP/1.1" 200 None 2026-05-08 23:30:10,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:30:10,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:30:10,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:30:10,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbceeddf29cd80ecaa4d63 HTTP/1.1" 200 None 2026-05-08 23:30:10,977 - lava_callback - ERROR - Error processing callback for node 69fbceeddf29cd80ecaa4d63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41420 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:30:34,416 - lava_callback - INFO - Received callback for node 69fbcf0edf29cd80ecaa4d71 INFO: 172.20.0.1:59654 - "POST /node/69fbcf0edf29cd80ecaa4d71 HTTP/1.0" 202 Accepted 2026-05-08 23:30:34,422 - lava_callback - INFO - Starting async job submit for node 69fbcf0edf29cd80ecaa4d71 2026-05-08 23:30:34,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:30:34,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcf0edf29cd80ecaa4d71 HTTP/1.1" 200 None 2026-05-08 23:30:34,438 - lava_callback - DEBUG - Processing node 69fbcf0edf29cd80ecaa4d71: baseline-arm-baylibre 2026-05-08 23:30:34,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcf0edf29cd80ecaa4d71 2026-05-08 23:30:34,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:30:34,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcf0edf29cd80ecaa4d71 HTTP/1.1" 200 None 2026-05-08 23:30:34,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:30:34,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:30:34,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:30:34,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcf0edf29cd80ecaa4d71 HTTP/1.1" 200 None 2026-05-08 23:30:34,506 - lava_callback - ERROR - Error processing callback for node 69fbcf0edf29cd80ecaa4d71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36488 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:31:14,417 - lava_callback - INFO - Received callback for node 69fbcf34df29cd80ecaa4d7c INFO: 172.20.0.1:33984 - "POST /node/69fbcf34df29cd80ecaa4d7c HTTP/1.0" 202 Accepted 2026-05-08 23:31:14,423 - lava_callback - INFO - Starting async job submit for node 69fbcf34df29cd80ecaa4d7c 2026-05-08 23:31:14,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:31:14,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcf34df29cd80ecaa4d7c HTTP/1.1" 200 None 2026-05-08 23:31:14,441 - lava_callback - DEBUG - Processing node 69fbcf34df29cd80ecaa4d7c: baseline-arm-baylibre 2026-05-08 23:31:14,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcf34df29cd80ecaa4d7c 2026-05-08 23:31:14,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:31:14,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcf34df29cd80ecaa4d7c HTTP/1.1" 200 None 2026-05-08 23:31:14,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:31:14,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:31:14,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:31:14,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcf34df29cd80ecaa4d7c HTTP/1.1" 200 None 2026-05-08 23:31:14,491 - lava_callback - ERROR - Error processing callback for node 69fbcf34df29cd80ecaa4d7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38598 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:31:51,063 - lava_callback - INFO - Received callback for node 69fbcf5adf29cd80ecaa4d89 INFO: 172.20.0.1:53420 - "POST /node/69fbcf5adf29cd80ecaa4d89 HTTP/1.0" 202 Accepted 2026-05-08 23:31:51,070 - lava_callback - INFO - Starting async job submit for node 69fbcf5adf29cd80ecaa4d89 2026-05-08 23:31:51,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:31:51,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcf5adf29cd80ecaa4d89 HTTP/1.1" 200 None 2026-05-08 23:31:51,087 - lava_callback - DEBUG - Processing node 69fbcf5adf29cd80ecaa4d89: baseline-arm-clabbe 2026-05-08 23:31:51,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcf5adf29cd80ecaa4d89 2026-05-08 23:31:51,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:31:51,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcf5adf29cd80ecaa4d89 HTTP/1.1" 200 None 2026-05-08 23:31:51,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:31:51,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:31:51,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:31:51,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcf5adf29cd80ecaa4d89 HTTP/1.1" 200 None 2026-05-08 23:31:51,160 - lava_callback - ERROR - Error processing callback for node 69fbcf5adf29cd80ecaa4d89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48284 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:32:31,027 - lava_callback - INFO - Received callback for node 69fbcf7fdf29cd80ecaa4d95 INFO: 172.20.0.1:37578 - "POST /node/69fbcf7fdf29cd80ecaa4d95 HTTP/1.0" 202 Accepted 2026-05-08 23:32:31,033 - lava_callback - INFO - Starting async job submit for node 69fbcf7fdf29cd80ecaa4d95 2026-05-08 23:32:31,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:32:31,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcf7fdf29cd80ecaa4d95 HTTP/1.1" 200 None 2026-05-08 23:32:31,087 - lava_callback - DEBUG - Processing node 69fbcf7fdf29cd80ecaa4d95: baseline-arm-clabbe 2026-05-08 23:32:31,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcf7fdf29cd80ecaa4d95 2026-05-08 23:32:31,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:32:31,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcf7fdf29cd80ecaa4d95 HTTP/1.1" 200 None 2026-05-08 23:32:31,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:32:31,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:32:31,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:32:31,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcf7fdf29cd80ecaa4d95 HTTP/1.1" 200 None 2026-05-08 23:32:31,148 - lava_callback - ERROR - Error processing callback for node 69fbcf7fdf29cd80ecaa4d95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55560 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:32:54,536 - lava_callback - INFO - Received callback for node 69fbcfa4df29cd80ecaa4d9f INFO: 172.20.0.1:33468 - "POST /node/69fbcfa4df29cd80ecaa4d9f HTTP/1.0" 202 Accepted 2026-05-08 23:32:54,546 - lava_callback - INFO - Starting async job submit for node 69fbcfa4df29cd80ecaa4d9f 2026-05-08 23:32:54,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:32:54,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcfa4df29cd80ecaa4d9f HTTP/1.1" 200 None 2026-05-08 23:32:54,566 - lava_callback - DEBUG - Processing node 69fbcfa4df29cd80ecaa4d9f: baseline-arm-baylibre 2026-05-08 23:32:54,566 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcfa4df29cd80ecaa4d9f 2026-05-08 23:32:54,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:32:54,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcfa4df29cd80ecaa4d9f HTTP/1.1" 200 None 2026-05-08 23:32:54,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:32:54,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:32:54,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:32:54,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcfa4df29cd80ecaa4d9f HTTP/1.1" 200 None 2026-05-08 23:32:54,616 - lava_callback - ERROR - Error processing callback for node 69fbcfa4df29cd80ecaa4d9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42060 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:33:51,110 - lava_callback - INFO - Received callback for node 69fbcfcadf29cd80ecaa4dab INFO: 172.20.0.1:57832 - "POST /node/69fbcfcadf29cd80ecaa4dab HTTP/1.0" 202 Accepted 2026-05-08 23:33:51,116 - lava_callback - INFO - Starting async job submit for node 69fbcfcadf29cd80ecaa4dab 2026-05-08 23:33:51,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:33:51,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcfcadf29cd80ecaa4dab HTTP/1.1" 200 None 2026-05-08 23:33:51,132 - lava_callback - DEBUG - Processing node 69fbcfcadf29cd80ecaa4dab: baseline-arm-clabbe 2026-05-08 23:33:51,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcfcadf29cd80ecaa4dab 2026-05-08 23:33:51,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:33:51,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcfcadf29cd80ecaa4dab HTTP/1.1" 200 None 2026-05-08 23:33:51,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:33:51,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:33:51,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:33:51,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcfcadf29cd80ecaa4dab HTTP/1.1" 200 None 2026-05-08 23:33:51,209 - lava_callback - ERROR - Error processing callback for node 69fbcfcadf29cd80ecaa4dab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51808 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:34:31,156 - lava_callback - INFO - Received callback for node 69fbcff0df29cd80ecaa4db8 INFO: 172.20.0.1:58850 - "POST /node/69fbcff0df29cd80ecaa4db8 HTTP/1.0" 202 Accepted 2026-05-08 23:34:31,162 - lava_callback - INFO - Starting async job submit for node 69fbcff0df29cd80ecaa4db8 2026-05-08 23:34:31,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:34:31,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcff0df29cd80ecaa4db8 HTTP/1.1" 200 None 2026-05-08 23:34:31,182 - lava_callback - DEBUG - Processing node 69fbcff0df29cd80ecaa4db8: baseline-arm-clabbe 2026-05-08 23:34:31,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbcff0df29cd80ecaa4db8 2026-05-08 23:34:31,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:34:31,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbcff0df29cd80ecaa4db8 HTTP/1.1" 200 None 2026-05-08 23:34:31,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:34:31,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:34:31,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:34:31,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbcff0df29cd80ecaa4db8 HTTP/1.1" 200 None 2026-05-08 23:34:31,237 - lava_callback - ERROR - Error processing callback for node 69fbcff0df29cd80ecaa4db8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41322 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:34:51,241 - lava_callback - INFO - Received callback for node 69fbd016df29cd80ecaa4dc5 INFO: 172.20.0.1:39330 - "POST /node/69fbd016df29cd80ecaa4dc5 HTTP/1.0" 202 Accepted 2026-05-08 23:34:51,249 - lava_callback - INFO - Starting async job submit for node 69fbd016df29cd80ecaa4dc5 2026-05-08 23:34:51,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:34:51,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd016df29cd80ecaa4dc5 HTTP/1.1" 200 None 2026-05-08 23:34:51,265 - lava_callback - DEBUG - Processing node 69fbd016df29cd80ecaa4dc5: baseline-arm-clabbe 2026-05-08 23:34:51,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd016df29cd80ecaa4dc5 2026-05-08 23:34:51,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:34:51,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd016df29cd80ecaa4dc5 HTTP/1.1" 200 None 2026-05-08 23:34:51,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:34:51,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:34:51,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:34:51,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd016df29cd80ecaa4dc5 HTTP/1.1" 200 None 2026-05-08 23:34:51,340 - lava_callback - ERROR - Error processing callback for node 69fbd016df29cd80ecaa4dc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36924 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:35:31,161 - lava_callback - INFO - Received callback for node 69fbd03bdf29cd80ecaa4dcf INFO: 172.20.0.1:60836 - "POST /node/69fbd03bdf29cd80ecaa4dcf HTTP/1.0" 202 Accepted 2026-05-08 23:35:31,170 - lava_callback - INFO - Starting async job submit for node 69fbd03bdf29cd80ecaa4dcf 2026-05-08 23:35:31,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:35:31,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd03bdf29cd80ecaa4dcf HTTP/1.1" 200 None 2026-05-08 23:35:31,186 - lava_callback - DEBUG - Processing node 69fbd03bdf29cd80ecaa4dcf: baseline-arm-clabbe 2026-05-08 23:35:31,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd03bdf29cd80ecaa4dcf 2026-05-08 23:35:31,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:35:31,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd03bdf29cd80ecaa4dcf HTTP/1.1" 200 None 2026-05-08 23:35:31,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:35:31,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:35:31,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:35:31,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd03bdf29cd80ecaa4dcf HTTP/1.1" 200 None 2026-05-08 23:35:31,240 - lava_callback - ERROR - Error processing callback for node 69fbd03bdf29cd80ecaa4dcf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46492 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:36:11,241 - lava_callback - INFO - Received callback for node 69fbd061df29cd80ecaa4dda INFO: 172.20.0.1:34216 - "POST /node/69fbd061df29cd80ecaa4dda HTTP/1.0" 202 Accepted 2026-05-08 23:36:11,247 - lava_callback - INFO - Starting async job submit for node 69fbd061df29cd80ecaa4dda 2026-05-08 23:36:11,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:36:11,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd061df29cd80ecaa4dda HTTP/1.1" 200 None 2026-05-08 23:36:11,272 - lava_callback - DEBUG - Processing node 69fbd061df29cd80ecaa4dda: baseline-arm-clabbe 2026-05-08 23:36:11,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd061df29cd80ecaa4dda 2026-05-08 23:36:11,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:36:11,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd061df29cd80ecaa4dda HTTP/1.1" 200 None 2026-05-08 23:36:11,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:36:11,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:36:11,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:36:11,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd061df29cd80ecaa4dda HTTP/1.1" 200 None 2026-05-08 23:36:11,318 - lava_callback - ERROR - Error processing callback for node 69fbd061df29cd80ecaa4dda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44414 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:36:54,772 - lava_callback - INFO - Received callback for node 69fbd08cdf29cd80ecaa4de7 INFO: 172.20.0.1:48920 - "POST /node/69fbd08cdf29cd80ecaa4de7 HTTP/1.0" 202 Accepted 2026-05-08 23:36:54,778 - lava_callback - INFO - Starting async job submit for node 69fbd08cdf29cd80ecaa4de7 2026-05-08 23:36:54,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:36:54,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd08cdf29cd80ecaa4de7 HTTP/1.1" 200 None 2026-05-08 23:36:54,792 - lava_callback - DEBUG - Processing node 69fbd08cdf29cd80ecaa4de7: baseline-arm64-baylibre 2026-05-08 23:36:54,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd08cdf29cd80ecaa4de7 2026-05-08 23:36:54,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:36:54,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd08cdf29cd80ecaa4de7 HTTP/1.1" 200 None 2026-05-08 23:36:54,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:36:54,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:36:54,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:36:54,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd08cdf29cd80ecaa4de7 HTTP/1.1" 200 None 2026-05-08 23:36:54,855 - lava_callback - ERROR - Error processing callback for node 69fbd08cdf29cd80ecaa4de7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37142 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:38:11,258 - lava_callback - INFO - Received callback for node 69fbd0d7df29cd80ecaa4e06 INFO: 172.20.0.1:34272 - "POST /node/69fbd0d7df29cd80ecaa4e06 HTTP/1.0" 202 Accepted 2026-05-08 23:38:11,264 - lava_callback - INFO - Starting async job submit for node 69fbd0d7df29cd80ecaa4e06 2026-05-08 23:38:11,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:38:11,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd0d7df29cd80ecaa4e06 HTTP/1.1" 200 None 2026-05-08 23:38:11,283 - lava_callback - DEBUG - Processing node 69fbd0d7df29cd80ecaa4e06: baseline-arm-clabbe 2026-05-08 23:38:11,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd0d7df29cd80ecaa4e06 2026-05-08 23:38:11,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:38:11,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd0d7df29cd80ecaa4e06 HTTP/1.1" 200 None 2026-05-08 23:38:11,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:38:11,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:38:11,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:38:11,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd0d7df29cd80ecaa4e06 HTTP/1.1" 200 None 2026-05-08 23:38:11,328 - lava_callback - ERROR - Error processing callback for node 69fbd0d7df29cd80ecaa4e06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39330 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:38:54,856 - lava_callback - INFO - Received callback for node 69fbd103df29cd80ecaa4e31 INFO: 172.20.0.1:41194 - "POST /node/69fbd103df29cd80ecaa4e31 HTTP/1.0" 202 Accepted 2026-05-08 23:38:54,862 - lava_callback - INFO - Starting async job submit for node 69fbd103df29cd80ecaa4e31 2026-05-08 23:38:54,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:38:54,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd103df29cd80ecaa4e31 HTTP/1.1" 200 None 2026-05-08 23:38:54,877 - lava_callback - DEBUG - Processing node 69fbd103df29cd80ecaa4e31: baseline-arm64-baylibre 2026-05-08 23:38:54,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd103df29cd80ecaa4e31 2026-05-08 23:38:54,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:38:54,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd103df29cd80ecaa4e31 HTTP/1.1" 200 None 2026-05-08 23:38:54,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:38:54,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:38:54,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:38:54,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd103df29cd80ecaa4e31 HTTP/1.1" 200 None 2026-05-08 23:38:54,928 - lava_callback - ERROR - Error processing callback for node 69fbd103df29cd80ecaa4e31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53338 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:40:11,335 - lava_callback - INFO - Received callback for node 69fbd151df29cd80ecaa4e6b INFO: 172.20.0.1:55746 - "POST /node/69fbd151df29cd80ecaa4e6b HTTP/1.0" 202 Accepted 2026-05-08 23:40:11,341 - lava_callback - INFO - Starting async job submit for node 69fbd151df29cd80ecaa4e6b 2026-05-08 23:40:11,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:40:11,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd151df29cd80ecaa4e6b HTTP/1.1" 200 None 2026-05-08 23:40:11,359 - lava_callback - DEBUG - Processing node 69fbd151df29cd80ecaa4e6b: baseline-arm-clabbe 2026-05-08 23:40:11,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd151df29cd80ecaa4e6b 2026-05-08 23:40:11,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:40:11,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd151df29cd80ecaa4e6b HTTP/1.1" 200 None 2026-05-08 23:40:11,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:40:11,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:40:11,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:40:11,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd151df29cd80ecaa4e6b HTTP/1.1" 200 None 2026-05-08 23:40:11,416 - lava_callback - ERROR - Error processing callback for node 69fbd151df29cd80ecaa4e6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42288 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:40:51,323 - lava_callback - INFO - Received callback for node 69fbd177df29cd80ecaa4e75 INFO: 172.20.0.1:60476 - "POST /node/69fbd177df29cd80ecaa4e75 HTTP/1.0" 202 Accepted 2026-05-08 23:40:51,328 - lava_callback - INFO - Starting async job submit for node 69fbd177df29cd80ecaa4e75 2026-05-08 23:40:51,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:40:51,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd177df29cd80ecaa4e75 HTTP/1.1" 200 None 2026-05-08 23:40:51,358 - lava_callback - DEBUG - Processing node 69fbd177df29cd80ecaa4e75: baseline-arm-clabbe 2026-05-08 23:40:51,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd177df29cd80ecaa4e75 2026-05-08 23:40:51,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:40:51,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd177df29cd80ecaa4e75 HTTP/1.1" 200 None 2026-05-08 23:40:51,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:40:51,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-08 23:40:51,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:40:51,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd177df29cd80ecaa4e75 HTTP/1.1" 200 None 2026-05-08 23:40:51,460 - lava_callback - ERROR - Error processing callback for node 69fbd177df29cd80ecaa4e75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38948 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:41:35,030 - lava_callback - INFO - Received callback for node 69fbd1a4df29cd80ecaa4e84 INFO: 172.20.0.1:51990 - "POST /node/69fbd1a4df29cd80ecaa4e84 HTTP/1.0" 202 Accepted 2026-05-08 23:41:35,036 - lava_callback - INFO - Starting async job submit for node 69fbd1a4df29cd80ecaa4e84 2026-05-08 23:41:35,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:41:35,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd1a4df29cd80ecaa4e84 HTTP/1.1" 200 None 2026-05-08 23:41:35,051 - lava_callback - DEBUG - Processing node 69fbd1a4df29cd80ecaa4e84: baseline-arm64-baylibre 2026-05-08 23:41:35,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd1a4df29cd80ecaa4e84 2026-05-08 23:41:35,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:41:35,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd1a4df29cd80ecaa4e84 HTTP/1.1" 200 None 2026-05-08 23:41:35,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:41:35,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:41:35,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:41:35,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd1a4df29cd80ecaa4e84 HTTP/1.1" 200 None 2026-05-08 23:41:35,112 - lava_callback - ERROR - Error processing callback for node 69fbd1a4df29cd80ecaa4e84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44630 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:42:51,500 - lava_callback - INFO - Received callback for node 69fbd1f2df29cd80ecaa4ea6 INFO: 172.20.0.1:36912 - "POST /node/69fbd1f2df29cd80ecaa4ea6 HTTP/1.0" 202 Accepted 2026-05-08 23:42:51,505 - lava_callback - INFO - Starting async job submit for node 69fbd1f2df29cd80ecaa4ea6 2026-05-08 23:42:51,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:42:51,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd1f2df29cd80ecaa4ea6 HTTP/1.1" 200 None 2026-05-08 23:42:51,522 - lava_callback - DEBUG - Processing node 69fbd1f2df29cd80ecaa4ea6: baseline-arm-clabbe 2026-05-08 23:42:51,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd1f2df29cd80ecaa4ea6 2026-05-08 23:42:51,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:42:51,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd1f2df29cd80ecaa4ea6 HTTP/1.1" 200 None 2026-05-08 23:42:51,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:42:51,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:42:51,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:42:51,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd1f2df29cd80ecaa4ea6 HTTP/1.1" 200 None 2026-05-08 23:42:51,578 - lava_callback - ERROR - Error processing callback for node 69fbd1f2df29cd80ecaa4ea6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37494 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:43:35,169 - lava_callback - INFO - Received callback for node 69fbd220df29cd80ecaa4eae INFO: 172.20.0.1:50616 - "POST /node/69fbd220df29cd80ecaa4eae HTTP/1.0" 202 Accepted 2026-05-08 23:43:35,175 - lava_callback - INFO - Starting async job submit for node 69fbd220df29cd80ecaa4eae 2026-05-08 23:43:35,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:43:35,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd220df29cd80ecaa4eae HTTP/1.1" 200 None 2026-05-08 23:43:35,196 - lava_callback - DEBUG - Processing node 69fbd220df29cd80ecaa4eae: baseline-arm64-baylibre 2026-05-08 23:43:35,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd220df29cd80ecaa4eae 2026-05-08 23:43:35,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:43:35,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd220df29cd80ecaa4eae HTTP/1.1" 200 None 2026-05-08 23:43:35,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:43:35,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:43:35,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:43:35,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd220df29cd80ecaa4eae HTTP/1.1" 200 None 2026-05-08 23:43:35,255 - lava_callback - ERROR - Error processing callback for node 69fbd220df29cd80ecaa4eae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34198 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:44:51,622 - lava_callback - INFO - Received callback for node 69fbd264df29cd80ecaa4eda INFO: 172.20.0.1:52158 - "POST /node/69fbd264df29cd80ecaa4eda HTTP/1.0" 202 Accepted 2026-05-08 23:44:51,627 - lava_callback - INFO - Starting async job submit for node 69fbd264df29cd80ecaa4eda 2026-05-08 23:44:51,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:44:51,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd264df29cd80ecaa4eda HTTP/1.1" 200 None 2026-05-08 23:44:51,667 - lava_callback - DEBUG - Processing node 69fbd264df29cd80ecaa4eda: baseline-arm-clabbe 2026-05-08 23:44:51,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd264df29cd80ecaa4eda 2026-05-08 23:44:51,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:44:51,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd264df29cd80ecaa4eda HTTP/1.1" 200 None 2026-05-08 23:44:51,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:44:51,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-08 23:44:51,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:44:51,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd264df29cd80ecaa4eda HTTP/1.1" 200 None 2026-05-08 23:44:51,733 - lava_callback - ERROR - Error processing callback for node 69fbd264df29cd80ecaa4eda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56946 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:45:35,254 - lava_callback - INFO - Received callback for node 69fbd293df29cd80ecaa4ef8 INFO: 172.20.0.1:59176 - "POST /node/69fbd293df29cd80ecaa4ef8 HTTP/1.0" 202 Accepted 2026-05-08 23:45:35,260 - lava_callback - INFO - Starting async job submit for node 69fbd293df29cd80ecaa4ef8 2026-05-08 23:45:35,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:45:35,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd293df29cd80ecaa4ef8 HTTP/1.1" 200 None 2026-05-08 23:45:35,275 - lava_callback - DEBUG - Processing node 69fbd293df29cd80ecaa4ef8: baseline-arm64-baylibre 2026-05-08 23:45:35,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd293df29cd80ecaa4ef8 2026-05-08 23:45:35,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:45:35,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd293df29cd80ecaa4ef8 HTTP/1.1" 200 None 2026-05-08 23:45:35,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:45:35,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:45:35,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:45:35,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd293df29cd80ecaa4ef8 HTTP/1.1" 200 None 2026-05-08 23:45:35,323 - lava_callback - ERROR - Error processing callback for node 69fbd293df29cd80ecaa4ef8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51304 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:46:55,304 - lava_callback - INFO - Received callback for node 69fbd2e4df29cd80ecaa4f1a INFO: 172.20.0.1:38650 - "POST /node/69fbd2e4df29cd80ecaa4f1a HTTP/1.0" 202 Accepted 2026-05-08 23:46:55,311 - lava_callback - INFO - Starting async job submit for node 69fbd2e4df29cd80ecaa4f1a 2026-05-08 23:46:55,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:46:55,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd2e4df29cd80ecaa4f1a HTTP/1.1" 200 None 2026-05-08 23:46:55,328 - lava_callback - DEBUG - Processing node 69fbd2e4df29cd80ecaa4f1a: baseline-arm64-baylibre 2026-05-08 23:46:55,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd2e4df29cd80ecaa4f1a 2026-05-08 23:46:55,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:46:55,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd2e4df29cd80ecaa4f1a HTTP/1.1" 200 None 2026-05-08 23:46:55,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:46:55,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:46:55,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:46:55,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd2e4df29cd80ecaa4f1a HTTP/1.1" 200 None 2026-05-08 23:46:55,387 - lava_callback - ERROR - Error processing callback for node 69fbd2e4df29cd80ecaa4f1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51974 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 23:48:15,367 - lava_callback - INFO - Received callback for node 69fbd338df29cd80ecaa4f36 INFO: 172.20.0.1:51980 - "POST /node/69fbd338df29cd80ecaa4f36 HTTP/1.0" 202 Accepted 2026-05-08 23:48:15,373 - lava_callback - INFO - Starting async job submit for node 69fbd338df29cd80ecaa4f36 2026-05-08 23:48:15,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:48:15,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd338df29cd80ecaa4f36 HTTP/1.1" 200 None 2026-05-08 23:48:15,394 - lava_callback - DEBUG - Processing node 69fbd338df29cd80ecaa4f36: baseline-arm64-baylibre 2026-05-08 23:48:15,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd338df29cd80ecaa4f36 2026-05-08 23:48:15,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:48:15,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd338df29cd80ecaa4f36 HTTP/1.1" 200 None 2026-05-08 23:48:15,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:48:15,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:48:15,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:48:15,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd338df29cd80ecaa4f36 HTTP/1.1" 200 None 2026-05-08 23:48:15,438 - lava_callback - ERROR - Error processing callback for node 69fbd338df29cd80ecaa4f36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37618 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:49:35,441 - lava_callback - INFO - Received callback for node 69fbd38bdf29cd80ecaa4f55 INFO: 172.20.0.1:46222 - "POST /node/69fbd38bdf29cd80ecaa4f55 HTTP/1.0" 202 Accepted 2026-05-08 23:49:35,446 - lava_callback - INFO - Starting async job submit for node 69fbd38bdf29cd80ecaa4f55 2026-05-08 23:49:35,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:49:35,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd38bdf29cd80ecaa4f55 HTTP/1.1" 200 None 2026-05-08 23:49:35,461 - lava_callback - DEBUG - Processing node 69fbd38bdf29cd80ecaa4f55: baseline-arm64-baylibre 2026-05-08 23:49:35,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd38bdf29cd80ecaa4f55 2026-05-08 23:49:35,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:49:35,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd38bdf29cd80ecaa4f55 HTTP/1.1" 200 None 2026-05-08 23:49:35,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:49:35,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:49:35,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:49:35,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd38bdf29cd80ecaa4f55 HTTP/1.1" 200 None 2026-05-08 23:49:35,515 - lava_callback - ERROR - Error processing callback for node 69fbd38bdf29cd80ecaa4f55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57778 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:50:55,563 - lava_callback - INFO - Received callback for node 69fbd3dddf29cd80ecaa4f78 INFO: 172.20.0.1:53218 - "POST /node/69fbd3dddf29cd80ecaa4f78 HTTP/1.0" 202 Accepted 2026-05-08 23:50:55,569 - lava_callback - INFO - Starting async job submit for node 69fbd3dddf29cd80ecaa4f78 2026-05-08 23:50:55,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:50:55,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd3dddf29cd80ecaa4f78 HTTP/1.1" 200 None 2026-05-08 23:50:55,591 - lava_callback - DEBUG - Processing node 69fbd3dddf29cd80ecaa4f78: baseline-arm64-baylibre 2026-05-08 23:50:55,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd3dddf29cd80ecaa4f78 2026-05-08 23:50:55,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:50:55,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd3dddf29cd80ecaa4f78 HTTP/1.1" 200 None 2026-05-08 23:50:55,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:50:55,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:50:55,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:50:55,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd3dddf29cd80ecaa4f78 HTTP/1.1" 200 None 2026-05-08 23:50:55,639 - lava_callback - ERROR - Error processing callback for node 69fbd3dddf29cd80ecaa4f78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50590 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:52:35,656 - lava_callback - INFO - Received callback for node 69fbd430df29cd80ecaa4f9b INFO: 172.20.0.1:58168 - "POST /node/69fbd430df29cd80ecaa4f9b HTTP/1.0" 202 Accepted 2026-05-08 23:52:35,662 - lava_callback - INFO - Starting async job submit for node 69fbd430df29cd80ecaa4f9b 2026-05-08 23:52:35,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:52:35,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd430df29cd80ecaa4f9b HTTP/1.1" 200 None 2026-05-08 23:52:35,692 - lava_callback - DEBUG - Processing node 69fbd430df29cd80ecaa4f9b: baseline-arm64-baylibre 2026-05-08 23:52:35,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd430df29cd80ecaa4f9b 2026-05-08 23:52:35,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:52:35,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd430df29cd80ecaa4f9b HTTP/1.1" 200 None 2026-05-08 23:52:35,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:52:35,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:52:35,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:52:35,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd430df29cd80ecaa4f9b HTTP/1.1" 200 None 2026-05-08 23:52:35,750 - lava_callback - ERROR - Error processing callback for node 69fbd430df29cd80ecaa4f9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51600 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:53:35,644 - lava_callback - INFO - Received callback for node 69fbd47ddf29cd80ecaa4fcc INFO: 172.20.0.1:59452 - "POST /node/69fbd47ddf29cd80ecaa4fcc HTTP/1.0" 202 Accepted 2026-05-08 23:53:35,649 - lava_callback - INFO - Starting async job submit for node 69fbd47ddf29cd80ecaa4fcc 2026-05-08 23:53:35,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:53:35,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd47ddf29cd80ecaa4fcc HTTP/1.1" 200 None 2026-05-08 23:53:35,664 - lava_callback - DEBUG - Processing node 69fbd47ddf29cd80ecaa4fcc: baseline-arm64-baylibre 2026-05-08 23:53:35,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd47ddf29cd80ecaa4fcc 2026-05-08 23:53:35,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:53:35,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd47ddf29cd80ecaa4fcc HTTP/1.1" 200 None 2026-05-08 23:53:35,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:53:35,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:53:35,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:53:35,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd47ddf29cd80ecaa4fcc HTTP/1.1" 200 None 2026-05-08 23:53:35,720 - lava_callback - ERROR - Error processing callback for node 69fbd47ddf29cd80ecaa4fcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34794 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:54:55,742 - lava_callback - INFO - Received callback for node 69fbd4c9df29cd80ecaa5007 INFO: 172.20.0.1:32864 - "POST /node/69fbd4c9df29cd80ecaa5007 HTTP/1.0" 202 Accepted 2026-05-08 23:54:55,747 - lava_callback - INFO - Starting async job submit for node 69fbd4c9df29cd80ecaa5007 2026-05-08 23:54:55,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:54:55,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd4c9df29cd80ecaa5007 HTTP/1.1" 200 None 2026-05-08 23:54:55,764 - lava_callback - DEBUG - Processing node 69fbd4c9df29cd80ecaa5007: baseline-arm64-baylibre 2026-05-08 23:54:55,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd4c9df29cd80ecaa5007 2026-05-08 23:54:55,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:54:55,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd4c9df29cd80ecaa5007 HTTP/1.1" 200 None 2026-05-08 23:54:55,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:54:55,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:54:55,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:54:55,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd4c9df29cd80ecaa5007 HTTP/1.1" 200 None 2026-05-08 23:54:55,817 - lava_callback - ERROR - Error processing callback for node 69fbd4c9df29cd80ecaa5007: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36248 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 23:56:15,977 - lava_callback - INFO - Received callback for node 69fbd51adf29cd80ecaa5024 INFO: 172.20.0.1:36250 - "POST /node/69fbd51adf29cd80ecaa5024 HTTP/1.0" 202 Accepted 2026-05-08 23:56:15,982 - lava_callback - INFO - Starting async job submit for node 69fbd51adf29cd80ecaa5024 2026-05-08 23:56:15,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:56:15,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd51adf29cd80ecaa5024 HTTP/1.1" 200 None 2026-05-08 23:56:15,997 - lava_callback - DEBUG - Processing node 69fbd51adf29cd80ecaa5024: baseline-arm64-baylibre 2026-05-08 23:56:15,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd51adf29cd80ecaa5024 2026-05-08 23:56:15,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:56:16,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd51adf29cd80ecaa5024 HTTP/1.1" 200 None 2026-05-08 23:56:16,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:56:16,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:56:16,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:56:16,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd51adf29cd80ecaa5024 HTTP/1.1" 200 None 2026-05-08 23:56:16,048 - lava_callback - ERROR - Error processing callback for node 69fbd51adf29cd80ecaa5024: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42274 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:57:35,892 - lava_callback - INFO - Received callback for node 69fbd56cdf29cd80ecaa5049 INFO: 172.20.0.1:34610 - "POST /node/69fbd56cdf29cd80ecaa5049 HTTP/1.0" 202 Accepted 2026-05-08 23:57:35,898 - lava_callback - INFO - Starting async job submit for node 69fbd56cdf29cd80ecaa5049 2026-05-08 23:57:35,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:57:35,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd56cdf29cd80ecaa5049 HTTP/1.1" 200 None 2026-05-08 23:57:35,913 - lava_callback - DEBUG - Processing node 69fbd56cdf29cd80ecaa5049: baseline-arm64-baylibre 2026-05-08 23:57:35,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd56cdf29cd80ecaa5049 2026-05-08 23:57:35,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:57:35,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd56cdf29cd80ecaa5049 HTTP/1.1" 200 None 2026-05-08 23:57:35,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:57:35,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:57:35,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:57:35,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd56cdf29cd80ecaa5049 HTTP/1.1" 200 None 2026-05-08 23:57:35,958 - lava_callback - ERROR - Error processing callback for node 69fbd56cdf29cd80ecaa5049: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38620 - "GET / HTTP/1.0" 200 OK 2026-05-08 23:58:55,942 - lava_callback - INFO - Received callback for node 69fbd5bbdf29cd80ecaa5070 INFO: 172.20.0.1:39838 - "POST /node/69fbd5bbdf29cd80ecaa5070 HTTP/1.0" 202 Accepted 2026-05-08 23:58:55,947 - lava_callback - INFO - Starting async job submit for node 69fbd5bbdf29cd80ecaa5070 2026-05-08 23:58:55,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:58:55,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd5bbdf29cd80ecaa5070 HTTP/1.1" 200 None 2026-05-08 23:58:55,962 - lava_callback - DEBUG - Processing node 69fbd5bbdf29cd80ecaa5070: baseline-arm64-baylibre 2026-05-08 23:58:55,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd5bbdf29cd80ecaa5070 2026-05-08 23:58:55,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:58:55,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd5bbdf29cd80ecaa5070 HTTP/1.1" 200 None 2026-05-08 23:58:55,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:58:55,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-08 23:58:55,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 23:58:56,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd5bbdf29cd80ecaa5070 HTTP/1.1" 200 None 2026-05-08 23:58:56,007 - lava_callback - ERROR - Error processing callback for node 69fbd5bbdf29cd80ecaa5070: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36710 - "GET / HTTP/1.0" 200 OK 2026-05-09 00:00:32,219 - lava_callback - INFO - Received callback for node 69fbd619df29cd80ecaa5093 INFO: 172.20.0.1:57960 - "POST /node/69fbd619df29cd80ecaa5093 HTTP/1.0" 202 Accepted 2026-05-09 00:00:32,227 - lava_callback - INFO - Starting async job submit for node 69fbd619df29cd80ecaa5093 2026-05-09 00:00:32,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:00:32,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd619df29cd80ecaa5093 HTTP/1.1" 200 None 2026-05-09 00:00:32,261 - lava_callback - DEBUG - Processing node 69fbd619df29cd80ecaa5093: baseline-arm64-clabbe 2026-05-09 00:00:32,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd619df29cd80ecaa5093 2026-05-09 00:00:32,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:00:32,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd619df29cd80ecaa5093 HTTP/1.1" 200 None 2026-05-09 00:00:32,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:00:32,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-09 00:00:32,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:00:32,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd619df29cd80ecaa5093 HTTP/1.1" 200 None 2026-05-09 00:00:32,317 - lava_callback - ERROR - Error processing callback for node 69fbd619df29cd80ecaa5093: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52552 - "GET / HTTP/1.0" 200 OK 2026-05-09 00:02:12,282 - lava_callback - INFO - Received callback for node 69fbd671df29cd80ecaa50b5 INFO: 172.20.0.1:59820 - "POST /node/69fbd671df29cd80ecaa50b5 HTTP/1.0" 202 Accepted 2026-05-09 00:02:12,290 - lava_callback - INFO - Starting async job submit for node 69fbd671df29cd80ecaa50b5 2026-05-09 00:02:12,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:02:12,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd671df29cd80ecaa50b5 HTTP/1.1" 200 None 2026-05-09 00:02:12,306 - lava_callback - DEBUG - Processing node 69fbd671df29cd80ecaa50b5: baseline-arm64-clabbe 2026-05-09 00:02:12,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd671df29cd80ecaa50b5 2026-05-09 00:02:12,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:02:12,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd671df29cd80ecaa50b5 HTTP/1.1" 200 None 2026-05-09 00:02:12,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:02:12,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-09 00:02:12,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:02:12,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd671df29cd80ecaa50b5 HTTP/1.1" 200 None 2026-05-09 00:02:12,361 - lava_callback - ERROR - Error processing callback for node 69fbd671df29cd80ecaa50b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38794 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-09 00:03:16,211 - lava_callback - INFO - Received callback for node 69fbd6badf29cd80ecaa50d2 INFO: 172.20.0.1:38796 - "POST /node/69fbd6badf29cd80ecaa50d2 HTTP/1.0" 202 Accepted 2026-05-09 00:03:16,218 - lava_callback - INFO - Starting async job submit for node 69fbd6badf29cd80ecaa50d2 2026-05-09 00:03:16,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:03:16,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd6badf29cd80ecaa50d2 HTTP/1.1" 200 None 2026-05-09 00:03:16,235 - lava_callback - DEBUG - Processing node 69fbd6badf29cd80ecaa50d2: baseline-arm64-baylibre 2026-05-09 00:03:16,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd6badf29cd80ecaa50d2 2026-05-09 00:03:16,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:03:16,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd6badf29cd80ecaa50d2 HTTP/1.1" 200 None 2026-05-09 00:03:16,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:03:16,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-09 00:03:16,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:03:16,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd6badf29cd80ecaa50d2 HTTP/1.1" 200 None 2026-05-09 00:03:16,305 - lava_callback - ERROR - Error processing callback for node 69fbd6badf29cd80ecaa50d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48234 - "GET / HTTP/1.0" 200 OK 2026-05-09 00:04:36,274 - lava_callback - INFO - Received callback for node 69fbd70ddf29cd80ecaa50f3 INFO: 172.20.0.1:50972 - "POST /node/69fbd70ddf29cd80ecaa50f3 HTTP/1.0" 202 Accepted 2026-05-09 00:04:36,279 - lava_callback - INFO - Starting async job submit for node 69fbd70ddf29cd80ecaa50f3 2026-05-09 00:04:36,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:04:36,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd70ddf29cd80ecaa50f3 HTTP/1.1" 200 None 2026-05-09 00:04:36,294 - lava_callback - DEBUG - Processing node 69fbd70ddf29cd80ecaa50f3: baseline-arm64-baylibre 2026-05-09 00:04:36,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd70ddf29cd80ecaa50f3 2026-05-09 00:04:36,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:04:36,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd70ddf29cd80ecaa50f3 HTTP/1.1" 200 None 2026-05-09 00:04:36,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:04:36,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-09 00:04:36,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:04:36,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd70ddf29cd80ecaa50f3 HTTP/1.1" 200 None 2026-05-09 00:04:36,349 - lava_callback - ERROR - Error processing callback for node 69fbd70ddf29cd80ecaa50f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55576 - "GET / HTTP/1.0" 200 OK 2026-05-09 00:05:56,284 - lava_callback - INFO - Received callback for node 69fbd762df29cd80ecaa5113 INFO: 172.20.0.1:52220 - "POST /node/69fbd762df29cd80ecaa5113 HTTP/1.0" 202 Accepted 2026-05-09 00:05:56,290 - lava_callback - INFO - Starting async job submit for node 69fbd762df29cd80ecaa5113 2026-05-09 00:05:56,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:05:56,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd762df29cd80ecaa5113 HTTP/1.1" 200 None 2026-05-09 00:05:56,308 - lava_callback - DEBUG - Processing node 69fbd762df29cd80ecaa5113: baseline-arm64-baylibre 2026-05-09 00:05:56,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd762df29cd80ecaa5113 2026-05-09 00:05:56,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:05:56,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd762df29cd80ecaa5113 HTTP/1.1" 200 None 2026-05-09 00:05:56,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:05:56,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-09 00:05:56,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:05:56,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd762df29cd80ecaa5113 HTTP/1.1" 200 None 2026-05-09 00:05:56,355 - lava_callback - ERROR - Error processing callback for node 69fbd762df29cd80ecaa5113: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40618 - "GET / HTTP/1.0" 200 OK 2026-05-09 00:07:36,383 - lava_callback - INFO - Received callback for node 69fbd7b3df29cd80ecaa5137 INFO: 172.20.0.1:36390 - "POST /node/69fbd7b3df29cd80ecaa5137 HTTP/1.0" 202 Accepted 2026-05-09 00:07:36,389 - lava_callback - INFO - Starting async job submit for node 69fbd7b3df29cd80ecaa5137 2026-05-09 00:07:36,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:07:36,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd7b3df29cd80ecaa5137 HTTP/1.1" 200 None 2026-05-09 00:07:36,404 - lava_callback - DEBUG - Processing node 69fbd7b3df29cd80ecaa5137: baseline-arm64-baylibre 2026-05-09 00:07:36,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd7b3df29cd80ecaa5137 2026-05-09 00:07:36,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:07:36,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd7b3df29cd80ecaa5137 HTTP/1.1" 200 None 2026-05-09 00:07:36,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:07:36,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-09 00:07:36,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:07:36,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd7b3df29cd80ecaa5137 HTTP/1.1" 200 None 2026-05-09 00:07:36,459 - lava_callback - ERROR - Error processing callback for node 69fbd7b3df29cd80ecaa5137: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47484 - "GET / HTTP/1.0" 200 OK 2026-05-09 00:08:56,458 - lava_callback - INFO - Received callback for node 69fbd805df29cd80ecaa5154 INFO: 172.20.0.1:51582 - "POST /node/69fbd805df29cd80ecaa5154 HTTP/1.0" 202 Accepted 2026-05-09 00:08:56,463 - lava_callback - INFO - Starting async job submit for node 69fbd805df29cd80ecaa5154 2026-05-09 00:08:56,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:08:56,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd805df29cd80ecaa5154 HTTP/1.1" 200 None 2026-05-09 00:08:56,485 - lava_callback - DEBUG - Processing node 69fbd805df29cd80ecaa5154: baseline-arm64-baylibre 2026-05-09 00:08:56,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd805df29cd80ecaa5154 2026-05-09 00:08:56,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:08:56,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd805df29cd80ecaa5154 HTTP/1.1" 200 None 2026-05-09 00:08:56,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:51588 - "GET / HTTP/1.0" 200 OK 2026-05-09 00:08:56,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-09 00:08:56,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:08:56,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd805df29cd80ecaa5154 HTTP/1.1" 200 None 2026-05-09 00:08:56,536 - lava_callback - ERROR - Error processing callback for node 69fbd805df29cd80ecaa5154: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43172 - "GET / HTTP/1.0" 200 OK 2026-05-09 00:09:56,511 - lava_callback - INFO - Received callback for node 69fbd850df29cd80ecaa5178 INFO: 172.20.0.1:50782 - "POST /node/69fbd850df29cd80ecaa5178 HTTP/1.0" 202 Accepted 2026-05-09 00:09:56,517 - lava_callback - INFO - Starting async job submit for node 69fbd850df29cd80ecaa5178 2026-05-09 00:09:56,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:50788 - "GET / HTTP/1.0" 200 OK 2026-05-09 00:09:56,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd850df29cd80ecaa5178 HTTP/1.1" 200 None 2026-05-09 00:09:56,534 - lava_callback - DEBUG - Processing node 69fbd850df29cd80ecaa5178: baseline-arm64-baylibre 2026-05-09 00:09:56,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd850df29cd80ecaa5178 2026-05-09 00:09:56,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:09:56,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd850df29cd80ecaa5178 HTTP/1.1" 200 None 2026-05-09 00:09:56,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:09:56,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-09 00:09:56,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:09:56,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd850df29cd80ecaa5178 HTTP/1.1" 200 None 2026-05-09 00:09:56,592 - lava_callback - ERROR - Error processing callback for node 69fbd850df29cd80ecaa5178: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41838 - "GET / HTTP/1.0" 200 OK 2026-05-09 00:11:36,632 - lava_callback - INFO - Received callback for node 69fbd8a4df29cd80ecaa519c INFO: 172.20.0.1:41852 - "POST /node/69fbd8a4df29cd80ecaa519c HTTP/1.0" 202 Accepted 2026-05-09 00:11:36,641 - lava_callback - INFO - Starting async job submit for node 69fbd8a4df29cd80ecaa519c 2026-05-09 00:11:36,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:11:36,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd8a4df29cd80ecaa519c HTTP/1.1" 200 None 2026-05-09 00:11:36,662 - lava_callback - DEBUG - Processing node 69fbd8a4df29cd80ecaa519c: baseline-arm64-baylibre 2026-05-09 00:11:36,662 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fbd8a4df29cd80ecaa519c 2026-05-09 00:11:36,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:11:36,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd8a4df29cd80ecaa519c HTTP/1.1" 200 None 2026-05-09 00:11:36,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:11:36,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-09 00:11:36,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 00:11:36,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fbd8a4df29cd80ecaa519c HTTP/1.1" 200 None 2026-05-09 00:11:36,714 - lava_callback - ERROR - Error processing callback for node 69fbd8a4df29cd80ecaa519c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]