INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:53956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41898 - "GET /node/69f2a8fae2fa3d7693ba6f62%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49542 - "GET /node/69e81c3cafb86e738cad0213%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55762 - "GET /node/69f20d8b13aba9734a494cbc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40150 - "GET /node/68b01b4c7c666e2d481a6db7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52252 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:28:19,495 - lava_callback - INFO - Received callback for node 69f3f3962fa6ff8e8ca92ca7 2026-05-03 00:28:19,501 - lava_callback - INFO - Starting async job submit for node 69f3f3962fa6ff8e8ca92ca7 INFO: 172.20.0.1:52254 - "POST /node/69f3f3962fa6ff8e8ca92ca7 HTTP/1.0" 202 Accepted 2026-05-03 00:28:19,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:28:19,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f3962fa6ff8e8ca92ca7 HTTP/1.1" 200 None 2026-05-03 00:28:19,533 - lava_callback - DEBUG - Processing node 69f3f3962fa6ff8e8ca92ca7: baseline-arm-clabbe 2026-05-03 00:28:19,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f3962fa6ff8e8ca92ca7 2026-05-03 00:28:19,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:28:19,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f3962fa6ff8e8ca92ca7 HTTP/1.1" 200 None 2026-05-03 00:28:19,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:28:19,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 00:28:19,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:28:19,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f3962fa6ff8e8ca92ca7 HTTP/1.1" 200 None 2026-05-03 00:28:19,583 - lava_callback - ERROR - Error processing callback for node 69f3f3962fa6ff8e8ca92ca7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45246 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:28:59,456 - lava_callback - INFO - Received callback for node 69f3f3bd2fa6ff8e8ca92cba INFO: 172.20.0.1:45254 - "POST /node/69f3f3bd2fa6ff8e8ca92cba HTTP/1.0" 202 Accepted 2026-05-03 00:28:59,465 - lava_callback - INFO - Starting async job submit for node 69f3f3bd2fa6ff8e8ca92cba 2026-05-03 00:28:59,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:28:59,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f3bd2fa6ff8e8ca92cba HTTP/1.1" 200 None 2026-05-03 00:28:59,506 - lava_callback - DEBUG - Processing node 69f3f3bd2fa6ff8e8ca92cba: baseline-arm-clabbe 2026-05-03 00:28:59,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f3bd2fa6ff8e8ca92cba 2026-05-03 00:28:59,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:28:59,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f3bd2fa6ff8e8ca92cba HTTP/1.1" 200 None 2026-05-03 00:28:59,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:28:59,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 00:28:59,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:28:59,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f3bd2fa6ff8e8ca92cba HTTP/1.1" 200 None 2026-05-03 00:28:59,570 - lava_callback - ERROR - Error processing callback for node 69f3f3bd2fa6ff8e8ca92cba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58280 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:29:39,510 - lava_callback - INFO - Received callback for node 69f3f3e12fa6ff8e8ca92cca INFO: 172.20.0.1:58288 - "POST /node/69f3f3e12fa6ff8e8ca92cca HTTP/1.0" 202 Accepted 2026-05-03 00:29:39,515 - lava_callback - INFO - Starting async job submit for node 69f3f3e12fa6ff8e8ca92cca 2026-05-03 00:29:39,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:29:39,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f3e12fa6ff8e8ca92cca HTTP/1.1" 200 None 2026-05-03 00:29:39,531 - lava_callback - DEBUG - Processing node 69f3f3e12fa6ff8e8ca92cca: baseline-arm-clabbe 2026-05-03 00:29:39,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f3e12fa6ff8e8ca92cca 2026-05-03 00:29:39,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:29:39,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f3e12fa6ff8e8ca92cca HTTP/1.1" 200 None 2026-05-03 00:29:39,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:29:39,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 00:29:39,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:29:39,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f3e12fa6ff8e8ca92cca HTTP/1.1" 200 None 2026-05-03 00:29:39,576 - lava_callback - ERROR - Error processing callback for node 69f3f3e12fa6ff8e8ca92cca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49096 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:30:19,652 - lava_callback - INFO - Received callback for node 69f3f4062fa6ff8e8ca92ce1 INFO: 172.20.0.1:49102 - "POST /node/69f3f4062fa6ff8e8ca92ce1 HTTP/1.0" 202 Accepted 2026-05-03 00:30:19,658 - lava_callback - INFO - Starting async job submit for node 69f3f4062fa6ff8e8ca92ce1 2026-05-03 00:30:19,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:30:19,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f4062fa6ff8e8ca92ce1 HTTP/1.1" 200 None 2026-05-03 00:30:19,673 - lava_callback - DEBUG - Processing node 69f3f4062fa6ff8e8ca92ce1: baseline-arm-clabbe 2026-05-03 00:30:19,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f4062fa6ff8e8ca92ce1 2026-05-03 00:30:19,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:30:19,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f4062fa6ff8e8ca92ce1 HTTP/1.1" 200 None 2026-05-03 00:30:19,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:30:19,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 00:30:19,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:30:19,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f4062fa6ff8e8ca92ce1 HTTP/1.1" 200 None 2026-05-03 00:30:19,739 - lava_callback - ERROR - Error processing callback for node 69f3f4062fa6ff8e8ca92ce1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39718 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:30:39,586 - lava_callback - INFO - Received callback for node 69f3f42c2fa6ff8e8ca92cea INFO: 172.20.0.1:39726 - "POST /node/69f3f42c2fa6ff8e8ca92cea HTTP/1.0" 202 Accepted 2026-05-03 00:30:39,591 - lava_callback - INFO - Starting async job submit for node 69f3f42c2fa6ff8e8ca92cea 2026-05-03 00:30:39,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:30:39,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f42c2fa6ff8e8ca92cea HTTP/1.1" 200 None 2026-05-03 00:30:39,606 - lava_callback - DEBUG - Processing node 69f3f42c2fa6ff8e8ca92cea: baseline-arm-clabbe 2026-05-03 00:30:39,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f42c2fa6ff8e8ca92cea 2026-05-03 00:30:39,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:30:39,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f42c2fa6ff8e8ca92cea HTTP/1.1" 200 None 2026-05-03 00:30:39,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:30:39,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 00:30:39,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:30:39,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f42c2fa6ff8e8ca92cea HTTP/1.1" 200 None 2026-05-03 00:30:39,668 - lava_callback - ERROR - Error processing callback for node 69f3f42c2fa6ff8e8ca92cea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39158 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:31:19,522 - lava_callback - INFO - Received callback for node 69f3f4502fa6ff8e8ca92cfa INFO: 172.20.0.1:39174 - "POST /node/69f3f4502fa6ff8e8ca92cfa HTTP/1.0" 202 Accepted 2026-05-03 00:31:19,528 - lava_callback - INFO - Starting async job submit for node 69f3f4502fa6ff8e8ca92cfa 2026-05-03 00:31:19,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:31:19,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f4502fa6ff8e8ca92cfa HTTP/1.1" 200 None 2026-05-03 00:31:19,543 - lava_callback - DEBUG - Processing node 69f3f4502fa6ff8e8ca92cfa: baseline-arm-clabbe 2026-05-03 00:31:19,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f4502fa6ff8e8ca92cfa 2026-05-03 00:31:19,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:31:19,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f4502fa6ff8e8ca92cfa HTTP/1.1" 200 None 2026-05-03 00:31:19,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:31:19,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 00:31:19,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:31:19,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f4502fa6ff8e8ca92cfa HTTP/1.1" 200 None 2026-05-03 00:31:19,615 - lava_callback - ERROR - Error processing callback for node 69f3f4502fa6ff8e8ca92cfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47042 - "GET /node/69f0e3f394b553ffc6903e7b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35684 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:31:59,667 - lava_callback - INFO - Received callback for node 69f3f4752fa6ff8e8ca92d0a INFO: 172.20.0.1:35690 - "POST /node/69f3f4752fa6ff8e8ca92d0a HTTP/1.0" 202 Accepted 2026-05-03 00:31:59,673 - lava_callback - INFO - Starting async job submit for node 69f3f4752fa6ff8e8ca92d0a 2026-05-03 00:31:59,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:31:59,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f4752fa6ff8e8ca92d0a HTTP/1.1" 200 None 2026-05-03 00:31:59,690 - lava_callback - DEBUG - Processing node 69f3f4752fa6ff8e8ca92d0a: baseline-arm-clabbe 2026-05-03 00:31:59,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f4752fa6ff8e8ca92d0a 2026-05-03 00:31:59,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:31:59,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f4752fa6ff8e8ca92d0a HTTP/1.1" 200 None 2026-05-03 00:31:59,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:31:59,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 00:31:59,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:31:59,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f4752fa6ff8e8ca92d0a HTTP/1.1" 200 None 2026-05-03 00:31:59,736 - lava_callback - ERROR - Error processing callback for node 69f3f4752fa6ff8e8ca92d0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51048 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:32:39,603 - lava_callback - INFO - Received callback for node 69f3f49a2fa6ff8e8ca92d24 INFO: 172.20.0.1:51064 - "POST /node/69f3f49a2fa6ff8e8ca92d24 HTTP/1.0" 202 Accepted 2026-05-03 00:32:39,609 - lava_callback - INFO - Starting async job submit for node 69f3f49a2fa6ff8e8ca92d24 2026-05-03 00:32:39,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:32:39,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f49a2fa6ff8e8ca92d24 HTTP/1.1" 200 None 2026-05-03 00:32:39,633 - lava_callback - DEBUG - Processing node 69f3f49a2fa6ff8e8ca92d24: baseline-arm-clabbe 2026-05-03 00:32:39,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f49a2fa6ff8e8ca92d24 2026-05-03 00:32:39,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:32:39,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f49a2fa6ff8e8ca92d24 HTTP/1.1" 200 None 2026-05-03 00:32:39,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:32:39,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 00:32:39,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:32:39,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f49a2fa6ff8e8ca92d24 HTTP/1.1" 200 None 2026-05-03 00:32:39,688 - lava_callback - ERROR - Error processing callback for node 69f3f49a2fa6ff8e8ca92d24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50944 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:33:19,684 - lava_callback - INFO - Received callback for node 69f3f4c02fa6ff8e8ca92d2a INFO: 172.20.0.1:50956 - "POST /node/69f3f4c02fa6ff8e8ca92d2a HTTP/1.0" 202 Accepted 2026-05-03 00:33:19,690 - lava_callback - INFO - Starting async job submit for node 69f3f4c02fa6ff8e8ca92d2a 2026-05-03 00:33:19,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:33:19,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f4c02fa6ff8e8ca92d2a HTTP/1.1" 200 None 2026-05-03 00:33:19,705 - lava_callback - DEBUG - Processing node 69f3f4c02fa6ff8e8ca92d2a: baseline-arm-clabbe 2026-05-03 00:33:19,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f4c02fa6ff8e8ca92d2a 2026-05-03 00:33:19,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:33:19,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f4c02fa6ff8e8ca92d2a HTTP/1.1" 200 None 2026-05-03 00:33:19,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:33:19,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 00:33:19,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:33:19,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f4c02fa6ff8e8ca92d2a HTTP/1.1" 200 None 2026-05-03 00:33:19,779 - lava_callback - ERROR - Error processing callback for node 69f3f4c02fa6ff8e8ca92d2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45968 - "GET /node/69e6dc9e60f5826562c1659c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54014 - "GET /node/69e68b91dc041e577b77bd2e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36392 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:40:21,844 - lava_callback - INFO - Received callback for node 69f699681f903fec0b0de59a INFO: 172.20.0.1:34006 - "POST /node/69f699681f903fec0b0de59a HTTP/1.0" 202 Accepted 2026-05-03 00:40:21,850 - lava_callback - INFO - Starting async job submit for node 69f699681f903fec0b0de59a 2026-05-03 00:40:21,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:21,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699681f903fec0b0de59a HTTP/1.1" 200 None 2026-05-03 00:40:21,868 - lava_callback - DEBUG - Processing node 69f699681f903fec0b0de59a: baseline-arm 2026-05-03 00:40:21,873 - lava_callback - WARNING - Failed to upload log 2026-05-03 00:40:21,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:40:21,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:40:21,978 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f699681f903fec0b0de59a/lava-logs.yaml 2026-05-03 00:40:21,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:40:22,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:40:22,091 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f699681f903fec0b0de59a/lava_callback.json.gz 2026-05-03 00:40:22,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:22,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699681f903fec0b0de59a HTTP/1.1" 200 None 2026-05-03 00:40:22,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:22,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:40:22,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:22,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699681f903fec0b0de59a HTTP/1.1" 200 None 2026-05-03 00:40:22,179 - lava_callback - INFO - Completed processing callback for node 69f699681f903fec0b0de59a INFO: 172.20.0.1:34012 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:40:28,837 - lava_callback - INFO - Received callback for node 69f699671f903fec0b0de597 INFO: 172.20.0.1:34022 - "POST /node/69f699671f903fec0b0de597 HTTP/1.0" 202 Accepted 2026-05-03 00:40:28,843 - lava_callback - INFO - Starting async job submit for node 69f699671f903fec0b0de597 2026-05-03 00:40:28,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:28,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699671f903fec0b0de597 HTTP/1.1" 200 None 2026-05-03 00:40:28,862 - lava_callback - DEBUG - Processing node 69f699671f903fec0b0de597: baseline-arm 2026-05-03 00:40:28,867 - lava_callback - WARNING - Failed to upload log 2026-05-03 00:40:28,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:40:28,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:40:28,976 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f699671f903fec0b0de597/lava-logs.yaml 2026-05-03 00:40:28,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:40:29,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:40:29,086 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f699671f903fec0b0de597/lava_callback.json.gz 2026-05-03 00:40:29,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:29,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699671f903fec0b0de597 HTTP/1.1" 200 None 2026-05-03 00:40:29,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:29,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:40:29,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:29,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699671f903fec0b0de597 HTTP/1.1" 200 None 2026-05-03 00:40:29,228 - lava_callback - INFO - Completed processing callback for node 69f699671f903fec0b0de597 INFO: 172.20.0.1:33542 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:40:38,281 - lava_callback - INFO - Received callback for node 69f699141f903fec0b0de556 INFO: 172.20.0.1:33548 - "POST /node/69f699141f903fec0b0de556 HTTP/1.0" 202 Accepted 2026-05-03 00:40:38,287 - lava_callback - INFO - Starting async job submit for node 69f699141f903fec0b0de556 2026-05-03 00:40:38,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:38,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699141f903fec0b0de556 HTTP/1.1" 200 None 2026-05-03 00:40:38,325 - lava_callback - DEBUG - Processing node 69f699141f903fec0b0de556: baseline-arm 2026-05-03 00:40:38,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:40:38,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:40:38,623 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f699141f903fec0b0de556/log.txt.gz 2026-05-03 00:40:38,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:40:38,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:40:38,904 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f699141f903fec0b0de556/lava-logs.yaml 2026-05-03 00:40:38,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:40:39,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:40:39,033 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f699141f903fec0b0de556/lava_callback.json.gz 2026-05-03 00:40:39,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:39,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699141f903fec0b0de556 HTTP/1.1" 200 None 2026-05-03 00:40:39,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:39,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f694321f903fec0b0dbc7d HTTP/1.1" 200 None 2026-05-03 00:40:39,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:39,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699141f903fec0b0de556 HTTP/1.1" 200 None 2026-05-03 00:40:39,179 - lava_callback - INFO - Completed processing callback for node 69f699141f903fec0b0de556 INFO: 172.20.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60198 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:40:47,347 - lava_callback - INFO - Received callback for node 69f6996b1f903fec0b0de5a3 INFO: 172.20.0.1:60206 - "POST /node/69f6996b1f903fec0b0de5a3 HTTP/1.0" 202 Accepted 2026-05-03 00:40:47,393 - lava_callback - INFO - Starting async job submit for node 69f6996b1f903fec0b0de5a3 2026-05-03 00:40:47,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:47,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6996b1f903fec0b0de5a3 HTTP/1.1" 200 None 2026-05-03 00:40:47,425 - lava_callback - DEBUG - Processing node 69f6996b1f903fec0b0de5a3: baseline-arm 2026-05-03 00:40:47,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:40:47,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:40:47,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f6996b1f903fec0b0de5a3/log.txt.gz 2026-05-03 00:40:47,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:40:47,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:40:47,817 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f6996b1f903fec0b0de5a3/lava-logs.yaml 2026-05-03 00:40:47,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:40:47,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:40:47,899 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f6996b1f903fec0b0de5a3/lava_callback.json.gz 2026-05-03 00:40:47,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:47,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6996b1f903fec0b0de5a3 HTTP/1.1" 200 None 2026-05-03 00:40:47,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:47,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:40:47,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:47,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6996b1f903fec0b0de5a3 HTTP/1.1" 200 None 2026-05-03 00:40:47,969 - lava_callback - INFO - Completed processing callback for node 69f6996b1f903fec0b0de5a3 2026-05-03 00:40:49,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:49,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 00:40:52,718 - lava_callback - INFO - Received callback for node 69f3f6842fa6ff8e8ca92dab INFO: 172.20.0.1:60642 - "POST /node/69f3f6842fa6ff8e8ca92dab HTTP/1.0" 202 Accepted 2026-05-03 00:40:52,723 - lava_callback - INFO - Starting async job submit for node 69f3f6842fa6ff8e8ca92dab 2026-05-03 00:40:52,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:52,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f6842fa6ff8e8ca92dab HTTP/1.1" 200 None 2026-05-03 00:40:52,749 - lava_callback - DEBUG - Processing node 69f3f6842fa6ff8e8ca92dab: baseline-arm-baylibre 2026-05-03 00:40:52,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f6842fa6ff8e8ca92dab 2026-05-03 00:40:52,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:52,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f6842fa6ff8e8ca92dab HTTP/1.1" 200 None 2026-05-03 00:40:52,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:52,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:40:52,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:40:52,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f6842fa6ff8e8ca92dab HTTP/1.1" 200 None 2026-05-03 00:40:52,794 - lava_callback - ERROR - Error processing callback for node 69f3f6842fa6ff8e8ca92dab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40212 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:41:16,987 - lava_callback - INFO - Received callback for node 69f6996a1f903fec0b0de5a0 INFO: 172.20.0.1:40220 - "POST /node/69f6996a1f903fec0b0de5a0 HTTP/1.0" 202 Accepted 2026-05-03 00:41:16,995 - lava_callback - INFO - Starting async job submit for node 69f6996a1f903fec0b0de5a0 2026-05-03 00:41:17,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:17,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6996a1f903fec0b0de5a0 HTTP/1.1" 200 None 2026-05-03 00:41:17,033 - lava_callback - DEBUG - Processing node 69f6996a1f903fec0b0de5a0: baseline-arm 2026-05-03 00:41:17,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:17,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:17,399 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f6996a1f903fec0b0de5a0/log.txt.gz 2026-05-03 00:41:17,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:17,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:17,724 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f6996a1f903fec0b0de5a0/lava-logs.yaml 2026-05-03 00:41:17,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:17,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:17,836 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f6996a1f903fec0b0de5a0/lava_callback.json.gz 2026-05-03 00:41:17,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:17,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6996a1f903fec0b0de5a0 HTTP/1.1" 200 None 2026-05-03 00:41:17,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:17,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:41:17,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:17,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6996a1f903fec0b0de5a0 HTTP/1.1" 200 None 2026-05-03 00:41:17,920 - lava_callback - INFO - Completed processing callback for node 69f6996a1f903fec0b0de5a0 2026-05-03 00:41:19,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:19,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 00:41:23,569 - lava_callback - INFO - Received callback for node 69f699661f903fec0b0de594 INFO: 172.20.0.1:49284 - "POST /node/69f699661f903fec0b0de594 HTTP/1.0" 202 Accepted 2026-05-03 00:41:23,575 - lava_callback - INFO - Starting async job submit for node 69f699661f903fec0b0de594 2026-05-03 00:41:23,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:23,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699661f903fec0b0de594 HTTP/1.1" 200 None 2026-05-03 00:41:23,611 - lava_callback - DEBUG - Processing node 69f699661f903fec0b0de594: baseline-arm 2026-05-03 00:41:23,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:23,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:23,875 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f699661f903fec0b0de594/log.txt.gz 2026-05-03 00:41:23,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:24,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:24,110 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f699661f903fec0b0de594/lava-logs.yaml 2026-05-03 00:41:24,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:24,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:24,214 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f699661f903fec0b0de594/lava_callback.json.gz 2026-05-03 00:41:24,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:24,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699661f903fec0b0de594 HTTP/1.1" 200 None 2026-05-03 00:41:24,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:24,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:41:24,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:24,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699661f903fec0b0de594 HTTP/1.1" 200 None 2026-05-03 00:41:24,300 - lava_callback - INFO - Completed processing callback for node 69f699661f903fec0b0de594 INFO: 172.20.0.1:49300 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:41:28,719 - lava_callback - INFO - Received callback for node 69f3f6a92fa6ff8e8ca92dcd INFO: 172.20.0.1:49316 - "POST /node/69f3f6a92fa6ff8e8ca92dcd HTTP/1.0" 202 Accepted 2026-05-03 00:41:28,725 - lava_callback - INFO - Starting async job submit for node 69f3f6a92fa6ff8e8ca92dcd 2026-05-03 00:41:28,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:28,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f6a92fa6ff8e8ca92dcd HTTP/1.1" 200 None 2026-05-03 00:41:28,740 - lava_callback - DEBUG - Processing node 69f3f6a92fa6ff8e8ca92dcd: baseline-arm-baylibre 2026-05-03 00:41:28,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f6a92fa6ff8e8ca92dcd 2026-05-03 00:41:28,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:28,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f6a92fa6ff8e8ca92dcd HTTP/1.1" 200 None 2026-05-03 00:41:28,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:28,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:41:28,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:28,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f6a92fa6ff8e8ca92dcd HTTP/1.1" 200 None 2026-05-03 00:41:28,787 - lava_callback - ERROR - Error processing callback for node 69f3f6a92fa6ff8e8ca92dcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40598 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:41:37,748 - lava_callback - INFO - Received callback for node 69f699731f903fec0b0de5b4 INFO: 172.20.0.1:40612 - "POST /node/69f699731f903fec0b0de5b4 HTTP/1.0" 202 Accepted 2026-05-03 00:41:37,754 - lava_callback - INFO - Starting async job submit for node 69f699731f903fec0b0de5b4 2026-05-03 00:41:37,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:37,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699731f903fec0b0de5b4 HTTP/1.1" 200 None 2026-05-03 00:41:37,796 - lava_callback - DEBUG - Processing node 69f699731f903fec0b0de5b4: baseline-arm-broonie 2026-05-03 00:41:37,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:38,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:38,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f699731f903fec0b0de5b4/log.txt.gz 2026-05-03 00:41:38,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:38,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:38,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f699731f903fec0b0de5b4/lava-logs.yaml 2026-05-03 00:41:38,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:38,391 - lava_callback - INFO - Received callback for node 69f699861f903fec0b0de627 2026-05-03 00:41:38,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:38,424 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f699731f903fec0b0de5b4/lava_callback.json.gz 2026-05-03 00:41:38,453 - lava_callback - INFO - Starting async job submit for node 69f699861f903fec0b0de627 INFO: 172.20.0.1:40628 - "POST /node/69f699861f903fec0b0de627 HTTP/1.0" 202 Accepted 2026-05-03 00:41:38,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:38,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:38,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699731f903fec0b0de5b4 HTTP/1.1" 200 None 2026-05-03 00:41:38,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:38,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699861f903fec0b0de627 HTTP/1.1" 200 None 2026-05-03 00:41:38,503 - lava_callback - DEBUG - Processing node 69f699861f903fec0b0de627: baseline-arm-pengutronix 2026-05-03 00:41:38,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:41:38,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:38,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:38,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699731f903fec0b0de5b4 HTTP/1.1" 200 None 2026-05-03 00:41:38,649 - lava_callback - INFO - Completed processing callback for node 69f699731f903fec0b0de5b4 2026-05-03 00:41:38,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:38,821 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f699861f903fec0b0de627/log.txt.gz 2026-05-03 00:41:38,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:39,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:39,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f699861f903fec0b0de627/lava-logs.yaml 2026-05-03 00:41:39,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:39,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:39,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f699861f903fec0b0de627/lava_callback.json.gz 2026-05-03 00:41:39,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:39,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699861f903fec0b0de627 HTTP/1.1" 200 None 2026-05-03 00:41:39,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:39,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:41:39,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:39,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699861f903fec0b0de627 HTTP/1.1" 200 None 2026-05-03 00:41:39,197 - lava_callback - INFO - Completed processing callback for node 69f699861f903fec0b0de627 2026-05-03 00:41:39,424 - lava_callback - INFO - Received callback for node 69f699741f903fec0b0de5b7 INFO: 172.20.0.1:40632 - "POST /node/69f699741f903fec0b0de5b7 HTTP/1.0" 202 Accepted 2026-05-03 00:41:39,430 - lava_callback - INFO - Starting async job submit for node 69f699741f903fec0b0de5b7 2026-05-03 00:41:39,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:39,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699741f903fec0b0de5b7 HTTP/1.1" 200 None 2026-05-03 00:41:39,493 - lava_callback - DEBUG - Processing node 69f699741f903fec0b0de5b7: baseline-arm-broonie 2026-05-03 00:41:39,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:39,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:39,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f699741f903fec0b0de5b7/log.txt.gz 2026-05-03 00:41:39,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:40,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:40,069 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f699741f903fec0b0de5b7/lava-logs.yaml 2026-05-03 00:41:40,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:40,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:40,175 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f699741f903fec0b0de5b7/lava_callback.json.gz 2026-05-03 00:41:40,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:40,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699741f903fec0b0de5b7 HTTP/1.1" 200 None 2026-05-03 00:41:40,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:40,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:41:40,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:40,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699741f903fec0b0de5b7 HTTP/1.1" 200 None 2026-05-03 00:41:40,251 - lava_callback - INFO - Completed processing callback for node 69f699741f903fec0b0de5b7 INFO: 172.20.0.1:41536 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:41:45,976 - lava_callback - INFO - Received callback for node 69f699831f903fec0b0de621 INFO: 172.20.0.1:41540 - "POST /node/69f699831f903fec0b0de621 HTTP/1.0" 202 Accepted 2026-05-03 00:41:45,982 - lava_callback - INFO - Starting async job submit for node 69f699831f903fec0b0de621 2026-05-03 00:41:46,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:46,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699831f903fec0b0de621 HTTP/1.1" 200 None 2026-05-03 00:41:46,022 - lava_callback - DEBUG - Processing node 69f699831f903fec0b0de621: baseline-arm-pengutronix 2026-05-03 00:41:46,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:46,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:46,278 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f699831f903fec0b0de621/log.txt.gz 2026-05-03 00:41:46,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:41:46,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:46,483 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f699831f903fec0b0de621/lava-logs.yaml 2026-05-03 00:41:46,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:41550 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:41:46,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:41:46,579 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f699831f903fec0b0de621/lava_callback.json.gz 2026-05-03 00:41:46,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:46,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699831f903fec0b0de621 HTTP/1.1" 200 None 2026-05-03 00:41:46,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:46,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:41:46,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:46,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699831f903fec0b0de621 HTTP/1.1" 200 None 2026-05-03 00:41:46,656 - lava_callback - INFO - Completed processing callback for node 69f699831f903fec0b0de621 2026-05-03 00:41:49,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:41:49,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:52626 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:42:03,995 - lava_callback - INFO - Received callback for node 69f699761f903fec0b0de5ba INFO: 172.20.0.1:37222 - "POST /node/69f699761f903fec0b0de5ba HTTP/1.0" 202 Accepted 2026-05-03 00:42:04,001 - lava_callback - INFO - Starting async job submit for node 69f699761f903fec0b0de5ba 2026-05-03 00:42:04,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:04,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699761f903fec0b0de5ba HTTP/1.1" 200 None 2026-05-03 00:42:04,040 - lava_callback - DEBUG - Processing node 69f699761f903fec0b0de5ba: baseline-arm-broonie 2026-05-03 00:42:04,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:04,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:04,341 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f699761f903fec0b0de5ba/log.txt.gz 2026-05-03 00:42:04,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:04,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:04,625 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f699761f903fec0b0de5ba/lava-logs.yaml 2026-05-03 00:42:04,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:04,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:04,734 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f699761f903fec0b0de5ba/lava_callback.json.gz 2026-05-03 00:42:04,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:04,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699761f903fec0b0de5ba HTTP/1.1" 200 None 2026-05-03 00:42:04,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:04,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:42:04,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:04,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699761f903fec0b0de5ba HTTP/1.1" 200 None 2026-05-03 00:42:04,821 - lava_callback - INFO - Completed processing callback for node 69f699761f903fec0b0de5ba INFO: 172.20.0.1:37230 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:42:08,780 - lava_callback - INFO - Received callback for node 69f3f6cf2fa6ff8e8ca92ddb INFO: 172.20.0.1:37232 - "POST /node/69f3f6cf2fa6ff8e8ca92ddb HTTP/1.0" 202 Accepted 2026-05-03 00:42:08,786 - lava_callback - INFO - Starting async job submit for node 69f3f6cf2fa6ff8e8ca92ddb 2026-05-03 00:42:08,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:08,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f6cf2fa6ff8e8ca92ddb HTTP/1.1" 200 None 2026-05-03 00:42:08,802 - lava_callback - DEBUG - Processing node 69f3f6cf2fa6ff8e8ca92ddb: baseline-arm-baylibre 2026-05-03 00:42:08,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f6cf2fa6ff8e8ca92ddb 2026-05-03 00:42:08,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:08,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f6cf2fa6ff8e8ca92ddb HTTP/1.1" 200 None 2026-05-03 00:42:08,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:08,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:42:08,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:08,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f6cf2fa6ff8e8ca92ddb HTTP/1.1" 200 None 2026-05-03 00:42:08,847 - lava_callback - ERROR - Error processing callback for node 69f3f6cf2fa6ff8e8ca92ddb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35764 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:42:19,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:19,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 00:42:24,232 - lava_callback - INFO - Received callback for node 69f699721f903fec0b0de5b1 INFO: 172.20.0.1:46248 - "POST /node/69f699721f903fec0b0de5b1 HTTP/1.0" 202 Accepted 2026-05-03 00:42:24,237 - lava_callback - INFO - Starting async job submit for node 69f699721f903fec0b0de5b1 2026-05-03 00:42:24,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:24,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699721f903fec0b0de5b1 HTTP/1.1" 200 None 2026-05-03 00:42:24,274 - lava_callback - DEBUG - Processing node 69f699721f903fec0b0de5b1: baseline-arm-broonie 2026-05-03 00:42:24,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:24,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:24,568 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f699721f903fec0b0de5b1/log.txt.gz 2026-05-03 00:42:24,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:24,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:24,866 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f699721f903fec0b0de5b1/lava-logs.yaml 2026-05-03 00:42:24,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:24,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:24,991 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f699721f903fec0b0de5b1/lava_callback.json.gz 2026-05-03 00:42:25,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:25,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699721f903fec0b0de5b1 HTTP/1.1" 200 None 2026-05-03 00:42:25,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:25,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:42:25,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:25,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699721f903fec0b0de5b1 HTTP/1.1" 200 None 2026-05-03 00:42:25,071 - lava_callback - INFO - Completed processing callback for node 69f699721f903fec0b0de5b1 INFO: 172.20.0.1:46260 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:42:28,775 - lava_callback - INFO - Received callback for node 69f3f6f12fa6ff8e8ca92de5 INFO: 172.20.0.1:46272 - "POST /node/69f3f6f12fa6ff8e8ca92de5 HTTP/1.0" 202 Accepted 2026-05-03 00:42:28,780 - lava_callback - INFO - Starting async job submit for node 69f3f6f12fa6ff8e8ca92de5 2026-05-03 00:42:28,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:28,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f6f12fa6ff8e8ca92de5 HTTP/1.1" 200 None 2026-05-03 00:42:28,812 - lava_callback - DEBUG - Processing node 69f3f6f12fa6ff8e8ca92de5: baseline-arm-baylibre 2026-05-03 00:42:28,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f6f12fa6ff8e8ca92de5 2026-05-03 00:42:28,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:28,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f6f12fa6ff8e8ca92de5 HTTP/1.1" 200 None 2026-05-03 00:42:28,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:28,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:42:28,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:28,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f6f12fa6ff8e8ca92de5 HTTP/1.1" 200 None 2026-05-03 00:42:28,869 - lava_callback - ERROR - Error processing callback for node 69f3f6f12fa6ff8e8ca92de5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-03 00:42:30,125 - lava_callback - INFO - Received callback for node 69f6997f1f903fec0b0de611 INFO: 172.20.0.1:40868 - "POST /node/69f6997f1f903fec0b0de611 HTTP/1.0" 202 Accepted 2026-05-03 00:42:30,131 - lava_callback - INFO - Starting async job submit for node 69f6997f1f903fec0b0de611 2026-05-03 00:42:30,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:30,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6997f1f903fec0b0de611 HTTP/1.1" 200 None 2026-05-03 00:42:30,167 - lava_callback - DEBUG - Processing node 69f6997f1f903fec0b0de611: baseline-arm-kontron 2026-05-03 00:42:30,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:30,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:30,454 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f6997f1f903fec0b0de611/log.txt.gz 2026-05-03 00:42:30,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:30,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:30,719 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f6997f1f903fec0b0de611/lava-logs.yaml 2026-05-03 00:42:30,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:30,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:30,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f6997f1f903fec0b0de611/lava_callback.json.gz 2026-05-03 00:42:30,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:30,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6997f1f903fec0b0de611 HTTP/1.1" 200 None 2026-05-03 00:42:30,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:30,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:42:30,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:30,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6997f1f903fec0b0de611 HTTP/1.1" 200 None 2026-05-03 00:42:30,897 - lava_callback - INFO - Completed processing callback for node 69f6997f1f903fec0b0de611 2026-05-03 00:42:31,220 - lava_callback - INFO - Received callback for node 69f699811f903fec0b0de616 INFO: 172.20.0.1:40870 - "POST /node/69f699811f903fec0b0de616 HTTP/1.0" 202 Accepted 2026-05-03 00:42:31,226 - lava_callback - INFO - Starting async job submit for node 69f699811f903fec0b0de616 2026-05-03 00:42:31,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:31,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699811f903fec0b0de616 HTTP/1.1" 200 None 2026-05-03 00:42:31,266 - lava_callback - DEBUG - Processing node 69f699811f903fec0b0de616: baseline-arm-kontron 2026-05-03 00:42:31,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:31,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:31,533 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f699811f903fec0b0de616/log.txt.gz 2026-05-03 00:42:31,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:31,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:31,768 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f699811f903fec0b0de616/lava-logs.yaml 2026-05-03 00:42:31,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:31,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:31,899 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f699811f903fec0b0de616/lava_callback.json.gz 2026-05-03 00:42:31,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:31,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699811f903fec0b0de616 HTTP/1.1" 200 None 2026-05-03 00:42:31,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:31,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:42:31,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:31,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699811f903fec0b0de616 HTTP/1.1" 200 None 2026-05-03 00:42:31,997 - lava_callback - INFO - Completed processing callback for node 69f699811f903fec0b0de616 INFO: 172.20.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49242 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:42:45,112 - lava_callback - INFO - Received callback for node 69f699841f903fec0b0de624 INFO: 172.20.0.1:49246 - "POST /node/69f699841f903fec0b0de624 HTTP/1.0" 202 Accepted 2026-05-03 00:42:45,118 - lava_callback - INFO - Starting async job submit for node 69f699841f903fec0b0de624 2026-05-03 00:42:45,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:45,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699841f903fec0b0de624 HTTP/1.1" 200 None 2026-05-03 00:42:45,165 - lava_callback - DEBUG - Processing node 69f699841f903fec0b0de624: baseline-arm-pengutronix 2026-05-03 00:42:45,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:45,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:45,415 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f699841f903fec0b0de624/log.txt.gz 2026-05-03 00:42:45,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:45,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:45,644 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f699841f903fec0b0de624/lava-logs.yaml 2026-05-03 00:42:45,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:42:45,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:42:45,803 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f699841f903fec0b0de624/lava_callback.json.gz 2026-05-03 00:42:45,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:45,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699841f903fec0b0de624 HTTP/1.1" 200 None 2026-05-03 00:42:45,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:45,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:42:45,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:45,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699841f903fec0b0de624 HTTP/1.1" 200 None 2026-05-03 00:42:45,971 - lava_callback - INFO - Completed processing callback for node 69f699841f903fec0b0de624 INFO: 172.20.0.1:49250 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:42:49,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:42:49,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:44088 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:43:05,143 - lava_callback - INFO - Received callback for node 69f6999c1f903fec0b0de671 INFO: 172.20.0.1:51516 - "POST /node/69f6999c1f903fec0b0de671 HTTP/1.0" 202 Accepted 2026-05-03 00:43:05,149 - lava_callback - INFO - Starting async job submit for node 69f6999c1f903fec0b0de671 2026-05-03 00:43:05,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:05,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6999c1f903fec0b0de671 HTTP/1.1" 200 None 2026-05-03 00:43:05,187 - lava_callback - DEBUG - Processing node 69f6999c1f903fec0b0de671: ltp-dio 2026-05-03 00:43:05,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:43:05,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:43:05,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69f6999c1f903fec0b0de671/log.txt.gz 2026-05-03 00:43:05,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:43:06,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:43:06,003 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69f6999c1f903fec0b0de671/lava-logs.yaml 2026-05-03 00:43:06,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:43:06,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:43:06,114 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69f6999c1f903fec0b0de671/lava_callback.json.gz 2026-05-03 00:43:06,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:06,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6999c1f903fec0b0de671 HTTP/1.1" 200 None 2026-05-03 00:43:06,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:06,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:43:06,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:06,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6999c1f903fec0b0de671 HTTP/1.1" 200 None 2026-05-03 00:43:06,204 - lava_callback - INFO - Completed processing callback for node 69f6999c1f903fec0b0de671 INFO: 172.20.0.1:51518 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:43:08,791 - lava_callback - INFO - Received callback for node 69f3f7172fa6ff8e8ca92df4 INFO: 172.20.0.1:51526 - "POST /node/69f3f7172fa6ff8e8ca92df4 HTTP/1.0" 202 Accepted 2026-05-03 00:43:08,796 - lava_callback - INFO - Starting async job submit for node 69f3f7172fa6ff8e8ca92df4 2026-05-03 00:43:08,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:08,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f7172fa6ff8e8ca92df4 HTTP/1.1" 200 None 2026-05-03 00:43:08,811 - lava_callback - DEBUG - Processing node 69f3f7172fa6ff8e8ca92df4: baseline-arm-baylibre 2026-05-03 00:43:08,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f7172fa6ff8e8ca92df4 2026-05-03 00:43:08,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:08,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f7172fa6ff8e8ca92df4 HTTP/1.1" 200 None 2026-05-03 00:43:08,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:08,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:43:08,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:08,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f7172fa6ff8e8ca92df4 HTTP/1.1" 200 None 2026-05-03 00:43:08,872 - lava_callback - ERROR - Error processing callback for node 69f3f7172fa6ff8e8ca92df4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47498 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:43:19,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:19,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50822 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:43:48,965 - lava_callback - INFO - Received callback for node 69f3f73b2fa6ff8e8ca92e02 INFO: 172.20.0.1:50826 - "POST /node/69f3f73b2fa6ff8e8ca92e02 HTTP/1.0" 202 Accepted 2026-05-03 00:43:48,970 - lava_callback - INFO - Starting async job submit for node 69f3f73b2fa6ff8e8ca92e02 2026-05-03 00:43:48,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:48,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f73b2fa6ff8e8ca92e02 HTTP/1.1" 200 None 2026-05-03 00:43:48,986 - lava_callback - DEBUG - Processing node 69f3f73b2fa6ff8e8ca92e02: baseline-arm-baylibre 2026-05-03 00:43:48,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f73b2fa6ff8e8ca92e02 2026-05-03 00:43:48,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:48,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f73b2fa6ff8e8ca92e02 HTTP/1.1" 200 None 2026-05-03 00:43:49,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:49,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:43:49,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:43:49,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f73b2fa6ff8e8ca92e02 HTTP/1.1" 200 None 2026-05-03 00:43:49,038 - lava_callback - ERROR - Error processing callback for node 69f3f73b2fa6ff8e8ca92e02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45110 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:44:20,112 - lava_callback - INFO - Received callback for node 69f3f7612fa6ff8e8ca92e11 INFO: 172.20.0.1:53922 - "POST /node/69f3f7612fa6ff8e8ca92e11 HTTP/1.0" 202 Accepted 2026-05-03 00:44:20,118 - lava_callback - INFO - Starting async job submit for node 69f3f7612fa6ff8e8ca92e11 2026-05-03 00:44:20,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:20,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f7612fa6ff8e8ca92e11 HTTP/1.1" 200 None 2026-05-03 00:44:20,164 - lava_callback - DEBUG - Processing node 69f3f7612fa6ff8e8ca92e11: baseline-arm-clabbe 2026-05-03 00:44:20,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f7612fa6ff8e8ca92e11 2026-05-03 00:44:20,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:20,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f7612fa6ff8e8ca92e11 HTTP/1.1" 200 None 2026-05-03 00:44:20,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:20,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:44:20,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:20,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f7612fa6ff8e8ca92e11 HTTP/1.1" 200 None 2026-05-03 00:44:20,213 - lava_callback - ERROR - Error processing callback for node 69f3f7612fa6ff8e8ca92e11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-03 00:44:20,687 - lava_callback - INFO - Received callback for node 69f69a4a1f903fec0b0de76a INFO: 172.20.0.1:53928 - "POST /node/69f69a4a1f903fec0b0de76a HTTP/1.0" 202 Accepted 2026-05-03 00:44:20,694 - lava_callback - INFO - Starting async job submit for node 69f69a4a1f903fec0b0de76a 2026-05-03 00:44:20,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:20,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69a4a1f903fec0b0de76a HTTP/1.1" 200 None 2026-05-03 00:44:20,728 - lava_callback - DEBUG - Processing node 69f69a4a1f903fec0b0de76a: baseline-x86 2026-05-03 00:44:20,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:44:21,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:44:21,275 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a4a1f903fec0b0de76a/log.txt.gz 2026-05-03 00:44:21,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:44:21,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:44:21,580 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a4a1f903fec0b0de76a/lava-logs.yaml 2026-05-03 00:44:21,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:44:21,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:44:21,725 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a4a1f903fec0b0de76a/lava_callback.json.gz 2026-05-03 00:44:21,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:21,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69a4a1f903fec0b0de76a HTTP/1.1" 200 None 2026-05-03 00:44:21,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:21,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f694501f903fec0b0dbca0 HTTP/1.1" 200 None 2026-05-03 00:44:21,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:21,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69a4a1f903fec0b0de76a HTTP/1.1" 200 None 2026-05-03 00:44:21,834 - lava_callback - INFO - Completed processing callback for node 69f69a4a1f903fec0b0de76a INFO: 172.20.0.1:53934 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:44:27,764 - lava_callback - INFO - Received callback for node 69f69a481f903fec0b0de761 INFO: 172.20.0.1:53942 - "POST /node/69f69a481f903fec0b0de761 HTTP/1.0" 202 Accepted 2026-05-03 00:44:27,772 - lava_callback - INFO - Starting async job submit for node 69f69a481f903fec0b0de761 2026-05-03 00:44:27,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:27,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69a481f903fec0b0de761 HTTP/1.1" 200 None 2026-05-03 00:44:27,830 - lava_callback - DEBUG - Processing node 69f69a481f903fec0b0de761: baseline-x86 2026-05-03 00:44:28,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:44:28,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:44:28,160 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a481f903fec0b0de761/log.txt.gz 2026-05-03 00:44:28,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:44:28,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:44:28,467 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a481f903fec0b0de761/lava-logs.yaml 2026-05-03 00:44:28,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:44:28,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:44:28,575 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a481f903fec0b0de761/lava_callback.json.gz 2026-05-03 00:44:28,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:28,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69a481f903fec0b0de761 HTTP/1.1" 200 None 2026-05-03 00:44:28,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:28,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f694501f903fec0b0dbca0 HTTP/1.1" 200 None 2026-05-03 00:44:28,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:28,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69a481f903fec0b0de761 HTTP/1.1" 200 None 2026-05-03 00:44:28,664 - lava_callback - INFO - Completed processing callback for node 69f69a481f903fec0b0de761 INFO: 172.20.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60384 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:44:49,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:44:49,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46064 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:45:00,099 - lava_callback - INFO - Received callback for node 69f3f7862fa6ff8e8ca92e24 INFO: 172.20.0.1:39076 - "POST /node/69f3f7862fa6ff8e8ca92e24 HTTP/1.0" 202 Accepted 2026-05-03 00:45:00,105 - lava_callback - INFO - Starting async job submit for node 69f3f7862fa6ff8e8ca92e24 2026-05-03 00:45:00,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:00,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f7862fa6ff8e8ca92e24 HTTP/1.1" 200 None 2026-05-03 00:45:00,131 - lava_callback - DEBUG - Processing node 69f3f7862fa6ff8e8ca92e24: baseline-arm-clabbe 2026-05-03 00:45:00,131 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f7862fa6ff8e8ca92e24 2026-05-03 00:45:00,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:00,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f7862fa6ff8e8ca92e24 HTTP/1.1" 200 None 2026-05-03 00:45:00,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:00,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:45:00,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:00,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f7862fa6ff8e8ca92e24 HTTP/1.1" 200 None 2026-05-03 00:45:00,228 - lava_callback - ERROR - Error processing callback for node 69f3f7862fa6ff8e8ca92e24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-03 00:45:04,343 - lava_callback - INFO - Received callback for node 69f699981f903fec0b0de66b INFO: 172.20.0.1:39090 - "POST /node/69f699981f903fec0b0de66b HTTP/1.0" 202 Accepted 2026-05-03 00:45:04,351 - lava_callback - INFO - Starting async job submit for node 69f699981f903fec0b0de66b 2026-05-03 00:45:04,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:04,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699981f903fec0b0de66b HTTP/1.1" 200 None 2026-05-03 00:45:04,401 - lava_callback - DEBUG - Processing node 69f699981f903fec0b0de66b: ltp-controllers 2026-05-03 00:45:04,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:05,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:05,102 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69f699981f903fec0b0de66b/log.txt.gz 2026-05-03 00:45:05,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:05,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:05,539 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69f699981f903fec0b0de66b/lava-logs.yaml 2026-05-03 00:45:05,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:05,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:05,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69f699981f903fec0b0de66b/lava_callback.json.gz 2026-05-03 00:45:05,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:05,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699981f903fec0b0de66b HTTP/1.1" 200 None 2026-05-03 00:45:05,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:05,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:45:05,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:05,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699981f903fec0b0de66b HTTP/1.1" 200 None 2026-05-03 00:45:05,755 - lava_callback - INFO - Completed processing callback for node 69f699981f903fec0b0de66b 2026-05-03 00:45:05,958 - lava_callback - INFO - Received callback for node 69f699a71f903fec0b0de689 INFO: 172.20.0.1:39100 - "POST /node/69f699a71f903fec0b0de689 HTTP/1.0" 202 Accepted 2026-05-03 00:45:05,970 - lava_callback - INFO - Starting async job submit for node 69f699a71f903fec0b0de689 2026-05-03 00:45:06,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:06,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a71f903fec0b0de689 HTTP/1.1" 200 None 2026-05-03 00:45:06,019 - lava_callback - DEBUG - Processing node 69f699a71f903fec0b0de689: ltp-syscalls INFO: 172.20.0.1:39116 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:45:06,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:07,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:07,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69f699a71f903fec0b0de689/log.txt.gz 2026-05-03 00:45:07,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:07,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:07,790 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69f699a71f903fec0b0de689/lava-logs.yaml 2026-05-03 00:45:07,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:07,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:07,950 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69f699a71f903fec0b0de689/lava_callback.json.gz 2026-05-03 00:45:07,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:08,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a71f903fec0b0de689 HTTP/1.1" 200 None 2026-05-03 00:45:08,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:08,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:45:08,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:08,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699a71f903fec0b0de689 HTTP/1.1" 200 None 2026-05-03 00:45:08,070 - lava_callback - INFO - Completed processing callback for node 69f699a71f903fec0b0de689 INFO: 172.20.0.1:33672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33682 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:45:18,284 - lava_callback - INFO - Received callback for node 69f699961f903fec0b0de640 INFO: 172.20.0.1:33692 - "POST /node/69f699961f903fec0b0de640 HTTP/1.0" 202 Accepted 2026-05-03 00:45:18,296 - lava_callback - INFO - Starting async job submit for node 69f699961f903fec0b0de640 2026-05-03 00:45:18,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:18,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699961f903fec0b0de640 HTTP/1.1" 200 None 2026-05-03 00:45:18,351 - lava_callback - DEBUG - Processing node 69f699961f903fec0b0de640: ltp-cap_bounds 2026-05-03 00:45:18,533 - lava_callback - INFO - Received callback for node 69f69a481f903fec0b0de764 INFO: 172.20.0.1:33702 - "POST /node/69f69a481f903fec0b0de764 HTTP/1.0" 202 Accepted 2026-05-03 00:45:18,550 - lava_callback - INFO - Starting async job submit for node 69f69a481f903fec0b0de764 2026-05-03 00:45:18,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:18,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69a481f903fec0b0de764 HTTP/1.1" 200 None 2026-05-03 00:45:18,716 - lava_callback - DEBUG - Processing node 69f69a481f903fec0b0de764: baseline-x86 2026-05-03 00:45:18,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:19,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:19,185 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69f699961f903fec0b0de640/log.txt.gz 2026-05-03 00:45:19,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:19,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:19,450 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a481f903fec0b0de764/log.txt.gz 2026-05-03 00:45:19,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:19,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:19,692 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69f699961f903fec0b0de640/lava-logs.yaml 2026-05-03 00:45:19,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:19,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:19,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:19,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 00:45:19,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:19,828 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69f699961f903fec0b0de640/lava_callback.json.gz 2026-05-03 00:45:19,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:19,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:19,868 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a481f903fec0b0de764/lava-logs.yaml 2026-05-03 00:45:19,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:19,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699961f903fec0b0de640 HTTP/1.1" 200 None 2026-05-03 00:45:19,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:19,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:45:19,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:19,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699961f903fec0b0de640 HTTP/1.1" 200 None 2026-05-03 00:45:19,952 - lava_callback - INFO - Completed processing callback for node 69f699961f903fec0b0de640 2026-05-03 00:45:20,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:20,007 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a481f903fec0b0de764/lava_callback.json.gz 2026-05-03 00:45:20,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:20,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69a481f903fec0b0de764 HTTP/1.1" 200 None 2026-05-03 00:45:20,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:20,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f694501f903fec0b0dbca0 HTTP/1.1" 200 None 2026-05-03 00:45:20,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:20,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69a481f903fec0b0de764 HTTP/1.1" 200 None 2026-05-03 00:45:20,167 - lava_callback - INFO - Completed processing callback for node 69f69a481f903fec0b0de764 2026-05-03 00:45:20,474 - lava_callback - INFO - Received callback for node 69f69a491f903fec0b0de767 INFO: 172.20.0.1:45590 - "POST /node/69f69a491f903fec0b0de767 HTTP/1.0" 202 Accepted 2026-05-03 00:45:20,484 - lava_callback - INFO - Starting async job submit for node 69f69a491f903fec0b0de767 2026-05-03 00:45:20,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:20,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69a491f903fec0b0de767 HTTP/1.1" 200 None 2026-05-03 00:45:20,521 - lava_callback - DEBUG - Processing node 69f69a491f903fec0b0de767: baseline-x86 2026-05-03 00:45:20,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:21,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:21,049 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a491f903fec0b0de767/log.txt.gz 2026-05-03 00:45:21,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:21,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:21,415 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a491f903fec0b0de767/lava-logs.yaml 2026-05-03 00:45:21,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:21,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:21,510 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a491f903fec0b0de767/lava_callback.json.gz 2026-05-03 00:45:21,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:21,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69a491f903fec0b0de767 HTTP/1.1" 200 None 2026-05-03 00:45:21,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:21,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f694501f903fec0b0dbca0 HTTP/1.1" 200 None 2026-05-03 00:45:21,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:21,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69a491f903fec0b0de767 HTTP/1.1" 200 None 2026-05-03 00:45:21,619 - lava_callback - INFO - Completed processing callback for node 69f69a491f903fec0b0de767 INFO: 172.20.0.1:45600 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:45:27,712 - lava_callback - INFO - Received callback for node 69f69a4b1f903fec0b0de76e INFO: 172.20.0.1:45610 - "POST /node/69f69a4b1f903fec0b0de76e HTTP/1.0" 202 Accepted 2026-05-03 00:45:27,718 - lava_callback - INFO - Starting async job submit for node 69f69a4b1f903fec0b0de76e 2026-05-03 00:45:27,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:27,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69a4b1f903fec0b0de76e HTTP/1.1" 200 None 2026-05-03 00:45:27,750 - lava_callback - DEBUG - Processing node 69f69a4b1f903fec0b0de76e: baseline-x86 2026-05-03 00:45:28,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:28,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:28,418 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a4b1f903fec0b0de76e/log.txt.gz 2026-05-03 00:45:28,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:28,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:28,787 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a4b1f903fec0b0de76e/lava-logs.yaml 2026-05-03 00:45:28,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:29,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:29,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f69a4b1f903fec0b0de76e/lava_callback.json.gz 2026-05-03 00:45:29,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:29,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69a4b1f903fec0b0de76e HTTP/1.1" 200 None 2026-05-03 00:45:29,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:29,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f694501f903fec0b0dbca0 HTTP/1.1" 200 None 2026-05-03 00:45:29,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:29,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69a4b1f903fec0b0de76e HTTP/1.1" 200 None 2026-05-03 00:45:29,149 - lava_callback - INFO - Completed processing callback for node 69f69a4b1f903fec0b0de76e INFO: 172.20.0.1:44924 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:45:40,169 - lava_callback - INFO - Received callback for node 69f3f7ab2fa6ff8e8ca92e3b INFO: 172.20.0.1:43536 - "POST /node/69f3f7ab2fa6ff8e8ca92e3b HTTP/1.0" 202 Accepted 2026-05-03 00:45:40,175 - lava_callback - INFO - Starting async job submit for node 69f3f7ab2fa6ff8e8ca92e3b 2026-05-03 00:45:40,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:40,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f7ab2fa6ff8e8ca92e3b HTTP/1.1" 200 None 2026-05-03 00:45:40,190 - lava_callback - DEBUG - Processing node 69f3f7ab2fa6ff8e8ca92e3b: baseline-arm-clabbe 2026-05-03 00:45:40,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f7ab2fa6ff8e8ca92e3b 2026-05-03 00:45:40,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:40,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f7ab2fa6ff8e8ca92e3b HTTP/1.1" 200 None 2026-05-03 00:45:40,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:40,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:45:40,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:40,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f7ab2fa6ff8e8ca92e3b HTTP/1.1" 200 None 2026-05-03 00:45:40,291 - lava_callback - ERROR - Error processing callback for node 69f3f7ab2fa6ff8e8ca92e3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43550 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:45:44,703 - lava_callback - INFO - Received callback for node 69f699971f903fec0b0de644 INFO: 172.20.0.1:43558 - "POST /node/69f699971f903fec0b0de644 HTTP/1.0" 202 Accepted 2026-05-03 00:45:44,711 - lava_callback - INFO - Starting async job submit for node 69f699971f903fec0b0de644 2026-05-03 00:45:44,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:44,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699971f903fec0b0de644 HTTP/1.1" 200 None 2026-05-03 00:45:44,749 - lava_callback - DEBUG - Processing node 69f699971f903fec0b0de644: ltp-containers 2026-05-03 00:45:45,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:45,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:45,230 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69f699971f903fec0b0de644/log.txt.gz 2026-05-03 00:45:45,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:45,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:45,604 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69f699971f903fec0b0de644/lava-logs.yaml 2026-05-03 00:45:45,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:45:45,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:45:45,740 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69f699971f903fec0b0de644/lava_callback.json.gz 2026-05-03 00:45:45,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:45,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699971f903fec0b0de644 HTTP/1.1" 200 None 2026-05-03 00:45:45,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:45,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:45:45,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:45,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699971f903fec0b0de644 HTTP/1.1" 200 None 2026-05-03 00:45:45,840 - lava_callback - INFO - Completed processing callback for node 69f699971f903fec0b0de644 INFO: 172.20.0.1:43574 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:45:49,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:45:49,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55860 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:46:20,184 - lava_callback - INFO - Received callback for node 69f3f7cf2fa6ff8e8ca92e47 INFO: 172.20.0.1:46458 - "POST /node/69f3f7cf2fa6ff8e8ca92e47 HTTP/1.0" 202 Accepted 2026-05-03 00:46:20,189 - lava_callback - INFO - Starting async job submit for node 69f3f7cf2fa6ff8e8ca92e47 2026-05-03 00:46:20,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:46:20,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f7cf2fa6ff8e8ca92e47 HTTP/1.1" 200 None 2026-05-03 00:46:20,204 - lava_callback - DEBUG - Processing node 69f3f7cf2fa6ff8e8ca92e47: baseline-arm-clabbe 2026-05-03 00:46:20,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f7cf2fa6ff8e8ca92e47 2026-05-03 00:46:20,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:46:20,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f7cf2fa6ff8e8ca92e47 HTTP/1.1" 200 None 2026-05-03 00:46:20,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:46:20,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:46:20,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:46:20,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f7cf2fa6ff8e8ca92e47 HTTP/1.1" 200 None 2026-05-03 00:46:20,251 - lava_callback - ERROR - Error processing callback for node 69f3f7cf2fa6ff8e8ca92e47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-03 00:46:24,320 - lava_callback - INFO - Received callback for node 69f6999d1f903fec0b0de674 INFO: 172.20.0.1:46464 - "POST /node/69f6999d1f903fec0b0de674 HTTP/1.0" 202 Accepted 2026-05-03 00:46:24,326 - lava_callback - INFO - Starting async job submit for node 69f6999d1f903fec0b0de674 2026-05-03 00:46:24,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:46:24,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6999d1f903fec0b0de674 HTTP/1.1" 200 None 2026-05-03 00:46:24,368 - lava_callback - DEBUG - Processing node 69f6999d1f903fec0b0de674: ltp-fs_bind 2026-05-03 00:46:24,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:46:24,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:46:24,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69f6999d1f903fec0b0de674/log.txt.gz 2026-05-03 00:46:25,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:46:25,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:46:25,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69f6999d1f903fec0b0de674/lava-logs.yaml 2026-05-03 00:46:25,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:46:25,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:46:25,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69f6999d1f903fec0b0de674/lava_callback.json.gz 2026-05-03 00:46:25,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:46:25,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6999d1f903fec0b0de674 HTTP/1.1" 200 None 2026-05-03 00:46:25,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:46:25,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:46:25,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:46:25,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6999d1f903fec0b0de674 HTTP/1.1" 200 None 2026-05-03 00:46:25,461 - lava_callback - INFO - Completed processing callback for node 69f6999d1f903fec0b0de674 INFO: 172.20.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41486 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:46:49,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:46:49,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49888 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:47:00,231 - lava_callback - INFO - Received callback for node 69f3f7f32fa6ff8e8ca92e57 INFO: 172.20.0.1:50326 - "POST /node/69f3f7f32fa6ff8e8ca92e57 HTTP/1.0" 202 Accepted 2026-05-03 00:47:00,237 - lava_callback - INFO - Starting async job submit for node 69f3f7f32fa6ff8e8ca92e57 2026-05-03 00:47:00,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:47:00,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f7f32fa6ff8e8ca92e57 HTTP/1.1" 200 None 2026-05-03 00:47:00,258 - lava_callback - DEBUG - Processing node 69f3f7f32fa6ff8e8ca92e57: baseline-arm-clabbe 2026-05-03 00:47:00,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f7f32fa6ff8e8ca92e57 2026-05-03 00:47:00,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:47:00,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f7f32fa6ff8e8ca92e57 HTTP/1.1" 200 None 2026-05-03 00:47:00,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:47:00,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:47:00,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:47:00,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f7f32fa6ff8e8ca92e57 HTTP/1.1" 200 None 2026-05-03 00:47:00,305 - lava_callback - ERROR - Error processing callback for node 69f3f7f32fa6ff8e8ca92e57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59150 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:47:40,237 - lava_callback - INFO - Received callback for node 69f3f8182fa6ff8e8ca92e69 INFO: 172.20.0.1:38484 - "POST /node/69f3f8182fa6ff8e8ca92e69 HTTP/1.0" 202 Accepted 2026-05-03 00:47:40,242 - lava_callback - INFO - Starting async job submit for node 69f3f8182fa6ff8e8ca92e69 2026-05-03 00:47:40,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:47:40,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f8182fa6ff8e8ca92e69 HTTP/1.1" 200 None 2026-05-03 00:47:40,257 - lava_callback - DEBUG - Processing node 69f3f8182fa6ff8e8ca92e69: baseline-arm-clabbe 2026-05-03 00:47:40,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f8182fa6ff8e8ca92e69 2026-05-03 00:47:40,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:47:40,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f8182fa6ff8e8ca92e69 HTTP/1.1" 200 None 2026-05-03 00:47:40,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:47:40,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:47:40,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:47:40,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f8182fa6ff8e8ca92e69 HTTP/1.1" 200 None 2026-05-03 00:47:40,302 - lava_callback - ERROR - Error processing callback for node 69f3f8182fa6ff8e8ca92e69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53700 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:48:07,501 - lava_callback - INFO - Received callback for node 69f69b1f1f903fec0b0de851 INFO: 172.20.0.1:53710 - "POST /node/69f69b1f1f903fec0b0de851 HTTP/1.0" 202 Accepted 2026-05-03 00:48:07,552 - lava_callback - INFO - Starting async job submit for node 69f69b1f1f903fec0b0de851 2026-05-03 00:48:07,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:07,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69b1f1f903fec0b0de851 HTTP/1.1" 200 None 2026-05-03 00:48:07,599 - lava_callback - DEBUG - Processing node 69f69b1f1f903fec0b0de851: baseline-arm 2026-05-03 00:48:07,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:48:07,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:48:07,868 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f69b1f1f903fec0b0de851/log.txt.gz 2026-05-03 00:48:07,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:48:08,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:48:08,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f69b1f1f903fec0b0de851/lava-logs.yaml 2026-05-03 00:48:08,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:48:08,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:48:08,191 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f69b1f1f903fec0b0de851/lava_callback.json.gz 2026-05-03 00:48:08,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:08,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69b1f1f903fec0b0de851 HTTP/1.1" 200 None 2026-05-03 00:48:08,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:08,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:48:08,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:08,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69b1f1f903fec0b0de851 HTTP/1.1" 200 None 2026-05-03 00:48:08,281 - lava_callback - INFO - Completed processing callback for node 69f69b1f1f903fec0b0de851 INFO: 172.20.0.1:33624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33632 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:48:19,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:19,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 00:48:20,287 - lava_callback - INFO - Received callback for node 69f3f8402fa6ff8e8ca92e80 INFO: 172.20.0.1:59832 - "POST /node/69f3f8402fa6ff8e8ca92e80 HTTP/1.0" 202 Accepted 2026-05-03 00:48:20,293 - lava_callback - INFO - Starting async job submit for node 69f3f8402fa6ff8e8ca92e80 2026-05-03 00:48:20,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:20,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f8402fa6ff8e8ca92e80 HTTP/1.1" 200 None 2026-05-03 00:48:20,310 - lava_callback - DEBUG - Processing node 69f3f8402fa6ff8e8ca92e80: baseline-arm-clabbe 2026-05-03 00:48:20,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f8402fa6ff8e8ca92e80 2026-05-03 00:48:20,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:20,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f8402fa6ff8e8ca92e80 HTTP/1.1" 200 None 2026-05-03 00:48:20,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:20,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:48:20,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:20,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f8402fa6ff8e8ca92e80 HTTP/1.1" 200 None 2026-05-03 00:48:20,363 - lava_callback - ERROR - Error processing callback for node 69f3f8402fa6ff8e8ca92e80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45274 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:48:40,269 - lava_callback - INFO - Received callback for node 69f3f8652fa6ff8e8ca92e8c INFO: 172.20.0.1:36986 - "POST /node/69f3f8652fa6ff8e8ca92e8c HTTP/1.0" 202 Accepted 2026-05-03 00:48:40,286 - lava_callback - INFO - Starting async job submit for node 69f3f8652fa6ff8e8ca92e8c 2026-05-03 00:48:40,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:40,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f8652fa6ff8e8ca92e8c HTTP/1.1" 200 None 2026-05-03 00:48:40,328 - lava_callback - DEBUG - Processing node 69f3f8652fa6ff8e8ca92e8c: baseline-arm-clabbe 2026-05-03 00:48:40,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f8652fa6ff8e8ca92e8c 2026-05-03 00:48:40,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:40,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f8652fa6ff8e8ca92e8c HTTP/1.1" 200 None 2026-05-03 00:48:40,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:40,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:48:40,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:40,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f8652fa6ff8e8ca92e8c HTTP/1.1" 200 None 2026-05-03 00:48:40,413 - lava_callback - ERROR - Error processing callback for node 69f3f8652fa6ff8e8ca92e8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37006 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:48:46,605 - lava_callback - INFO - Received callback for node 69f69b681f903fec0b0de879 INFO: 172.20.0.1:37022 - "POST /node/69f69b681f903fec0b0de879 HTTP/1.0" 202 Accepted 2026-05-03 00:48:46,615 - lava_callback - INFO - Starting async job submit for node 69f69b681f903fec0b0de879 2026-05-03 00:48:46,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:46,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69b681f903fec0b0de879 HTTP/1.1" 200 None 2026-05-03 00:48:46,643 - lava_callback - DEBUG - Processing node 69f69b681f903fec0b0de879: baseline-arm 2026-05-03 00:48:46,651 - lava_callback - WARNING - Failed to upload log 2026-05-03 00:48:46,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:48:46,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:48:46,787 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f69b681f903fec0b0de879/lava-logs.yaml 2026-05-03 00:48:46,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:48:46,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:48:46,888 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f69b681f903fec0b0de879/lava_callback.json.gz 2026-05-03 00:48:46,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:46,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69b681f903fec0b0de879 HTTP/1.1" 200 None 2026-05-03 00:48:46,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:46,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:48:46,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:46,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69b681f903fec0b0de879 HTTP/1.1" 200 None 2026-05-03 00:48:46,993 - lava_callback - INFO - Completed processing callback for node 69f69b681f903fec0b0de879 2026-05-03 00:48:49,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:48:49,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51678 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:49:18,237 - lava_callback - INFO - Received callback for node 69f699a01f903fec0b0de67a INFO: 172.20.0.1:51690 - "POST /node/69f699a01f903fec0b0de67a HTTP/1.0" 202 Accepted 2026-05-03 00:49:18,249 - lava_callback - INFO - Starting async job submit for node 69f699a01f903fec0b0de67a 2026-05-03 00:49:18,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:49:18,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a01f903fec0b0de67a HTTP/1.1" 200 None 2026-05-03 00:49:18,321 - lava_callback - DEBUG - Processing node 69f699a01f903fec0b0de67a: ltp-input 2026-05-03 00:49:18,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:49:19,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:49:19,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69f699a01f903fec0b0de67a/log.txt.gz 2026-05-03 00:49:19,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:49:19,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:49:19,716 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69f699a01f903fec0b0de67a/lava-logs.yaml 2026-05-03 00:49:19,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:49:19,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:49:19,953 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69f699a01f903fec0b0de67a/lava_callback.json.gz 2026-05-03 00:49:19,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:49:20,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a01f903fec0b0de67a HTTP/1.1" 200 None 2026-05-03 00:49:20,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:49:20,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:49:20,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:49:20,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699a01f903fec0b0de67a HTTP/1.1" 200 None 2026-05-03 00:49:20,113 - lava_callback - INFO - Completed processing callback for node 69f699a01f903fec0b0de67a 2026-05-03 00:49:20,359 - lava_callback - INFO - Received callback for node 69f3f88a2fa6ff8e8ca92e9d INFO: 172.20.0.1:49328 - "POST /node/69f3f88a2fa6ff8e8ca92e9d HTTP/1.0" 202 Accepted 2026-05-03 00:49:20,369 - lava_callback - INFO - Starting async job submit for node 69f3f88a2fa6ff8e8ca92e9d 2026-05-03 00:49:20,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:49:20,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f88a2fa6ff8e8ca92e9d HTTP/1.1" 200 None 2026-05-03 00:49:20,399 - lava_callback - DEBUG - Processing node 69f3f88a2fa6ff8e8ca92e9d: baseline-arm-clabbe 2026-05-03 00:49:20,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f88a2fa6ff8e8ca92e9d 2026-05-03 00:49:20,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:49:20,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f88a2fa6ff8e8ca92e9d HTTP/1.1" 200 None 2026-05-03 00:49:20,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:49:20,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 00:49:20,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:49:20,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f88a2fa6ff8e8ca92e9d HTTP/1.1" 200 None 2026-05-03 00:49:20,517 - lava_callback - ERROR - Error processing callback for node 69f3f88a2fa6ff8e8ca92e9d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32776 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:49:49,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:49:49,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37680 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:50:09,314 - lava_callback - INFO - Received callback for node 69f3f8b62fa6ff8e8ca92eb5 INFO: 172.20.0.1:37682 - "POST /node/69f3f8b62fa6ff8e8ca92eb5 HTTP/1.0" 202 Accepted 2026-05-03 00:50:09,319 - lava_callback - INFO - Starting async job submit for node 69f3f8b62fa6ff8e8ca92eb5 2026-05-03 00:50:09,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:09,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f8b62fa6ff8e8ca92eb5 HTTP/1.1" 200 None 2026-05-03 00:50:09,336 - lava_callback - DEBUG - Processing node 69f3f8b62fa6ff8e8ca92eb5: baseline-arm64-baylibre 2026-05-03 00:50:09,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f8b62fa6ff8e8ca92eb5 2026-05-03 00:50:09,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:09,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f8b62fa6ff8e8ca92eb5 HTTP/1.1" 200 None 2026-05-03 00:50:09,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:09,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 00:50:09,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:09,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f8b62fa6ff8e8ca92eb5 HTTP/1.1" 200 None 2026-05-03 00:50:09,391 - lava_callback - ERROR - Error processing callback for node 69f3f8b62fa6ff8e8ca92eb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45124 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:50:24,477 - lava_callback - INFO - Received callback for node 69f699a21f903fec0b0de67d INFO: 172.20.0.1:40844 - "POST /node/69f699a21f903fec0b0de67d HTTP/1.0" 202 Accepted 2026-05-03 00:50:24,483 - lava_callback - INFO - Starting async job submit for node 69f699a21f903fec0b0de67d 2026-05-03 00:50:24,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:24,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a21f903fec0b0de67d HTTP/1.1" 200 None 2026-05-03 00:50:24,522 - lava_callback - DEBUG - Processing node 69f699a21f903fec0b0de67d: ltp-ipc 2026-05-03 00:50:24,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:50:25,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:50:25,039 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69f699a21f903fec0b0de67d/log.txt.gz 2026-05-03 00:50:25,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:50:25,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:50:25,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69f699a21f903fec0b0de67d/lava-logs.yaml 2026-05-03 00:50:25,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:50:25,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:50:25,593 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69f699a21f903fec0b0de67d/lava_callback.json.gz 2026-05-03 00:50:25,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:25,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a21f903fec0b0de67d HTTP/1.1" 200 None 2026-05-03 00:50:25,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:25,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:50:25,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:25,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699a21f903fec0b0de67d HTTP/1.1" 200 None 2026-05-03 00:50:25,677 - lava_callback - INFO - Completed processing callback for node 69f699a21f903fec0b0de67d 2026-05-03 00:50:26,083 - lava_callback - INFO - Received callback for node 69f699a31f903fec0b0de680 INFO: 172.20.0.1:40852 - "POST /node/69f699a31f903fec0b0de680 HTTP/1.0" 202 Accepted 2026-05-03 00:50:26,090 - lava_callback - INFO - Starting async job submit for node 69f699a31f903fec0b0de680 2026-05-03 00:50:26,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:26,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a31f903fec0b0de680 HTTP/1.1" 200 None 2026-05-03 00:50:26,134 - lava_callback - DEBUG - Processing node 69f699a31f903fec0b0de680: ltp-pty 2026-05-03 00:50:26,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:40862 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:50:26,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:50:26,734 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69f699a31f903fec0b0de680/log.txt.gz 2026-05-03 00:50:26,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:50:27,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:50:27,093 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69f699a31f903fec0b0de680/lava-logs.yaml 2026-05-03 00:50:27,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:50:27,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:50:27,220 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69f699a31f903fec0b0de680/lava_callback.json.gz 2026-05-03 00:50:27,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:27,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a31f903fec0b0de680 HTTP/1.1" 200 None 2026-05-03 00:50:27,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:27,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:50:27,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:27,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699a31f903fec0b0de680 HTTP/1.1" 200 None 2026-05-03 00:50:27,308 - lava_callback - INFO - Completed processing callback for node 69f699a31f903fec0b0de680 INFO: 172.20.0.1:49150 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:50:39,122 - lava_callback - INFO - Received callback for node 69f69b1d1f903fec0b0de848 INFO: 172.20.0.1:49162 - "POST /node/69f69b1d1f903fec0b0de848 HTTP/1.0" 202 Accepted 2026-05-03 00:50:39,128 - lava_callback - INFO - Starting async job submit for node 69f69b1d1f903fec0b0de848 2026-05-03 00:50:39,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:39,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69b1d1f903fec0b0de848 HTTP/1.1" 200 None 2026-05-03 00:50:39,159 - lava_callback - DEBUG - Processing node 69f69b1d1f903fec0b0de848: baseline-arm 2026-05-03 00:50:39,200 - lava_callback - WARNING - Failed to upload log 2026-05-03 00:50:39,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:50:39,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:50:39,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f69b1d1f903fec0b0de848/lava-logs.yaml 2026-05-03 00:50:39,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:50:39,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:50:39,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f69b1d1f903fec0b0de848/lava_callback.json.gz 2026-05-03 00:50:39,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:39,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69b1d1f903fec0b0de848 HTTP/1.1" 200 None 2026-05-03 00:50:39,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:39,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:50:39,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:39,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69b1d1f903fec0b0de848 HTTP/1.1" 200 None 2026-05-03 00:50:39,512 - lava_callback - INFO - Completed processing callback for node 69f69b1d1f903fec0b0de848 INFO: 172.20.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43302 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:50:49,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:50:49,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52386 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:51:40,454 - lava_callback - INFO - Received callback for node 69f3f9092fa6ff8e8ca92ed5 INFO: 172.20.0.1:50640 - "POST /node/69f3f9092fa6ff8e8ca92ed5 HTTP/1.0" 202 Accepted 2026-05-03 00:51:40,460 - lava_callback - INFO - Starting async job submit for node 69f3f9092fa6ff8e8ca92ed5 2026-05-03 00:51:40,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:51:40,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f9092fa6ff8e8ca92ed5 HTTP/1.1" 200 None 2026-05-03 00:51:40,474 - lava_callback - DEBUG - Processing node 69f3f9092fa6ff8e8ca92ed5: baseline-arm64-clabbe 2026-05-03 00:51:40,474 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f9092fa6ff8e8ca92ed5 2026-05-03 00:51:40,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:51:40,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f9092fa6ff8e8ca92ed5 HTTP/1.1" 200 None 2026-05-03 00:51:40,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:51:40,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 00:51:40,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:51:40,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f9092fa6ff8e8ca92ed5 HTTP/1.1" 200 None 2026-05-03 00:51:40,529 - lava_callback - ERROR - Error processing callback for node 69f3f9092fa6ff8e8ca92ed5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41854 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:52:40,471 - lava_callback - INFO - Received callback for node 69f3f9552fa6ff8e8ca92f16 INFO: 172.20.0.1:33660 - "POST /node/69f3f9552fa6ff8e8ca92f16 HTTP/1.0" 202 Accepted 2026-05-03 00:52:40,478 - lava_callback - INFO - Starting async job submit for node 69f3f9552fa6ff8e8ca92f16 2026-05-03 00:52:40,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:52:40,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f9552fa6ff8e8ca92f16 HTTP/1.1" 200 None 2026-05-03 00:52:40,496 - lava_callback - DEBUG - Processing node 69f3f9552fa6ff8e8ca92f16: baseline-arm64-clabbe 2026-05-03 00:52:40,497 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f9552fa6ff8e8ca92f16 2026-05-03 00:52:40,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:52:40,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f9552fa6ff8e8ca92f16 HTTP/1.1" 200 None 2026-05-03 00:52:40,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:52:40,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 00:52:40,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:52:40,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f9552fa6ff8e8ca92f16 HTTP/1.1" 200 None 2026-05-03 00:52:40,611 - lava_callback - ERROR - Error processing callback for node 69f3f9552fa6ff8e8ca92f16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33676 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:52:49,536 - lava_callback - INFO - Received callback for node 69f69c471f903fec0b0de91a INFO: 172.20.0.1:33688 - "POST /node/69f69c471f903fec0b0de91a HTTP/1.0" 202 Accepted 2026-05-03 00:52:49,543 - lava_callback - INFO - Starting async job submit for node 69f69c471f903fec0b0de91a 2026-05-03 00:52:49,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:52:49,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c471f903fec0b0de91a HTTP/1.1" 200 None 2026-05-03 00:52:49,581 - lava_callback - DEBUG - Processing node 69f69c471f903fec0b0de91a: baseline-arm64 2026-05-03 00:52:49,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:52:49,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:52:49,848 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c471f903fec0b0de91a/log.txt.gz 2026-05-03 00:52:50,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:52:50,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:52:50,195 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c471f903fec0b0de91a/lava-logs.yaml 2026-05-03 00:52:50,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:52:50,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:52:50,308 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c471f903fec0b0de91a/lava_callback.json.gz 2026-05-03 00:52:50,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:52:50,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c471f903fec0b0de91a HTTP/1.1" 200 None 2026-05-03 00:52:50,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:52:50,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:52:50,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:52:50,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c471f903fec0b0de91a HTTP/1.1" 200 None 2026-05-03 00:52:50,393 - lava_callback - INFO - Completed processing callback for node 69f69c471f903fec0b0de91a INFO: 172.20.0.1:55010 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:53:03,339 - lava_callback - INFO - Received callback for node 69f69c521f903fec0b0de94e INFO: 172.20.0.1:40150 - "POST /node/69f69c521f903fec0b0de94e HTTP/1.0" 202 Accepted 2026-05-03 00:53:03,346 - lava_callback - INFO - Starting async job submit for node 69f69c521f903fec0b0de94e 2026-05-03 00:53:03,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:03,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c521f903fec0b0de94e HTTP/1.1" 200 None 2026-05-03 00:53:03,399 - lava_callback - DEBUG - Processing node 69f69c521f903fec0b0de94e: baseline-arm64 2026-05-03 00:53:03,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:03,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:03,651 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c521f903fec0b0de94e/log.txt.gz 2026-05-03 00:53:03,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:03,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:03,963 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c521f903fec0b0de94e/lava-logs.yaml 2026-05-03 00:53:03,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:04,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:04,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c521f903fec0b0de94e/lava_callback.json.gz 2026-05-03 00:53:04,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:04,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c521f903fec0b0de94e HTTP/1.1" 200 None 2026-05-03 00:53:04,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:04,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:04,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:04,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c521f903fec0b0de94e HTTP/1.1" 200 None 2026-05-03 00:53:04,134 - lava_callback - INFO - Completed processing callback for node 69f69c521f903fec0b0de94e INFO: 172.20.0.1:40154 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:53:09,270 - lava_callback - INFO - Received callback for node 69f69c5f1f903fec0b0de974 INFO: 172.20.0.1:40164 - "POST /node/69f69c5f1f903fec0b0de974 HTTP/1.0" 202 Accepted 2026-05-03 00:53:09,276 - lava_callback - INFO - Starting async job submit for node 69f69c5f1f903fec0b0de974 2026-05-03 00:53:09,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:09,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c5f1f903fec0b0de974 HTTP/1.1" 200 None 2026-05-03 00:53:09,294 - lava_callback - DEBUG - Processing node 69f69c5f1f903fec0b0de974: baseline-nfs-arm64 2026-05-03 00:53:09,296 - lava_callback - WARNING - Failed to upload log 2026-05-03 00:53:09,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:09,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:09,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5f1f903fec0b0de974/lava-logs.yaml 2026-05-03 00:53:09,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:09,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:09,539 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5f1f903fec0b0de974/lava_callback.json.gz 2026-05-03 00:53:09,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:09,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c5f1f903fec0b0de974 HTTP/1.1" 200 None 2026-05-03 00:53:09,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:09,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:09,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:09,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c5f1f903fec0b0de974 HTTP/1.1" 200 None 2026-05-03 00:53:09,613 - lava_callback - INFO - Completed processing callback for node 69f69c5f1f903fec0b0de974 INFO: 172.20.0.1:60894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60904 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:53:19,025 - lava_callback - INFO - Received callback for node 69f699a41f903fec0b0de683 INFO: 172.20.0.1:60918 - "POST /node/69f699a41f903fec0b0de683 HTTP/1.0" 202 Accepted 2026-05-03 00:53:19,032 - lava_callback - INFO - Starting async job submit for node 69f699a41f903fec0b0de683 2026-05-03 00:53:19,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:19,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a41f903fec0b0de683 HTTP/1.1" 200 None 2026-05-03 00:53:19,076 - lava_callback - DEBUG - Processing node 69f699a41f903fec0b0de683: ltp-sched 2026-05-03 00:53:19,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:19,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:19,638 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69f699a41f903fec0b0de683/log.txt.gz 2026-05-03 00:53:19,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:19,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:19,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 00:53:20,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:20,063 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69f699a41f903fec0b0de683/lava-logs.yaml 2026-05-03 00:53:20,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:20,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:20,202 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69f699a41f903fec0b0de683/lava_callback.json.gz 2026-05-03 00:53:20,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:20,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a41f903fec0b0de683 HTTP/1.1" 200 None 2026-05-03 00:53:20,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:20,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:53:20,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:20,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699a41f903fec0b0de683 HTTP/1.1" 200 None 2026-05-03 00:53:20,299 - lava_callback - INFO - Completed processing callback for node 69f699a41f903fec0b0de683 INFO: 172.20.0.1:48860 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:53:29,602 - lava_callback - INFO - Received callback for node 69f69c4f1f903fec0b0de941 INFO: 172.20.0.1:48862 - "POST /node/69f69c4f1f903fec0b0de941 HTTP/1.0" 202 Accepted 2026-05-03 00:53:29,609 - lava_callback - INFO - Starting async job submit for node 69f69c4f1f903fec0b0de941 2026-05-03 00:53:29,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:29,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c4f1f903fec0b0de941 HTTP/1.1" 200 None 2026-05-03 00:53:29,660 - lava_callback - DEBUG - Processing node 69f69c4f1f903fec0b0de941: baseline-arm64 2026-05-03 00:53:30,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:30,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:30,239 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4f1f903fec0b0de941/log.txt.gz 2026-05-03 00:53:30,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:30,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:30,678 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4f1f903fec0b0de941/lava-logs.yaml 2026-05-03 00:53:30,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:30,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:30,818 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4f1f903fec0b0de941/lava_callback.json.gz 2026-05-03 00:53:30,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:30,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c4f1f903fec0b0de941 HTTP/1.1" 200 None 2026-05-03 00:53:30,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:30,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:30,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:30,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c4f1f903fec0b0de941 HTTP/1.1" 200 None 2026-05-03 00:53:30,913 - lava_callback - INFO - Completed processing callback for node 69f69c4f1f903fec0b0de941 2026-05-03 00:53:35,899 - lava_callback - INFO - Received callback for node 69f69c501f903fec0b0de944 INFO: 172.20.0.1:59210 - "POST /node/69f69c501f903fec0b0de944 HTTP/1.0" 202 Accepted 2026-05-03 00:53:35,910 - lava_callback - INFO - Starting async job submit for node 69f69c501f903fec0b0de944 2026-05-03 00:53:35,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:35,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c501f903fec0b0de944 HTTP/1.1" 200 None 2026-05-03 00:53:35,958 - lava_callback - DEBUG - Processing node 69f69c501f903fec0b0de944: baseline-arm64 2026-05-03 00:53:36,317 - lava_callback - INFO - Received callback for node 69f69c4d1f903fec0b0de93e INFO: 172.20.0.1:59220 - "POST /node/69f69c4d1f903fec0b0de93e HTTP/1.0" 202 Accepted 2026-05-03 00:53:36,340 - lava_callback - INFO - Starting async job submit for node 69f69c4d1f903fec0b0de93e 2026-05-03 00:53:36,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:36,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c4d1f903fec0b0de93e HTTP/1.1" 200 None 2026-05-03 00:53:36,479 - lava_callback - DEBUG - Processing node 69f69c4d1f903fec0b0de93e: baseline-arm64 INFO: 172.20.0.1:59224 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:53:36,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:36,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:36,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:36,781 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c501f903fec0b0de944/log.txt.gz 2026-05-03 00:53:36,879 - lava_callback - INFO - Received callback for node 69f69c4a1f903fec0b0de935 2026-05-03 00:53:36,892 - lava_callback - INFO - Starting async job submit for node 69f69c4a1f903fec0b0de935 INFO: 172.20.0.1:59234 - "POST /node/69f69c4a1f903fec0b0de935 HTTP/1.0" 202 Accepted 2026-05-03 00:53:36,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:36,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:36,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4d1f903fec0b0de93e/log.txt.gz 2026-05-03 00:53:37,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c4a1f903fec0b0de935 HTTP/1.1" 200 None 2026-05-03 00:53:37,099 - lava_callback - DEBUG - Processing node 69f69c4a1f903fec0b0de935: baseline-arm64 2026-05-03 00:53:37,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:37,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:37,437 - lava_callback - WARNING - Failed to upload log 2026-05-03 00:53:37,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:37,665 - lava_callback - INFO - Received callback for node 69f69c541f903fec0b0de954 2026-05-03 00:53:37,675 - lava_callback - INFO - Starting async job submit for node 69f69c541f903fec0b0de954 INFO: 172.20.0.1:59236 - "POST /node/69f69c541f903fec0b0de954 HTTP/1.0" 202 Accepted 2026-05-03 00:53:37,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:37,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4a1f903fec0b0de935/lava-logs.yaml 2026-05-03 00:53:37,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:37,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:37,723 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4d1f903fec0b0de93e/lava-logs.yaml 2026-05-03 00:53:37,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:37,727 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c501f903fec0b0de944/lava-logs.yaml 2026-05-03 00:53:37,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:37,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:37,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:37,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c541f903fec0b0de954 HTTP/1.1" 200 None 2026-05-03 00:53:37,754 - lava_callback - DEBUG - Processing node 69f69c541f903fec0b0de954: baseline-arm64 2026-05-03 00:53:37,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:37,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4d1f903fec0b0de93e/lava_callback.json.gz 2026-05-03 00:53:37,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:37,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:37,983 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c501f903fec0b0de944/lava_callback.json.gz 2026-05-03 00:53:38,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:38,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c4d1f903fec0b0de93e HTTP/1.1" 200 None 2026-05-03 00:53:38,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c501f903fec0b0de944 HTTP/1.1" 200 None 2026-05-03 00:53:38,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:38,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:38,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:38,169 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4a1f903fec0b0de935/lava_callback.json.gz 2026-05-03 00:53:38,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:38,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:38,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:38,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:38,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:38,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c4a1f903fec0b0de935 HTTP/1.1" 200 None 2026-05-03 00:53:38,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:38,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:38,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c4d1f903fec0b0de93e HTTP/1.1" 200 None 2026-05-03 00:53:38,260 - lava_callback - INFO - Completed processing callback for node 69f69c4d1f903fec0b0de93e 2026-05-03 00:53:38,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:38,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:38,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c501f903fec0b0de944 HTTP/1.1" 200 None 2026-05-03 00:53:38,326 - lava_callback - INFO - Completed processing callback for node 69f69c501f903fec0b0de944 2026-05-03 00:53:38,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:38,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c541f903fec0b0de954/log.txt.gz 2026-05-03 00:53:38,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c4a1f903fec0b0de935 HTTP/1.1" 200 None 2026-05-03 00:53:38,384 - lava_callback - INFO - Received callback for node 69f69c481f903fec0b0de923 INFO: 172.20.0.1:59248 - "POST /node/69f69c481f903fec0b0de923 HTTP/1.0" 202 Accepted 2026-05-03 00:53:38,413 - lava_callback - INFO - Starting async job submit for node 69f69c481f903fec0b0de923 2026-05-03 00:53:38,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:38,627 - lava_callback - INFO - Completed processing callback for node 69f69c4a1f903fec0b0de935 2026-05-03 00:53:38,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c481f903fec0b0de923 HTTP/1.1" 200 None 2026-05-03 00:53:38,717 - lava_callback - DEBUG - Processing node 69f69c481f903fec0b0de923: baseline-arm64 2026-05-03 00:53:39,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:39,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:39,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:39,241 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c541f903fec0b0de954/lava-logs.yaml 2026-05-03 00:53:39,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:39,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:39,299 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c481f903fec0b0de923/log.txt.gz 2026-05-03 00:53:39,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:39,385 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c541f903fec0b0de954/lava_callback.json.gz 2026-05-03 00:53:39,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:39,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c541f903fec0b0de954 HTTP/1.1" 200 None 2026-05-03 00:53:39,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:39,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:39,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:39,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:39,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c541f903fec0b0de954 HTTP/1.1" 200 None 2026-05-03 00:53:39,614 - lava_callback - INFO - Completed processing callback for node 69f69c541f903fec0b0de954 2026-05-03 00:53:39,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:39,767 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c481f903fec0b0de923/lava-logs.yaml 2026-05-03 00:53:39,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:39,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:39,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c481f903fec0b0de923/lava_callback.json.gz 2026-05-03 00:53:39,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:39,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c481f903fec0b0de923 HTTP/1.1" 200 None 2026-05-03 00:53:39,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:39,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:39,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:39,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c481f903fec0b0de923 HTTP/1.1" 200 None 2026-05-03 00:53:39,978 - lava_callback - INFO - Completed processing callback for node 69f69c481f903fec0b0de923 2026-05-03 00:53:42,109 - lava_callback - INFO - Received callback for node 69f69c4b1f903fec0b0de938 INFO: 172.20.0.1:53456 - "POST /node/69f69c4b1f903fec0b0de938 HTTP/1.0" 202 Accepted 2026-05-03 00:53:42,116 - lava_callback - INFO - Starting async job submit for node 69f69c4b1f903fec0b0de938 2026-05-03 00:53:42,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:42,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c4b1f903fec0b0de938 HTTP/1.1" 200 None 2026-05-03 00:53:42,177 - lava_callback - DEBUG - Processing node 69f69c4b1f903fec0b0de938: baseline-arm64 2026-05-03 00:53:42,343 - lava_callback - WARNING - Failed to upload log 2026-05-03 00:53:42,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:42,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:42,537 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4b1f903fec0b0de938/lava-logs.yaml 2026-05-03 00:53:42,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:42,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:42,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4b1f903fec0b0de938/lava_callback.json.gz 2026-05-03 00:53:42,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:42,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c4b1f903fec0b0de938 HTTP/1.1" 200 None 2026-05-03 00:53:42,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:42,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:42,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:42,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c4b1f903fec0b0de938 HTTP/1.1" 200 None 2026-05-03 00:53:42,768 - lava_callback - INFO - Completed processing callback for node 69f69c4b1f903fec0b0de938 INFO: 172.20.0.1:53470 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:53:45,921 - lava_callback - INFO - Received callback for node 69f69c561f903fec0b0de95a INFO: 172.20.0.1:53476 - "POST /node/69f69c561f903fec0b0de95a HTTP/1.0" 202 Accepted 2026-05-03 00:53:45,932 - lava_callback - INFO - Starting async job submit for node 69f69c561f903fec0b0de95a 2026-05-03 00:53:45,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:45,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c561f903fec0b0de95a HTTP/1.1" 200 None 2026-05-03 00:53:45,980 - lava_callback - DEBUG - Processing node 69f69c561f903fec0b0de95a: baseline-arm64 2026-05-03 00:53:46,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:46,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:46,405 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c561f903fec0b0de95a/log.txt.gz INFO: 172.20.0.1:53478 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:53:46,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:46,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:46,774 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c561f903fec0b0de95a/lava-logs.yaml 2026-05-03 00:53:46,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:46,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:46,892 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c561f903fec0b0de95a/lava_callback.json.gz 2026-05-03 00:53:46,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:46,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c561f903fec0b0de95a HTTP/1.1" 200 None 2026-05-03 00:53:46,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:46,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:46,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:46,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c561f903fec0b0de95a HTTP/1.1" 200 None 2026-05-03 00:53:46,969 - lava_callback - INFO - Completed processing callback for node 69f69c561f903fec0b0de95a 2026-05-03 00:53:47,873 - lava_callback - INFO - Received callback for node 69f69c551f903fec0b0de957 INFO: 172.20.0.1:53480 - "POST /node/69f69c551f903fec0b0de957 HTTP/1.0" 202 Accepted 2026-05-03 00:53:47,882 - lava_callback - INFO - Starting async job submit for node 69f69c551f903fec0b0de957 2026-05-03 00:53:47,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:47,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c551f903fec0b0de957 HTTP/1.1" 200 None 2026-05-03 00:53:47,928 - lava_callback - DEBUG - Processing node 69f69c551f903fec0b0de957: baseline-arm64 2026-05-03 00:53:48,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:48,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:48,395 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c551f903fec0b0de957/log.txt.gz 2026-05-03 00:53:48,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:48,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:48,694 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c551f903fec0b0de957/lava-logs.yaml 2026-05-03 00:53:48,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:48,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:48,798 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c551f903fec0b0de957/lava_callback.json.gz 2026-05-03 00:53:48,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:48,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c551f903fec0b0de957 HTTP/1.1" 200 None 2026-05-03 00:53:48,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:48,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:48,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:48,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c551f903fec0b0de957 HTTP/1.1" 200 None 2026-05-03 00:53:48,898 - lava_callback - INFO - Completed processing callback for node 69f69c551f903fec0b0de957 2026-05-03 00:53:49,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:49,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-03 00:53:51,339 - lava_callback - INFO - Received callback for node 69f69c491f903fec0b0de926 INFO: 172.20.0.1:43796 - "POST /node/69f69c491f903fec0b0de926 HTTP/1.0" 202 Accepted 2026-05-03 00:53:51,345 - lava_callback - INFO - Starting async job submit for node 69f69c491f903fec0b0de926 2026-05-03 00:53:51,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:51,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c491f903fec0b0de926 HTTP/1.1" 200 None 2026-05-03 00:53:51,389 - lava_callback - DEBUG - Processing node 69f69c491f903fec0b0de926: baseline-arm64 2026-05-03 00:53:51,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:51,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:51,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c491f903fec0b0de926/log.txt.gz 2026-05-03 00:53:51,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:52,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:52,016 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c491f903fec0b0de926/lava-logs.yaml 2026-05-03 00:53:52,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:52,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:52,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c491f903fec0b0de926/lava_callback.json.gz 2026-05-03 00:53:52,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:52,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c491f903fec0b0de926 HTTP/1.1" 200 None 2026-05-03 00:53:52,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:52,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:52,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:52,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c491f903fec0b0de926 HTTP/1.1" 200 None 2026-05-03 00:53:52,230 - lava_callback - INFO - Completed processing callback for node 69f69c491f903fec0b0de926 2026-05-03 00:53:53,978 - lava_callback - INFO - Received callback for node 69f69c531f903fec0b0de951 INFO: 172.20.0.1:43812 - "POST /node/69f69c531f903fec0b0de951 HTTP/1.0" 202 Accepted 2026-05-03 00:53:53,986 - lava_callback - INFO - Starting async job submit for node 69f69c531f903fec0b0de951 2026-05-03 00:53:54,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:54,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c531f903fec0b0de951 HTTP/1.1" 200 None 2026-05-03 00:53:54,045 - lava_callback - DEBUG - Processing node 69f69c531f903fec0b0de951: baseline-arm64 2026-05-03 00:53:54,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:54,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:54,376 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c531f903fec0b0de951/log.txt.gz 2026-05-03 00:53:54,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:54,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:54,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c531f903fec0b0de951/lava-logs.yaml 2026-05-03 00:53:54,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:53:54,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:53:54,789 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c531f903fec0b0de951/lava_callback.json.gz 2026-05-03 00:53:54,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:54,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c531f903fec0b0de951 HTTP/1.1" 200 None 2026-05-03 00:53:54,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:54,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:53:54,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:53:54,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c531f903fec0b0de951 HTTP/1.1" 200 None 2026-05-03 00:53:54,894 - lava_callback - INFO - Completed processing callback for node 69f69c531f903fec0b0de951 INFO: 172.20.0.1:43822 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:54:00,496 - lava_callback - INFO - Received callback for node 69f3f9a22fa6ff8e8ca92f34 INFO: 172.20.0.1:53392 - "POST /node/69f3f9a22fa6ff8e8ca92f34 HTTP/1.0" 202 Accepted 2026-05-03 00:54:00,501 - lava_callback - INFO - Starting async job submit for node 69f3f9a22fa6ff8e8ca92f34 2026-05-03 00:54:00,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:00,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f9a22fa6ff8e8ca92f34 HTTP/1.1" 200 None 2026-05-03 00:54:00,516 - lava_callback - DEBUG - Processing node 69f3f9a22fa6ff8e8ca92f34: baseline-arm64-clabbe 2026-05-03 00:54:00,516 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f9a22fa6ff8e8ca92f34 2026-05-03 00:54:00,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:00,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f9a22fa6ff8e8ca92f34 HTTP/1.1" 200 None 2026-05-03 00:54:00,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:00,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 00:54:00,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:00,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f9a22fa6ff8e8ca92f34 HTTP/1.1" 200 None 2026-05-03 00:54:00,567 - lava_callback - ERROR - Error processing callback for node 69f3f9a22fa6ff8e8ca92f34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-03 00:54:04,551 - lava_callback - INFO - Received callback for node 69f69c641f903fec0b0de984 INFO: 172.20.0.1:53406 - "POST /node/69f69c641f903fec0b0de984 HTTP/1.0" 202 Accepted 2026-05-03 00:54:04,558 - lava_callback - INFO - Starting async job submit for node 69f69c641f903fec0b0de984 2026-05-03 00:54:04,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:04,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c641f903fec0b0de984 HTTP/1.1" 200 None 2026-05-03 00:54:04,601 - lava_callback - DEBUG - Processing node 69f69c641f903fec0b0de984: baseline-nfs-arm64 2026-05-03 00:54:05,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:05,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:05,155 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c641f903fec0b0de984/log.txt.gz 2026-05-03 00:54:05,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:05,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:05,635 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c641f903fec0b0de984/lava-logs.yaml 2026-05-03 00:54:05,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:05,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:05,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c641f903fec0b0de984/lava_callback.json.gz 2026-05-03 00:54:05,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:05,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c641f903fec0b0de984 HTTP/1.1" 200 None 2026-05-03 00:54:05,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:05,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:05,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:05,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c641f903fec0b0de984 HTTP/1.1" 200 None 2026-05-03 00:54:05,844 - lava_callback - INFO - Completed processing callback for node 69f69c641f903fec0b0de984 INFO: 172.20.0.1:53410 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:54:12,918 - lava_callback - INFO - Received callback for node 69f69c5e1f903fec0b0de971 INFO: 172.20.0.1:41220 - "POST /node/69f69c5e1f903fec0b0de971 HTTP/1.0" 202 Accepted 2026-05-03 00:54:12,927 - lava_callback - INFO - Starting async job submit for node 69f69c5e1f903fec0b0de971 2026-05-03 00:54:12,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:12,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c5e1f903fec0b0de971 HTTP/1.1" 200 None 2026-05-03 00:54:12,968 - lava_callback - DEBUG - Processing node 69f69c5e1f903fec0b0de971: baseline-nfs-arm64 2026-05-03 00:54:13,080 - lava_callback - INFO - Received callback for node 69f69c611f903fec0b0de97a INFO: 172.20.0.1:41236 - "POST /node/69f69c611f903fec0b0de97a HTTP/1.0" 202 Accepted 2026-05-03 00:54:13,112 - lava_callback - INFO - Starting async job submit for node 69f69c611f903fec0b0de97a 2026-05-03 00:54:13,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:13,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c611f903fec0b0de97a HTTP/1.1" 200 None 2026-05-03 00:54:13,304 - lava_callback - DEBUG - Processing node 69f69c611f903fec0b0de97a: baseline-nfs-arm64 2026-05-03 00:54:14,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:14,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:14,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:14,178 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5e1f903fec0b0de971/log.txt.gz 2026-05-03 00:54:14,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:14,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c611f903fec0b0de97a/log.txt.gz 2026-05-03 00:54:14,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:14,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:14,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:14,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c611f903fec0b0de97a/lava-logs.yaml 2026-05-03 00:54:14,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:14,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:14,965 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5e1f903fec0b0de971/lava-logs.yaml 2026-05-03 00:54:14,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:15,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:15,003 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c611f903fec0b0de97a/lava_callback.json.gz 2026-05-03 00:54:15,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:15,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c611f903fec0b0de97a HTTP/1.1" 200 None 2026-05-03 00:54:15,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:15,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:15,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:15,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c611f903fec0b0de97a HTTP/1.1" 200 None 2026-05-03 00:54:15,133 - lava_callback - INFO - Completed processing callback for node 69f69c611f903fec0b0de97a INFO: 172.20.0.1:41248 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-03 00:54:15,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:15,213 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5e1f903fec0b0de971/lava_callback.json.gz 2026-05-03 00:54:15,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:15,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c5e1f903fec0b0de971 HTTP/1.1" 200 None 2026-05-03 00:54:15,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:15,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:15,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:15,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c5e1f903fec0b0de971 HTTP/1.1" 200 None 2026-05-03 00:54:15,349 - lava_callback - INFO - Completed processing callback for node 69f69c5e1f903fec0b0de971 INFO: 172.20.0.1:41264 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:54:17,112 - lava_callback - INFO - Received callback for node 69f69c811f903fec0b0de9fe INFO: 172.20.0.1:41280 - "POST /node/69f69c811f903fec0b0de9fe HTTP/1.0" 202 Accepted 2026-05-03 00:54:17,122 - lava_callback - INFO - Starting async job submit for node 69f69c811f903fec0b0de9fe 2026-05-03 00:54:17,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:17,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c811f903fec0b0de9fe HTTP/1.1" 200 None 2026-05-03 00:54:17,178 - lava_callback - DEBUG - Processing node 69f69c811f903fec0b0de9fe: baseline-arm64-pengutronix 2026-05-03 00:54:17,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:17,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:17,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f69c811f903fec0b0de9fe/log.txt.gz 2026-05-03 00:54:17,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:17,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:17,749 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f69c811f903fec0b0de9fe/lava-logs.yaml 2026-05-03 00:54:17,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:17,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:17,849 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f69c811f903fec0b0de9fe/lava_callback.json.gz 2026-05-03 00:54:17,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:17,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c811f903fec0b0de9fe HTTP/1.1" 200 None 2026-05-03 00:54:17,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:17,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:17,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:17,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c811f903fec0b0de9fe HTTP/1.1" 200 None 2026-05-03 00:54:17,947 - lava_callback - INFO - Completed processing callback for node 69f69c811f903fec0b0de9fe 2026-05-03 00:54:19,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:19,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-03 00:54:21,435 - lava_callback - INFO - Received callback for node 69f69c5b1f903fec0b0de968 INFO: 172.20.0.1:46398 - "POST /node/69f69c5b1f903fec0b0de968 HTTP/1.0" 202 Accepted 2026-05-03 00:54:21,442 - lava_callback - INFO - Starting async job submit for node 69f69c5b1f903fec0b0de968 2026-05-03 00:54:21,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:21,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c5b1f903fec0b0de968 HTTP/1.1" 200 None 2026-05-03 00:54:21,480 - lava_callback - DEBUG - Processing node 69f69c5b1f903fec0b0de968: baseline-nfs-arm64 2026-05-03 00:54:21,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:21,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:21,995 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5b1f903fec0b0de968/log.txt.gz 2026-05-03 00:54:22,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:22,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:22,357 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5b1f903fec0b0de968/lava-logs.yaml 2026-05-03 00:54:22,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:22,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:22,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5b1f903fec0b0de968/lava_callback.json.gz 2026-05-03 00:54:22,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:22,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c5b1f903fec0b0de968 HTTP/1.1" 200 None 2026-05-03 00:54:22,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:22,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:22,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:22,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c5b1f903fec0b0de968 HTTP/1.1" 200 None 2026-05-03 00:54:22,581 - lava_callback - INFO - Completed processing callback for node 69f69c5b1f903fec0b0de968 2026-05-03 00:54:23,103 - lava_callback - INFO - Received callback for node 69f69c5d1f903fec0b0de96e INFO: 172.20.0.1:46408 - "POST /node/69f69c5d1f903fec0b0de96e HTTP/1.0" 202 Accepted 2026-05-03 00:54:23,111 - lava_callback - INFO - Starting async job submit for node 69f69c5d1f903fec0b0de96e 2026-05-03 00:54:23,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:23,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c5d1f903fec0b0de96e HTTP/1.1" 200 None 2026-05-03 00:54:23,178 - lava_callback - DEBUG - Processing node 69f69c5d1f903fec0b0de96e: baseline-nfs-arm64 2026-05-03 00:54:23,833 - lava_callback - INFO - Received callback for node 69f69c621f903fec0b0de981 INFO: 172.20.0.1:46416 - "POST /node/69f69c621f903fec0b0de981 HTTP/1.0" 202 Accepted 2026-05-03 00:54:23,839 - lava_callback - INFO - Starting async job submit for node 69f69c621f903fec0b0de981 2026-05-03 00:54:23,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:23,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:23,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c621f903fec0b0de981 HTTP/1.1" 200 None 2026-05-03 00:54:23,878 - lava_callback - DEBUG - Processing node 69f69c621f903fec0b0de981: baseline-nfs-arm64 2026-05-03 00:54:24,001 - lava_callback - INFO - Received callback for node 69f69c851f903fec0b0dea07 INFO: 172.20.0.1:46422 - "POST /node/69f69c851f903fec0b0dea07 HTTP/1.0" 202 Accepted 2026-05-03 00:54:24,022 - lava_callback - INFO - Starting async job submit for node 69f69c851f903fec0b0dea07 2026-05-03 00:54:24,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:24,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:24,176 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5d1f903fec0b0de96e/log.txt.gz 2026-05-03 00:54:24,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c851f903fec0b0dea07 HTTP/1.1" 200 None 2026-05-03 00:54:24,397 - lava_callback - DEBUG - Processing node 69f69c851f903fec0b0dea07: baseline-arm64-foundriesio 2026-05-03 00:54:24,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:24,671 - lava_callback - INFO - Received callback for node 69f69c821f903fec0b0dea01 INFO: 172.20.0.1:46432 - "POST /node/69f69c821f903fec0b0dea01 HTTP/1.0" 202 Accepted 2026-05-03 00:54:24,723 - lava_callback - INFO - Starting async job submit for node 69f69c821f903fec0b0dea01 2026-05-03 00:54:24,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:24,812 - lava_callback - INFO - Received callback for node 69f699a61f903fec0b0de686 2026-05-03 00:54:24,842 - lava_callback - INFO - Starting async job submit for node 69f699a61f903fec0b0de686 2026-05-03 00:54:24,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.20.0.1:46434 - "POST /node/69f699a61f903fec0b0de686 HTTP/1.0" 202 Accepted 2026-05-03 00:54:24,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:24,926 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c621f903fec0b0de981/log.txt.gz 2026-05-03 00:54:24,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c821f903fec0b0dea01 HTTP/1.1" 200 None 2026-05-03 00:54:24,934 - lava_callback - DEBUG - Processing node 69f69c821f903fec0b0dea01: baseline-arm64-pengutronix 2026-05-03 00:54:24,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:25,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a61f903fec0b0de686 HTTP/1.1" 200 None 2026-05-03 00:54:25,338 - lava_callback - DEBUG - Processing node 69f699a61f903fec0b0de686: ltp-smoke 2026-05-03 00:54:25,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:25,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:25,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:25,548 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f69c851f903fec0b0dea07/log.txt.gz 2026-05-03 00:54:25,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:25,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:25,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:25,888 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5d1f903fec0b0de96e/lava-logs.yaml 2026-05-03 00:54:25,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:25,988 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c621f903fec0b0de981/lava-logs.yaml 2026-05-03 00:54:25,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:25,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:25,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:26,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:26,047 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f69c821f903fec0b0dea01/log.txt.gz 2026-05-03 00:54:26,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:26,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:26,119 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f69c851f903fec0b0dea07/lava-logs.yaml 2026-05-03 00:54:26,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:26,184 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f699a61f903fec0b0de686/log.txt.gz 2026-05-03 00:54:26,190 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5d1f903fec0b0de96e/lava_callback.json.gz 2026-05-03 00:54:26,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:26,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:26,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:26,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:26,418 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c621f903fec0b0de981/lava_callback.json.gz 2026-05-03 00:54:26,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:26,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.20.0.1:46444 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:54:26,549 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f69c821f903fec0b0dea01/lava-logs.yaml 2026-05-03 00:54:26,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c5d1f903fec0b0de96e HTTP/1.1" 200 None 2026-05-03 00:54:26,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c621f903fec0b0de981 HTTP/1.1" 200 None 2026-05-03 00:54:26,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:26,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:26,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:26,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:26,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:26,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:26,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:26,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:26,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:26,603 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f69c851f903fec0b0dea07/lava_callback.json.gz 2026-05-03 00:54:26,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:26,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c5d1f903fec0b0de96e HTTP/1.1" 200 None 2026-05-03 00:54:26,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c621f903fec0b0de981 HTTP/1.1" 200 None 2026-05-03 00:54:26,701 - lava_callback - INFO - Completed processing callback for node 69f69c621f903fec0b0de981 2026-05-03 00:54:26,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c851f903fec0b0dea07 HTTP/1.1" 200 None 2026-05-03 00:54:26,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:26,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:26,774 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f69c821f903fec0b0dea01/lava_callback.json.gz 2026-05-03 00:54:26,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:26,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:26,879 - lava_callback - INFO - Completed processing callback for node 69f69c5d1f903fec0b0de96e 2026-05-03 00:54:26,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:26,888 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f699a61f903fec0b0de686/lava-logs.yaml 2026-05-03 00:54:26,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:26,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:26,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c851f903fec0b0dea07 HTTP/1.1" 200 None 2026-05-03 00:54:26,914 - lava_callback - INFO - Completed processing callback for node 69f69c851f903fec0b0dea07 2026-05-03 00:54:26,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c821f903fec0b0dea01 HTTP/1.1" 200 None 2026-05-03 00:54:26,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:26,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:26,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:27,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c821f903fec0b0dea01 HTTP/1.1" 200 None 2026-05-03 00:54:27,045 - lava_callback - INFO - Completed processing callback for node 69f69c821f903fec0b0dea01 2026-05-03 00:54:27,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:27,094 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f699a61f903fec0b0de686/lava_callback.json.gz 2026-05-03 00:54:27,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:27,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a61f903fec0b0de686 HTTP/1.1" 200 None 2026-05-03 00:54:27,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:27,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:54:27,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:27,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699a61f903fec0b0de686 HTTP/1.1" 200 None 2026-05-03 00:54:27,194 - lava_callback - INFO - Completed processing callback for node 69f699a61f903fec0b0de686 2026-05-03 00:54:32,074 - lava_callback - INFO - Received callback for node 69f69c581f903fec0b0de962 INFO: 172.20.0.1:42020 - "POST /node/69f69c581f903fec0b0de962 HTTP/1.0" 202 Accepted 2026-05-03 00:54:32,081 - lava_callback - INFO - Starting async job submit for node 69f69c581f903fec0b0de962 2026-05-03 00:54:32,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:32,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c581f903fec0b0de962 HTTP/1.1" 200 None 2026-05-03 00:54:32,137 - lava_callback - DEBUG - Processing node 69f69c581f903fec0b0de962: baseline-nfs-arm64 2026-05-03 00:54:32,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:32,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:32,532 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c581f903fec0b0de962/log.txt.gz 2026-05-03 00:54:32,633 - lava_callback - INFO - Received callback for node 69f69c601f903fec0b0de977 INFO: 172.20.0.1:42034 - "POST /node/69f69c601f903fec0b0de977 HTTP/1.0" 202 Accepted 2026-05-03 00:54:32,649 - lava_callback - INFO - Starting async job submit for node 69f69c601f903fec0b0de977 2026-05-03 00:54:32,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:32,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:32,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c601f903fec0b0de977 HTTP/1.1" 200 None 2026-05-03 00:54:32,749 - lava_callback - DEBUG - Processing node 69f69c601f903fec0b0de977: baseline-nfs-arm64 2026-05-03 00:54:32,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:33,003 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c581f903fec0b0de962/lava-logs.yaml 2026-05-03 00:54:33,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:33,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:33,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:33,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:33,203 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c581f903fec0b0de962/lava_callback.json.gz 2026-05-03 00:54:33,223 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c601f903fec0b0de977/log.txt.gz 2026-05-03 00:54:33,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:33,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c581f903fec0b0de962 HTTP/1.1" 200 None 2026-05-03 00:54:33,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:33,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:33,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:33,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:33,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c581f903fec0b0de962 HTTP/1.1" 200 None 2026-05-03 00:54:33,536 - lava_callback - INFO - Completed processing callback for node 69f69c581f903fec0b0de962 2026-05-03 00:54:33,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:33,687 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c601f903fec0b0de977/lava-logs.yaml 2026-05-03 00:54:33,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:33,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:33,778 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c601f903fec0b0de977/lava_callback.json.gz 2026-05-03 00:54:33,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:33,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c601f903fec0b0de977 HTTP/1.1" 200 None 2026-05-03 00:54:33,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:33,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:33,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:33,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c601f903fec0b0de977 HTTP/1.1" 200 None 2026-05-03 00:54:33,860 - lava_callback - INFO - Completed processing callback for node 69f69c601f903fec0b0de977 2026-05-03 00:54:35,044 - lava_callback - INFO - Received callback for node 69f69c841f903fec0b0dea04 INFO: 172.20.0.1:42038 - "POST /node/69f69c841f903fec0b0dea04 HTTP/1.0" 202 Accepted 2026-05-03 00:54:35,050 - lava_callback - INFO - Starting async job submit for node 69f69c841f903fec0b0dea04 2026-05-03 00:54:35,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:35,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c841f903fec0b0dea04 HTTP/1.1" 200 None 2026-05-03 00:54:35,084 - lava_callback - DEBUG - Processing node 69f69c841f903fec0b0dea04: baseline-arm64-pengutronix 2026-05-03 00:54:35,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:35,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:35,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f69c841f903fec0b0dea04/log.txt.gz 2026-05-03 00:54:35,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:35,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:35,661 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f69c841f903fec0b0dea04/lava-logs.yaml 2026-05-03 00:54:35,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:35,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:35,762 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f69c841f903fec0b0dea04/lava_callback.json.gz 2026-05-03 00:54:35,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:35,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c841f903fec0b0dea04 HTTP/1.1" 200 None 2026-05-03 00:54:35,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:35,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:35,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:35,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c841f903fec0b0dea04 HTTP/1.1" 200 None 2026-05-03 00:54:35,836 - lava_callback - INFO - Completed processing callback for node 69f69c841f903fec0b0dea04 INFO: 172.20.0.1:42054 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:54:37,428 - lava_callback - INFO - Received callback for node 69f69c511f903fec0b0de94b INFO: 172.20.0.1:42062 - "POST /node/69f69c511f903fec0b0de94b HTTP/1.0" 202 Accepted 2026-05-03 00:54:37,435 - lava_callback - INFO - Starting async job submit for node 69f69c511f903fec0b0de94b 2026-05-03 00:54:37,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:37,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c511f903fec0b0de94b HTTP/1.1" 200 None 2026-05-03 00:54:37,471 - lava_callback - DEBUG - Processing node 69f69c511f903fec0b0de94b: baseline-arm64 2026-05-03 00:54:37,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:38,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:38,062 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c511f903fec0b0de94b/log.txt.gz 2026-05-03 00:54:38,168 - lava_callback - INFO - Received callback for node 69f69c6b1f903fec0b0de9b7 INFO: 172.20.0.1:42066 - "POST /node/69f69c6b1f903fec0b0de9b7 HTTP/1.0" 202 Accepted 2026-05-03 00:54:38,181 - lava_callback - INFO - Starting async job submit for node 69f69c6b1f903fec0b0de9b7 2026-05-03 00:54:38,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:38,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c6b1f903fec0b0de9b7 HTTP/1.1" 200 None 2026-05-03 00:54:38,307 - lava_callback - DEBUG - Processing node 69f69c6b1f903fec0b0de9b7: baseline-arm64-broonie 2026-05-03 00:54:38,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:38,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:38,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:38,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c6b1f903fec0b0de9b7/log.txt.gz 2026-05-03 00:54:38,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:38,799 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c511f903fec0b0de94b/lava-logs.yaml 2026-05-03 00:54:38,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:38,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:38,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:38,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c511f903fec0b0de94b/lava_callback.json.gz 2026-05-03 00:54:39,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:39,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:39,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c6b1f903fec0b0de9b7/lava-logs.yaml 2026-05-03 00:54:39,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:39,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c511f903fec0b0de94b HTTP/1.1" 200 None 2026-05-03 00:54:39,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:39,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:39,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:39,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c511f903fec0b0de94b HTTP/1.1" 200 None 2026-05-03 00:54:39,137 - lava_callback - INFO - Completed processing callback for node 69f69c511f903fec0b0de94b 2026-05-03 00:54:39,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:39,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c6b1f903fec0b0de9b7/lava_callback.json.gz 2026-05-03 00:54:39,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:39,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c6b1f903fec0b0de9b7 HTTP/1.1" 200 None 2026-05-03 00:54:39,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:39,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:39,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:39,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c6b1f903fec0b0de9b7 HTTP/1.1" 200 None 2026-05-03 00:54:39,288 - lava_callback - INFO - Completed processing callback for node 69f69c6b1f903fec0b0de9b7 2026-05-03 00:54:39,590 - lava_callback - INFO - Received callback for node 69f69c721f903fec0b0de9cd INFO: 172.20.0.1:42080 - "POST /node/69f69c721f903fec0b0de9cd HTTP/1.0" 202 Accepted 2026-05-03 00:54:39,596 - lava_callback - INFO - Starting async job submit for node 69f69c721f903fec0b0de9cd 2026-05-03 00:54:39,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:39,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c721f903fec0b0de9cd HTTP/1.1" 200 None 2026-05-03 00:54:39,638 - lava_callback - DEBUG - Processing node 69f69c721f903fec0b0de9cd: baseline-arm64-broonie 2026-05-03 00:54:39,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:39,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:39,960 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c721f903fec0b0de9cd/log.txt.gz 2026-05-03 00:54:40,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:40,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:40,242 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c721f903fec0b0de9cd/lava-logs.yaml 2026-05-03 00:54:40,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:40,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:40,339 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c721f903fec0b0de9cd/lava_callback.json.gz 2026-05-03 00:54:40,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:40,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c721f903fec0b0de9cd HTTP/1.1" 200 None 2026-05-03 00:54:40,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:40,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:40,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:40,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c721f903fec0b0de9cd HTTP/1.1" 200 None 2026-05-03 00:54:40,412 - lava_callback - INFO - Completed processing callback for node 69f69c721f903fec0b0de9cd INFO: 172.20.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53954 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:54:49,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:50,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-03 00:54:50,554 - lava_callback - INFO - Received callback for node 69f69c801f903fec0b0de9fb INFO: 172.20.0.1:58262 - "POST /node/69f69c801f903fec0b0de9fb HTTP/1.0" 202 Accepted 2026-05-03 00:54:50,560 - lava_callback - INFO - Starting async job submit for node 69f69c801f903fec0b0de9fb 2026-05-03 00:54:50,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:50,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c801f903fec0b0de9fb HTTP/1.1" 200 None 2026-05-03 00:54:50,600 - lava_callback - DEBUG - Processing node 69f69c801f903fec0b0de9fb: baseline-arm64-kontron 2026-05-03 00:54:50,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:50,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:50,964 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69f69c801f903fec0b0de9fb/log.txt.gz 2026-05-03 00:54:51,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:51,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:51,345 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69f69c801f903fec0b0de9fb/lava-logs.yaml 2026-05-03 00:54:51,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:54:51,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:54:51,447 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69f69c801f903fec0b0de9fb/lava_callback.json.gz 2026-05-03 00:54:51,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:51,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c801f903fec0b0de9fb HTTP/1.1" 200 None 2026-05-03 00:54:51,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:51,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:54:51,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:54:51,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c801f903fec0b0de9fb HTTP/1.1" 200 None 2026-05-03 00:54:51,528 - lava_callback - INFO - Completed processing callback for node 69f69c801f903fec0b0de9fb INFO: 172.20.0.1:58272 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:55:04,705 - lava_callback - INFO - Received callback for node 69f699a91f903fec0b0de68c INFO: 172.20.0.1:41286 - "POST /node/69f699a91f903fec0b0de68c HTTP/1.0" 202 Accepted 2026-05-03 00:55:04,711 - lava_callback - INFO - Starting async job submit for node 69f699a91f903fec0b0de68c 2026-05-03 00:55:04,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:04,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a91f903fec0b0de68c HTTP/1.1" 200 None 2026-05-03 00:55:04,749 - lava_callback - DEBUG - Processing node 69f699a91f903fec0b0de68c: ltp-syscalls-ipc 2026-05-03 00:55:05,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:05,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:05,223 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69f699a91f903fec0b0de68c/log.txt.gz 2026-05-03 00:55:05,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:05,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:05,580 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69f699a91f903fec0b0de68c/lava-logs.yaml 2026-05-03 00:55:05,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:05,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:05,796 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69f699a91f903fec0b0de68c/lava_callback.json.gz 2026-05-03 00:55:05,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:05,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699a91f903fec0b0de68c HTTP/1.1" 200 None 2026-05-03 00:55:05,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:05,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:55:05,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:05,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699a91f903fec0b0de68c HTTP/1.1" 200 None 2026-05-03 00:55:05,882 - lava_callback - INFO - Completed processing callback for node 69f699a91f903fec0b0de68c 2026-05-03 00:55:06,160 - lava_callback - INFO - Received callback for node 69f69c6e1f903fec0b0de9c0 INFO: 172.20.0.1:41298 - "POST /node/69f69c6e1f903fec0b0de9c0 HTTP/1.0" 202 Accepted 2026-05-03 00:55:06,166 - lava_callback - INFO - Starting async job submit for node 69f69c6e1f903fec0b0de9c0 2026-05-03 00:55:06,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:06,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c6e1f903fec0b0de9c0 HTTP/1.1" 200 None 2026-05-03 00:55:06,203 - lava_callback - DEBUG - Processing node 69f69c6e1f903fec0b0de9c0: baseline-arm64-broonie 2026-05-03 00:55:06,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:41300 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:55:06,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:06,559 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c6e1f903fec0b0de9c0/log.txt.gz 2026-05-03 00:55:06,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:06,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:06,868 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c6e1f903fec0b0de9c0/lava-logs.yaml 2026-05-03 00:55:06,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:06,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:06,973 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c6e1f903fec0b0de9c0/lava_callback.json.gz 2026-05-03 00:55:06,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:07,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c6e1f903fec0b0de9c0 HTTP/1.1" 200 None 2026-05-03 00:55:07,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:07,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:55:07,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:07,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c6e1f903fec0b0de9c0 HTTP/1.1" 200 None 2026-05-03 00:55:07,048 - lava_callback - INFO - Completed processing callback for node 69f69c6e1f903fec0b0de9c0 2026-05-03 00:55:07,640 - lava_callback - INFO - Received callback for node 69f69c701f903fec0b0de9c7 INFO: 172.20.0.1:41302 - "POST /node/69f69c701f903fec0b0de9c7 HTTP/1.0" 202 Accepted 2026-05-03 00:55:07,646 - lava_callback - INFO - Starting async job submit for node 69f69c701f903fec0b0de9c7 2026-05-03 00:55:07,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:07,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c701f903fec0b0de9c7 HTTP/1.1" 200 None 2026-05-03 00:55:07,699 - lava_callback - DEBUG - Processing node 69f69c701f903fec0b0de9c7: baseline-arm64-broonie 2026-05-03 00:55:08,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:08,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:08,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c701f903fec0b0de9c7/log.txt.gz 2026-05-03 00:55:08,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:08,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:08,452 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c701f903fec0b0de9c7/lava-logs.yaml 2026-05-03 00:55:08,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:08,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:08,562 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c701f903fec0b0de9c7/lava_callback.json.gz 2026-05-03 00:55:08,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:08,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c701f903fec0b0de9c7 HTTP/1.1" 200 None 2026-05-03 00:55:08,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:08,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:55:08,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:08,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c701f903fec0b0de9c7 HTTP/1.1" 200 None 2026-05-03 00:55:08,654 - lava_callback - INFO - Completed processing callback for node 69f69c701f903fec0b0de9c7 2026-05-03 00:55:09,031 - lava_callback - INFO - Received callback for node 69f69c761f903fec0b0de9d5 INFO: 172.20.0.1:41308 - "POST /node/69f69c761f903fec0b0de9d5 HTTP/1.0" 202 Accepted 2026-05-03 00:55:09,038 - lava_callback - INFO - Starting async job submit for node 69f69c761f903fec0b0de9d5 2026-05-03 00:55:09,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:09,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c761f903fec0b0de9d5 HTTP/1.1" 200 None 2026-05-03 00:55:09,081 - lava_callback - DEBUG - Processing node 69f69c761f903fec0b0de9d5: baseline-arm64-broonie 2026-05-03 00:55:09,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:09,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:09,409 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c761f903fec0b0de9d5/log.txt.gz 2026-05-03 00:55:09,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:09,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:09,686 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c761f903fec0b0de9d5/lava-logs.yaml 2026-05-03 00:55:09,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:09,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:09,789 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c761f903fec0b0de9d5/lava_callback.json.gz 2026-05-03 00:55:09,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:09,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c761f903fec0b0de9d5 HTTP/1.1" 200 None 2026-05-03 00:55:09,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:09,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:55:09,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:09,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c761f903fec0b0de9d5 HTTP/1.1" 200 None 2026-05-03 00:55:09,867 - lava_callback - INFO - Completed processing callback for node 69f69c761f903fec0b0de9d5 INFO: 172.20.0.1:44888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44890 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:55:20,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:20,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-03 00:55:20,560 - lava_callback - INFO - Received callback for node 69f3f9ee2fa6ff8e8ca92f54 INFO: 172.20.0.1:57366 - "POST /node/69f3f9ee2fa6ff8e8ca92f54 HTTP/1.0" 202 Accepted 2026-05-03 00:55:20,565 - lava_callback - INFO - Starting async job submit for node 69f3f9ee2fa6ff8e8ca92f54 2026-05-03 00:55:20,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:20,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f9ee2fa6ff8e8ca92f54 HTTP/1.1" 200 None 2026-05-03 00:55:20,580 - lava_callback - DEBUG - Processing node 69f3f9ee2fa6ff8e8ca92f54: baseline-arm64-clabbe 2026-05-03 00:55:20,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3f9ee2fa6ff8e8ca92f54 2026-05-03 00:55:20,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:20,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3f9ee2fa6ff8e8ca92f54 HTTP/1.1" 200 None 2026-05-03 00:55:20,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:20,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 00:55:20,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:20,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3f9ee2fa6ff8e8ca92f54 HTTP/1.1" 200 None 2026-05-03 00:55:20,650 - lava_callback - ERROR - Error processing callback for node 69f3f9ee2fa6ff8e8ca92f54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-03 00:55:24,534 - lava_callback - INFO - Received callback for node 69f69c741f903fec0b0de9d0 INFO: 172.20.0.1:57368 - "POST /node/69f69c741f903fec0b0de9d0 HTTP/1.0" 202 Accepted 2026-05-03 00:55:24,540 - lava_callback - INFO - Starting async job submit for node 69f69c741f903fec0b0de9d0 2026-05-03 00:55:24,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:24,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c741f903fec0b0de9d0 HTTP/1.1" 200 None 2026-05-03 00:55:24,581 - lava_callback - DEBUG - Processing node 69f69c741f903fec0b0de9d0: baseline-arm64-broonie 2026-05-03 00:55:24,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:25,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:25,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c741f903fec0b0de9d0/log.txt.gz 2026-05-03 00:55:25,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:25,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:25,533 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c741f903fec0b0de9d0/lava-logs.yaml 2026-05-03 00:55:25,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:25,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:25,679 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c741f903fec0b0de9d0/lava_callback.json.gz 2026-05-03 00:55:25,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:25,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c741f903fec0b0de9d0 HTTP/1.1" 200 None 2026-05-03 00:55:25,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:25,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:55:25,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:25,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c741f903fec0b0de9d0 HTTP/1.1" 200 None 2026-05-03 00:55:25,754 - lava_callback - INFO - Completed processing callback for node 69f69c741f903fec0b0de9d0 2026-05-03 00:55:25,975 - lava_callback - INFO - Received callback for node 69f69c771f903fec0b0de9d8 INFO: 172.20.0.1:57378 - "POST /node/69f69c771f903fec0b0de9d8 HTTP/1.0" 202 Accepted 2026-05-03 00:55:25,982 - lava_callback - INFO - Starting async job submit for node 69f69c771f903fec0b0de9d8 2026-05-03 00:55:26,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:26,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c771f903fec0b0de9d8 HTTP/1.1" 200 None 2026-05-03 00:55:26,026 - lava_callback - DEBUG - Processing node 69f69c771f903fec0b0de9d8: baseline-arm64-broonie 2026-05-03 00:55:26,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:26,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:26,414 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c771f903fec0b0de9d8/log.txt.gz INFO: 172.20.0.1:57388 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:55:26,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:26,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:26,743 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c771f903fec0b0de9d8/lava-logs.yaml 2026-05-03 00:55:26,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:26,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:26,870 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c771f903fec0b0de9d8/lava_callback.json.gz 2026-05-03 00:55:26,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:26,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c771f903fec0b0de9d8 HTTP/1.1" 200 None 2026-05-03 00:55:26,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:26,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:55:26,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:26,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c771f903fec0b0de9d8 HTTP/1.1" 200 None 2026-05-03 00:55:26,955 - lava_callback - INFO - Completed processing callback for node 69f69c771f903fec0b0de9d8 INFO: 172.20.0.1:60284 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:55:38,247 - lava_callback - INFO - Received callback for node 69f69c6c1f903fec0b0de9ba INFO: 172.20.0.1:60288 - "POST /node/69f69c6c1f903fec0b0de9ba HTTP/1.0" 202 Accepted 2026-05-03 00:55:38,253 - lava_callback - INFO - Starting async job submit for node 69f69c6c1f903fec0b0de9ba 2026-05-03 00:55:38,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:38,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c6c1f903fec0b0de9ba HTTP/1.1" 200 None 2026-05-03 00:55:38,291 - lava_callback - DEBUG - Processing node 69f69c6c1f903fec0b0de9ba: baseline-arm64-broonie 2026-05-03 00:55:38,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:38,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:38,582 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c6c1f903fec0b0de9ba/log.txt.gz 2026-05-03 00:55:38,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:38,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:38,844 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c6c1f903fec0b0de9ba/lava-logs.yaml 2026-05-03 00:55:38,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:55:38,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:55:38,948 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c6c1f903fec0b0de9ba/lava_callback.json.gz 2026-05-03 00:55:38,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:38,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c6c1f903fec0b0de9ba HTTP/1.1" 200 None 2026-05-03 00:55:38,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:39,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:55:39,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:39,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c6c1f903fec0b0de9ba HTTP/1.1" 200 None 2026-05-03 00:55:39,029 - lava_callback - INFO - Completed processing callback for node 69f69c6c1f903fec0b0de9ba INFO: 172.20.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48426 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:55:50,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:55:50,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36850 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:56:31,629 - lava_callback - INFO - Received callback for node 69f69c851f903fec0b0dea0a INFO: 172.20.0.1:56980 - "POST /node/69f69c851f903fec0b0dea0a HTTP/1.0" 202 Accepted 2026-05-03 00:56:31,641 - lava_callback - INFO - Starting async job submit for node 69f69c851f903fec0b0dea0a 2026-05-03 00:56:31,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:31,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c851f903fec0b0dea0a HTTP/1.1" 200 None 2026-05-03 00:56:31,719 - lava_callback - DEBUG - Processing node 69f69c851f903fec0b0dea0a: baseline-arm64-foundriesio 2026-05-03 00:56:32,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:56:32,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:56:32,736 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f69c851f903fec0b0dea0a/log.txt.gz 2026-05-03 00:56:32,783 - lava_callback - INFO - Received callback for node 69f69c4c1f903fec0b0de93b INFO: 172.20.0.1:56982 - "POST /node/69f69c4c1f903fec0b0de93b HTTP/1.0" 202 Accepted 2026-05-03 00:56:32,805 - lava_callback - INFO - Starting async job submit for node 69f69c4c1f903fec0b0de93b 2026-05-03 00:56:32,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:32,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c4c1f903fec0b0de93b HTTP/1.1" 200 None 2026-05-03 00:56:32,929 - lava_callback - DEBUG - Processing node 69f69c4c1f903fec0b0de93b: baseline-arm64 2026-05-03 00:56:33,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:56:33,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:56:33,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:56:33,843 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4c1f903fec0b0de93b/log.txt.gz 2026-05-03 00:56:34,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:56:34,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:56:34,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:56:34,200 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f69c851f903fec0b0dea0a/lava-logs.yaml 2026-05-03 00:56:34,203 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4c1f903fec0b0de93b/lava-logs.yaml 2026-05-03 00:56:34,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:56:34,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:56:34,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:56:34,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c4c1f903fec0b0de93b/lava_callback.json.gz 2026-05-03 00:56:34,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:56:34,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:34,377 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f69c851f903fec0b0dea0a/lava_callback.json.gz DEBUG: 69f69c851f903fec0b0dea0a Transitting job node result: pass -> incomplete 2026-05-03 00:56:34,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:34,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c4c1f903fec0b0de93b HTTP/1.1" 200 None 2026-05-03 00:56:34,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:34,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c851f903fec0b0dea0a HTTP/1.1" 200 None 2026-05-03 00:56:34,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:34,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:56:34,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:34,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:56:34,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:34,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c4c1f903fec0b0de93b HTTP/1.1" 200 None 2026-05-03 00:56:34,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c851f903fec0b0dea0a HTTP/1.1" 200 None 2026-05-03 00:56:34,512 - lava_callback - INFO - Completed processing callback for node 69f69c851f903fec0b0dea0a 2026-05-03 00:56:34,534 - lava_callback - INFO - Completed processing callback for node 69f69c4c1f903fec0b0de93b INFO: 172.20.0.1:56994 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:56:38,373 - lava_callback - INFO - Received callback for node 69f69c711f903fec0b0de9ca INFO: 172.20.0.1:57010 - "POST /node/69f69c711f903fec0b0de9ca HTTP/1.0" 202 Accepted 2026-05-03 00:56:38,379 - lava_callback - INFO - Starting async job submit for node 69f69c711f903fec0b0de9ca 2026-05-03 00:56:38,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:38,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c711f903fec0b0de9ca HTTP/1.1" 200 None 2026-05-03 00:56:38,415 - lava_callback - DEBUG - Processing node 69f69c711f903fec0b0de9ca: baseline-arm64-broonie 2026-05-03 00:56:38,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:56:38,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:56:38,816 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c711f903fec0b0de9ca/log.txt.gz 2026-05-03 00:56:38,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:56:39,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:56:39,121 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c711f903fec0b0de9ca/lava-logs.yaml 2026-05-03 00:56:39,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:56:39,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:56:39,225 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f69c711f903fec0b0de9ca/lava_callback.json.gz 2026-05-03 00:56:39,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:39,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c711f903fec0b0de9ca HTTP/1.1" 200 None 2026-05-03 00:56:39,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:39,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:56:39,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:39,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c711f903fec0b0de9ca HTTP/1.1" 200 None 2026-05-03 00:56:39,304 - lava_callback - INFO - Completed processing callback for node 69f69c711f903fec0b0de9ca 2026-05-03 00:56:40,633 - lava_callback - INFO - Received callback for node 69f3fa3c2fa6ff8e8ca92f7f INFO: 172.20.0.1:48916 - "POST /node/69f3fa3c2fa6ff8e8ca92f7f HTTP/1.0" 202 Accepted 2026-05-03 00:56:40,638 - lava_callback - INFO - Starting async job submit for node 69f3fa3c2fa6ff8e8ca92f7f 2026-05-03 00:56:40,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:40,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fa3c2fa6ff8e8ca92f7f HTTP/1.1" 200 None 2026-05-03 00:56:40,659 - lava_callback - DEBUG - Processing node 69f3fa3c2fa6ff8e8ca92f7f: baseline-arm64-clabbe 2026-05-03 00:56:40,660 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fa3c2fa6ff8e8ca92f7f 2026-05-03 00:56:40,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:40,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fa3c2fa6ff8e8ca92f7f HTTP/1.1" 200 None 2026-05-03 00:56:40,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:40,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 00:56:40,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:40,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fa3c2fa6ff8e8ca92f7f HTTP/1.1" 200 None 2026-05-03 00:56:40,710 - lava_callback - ERROR - Error processing callback for node 69f3fa3c2fa6ff8e8ca92f7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48936 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:56:50,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:50,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 00:56:52,345 - lava_callback - INFO - Received callback for node 69f69c5a1f903fec0b0de965 INFO: 172.20.0.1:51334 - "POST /node/69f69c5a1f903fec0b0de965 HTTP/1.0" 202 Accepted 2026-05-03 00:56:52,351 - lava_callback - INFO - Starting async job submit for node 69f69c5a1f903fec0b0de965 2026-05-03 00:56:52,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:52,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c5a1f903fec0b0de965 HTTP/1.1" 200 None 2026-05-03 00:56:52,383 - lava_callback - DEBUG - Processing node 69f69c5a1f903fec0b0de965: baseline-nfs-arm64 2026-05-03 00:56:52,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:56:52,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:56:52,860 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5a1f903fec0b0de965/log.txt.gz 2026-05-03 00:56:53,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:56:53,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:56:53,259 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5a1f903fec0b0de965/lava-logs.yaml 2026-05-03 00:56:53,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:56:53,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:56:53,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5a1f903fec0b0de965/lava_callback.json.gz 2026-05-03 00:56:53,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:53,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c5a1f903fec0b0de965 HTTP/1.1" 200 None 2026-05-03 00:56:53,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:53,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:56:53,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:56:53,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c5a1f903fec0b0de965 HTTP/1.1" 200 None 2026-05-03 00:56:53,454 - lava_callback - INFO - Completed processing callback for node 69f69c5a1f903fec0b0de965 INFO: 172.20.0.1:51348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34432 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:57:18,526 - lava_callback - INFO - Received callback for node 69f699ab1f903fec0b0de68f INFO: 172.20.0.1:34442 - "POST /node/69f699ab1f903fec0b0de68f HTTP/1.0" 202 Accepted 2026-05-03 00:57:18,532 - lava_callback - INFO - Starting async job submit for node 69f699ab1f903fec0b0de68f 2026-05-03 00:57:18,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:57:18,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699ab1f903fec0b0de68f HTTP/1.1" 200 None 2026-05-03 00:57:18,590 - lava_callback - DEBUG - Processing node 69f699ab1f903fec0b0de68f: ltp-timers 2026-05-03 00:57:18,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:57:19,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:57:19,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69f699ab1f903fec0b0de68f/log.txt.gz 2026-05-03 00:57:19,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:57:19,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:57:19,412 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69f699ab1f903fec0b0de68f/lava-logs.yaml 2026-05-03 00:57:19,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:57:19,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:57:19,539 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69f699ab1f903fec0b0de68f/lava_callback.json.gz 2026-05-03 00:57:19,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:57:19,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699ab1f903fec0b0de68f HTTP/1.1" 200 None 2026-05-03 00:57:19,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:57:19,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:57:19,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:57:19,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699ab1f903fec0b0de68f HTTP/1.1" 200 None 2026-05-03 00:57:19,631 - lava_callback - INFO - Completed processing callback for node 69f699ab1f903fec0b0de68f 2026-05-03 00:57:20,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:57:20,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41586 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:58:00,651 - lava_callback - INFO - Received callback for node 69f3fa882fa6ff8e8ca92f96 INFO: 172.20.0.1:60120 - "POST /node/69f3fa882fa6ff8e8ca92f96 HTTP/1.0" 202 Accepted 2026-05-03 00:58:00,658 - lava_callback - INFO - Starting async job submit for node 69f3fa882fa6ff8e8ca92f96 2026-05-03 00:58:00,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:00,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fa882fa6ff8e8ca92f96 HTTP/1.1" 200 None 2026-05-03 00:58:00,674 - lava_callback - DEBUG - Processing node 69f3fa882fa6ff8e8ca92f96: baseline-arm64-clabbe 2026-05-03 00:58:00,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fa882fa6ff8e8ca92f96 2026-05-03 00:58:00,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:00,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fa882fa6ff8e8ca92f96 HTTP/1.1" 200 None 2026-05-03 00:58:00,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:00,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 00:58:00,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:00,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fa882fa6ff8e8ca92f96 HTTP/1.1" 200 None 2026-05-03 00:58:00,730 - lava_callback - ERROR - Error processing callback for node 69f3fa882fa6ff8e8ca92f96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60130 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:58:13,999 - lava_callback - INFO - Received callback for node 69f699681f903fec0b0de59d INFO: 172.20.0.1:56146 - "POST /node/69f699681f903fec0b0de59d HTTP/1.0" 202 Accepted 2026-05-03 00:58:14,007 - lava_callback - INFO - Starting async job submit for node 69f699681f903fec0b0de59d 2026-05-03 00:58:14,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:14,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699681f903fec0b0de59d HTTP/1.1" 200 None 2026-05-03 00:58:14,080 - lava_callback - DEBUG - Processing node 69f699681f903fec0b0de59d: baseline-arm 2026-05-03 00:58:14,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:58:15,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:58:15,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f699681f903fec0b0de59d/log.txt.gz INFO: 172.20.0.1:56158 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-03 00:58:15,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:58:15,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:58:15,628 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f699681f903fec0b0de59d/lava-logs.yaml 2026-05-03 00:58:15,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:58:15,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:58:15,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f699681f903fec0b0de59d/lava_callback.json.gz DEBUG: Setup failed for 69f699681f903fec0b0de59d. Transitting job node result: incomplete -> fail 2026-05-03 00:58:15,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:15,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699681f903fec0b0de59d HTTP/1.1" 200 None 2026-05-03 00:58:15,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:15,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:58:15,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:15,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699681f903fec0b0de59d HTTP/1.1" 200 None 2026-05-03 00:58:16,101 - lava_callback - INFO - Completed processing callback for node 69f699681f903fec0b0de59d INFO: 172.20.0.1:56172 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:58:18,846 - lava_callback - INFO - Received callback for node 69f699151f903fec0b0de559 INFO: 172.20.0.1:56186 - "POST /node/69f699151f903fec0b0de559 HTTP/1.0" 202 Accepted 2026-05-03 00:58:18,855 - lava_callback - INFO - Starting async job submit for node 69f699151f903fec0b0de559 2026-05-03 00:58:18,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:18,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699151f903fec0b0de559 HTTP/1.1" 200 None 2026-05-03 00:58:18,958 - lava_callback - DEBUG - Processing node 69f699151f903fec0b0de559: ltp-smoke 2026-05-03 00:58:19,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:58:19,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:58:19,679 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f699151f903fec0b0de559/log.txt.gz 2026-05-03 00:58:19,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:58:20,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:20,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 00:58:20,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:58:20,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f699151f903fec0b0de559/lava-logs.yaml 2026-05-03 00:58:20,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:58:20,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:58:20,291 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f699151f903fec0b0de559/lava_callback.json.gz 2026-05-03 00:58:20,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:20,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699151f903fec0b0de559 HTTP/1.1" 200 None 2026-05-03 00:58:20,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:20,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f694321f903fec0b0dbc7d HTTP/1.1" 200 None 2026-05-03 00:58:20,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:20,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699151f903fec0b0de559 HTTP/1.1" 200 None 2026-05-03 00:58:20,694 - lava_callback - INFO - Completed processing callback for node 69f699151f903fec0b0de559 2026-05-03 00:58:24,853 - lava_callback - INFO - Received callback for node 69f699ac1f903fec0b0de692 INFO: 172.20.0.1:42366 - "POST /node/69f699ac1f903fec0b0de692 HTTP/1.0" 202 Accepted 2026-05-03 00:58:24,861 - lava_callback - INFO - Starting async job submit for node 69f699ac1f903fec0b0de692 2026-05-03 00:58:24,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:24,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699ac1f903fec0b0de692 HTTP/1.1" 200 None 2026-05-03 00:58:24,925 - lava_callback - DEBUG - Processing node 69f699ac1f903fec0b0de692: ltp-watchqueue 2026-05-03 00:58:25,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:58:25,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:58:25,500 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69f699ac1f903fec0b0de692/log.txt.gz 2026-05-03 00:58:25,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:58:25,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:58:25,897 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69f699ac1f903fec0b0de692/lava-logs.yaml 2026-05-03 00:58:25,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:58:26,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:58:26,034 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69f699ac1f903fec0b0de692/lava_callback.json.gz 2026-05-03 00:58:26,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:26,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f699ac1f903fec0b0de692 HTTP/1.1" 200 None 2026-05-03 00:58:26,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:26,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:58:26,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:26,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f699ac1f903fec0b0de692 HTTP/1.1" 200 None 2026-05-03 00:58:26,133 - lava_callback - INFO - Completed processing callback for node 69f699ac1f903fec0b0de692 INFO: 172.20.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56454 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:58:50,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:58:50,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37214 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:59:09,682 - lava_callback - INFO - Received callback for node 69f3face2fa6ff8e8ca92fb1 INFO: 172.20.0.1:37220 - "POST /node/69f3face2fa6ff8e8ca92fb1 HTTP/1.0" 202 Accepted 2026-05-03 00:59:09,688 - lava_callback - INFO - Starting async job submit for node 69f3face2fa6ff8e8ca92fb1 2026-05-03 00:59:09,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:09,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3face2fa6ff8e8ca92fb1 HTTP/1.1" 200 None 2026-05-03 00:59:09,703 - lava_callback - DEBUG - Processing node 69f3face2fa6ff8e8ca92fb1: baseline-arm64-baylibre 2026-05-03 00:59:09,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3face2fa6ff8e8ca92fb1 2026-05-03 00:59:09,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:09,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3face2fa6ff8e8ca92fb1 HTTP/1.1" 200 None 2026-05-03 00:59:09,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:09,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 00:59:09,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:09,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3face2fa6ff8e8ca92fb1 HTTP/1.1" 200 None 2026-05-03 00:59:09,759 - lava_callback - ERROR - Error processing callback for node 69f3face2fa6ff8e8ca92fb1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58442 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-03 00:59:16,342 - lava_callback - INFO - Received callback for node 69f69c471f903fec0b0de91f INFO: 172.20.0.1:58458 - "POST /node/69f69c471f903fec0b0de91f HTTP/1.0" 202 Accepted 2026-05-03 00:59:16,348 - lava_callback - INFO - Starting async job submit for node 69f69c471f903fec0b0de91f 2026-05-03 00:59:16,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:16,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c471f903fec0b0de91f HTTP/1.1" 200 None 2026-05-03 00:59:16,432 - lava_callback - DEBUG - Processing node 69f69c471f903fec0b0de91f: baseline-arm64 INFO: 172.20.0.1:58472 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:59:16,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:59:16,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:59:16,771 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c471f903fec0b0de91f/log.txt.gz 2026-05-03 00:59:16,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:59:17,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:59:17,111 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c471f903fec0b0de91f/lava-logs.yaml 2026-05-03 00:59:17,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:59:17,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:59:17,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c471f903fec0b0de91f/lava_callback.json.gz 2026-05-03 00:59:17,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:17,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c471f903fec0b0de91f HTTP/1.1" 200 None 2026-05-03 00:59:17,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:17,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 00:59:17,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:17,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c471f903fec0b0de91f HTTP/1.1" 200 None 2026-05-03 00:59:17,352 - lava_callback - INFO - Completed processing callback for node 69f69c471f903fec0b0de91f 2026-05-03 00:59:19,320 - lava_callback - INFO - Received callback for node 69f69d751f903fec0b0debe0 INFO: 172.20.0.1:58482 - "POST /node/69f69d751f903fec0b0debe0 HTTP/1.0" 202 Accepted 2026-05-03 00:59:19,326 - lava_callback - INFO - Starting async job submit for node 69f69d751f903fec0b0debe0 2026-05-03 00:59:19,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:19,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69d751f903fec0b0debe0 HTTP/1.1" 200 None 2026-05-03 00:59:19,363 - lava_callback - DEBUG - Processing node 69f69d751f903fec0b0debe0: baseline-arm-pengutronix 2026-05-03 00:59:19,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:59:19,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:59:19,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f69d751f903fec0b0debe0/log.txt.gz 2026-05-03 00:59:19,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:59:19,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:59:19,877 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f69d751f903fec0b0debe0/lava-logs.yaml 2026-05-03 00:59:19,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 00:59:20,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 00:59:20,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f69d751f903fec0b0debe0/lava_callback.json.gz 2026-05-03 00:59:20,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:20,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:20,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69d751f903fec0b0debe0 HTTP/1.1" 200 None 2026-05-03 00:59:20,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:20,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 00:59:20,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 00:59:20,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:20,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69d751f903fec0b0debe0 HTTP/1.1" 200 None 2026-05-03 00:59:20,306 - lava_callback - INFO - Completed processing callback for node 69f69d751f903fec0b0debe0 INFO: 172.20.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49548 - "GET / HTTP/1.0" 200 OK 2026-05-03 00:59:50,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 00:59:50,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36838 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:00:29,762 - lava_callback - INFO - Received callback for node 69f3fb1d2fa6ff8e8ca92fd1 INFO: 172.20.0.1:53404 - "POST /node/69f3fb1d2fa6ff8e8ca92fd1 HTTP/1.0" 202 Accepted 2026-05-03 01:00:29,768 - lava_callback - INFO - Starting async job submit for node 69f3fb1d2fa6ff8e8ca92fd1 2026-05-03 01:00:29,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:00:29,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fb1d2fa6ff8e8ca92fd1 HTTP/1.1" 200 None 2026-05-03 01:00:29,783 - lava_callback - DEBUG - Processing node 69f3fb1d2fa6ff8e8ca92fd1: baseline-arm64-baylibre 2026-05-03 01:00:29,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fb1d2fa6ff8e8ca92fd1 2026-05-03 01:00:29,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:00:29,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fb1d2fa6ff8e8ca92fd1 HTTP/1.1" 200 None 2026-05-03 01:00:29,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:00:29,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 01:00:29,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:00:29,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fb1d2fa6ff8e8ca92fd1 HTTP/1.1" 200 None 2026-05-03 01:00:29,837 - lava_callback - ERROR - Error processing callback for node 69f3fb1d2fa6ff8e8ca92fd1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-03 01:00:30,478 - lava_callback - INFO - Received callback for node 69f69c571f903fec0b0de95d INFO: 172.20.0.1:53418 - "POST /node/69f69c571f903fec0b0de95d HTTP/1.0" 202 Accepted 2026-05-03 01:00:30,485 - lava_callback - INFO - Starting async job submit for node 69f69c571f903fec0b0de95d 2026-05-03 01:00:30,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:00:30,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c571f903fec0b0de95d HTTP/1.1" 200 None 2026-05-03 01:00:30,535 - lava_callback - DEBUG - Processing node 69f69c571f903fec0b0de95d: baseline-arm64 2026-05-03 01:00:30,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:00:31,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:00:31,018 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c571f903fec0b0de95d/log.txt.gz 2026-05-03 01:00:31,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:00:31,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:00:31,423 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c571f903fec0b0de95d/lava-logs.yaml 2026-05-03 01:00:31,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:00:31,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:00:31,560 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f69c571f903fec0b0de95d/lava_callback.json.gz DEBUG: Setup failed for 69f69c571f903fec0b0de95d. Transitting job node result: incomplete -> fail 2026-05-03 01:00:31,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:00:31,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c571f903fec0b0de95d HTTP/1.1" 200 None 2026-05-03 01:00:31,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:00:31,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 01:00:31,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:00:31,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c571f903fec0b0de95d HTTP/1.1" 200 None 2026-05-03 01:00:31,786 - lava_callback - INFO - Completed processing callback for node 69f69c571f903fec0b0de95d INFO: 172.20.0.1:53432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60806 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:00:50,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:00:50,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48874 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:01:29,772 - lava_callback - INFO - Received callback for node 69f3fb672fa6ff8e8ca92ff7 INFO: 172.20.0.1:41492 - "POST /node/69f3fb672fa6ff8e8ca92ff7 HTTP/1.0" 202 Accepted 2026-05-03 01:01:29,778 - lava_callback - INFO - Starting async job submit for node 69f3fb672fa6ff8e8ca92ff7 2026-05-03 01:01:29,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:01:29,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fb672fa6ff8e8ca92ff7 HTTP/1.1" 200 None 2026-05-03 01:01:29,804 - lava_callback - DEBUG - Processing node 69f3fb672fa6ff8e8ca92ff7: baseline-arm64-baylibre 2026-05-03 01:01:29,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fb672fa6ff8e8ca92ff7 2026-05-03 01:01:29,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:01:29,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fb672fa6ff8e8ca92ff7 HTTP/1.1" 200 None 2026-05-03 01:01:29,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:01:29,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 01:01:29,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:01:29,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fb672fa6ff8e8ca92ff7 HTTP/1.1" 200 None 2026-05-03 01:01:29,887 - lava_callback - ERROR - Error processing callback for node 69f3fb672fa6ff8e8ca92ff7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34934 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:02:49,931 - lava_callback - INFO - Received callback for node 69f3fbb32fa6ff8e8ca93024 INFO: 172.20.0.1:36836 - "POST /node/69f3fbb32fa6ff8e8ca93024 HTTP/1.0" 202 Accepted 2026-05-03 01:02:49,936 - lava_callback - INFO - Starting async job submit for node 69f3fbb32fa6ff8e8ca93024 2026-05-03 01:02:49,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:02:49,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fbb32fa6ff8e8ca93024 HTTP/1.1" 200 None 2026-05-03 01:02:49,952 - lava_callback - DEBUG - Processing node 69f3fbb32fa6ff8e8ca93024: baseline-arm64-baylibre 2026-05-03 01:02:49,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fbb32fa6ff8e8ca93024 2026-05-03 01:02:49,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:02:49,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fbb32fa6ff8e8ca93024 HTTP/1.1" 200 None 2026-05-03 01:02:49,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:02:49,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 01:02:49,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:02:50,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fbb32fa6ff8e8ca93024 HTTP/1.1" 200 None 2026-05-03 01:02:50,016 - lava_callback - ERROR - Error processing callback for node 69f3fbb32fa6ff8e8ca93024: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36846 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:03:04,652 - lava_callback - INFO - Received callback for node 69f6999b1f903fec0b0de66e INFO: 172.20.0.1:47176 - "POST /node/69f6999b1f903fec0b0de66e HTTP/1.0" 202 Accepted 2026-05-03 01:03:04,697 - lava_callback - INFO - Starting async job submit for node 69f6999b1f903fec0b0de66e 2026-05-03 01:03:04,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:03:04,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6999b1f903fec0b0de66e HTTP/1.1" 200 None 2026-05-03 01:03:04,739 - lava_callback - DEBUG - Processing node 69f6999b1f903fec0b0de66e: ltp-cve 2026-05-03 01:03:04,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:03:04,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:03:04,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69f6999b1f903fec0b0de66e/log.txt.gz 2026-05-03 01:03:05,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:03:05,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:03:05,138 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69f6999b1f903fec0b0de66e/lava-logs.yaml 2026-05-03 01:03:05,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:03:05,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:03:05,230 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69f6999b1f903fec0b0de66e/lava_callback.json.gz 2026-05-03 01:03:05,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:03:05,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6999b1f903fec0b0de66e HTTP/1.1" 200 None 2026-05-03 01:03:05,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:03:05,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 01:03:05,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:03:05,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6999b1f903fec0b0de66e HTTP/1.1" 200 None 2026-05-03 01:03:05,360 - lava_callback - INFO - Completed processing callback for node 69f6999b1f903fec0b0de66e INFO: 172.20.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49824 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:03:20,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:03:20,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47446 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:04:09,995 - lava_callback - INFO - Received callback for node 69f3fbff2fa6ff8e8ca93051 INFO: 172.20.0.1:33576 - "POST /node/69f3fbff2fa6ff8e8ca93051 HTTP/1.0" 202 Accepted 2026-05-03 01:04:10,004 - lava_callback - INFO - Starting async job submit for node 69f3fbff2fa6ff8e8ca93051 2026-05-03 01:04:10,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:04:10,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fbff2fa6ff8e8ca93051 HTTP/1.1" 200 None 2026-05-03 01:04:10,047 - lava_callback - DEBUG - Processing node 69f3fbff2fa6ff8e8ca93051: baseline-arm64-baylibre 2026-05-03 01:04:10,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fbff2fa6ff8e8ca93051 2026-05-03 01:04:10,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:04:10,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fbff2fa6ff8e8ca93051 HTTP/1.1" 200 None 2026-05-03 01:04:10,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:04:10,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 01:04:10,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:04:10,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fbff2fa6ff8e8ca93051 HTTP/1.1" 200 None 2026-05-03 01:04:10,131 - lava_callback - ERROR - Error processing callback for node 69f3fbff2fa6ff8e8ca93051: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35626 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:05:30,041 - lava_callback - INFO - Received callback for node 69f3fc4a2fa6ff8e8ca93072 INFO: 172.20.0.1:60684 - "POST /node/69f3fc4a2fa6ff8e8ca93072 HTTP/1.0" 202 Accepted 2026-05-03 01:05:30,047 - lava_callback - INFO - Starting async job submit for node 69f3fc4a2fa6ff8e8ca93072 2026-05-03 01:05:30,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:05:30,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fc4a2fa6ff8e8ca93072 HTTP/1.1" 200 None 2026-05-03 01:05:30,069 - lava_callback - DEBUG - Processing node 69f3fc4a2fa6ff8e8ca93072: baseline-arm64-baylibre 2026-05-03 01:05:30,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fc4a2fa6ff8e8ca93072 2026-05-03 01:05:30,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:05:30,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fc4a2fa6ff8e8ca93072 HTTP/1.1" 200 None 2026-05-03 01:05:30,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:05:30,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 01:05:30,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:05:30,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fc4a2fa6ff8e8ca93072 HTTP/1.1" 200 None 2026-05-03 01:05:30,139 - lava_callback - ERROR - Error processing callback for node 69f3fc4a2fa6ff8e8ca93072: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43976 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:06:41,018 - lava_callback - INFO - Received callback for node 69f3fc9a2fa6ff8e8ca930a6 INFO: 172.20.0.1:38110 - "POST /node/69f3fc9a2fa6ff8e8ca930a6 HTTP/1.0" 202 Accepted 2026-05-03 01:06:41,024 - lava_callback - INFO - Starting async job submit for node 69f3fc9a2fa6ff8e8ca930a6 2026-05-03 01:06:41,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:06:41,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fc9a2fa6ff8e8ca930a6 HTTP/1.1" 200 None 2026-05-03 01:06:41,039 - lava_callback - DEBUG - Processing node 69f3fc9a2fa6ff8e8ca930a6: baseline-arm64-clabbe 2026-05-03 01:06:41,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fc9a2fa6ff8e8ca930a6 2026-05-03 01:06:41,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:06:41,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fc9a2fa6ff8e8ca930a6 HTTP/1.1" 200 None 2026-05-03 01:06:41,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:06:41,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 01:06:41,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:06:41,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fc9a2fa6ff8e8ca930a6 HTTP/1.1" 200 None 2026-05-03 01:06:41,085 - lava_callback - ERROR - Error processing callback for node 69f3fc9a2fa6ff8e8ca930a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37170 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:08:01,078 - lava_callback - INFO - Received callback for node 69f3fce42fa6ff8e8ca930c8 INFO: 172.20.0.1:41484 - "POST /node/69f3fce42fa6ff8e8ca930c8 HTTP/1.0" 202 Accepted 2026-05-03 01:08:01,084 - lava_callback - INFO - Starting async job submit for node 69f3fce42fa6ff8e8ca930c8 2026-05-03 01:08:01,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:08:01,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fce42fa6ff8e8ca930c8 HTTP/1.1" 200 None 2026-05-03 01:08:01,099 - lava_callback - DEBUG - Processing node 69f3fce42fa6ff8e8ca930c8: baseline-arm64-clabbe 2026-05-03 01:08:01,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fce42fa6ff8e8ca930c8 2026-05-03 01:08:01,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:08:01,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fce42fa6ff8e8ca930c8 HTTP/1.1" 200 None 2026-05-03 01:08:01,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:08:01,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 01:08:01,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:08:01,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fce42fa6ff8e8ca930c8 HTTP/1.1" 200 None 2026-05-03 01:08:01,149 - lava_callback - ERROR - Error processing callback for node 69f3fce42fa6ff8e8ca930c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46688 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:09:21,105 - lava_callback - INFO - Received callback for node 69f3fd2f2fa6ff8e8ca930f5 INFO: 172.20.0.1:52222 - "POST /node/69f3fd2f2fa6ff8e8ca930f5 HTTP/1.0" 202 Accepted 2026-05-03 01:09:21,111 - lava_callback - INFO - Starting async job submit for node 69f3fd2f2fa6ff8e8ca930f5 2026-05-03 01:09:21,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:09:21,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fd2f2fa6ff8e8ca930f5 HTTP/1.1" 200 None 2026-05-03 01:09:21,126 - lava_callback - DEBUG - Processing node 69f3fd2f2fa6ff8e8ca930f5: baseline-arm64-clabbe 2026-05-03 01:09:21,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fd2f2fa6ff8e8ca930f5 2026-05-03 01:09:21,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:09:21,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fd2f2fa6ff8e8ca930f5 HTTP/1.1" 200 None 2026-05-03 01:09:21,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:09:21,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 01:09:21,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:09:21,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fd2f2fa6ff8e8ca930f5 HTTP/1.1" 200 None 2026-05-03 01:09:21,171 - lava_callback - ERROR - Error processing callback for node 69f3fd2f2fa6ff8e8ca930f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56434 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:10:41,161 - lava_callback - INFO - Received callback for node 69f3fd7a2fa6ff8e8ca93111 INFO: 172.20.0.1:51490 - "POST /node/69f3fd7a2fa6ff8e8ca93111 HTTP/1.0" 202 Accepted 2026-05-03 01:10:41,167 - lava_callback - INFO - Starting async job submit for node 69f3fd7a2fa6ff8e8ca93111 2026-05-03 01:10:41,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:10:41,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fd7a2fa6ff8e8ca93111 HTTP/1.1" 200 None 2026-05-03 01:10:41,186 - lava_callback - DEBUG - Processing node 69f3fd7a2fa6ff8e8ca93111: baseline-arm64-clabbe 2026-05-03 01:10:41,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fd7a2fa6ff8e8ca93111 2026-05-03 01:10:41,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:10:41,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fd7a2fa6ff8e8ca93111 HTTP/1.1" 200 None 2026-05-03 01:10:41,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:10:41,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 01:10:41,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:10:41,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fd7a2fa6ff8e8ca93111 HTTP/1.1" 200 None 2026-05-03 01:10:41,235 - lava_callback - ERROR - Error processing callback for node 69f3fd7a2fa6ff8e8ca93111: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55428 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:11:41,200 - lava_callback - INFO - Received callback for node 69f3fdc72fa6ff8e8ca93139 INFO: 172.20.0.1:39754 - "POST /node/69f3fdc72fa6ff8e8ca93139 HTTP/1.0" 202 Accepted 2026-05-03 01:11:41,205 - lava_callback - INFO - Starting async job submit for node 69f3fdc72fa6ff8e8ca93139 2026-05-03 01:11:41,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:11:41,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fdc72fa6ff8e8ca93139 HTTP/1.1" 200 None 2026-05-03 01:11:41,226 - lava_callback - DEBUG - Processing node 69f3fdc72fa6ff8e8ca93139: baseline-arm64-clabbe 2026-05-03 01:11:41,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fdc72fa6ff8e8ca93139 2026-05-03 01:11:41,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:11:41,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fdc72fa6ff8e8ca93139 HTTP/1.1" 200 None 2026-05-03 01:11:41,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:11:41,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 01:11:41,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:11:41,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fdc72fa6ff8e8ca93139 HTTP/1.1" 200 None 2026-05-03 01:11:41,274 - lava_callback - ERROR - Error processing callback for node 69f3fdc72fa6ff8e8ca93139: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32922 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:12:29,966 - lava_callback - INFO - Received callback for node 69f6a0e61f903fec0b0dee03 INFO: 172.20.0.1:55152 - "POST /node/69f6a0e61f903fec0b0dee03 HTTP/1.0" 202 Accepted 2026-05-03 01:12:29,973 - lava_callback - INFO - Starting async job submit for node 69f6a0e61f903fec0b0dee03 2026-05-03 01:12:29,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:12:30,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a0e61f903fec0b0dee03 HTTP/1.1" 200 None 2026-05-03 01:12:30,004 - lava_callback - DEBUG - Processing node 69f6a0e61f903fec0b0dee03: baseline-arm 2026-05-03 01:12:30,009 - lava_callback - WARNING - Failed to upload log 2026-05-03 01:12:30,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:12:30,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:12:30,108 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f6a0e61f903fec0b0dee03/lava-logs.yaml 2026-05-03 01:12:30,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:12:30,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:12:30,217 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f6a0e61f903fec0b0dee03/lava_callback.json.gz 2026-05-03 01:12:30,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:12:30,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a0e61f903fec0b0dee03 HTTP/1.1" 200 None 2026-05-03 01:12:30,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:12:30,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 01:12:30,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:12:30,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a0e61f903fec0b0dee03 HTTP/1.1" 200 None 2026-05-03 01:12:30,301 - lava_callback - INFO - Completed processing callback for node 69f6a0e61f903fec0b0dee03 INFO: 172.20.0.1:55158 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:12:38,181 - lava_callback - INFO - Received callback for node 69f69c5c1f903fec0b0de96b INFO: 172.20.0.1:55162 - "POST /node/69f69c5c1f903fec0b0de96b HTTP/1.0" 202 Accepted 2026-05-03 01:12:38,189 - lava_callback - INFO - Starting async job submit for node 69f69c5c1f903fec0b0de96b 2026-05-03 01:12:38,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:12:38,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c5c1f903fec0b0de96b HTTP/1.1" 200 None 2026-05-03 01:12:38,247 - lava_callback - DEBUG - Processing node 69f69c5c1f903fec0b0de96b: baseline-nfs-arm64 2026-05-03 01:12:39,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:12:39,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:12:39,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5c1f903fec0b0de96b/log.txt.gz 2026-05-03 01:12:40,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:12:40,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:12:40,250 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5c1f903fec0b0de96b/lava-logs.yaml 2026-05-03 01:12:40,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:12:40,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:12:40,428 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f69c5c1f903fec0b0de96b/lava_callback.json.gz DEBUG: Setup failed for 69f69c5c1f903fec0b0de96b. Transitting job node result: incomplete -> fail 2026-05-03 01:12:40,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:12:40,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f69c5c1f903fec0b0de96b HTTP/1.1" 200 None 2026-05-03 01:12:40,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:12:40,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 01:12:40,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:12:40,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f69c5c1f903fec0b0de96b HTTP/1.1" 200 None 2026-05-03 01:12:40,660 - lava_callback - INFO - Completed processing callback for node 69f69c5c1f903fec0b0de96b INFO: 172.20.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52474 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:12:50,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:12:50,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54862 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:13:01,250 - lava_callback - INFO - Received callback for node 69f3fe122fa6ff8e8ca93156 INFO: 172.20.0.1:46492 - "POST /node/69f3fe122fa6ff8e8ca93156 HTTP/1.0" 202 Accepted 2026-05-03 01:13:01,256 - lava_callback - INFO - Starting async job submit for node 69f3fe122fa6ff8e8ca93156 2026-05-03 01:13:01,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:13:01,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fe122fa6ff8e8ca93156 HTTP/1.1" 200 None 2026-05-03 01:13:01,277 - lava_callback - DEBUG - Processing node 69f3fe122fa6ff8e8ca93156: baseline-arm64-clabbe 2026-05-03 01:13:01,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fe122fa6ff8e8ca93156 2026-05-03 01:13:01,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:13:01,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fe122fa6ff8e8ca93156 HTTP/1.1" 200 None 2026-05-03 01:13:01,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:13:01,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 01:13:01,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:13:01,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fe122fa6ff8e8ca93156 HTTP/1.1" 200 None 2026-05-03 01:13:01,322 - lava_callback - ERROR - Error processing callback for node 69f3fe122fa6ff8e8ca93156: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59328 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:14:05,270 - lava_callback - INFO - Received callback for node 69f6999f1f903fec0b0de677 INFO: 172.20.0.1:44630 - "POST /node/69f6999f1f903fec0b0de677 HTTP/1.0" 202 Accepted 2026-05-03 01:14:05,276 - lava_callback - INFO - Starting async job submit for node 69f6999f1f903fec0b0de677 2026-05-03 01:14:05,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:14:05,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6999f1f903fec0b0de677 HTTP/1.1" 200 None 2026-05-03 01:14:05,326 - lava_callback - DEBUG - Processing node 69f6999f1f903fec0b0de677: ltp-fsx 2026-05-03 01:14:05,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:14:05,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:14:05,863 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69f6999f1f903fec0b0de677/log.txt.gz 2026-05-03 01:14:06,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:14:06,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:14:06,353 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69f6999f1f903fec0b0de677/lava-logs.yaml 2026-05-03 01:14:06,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:14:06,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:14:06,480 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69f6999f1f903fec0b0de677/lava_callback.json.gz INFO: 172.20.0.1:44636 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:14:06,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:14:06,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6999f1f903fec0b0de677 HTTP/1.1" 200 None 2026-05-03 01:14:06,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:14:06,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 01:14:06,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:14:06,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6999f1f903fec0b0de677 HTTP/1.1" 200 None 2026-05-03 01:14:06,698 - lava_callback - INFO - Completed processing callback for node 69f6999f1f903fec0b0de677 INFO: 172.20.0.1:38784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38794 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:14:20,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:14:20,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 01:14:21,324 - lava_callback - INFO - Received callback for node 69f3fe5d2fa6ff8e8ca93181 INFO: 172.20.0.1:48882 - "POST /node/69f3fe5d2fa6ff8e8ca93181 HTTP/1.0" 202 Accepted 2026-05-03 01:14:21,330 - lava_callback - INFO - Starting async job submit for node 69f3fe5d2fa6ff8e8ca93181 2026-05-03 01:14:21,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:14:21,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fe5d2fa6ff8e8ca93181 HTTP/1.1" 200 None 2026-05-03 01:14:21,347 - lava_callback - DEBUG - Processing node 69f3fe5d2fa6ff8e8ca93181: baseline-arm64-clabbe 2026-05-03 01:14:21,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fe5d2fa6ff8e8ca93181 2026-05-03 01:14:21,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:14:21,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fe5d2fa6ff8e8ca93181 HTTP/1.1" 200 None 2026-05-03 01:14:21,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:14:21,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 01:14:21,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:14:21,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fe5d2fa6ff8e8ca93181 HTTP/1.1" 200 None 2026-05-03 01:14:21,393 - lava_callback - ERROR - Error processing callback for node 69f3fe5d2fa6ff8e8ca93181: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49150 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:15:41,382 - lava_callback - INFO - Received callback for node 69f3fea82fa6ff8e8ca9319d INFO: 172.20.0.1:47394 - "POST /node/69f3fea82fa6ff8e8ca9319d HTTP/1.0" 202 Accepted 2026-05-03 01:15:41,387 - lava_callback - INFO - Starting async job submit for node 69f3fea82fa6ff8e8ca9319d 2026-05-03 01:15:41,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:15:41,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fea82fa6ff8e8ca9319d HTTP/1.1" 200 None 2026-05-03 01:15:41,403 - lava_callback - DEBUG - Processing node 69f3fea82fa6ff8e8ca9319d: baseline-arm64-clabbe 2026-05-03 01:15:41,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fea82fa6ff8e8ca9319d 2026-05-03 01:15:41,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:15:41,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fea82fa6ff8e8ca9319d HTTP/1.1" 200 None 2026-05-03 01:15:41,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:15:41,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 01:15:41,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:15:41,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fea82fa6ff8e8ca9319d HTTP/1.1" 200 None 2026-05-03 01:15:41,447 - lava_callback - ERROR - Error processing callback for node 69f3fea82fa6ff8e8ca9319d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45150 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:16:48,203 - lava_callback - INFO - Received callback for node 69f6a1de1f903fec0b0dee98 INFO: 172.20.0.1:45152 - "POST /node/69f6a1de1f903fec0b0dee98 HTTP/1.0" 202 Accepted 2026-05-03 01:16:48,249 - lava_callback - INFO - Starting async job submit for node 69f6a1de1f903fec0b0dee98 2026-05-03 01:16:48,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:16:48,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a1de1f903fec0b0dee98 HTTP/1.1" 200 None 2026-05-03 01:16:48,281 - lava_callback - DEBUG - Processing node 69f6a1de1f903fec0b0dee98: baseline-arm 2026-05-03 01:16:48,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:16:48,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:16:48,717 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f6a1de1f903fec0b0dee98/log.txt.gz 2026-05-03 01:16:48,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:16:48,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:16:48,943 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f6a1de1f903fec0b0dee98/lava-logs.yaml 2026-05-03 01:16:48,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:16:49,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:16:49,064 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f6a1de1f903fec0b0dee98/lava_callback.json.gz 2026-05-03 01:16:49,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:16:49,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a1de1f903fec0b0dee98 HTTP/1.1" 200 None 2026-05-03 01:16:49,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:16:49,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 01:16:49,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:16:49,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a1de1f903fec0b0dee98 HTTP/1.1" 200 None 2026-05-03 01:16:49,135 - lava_callback - INFO - Completed processing callback for node 69f6a1de1f903fec0b0dee98 2026-05-03 01:16:50,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:16:50,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37408 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:17:15,110 - lava_callback - INFO - Received callback for node 69f6a1dd1f903fec0b0dee95 INFO: 172.20.0.1:41584 - "POST /node/69f6a1dd1f903fec0b0dee95 HTTP/1.0" 202 Accepted 2026-05-03 01:17:15,158 - lava_callback - INFO - Starting async job submit for node 69f6a1dd1f903fec0b0dee95 INFO: 172.20.0.1:41598 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-03 01:17:15,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:17:15,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a1dd1f903fec0b0dee95 HTTP/1.1" 200 None 2026-05-03 01:17:15,192 - lava_callback - DEBUG - Processing node 69f6a1dd1f903fec0b0dee95: baseline-arm 2026-05-03 01:17:15,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:17:15,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:17:15,424 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f6a1dd1f903fec0b0dee95/log.txt.gz 2026-05-03 01:17:15,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:17:15,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:17:15,637 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f6a1dd1f903fec0b0dee95/lava-logs.yaml 2026-05-03 01:17:15,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:17:15,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:17:15,769 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f6a1dd1f903fec0b0dee95/lava_callback.json.gz 2026-05-03 01:17:15,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:17:15,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a1dd1f903fec0b0dee95 HTTP/1.1" 200 None 2026-05-03 01:17:15,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:17:15,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 01:17:15,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:17:15,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a1dd1f903fec0b0dee95 HTTP/1.1" 200 None 2026-05-03 01:17:15,838 - lava_callback - INFO - Completed processing callback for node 69f6a1dd1f903fec0b0dee95 INFO: 172.20.0.1:41602 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:17:20,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:17:20,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35712 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:19:01,466 - lava_callback - INFO - Received callback for node 69f3ff7a2fa6ff8e8ca93208 INFO: 172.20.0.1:46428 - "POST /node/69f3ff7a2fa6ff8e8ca93208 HTTP/1.0" 202 Accepted 2026-05-03 01:19:01,472 - lava_callback - INFO - Starting async job submit for node 69f3ff7a2fa6ff8e8ca93208 2026-05-03 01:19:01,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:19:01,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3ff7a2fa6ff8e8ca93208 HTTP/1.1" 200 None 2026-05-03 01:19:01,491 - lava_callback - DEBUG - Processing node 69f3ff7a2fa6ff8e8ca93208: baseline-arm-clabbe 2026-05-03 01:19:01,491 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3ff7a2fa6ff8e8ca93208 2026-05-03 01:19:01,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:19:01,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3ff7a2fa6ff8e8ca93208 HTTP/1.1" 200 None 2026-05-03 01:19:01,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:19:01,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 01:19:01,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:19:01,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3ff7a2fa6ff8e8ca93208 HTTP/1.1" 200 None 2026-05-03 01:19:01,556 - lava_callback - ERROR - Error processing callback for node 69f3ff7a2fa6ff8e8ca93208: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48904 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:19:41,447 - lava_callback - INFO - Received callback for node 69f3ffa12fa6ff8e8ca93222 INFO: 172.20.0.1:55954 - "POST /node/69f3ffa12fa6ff8e8ca93222 HTTP/1.0" 202 Accepted 2026-05-03 01:19:41,454 - lava_callback - INFO - Starting async job submit for node 69f3ffa12fa6ff8e8ca93222 2026-05-03 01:19:41,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:19:41,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3ffa12fa6ff8e8ca93222 HTTP/1.1" 200 None 2026-05-03 01:19:41,470 - lava_callback - DEBUG - Processing node 69f3ffa12fa6ff8e8ca93222: baseline-arm-clabbe 2026-05-03 01:19:41,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3ffa12fa6ff8e8ca93222 2026-05-03 01:19:41,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:19:41,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3ffa12fa6ff8e8ca93222 HTTP/1.1" 200 None 2026-05-03 01:19:41,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:19:41,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 01:19:41,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:19:41,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3ffa12fa6ff8e8ca93222 HTTP/1.1" 200 None 2026-05-03 01:19:41,515 - lava_callback - ERROR - Error processing callback for node 69f3ffa12fa6ff8e8ca93222: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34784 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:20:21,545 - lava_callback - INFO - Received callback for node 69f3ffca2fa6ff8e8ca9322b INFO: 172.20.0.1:34086 - "POST /node/69f3ffca2fa6ff8e8ca9322b HTTP/1.0" 202 Accepted 2026-05-03 01:20:21,551 - lava_callback - INFO - Starting async job submit for node 69f3ffca2fa6ff8e8ca9322b 2026-05-03 01:20:21,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:20:21,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3ffca2fa6ff8e8ca9322b HTTP/1.1" 200 None 2026-05-03 01:20:21,566 - lava_callback - DEBUG - Processing node 69f3ffca2fa6ff8e8ca9322b: baseline-arm-clabbe 2026-05-03 01:20:21,566 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3ffca2fa6ff8e8ca9322b 2026-05-03 01:20:21,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:20:21,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3ffca2fa6ff8e8ca9322b HTTP/1.1" 200 None 2026-05-03 01:20:21,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:20:21,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 01:20:21,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:20:21,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3ffca2fa6ff8e8ca9322b HTTP/1.1" 200 None 2026-05-03 01:20:21,619 - lava_callback - ERROR - Error processing callback for node 69f3ffca2fa6ff8e8ca9322b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49136 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:21:01,511 - lava_callback - INFO - Received callback for node 69f3fff22fa6ff8e8ca9323e INFO: 172.20.0.1:47574 - "POST /node/69f3fff22fa6ff8e8ca9323e HTTP/1.0" 202 Accepted 2026-05-03 01:21:01,517 - lava_callback - INFO - Starting async job submit for node 69f3fff22fa6ff8e8ca9323e 2026-05-03 01:21:01,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:21:01,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fff22fa6ff8e8ca9323e HTTP/1.1" 200 None 2026-05-03 01:21:01,533 - lava_callback - DEBUG - Processing node 69f3fff22fa6ff8e8ca9323e: baseline-arm-clabbe 2026-05-03 01:21:01,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f3fff22fa6ff8e8ca9323e 2026-05-03 01:21:01,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:21:01,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f3fff22fa6ff8e8ca9323e HTTP/1.1" 200 None 2026-05-03 01:21:01,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:21:01,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 01:21:01,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:21:01,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f3fff22fa6ff8e8ca9323e HTTP/1.1" 200 None 2026-05-03 01:21:01,588 - lava_callback - ERROR - Error processing callback for node 69f3fff22fa6ff8e8ca9323e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59954 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:21:41,615 - lava_callback - INFO - Received callback for node 69f400192fa6ff8e8ca93259 INFO: 172.20.0.1:38024 - "POST /node/69f400192fa6ff8e8ca93259 HTTP/1.0" 202 Accepted 2026-05-03 01:21:41,620 - lava_callback - INFO - Starting async job submit for node 69f400192fa6ff8e8ca93259 2026-05-03 01:21:41,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:21:41,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f400192fa6ff8e8ca93259 HTTP/1.1" 200 None 2026-05-03 01:21:41,637 - lava_callback - DEBUG - Processing node 69f400192fa6ff8e8ca93259: baseline-arm-clabbe 2026-05-03 01:21:41,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f400192fa6ff8e8ca93259 2026-05-03 01:21:41,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:21:41,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f400192fa6ff8e8ca93259 HTTP/1.1" 200 None 2026-05-03 01:21:41,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:21:41,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 01:21:41,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:21:41,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f400192fa6ff8e8ca93259 HTTP/1.1" 200 None 2026-05-03 01:21:41,691 - lava_callback - ERROR - Error processing callback for node 69f400192fa6ff8e8ca93259: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33816 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:22:21,569 - lava_callback - INFO - Received callback for node 69f4003f2fa6ff8e8ca93264 INFO: 172.20.0.1:55354 - "POST /node/69f4003f2fa6ff8e8ca93264 HTTP/1.0" 202 Accepted 2026-05-03 01:22:21,575 - lava_callback - INFO - Starting async job submit for node 69f4003f2fa6ff8e8ca93264 2026-05-03 01:22:21,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:22:21,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4003f2fa6ff8e8ca93264 HTTP/1.1" 200 None 2026-05-03 01:22:21,597 - lava_callback - DEBUG - Processing node 69f4003f2fa6ff8e8ca93264: baseline-arm-clabbe 2026-05-03 01:22:21,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4003f2fa6ff8e8ca93264 2026-05-03 01:22:21,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:22:21,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4003f2fa6ff8e8ca93264 HTTP/1.1" 200 None 2026-05-03 01:22:21,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:22:21,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 01:22:21,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:22:21,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4003f2fa6ff8e8ca93264 HTTP/1.1" 200 None 2026-05-03 01:22:21,644 - lava_callback - ERROR - Error processing callback for node 69f4003f2fa6ff8e8ca93264: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36774 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:23:01,704 - lava_callback - INFO - Received callback for node 69f400672fa6ff8e8ca93277 INFO: 172.20.0.1:58642 - "POST /node/69f400672fa6ff8e8ca93277 HTTP/1.0" 202 Accepted 2026-05-03 01:23:01,709 - lava_callback - INFO - Starting async job submit for node 69f400672fa6ff8e8ca93277 2026-05-03 01:23:01,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:23:01,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f400672fa6ff8e8ca93277 HTTP/1.1" 200 None 2026-05-03 01:23:01,724 - lava_callback - DEBUG - Processing node 69f400672fa6ff8e8ca93277: baseline-arm-clabbe 2026-05-03 01:23:01,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f400672fa6ff8e8ca93277 2026-05-03 01:23:01,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:23:01,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f400672fa6ff8e8ca93277 HTTP/1.1" 200 None 2026-05-03 01:23:01,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:23:01,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 01:23:01,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:23:01,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f400672fa6ff8e8ca93277 HTTP/1.1" 200 None 2026-05-03 01:23:01,780 - lava_callback - ERROR - Error processing callback for node 69f400672fa6ff8e8ca93277: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36390 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:23:41,711 - lava_callback - INFO - Received callback for node 69f4008e2fa6ff8e8ca93286 INFO: 172.20.0.1:48760 - "POST /node/69f4008e2fa6ff8e8ca93286 HTTP/1.0" 202 Accepted 2026-05-03 01:23:41,717 - lava_callback - INFO - Starting async job submit for node 69f4008e2fa6ff8e8ca93286 2026-05-03 01:23:41,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:23:41,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4008e2fa6ff8e8ca93286 HTTP/1.1" 200 None 2026-05-03 01:23:41,741 - lava_callback - DEBUG - Processing node 69f4008e2fa6ff8e8ca93286: baseline-arm-clabbe 2026-05-03 01:23:41,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4008e2fa6ff8e8ca93286 2026-05-03 01:23:41,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:23:41,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4008e2fa6ff8e8ca93286 HTTP/1.1" 200 None 2026-05-03 01:23:41,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:23:41,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 01:23:41,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:23:41,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4008e2fa6ff8e8ca93286 HTTP/1.1" 200 None 2026-05-03 01:23:41,790 - lava_callback - ERROR - Error processing callback for node 69f4008e2fa6ff8e8ca93286: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42872 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:24:21,800 - lava_callback - INFO - Received callback for node 69f400b62fa6ff8e8ca93295 INFO: 172.20.0.1:58088 - "POST /node/69f400b62fa6ff8e8ca93295 HTTP/1.0" 202 Accepted 2026-05-03 01:24:21,805 - lava_callback - INFO - Starting async job submit for node 69f400b62fa6ff8e8ca93295 2026-05-03 01:24:21,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:24:21,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f400b62fa6ff8e8ca93295 HTTP/1.1" 200 None 2026-05-03 01:24:21,820 - lava_callback - DEBUG - Processing node 69f400b62fa6ff8e8ca93295: baseline-arm-clabbe 2026-05-03 01:24:21,820 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f400b62fa6ff8e8ca93295 2026-05-03 01:24:21,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:24:21,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f400b62fa6ff8e8ca93295 HTTP/1.1" 200 None 2026-05-03 01:24:21,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:24:21,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 01:24:21,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:24:21,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f400b62fa6ff8e8ca93295 HTTP/1.1" 200 None 2026-05-03 01:24:21,863 - lava_callback - ERROR - Error processing callback for node 69f400b62fa6ff8e8ca93295: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35212 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:25:10,449 - lava_callback - INFO - Received callback for node 69f6a3de1f903fec0b0defd3 INFO: 172.20.0.1:34588 - "POST /node/69f6a3de1f903fec0b0defd3 HTTP/1.0" 202 Accepted 2026-05-03 01:25:10,455 - lava_callback - INFO - Starting async job submit for node 69f6a3de1f903fec0b0defd3 2026-05-03 01:25:10,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:25:10,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a3de1f903fec0b0defd3 HTTP/1.1" 200 None 2026-05-03 01:25:10,471 - lava_callback - DEBUG - Processing node 69f6a3de1f903fec0b0defd3: baseline-nfs-arm64 2026-05-03 01:25:10,473 - lava_callback - WARNING - Failed to upload log 2026-05-03 01:25:10,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:25:10,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:25:10,586 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6a3de1f903fec0b0defd3/lava-logs.yaml 2026-05-03 01:25:10,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:25:10,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:25:10,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6a3de1f903fec0b0defd3/lava_callback.json.gz 2026-05-03 01:25:10,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:25:10,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a3de1f903fec0b0defd3 HTTP/1.1" 200 None 2026-05-03 01:25:10,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:25:10,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 01:25:10,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:25:10,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a3de1f903fec0b0defd3 HTTP/1.1" 200 None 2026-05-03 01:25:10,917 - lava_callback - INFO - Completed processing callback for node 69f6a3de1f903fec0b0defd3 INFO: 172.20.0.1:34594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34610 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:25:20,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:25:20,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59952 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:25:55,194 - lava_callback - INFO - Received callback for node 69f4011c2fa6ff8e8ca932b4 INFO: 172.20.0.1:54440 - "POST /node/69f4011c2fa6ff8e8ca932b4 HTTP/1.0" 202 Accepted 2026-05-03 01:25:55,199 - lava_callback - INFO - Starting async job submit for node 69f4011c2fa6ff8e8ca932b4 2026-05-03 01:25:55,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:25:55,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4011c2fa6ff8e8ca932b4 HTTP/1.1" 200 None 2026-05-03 01:25:55,221 - lava_callback - DEBUG - Processing node 69f4011c2fa6ff8e8ca932b4: baseline-arm-baylibre 2026-05-03 01:25:55,222 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4011c2fa6ff8e8ca932b4 2026-05-03 01:25:55,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:25:55,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4011c2fa6ff8e8ca932b4 HTTP/1.1" 200 None 2026-05-03 01:25:55,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:25:55,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:25:55,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:25:55,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4011c2fa6ff8e8ca932b4 HTTP/1.1" 200 None 2026-05-03 01:25:55,269 - lava_callback - ERROR - Error processing callback for node 69f4011c2fa6ff8e8ca932b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35162 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:26:31,270 - lava_callback - INFO - Received callback for node 69f401432fa6ff8e8ca932c5 INFO: 172.20.0.1:38836 - "POST /node/69f401432fa6ff8e8ca932c5 HTTP/1.0" 202 Accepted 2026-05-03 01:26:31,275 - lava_callback - INFO - Starting async job submit for node 69f401432fa6ff8e8ca932c5 2026-05-03 01:26:31,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:26:31,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f401432fa6ff8e8ca932c5 HTTP/1.1" 200 None 2026-05-03 01:26:31,291 - lava_callback - DEBUG - Processing node 69f401432fa6ff8e8ca932c5: baseline-arm-baylibre 2026-05-03 01:26:31,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f401432fa6ff8e8ca932c5 2026-05-03 01:26:31,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:26:31,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f401432fa6ff8e8ca932c5 HTTP/1.1" 200 None 2026-05-03 01:26:31,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:26:31,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:26:31,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:26:31,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f401432fa6ff8e8ca932c5 HTTP/1.1" 200 None 2026-05-03 01:26:31,356 - lava_callback - ERROR - Error processing callback for node 69f401432fa6ff8e8ca932c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33936 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:27:11,330 - lava_callback - INFO - Received callback for node 69f4016b2fa6ff8e8ca932d2 INFO: 172.20.0.1:56068 - "POST /node/69f4016b2fa6ff8e8ca932d2 HTTP/1.0" 202 Accepted 2026-05-03 01:27:11,336 - lava_callback - INFO - Starting async job submit for node 69f4016b2fa6ff8e8ca932d2 2026-05-03 01:27:11,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:27:11,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4016b2fa6ff8e8ca932d2 HTTP/1.1" 200 None 2026-05-03 01:27:11,350 - lava_callback - DEBUG - Processing node 69f4016b2fa6ff8e8ca932d2: baseline-arm-baylibre 2026-05-03 01:27:11,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4016b2fa6ff8e8ca932d2 2026-05-03 01:27:11,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:27:11,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4016b2fa6ff8e8ca932d2 HTTP/1.1" 200 None 2026-05-03 01:27:11,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:27:11,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:27:11,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:27:11,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4016b2fa6ff8e8ca932d2 HTTP/1.1" 200 None 2026-05-03 01:27:11,399 - lava_callback - ERROR - Error processing callback for node 69f4016b2fa6ff8e8ca932d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58678 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:27:51,274 - lava_callback - INFO - Received callback for node 69f401912fa6ff8e8ca932e1 INFO: 172.20.0.1:37872 - "POST /node/69f401912fa6ff8e8ca932e1 HTTP/1.0" 202 Accepted 2026-05-03 01:27:51,280 - lava_callback - INFO - Starting async job submit for node 69f401912fa6ff8e8ca932e1 2026-05-03 01:27:51,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:27:51,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f401912fa6ff8e8ca932e1 HTTP/1.1" 200 None 2026-05-03 01:27:51,299 - lava_callback - DEBUG - Processing node 69f401912fa6ff8e8ca932e1: baseline-arm-baylibre 2026-05-03 01:27:51,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f401912fa6ff8e8ca932e1 2026-05-03 01:27:51,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:27:51,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f401912fa6ff8e8ca932e1 HTTP/1.1" 200 None 2026-05-03 01:27:51,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:27:51,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:27:51,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:27:51,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f401912fa6ff8e8ca932e1 HTTP/1.1" 200 None 2026-05-03 01:27:51,345 - lava_callback - ERROR - Error processing callback for node 69f401912fa6ff8e8ca932e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49404 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:28:08,564 - lava_callback - INFO - Received callback for node 69f6a46a1f903fec0b0df029 INFO: 172.20.0.1:49412 - "POST /node/69f6a46a1f903fec0b0df029 HTTP/1.0" 202 Accepted 2026-05-03 01:28:08,571 - lava_callback - INFO - Starting async job submit for node 69f6a46a1f903fec0b0df029 2026-05-03 01:28:08,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:08,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a46a1f903fec0b0df029 HTTP/1.1" 200 None 2026-05-03 01:28:08,615 - lava_callback - DEBUG - Processing node 69f6a46a1f903fec0b0df029: baseline-arm64 2026-05-03 01:28:08,745 - lava_callback - WARNING - Failed to upload log 2026-05-03 01:28:08,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:28:09,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:28:09,128 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a46a1f903fec0b0df029/lava-logs.yaml 2026-05-03 01:28:09,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:28:09,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:28:09,257 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a46a1f903fec0b0df029/lava_callback.json.gz 2026-05-03 01:28:09,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:09,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a46a1f903fec0b0df029 HTTP/1.1" 200 None 2026-05-03 01:28:09,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:09,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 01:28:09,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:09,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a46a1f903fec0b0df029 HTTP/1.1" 200 None 2026-05-03 01:28:09,423 - lava_callback - INFO - Completed processing callback for node 69f6a46a1f903fec0b0df029 INFO: 172.20.0.1:33718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33726 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:28:20,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:20,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48678 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:28:31,421 - lava_callback - INFO - Received callback for node 69f401b82fa6ff8e8ca932f0 INFO: 172.20.0.1:41598 - "POST /node/69f401b82fa6ff8e8ca932f0 HTTP/1.0" 202 Accepted 2026-05-03 01:28:31,426 - lava_callback - INFO - Starting async job submit for node 69f401b82fa6ff8e8ca932f0 2026-05-03 01:28:31,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:31,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f401b82fa6ff8e8ca932f0 HTTP/1.1" 200 None 2026-05-03 01:28:31,442 - lava_callback - DEBUG - Processing node 69f401b82fa6ff8e8ca932f0: baseline-arm-baylibre 2026-05-03 01:28:31,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f401b82fa6ff8e8ca932f0 2026-05-03 01:28:31,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:31,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f401b82fa6ff8e8ca932f0 HTTP/1.1" 200 None 2026-05-03 01:28:31,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:31,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:28:31,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:31,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f401b82fa6ff8e8ca932f0 HTTP/1.1" 200 None 2026-05-03 01:28:31,514 - lava_callback - ERROR - Error processing callback for node 69f401b82fa6ff8e8ca932f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53794 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:28:57,646 - lava_callback - INFO - Received callback for node 69f6a4b21f903fec0b0df04d INFO: 172.20.0.1:53804 - "POST /node/69f6a4b21f903fec0b0df04d HTTP/1.0" 202 Accepted 2026-05-03 01:28:57,654 - lava_callback - INFO - Starting async job submit for node 69f6a4b21f903fec0b0df04d 2026-05-03 01:28:57,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:57,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a4b21f903fec0b0df04d HTTP/1.1" 200 None 2026-05-03 01:28:57,702 - lava_callback - DEBUG - Processing node 69f6a4b21f903fec0b0df04d: baseline-arm64 2026-05-03 01:28:57,834 - lava_callback - WARNING - Failed to upload log 2026-05-03 01:28:57,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:28:58,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:28:58,026 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a4b21f903fec0b0df04d/lava-logs.yaml 2026-05-03 01:28:58,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:28:58,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:28:58,105 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a4b21f903fec0b0df04d/lava_callback.json.gz 2026-05-03 01:28:58,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:58,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a4b21f903fec0b0df04d HTTP/1.1" 200 None 2026-05-03 01:28:58,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:58,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 01:28:58,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:28:58,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a4b21f903fec0b0df04d HTTP/1.1" 200 None 2026-05-03 01:28:58,263 - lava_callback - INFO - Completed processing callback for node 69f6a4b21f903fec0b0df04d INFO: 172.20.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56046 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:29:20,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:29:20,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49302 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:29:51,398 - lava_callback - INFO - Received callback for node 69f402052fa6ff8e8ca93310 INFO: 172.20.0.1:45804 - "POST /node/69f402052fa6ff8e8ca93310 HTTP/1.0" 202 Accepted 2026-05-03 01:29:51,403 - lava_callback - INFO - Starting async job submit for node 69f402052fa6ff8e8ca93310 2026-05-03 01:29:51,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:29:51,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f402052fa6ff8e8ca93310 HTTP/1.1" 200 None 2026-05-03 01:29:51,418 - lava_callback - DEBUG - Processing node 69f402052fa6ff8e8ca93310: baseline-arm-baylibre 2026-05-03 01:29:51,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f402052fa6ff8e8ca93310 2026-05-03 01:29:51,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:29:51,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f402052fa6ff8e8ca93310 HTTP/1.1" 200 None 2026-05-03 01:29:51,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:29:51,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:29:51,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:29:51,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f402052fa6ff8e8ca93310 HTTP/1.1" 200 None 2026-05-03 01:29:51,464 - lava_callback - ERROR - Error processing callback for node 69f402052fa6ff8e8ca93310: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52368 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:31:01,990 - lava_callback - INFO - Received callback for node 69f402522fa6ff8e8ca9332c INFO: 172.20.0.1:39686 - "POST /node/69f402522fa6ff8e8ca9332c HTTP/1.0" 202 Accepted 2026-05-03 01:31:01,996 - lava_callback - INFO - Starting async job submit for node 69f402522fa6ff8e8ca9332c 2026-05-03 01:31:01,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:31:02,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f402522fa6ff8e8ca9332c HTTP/1.1" 200 None 2026-05-03 01:31:02,016 - lava_callback - DEBUG - Processing node 69f402522fa6ff8e8ca9332c: baseline-arm-clabbe 2026-05-03 01:31:02,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f402522fa6ff8e8ca9332c 2026-05-03 01:31:02,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:31:02,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f402522fa6ff8e8ca9332c HTTP/1.1" 200 None 2026-05-03 01:31:02,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:31:02,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:31:02,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:31:02,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f402522fa6ff8e8ca9332c HTTP/1.1" 200 None 2026-05-03 01:31:02,061 - lava_callback - ERROR - Error processing callback for node 69f402522fa6ff8e8ca9332c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46398 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:32:00,702 - lava_callback - INFO - Received callback for node 69f6a54b1f903fec0b0df09e INFO: 172.20.0.1:37486 - "POST /node/69f6a54b1f903fec0b0df09e HTTP/1.0" 202 Accepted 2026-05-03 01:32:00,709 - lava_callback - INFO - Starting async job submit for node 69f6a54b1f903fec0b0df09e 2026-05-03 01:32:00,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:32:00,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a54b1f903fec0b0df09e HTTP/1.1" 200 None 2026-05-03 01:32:00,754 - lava_callback - DEBUG - Processing node 69f6a54b1f903fec0b0df09e: baseline-nfs-arm64 2026-05-03 01:32:01,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:32:01,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:32:01,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6a54b1f903fec0b0df09e/log.txt.gz 2026-05-03 01:32:01,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:32:02,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:32:02,175 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6a54b1f903fec0b0df09e/lava-logs.yaml 2026-05-03 01:32:02,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:32:02,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:32:02,301 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6a54b1f903fec0b0df09e/lava_callback.json.gz 2026-05-03 01:32:02,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:32:02,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a54b1f903fec0b0df09e HTTP/1.1" 200 None 2026-05-03 01:32:02,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:32:02,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 01:32:02,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:32:02,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a54b1f903fec0b0df09e HTTP/1.1" 200 None 2026-05-03 01:32:02,382 - lava_callback - INFO - Completed processing callback for node 69f6a54b1f903fec0b0df09e INFO: 172.20.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43338 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:32:20,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:32:20,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 01:32:22,011 - lava_callback - INFO - Received callback for node 69f402a02fa6ff8e8ca9334f INFO: 172.20.0.1:46566 - "POST /node/69f402a02fa6ff8e8ca9334f HTTP/1.0" 202 Accepted 2026-05-03 01:32:22,016 - lava_callback - INFO - Starting async job submit for node 69f402a02fa6ff8e8ca9334f 2026-05-03 01:32:22,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:32:22,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f402a02fa6ff8e8ca9334f HTTP/1.1" 200 None 2026-05-03 01:32:22,035 - lava_callback - DEBUG - Processing node 69f402a02fa6ff8e8ca9334f: baseline-arm-clabbe 2026-05-03 01:32:22,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f402a02fa6ff8e8ca9334f 2026-05-03 01:32:22,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:32:22,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f402a02fa6ff8e8ca9334f HTTP/1.1" 200 None 2026-05-03 01:32:22,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:32:22,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:32:22,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:32:22,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f402a02fa6ff8e8ca9334f HTTP/1.1" 200 None 2026-05-03 01:32:22,081 - lava_callback - ERROR - Error processing callback for node 69f402a02fa6ff8e8ca9334f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39354 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:33:02,010 - lava_callback - INFO - Received callback for node 69f402c72fa6ff8e8ca93361 INFO: 172.20.0.1:52778 - "POST /node/69f402c72fa6ff8e8ca93361 HTTP/1.0" 202 Accepted 2026-05-03 01:33:02,015 - lava_callback - INFO - Starting async job submit for node 69f402c72fa6ff8e8ca93361 2026-05-03 01:33:02,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:33:02,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f402c72fa6ff8e8ca93361 HTTP/1.1" 200 None 2026-05-03 01:33:02,030 - lava_callback - DEBUG - Processing node 69f402c72fa6ff8e8ca93361: baseline-arm-clabbe 2026-05-03 01:33:02,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f402c72fa6ff8e8ca93361 2026-05-03 01:33:02,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:33:02,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f402c72fa6ff8e8ca93361 HTTP/1.1" 200 None 2026-05-03 01:33:02,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:33:02,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:33:02,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:33:02,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f402c72fa6ff8e8ca93361 HTTP/1.1" 200 None 2026-05-03 01:33:02,077 - lava_callback - ERROR - Error processing callback for node 69f402c72fa6ff8e8ca93361: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55272 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:34:10,077 - lava_callback - INFO - Received callback for node 69f6a5d91f903fec0b0df0f6 INFO: 172.20.0.1:59536 - "POST /node/69f6a5d91f903fec0b0df0f6 HTTP/1.0" 202 Accepted 2026-05-03 01:34:10,084 - lava_callback - INFO - Starting async job submit for node 69f6a5d91f903fec0b0df0f6 2026-05-03 01:34:10,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:34:10,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a5d91f903fec0b0df0f6 HTTP/1.1" 200 None 2026-05-03 01:34:10,120 - lava_callback - DEBUG - Processing node 69f6a5d91f903fec0b0df0f6: baseline-arm64 2026-05-03 01:34:10,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:34:10,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:34:10,650 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a5d91f903fec0b0df0f6/log.txt.gz 2026-05-03 01:34:10,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:34:11,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:34:11,073 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a5d91f903fec0b0df0f6/lava-logs.yaml 2026-05-03 01:34:11,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:34:11,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:34:11,193 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a5d91f903fec0b0df0f6/lava_callback.json.gz 2026-05-03 01:34:11,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:34:11,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a5d91f903fec0b0df0f6 HTTP/1.1" 200 None 2026-05-03 01:34:11,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:34:11,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 01:34:11,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:34:11,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a5d91f903fec0b0df0f6 HTTP/1.1" 200 None 2026-05-03 01:34:11,264 - lava_callback - INFO - Completed processing callback for node 69f6a5d91f903fec0b0df0f6 INFO: 172.20.0.1:59538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59546 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:34:20,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:34:20,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44814 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:35:02,066 - lava_callback - INFO - Received callback for node 69f4033b2fa6ff8e8ca93390 INFO: 172.20.0.1:37178 - "POST /node/69f4033b2fa6ff8e8ca93390 HTTP/1.0" 202 Accepted 2026-05-03 01:35:02,071 - lava_callback - INFO - Starting async job submit for node 69f4033b2fa6ff8e8ca93390 2026-05-03 01:35:02,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:35:02,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4033b2fa6ff8e8ca93390 HTTP/1.1" 200 None 2026-05-03 01:35:02,086 - lava_callback - DEBUG - Processing node 69f4033b2fa6ff8e8ca93390: baseline-arm-clabbe 2026-05-03 01:35:02,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4033b2fa6ff8e8ca93390 2026-05-03 01:35:02,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:35:02,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4033b2fa6ff8e8ca93390 HTTP/1.1" 200 None 2026-05-03 01:35:02,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:35:02,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:35:02,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:35:02,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4033b2fa6ff8e8ca93390 HTTP/1.1" 200 None 2026-05-03 01:35:02,132 - lava_callback - ERROR - Error processing callback for node 69f4033b2fa6ff8e8ca93390: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60478 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:36:22,140 - lava_callback - INFO - Received callback for node 69f403862fa6ff8e8ca933b7 INFO: 172.20.0.1:56600 - "POST /node/69f403862fa6ff8e8ca933b7 HTTP/1.0" 202 Accepted 2026-05-03 01:36:22,145 - lava_callback - INFO - Starting async job submit for node 69f403862fa6ff8e8ca933b7 2026-05-03 01:36:22,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:36:22,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f403862fa6ff8e8ca933b7 HTTP/1.1" 200 None 2026-05-03 01:36:22,168 - lava_callback - DEBUG - Processing node 69f403862fa6ff8e8ca933b7: baseline-arm-clabbe 2026-05-03 01:36:22,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f403862fa6ff8e8ca933b7 2026-05-03 01:36:22,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:36:22,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f403862fa6ff8e8ca933b7 HTTP/1.1" 200 None 2026-05-03 01:36:22,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:36:22,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:36:22,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:36:22,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f403862fa6ff8e8ca933b7 HTTP/1.1" 200 None 2026-05-03 01:36:22,213 - lava_callback - ERROR - Error processing callback for node 69f403862fa6ff8e8ca933b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45874 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:37:02,136 - lava_callback - INFO - Received callback for node 69f403ae2fa6ff8e8ca933c9 INFO: 172.20.0.1:45764 - "POST /node/69f403ae2fa6ff8e8ca933c9 HTTP/1.0" 202 Accepted 2026-05-03 01:37:02,143 - lava_callback - INFO - Starting async job submit for node 69f403ae2fa6ff8e8ca933c9 2026-05-03 01:37:02,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:37:02,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f403ae2fa6ff8e8ca933c9 HTTP/1.1" 200 None 2026-05-03 01:37:02,161 - lava_callback - DEBUG - Processing node 69f403ae2fa6ff8e8ca933c9: baseline-arm-clabbe 2026-05-03 01:37:02,161 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f403ae2fa6ff8e8ca933c9 2026-05-03 01:37:02,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:37:02,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f403ae2fa6ff8e8ca933c9 HTTP/1.1" 200 None 2026-05-03 01:37:02,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:37:02,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:37:02,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:37:02,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f403ae2fa6ff8e8ca933c9 HTTP/1.1" 200 None 2026-05-03 01:37:02,206 - lava_callback - ERROR - Error processing callback for node 69f403ae2fa6ff8e8ca933c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37164 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:37:42,248 - lava_callback - INFO - Received callback for node 69f403d52fa6ff8e8ca933dd INFO: 172.20.0.1:56934 - "POST /node/69f403d52fa6ff8e8ca933dd HTTP/1.0" 202 Accepted 2026-05-03 01:37:42,254 - lava_callback - INFO - Starting async job submit for node 69f403d52fa6ff8e8ca933dd 2026-05-03 01:37:42,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:37:42,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f403d52fa6ff8e8ca933dd HTTP/1.1" 200 None 2026-05-03 01:37:42,268 - lava_callback - DEBUG - Processing node 69f403d52fa6ff8e8ca933dd: baseline-arm-clabbe 2026-05-03 01:37:42,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f403d52fa6ff8e8ca933dd 2026-05-03 01:37:42,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:37:42,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f403d52fa6ff8e8ca933dd HTTP/1.1" 200 None 2026-05-03 01:37:42,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:37:42,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:37:42,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:37:42,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f403d52fa6ff8e8ca933dd HTTP/1.1" 200 None 2026-05-03 01:37:42,312 - lava_callback - ERROR - Error processing callback for node 69f403d52fa6ff8e8ca933dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38234 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:38:22,190 - lava_callback - INFO - Received callback for node 69f403fc2fa6ff8e8ca933f2 INFO: 172.20.0.1:57058 - "POST /node/69f403fc2fa6ff8e8ca933f2 HTTP/1.0" 202 Accepted 2026-05-03 01:38:22,195 - lava_callback - INFO - Starting async job submit for node 69f403fc2fa6ff8e8ca933f2 2026-05-03 01:38:22,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:38:22,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f403fc2fa6ff8e8ca933f2 HTTP/1.1" 200 None 2026-05-03 01:38:22,210 - lava_callback - DEBUG - Processing node 69f403fc2fa6ff8e8ca933f2: baseline-arm-clabbe 2026-05-03 01:38:22,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f403fc2fa6ff8e8ca933f2 2026-05-03 01:38:22,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:38:22,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f403fc2fa6ff8e8ca933f2 HTTP/1.1" 200 None 2026-05-03 01:38:22,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:38:22,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:38:22,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:38:22,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f403fc2fa6ff8e8ca933f2 HTTP/1.1" 200 None 2026-05-03 01:38:22,261 - lava_callback - ERROR - Error processing callback for node 69f403fc2fa6ff8e8ca933f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53846 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:39:02,285 - lava_callback - INFO - Received callback for node 69f404232fa6ff8e8ca93401 INFO: 172.20.0.1:34870 - "POST /node/69f404232fa6ff8e8ca93401 HTTP/1.0" 202 Accepted 2026-05-03 01:39:02,290 - lava_callback - INFO - Starting async job submit for node 69f404232fa6ff8e8ca93401 2026-05-03 01:39:02,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:39:02,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f404232fa6ff8e8ca93401 HTTP/1.1" 200 None 2026-05-03 01:39:02,311 - lava_callback - DEBUG - Processing node 69f404232fa6ff8e8ca93401: baseline-arm-clabbe 2026-05-03 01:39:02,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f404232fa6ff8e8ca93401 2026-05-03 01:39:02,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:39:02,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f404232fa6ff8e8ca93401 HTTP/1.1" 200 None 2026-05-03 01:39:02,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:39:02,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:39:02,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:39:02,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f404232fa6ff8e8ca93401 HTTP/1.1" 200 None 2026-05-03 01:39:02,356 - lava_callback - ERROR - Error processing callback for node 69f404232fa6ff8e8ca93401: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46636 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:39:42,225 - lava_callback - INFO - Received callback for node 69f4044a2fa6ff8e8ca93412 INFO: 172.20.0.1:51922 - "POST /node/69f4044a2fa6ff8e8ca93412 HTTP/1.0" 202 Accepted 2026-05-03 01:39:42,231 - lava_callback - INFO - Starting async job submit for node 69f4044a2fa6ff8e8ca93412 2026-05-03 01:39:42,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:39:42,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4044a2fa6ff8e8ca93412 HTTP/1.1" 200 None 2026-05-03 01:39:42,246 - lava_callback - DEBUG - Processing node 69f4044a2fa6ff8e8ca93412: baseline-arm-clabbe 2026-05-03 01:39:42,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4044a2fa6ff8e8ca93412 2026-05-03 01:39:42,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:39:42,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4044a2fa6ff8e8ca93412 HTTP/1.1" 200 None 2026-05-03 01:39:42,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:39:42,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:39:42,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:39:42,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4044a2fa6ff8e8ca93412 HTTP/1.1" 200 None 2026-05-03 01:39:42,296 - lava_callback - ERROR - Error processing callback for node 69f4044a2fa6ff8e8ca93412: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57864 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:40:20,350 - lava_callback - INFO - Received callback for node 69f6a7381f903fec0b0df1b9 INFO: 172.20.0.1:57954 - "POST /node/69f6a7381f903fec0b0df1b9 HTTP/1.0" 202 Accepted 2026-05-03 01:40:20,357 - lava_callback - INFO - Starting async job submit for node 69f6a7381f903fec0b0df1b9 2026-05-03 01:40:20,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:20,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a7381f903fec0b0df1b9 HTTP/1.1" 200 None 2026-05-03 01:40:20,398 - lava_callback - DEBUG - Processing node 69f6a7381f903fec0b0df1b9: baseline-arm64-foundriesio 2026-05-03 01:40:20,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:40:20,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:40:20,946 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f6a7381f903fec0b0df1b9/log.txt.gz 2026-05-03 01:40:21,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:40:21,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:40:21,394 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f6a7381f903fec0b0df1b9/lava-logs.yaml 2026-05-03 01:40:21,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:40:21,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:40:21,702 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f6a7381f903fec0b0df1b9/lava_callback.json.gz 2026-05-03 01:40:21,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:21,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a7381f903fec0b0df1b9 HTTP/1.1" 200 None 2026-05-03 01:40:21,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:21,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 01:40:21,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:21,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a7381f903fec0b0df1b9 HTTP/1.1" 200 None 2026-05-03 01:40:21,812 - lava_callback - INFO - Completed processing callback for node 69f6a7381f903fec0b0df1b9 2026-05-03 01:40:22,329 - lava_callback - INFO - Received callback for node 69f404712fa6ff8e8ca93429 INFO: 172.20.0.1:57960 - "POST /node/69f404712fa6ff8e8ca93429 HTTP/1.0" 202 Accepted 2026-05-03 01:40:22,334 - lava_callback - INFO - Starting async job submit for node 69f404712fa6ff8e8ca93429 2026-05-03 01:40:22,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:22,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f404712fa6ff8e8ca93429 HTTP/1.1" 200 None 2026-05-03 01:40:22,353 - lava_callback - DEBUG - Processing node 69f404712fa6ff8e8ca93429: baseline-arm-clabbe 2026-05-03 01:40:22,353 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f404712fa6ff8e8ca93429 2026-05-03 01:40:22,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:22,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f404712fa6ff8e8ca93429 HTTP/1.1" 200 None 2026-05-03 01:40:22,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:22,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:40:22,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:22,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f404712fa6ff8e8ca93429 HTTP/1.1" 200 None 2026-05-03 01:40:22,403 - lava_callback - ERROR - Error processing callback for node 69f404712fa6ff8e8ca93429: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57302 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:40:42,297 - lava_callback - INFO - Received callback for node 69f404972fa6ff8e8ca93434 INFO: 172.20.0.1:58882 - "POST /node/69f404972fa6ff8e8ca93434 HTTP/1.0" 202 Accepted 2026-05-03 01:40:42,303 - lava_callback - INFO - Starting async job submit for node 69f404972fa6ff8e8ca93434 2026-05-03 01:40:42,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:42,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f404972fa6ff8e8ca93434 HTTP/1.1" 200 None 2026-05-03 01:40:42,319 - lava_callback - DEBUG - Processing node 69f404972fa6ff8e8ca93434: baseline-arm-clabbe 2026-05-03 01:40:42,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f404972fa6ff8e8ca93434 2026-05-03 01:40:42,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:42,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f404972fa6ff8e8ca93434 HTTP/1.1" 200 None 2026-05-03 01:40:42,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:42,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:40:42,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:42,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f404972fa6ff8e8ca93434 HTTP/1.1" 200 None 2026-05-03 01:40:42,373 - lava_callback - ERROR - Error processing callback for node 69f404972fa6ff8e8ca93434: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58900 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:40:50,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:40:50,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42690 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:41:22,342 - lava_callback - INFO - Received callback for node 69f404be2fa6ff8e8ca93445 INFO: 172.20.0.1:33412 - "POST /node/69f404be2fa6ff8e8ca93445 HTTP/1.0" 202 Accepted 2026-05-03 01:41:22,347 - lava_callback - INFO - Starting async job submit for node 69f404be2fa6ff8e8ca93445 2026-05-03 01:41:22,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:41:22,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f404be2fa6ff8e8ca93445 HTTP/1.1" 200 None 2026-05-03 01:41:22,362 - lava_callback - DEBUG - Processing node 69f404be2fa6ff8e8ca93445: baseline-arm-clabbe 2026-05-03 01:41:22,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f404be2fa6ff8e8ca93445 2026-05-03 01:41:22,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:41:22,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f404be2fa6ff8e8ca93445 HTTP/1.1" 200 None 2026-05-03 01:41:22,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:41:22,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:41:22,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:41:22,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f404be2fa6ff8e8ca93445 HTTP/1.1" 200 None 2026-05-03 01:41:22,411 - lava_callback - ERROR - Error processing callback for node 69f404be2fa6ff8e8ca93445: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33426 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:41:30,389 - lava_callback - INFO - Received callback for node 69f6a6d91f903fec0b0df184 INFO: 172.20.0.1:45102 - "POST /node/69f6a6d91f903fec0b0df184 HTTP/1.0" 202 Accepted 2026-05-03 01:41:30,398 - lava_callback - INFO - Starting async job submit for node 69f6a6d91f903fec0b0df184 2026-05-03 01:41:30,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:41:30,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a6d91f903fec0b0df184 HTTP/1.1" 200 None 2026-05-03 01:41:30,439 - lava_callback - DEBUG - Processing node 69f6a6d91f903fec0b0df184: baseline-arm64 2026-05-03 01:41:30,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:41:30,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:41:30,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a6d91f903fec0b0df184/log.txt.gz 2026-05-03 01:41:31,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:41:31,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:41:31,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a6d91f903fec0b0df184/lava-logs.yaml 2026-05-03 01:41:31,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:41:31,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:41:31,461 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a6d91f903fec0b0df184/lava_callback.json.gz 2026-05-03 01:41:31,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:41:31,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a6d91f903fec0b0df184 HTTP/1.1" 200 None 2026-05-03 01:41:31,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:41:31,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 01:41:31,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:41:31,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a6d91f903fec0b0df184 HTTP/1.1" 200 None 2026-05-03 01:41:31,607 - lava_callback - INFO - Completed processing callback for node 69f6a6d91f903fec0b0df184 INFO: 172.20.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34118 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:41:50,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:41:50,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39050 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:42:02,336 - lava_callback - INFO - Received callback for node 69f404e62fa6ff8e8ca93455 INFO: 172.20.0.1:45520 - "POST /node/69f404e62fa6ff8e8ca93455 HTTP/1.0" 202 Accepted 2026-05-03 01:42:02,341 - lava_callback - INFO - Starting async job submit for node 69f404e62fa6ff8e8ca93455 2026-05-03 01:42:02,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:42:02,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f404e62fa6ff8e8ca93455 HTTP/1.1" 200 None 2026-05-03 01:42:02,356 - lava_callback - DEBUG - Processing node 69f404e62fa6ff8e8ca93455: baseline-arm-clabbe 2026-05-03 01:42:02,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f404e62fa6ff8e8ca93455 2026-05-03 01:42:02,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:42:02,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f404e62fa6ff8e8ca93455 HTTP/1.1" 200 None 2026-05-03 01:42:02,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:42:02,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:42:02,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:42:02,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f404e62fa6ff8e8ca93455 HTTP/1.1" 200 None 2026-05-03 01:42:02,401 - lava_callback - ERROR - Error processing callback for node 69f404e62fa6ff8e8ca93455: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52650 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:42:42,387 - lava_callback - INFO - Received callback for node 69f4050c2fa6ff8e8ca93467 INFO: 172.20.0.1:53552 - "POST /node/69f4050c2fa6ff8e8ca93467 HTTP/1.0" 202 Accepted 2026-05-03 01:42:42,393 - lava_callback - INFO - Starting async job submit for node 69f4050c2fa6ff8e8ca93467 2026-05-03 01:42:42,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:42:42,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4050c2fa6ff8e8ca93467 HTTP/1.1" 200 None 2026-05-03 01:42:42,408 - lava_callback - DEBUG - Processing node 69f4050c2fa6ff8e8ca93467: baseline-arm-clabbe 2026-05-03 01:42:42,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4050c2fa6ff8e8ca93467 2026-05-03 01:42:42,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:42:42,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4050c2fa6ff8e8ca93467 HTTP/1.1" 200 None 2026-05-03 01:42:42,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:42:42,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:42:42,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:42:42,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4050c2fa6ff8e8ca93467 HTTP/1.1" 200 None 2026-05-03 01:42:42,464 - lava_callback - ERROR - Error processing callback for node 69f4050c2fa6ff8e8ca93467: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40540 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:43:22,374 - lava_callback - INFO - Received callback for node 69f405332fa6ff8e8ca93478 INFO: 172.20.0.1:42230 - "POST /node/69f405332fa6ff8e8ca93478 HTTP/1.0" 202 Accepted 2026-05-03 01:43:22,380 - lava_callback - INFO - Starting async job submit for node 69f405332fa6ff8e8ca93478 2026-05-03 01:43:22,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:43:22,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f405332fa6ff8e8ca93478 HTTP/1.1" 200 None 2026-05-03 01:43:22,397 - lava_callback - DEBUG - Processing node 69f405332fa6ff8e8ca93478: baseline-arm-clabbe 2026-05-03 01:43:22,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f405332fa6ff8e8ca93478 2026-05-03 01:43:22,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:43:22,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f405332fa6ff8e8ca93478 HTTP/1.1" 200 None 2026-05-03 01:43:22,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:43:22,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:43:22,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:43:22,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f405332fa6ff8e8ca93478 HTTP/1.1" 200 None 2026-05-03 01:43:22,443 - lava_callback - ERROR - Error processing callback for node 69f405332fa6ff8e8ca93478: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54898 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:44:02,432 - lava_callback - INFO - Received callback for node 69f4055a2fa6ff8e8ca9348b INFO: 172.20.0.1:50332 - "POST /node/69f4055a2fa6ff8e8ca9348b HTTP/1.0" 202 Accepted 2026-05-03 01:44:02,437 - lava_callback - INFO - Starting async job submit for node 69f4055a2fa6ff8e8ca9348b 2026-05-03 01:44:02,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:44:02,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4055a2fa6ff8e8ca9348b HTTP/1.1" 200 None 2026-05-03 01:44:02,452 - lava_callback - DEBUG - Processing node 69f4055a2fa6ff8e8ca9348b: baseline-arm-clabbe 2026-05-03 01:44:02,453 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4055a2fa6ff8e8ca9348b 2026-05-03 01:44:02,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:44:02,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4055a2fa6ff8e8ca9348b HTTP/1.1" 200 None 2026-05-03 01:44:02,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:44:02,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:44:02,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:44:02,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4055a2fa6ff8e8ca9348b HTTP/1.1" 200 None 2026-05-03 01:44:02,500 - lava_callback - ERROR - Error processing callback for node 69f4055a2fa6ff8e8ca9348b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52620 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:44:42,448 - lava_callback - INFO - Received callback for node 69f405802fa6ff8e8ca934a3 INFO: 172.20.0.1:38314 - "POST /node/69f405802fa6ff8e8ca934a3 HTTP/1.0" 202 Accepted 2026-05-03 01:44:42,453 - lava_callback - INFO - Starting async job submit for node 69f405802fa6ff8e8ca934a3 2026-05-03 01:44:42,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:44:42,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f405802fa6ff8e8ca934a3 HTTP/1.1" 200 None 2026-05-03 01:44:42,471 - lava_callback - DEBUG - Processing node 69f405802fa6ff8e8ca934a3: baseline-arm-clabbe 2026-05-03 01:44:42,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f405802fa6ff8e8ca934a3 2026-05-03 01:44:42,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:44:42,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f405802fa6ff8e8ca934a3 HTTP/1.1" 200 None 2026-05-03 01:44:42,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:44:42,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:44:42,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:44:42,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f405802fa6ff8e8ca934a3 HTTP/1.1" 200 None 2026-05-03 01:44:42,521 - lava_callback - ERROR - Error processing callback for node 69f405802fa6ff8e8ca934a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57184 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:45:22,552 - lava_callback - INFO - Received callback for node 69f405a62fa6ff8e8ca934b0 INFO: 172.20.0.1:51508 - "POST /node/69f405a62fa6ff8e8ca934b0 HTTP/1.0" 202 Accepted 2026-05-03 01:45:22,561 - lava_callback - INFO - Starting async job submit for node 69f405a62fa6ff8e8ca934b0 2026-05-03 01:45:22,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:45:22,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f405a62fa6ff8e8ca934b0 HTTP/1.1" 200 None 2026-05-03 01:45:22,578 - lava_callback - DEBUG - Processing node 69f405a62fa6ff8e8ca934b0: baseline-arm-clabbe 2026-05-03 01:45:22,578 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f405a62fa6ff8e8ca934b0 2026-05-03 01:45:22,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:45:22,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f405a62fa6ff8e8ca934b0 HTTP/1.1" 200 None 2026-05-03 01:45:22,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:45:22,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:45:22,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:45:22,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f405a62fa6ff8e8ca934b0 HTTP/1.1" 200 None 2026-05-03 01:45:22,623 - lava_callback - ERROR - Error processing callback for node 69f405a62fa6ff8e8ca934b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39216 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:46:02,492 - lava_callback - INFO - Received callback for node 69f405cc2fa6ff8e8ca934c3 INFO: 172.20.0.1:49654 - "POST /node/69f405cc2fa6ff8e8ca934c3 HTTP/1.0" 202 Accepted 2026-05-03 01:46:02,497 - lava_callback - INFO - Starting async job submit for node 69f405cc2fa6ff8e8ca934c3 2026-05-03 01:46:02,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:46:02,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f405cc2fa6ff8e8ca934c3 HTTP/1.1" 200 None 2026-05-03 01:46:02,512 - lava_callback - DEBUG - Processing node 69f405cc2fa6ff8e8ca934c3: baseline-arm-clabbe 2026-05-03 01:46:02,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f405cc2fa6ff8e8ca934c3 2026-05-03 01:46:02,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:46:02,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f405cc2fa6ff8e8ca934c3 HTTP/1.1" 200 None 2026-05-03 01:46:02,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:46:02,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:46:02,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:46:02,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f405cc2fa6ff8e8ca934c3 HTTP/1.1" 200 None 2026-05-03 01:46:02,557 - lava_callback - ERROR - Error processing callback for node 69f405cc2fa6ff8e8ca934c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34156 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:46:42,594 - lava_callback - INFO - Received callback for node 69f405f22fa6ff8e8ca934d7 INFO: 172.20.0.1:48500 - "POST /node/69f405f22fa6ff8e8ca934d7 HTTP/1.0" 202 Accepted 2026-05-03 01:46:42,599 - lava_callback - INFO - Starting async job submit for node 69f405f22fa6ff8e8ca934d7 2026-05-03 01:46:42,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:46:42,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f405f22fa6ff8e8ca934d7 HTTP/1.1" 200 None 2026-05-03 01:46:42,626 - lava_callback - DEBUG - Processing node 69f405f22fa6ff8e8ca934d7: baseline-arm-clabbe 2026-05-03 01:46:42,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f405f22fa6ff8e8ca934d7 2026-05-03 01:46:42,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:46:42,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f405f22fa6ff8e8ca934d7 HTTP/1.1" 200 None 2026-05-03 01:46:42,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:46:42,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:46:42,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:46:42,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f405f22fa6ff8e8ca934d7 HTTP/1.1" 200 None 2026-05-03 01:46:42,675 - lava_callback - ERROR - Error processing callback for node 69f405f22fa6ff8e8ca934d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39384 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:47:22,458 - lava_callback - INFO - Received callback for node 69f6a8e61f903fec0b0df299 INFO: 172.20.0.1:32876 - "POST /node/69f6a8e61f903fec0b0df299 HTTP/1.0" 202 Accepted 2026-05-03 01:47:22,464 - lava_callback - INFO - Starting async job submit for node 69f6a8e61f903fec0b0df299 2026-05-03 01:47:22,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:47:22,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a8e61f903fec0b0df299 HTTP/1.1" 200 None 2026-05-03 01:47:22,502 - lava_callback - DEBUG - Processing node 69f6a8e61f903fec0b0df299: baseline-arm-pengutronix 2026-05-03 01:47:22,570 - lava_callback - INFO - Received callback for node 69f406192fa6ff8e8ca934ea INFO: 172.20.0.1:32882 - "POST /node/69f406192fa6ff8e8ca934ea HTTP/1.0" 202 Accepted 2026-05-03 01:47:22,581 - lava_callback - INFO - Starting async job submit for node 69f406192fa6ff8e8ca934ea 2026-05-03 01:47:22,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:47:22,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:47:22,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f406192fa6ff8e8ca934ea HTTP/1.1" 200 None 2026-05-03 01:47:22,658 - lava_callback - DEBUG - Processing node 69f406192fa6ff8e8ca934ea: baseline-arm-clabbe 2026-05-03 01:47:22,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f406192fa6ff8e8ca934ea 2026-05-03 01:47:22,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:47:22,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f406192fa6ff8e8ca934ea HTTP/1.1" 200 None 2026-05-03 01:47:22,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:47:22,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:47:22,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:47:22,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f406192fa6ff8e8ca934ea HTTP/1.1" 200 None 2026-05-03 01:47:22,714 - lava_callback - ERROR - Error processing callback for node 69f406192fa6ff8e8ca934ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-03 01:47:22,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:47:22,926 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f6a8e61f903fec0b0df299/log.txt.gz 2026-05-03 01:47:23,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:47:23,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:47:23,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f6a8e61f903fec0b0df299/lava-logs.yaml 2026-05-03 01:47:23,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:47:23,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:47:23,323 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f6a8e61f903fec0b0df299/lava_callback.json.gz 2026-05-03 01:47:23,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:47:23,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a8e61f903fec0b0df299 HTTP/1.1" 200 None 2026-05-03 01:47:23,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:47:23,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 01:47:23,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:47:23,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a8e61f903fec0b0df299 HTTP/1.1" 200 None 2026-05-03 01:47:23,395 - lava_callback - INFO - Completed processing callback for node 69f6a8e61f903fec0b0df299 INFO: 172.20.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45284 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:47:50,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:47:50,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36102 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:48:02,608 - lava_callback - INFO - Received callback for node 69f4063f2fa6ff8e8ca934fa INFO: 172.20.0.1:33358 - "POST /node/69f4063f2fa6ff8e8ca934fa HTTP/1.0" 202 Accepted 2026-05-03 01:48:02,613 - lava_callback - INFO - Starting async job submit for node 69f4063f2fa6ff8e8ca934fa 2026-05-03 01:48:02,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:48:02,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4063f2fa6ff8e8ca934fa HTTP/1.1" 200 None 2026-05-03 01:48:02,629 - lava_callback - DEBUG - Processing node 69f4063f2fa6ff8e8ca934fa: baseline-arm-clabbe 2026-05-03 01:48:02,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4063f2fa6ff8e8ca934fa 2026-05-03 01:48:02,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:48:02,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4063f2fa6ff8e8ca934fa HTTP/1.1" 200 None 2026-05-03 01:48:02,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:48:02,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:48:02,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:48:02,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4063f2fa6ff8e8ca934fa HTTP/1.1" 200 None 2026-05-03 01:48:02,694 - lava_callback - ERROR - Error processing callback for node 69f4063f2fa6ff8e8ca934fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38016 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:48:42,616 - lava_callback - INFO - Received callback for node 69f406652fa6ff8e8ca9350a INFO: 172.20.0.1:45142 - "POST /node/69f406652fa6ff8e8ca9350a HTTP/1.0" 202 Accepted 2026-05-03 01:48:42,622 - lava_callback - INFO - Starting async job submit for node 69f406652fa6ff8e8ca9350a 2026-05-03 01:48:42,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:48:42,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f406652fa6ff8e8ca9350a HTTP/1.1" 200 None 2026-05-03 01:48:42,644 - lava_callback - DEBUG - Processing node 69f406652fa6ff8e8ca9350a: baseline-arm-clabbe 2026-05-03 01:48:42,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f406652fa6ff8e8ca9350a 2026-05-03 01:48:42,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:48:42,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f406652fa6ff8e8ca9350a HTTP/1.1" 200 None 2026-05-03 01:48:42,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:48:42,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:48:42,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:48:42,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f406652fa6ff8e8ca9350a HTTP/1.1" 200 None 2026-05-03 01:48:42,694 - lava_callback - ERROR - Error processing callback for node 69f406652fa6ff8e8ca9350a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49770 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:49:12,836 - lava_callback - INFO - Received callback for node 69f406912fa6ff8e8ca9351e INFO: 172.20.0.1:43378 - "POST /node/69f406912fa6ff8e8ca9351e HTTP/1.0" 202 Accepted 2026-05-03 01:49:12,842 - lava_callback - INFO - Starting async job submit for node 69f406912fa6ff8e8ca9351e 2026-05-03 01:49:12,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:49:12,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f406912fa6ff8e8ca9351e HTTP/1.1" 200 None 2026-05-03 01:49:12,856 - lava_callback - DEBUG - Processing node 69f406912fa6ff8e8ca9351e: baseline-arm64-baylibre 2026-05-03 01:49:12,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f406912fa6ff8e8ca9351e 2026-05-03 01:49:12,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:49:12,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f406912fa6ff8e8ca9351e HTTP/1.1" 200 None 2026-05-03 01:49:12,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:49:12,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 01:49:12,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:49:12,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f406912fa6ff8e8ca9351e HTTP/1.1" 200 None 2026-05-03 01:49:12,907 - lava_callback - ERROR - Error processing callback for node 69f406912fa6ff8e8ca9351e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39962 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:50:22,676 - lava_callback - INFO - Received callback for node 69f406d62fa6ff8e8ca9353e INFO: 172.20.0.1:37534 - "POST /node/69f406d62fa6ff8e8ca9353e HTTP/1.0" 202 Accepted 2026-05-03 01:50:22,681 - lava_callback - INFO - Starting async job submit for node 69f406d62fa6ff8e8ca9353e 2026-05-03 01:50:22,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:50:22,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f406d62fa6ff8e8ca9353e HTTP/1.1" 200 None 2026-05-03 01:50:22,701 - lava_callback - DEBUG - Processing node 69f406d62fa6ff8e8ca9353e: baseline-arm-clabbe 2026-05-03 01:50:22,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f406d62fa6ff8e8ca9353e 2026-05-03 01:50:22,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:50:22,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f406d62fa6ff8e8ca9353e HTTP/1.1" 200 None 2026-05-03 01:50:22,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:50:22,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:50:22,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:50:22,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f406d62fa6ff8e8ca9353e HTTP/1.1" 200 None 2026-05-03 01:50:22,746 - lava_callback - ERROR - Error processing callback for node 69f406d62fa6ff8e8ca9353e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35422 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:51:12,537 - lava_callback - INFO - Received callback for node 69f407012fa6ff8e8ca93550 INFO: 172.20.0.1:44060 - "POST /node/69f407012fa6ff8e8ca93550 HTTP/1.0" 202 Accepted 2026-05-03 01:51:12,543 - lava_callback - INFO - Starting async job submit for node 69f407012fa6ff8e8ca93550 2026-05-03 01:51:12,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:51:12,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f407012fa6ff8e8ca93550 HTTP/1.1" 200 None 2026-05-03 01:51:12,558 - lava_callback - DEBUG - Processing node 69f407012fa6ff8e8ca93550: baseline-arm64-baylibre 2026-05-03 01:51:12,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f407012fa6ff8e8ca93550 2026-05-03 01:51:12,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:51:12,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f407012fa6ff8e8ca93550 HTTP/1.1" 200 None 2026-05-03 01:51:12,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:51:12,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 01:51:12,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:51:12,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f407012fa6ff8e8ca93550 HTTP/1.1" 200 None 2026-05-03 01:51:12,616 - lava_callback - ERROR - Error processing callback for node 69f407012fa6ff8e8ca93550: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48936 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:52:22,810 - lava_callback - INFO - Received callback for node 69f407452fa6ff8e8ca93576 INFO: 172.20.0.1:39396 - "POST /node/69f407452fa6ff8e8ca93576 HTTP/1.0" 202 Accepted 2026-05-03 01:52:22,815 - lava_callback - INFO - Starting async job submit for node 69f407452fa6ff8e8ca93576 2026-05-03 01:52:22,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:52:22,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f407452fa6ff8e8ca93576 HTTP/1.1" 200 None 2026-05-03 01:52:22,832 - lava_callback - DEBUG - Processing node 69f407452fa6ff8e8ca93576: baseline-arm-clabbe 2026-05-03 01:52:22,832 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f407452fa6ff8e8ca93576 2026-05-03 01:52:22,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:52:22,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f407452fa6ff8e8ca93576 HTTP/1.1" 200 None 2026-05-03 01:52:22,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:52:22,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:52:22,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:52:22,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f407452fa6ff8e8ca93576 HTTP/1.1" 200 None 2026-05-03 01:52:22,882 - lava_callback - ERROR - Error processing callback for node 69f407452fa6ff8e8ca93576: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54532 - "GET /node/69e89af6b1b1e6995a88d410%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54320 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:52:56,643 - lava_callback - INFO - Received callback for node 69f407702fa6ff8e8ca93586 INFO: 172.20.0.1:54326 - "POST /node/69f407702fa6ff8e8ca93586 HTTP/1.0" 202 Accepted 2026-05-03 01:52:56,649 - lava_callback - INFO - Starting async job submit for node 69f407702fa6ff8e8ca93586 2026-05-03 01:52:56,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:52:56,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f407702fa6ff8e8ca93586 HTTP/1.1" 200 None 2026-05-03 01:52:56,670 - lava_callback - DEBUG - Processing node 69f407702fa6ff8e8ca93586: baseline-arm64-baylibre 2026-05-03 01:52:56,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f407702fa6ff8e8ca93586 2026-05-03 01:52:56,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:52:56,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f407702fa6ff8e8ca93586 HTTP/1.1" 200 None 2026-05-03 01:52:56,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:52:56,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 01:52:56,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:52:56,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f407702fa6ff8e8ca93586 HTTP/1.1" 200 None 2026-05-03 01:52:56,730 - lava_callback - ERROR - Error processing callback for node 69f407702fa6ff8e8ca93586: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48162 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:55:22,977 - lava_callback - INFO - Received callback for node 69f408002fa6ff8e8ca935c8 INFO: 172.20.0.1:47558 - "POST /node/69f408002fa6ff8e8ca935c8 HTTP/1.0" 202 Accepted 2026-05-03 01:55:22,983 - lava_callback - INFO - Starting async job submit for node 69f408002fa6ff8e8ca935c8 2026-05-03 01:55:22,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:55:22,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f408002fa6ff8e8ca935c8 HTTP/1.1" 200 None 2026-05-03 01:55:22,999 - lava_callback - DEBUG - Processing node 69f408002fa6ff8e8ca935c8: baseline-arm-clabbe 2026-05-03 01:55:22,999 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f408002fa6ff8e8ca935c8 2026-05-03 01:55:22,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:55:23,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f408002fa6ff8e8ca935c8 HTTP/1.1" 200 None 2026-05-03 01:55:23,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:55:23,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-03 01:55:23,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:55:23,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f408002fa6ff8e8ca935c8 HTTP/1.1" 200 None 2026-05-03 01:55:23,052 - lava_callback - ERROR - Error processing callback for node 69f408002fa6ff8e8ca935c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42010 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:38928 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:55:59,543 - lava_callback - INFO - Received callback for node 69f6a9731f903fec0b0df2e6 INFO: 172.20.0.1:38938 - "POST /node/69f6a9731f903fec0b0df2e6 HTTP/1.0" 202 Accepted 2026-05-03 01:55:59,551 - lava_callback - INFO - Starting async job submit for node 69f6a9731f903fec0b0df2e6 2026-05-03 01:55:59,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:55:59,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a9731f903fec0b0df2e6 HTTP/1.1" 200 None 2026-05-03 01:55:59,612 - lava_callback - DEBUG - Processing node 69f6a9731f903fec0b0df2e6: baseline-arm64 2026-05-03 01:56:00,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:56:00,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:56:00,174 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a9731f903fec0b0df2e6/log.txt.gz 2026-05-03 01:56:00,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:56:00,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:56:00,535 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a9731f903fec0b0df2e6/lava-logs.yaml 2026-05-03 01:56:00,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 01:56:00,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 01:56:00,660 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6a9731f903fec0b0df2e6/lava_callback.json.gz DEBUG: Setup failed for 69f6a9731f903fec0b0df2e6. Transitting job node result: incomplete -> fail 2026-05-03 01:56:00,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:56:00,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a9731f903fec0b0df2e6 HTTP/1.1" 200 None 2026-05-03 01:56:00,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:56:00,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 01:56:00,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:56:00,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a9731f903fec0b0df2e6 HTTP/1.1" 200 None 2026-05-03 01:56:00,859 - lava_callback - INFO - Completed processing callback for node 69f6a9731f903fec0b0df2e6 INFO: 172.20.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60996 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:56:20,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:56:20,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39136 - "GET /node/69e69211dc041e577b77c05c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39138 - "GET / HTTP/1.0" 200 OK 2026-05-03 01:57:13,092 - lava_callback - INFO - Received callback for node 69f408772fa6ff8e8ca935f8 INFO: 172.20.0.1:59410 - "POST /node/69f408772fa6ff8e8ca935f8 HTTP/1.0" 202 Accepted 2026-05-03 01:57:13,098 - lava_callback - INFO - Starting async job submit for node 69f408772fa6ff8e8ca935f8 2026-05-03 01:57:13,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:57:13,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f408772fa6ff8e8ca935f8 HTTP/1.1" 200 None 2026-05-03 01:57:13,113 - lava_callback - DEBUG - Processing node 69f408772fa6ff8e8ca935f8: baseline-arm64-baylibre 2026-05-03 01:57:13,113 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f408772fa6ff8e8ca935f8 2026-05-03 01:57:13,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:57:13,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f408772fa6ff8e8ca935f8 HTTP/1.1" 200 None 2026-05-03 01:57:13,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:57:13,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 01:57:13,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 01:57:13,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f408772fa6ff8e8ca935f8 HTTP/1.1" 200 None 2026-05-03 01:57:13,162 - lava_callback - ERROR - Error processing callback for node 69f408772fa6ff8e8ca935f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34694 - "GET /node/69e65ec747863bb428fe4cc4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43034 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:00:42,701 - lava_callback - INFO - Received callback for node 69f6a8261f903fec0b0df244 INFO: 172.20.0.1:40674 - "POST /node/69f6a8261f903fec0b0df244 HTTP/1.0" 202 Accepted 2026-05-03 02:00:42,708 - lava_callback - INFO - Starting async job submit for node 69f6a8261f903fec0b0df244 2026-05-03 02:00:42,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:00:42,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a8261f903fec0b0df244 HTTP/1.1" 200 None 2026-05-03 02:00:42,782 - lava_callback - DEBUG - Processing node 69f6a8261f903fec0b0df244: baseline-arm 2026-05-03 02:00:43,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:00:43,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:00:43,591 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f6a8261f903fec0b0df244/log.txt.gz 2026-05-03 02:00:44,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:00:44,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:00:44,275 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f6a8261f903fec0b0df244/lava-logs.yaml 2026-05-03 02:00:44,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:00:44,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:00:44,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f6a8261f903fec0b0df244/lava_callback.json.gz DEBUG: Setup failed for 69f6a8261f903fec0b0df244. Transitting job node result: incomplete -> fail 2026-05-03 02:00:44,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:00:44,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a8261f903fec0b0df244 HTTP/1.1" 200 None 2026-05-03 02:00:44,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:00:44,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 02:00:44,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:00:44,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a8261f903fec0b0df244 HTTP/1.1" 200 None 2026-05-03 02:00:44,681 - lava_callback - INFO - Completed processing callback for node 69f6a8261f903fec0b0df244 INFO: 172.20.0.1:40680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40682 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:00:47,337 - lava_callback - INFO - Received callback for node 69f6ab331f903fec0b0df3d8 INFO: 172.20.0.1:40694 - "POST /node/69f6ab331f903fec0b0df3d8 HTTP/1.0" 202 Accepted 2026-05-03 02:00:47,345 - lava_callback - INFO - Starting async job submit for node 69f6ab331f903fec0b0df3d8 2026-05-03 02:00:47,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:00:47,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6ab331f903fec0b0df3d8 HTTP/1.1" 200 None 2026-05-03 02:00:47,429 - lava_callback - DEBUG - Processing node 69f6ab331f903fec0b0df3d8: ltp-cve 2026-05-03 02:00:47,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:00:48,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:00:48,115 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69f6ab331f903fec0b0df3d8/log.txt.gz 2026-05-03 02:00:48,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:00:48,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:00:48,519 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69f6ab331f903fec0b0df3d8/lava-logs.yaml 2026-05-03 02:00:48,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:00:48,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:00:48,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69f6ab331f903fec0b0df3d8/lava_callback.json.gz 2026-05-03 02:00:48,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:00:48,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6ab331f903fec0b0df3d8 HTTP/1.1" 200 None 2026-05-03 02:00:48,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:00:48,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 02:00:48,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:00:48,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6ab331f903fec0b0df3d8 HTTP/1.1" 200 None 2026-05-03 02:00:48,761 - lava_callback - INFO - Completed processing callback for node 69f6ab331f903fec0b0df3d8 2026-05-03 02:00:50,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:00:50,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41826 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:01:21,110 - lava_callback - INFO - Received callback for node 69f6a8481f903fec0b0df252 INFO: 172.20.0.1:49778 - "POST /node/69f6a8481f903fec0b0df252 HTTP/1.0" 202 Accepted 2026-05-03 02:01:21,117 - lava_callback - INFO - Starting async job submit for node 69f6a8481f903fec0b0df252 2026-05-03 02:01:21,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:01:21,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a8481f903fec0b0df252 HTTP/1.1" 200 None 2026-05-03 02:01:21,201 - lava_callback - DEBUG - Processing node 69f6a8481f903fec0b0df252: ltp-smoke 2026-05-03 02:01:21,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:01:21,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:01:21,772 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f6a8481f903fec0b0df252/log.txt.gz 2026-05-03 02:01:22,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:01:22,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:01:22,200 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f6a8481f903fec0b0df252/lava-logs.yaml 2026-05-03 02:01:22,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:01:22,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:01:22,338 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f6a8481f903fec0b0df252/lava_callback.json.gz 2026-05-03 02:01:22,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:01:22,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6a8481f903fec0b0df252 HTTP/1.1" 200 None 2026-05-03 02:01:22,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:01:22,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f694321f903fec0b0dbc7d HTTP/1.1" 200 None 2026-05-03 02:01:22,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:01:22,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6a8481f903fec0b0df252 HTTP/1.1" 200 None 2026-05-03 02:01:22,723 - lava_callback - INFO - Completed processing callback for node 69f6a8481f903fec0b0df252 INFO: 172.20.0.1:49788 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:01:33,170 - lava_callback - INFO - Received callback for node 69f409692fa6ff8e8ca9365d INFO: 172.20.0.1:45222 - "POST /node/69f409692fa6ff8e8ca9365d HTTP/1.0" 202 Accepted 2026-05-03 02:01:33,176 - lava_callback - INFO - Starting async job submit for node 69f409692fa6ff8e8ca9365d 2026-05-03 02:01:33,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:01:33,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f409692fa6ff8e8ca9365d HTTP/1.1" 200 None 2026-05-03 02:01:33,191 - lava_callback - DEBUG - Processing node 69f409692fa6ff8e8ca9365d: baseline-arm64-baylibre 2026-05-03 02:01:33,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f409692fa6ff8e8ca9365d 2026-05-03 02:01:33,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:01:33,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f409692fa6ff8e8ca9365d HTTP/1.1" 200 None 2026-05-03 02:01:33,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:01:33,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:01:33,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:01:33,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f409692fa6ff8e8ca9365d HTTP/1.1" 200 None 2026-05-03 02:01:33,247 - lava_callback - ERROR - Error processing callback for node 69f409692fa6ff8e8ca9365d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35256 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:01:50,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:01:50,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36820 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:04:13,344 - lava_callback - INFO - Received callback for node 69f40a092fa6ff8e8ca936b9 INFO: 172.20.0.1:57956 - "POST /node/69f40a092fa6ff8e8ca936b9 HTTP/1.0" 202 Accepted 2026-05-03 02:04:13,350 - lava_callback - INFO - Starting async job submit for node 69f40a092fa6ff8e8ca936b9 2026-05-03 02:04:13,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:04:13,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40a092fa6ff8e8ca936b9 HTTP/1.1" 200 None 2026-05-03 02:04:13,367 - lava_callback - DEBUG - Processing node 69f40a092fa6ff8e8ca936b9: baseline-arm64-baylibre 2026-05-03 02:04:13,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40a092fa6ff8e8ca936b9 2026-05-03 02:04:13,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:04:13,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40a092fa6ff8e8ca936b9 HTTP/1.1" 200 None 2026-05-03 02:04:13,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:04:13,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:04:13,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:04:13,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40a092fa6ff8e8ca936b9 HTTP/1.1" 200 None 2026-05-03 02:04:13,414 - lava_callback - ERROR - Error processing callback for node 69f40a092fa6ff8e8ca936b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44560 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:05:13,314 - lava_callback - INFO - Received callback for node 69f40a532fa6ff8e8ca936fb INFO: 172.20.0.1:39418 - "POST /node/69f40a532fa6ff8e8ca936fb HTTP/1.0" 202 Accepted 2026-05-03 02:05:13,322 - lava_callback - INFO - Starting async job submit for node 69f40a532fa6ff8e8ca936fb 2026-05-03 02:05:13,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:05:13,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40a532fa6ff8e8ca936fb HTTP/1.1" 200 None 2026-05-03 02:05:13,347 - lava_callback - DEBUG - Processing node 69f40a532fa6ff8e8ca936fb: baseline-arm64-baylibre 2026-05-03 02:05:13,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40a532fa6ff8e8ca936fb 2026-05-03 02:05:13,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:05:13,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40a532fa6ff8e8ca936fb HTTP/1.1" 200 None 2026-05-03 02:05:13,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:05:13,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:05:13,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:05:13,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40a532fa6ff8e8ca936fb HTTP/1.1" 200 None 2026-05-03 02:05:13,401 - lava_callback - ERROR - Error processing callback for node 69f40a532fa6ff8e8ca936fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40498 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:06:43,408 - lava_callback - INFO - Received callback for node 69f40aa82fa6ff8e8ca93729 INFO: 172.20.0.1:39102 - "POST /node/69f40aa82fa6ff8e8ca93729 HTTP/1.0" 202 Accepted 2026-05-03 02:06:43,414 - lava_callback - INFO - Starting async job submit for node 69f40aa82fa6ff8e8ca93729 2026-05-03 02:06:43,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:06:43,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40aa82fa6ff8e8ca93729 HTTP/1.1" 200 None 2026-05-03 02:06:43,430 - lava_callback - DEBUG - Processing node 69f40aa82fa6ff8e8ca93729: baseline-arm64-clabbe 2026-05-03 02:06:43,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40aa82fa6ff8e8ca93729 2026-05-03 02:06:43,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:06:43,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40aa82fa6ff8e8ca93729 HTTP/1.1" 200 None 2026-05-03 02:06:43,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:06:43,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:06:43,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:06:43,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40aa82fa6ff8e8ca93729 HTTP/1.1" 200 None 2026-05-03 02:06:43,490 - lava_callback - ERROR - Error processing callback for node 69f40aa82fa6ff8e8ca93729: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54414 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:08:03,500 - lava_callback - INFO - Received callback for node 69f40af92fa6ff8e8ca93745 INFO: 172.20.0.1:37730 - "POST /node/69f40af92fa6ff8e8ca93745 HTTP/1.0" 202 Accepted 2026-05-03 02:08:03,506 - lava_callback - INFO - Starting async job submit for node 69f40af92fa6ff8e8ca93745 2026-05-03 02:08:03,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:08:03,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40af92fa6ff8e8ca93745 HTTP/1.1" 200 None 2026-05-03 02:08:03,522 - lava_callback - DEBUG - Processing node 69f40af92fa6ff8e8ca93745: baseline-arm64-clabbe 2026-05-03 02:08:03,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40af92fa6ff8e8ca93745 2026-05-03 02:08:03,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:08:03,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40af92fa6ff8e8ca93745 HTTP/1.1" 200 None 2026-05-03 02:08:03,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:08:03,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:08:03,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:08:03,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40af92fa6ff8e8ca93745 HTTP/1.1" 200 None 2026-05-03 02:08:03,580 - lava_callback - ERROR - Error processing callback for node 69f40af92fa6ff8e8ca93745: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58084 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:09:18,479 - lava_callback - INFO - Received callback for node 69f6ae3f1f903fec0b0df583 INFO: 172.20.0.1:58094 - "POST /node/69f6ae3f1f903fec0b0df583 HTTP/1.0" 202 Accepted 2026-05-03 02:09:18,485 - lava_callback - INFO - Starting async job submit for node 69f6ae3f1f903fec0b0df583 2026-05-03 02:09:18,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:09:18,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6ae3f1f903fec0b0df583 HTTP/1.1" 200 None 2026-05-03 02:09:18,510 - lava_callback - DEBUG - Processing node 69f6ae3f1f903fec0b0df583: baseline-arm 2026-05-03 02:09:18,517 - lava_callback - WARNING - Failed to upload log 2026-05-03 02:09:18,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:09:18,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:09:18,641 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f6ae3f1f903fec0b0df583/lava-logs.yaml 2026-05-03 02:09:18,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:09:18,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:09:18,728 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f6ae3f1f903fec0b0df583/lava_callback.json.gz 2026-05-03 02:09:18,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:09:18,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6ae3f1f903fec0b0df583 HTTP/1.1" 200 None 2026-05-03 02:09:18,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:09:18,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 02:09:18,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:09:18,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6ae3f1f903fec0b0df583 HTTP/1.1" 200 None 2026-05-03 02:09:18,795 - lava_callback - INFO - Completed processing callback for node 69f6ae3f1f903fec0b0df583 2026-05-03 02:09:20,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:09:20,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 02:09:23,528 - lava_callback - INFO - Received callback for node 69f40b482fa6ff8e8ca9376a INFO: 172.20.0.1:51192 - "POST /node/69f40b482fa6ff8e8ca9376a HTTP/1.0" 202 Accepted 2026-05-03 02:09:23,533 - lava_callback - INFO - Starting async job submit for node 69f40b482fa6ff8e8ca9376a 2026-05-03 02:09:23,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:09:23,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40b482fa6ff8e8ca9376a HTTP/1.1" 200 None 2026-05-03 02:09:23,548 - lava_callback - DEBUG - Processing node 69f40b482fa6ff8e8ca9376a: baseline-arm64-clabbe 2026-05-03 02:09:23,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40b482fa6ff8e8ca9376a 2026-05-03 02:09:23,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:09:23,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40b482fa6ff8e8ca9376a HTTP/1.1" 200 None 2026-05-03 02:09:23,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:09:23,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:09:23,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:09:23,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40b482fa6ff8e8ca9376a HTTP/1.1" 200 None 2026-05-03 02:09:23,591 - lava_callback - ERROR - Error processing callback for node 69f40b482fa6ff8e8ca9376a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56298 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:10:43,610 - lava_callback - INFO - Received callback for node 69f40b9a2fa6ff8e8ca9379b INFO: 172.20.0.1:40968 - "POST /node/69f40b9a2fa6ff8e8ca9379b HTTP/1.0" 202 Accepted 2026-05-03 02:10:43,619 - lava_callback - INFO - Starting async job submit for node 69f40b9a2fa6ff8e8ca9379b 2026-05-03 02:10:43,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:10:43,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40b9a2fa6ff8e8ca9379b HTTP/1.1" 200 None 2026-05-03 02:10:43,634 - lava_callback - DEBUG - Processing node 69f40b9a2fa6ff8e8ca9379b: baseline-arm64-clabbe 2026-05-03 02:10:43,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40b9a2fa6ff8e8ca9379b 2026-05-03 02:10:43,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:10:43,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40b9a2fa6ff8e8ca9379b HTTP/1.1" 200 None 2026-05-03 02:10:43,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:10:43,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:10:43,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:10:43,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40b9a2fa6ff8e8ca9379b HTTP/1.1" 200 None 2026-05-03 02:10:43,700 - lava_callback - ERROR - Error processing callback for node 69f40b9a2fa6ff8e8ca9379b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47180 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:12:03,598 - lava_callback - INFO - Received callback for node 69f40bec2fa6ff8e8ca937b6 INFO: 172.20.0.1:56200 - "POST /node/69f40bec2fa6ff8e8ca937b6 HTTP/1.0" 202 Accepted 2026-05-03 02:12:03,603 - lava_callback - INFO - Starting async job submit for node 69f40bec2fa6ff8e8ca937b6 2026-05-03 02:12:03,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:12:03,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40bec2fa6ff8e8ca937b6 HTTP/1.1" 200 None 2026-05-03 02:12:03,623 - lava_callback - DEBUG - Processing node 69f40bec2fa6ff8e8ca937b6: baseline-arm64-clabbe 2026-05-03 02:12:03,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40bec2fa6ff8e8ca937b6 2026-05-03 02:12:03,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:12:03,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40bec2fa6ff8e8ca937b6 HTTP/1.1" 200 None 2026-05-03 02:12:03,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:12:03,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:12:03,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:12:03,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40bec2fa6ff8e8ca937b6 HTTP/1.1" 200 None 2026-05-03 02:12:03,678 - lava_callback - ERROR - Error processing callback for node 69f40bec2fa6ff8e8ca937b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42164 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:13:23,658 - lava_callback - INFO - Received callback for node 69f40c382fa6ff8e8ca937f2 INFO: 172.20.0.1:53752 - "POST /node/69f40c382fa6ff8e8ca937f2 HTTP/1.0" 202 Accepted 2026-05-03 02:13:23,664 - lava_callback - INFO - Starting async job submit for node 69f40c382fa6ff8e8ca937f2 2026-05-03 02:13:23,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:13:23,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40c382fa6ff8e8ca937f2 HTTP/1.1" 200 None 2026-05-03 02:13:23,688 - lava_callback - DEBUG - Processing node 69f40c382fa6ff8e8ca937f2: baseline-arm64-clabbe 2026-05-03 02:13:23,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40c382fa6ff8e8ca937f2 2026-05-03 02:13:23,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:13:23,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40c382fa6ff8e8ca937f2 HTTP/1.1" 200 None 2026-05-03 02:13:23,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:13:23,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:13:23,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:13:23,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40c382fa6ff8e8ca937f2 HTTP/1.1" 200 None 2026-05-03 02:13:23,733 - lava_callback - ERROR - Error processing callback for node 69f40c382fa6ff8e8ca937f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32902 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:14:43,718 - lava_callback - INFO - Received callback for node 69f40c862fa6ff8e8ca9382d INFO: 172.20.0.1:42728 - "POST /node/69f40c862fa6ff8e8ca9382d HTTP/1.0" 202 Accepted 2026-05-03 02:14:43,724 - lava_callback - INFO - Starting async job submit for node 69f40c862fa6ff8e8ca9382d 2026-05-03 02:14:43,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:14:43,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40c862fa6ff8e8ca9382d HTTP/1.1" 200 None 2026-05-03 02:14:43,751 - lava_callback - DEBUG - Processing node 69f40c862fa6ff8e8ca9382d: baseline-arm64-clabbe 2026-05-03 02:14:43,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40c862fa6ff8e8ca9382d 2026-05-03 02:14:43,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:14:43,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40c862fa6ff8e8ca9382d HTTP/1.1" 200 None 2026-05-03 02:14:43,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:14:43,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:14:43,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:14:43,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40c862fa6ff8e8ca9382d HTTP/1.1" 200 None 2026-05-03 02:14:43,806 - lava_callback - ERROR - Error processing callback for node 69f40c862fa6ff8e8ca9382d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57028 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:16:03,804 - lava_callback - INFO - Received callback for node 69f40cd82fa6ff8e8ca93854 INFO: 172.20.0.1:58146 - "POST /node/69f40cd82fa6ff8e8ca93854 HTTP/1.0" 202 Accepted 2026-05-03 02:16:03,810 - lava_callback - INFO - Starting async job submit for node 69f40cd82fa6ff8e8ca93854 2026-05-03 02:16:03,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:16:03,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40cd82fa6ff8e8ca93854 HTTP/1.1" 200 None 2026-05-03 02:16:03,824 - lava_callback - DEBUG - Processing node 69f40cd82fa6ff8e8ca93854: baseline-arm64-clabbe 2026-05-03 02:16:03,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40cd82fa6ff8e8ca93854 2026-05-03 02:16:03,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:16:03,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40cd82fa6ff8e8ca93854 HTTP/1.1" 200 None 2026-05-03 02:16:03,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:16:03,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:16:03,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:16:03,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40cd82fa6ff8e8ca93854 HTTP/1.1" 200 None 2026-05-03 02:16:03,869 - lava_callback - ERROR - Error processing callback for node 69f40cd82fa6ff8e8ca93854: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57542 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:16:47,757 - lava_callback - INFO - Received callback for node 69f6af141f903fec0b0df5ea INFO: 172.20.0.1:57544 - "POST /node/69f6af141f903fec0b0df5ea HTTP/1.0" 202 Accepted 2026-05-03 02:16:47,768 - lava_callback - INFO - Starting async job submit for node 69f6af141f903fec0b0df5ea 2026-05-03 02:16:47,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:16:47,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6af141f903fec0b0df5ea HTTP/1.1" 200 None 2026-05-03 02:16:47,812 - lava_callback - DEBUG - Processing node 69f6af141f903fec0b0df5ea: ltp-fsx 2026-05-03 02:16:48,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:16:48,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:16:48,291 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69f6af141f903fec0b0df5ea/log.txt.gz 2026-05-03 02:16:48,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:16:48,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:16:48,718 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69f6af141f903fec0b0df5ea/lava-logs.yaml 2026-05-03 02:16:48,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:16:49,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:16:49,036 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69f6af141f903fec0b0df5ea/lava_callback.json.gz 2026-05-03 02:16:49,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:16:49,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6af141f903fec0b0df5ea HTTP/1.1" 200 None 2026-05-03 02:16:49,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:16:49,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 02:16:49,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:16:49,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6af141f903fec0b0df5ea HTTP/1.1" 200 None 2026-05-03 02:16:49,131 - lava_callback - INFO - Completed processing callback for node 69f6af141f903fec0b0df5ea 2026-05-03 02:16:50,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:16:50,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35280 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:17:23,866 - lava_callback - INFO - Received callback for node 69f40d2b2fa6ff8e8ca9387b INFO: 172.20.0.1:35622 - "POST /node/69f40d2b2fa6ff8e8ca9387b HTTP/1.0" 202 Accepted 2026-05-03 02:17:23,871 - lava_callback - INFO - Starting async job submit for node 69f40d2b2fa6ff8e8ca9387b 2026-05-03 02:17:23,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:17:23,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40d2b2fa6ff8e8ca9387b HTTP/1.1" 200 None 2026-05-03 02:17:23,886 - lava_callback - DEBUG - Processing node 69f40d2b2fa6ff8e8ca9387b: baseline-arm64-clabbe 2026-05-03 02:17:23,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40d2b2fa6ff8e8ca9387b 2026-05-03 02:17:23,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:17:23,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40d2b2fa6ff8e8ca9387b HTTP/1.1" 200 None 2026-05-03 02:17:23,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:17:23,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:17:23,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:17:23,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40d2b2fa6ff8e8ca9387b HTTP/1.1" 200 None 2026-05-03 02:17:23,943 - lava_callback - ERROR - Error processing callback for node 69f40d2b2fa6ff8e8ca9387b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38222 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:18:43,942 - lava_callback - INFO - Received callback for node 69f40d7d2fa6ff8e8ca938a8 INFO: 172.20.0.1:55768 - "POST /node/69f40d7d2fa6ff8e8ca938a8 HTTP/1.0" 202 Accepted 2026-05-03 02:18:43,947 - lava_callback - INFO - Starting async job submit for node 69f40d7d2fa6ff8e8ca938a8 2026-05-03 02:18:43,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:18:43,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40d7d2fa6ff8e8ca938a8 HTTP/1.1" 200 None 2026-05-03 02:18:43,964 - lava_callback - DEBUG - Processing node 69f40d7d2fa6ff8e8ca938a8: baseline-arm64-clabbe 2026-05-03 02:18:43,965 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40d7d2fa6ff8e8ca938a8 2026-05-03 02:18:43,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:18:43,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40d7d2fa6ff8e8ca938a8 HTTP/1.1" 200 None 2026-05-03 02:18:43,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:18:44,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:18:44,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:18:44,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40d7d2fa6ff8e8ca938a8 HTTP/1.1" 200 None 2026-05-03 02:18:44,028 - lava_callback - ERROR - Error processing callback for node 69f40d7d2fa6ff8e8ca938a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54856 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:20:23,897 - lava_callback - INFO - Received callback for node 69f40dd12fa6ff8e8ca938d4 INFO: 172.20.0.1:54114 - "POST /node/69f40dd12fa6ff8e8ca938d4 HTTP/1.0" 202 Accepted 2026-05-03 02:20:23,903 - lava_callback - INFO - Starting async job submit for node 69f40dd12fa6ff8e8ca938d4 2026-05-03 02:20:23,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:20:23,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40dd12fa6ff8e8ca938d4 HTTP/1.1" 200 None 2026-05-03 02:20:23,919 - lava_callback - DEBUG - Processing node 69f40dd12fa6ff8e8ca938d4: baseline-arm64-clabbe 2026-05-03 02:20:23,919 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40dd12fa6ff8e8ca938d4 2026-05-03 02:20:23,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:20:23,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40dd12fa6ff8e8ca938d4 HTTP/1.1" 200 None 2026-05-03 02:20:23,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:20:23,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:20:23,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:20:23,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40dd12fa6ff8e8ca938d4 HTTP/1.1" 200 None 2026-05-03 02:20:23,964 - lava_callback - ERROR - Error processing callback for node 69f40dd12fa6ff8e8ca938d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39362 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:21:34,367 - lava_callback - INFO - Received callback for node 69f40e222fa6ff8e8ca938eb INFO: 172.20.0.1:40532 - "POST /node/69f40e222fa6ff8e8ca938eb HTTP/1.0" 202 Accepted 2026-05-03 02:21:34,373 - lava_callback - INFO - Starting async job submit for node 69f40e222fa6ff8e8ca938eb 2026-05-03 02:21:34,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:21:34,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40e222fa6ff8e8ca938eb HTTP/1.1" 200 None 2026-05-03 02:21:34,401 - lava_callback - DEBUG - Processing node 69f40e222fa6ff8e8ca938eb: baseline-arm64-baylibre 2026-05-03 02:21:34,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40e222fa6ff8e8ca938eb 2026-05-03 02:21:34,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:21:34,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40e222fa6ff8e8ca938eb HTTP/1.1" 200 None 2026-05-03 02:21:34,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:21:34,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:21:34,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:21:34,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40e222fa6ff8e8ca938eb HTTP/1.1" 200 None 2026-05-03 02:21:34,448 - lava_callback - ERROR - Error processing callback for node 69f40e222fa6ff8e8ca938eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47960 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:23:04,038 - lava_callback - INFO - Received callback for node 69f40e752fa6ff8e8ca93928 INFO: 172.20.0.1:46172 - "POST /node/69f40e752fa6ff8e8ca93928 HTTP/1.0" 202 Accepted 2026-05-03 02:23:04,045 - lava_callback - INFO - Starting async job submit for node 69f40e752fa6ff8e8ca93928 2026-05-03 02:23:04,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:23:04,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40e752fa6ff8e8ca93928 HTTP/1.1" 200 None 2026-05-03 02:23:04,068 - lava_callback - DEBUG - Processing node 69f40e752fa6ff8e8ca93928: baseline-arm64-clabbe 2026-05-03 02:23:04,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40e752fa6ff8e8ca93928 2026-05-03 02:23:04,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:23:04,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40e752fa6ff8e8ca93928 HTTP/1.1" 200 None 2026-05-03 02:23:04,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:23:04,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:23:04,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:23:04,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40e752fa6ff8e8ca93928 HTTP/1.1" 200 None 2026-05-03 02:23:04,115 - lava_callback - ERROR - Error processing callback for node 69f40e752fa6ff8e8ca93928: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54228 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:24:24,082 - lava_callback - INFO - Received callback for node 69f40ec22fa6ff8e8ca93971 INFO: 172.20.0.1:50496 - "POST /node/69f40ec22fa6ff8e8ca93971 HTTP/1.0" 202 Accepted 2026-05-03 02:24:24,087 - lava_callback - INFO - Starting async job submit for node 69f40ec22fa6ff8e8ca93971 2026-05-03 02:24:24,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:24:24,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40ec22fa6ff8e8ca93971 HTTP/1.1" 200 None 2026-05-03 02:24:24,103 - lava_callback - DEBUG - Processing node 69f40ec22fa6ff8e8ca93971: baseline-arm64-clabbe 2026-05-03 02:24:24,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40ec22fa6ff8e8ca93971 2026-05-03 02:24:24,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:24:24,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40ec22fa6ff8e8ca93971 HTTP/1.1" 200 None 2026-05-03 02:24:24,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:24:24,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:24:24,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:24:24,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40ec22fa6ff8e8ca93971 HTTP/1.1" 200 None 2026-05-03 02:24:24,150 - lava_callback - ERROR - Error processing callback for node 69f40ec22fa6ff8e8ca93971: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47516 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:25:44,293 - lava_callback - INFO - Received callback for node 69f40f132fa6ff8e8ca93987 INFO: 172.20.0.1:40372 - "POST /node/69f40f132fa6ff8e8ca93987 HTTP/1.0" 202 Accepted 2026-05-03 02:25:44,299 - lava_callback - INFO - Starting async job submit for node 69f40f132fa6ff8e8ca93987 2026-05-03 02:25:44,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:25:44,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40f132fa6ff8e8ca93987 HTTP/1.1" 200 None 2026-05-03 02:25:44,314 - lava_callback - DEBUG - Processing node 69f40f132fa6ff8e8ca93987: baseline-arm64-clabbe 2026-05-03 02:25:44,315 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40f132fa6ff8e8ca93987 2026-05-03 02:25:44,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:25:44,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40f132fa6ff8e8ca93987 HTTP/1.1" 200 None 2026-05-03 02:25:44,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:25:44,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:25:44,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:25:44,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40f132fa6ff8e8ca93987 HTTP/1.1" 200 None 2026-05-03 02:25:44,376 - lava_callback - ERROR - Error processing callback for node 69f40f132fa6ff8e8ca93987: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40040 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:27:04,177 - lava_callback - INFO - Received callback for node 69f40f652fa6ff8e8ca939ab INFO: 172.20.0.1:59316 - "POST /node/69f40f652fa6ff8e8ca939ab HTTP/1.0" 202 Accepted 2026-05-03 02:27:04,185 - lava_callback - INFO - Starting async job submit for node 69f40f652fa6ff8e8ca939ab 2026-05-03 02:27:04,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:27:04,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40f652fa6ff8e8ca939ab HTTP/1.1" 200 None 2026-05-03 02:27:04,205 - lava_callback - DEBUG - Processing node 69f40f652fa6ff8e8ca939ab: baseline-arm64-clabbe 2026-05-03 02:27:04,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40f652fa6ff8e8ca939ab 2026-05-03 02:27:04,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:27:04,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40f652fa6ff8e8ca939ab HTTP/1.1" 200 None 2026-05-03 02:27:04,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:27:04,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:27:04,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:27:04,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40f652fa6ff8e8ca939ab HTTP/1.1" 200 None 2026-05-03 02:27:04,265 - lava_callback - ERROR - Error processing callback for node 69f40f652fa6ff8e8ca939ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57296 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:28:24,271 - lava_callback - INFO - Received callback for node 69f40fb62fa6ff8e8ca939d8 INFO: 172.20.0.1:46366 - "POST /node/69f40fb62fa6ff8e8ca939d8 HTTP/1.0" 202 Accepted 2026-05-03 02:28:24,276 - lava_callback - INFO - Starting async job submit for node 69f40fb62fa6ff8e8ca939d8 2026-05-03 02:28:24,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:28:24,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40fb62fa6ff8e8ca939d8 HTTP/1.1" 200 None 2026-05-03 02:28:24,294 - lava_callback - DEBUG - Processing node 69f40fb62fa6ff8e8ca939d8: baseline-arm64-clabbe 2026-05-03 02:28:24,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f40fb62fa6ff8e8ca939d8 2026-05-03 02:28:24,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:28:24,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f40fb62fa6ff8e8ca939d8 HTTP/1.1" 200 None 2026-05-03 02:28:24,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:28:24,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:28:24,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:28:24,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f40fb62fa6ff8e8ca939d8 HTTP/1.1" 200 None 2026-05-03 02:28:24,350 - lava_callback - ERROR - Error processing callback for node 69f40fb62fa6ff8e8ca939d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46368 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:28:27,788 - lava_callback - INFO - Received callback for node 69f6b2b81f903fec0b0df75c INFO: 172.20.0.1:46384 - "POST /node/69f6b2b81f903fec0b0df75c HTTP/1.0" 202 Accepted 2026-05-03 02:28:27,794 - lava_callback - INFO - Starting async job submit for node 69f6b2b81f903fec0b0df75c 2026-05-03 02:28:27,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:28:27,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b2b81f903fec0b0df75c HTTP/1.1" 200 None 2026-05-03 02:28:27,811 - lava_callback - DEBUG - Processing node 69f6b2b81f903fec0b0df75c: baseline-nfs-arm64 2026-05-03 02:28:27,813 - lava_callback - WARNING - Failed to upload log 2026-05-03 02:28:27,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:28:27,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:28:27,899 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6b2b81f903fec0b0df75c/lava-logs.yaml 2026-05-03 02:28:27,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:28:27,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:28:27,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6b2b81f903fec0b0df75c/lava_callback.json.gz 2026-05-03 02:28:27,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:28:28,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b2b81f903fec0b0df75c HTTP/1.1" 200 None 2026-05-03 02:28:28,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:28:28,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 02:28:28,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:28:28,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b2b81f903fec0b0df75c HTTP/1.1" 200 None 2026-05-03 02:28:28,056 - lava_callback - INFO - Completed processing callback for node 69f6b2b81f903fec0b0df75c INFO: 172.20.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41610 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:28:50,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:28:50,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36120 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:29:42,922 - lava_callback - INFO - Received callback for node 69f6ae6a1f903fec0b0df594 INFO: 172.20.0.1:55186 - "POST /node/69f6ae6a1f903fec0b0df594 HTTP/1.0" 202 Accepted 2026-05-03 02:29:42,930 - lava_callback - INFO - Starting async job submit for node 69f6ae6a1f903fec0b0df594 2026-05-03 02:29:42,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:29:42,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6ae6a1f903fec0b0df594 HTTP/1.1" 200 None 2026-05-03 02:29:42,987 - lava_callback - DEBUG - Processing node 69f6ae6a1f903fec0b0df594: baseline-nfs-arm64 2026-05-03 02:29:44,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:29:44,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:29:44,298 - lava_callback - INFO - Received callback for node 69f410052fa6ff8e8ca939f0 INFO: 172.20.0.1:55194 - "POST /node/69f410052fa6ff8e8ca939f0 HTTP/1.0" 202 Accepted 2026-05-03 02:29:44,305 - lava_callback - INFO - Starting async job submit for node 69f410052fa6ff8e8ca939f0 2026-05-03 02:29:44,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6ae6a1f903fec0b0df594/log.txt.gz 2026-05-03 02:29:44,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:29:44,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f410052fa6ff8e8ca939f0 HTTP/1.1" 200 None 2026-05-03 02:29:44,425 - lava_callback - DEBUG - Processing node 69f410052fa6ff8e8ca939f0: baseline-arm64-clabbe 2026-05-03 02:29:44,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f410052fa6ff8e8ca939f0 2026-05-03 02:29:44,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:29:44,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f410052fa6ff8e8ca939f0 HTTP/1.1" 200 None 2026-05-03 02:29:44,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:29:44,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:29:44,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:29:44,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f410052fa6ff8e8ca939f0 HTTP/1.1" 200 None 2026-05-03 02:29:44,723 - lava_callback - ERROR - Error processing callback for node 69f410052fa6ff8e8ca939f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-03 02:29:45,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:29:45,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:29:45,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6ae6a1f903fec0b0df594/lava-logs.yaml INFO: 172.20.0.1:55206 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:29:45,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:29:45,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:29:45,385 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6ae6a1f903fec0b0df594/lava_callback.json.gz DEBUG: Setup failed for 69f6ae6a1f903fec0b0df594. Transitting job node result: incomplete -> fail 2026-05-03 02:29:45,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:29:45,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6ae6a1f903fec0b0df594 HTTP/1.1" 200 None 2026-05-03 02:29:45,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:29:45,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 02:29:45,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:29:45,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6ae6a1f903fec0b0df594 HTTP/1.1" 200 None 2026-05-03 02:29:45,680 - lava_callback - INFO - Completed processing callback for node 69f6ae6a1f903fec0b0df594 INFO: 172.20.0.1:55218 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:29:50,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:29:50,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53904 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:31:04,341 - lava_callback - INFO - Received callback for node 69f410582fa6ff8e8ca93a18 INFO: 172.20.0.1:43276 - "POST /node/69f410582fa6ff8e8ca93a18 HTTP/1.0" 202 Accepted 2026-05-03 02:31:04,347 - lava_callback - INFO - Starting async job submit for node 69f410582fa6ff8e8ca93a18 2026-05-03 02:31:04,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:31:04,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f410582fa6ff8e8ca93a18 HTTP/1.1" 200 None 2026-05-03 02:31:04,363 - lava_callback - DEBUG - Processing node 69f410582fa6ff8e8ca93a18: baseline-arm64-clabbe 2026-05-03 02:31:04,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f410582fa6ff8e8ca93a18 2026-05-03 02:31:04,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:31:04,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f410582fa6ff8e8ca93a18 HTTP/1.1" 200 None 2026-05-03 02:31:04,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:31:04,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:31:04,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:31:04,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f410582fa6ff8e8ca93a18 HTTP/1.1" 200 None 2026-05-03 02:31:04,420 - lava_callback - ERROR - Error processing callback for node 69f410582fa6ff8e8ca93a18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38998 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:31:33,848 - lava_callback - INFO - Received callback for node 69f6b3431f903fec0b0df7a0 INFO: 172.20.0.1:34648 - "POST /node/69f6b3431f903fec0b0df7a0 HTTP/1.0" 202 Accepted 2026-05-03 02:31:33,857 - lava_callback - INFO - Starting async job submit for node 69f6b3431f903fec0b0df7a0 2026-05-03 02:31:33,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:31:33,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b3431f903fec0b0df7a0 HTTP/1.1" 200 None 2026-05-03 02:31:33,901 - lava_callback - DEBUG - Processing node 69f6b3431f903fec0b0df7a0: baseline-arm64 2026-05-03 02:31:34,041 - lava_callback - WARNING - Failed to upload log 2026-05-03 02:31:34,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:31:34,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:31:34,264 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b3431f903fec0b0df7a0/lava-logs.yaml 2026-05-03 02:31:34,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:31:34,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:31:34,343 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b3431f903fec0b0df7a0/lava_callback.json.gz 2026-05-03 02:31:34,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:31:34,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b3431f903fec0b0df7a0 HTTP/1.1" 200 None 2026-05-03 02:31:34,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:31:34,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 02:31:34,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:31:34,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b3431f903fec0b0df7a0 HTTP/1.1" 200 None 2026-05-03 02:31:34,499 - lava_callback - INFO - Completed processing callback for node 69f6b3431f903fec0b0df7a0 INFO: 172.20.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49040 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:31:50,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:31:50,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53426 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:32:19,767 - lava_callback - INFO - Received callback for node 69f6b38a1f903fec0b0df7ca INFO: 172.20.0.1:40846 - "POST /node/69f6b38a1f903fec0b0df7ca HTTP/1.0" 202 Accepted 2026-05-03 02:32:19,775 - lava_callback - INFO - Starting async job submit for node 69f6b38a1f903fec0b0df7ca 2026-05-03 02:32:19,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:32:19,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b38a1f903fec0b0df7ca HTTP/1.1" 200 None 2026-05-03 02:32:19,819 - lava_callback - DEBUG - Processing node 69f6b38a1f903fec0b0df7ca: baseline-arm64 2026-05-03 02:32:19,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:32:20,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:32:20,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b38a1f903fec0b0df7ca/log.txt.gz 2026-05-03 02:32:20,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:32:20,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:32:20,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b38a1f903fec0b0df7ca/lava-logs.yaml 2026-05-03 02:32:20,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:32:20,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:32:20,328 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b38a1f903fec0b0df7ca/lava_callback.json.gz 2026-05-03 02:32:20,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:32:20,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b38a1f903fec0b0df7ca HTTP/1.1" 200 None 2026-05-03 02:32:20,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:32:20,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 02:32:20,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:32:20,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b38a1f903fec0b0df7ca HTTP/1.1" 200 None 2026-05-03 02:32:20,479 - lava_callback - INFO - Completed processing callback for node 69f6b38a1f903fec0b0df7ca 2026-05-03 02:32:20,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:32:20,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-03 02:32:24,435 - lava_callback - INFO - Received callback for node 69f410a42fa6ff8e8ca93a5d INFO: 172.20.0.1:40854 - "POST /node/69f410a42fa6ff8e8ca93a5d HTTP/1.0" 202 Accepted 2026-05-03 02:32:24,441 - lava_callback - INFO - Starting async job submit for node 69f410a42fa6ff8e8ca93a5d 2026-05-03 02:32:24,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:32:24,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f410a42fa6ff8e8ca93a5d HTTP/1.1" 200 None 2026-05-03 02:32:24,459 - lava_callback - DEBUG - Processing node 69f410a42fa6ff8e8ca93a5d: baseline-arm64-clabbe 2026-05-03 02:32:24,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f410a42fa6ff8e8ca93a5d 2026-05-03 02:32:24,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:32:24,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f410a42fa6ff8e8ca93a5d HTTP/1.1" 200 None 2026-05-03 02:32:24,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:32:24,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:32:24,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:32:24,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f410a42fa6ff8e8ca93a5d HTTP/1.1" 200 None 2026-05-03 02:32:24,521 - lava_callback - ERROR - Error processing callback for node 69f410a42fa6ff8e8ca93a5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53794 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:33:24,480 - lava_callback - INFO - Received callback for node 69f410f12fa6ff8e8ca93a8b INFO: 172.20.0.1:42026 - "POST /node/69f410f12fa6ff8e8ca93a8b HTTP/1.0" 202 Accepted 2026-05-03 02:33:24,485 - lava_callback - INFO - Starting async job submit for node 69f410f12fa6ff8e8ca93a8b 2026-05-03 02:33:24,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:33:24,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f410f12fa6ff8e8ca93a8b HTTP/1.1" 200 None 2026-05-03 02:33:24,500 - lava_callback - DEBUG - Processing node 69f410f12fa6ff8e8ca93a8b: baseline-arm64-clabbe 2026-05-03 02:33:24,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f410f12fa6ff8e8ca93a8b 2026-05-03 02:33:24,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:33:24,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f410f12fa6ff8e8ca93a8b HTTP/1.1" 200 None 2026-05-03 02:33:24,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:33:24,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:33:24,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:33:24,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f410f12fa6ff8e8ca93a8b HTTP/1.1" 200 None 2026-05-03 02:33:24,555 - lava_callback - ERROR - Error processing callback for node 69f410f12fa6ff8e8ca93a8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59092 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:35:04,568 - lava_callback - INFO - Received callback for node 69f411442fa6ff8e8ca93ab0 INFO: 172.20.0.1:40554 - "POST /node/69f411442fa6ff8e8ca93ab0 HTTP/1.0" 202 Accepted 2026-05-03 02:35:04,574 - lava_callback - INFO - Starting async job submit for node 69f411442fa6ff8e8ca93ab0 2026-05-03 02:35:04,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:35:04,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f411442fa6ff8e8ca93ab0 HTTP/1.1" 200 None 2026-05-03 02:35:04,590 - lava_callback - DEBUG - Processing node 69f411442fa6ff8e8ca93ab0: baseline-arm64-clabbe 2026-05-03 02:35:04,591 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f411442fa6ff8e8ca93ab0 2026-05-03 02:35:04,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:35:04,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f411442fa6ff8e8ca93ab0 HTTP/1.1" 200 None 2026-05-03 02:35:04,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:35:04,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-03 02:35:04,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:35:04,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f411442fa6ff8e8ca93ab0 HTTP/1.1" 200 None 2026-05-03 02:35:04,635 - lava_callback - ERROR - Error processing callback for node 69f411442fa6ff8e8ca93ab0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42578 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:36:26,831 - lava_callback - INFO - Received callback for node 69f6b3d31f903fec0b0df7f3 INFO: 172.20.0.1:42582 - "POST /node/69f6b3d31f903fec0b0df7f3 HTTP/1.0" 202 Accepted 2026-05-03 02:36:26,839 - lava_callback - INFO - Starting async job submit for node 69f6b3d31f903fec0b0df7f3 2026-05-03 02:36:26,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:36:26,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b3d31f903fec0b0df7f3 HTTP/1.1" 200 None 2026-05-03 02:36:26,877 - lava_callback - DEBUG - Processing node 69f6b3d31f903fec0b0df7f3: baseline-arm64 2026-05-03 02:36:27,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:36:27,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:36:27,337 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b3d31f903fec0b0df7f3/log.txt.gz 2026-05-03 02:36:27,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:36:27,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:36:27,669 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b3d31f903fec0b0df7f3/lava-logs.yaml 2026-05-03 02:36:27,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:36:27,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:36:27,787 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b3d31f903fec0b0df7f3/lava_callback.json.gz 2026-05-03 02:36:27,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:36:27,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b3d31f903fec0b0df7f3 HTTP/1.1" 200 None 2026-05-03 02:36:27,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:36:27,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 02:36:27,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:36:27,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b3d31f903fec0b0df7f3 HTTP/1.1" 200 None 2026-05-03 02:36:27,921 - lava_callback - INFO - Completed processing callback for node 69f6b3d31f903fec0b0df7f3 INFO: 172.20.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33518 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:36:50,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:36:50,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36224 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:38:33,707 - lava_callback - INFO - Received callback for node 69f6b5151f903fec0b0df88d INFO: 172.20.0.1:59564 - "POST /node/69f6b5151f903fec0b0df88d HTTP/1.0" 202 Accepted 2026-05-03 02:38:33,713 - lava_callback - INFO - Starting async job submit for node 69f6b5151f903fec0b0df88d 2026-05-03 02:38:33,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:38:33,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b5151f903fec0b0df88d HTTP/1.1" 200 None 2026-05-03 02:38:33,730 - lava_callback - DEBUG - Processing node 69f6b5151f903fec0b0df88d: baseline-nfs-arm64 2026-05-03 02:38:33,732 - lava_callback - WARNING - Failed to upload log 2026-05-03 02:38:33,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:38:33,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:38:33,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6b5151f903fec0b0df88d/lava-logs.yaml 2026-05-03 02:38:33,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:38:33,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:38:33,930 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6b5151f903fec0b0df88d/lava_callback.json.gz 2026-05-03 02:38:33,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:38:33,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b5151f903fec0b0df88d HTTP/1.1" 200 None 2026-05-03 02:38:33,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:38:33,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 02:38:33,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:38:33,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b5151f903fec0b0df88d HTTP/1.1" 200 None 2026-05-03 02:38:33,992 - lava_callback - INFO - Completed processing callback for node 69f6b5151f903fec0b0df88d INFO: 172.20.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43180 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:38:50,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:38:50,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34516 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:41:31,296 - lava_callback - INFO - Received callback for node 69f6b5a11f903fec0b0df8da INFO: 172.20.0.1:49358 - "POST /node/69f6b5a11f903fec0b0df8da HTTP/1.0" 202 Accepted 2026-05-03 02:41:31,303 - lava_callback - INFO - Starting async job submit for node 69f6b5a11f903fec0b0df8da 2026-05-03 02:41:31,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:41:31,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b5a11f903fec0b0df8da HTTP/1.1" 200 None 2026-05-03 02:41:31,347 - lava_callback - DEBUG - Processing node 69f6b5a11f903fec0b0df8da: baseline-arm64 2026-05-03 02:41:31,479 - lava_callback - WARNING - Failed to upload log 2026-05-03 02:41:31,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:41:31,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:41:31,682 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b5a11f903fec0b0df8da/lava-logs.yaml 2026-05-03 02:41:31,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:41:31,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:41:31,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b5a11f903fec0b0df8da/lava_callback.json.gz 2026-05-03 02:41:31,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:41:31,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b5a11f903fec0b0df8da HTTP/1.1" 200 None 2026-05-03 02:41:31,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:41:31,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 02:41:31,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:41:31,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b5a11f903fec0b0df8da HTTP/1.1" 200 None 2026-05-03 02:41:31,911 - lava_callback - INFO - Completed processing callback for node 69f6b5a11f903fec0b0df8da INFO: 172.20.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37562 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:41:50,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:41:50,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38470 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:42:23,520 - lava_callback - INFO - Received callback for node 69f6b45a1f903fec0b0df82e INFO: 172.20.0.1:53458 - "POST /node/69f6b45a1f903fec0b0df82e HTTP/1.0" 202 Accepted 2026-05-03 02:42:23,528 - lava_callback - INFO - Starting async job submit for node 69f6b45a1f903fec0b0df82e 2026-05-03 02:42:23,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:42:23,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b45a1f903fec0b0df82e HTTP/1.1" 200 None 2026-05-03 02:42:23,580 - lava_callback - DEBUG - Processing node 69f6b45a1f903fec0b0df82e: baseline-arm64 2026-05-03 02:42:23,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:42:24,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:42:24,035 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b45a1f903fec0b0df82e/log.txt.gz 2026-05-03 02:42:24,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:42:24,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:42:24,481 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b45a1f903fec0b0df82e/lava-logs.yaml 2026-05-03 02:42:24,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:42:24,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:42:24,633 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b45a1f903fec0b0df82e/lava_callback.json.gz DEBUG: Setup failed for 69f6b45a1f903fec0b0df82e. Transitting job node result: incomplete -> fail 2026-05-03 02:42:24,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:42:24,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b45a1f903fec0b0df82e HTTP/1.1" 200 None 2026-05-03 02:42:24,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:42:24,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 02:42:24,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:42:24,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b45a1f903fec0b0df82e HTTP/1.1" 200 None 2026-05-03 02:42:24,850 - lava_callback - INFO - Completed processing callback for node 69f6b45a1f903fec0b0df82e INFO: 172.20.0.1:53472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33502 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:42:46,177 - lava_callback - INFO - Received callback for node 69f6b5eb1f903fec0b0df8fe INFO: 172.20.0.1:33516 - "POST /node/69f6b5eb1f903fec0b0df8fe HTTP/1.0" 202 Accepted 2026-05-03 02:42:46,184 - lava_callback - INFO - Starting async job submit for node 69f6b5eb1f903fec0b0df8fe 2026-05-03 02:42:46,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:42:46,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b5eb1f903fec0b0df8fe HTTP/1.1" 200 None 2026-05-03 02:42:46,236 - lava_callback - DEBUG - Processing node 69f6b5eb1f903fec0b0df8fe: baseline-arm64 2026-05-03 02:42:46,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:42:46,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:42:46,459 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b5eb1f903fec0b0df8fe/log.txt.gz INFO: 172.20.0.1:33522 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:42:46,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:42:46,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:42:46,686 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b5eb1f903fec0b0df8fe/lava-logs.yaml 2026-05-03 02:42:46,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:42:46,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:42:46,785 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b5eb1f903fec0b0df8fe/lava_callback.json.gz 2026-05-03 02:42:46,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:42:46,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b5eb1f903fec0b0df8fe HTTP/1.1" 200 None 2026-05-03 02:42:46,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:42:46,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 02:42:46,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:42:46,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b5eb1f903fec0b0df8fe HTTP/1.1" 200 None 2026-05-03 02:42:46,957 - lava_callback - INFO - Completed processing callback for node 69f6b5eb1f903fec0b0df8fe 2026-05-03 02:42:50,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:42:50,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39536 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:46:44,953 - lava_callback - INFO - Received callback for node 69f4140d2fa6ff8e8ca93b21 INFO: 172.20.0.1:52462 - "POST /node/69f4140d2fa6ff8e8ca93b21 HTTP/1.0" 202 Accepted 2026-05-03 02:46:44,959 - lava_callback - INFO - Starting async job submit for node 69f4140d2fa6ff8e8ca93b21 2026-05-03 02:46:44,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:46:44,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4140d2fa6ff8e8ca93b21 HTTP/1.1" 200 None 2026-05-03 02:46:44,974 - lava_callback - DEBUG - Processing node 69f4140d2fa6ff8e8ca93b21: baseline-arm-clabbe 2026-05-03 02:46:44,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4140d2fa6ff8e8ca93b21 2026-05-03 02:46:44,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:46:44,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4140d2fa6ff8e8ca93b21 HTTP/1.1" 200 None 2026-05-03 02:46:44,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:46:45,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-03 02:46:45,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:46:45,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4140d2fa6ff8e8ca93b21 HTTP/1.1" 200 None 2026-05-03 02:46:45,030 - lava_callback - ERROR - Error processing callback for node 69f4140d2fa6ff8e8ca93b21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52480 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:46:53,057 - lava_callback - INFO - Received callback for node 69f6b6341f903fec0b0df92b INFO: 172.20.0.1:48134 - "POST /node/69f6b6341f903fec0b0df92b HTTP/1.0" 202 Accepted 2026-05-03 02:46:53,063 - lava_callback - INFO - Starting async job submit for node 69f6b6341f903fec0b0df92b 2026-05-03 02:46:53,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:46:53,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b6341f903fec0b0df92b HTTP/1.1" 200 None 2026-05-03 02:46:53,095 - lava_callback - DEBUG - Processing node 69f6b6341f903fec0b0df92b: baseline-arm64 2026-05-03 02:46:53,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:46:53,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:46:53,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b6341f903fec0b0df92b/log.txt.gz 2026-05-03 02:46:53,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:46:53,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:46:53,974 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b6341f903fec0b0df92b/lava-logs.yaml 2026-05-03 02:46:53,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:46:54,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:46:54,118 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b6341f903fec0b0df92b/lava_callback.json.gz 2026-05-03 02:46:54,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:46:54,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b6341f903fec0b0df92b HTTP/1.1" 200 None 2026-05-03 02:46:54,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:46:54,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 02:46:54,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:46:54,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b6341f903fec0b0df92b HTTP/1.1" 200 None 2026-05-03 02:46:54,243 - lava_callback - INFO - Completed processing callback for node 69f6b6341f903fec0b0df92b INFO: 172.20.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42086 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:47:20,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:47:20,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50858 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:47:44,982 - lava_callback - INFO - Received callback for node 69f414482fa6ff8e8ca93b37 INFO: 172.20.0.1:37274 - "POST /node/69f414482fa6ff8e8ca93b37 HTTP/1.0" 202 Accepted 2026-05-03 02:47:44,989 - lava_callback - INFO - Starting async job submit for node 69f414482fa6ff8e8ca93b37 2026-05-03 02:47:44,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:47:45,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f414482fa6ff8e8ca93b37 HTTP/1.1" 200 None 2026-05-03 02:47:45,005 - lava_callback - DEBUG - Processing node 69f414482fa6ff8e8ca93b37: baseline-arm-clabbe 2026-05-03 02:47:45,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f414482fa6ff8e8ca93b37 2026-05-03 02:47:45,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:47:45,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f414482fa6ff8e8ca93b37 HTTP/1.1" 200 None 2026-05-03 02:47:45,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:47:45,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-03 02:47:45,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:47:45,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f414482fa6ff8e8ca93b37 HTTP/1.1" 200 None 2026-05-03 02:47:45,069 - lava_callback - ERROR - Error processing callback for node 69f414482fa6ff8e8ca93b37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41714 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:48:24,936 - lava_callback - INFO - Received callback for node 69f414702fa6ff8e8ca93b45 INFO: 172.20.0.1:50076 - "POST /node/69f414702fa6ff8e8ca93b45 HTTP/1.0" 202 Accepted 2026-05-03 02:48:24,942 - lava_callback - INFO - Starting async job submit for node 69f414702fa6ff8e8ca93b45 2026-05-03 02:48:24,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:48:24,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f414702fa6ff8e8ca93b45 HTTP/1.1" 200 None 2026-05-03 02:48:24,959 - lava_callback - DEBUG - Processing node 69f414702fa6ff8e8ca93b45: baseline-arm-clabbe 2026-05-03 02:48:24,959 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f414702fa6ff8e8ca93b45 2026-05-03 02:48:24,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:48:24,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f414702fa6ff8e8ca93b45 HTTP/1.1" 200 None 2026-05-03 02:48:24,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:48:24,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-03 02:48:24,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:48:25,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f414702fa6ff8e8ca93b45 HTTP/1.1" 200 None 2026-05-03 02:48:25,009 - lava_callback - ERROR - Error processing callback for node 69f414702fa6ff8e8ca93b45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58356 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:49:05,020 - lava_callback - INFO - Received callback for node 69f414992fa6ff8e8ca93b58 INFO: 172.20.0.1:34596 - "POST /node/69f414992fa6ff8e8ca93b58 HTTP/1.0" 202 Accepted 2026-05-03 02:49:05,025 - lava_callback - INFO - Starting async job submit for node 69f414992fa6ff8e8ca93b58 2026-05-03 02:49:05,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:49:05,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f414992fa6ff8e8ca93b58 HTTP/1.1" 200 None 2026-05-03 02:49:05,040 - lava_callback - DEBUG - Processing node 69f414992fa6ff8e8ca93b58: baseline-arm-clabbe 2026-05-03 02:49:05,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f414992fa6ff8e8ca93b58 2026-05-03 02:49:05,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:49:05,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f414992fa6ff8e8ca93b58 HTTP/1.1" 200 None 2026-05-03 02:49:05,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:49:05,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-03 02:49:05,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:49:05,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f414992fa6ff8e8ca93b58 HTTP/1.1" 200 None 2026-05-03 02:49:05,088 - lava_callback - ERROR - Error processing callback for node 69f414992fa6ff8e8ca93b58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40186 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:49:45,023 - lava_callback - INFO - Received callback for node 69f414c12fa6ff8e8ca93b6f INFO: 172.20.0.1:50522 - "POST /node/69f414c12fa6ff8e8ca93b6f HTTP/1.0" 202 Accepted 2026-05-03 02:49:45,029 - lava_callback - INFO - Starting async job submit for node 69f414c12fa6ff8e8ca93b6f 2026-05-03 02:49:45,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:49:45,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f414c12fa6ff8e8ca93b6f HTTP/1.1" 200 None 2026-05-03 02:49:45,055 - lava_callback - DEBUG - Processing node 69f414c12fa6ff8e8ca93b6f: baseline-arm-clabbe 2026-05-03 02:49:45,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f414c12fa6ff8e8ca93b6f 2026-05-03 02:49:45,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:49:45,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f414c12fa6ff8e8ca93b6f HTTP/1.1" 200 None 2026-05-03 02:49:45,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:49:45,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-03 02:49:45,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:49:45,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f414c12fa6ff8e8ca93b6f HTTP/1.1" 200 None 2026-05-03 02:49:45,124 - lava_callback - ERROR - Error processing callback for node 69f414c12fa6ff8e8ca93b6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51746 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:50:25,045 - lava_callback - INFO - Received callback for node 69f414ea2fa6ff8e8ca93b7e INFO: 172.20.0.1:57598 - "POST /node/69f414ea2fa6ff8e8ca93b7e HTTP/1.0" 202 Accepted 2026-05-03 02:50:25,051 - lava_callback - INFO - Starting async job submit for node 69f414ea2fa6ff8e8ca93b7e 2026-05-03 02:50:25,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:50:25,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f414ea2fa6ff8e8ca93b7e HTTP/1.1" 200 None 2026-05-03 02:50:25,068 - lava_callback - DEBUG - Processing node 69f414ea2fa6ff8e8ca93b7e: baseline-arm-clabbe 2026-05-03 02:50:25,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f414ea2fa6ff8e8ca93b7e 2026-05-03 02:50:25,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:50:25,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f414ea2fa6ff8e8ca93b7e HTTP/1.1" 200 None 2026-05-03 02:50:25,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:50:25,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-03 02:50:25,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:50:25,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f414ea2fa6ff8e8ca93b7e HTTP/1.1" 200 None 2026-05-03 02:50:25,139 - lava_callback - ERROR - Error processing callback for node 69f414ea2fa6ff8e8ca93b7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52914 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:51:05,034 - lava_callback - INFO - Received callback for node 69f415132fa6ff8e8ca93b91 INFO: 172.20.0.1:51178 - "POST /node/69f415132fa6ff8e8ca93b91 HTTP/1.0" 202 Accepted 2026-05-03 02:51:05,039 - lava_callback - INFO - Starting async job submit for node 69f415132fa6ff8e8ca93b91 2026-05-03 02:51:05,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:05,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f415132fa6ff8e8ca93b91 HTTP/1.1" 200 None 2026-05-03 02:51:05,057 - lava_callback - DEBUG - Processing node 69f415132fa6ff8e8ca93b91: baseline-arm-clabbe 2026-05-03 02:51:05,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f415132fa6ff8e8ca93b91 2026-05-03 02:51:05,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:05,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f415132fa6ff8e8ca93b91 HTTP/1.1" 200 None 2026-05-03 02:51:05,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:05,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-03 02:51:05,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:05,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f415132fa6ff8e8ca93b91 HTTP/1.1" 200 None 2026-05-03 02:51:05,109 - lava_callback - ERROR - Error processing callback for node 69f415132fa6ff8e8ca93b91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57560 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:51:45,116 - lava_callback - INFO - Received callback for node 69f4153d2fa6ff8e8ca93ba5 INFO: 172.20.0.1:59468 - "POST /node/69f4153d2fa6ff8e8ca93ba5 HTTP/1.0" 202 Accepted 2026-05-03 02:51:45,122 - lava_callback - INFO - Starting async job submit for node 69f4153d2fa6ff8e8ca93ba5 2026-05-03 02:51:45,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:45,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4153d2fa6ff8e8ca93ba5 HTTP/1.1" 200 None 2026-05-03 02:51:45,142 - lava_callback - DEBUG - Processing node 69f4153d2fa6ff8e8ca93ba5: baseline-arm-clabbe 2026-05-03 02:51:45,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4153d2fa6ff8e8ca93ba5 2026-05-03 02:51:45,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:45,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4153d2fa6ff8e8ca93ba5 HTTP/1.1" 200 None 2026-05-03 02:51:45,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:45,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-03 02:51:45,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:45,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4153d2fa6ff8e8ca93ba5 HTTP/1.1" 200 None 2026-05-03 02:51:45,210 - lava_callback - ERROR - Error processing callback for node 69f4153d2fa6ff8e8ca93ba5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59470 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:51:45,716 - lava_callback - INFO - Received callback for node 69f6b6821f903fec0b0df955 INFO: 172.20.0.1:59482 - "POST /node/69f6b6821f903fec0b0df955 HTTP/1.0" 202 Accepted 2026-05-03 02:51:45,724 - lava_callback - INFO - Starting async job submit for node 69f6b6821f903fec0b0df955 2026-05-03 02:51:45,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:45,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b6821f903fec0b0df955 HTTP/1.1" 200 None 2026-05-03 02:51:45,774 - lava_callback - DEBUG - Processing node 69f6b6821f903fec0b0df955: baseline-arm64 2026-05-03 02:51:46,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:51:46,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:51:46,230 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b6821f903fec0b0df955/log.txt.gz 2026-05-03 02:51:46,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:59498 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:51:46,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:51:46,600 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b6821f903fec0b0df955/lava-logs.yaml 2026-05-03 02:51:46,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:51:46,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:51:46,720 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f6b6821f903fec0b0df955/lava_callback.json.gz DEBUG: Setup failed for 69f6b6821f903fec0b0df955. Transitting job node result: incomplete -> fail 2026-05-03 02:51:46,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:46,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b6821f903fec0b0df955 HTTP/1.1" 200 None 2026-05-03 02:51:46,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:46,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 02:51:46,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:46,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b6821f903fec0b0df955 HTTP/1.1" 200 None 2026-05-03 02:51:46,954 - lava_callback - INFO - Completed processing callback for node 69f6b6821f903fec0b0df955 2026-05-03 02:51:50,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:51:50,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43960 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:52:23,363 - lava_callback - INFO - Received callback for node 69f6b49f1f903fec0b0df84b INFO: 172.20.0.1:51054 - "POST /node/69f6b49f1f903fec0b0df84b HTTP/1.0" 202 Accepted 2026-05-03 02:52:23,369 - lava_callback - INFO - Starting async job submit for node 69f6b49f1f903fec0b0df84b 2026-05-03 02:52:23,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:52:23,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b49f1f903fec0b0df84b HTTP/1.1" 200 None 2026-05-03 02:52:23,437 - lava_callback - DEBUG - Processing node 69f6b49f1f903fec0b0df84b: baseline-arm 2026-05-03 02:52:24,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:52:24,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:52:24,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f6b49f1f903fec0b0df84b/log.txt.gz 2026-05-03 02:52:24,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:52:24,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:52:24,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f6b49f1f903fec0b0df84b/lava-logs.yaml 2026-05-03 02:52:24,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:52:24,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:52:24,792 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f6b49f1f903fec0b0df84b/lava_callback.json.gz DEBUG: Setup failed for 69f6b49f1f903fec0b0df84b. Transitting job node result: incomplete -> fail 2026-05-03 02:52:24,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:52:24,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b49f1f903fec0b0df84b HTTP/1.1" 200 None 2026-05-03 02:52:24,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:52:24,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 02:52:24,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:52:24,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b49f1f903fec0b0df84b HTTP/1.1" 200 None 2026-05-03 02:52:25,080 - lava_callback - INFO - Completed processing callback for node 69f6b49f1f903fec0b0df84b 2026-05-03 02:52:25,105 - lava_callback - INFO - Received callback for node 69f415662fa6ff8e8ca93bb7 INFO: 172.20.0.1:51070 - "POST /node/69f415662fa6ff8e8ca93bb7 HTTP/1.0" 202 Accepted 2026-05-03 02:52:25,110 - lava_callback - INFO - Starting async job submit for node 69f415662fa6ff8e8ca93bb7 2026-05-03 02:52:25,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:52:25,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f415662fa6ff8e8ca93bb7 HTTP/1.1" 200 None 2026-05-03 02:52:25,125 - lava_callback - DEBUG - Processing node 69f415662fa6ff8e8ca93bb7: baseline-arm-clabbe 2026-05-03 02:52:25,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f415662fa6ff8e8ca93bb7 2026-05-03 02:52:25,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:52:25,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f415662fa6ff8e8ca93bb7 HTTP/1.1" 200 None 2026-05-03 02:52:25,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:52:25,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-03 02:52:25,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:52:25,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f415662fa6ff8e8ca93bb7 HTTP/1.1" 200 None 2026-05-03 02:52:25,185 - lava_callback - ERROR - Error processing callback for node 69f415662fa6ff8e8ca93bb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47430 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:52:50,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:52:50,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40860 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:54:43,409 - lava_callback - INFO - Received callback for node 69f6b4c31f903fec0b0df865 INFO: 172.20.0.1:57090 - "POST /node/69f6b4c31f903fec0b0df865 HTTP/1.0" 202 Accepted 2026-05-03 02:54:43,415 - lava_callback - INFO - Starting async job submit for node 69f6b4c31f903fec0b0df865 2026-05-03 02:54:43,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:54:43,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b4c31f903fec0b0df865 HTTP/1.1" 200 None 2026-05-03 02:54:43,487 - lava_callback - DEBUG - Processing node 69f6b4c31f903fec0b0df865: ltp-smoke 2026-05-03 02:54:44,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:54:44,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:54:44,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f6b4c31f903fec0b0df865/log.txt.gz 2026-05-03 02:54:44,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:54:44,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:54:44,604 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f6b4c31f903fec0b0df865/lava-logs.yaml 2026-05-03 02:54:44,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:54:44,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:54:44,718 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f6b4c31f903fec0b0df865/lava_callback.json.gz 2026-05-03 02:54:44,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:54:44,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b4c31f903fec0b0df865 HTTP/1.1" 200 None 2026-05-03 02:54:44,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:54:44,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f694321f903fec0b0dbc7d HTTP/1.1" 200 None 2026-05-03 02:54:44,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:54:44,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b4c31f903fec0b0df865 HTTP/1.1" 200 None 2026-05-03 02:54:45,116 - lava_callback - INFO - Completed processing callback for node 69f6b4c31f903fec0b0df865 INFO: 172.20.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57110 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:54:50,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:54:50,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33244 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:59:21,300 - lava_callback - INFO - Received callback for node 69f6b55d1f903fec0b0df8b2 INFO: 172.20.0.1:46810 - "POST /node/69f6b55d1f903fec0b0df8b2 HTTP/1.0" 202 Accepted 2026-05-03 02:59:21,312 - lava_callback - INFO - Starting async job submit for node 69f6b55d1f903fec0b0df8b2 2026-05-03 02:59:21,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:59:21,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b55d1f903fec0b0df8b2 HTTP/1.1" 200 None 2026-05-03 02:59:21,384 - lava_callback - DEBUG - Processing node 69f6b55d1f903fec0b0df8b2: baseline-nfs-arm64 2026-05-03 02:59:22,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:59:22,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:59:22,646 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6b55d1f903fec0b0df8b2/log.txt.gz 2026-05-03 02:59:23,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:59:23,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:59:23,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6b55d1f903fec0b0df8b2/lava-logs.yaml 2026-05-03 02:59:23,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 02:59:23,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 02:59:23,705 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6b55d1f903fec0b0df8b2/lava_callback.json.gz DEBUG: Setup failed for 69f6b55d1f903fec0b0df8b2. Transitting job node result: incomplete -> fail 2026-05-03 02:59:23,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:59:23,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b55d1f903fec0b0df8b2 HTTP/1.1" 200 None 2026-05-03 02:59:23,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:59:23,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 02:59:23,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:59:23,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b55d1f903fec0b0df8b2 HTTP/1.1" 200 None 2026-05-03 02:59:23,927 - lava_callback - INFO - Completed processing callback for node 69f6b55d1f903fec0b0df8b2 INFO: 172.20.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47490 - "GET / HTTP/1.0" 200 OK 2026-05-03 02:59:50,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 02:59:50,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36484 - "GET /node/693f72220d8ce4018da93647%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33814 - "GET /node/69e3b4b97f5347282fbde4d1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41624 - "GET /node/69e4ad457ab9251d5f9174c4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40728 - "GET / HTTP/1.0" 200 OK 2026-05-03 03:11:19,003 - lava_callback - INFO - Received callback for node 69f6b8981f903fec0b0dfa22 INFO: 172.20.0.1:40736 - "POST /node/69f6b8981f903fec0b0dfa22 HTTP/1.0" 202 Accepted 2026-05-03 03:11:19,015 - lava_callback - INFO - Starting async job submit for node 69f6b8981f903fec0b0dfa22 2026-05-03 03:11:19,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:11:19,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b8981f903fec0b0dfa22 HTTP/1.1" 200 None 2026-05-03 03:11:19,113 - lava_callback - DEBUG - Processing node 69f6b8981f903fec0b0dfa22: baseline-arm 2026-05-03 03:11:19,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 03:11:19,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 03:11:19,844 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f6b8981f903fec0b0dfa22/log.txt.gz 2026-05-03 03:11:20,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 03:11:20,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 03:11:20,397 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f6b8981f903fec0b0dfa22/lava-logs.yaml 2026-05-03 03:11:20,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 03:11:20,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 03:11:20,524 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f6b8981f903fec0b0dfa22/lava_callback.json.gz DEBUG: Setup failed for 69f6b8981f903fec0b0dfa22. Transitting job node result: incomplete -> fail 2026-05-03 03:11:20,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:11:20,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b8981f903fec0b0dfa22 HTTP/1.1" 200 None 2026-05-03 03:11:20,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:11:20,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-03 03:11:20,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:11:20,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b8981f903fec0b0dfa22 HTTP/1.1" 200 None 2026-05-03 03:11:20,804 - lava_callback - INFO - Completed processing callback for node 69f6b8981f903fec0b0dfa22 2026-05-03 03:11:20,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:11:20,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54656 - "GET / HTTP/1.0" 200 OK 2026-05-03 03:13:44,163 - lava_callback - INFO - Received callback for node 69f6b93d1f903fec0b0dfa78 INFO: 172.20.0.1:44798 - "POST /node/69f6b93d1f903fec0b0dfa78 HTTP/1.0" 202 Accepted 2026-05-03 03:13:44,169 - lava_callback - INFO - Starting async job submit for node 69f6b93d1f903fec0b0dfa78 2026-05-03 03:13:44,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:13:44,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b93d1f903fec0b0dfa78 HTTP/1.1" 200 None 2026-05-03 03:13:44,255 - lava_callback - DEBUG - Processing node 69f6b93d1f903fec0b0dfa78: ltp-smoke 2026-05-03 03:13:44,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 03:13:44,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 03:13:44,868 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f6b93d1f903fec0b0dfa78/log.txt.gz 2026-05-03 03:13:45,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 03:13:45,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 03:13:45,322 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f6b93d1f903fec0b0dfa78/lava-logs.yaml 2026-05-03 03:13:45,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 03:13:45,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 03:13:45,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f6b93d1f903fec0b0dfa78/lava_callback.json.gz 2026-05-03 03:13:45,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:13:45,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6b93d1f903fec0b0dfa78 HTTP/1.1" 200 None 2026-05-03 03:13:45,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:13:45,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f694321f903fec0b0dbc7d HTTP/1.1" 200 None 2026-05-03 03:13:45,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:13:45,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6b93d1f903fec0b0dfa78 HTTP/1.1" 200 None 2026-05-03 03:13:45,717 - lava_callback - INFO - Completed processing callback for node 69f6b93d1f903fec0b0dfa78 INFO: 172.20.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44828 - "GET / HTTP/1.0" 200 OK 2026-05-03 03:13:50,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:13:50,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50436 - "GET /node/69831396409235c29c0def2e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33286 - "GET / HTTP/1.0" 200 OK 2026-05-03 03:19:21,630 - lava_callback - INFO - Received callback for node 69f6ba131f903fec0b0dfac3 INFO: 172.20.0.1:55376 - "POST /node/69f6ba131f903fec0b0dfac3 HTTP/1.0" 202 Accepted 2026-05-03 03:19:21,639 - lava_callback - INFO - Starting async job submit for node 69f6ba131f903fec0b0dfac3 2026-05-03 03:19:21,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:19:21,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6ba131f903fec0b0dfac3 HTTP/1.1" 200 None 2026-05-03 03:19:21,715 - lava_callback - DEBUG - Processing node 69f6ba131f903fec0b0dfac3: baseline-nfs-arm64 2026-05-03 03:19:22,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 03:19:22,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 03:19:22,944 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6ba131f903fec0b0dfac3/log.txt.gz 2026-05-03 03:19:23,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 03:19:23,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 03:19:23,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6ba131f903fec0b0dfac3/lava-logs.yaml 2026-05-03 03:19:23,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-03 03:19:23,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-03 03:19:23,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f6ba131f903fec0b0dfac3/lava_callback.json.gz DEBUG: Setup failed for 69f6ba131f903fec0b0dfac3. Transitting job node result: incomplete -> fail 2026-05-03 03:19:24,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:19:24,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6ba131f903fec0b0dfac3 HTTP/1.1" 200 None 2026-05-03 03:19:24,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:19:24,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-03 03:19:24,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:19:24,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6ba131f903fec0b0dfac3 HTTP/1.1" 200 None 2026-05-03 03:19:24,174 - lava_callback - INFO - Completed processing callback for node 69f6ba131f903fec0b0dfac3 INFO: 172.20.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41494 - "GET / HTTP/1.0" 200 OK 2026-05-03 03:19:50,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:19:50,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38822 - "GET / HTTP/1.0" 200 OK 2026-05-03 03:49:58,997 - lava_callback - INFO - Received callback for node 69f422dd2fa6ff8e8ca93c6a INFO: 172.20.0.1:38826 - "POST /node/69f422dd2fa6ff8e8ca93c6a HTTP/1.0" 202 Accepted 2026-05-03 03:49:59,002 - lava_callback - INFO - Starting async job submit for node 69f422dd2fa6ff8e8ca93c6a 2026-05-03 03:49:59,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:49:59,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f422dd2fa6ff8e8ca93c6a HTTP/1.1" 200 None 2026-05-03 03:49:59,018 - lava_callback - DEBUG - Processing node 69f422dd2fa6ff8e8ca93c6a: baseline-arm64-baylibre 2026-05-03 03:49:59,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f422dd2fa6ff8e8ca93c6a 2026-05-03 03:49:59,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:49:59,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f422dd2fa6ff8e8ca93c6a HTTP/1.1" 200 None 2026-05-03 03:49:59,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:49:59,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-03 03:49:59,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:49:59,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f422dd2fa6ff8e8ca93c6a HTTP/1.1" 200 None 2026-05-03 03:49:59,067 - lava_callback - ERROR - Error processing callback for node 69f422dd2fa6ff8e8ca93c6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57472 - "GET / HTTP/1.0" 200 OK 2026-05-03 03:52:07,719 - lava_callback - INFO - Received callback for node 69f4235b2fa6ff8e8ca93c90 INFO: 172.20.0.1:57486 - "POST /node/69f4235b2fa6ff8e8ca93c90 HTTP/1.0" 202 Accepted 2026-05-03 03:52:07,725 - lava_callback - INFO - Starting async job submit for node 69f4235b2fa6ff8e8ca93c90 2026-05-03 03:52:07,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:52:07,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4235b2fa6ff8e8ca93c90 HTTP/1.1" 200 None 2026-05-03 03:52:07,740 - lava_callback - DEBUG - Processing node 69f4235b2fa6ff8e8ca93c90: baseline-arm64-clabbe 2026-05-03 03:52:07,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4235b2fa6ff8e8ca93c90 2026-05-03 03:52:07,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:52:07,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4235b2fa6ff8e8ca93c90 HTTP/1.1" 200 None 2026-05-03 03:52:07,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:52:07,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-03 03:52:07,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:52:07,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4235b2fa6ff8e8ca93c90 HTTP/1.1" 200 None 2026-05-03 03:52:07,794 - lava_callback - ERROR - Error processing callback for node 69f4235b2fa6ff8e8ca93c90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43386 - "GET / HTTP/1.0" 200 OK 2026-05-03 03:54:07,722 - lava_callback - INFO - Received callback for node 69f423d32fa6ff8e8ca93cb6 INFO: 172.20.0.1:43396 - "POST /node/69f423d32fa6ff8e8ca93cb6 HTTP/1.0" 202 Accepted 2026-05-03 03:54:07,729 - lava_callback - INFO - Starting async job submit for node 69f423d32fa6ff8e8ca93cb6 2026-05-03 03:54:07,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:54:07,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f423d32fa6ff8e8ca93cb6 HTTP/1.1" 200 None 2026-05-03 03:54:07,746 - lava_callback - DEBUG - Processing node 69f423d32fa6ff8e8ca93cb6: baseline-arm64-clabbe 2026-05-03 03:54:07,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f423d32fa6ff8e8ca93cb6 2026-05-03 03:54:07,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:54:07,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f423d32fa6ff8e8ca93cb6 HTTP/1.1" 200 None 2026-05-03 03:54:07,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:54:07,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-03 03:54:07,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:54:07,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f423d32fa6ff8e8ca93cb6 HTTP/1.1" 200 None 2026-05-03 03:54:07,800 - lava_callback - ERROR - Error processing callback for node 69f423d32fa6ff8e8ca93cb6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33894 - "GET / HTTP/1.0" 200 OK 2026-05-03 03:55:27,782 - lava_callback - INFO - Received callback for node 69f424252fa6ff8e8ca93cdd INFO: 172.20.0.1:33900 - "POST /node/69f424252fa6ff8e8ca93cdd HTTP/1.0" 202 Accepted 2026-05-03 03:55:27,787 - lava_callback - INFO - Starting async job submit for node 69f424252fa6ff8e8ca93cdd 2026-05-03 03:55:27,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:55:27,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f424252fa6ff8e8ca93cdd HTTP/1.1" 200 None 2026-05-03 03:55:27,810 - lava_callback - DEBUG - Processing node 69f424252fa6ff8e8ca93cdd: baseline-arm64-clabbe 2026-05-03 03:55:27,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f424252fa6ff8e8ca93cdd 2026-05-03 03:55:27,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:55:27,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f424252fa6ff8e8ca93cdd HTTP/1.1" 200 None 2026-05-03 03:55:27,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:55:27,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-03 03:55:27,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:55:27,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f424252fa6ff8e8ca93cdd HTTP/1.1" 200 None 2026-05-03 03:55:27,867 - lava_callback - ERROR - Error processing callback for node 69f424252fa6ff8e8ca93cdd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36502 - "GET / HTTP/1.0" 200 OK 2026-05-03 03:57:07,826 - lava_callback - INFO - Received callback for node 69f424862fa6ff8e8ca93d09 INFO: 172.20.0.1:36504 - "POST /node/69f424862fa6ff8e8ca93d09 HTTP/1.0" 202 Accepted 2026-05-03 03:57:07,832 - lava_callback - INFO - Starting async job submit for node 69f424862fa6ff8e8ca93d09 2026-05-03 03:57:07,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:57:07,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f424862fa6ff8e8ca93d09 HTTP/1.1" 200 None 2026-05-03 03:57:07,859 - lava_callback - DEBUG - Processing node 69f424862fa6ff8e8ca93d09: baseline-arm64-clabbe 2026-05-03 03:57:07,859 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f424862fa6ff8e8ca93d09 2026-05-03 03:57:07,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:57:07,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f424862fa6ff8e8ca93d09 HTTP/1.1" 200 None 2026-05-03 03:57:07,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:57:07,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-03 03:57:07,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:57:07,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f424862fa6ff8e8ca93d09 HTTP/1.1" 200 None 2026-05-03 03:57:07,903 - lava_callback - ERROR - Error processing callback for node 69f424862fa6ff8e8ca93d09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58902 - "GET / HTTP/1.0" 200 OK 2026-05-03 03:58:27,978 - lava_callback - INFO - Received callback for node 69f424de2fa6ff8e8ca93d30 INFO: 172.20.0.1:58906 - "POST /node/69f424de2fa6ff8e8ca93d30 HTTP/1.0" 202 Accepted 2026-05-03 03:58:27,983 - lava_callback - INFO - Starting async job submit for node 69f424de2fa6ff8e8ca93d30 2026-05-03 03:58:27,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:58:27,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f424de2fa6ff8e8ca93d30 HTTP/1.1" 200 None 2026-05-03 03:58:27,998 - lava_callback - DEBUG - Processing node 69f424de2fa6ff8e8ca93d30: baseline-arm64-clabbe 2026-05-03 03:58:27,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f424de2fa6ff8e8ca93d30 2026-05-03 03:58:27,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:58:28,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f424de2fa6ff8e8ca93d30 HTTP/1.1" 200 None 2026-05-03 03:58:28,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:58:28,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-03 03:58:28,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 03:58:28,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f424de2fa6ff8e8ca93d30 HTTP/1.1" 200 None 2026-05-03 03:58:28,062 - lava_callback - ERROR - Error processing callback for node 69f424de2fa6ff8e8ca93d30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41974 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:00:08,957 - lava_callback - INFO - Received callback for node 69f4253c2fa6ff8e8ca93d54 INFO: 172.20.0.1:41976 - "POST /node/69f4253c2fa6ff8e8ca93d54 HTTP/1.0" 202 Accepted 2026-05-03 04:00:08,962 - lava_callback - INFO - Starting async job submit for node 69f4253c2fa6ff8e8ca93d54 2026-05-03 04:00:08,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:00:08,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4253c2fa6ff8e8ca93d54 HTTP/1.1" 200 None 2026-05-03 04:00:08,977 - lava_callback - DEBUG - Processing node 69f4253c2fa6ff8e8ca93d54: baseline-arm64-clabbe 2026-05-03 04:00:08,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4253c2fa6ff8e8ca93d54 2026-05-03 04:00:08,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:00:08,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4253c2fa6ff8e8ca93d54 HTTP/1.1" 200 None 2026-05-03 04:00:08,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:00:09,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-03 04:00:09,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:00:09,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4253c2fa6ff8e8ca93d54 HTTP/1.1" 200 None 2026-05-03 04:00:09,024 - lava_callback - ERROR - Error processing callback for node 69f4253c2fa6ff8e8ca93d54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34568 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:02:08,037 - lava_callback - INFO - Received callback for node 69f425b52fa6ff8e8ca93d7b INFO: 172.20.0.1:34580 - "POST /node/69f425b52fa6ff8e8ca93d7b HTTP/1.0" 202 Accepted 2026-05-03 04:02:08,042 - lava_callback - INFO - Starting async job submit for node 69f425b52fa6ff8e8ca93d7b 2026-05-03 04:02:08,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:02:08,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f425b52fa6ff8e8ca93d7b HTTP/1.1" 200 None 2026-05-03 04:02:08,058 - lava_callback - DEBUG - Processing node 69f425b52fa6ff8e8ca93d7b: baseline-arm64-clabbe 2026-05-03 04:02:08,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f425b52fa6ff8e8ca93d7b 2026-05-03 04:02:08,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:02:08,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f425b52fa6ff8e8ca93d7b HTTP/1.1" 200 None 2026-05-03 04:02:08,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:02:08,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-03 04:02:08,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:02:08,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f425b52fa6ff8e8ca93d7b HTTP/1.1" 200 None 2026-05-03 04:02:08,108 - lava_callback - ERROR - Error processing callback for node 69f425b52fa6ff8e8ca93d7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53816 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54008 - "GET /node/69e88a79b1b1e6995a88cc2c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33790 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:47:22,112 - lava_callback - INFO - Received callback for node 69f430562fa6ff8e8ca93dbb INFO: 172.20.0.1:60824 - "POST /node/69f430562fa6ff8e8ca93dbb HTTP/1.0" 202 Accepted 2026-05-03 04:47:22,117 - lava_callback - INFO - Starting async job submit for node 69f430562fa6ff8e8ca93dbb 2026-05-03 04:47:22,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:47:22,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f430562fa6ff8e8ca93dbb HTTP/1.1" 200 None 2026-05-03 04:47:22,132 - lava_callback - DEBUG - Processing node 69f430562fa6ff8e8ca93dbb: baseline-arm-baylibre 2026-05-03 04:47:22,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f430562fa6ff8e8ca93dbb 2026-05-03 04:47:22,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:47:22,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f430562fa6ff8e8ca93dbb HTTP/1.1" 200 None 2026-05-03 04:47:22,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:47:22,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:47:22,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:47:22,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f430562fa6ff8e8ca93dbb HTTP/1.1" 200 None 2026-05-03 04:47:22,180 - lava_callback - ERROR - Error processing callback for node 69f430562fa6ff8e8ca93dbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42384 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:48:42,200 - lava_callback - INFO - Received callback for node 69f430a52fa6ff8e8ca93de0 INFO: 172.20.0.1:44172 - "POST /node/69f430a52fa6ff8e8ca93de0 HTTP/1.0" 202 Accepted 2026-05-03 04:48:42,205 - lava_callback - INFO - Starting async job submit for node 69f430a52fa6ff8e8ca93de0 2026-05-03 04:48:42,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:48:42,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f430a52fa6ff8e8ca93de0 HTTP/1.1" 200 None 2026-05-03 04:48:42,221 - lava_callback - DEBUG - Processing node 69f430a52fa6ff8e8ca93de0: baseline-arm-baylibre 2026-05-03 04:48:42,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f430a52fa6ff8e8ca93de0 2026-05-03 04:48:42,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:48:42,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f430a52fa6ff8e8ca93de0 HTTP/1.1" 200 None 2026-05-03 04:48:42,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:48:42,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:48:42,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:48:42,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f430a52fa6ff8e8ca93de0 HTTP/1.1" 200 None 2026-05-03 04:48:42,267 - lava_callback - ERROR - Error processing callback for node 69f430a52fa6ff8e8ca93de0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34666 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:49:22,136 - lava_callback - INFO - Received callback for node 69f430d02fa6ff8e8ca93df2 INFO: 172.20.0.1:41614 - "POST /node/69f430d02fa6ff8e8ca93df2 HTTP/1.0" 202 Accepted 2026-05-03 04:49:22,142 - lava_callback - INFO - Starting async job submit for node 69f430d02fa6ff8e8ca93df2 2026-05-03 04:49:22,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:49:22,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f430d02fa6ff8e8ca93df2 HTTP/1.1" 200 None 2026-05-03 04:49:22,157 - lava_callback - DEBUG - Processing node 69f430d02fa6ff8e8ca93df2: baseline-arm-baylibre 2026-05-03 04:49:22,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f430d02fa6ff8e8ca93df2 2026-05-03 04:49:22,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:49:22,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f430d02fa6ff8e8ca93df2 HTTP/1.1" 200 None 2026-05-03 04:49:22,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:49:22,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:49:22,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:49:22,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f430d02fa6ff8e8ca93df2 HTTP/1.1" 200 None 2026-05-03 04:49:22,203 - lava_callback - ERROR - Error processing callback for node 69f430d02fa6ff8e8ca93df2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34782 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:50:02,166 - lava_callback - INFO - Received callback for node 69f430f82fa6ff8e8ca93e02 INFO: 172.20.0.1:45602 - "POST /node/69f430f82fa6ff8e8ca93e02 HTTP/1.0" 202 Accepted 2026-05-03 04:50:02,171 - lava_callback - INFO - Starting async job submit for node 69f430f82fa6ff8e8ca93e02 2026-05-03 04:50:02,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:50:02,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f430f82fa6ff8e8ca93e02 HTTP/1.1" 200 None 2026-05-03 04:50:02,188 - lava_callback - DEBUG - Processing node 69f430f82fa6ff8e8ca93e02: baseline-arm-baylibre 2026-05-03 04:50:02,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f430f82fa6ff8e8ca93e02 2026-05-03 04:50:02,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:50:02,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f430f82fa6ff8e8ca93e02 HTTP/1.1" 200 None 2026-05-03 04:50:02,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:50:02,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:50:02,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:50:02,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f430f82fa6ff8e8ca93e02 HTTP/1.1" 200 None 2026-05-03 04:50:02,239 - lava_callback - ERROR - Error processing callback for node 69f430f82fa6ff8e8ca93e02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53644 - "GET /node/69e3cf7e7f5347282fbdf3b8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49522 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:52:02,347 - lava_callback - INFO - Received callback for node 69f4316d2fa6ff8e8ca93e2e INFO: 172.20.0.1:57598 - "POST /node/69f4316d2fa6ff8e8ca93e2e HTTP/1.0" 202 Accepted 2026-05-03 04:52:02,353 - lava_callback - INFO - Starting async job submit for node 69f4316d2fa6ff8e8ca93e2e 2026-05-03 04:52:02,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:52:02,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4316d2fa6ff8e8ca93e2e HTTP/1.1" 200 None 2026-05-03 04:52:02,367 - lava_callback - DEBUG - Processing node 69f4316d2fa6ff8e8ca93e2e: baseline-arm-baylibre 2026-05-03 04:52:02,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4316d2fa6ff8e8ca93e2e 2026-05-03 04:52:02,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:52:02,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4316d2fa6ff8e8ca93e2e HTTP/1.1" 200 None 2026-05-03 04:52:02,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:52:02,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:52:02,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:52:02,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4316d2fa6ff8e8ca93e2e HTTP/1.1" 200 None 2026-05-03 04:52:02,419 - lava_callback - ERROR - Error processing callback for node 69f4316d2fa6ff8e8ca93e2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33452 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:52:42,353 - lava_callback - INFO - Received callback for node 69f431952fa6ff8e8ca93e42 INFO: 172.20.0.1:41476 - "POST /node/69f431952fa6ff8e8ca93e42 HTTP/1.0" 202 Accepted 2026-05-03 04:52:42,359 - lava_callback - INFO - Starting async job submit for node 69f431952fa6ff8e8ca93e42 2026-05-03 04:52:42,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:52:42,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f431952fa6ff8e8ca93e42 HTTP/1.1" 200 None 2026-05-03 04:52:42,374 - lava_callback - DEBUG - Processing node 69f431952fa6ff8e8ca93e42: baseline-arm-baylibre 2026-05-03 04:52:42,374 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f431952fa6ff8e8ca93e42 2026-05-03 04:52:42,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:52:42,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f431952fa6ff8e8ca93e42 HTTP/1.1" 200 None 2026-05-03 04:52:42,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:52:42,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:52:42,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:52:42,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f431952fa6ff8e8ca93e42 HTTP/1.1" 200 None 2026-05-03 04:52:42,436 - lava_callback - ERROR - Error processing callback for node 69f431952fa6ff8e8ca93e42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53954 - "GET /node/69e3bc947f5347282fbde9de%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56910 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:54:50,340 - lava_callback - INFO - Received callback for node 69f432092fa6ff8e8ca93e6e INFO: 172.20.0.1:33952 - "POST /node/69f432092fa6ff8e8ca93e6e HTTP/1.0" 202 Accepted 2026-05-03 04:54:50,346 - lava_callback - INFO - Starting async job submit for node 69f432092fa6ff8e8ca93e6e 2026-05-03 04:54:50,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:54:50,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f432092fa6ff8e8ca93e6e HTTP/1.1" 200 None 2026-05-03 04:54:50,361 - lava_callback - DEBUG - Processing node 69f432092fa6ff8e8ca93e6e: baseline-arm-clabbe 2026-05-03 04:54:50,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f432092fa6ff8e8ca93e6e 2026-05-03 04:54:50,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:54:50,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f432092fa6ff8e8ca93e6e HTTP/1.1" 200 None 2026-05-03 04:54:50,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:54:50,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:54:50,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:54:50,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f432092fa6ff8e8ca93e6e HTTP/1.1" 200 None 2026-05-03 04:54:50,408 - lava_callback - ERROR - Error processing callback for node 69f432092fa6ff8e8ca93e6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56102 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:55:30,207 - lava_callback - INFO - Received callback for node 69f432322fa6ff8e8ca93e86 INFO: 172.20.0.1:39592 - "POST /node/69f432322fa6ff8e8ca93e86 HTTP/1.0" 202 Accepted 2026-05-03 04:55:30,212 - lava_callback - INFO - Starting async job submit for node 69f432322fa6ff8e8ca93e86 2026-05-03 04:55:30,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:55:30,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f432322fa6ff8e8ca93e86 HTTP/1.1" 200 None 2026-05-03 04:55:30,228 - lava_callback - DEBUG - Processing node 69f432322fa6ff8e8ca93e86: baseline-arm-clabbe 2026-05-03 04:55:30,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f432322fa6ff8e8ca93e86 2026-05-03 04:55:30,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:55:30,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f432322fa6ff8e8ca93e86 HTTP/1.1" 200 None 2026-05-03 04:55:30,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:55:30,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:55:30,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:55:30,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f432322fa6ff8e8ca93e86 HTTP/1.1" 200 None 2026-05-03 04:55:30,294 - lava_callback - ERROR - Error processing callback for node 69f432322fa6ff8e8ca93e86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52334 - "GET /node/69f69c841f903fec0b0dea04%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56868 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:56:10,345 - lava_callback - INFO - Received callback for node 69f4325a2fa6ff8e8ca93e9b INFO: 172.20.0.1:54758 - "POST /node/69f4325a2fa6ff8e8ca93e9b HTTP/1.0" 202 Accepted 2026-05-03 04:56:10,351 - lava_callback - INFO - Starting async job submit for node 69f4325a2fa6ff8e8ca93e9b 2026-05-03 04:56:10,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:56:10,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4325a2fa6ff8e8ca93e9b HTTP/1.1" 200 None 2026-05-03 04:56:10,365 - lava_callback - DEBUG - Processing node 69f4325a2fa6ff8e8ca93e9b: baseline-arm-clabbe 2026-05-03 04:56:10,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4325a2fa6ff8e8ca93e9b 2026-05-03 04:56:10,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:56:10,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4325a2fa6ff8e8ca93e9b HTTP/1.1" 200 None 2026-05-03 04:56:10,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:56:10,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:56:10,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:56:10,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4325a2fa6ff8e8ca93e9b HTTP/1.1" 200 None 2026-05-03 04:56:10,420 - lava_callback - ERROR - Error processing callback for node 69f4325a2fa6ff8e8ca93e9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38666 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:56:50,259 - lava_callback - INFO - Received callback for node 69f432832fa6ff8e8ca93eb5 INFO: 172.20.0.1:42586 - "POST /node/69f432832fa6ff8e8ca93eb5 HTTP/1.0" 202 Accepted 2026-05-03 04:56:50,268 - lava_callback - INFO - Starting async job submit for node 69f432832fa6ff8e8ca93eb5 2026-05-03 04:56:50,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:56:50,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f432832fa6ff8e8ca93eb5 HTTP/1.1" 200 None 2026-05-03 04:56:50,287 - lava_callback - DEBUG - Processing node 69f432832fa6ff8e8ca93eb5: baseline-arm-clabbe 2026-05-03 04:56:50,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f432832fa6ff8e8ca93eb5 2026-05-03 04:56:50,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:56:50,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f432832fa6ff8e8ca93eb5 HTTP/1.1" 200 None 2026-05-03 04:56:50,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:56:50,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:56:50,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:56:50,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f432832fa6ff8e8ca93eb5 HTTP/1.1" 200 None 2026-05-03 04:56:50,341 - lava_callback - ERROR - Error processing callback for node 69f432832fa6ff8e8ca93eb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55428 - "GET /node/69f69c821f903fec0b0dea01%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50852 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:57:30,382 - lava_callback - INFO - Received callback for node 69f432ac2fa6ff8e8ca93ec5 INFO: 172.20.0.1:39300 - "POST /node/69f432ac2fa6ff8e8ca93ec5 HTTP/1.0" 202 Accepted 2026-05-03 04:57:30,388 - lava_callback - INFO - Starting async job submit for node 69f432ac2fa6ff8e8ca93ec5 2026-05-03 04:57:30,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:57:30,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f432ac2fa6ff8e8ca93ec5 HTTP/1.1" 200 None 2026-05-03 04:57:30,403 - lava_callback - DEBUG - Processing node 69f432ac2fa6ff8e8ca93ec5: baseline-arm-clabbe 2026-05-03 04:57:30,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f432ac2fa6ff8e8ca93ec5 2026-05-03 04:57:30,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:57:30,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f432ac2fa6ff8e8ca93ec5 HTTP/1.1" 200 None 2026-05-03 04:57:30,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:57:30,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:57:30,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:57:30,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f432ac2fa6ff8e8ca93ec5 HTTP/1.1" 200 None 2026-05-03 04:57:30,451 - lava_callback - ERROR - Error processing callback for node 69f432ac2fa6ff8e8ca93ec5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55712 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:58:10,296 - lava_callback - INFO - Received callback for node 69f432d52fa6ff8e8ca93edb INFO: 172.20.0.1:48282 - "POST /node/69f432d52fa6ff8e8ca93edb HTTP/1.0" 202 Accepted 2026-05-03 04:58:10,301 - lava_callback - INFO - Starting async job submit for node 69f432d52fa6ff8e8ca93edb 2026-05-03 04:58:10,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:58:10,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f432d52fa6ff8e8ca93edb HTTP/1.1" 200 None 2026-05-03 04:58:10,317 - lava_callback - DEBUG - Processing node 69f432d52fa6ff8e8ca93edb: baseline-arm-clabbe 2026-05-03 04:58:10,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f432d52fa6ff8e8ca93edb 2026-05-03 04:58:10,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:58:10,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f432d52fa6ff8e8ca93edb HTTP/1.1" 200 None 2026-05-03 04:58:10,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:58:10,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:58:10,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:58:10,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f432d52fa6ff8e8ca93edb HTTP/1.1" 200 None 2026-05-03 04:58:10,368 - lava_callback - ERROR - Error processing callback for node 69f432d52fa6ff8e8ca93edb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53224 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:58:50,329 - lava_callback - INFO - Received callback for node 69f432fe2fa6ff8e8ca93ef2 INFO: 172.20.0.1:53830 - "POST /node/69f432fe2fa6ff8e8ca93ef2 HTTP/1.0" 202 Accepted 2026-05-03 04:58:50,335 - lava_callback - INFO - Starting async job submit for node 69f432fe2fa6ff8e8ca93ef2 2026-05-03 04:58:50,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:58:50,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f432fe2fa6ff8e8ca93ef2 HTTP/1.1" 200 None 2026-05-03 04:58:50,366 - lava_callback - DEBUG - Processing node 69f432fe2fa6ff8e8ca93ef2: baseline-arm-clabbe 2026-05-03 04:58:50,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f432fe2fa6ff8e8ca93ef2 2026-05-03 04:58:50,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:58:50,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f432fe2fa6ff8e8ca93ef2 HTTP/1.1" 200 None 2026-05-03 04:58:50,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:58:50,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:58:50,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:58:50,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f432fe2fa6ff8e8ca93ef2 HTTP/1.1" 200 None 2026-05-03 04:58:50,413 - lava_callback - ERROR - Error processing callback for node 69f432fe2fa6ff8e8ca93ef2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59930 - "GET / HTTP/1.0" 200 OK 2026-05-03 04:59:30,351 - lava_callback - INFO - Received callback for node 69f433262fa6ff8e8ca93efe INFO: 172.20.0.1:34590 - "POST /node/69f433262fa6ff8e8ca93efe HTTP/1.0" 202 Accepted 2026-05-03 04:59:30,357 - lava_callback - INFO - Starting async job submit for node 69f433262fa6ff8e8ca93efe 2026-05-03 04:59:30,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:59:30,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f433262fa6ff8e8ca93efe HTTP/1.1" 200 None 2026-05-03 04:59:30,378 - lava_callback - DEBUG - Processing node 69f433262fa6ff8e8ca93efe: baseline-arm-clabbe 2026-05-03 04:59:30,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f433262fa6ff8e8ca93efe 2026-05-03 04:59:30,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:59:30,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f433262fa6ff8e8ca93efe HTTP/1.1" 200 None 2026-05-03 04:59:30,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:59:30,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 04:59:30,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 04:59:30,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f433262fa6ff8e8ca93efe HTTP/1.1" 200 None 2026-05-03 04:59:30,433 - lava_callback - ERROR - Error processing callback for node 69f433262fa6ff8e8ca93efe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48518 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:00:10,825 - lava_callback - INFO - Received callback for node 69f4334f2fa6ff8e8ca93f14 INFO: 172.20.0.1:53110 - "POST /node/69f4334f2fa6ff8e8ca93f14 HTTP/1.0" 202 Accepted 2026-05-03 05:00:10,831 - lava_callback - INFO - Starting async job submit for node 69f4334f2fa6ff8e8ca93f14 2026-05-03 05:00:10,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:00:10,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4334f2fa6ff8e8ca93f14 HTTP/1.1" 200 None 2026-05-03 05:00:10,846 - lava_callback - DEBUG - Processing node 69f4334f2fa6ff8e8ca93f14: baseline-arm-clabbe 2026-05-03 05:00:10,847 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4334f2fa6ff8e8ca93f14 2026-05-03 05:00:10,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:00:10,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4334f2fa6ff8e8ca93f14 HTTP/1.1" 200 None 2026-05-03 05:00:10,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:00:10,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:00:10,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:00:10,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4334f2fa6ff8e8ca93f14 HTTP/1.1" 200 None 2026-05-03 05:00:10,898 - lava_callback - ERROR - Error processing callback for node 69f4334f2fa6ff8e8ca93f14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50578 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:00:50,440 - lava_callback - INFO - Received callback for node 69f433792fa6ff8e8ca93f29 INFO: 172.20.0.1:55182 - "POST /node/69f433792fa6ff8e8ca93f29 HTTP/1.0" 202 Accepted 2026-05-03 05:00:50,445 - lava_callback - INFO - Starting async job submit for node 69f433792fa6ff8e8ca93f29 2026-05-03 05:00:50,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:00:50,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f433792fa6ff8e8ca93f29 HTTP/1.1" 200 None 2026-05-03 05:00:50,460 - lava_callback - DEBUG - Processing node 69f433792fa6ff8e8ca93f29: baseline-arm-clabbe 2026-05-03 05:00:50,460 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f433792fa6ff8e8ca93f29 2026-05-03 05:00:50,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:00:50,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f433792fa6ff8e8ca93f29 HTTP/1.1" 200 None 2026-05-03 05:00:50,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:00:50,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:00:50,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:00:50,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f433792fa6ff8e8ca93f29 HTTP/1.1" 200 None 2026-05-03 05:00:50,511 - lava_callback - ERROR - Error processing callback for node 69f433792fa6ff8e8ca93f29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47942 - "GET /node/69f6a8e61f903fec0b0df299%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35952 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:01:30,473 - lava_callback - INFO - Received callback for node 69f433a12fa6ff8e8ca93f38 INFO: 172.20.0.1:35034 - "POST /node/69f433a12fa6ff8e8ca93f38 HTTP/1.0" 202 Accepted 2026-05-03 05:01:30,478 - lava_callback - INFO - Starting async job submit for node 69f433a12fa6ff8e8ca93f38 2026-05-03 05:01:30,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:01:30,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f433a12fa6ff8e8ca93f38 HTTP/1.1" 200 None 2026-05-03 05:01:30,493 - lava_callback - DEBUG - Processing node 69f433a12fa6ff8e8ca93f38: baseline-arm-clabbe 2026-05-03 05:01:30,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f433a12fa6ff8e8ca93f38 2026-05-03 05:01:30,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:01:30,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f433a12fa6ff8e8ca93f38 HTTP/1.1" 200 None 2026-05-03 05:01:30,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:01:30,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:01:30,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:01:30,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f433a12fa6ff8e8ca93f38 HTTP/1.1" 200 None 2026-05-03 05:01:30,559 - lava_callback - ERROR - Error processing callback for node 69f433a12fa6ff8e8ca93f38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41530 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:02:10,502 - lava_callback - INFO - Received callback for node 69f433cb2fa6ff8e8ca93f56 INFO: 172.20.0.1:41996 - "POST /node/69f433cb2fa6ff8e8ca93f56 HTTP/1.0" 202 Accepted 2026-05-03 05:02:10,508 - lava_callback - INFO - Starting async job submit for node 69f433cb2fa6ff8e8ca93f56 2026-05-03 05:02:10,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:02:10,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f433cb2fa6ff8e8ca93f56 HTTP/1.1" 200 None 2026-05-03 05:02:10,523 - lava_callback - DEBUG - Processing node 69f433cb2fa6ff8e8ca93f56: baseline-arm-clabbe 2026-05-03 05:02:10,523 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f433cb2fa6ff8e8ca93f56 2026-05-03 05:02:10,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:02:10,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f433cb2fa6ff8e8ca93f56 HTTP/1.1" 200 None 2026-05-03 05:02:10,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:02:10,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:02:10,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:02:10,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f433cb2fa6ff8e8ca93f56 HTTP/1.1" 200 None 2026-05-03 05:02:10,577 - lava_callback - ERROR - Error processing callback for node 69f433cb2fa6ff8e8ca93f56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45734 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:02:50,520 - lava_callback - INFO - Received callback for node 69f433f52fa6ff8e8ca93f60 INFO: 172.20.0.1:54412 - "POST /node/69f433f52fa6ff8e8ca93f60 HTTP/1.0" 202 Accepted 2026-05-03 05:02:50,525 - lava_callback - INFO - Starting async job submit for node 69f433f52fa6ff8e8ca93f60 2026-05-03 05:02:50,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:02:50,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f433f52fa6ff8e8ca93f60 HTTP/1.1" 200 None 2026-05-03 05:02:50,540 - lava_callback - DEBUG - Processing node 69f433f52fa6ff8e8ca93f60: baseline-arm-clabbe 2026-05-03 05:02:50,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f433f52fa6ff8e8ca93f60 2026-05-03 05:02:50,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:02:50,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f433f52fa6ff8e8ca93f60 HTTP/1.1" 200 None 2026-05-03 05:02:50,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:02:50,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:02:50,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:02:50,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f433f52fa6ff8e8ca93f60 HTTP/1.1" 200 None 2026-05-03 05:02:50,586 - lava_callback - ERROR - Error processing callback for node 69f433f52fa6ff8e8ca93f60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49252 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:03:30,509 - lava_callback - INFO - Received callback for node 69f4341d2fa6ff8e8ca93f71 INFO: 172.20.0.1:52458 - "POST /node/69f4341d2fa6ff8e8ca93f71 HTTP/1.0" 202 Accepted 2026-05-03 05:03:30,515 - lava_callback - INFO - Starting async job submit for node 69f4341d2fa6ff8e8ca93f71 2026-05-03 05:03:30,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:03:30,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4341d2fa6ff8e8ca93f71 HTTP/1.1" 200 None 2026-05-03 05:03:30,540 - lava_callback - DEBUG - Processing node 69f4341d2fa6ff8e8ca93f71: baseline-arm-clabbe 2026-05-03 05:03:30,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4341d2fa6ff8e8ca93f71 2026-05-03 05:03:30,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:03:30,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4341d2fa6ff8e8ca93f71 HTTP/1.1" 200 None 2026-05-03 05:03:30,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:03:30,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:03:30,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:03:30,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4341d2fa6ff8e8ca93f71 HTTP/1.1" 200 None 2026-05-03 05:03:30,591 - lava_callback - ERROR - Error processing callback for node 69f4341d2fa6ff8e8ca93f71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56568 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:04:10,554 - lava_callback - INFO - Received callback for node 69f434452fa6ff8e8ca93f8f INFO: 172.20.0.1:59766 - "POST /node/69f434452fa6ff8e8ca93f8f HTTP/1.0" 202 Accepted 2026-05-03 05:04:10,559 - lava_callback - INFO - Starting async job submit for node 69f434452fa6ff8e8ca93f8f 2026-05-03 05:04:10,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:04:10,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f434452fa6ff8e8ca93f8f HTTP/1.1" 200 None 2026-05-03 05:04:10,574 - lava_callback - DEBUG - Processing node 69f434452fa6ff8e8ca93f8f: baseline-arm-clabbe 2026-05-03 05:04:10,574 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f434452fa6ff8e8ca93f8f 2026-05-03 05:04:10,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:04:10,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f434452fa6ff8e8ca93f8f HTTP/1.1" 200 None 2026-05-03 05:04:10,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:04:10,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:04:10,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:04:10,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f434452fa6ff8e8ca93f8f HTTP/1.1" 200 None 2026-05-03 05:04:10,621 - lava_callback - ERROR - Error processing callback for node 69f434452fa6ff8e8ca93f8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43534 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:04:50,649 - lava_callback - INFO - Received callback for node 69f4346e2fa6ff8e8ca93f99 INFO: 172.20.0.1:39792 - "POST /node/69f4346e2fa6ff8e8ca93f99 HTTP/1.0" 202 Accepted 2026-05-03 05:04:50,654 - lava_callback - INFO - Starting async job submit for node 69f4346e2fa6ff8e8ca93f99 2026-05-03 05:04:50,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:04:50,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4346e2fa6ff8e8ca93f99 HTTP/1.1" 200 None 2026-05-03 05:04:50,670 - lava_callback - DEBUG - Processing node 69f4346e2fa6ff8e8ca93f99: baseline-arm-clabbe 2026-05-03 05:04:50,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4346e2fa6ff8e8ca93f99 2026-05-03 05:04:50,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:04:50,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4346e2fa6ff8e8ca93f99 HTTP/1.1" 200 None 2026-05-03 05:04:50,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:04:50,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:04:50,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:04:50,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4346e2fa6ff8e8ca93f99 HTTP/1.1" 200 None 2026-05-03 05:04:50,729 - lava_callback - ERROR - Error processing callback for node 69f4346e2fa6ff8e8ca93f99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53384 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:05:30,621 - lava_callback - INFO - Received callback for node 69f434962fa6ff8e8ca93faa INFO: 172.20.0.1:35444 - "POST /node/69f434962fa6ff8e8ca93faa HTTP/1.0" 202 Accepted 2026-05-03 05:05:30,627 - lava_callback - INFO - Starting async job submit for node 69f434962fa6ff8e8ca93faa 2026-05-03 05:05:30,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:05:30,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f434962fa6ff8e8ca93faa HTTP/1.1" 200 None 2026-05-03 05:05:30,643 - lava_callback - DEBUG - Processing node 69f434962fa6ff8e8ca93faa: baseline-arm-clabbe 2026-05-03 05:05:30,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f434962fa6ff8e8ca93faa 2026-05-03 05:05:30,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:05:30,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f434962fa6ff8e8ca93faa HTTP/1.1" 200 None 2026-05-03 05:05:30,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:05:30,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:05:30,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:05:30,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f434962fa6ff8e8ca93faa HTTP/1.1" 200 None 2026-05-03 05:05:30,826 - lava_callback - ERROR - Error processing callback for node 69f434962fa6ff8e8ca93faa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59974 - "GET /node/69f69c811f903fec0b0de9fe%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39870 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:06:10,590 - lava_callback - INFO - Received callback for node 69f434bf2fa6ff8e8ca93fc0 INFO: 172.20.0.1:49314 - "POST /node/69f434bf2fa6ff8e8ca93fc0 HTTP/1.0" 202 Accepted 2026-05-03 05:06:10,597 - lava_callback - INFO - Starting async job submit for node 69f434bf2fa6ff8e8ca93fc0 2026-05-03 05:06:10,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:06:10,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f434bf2fa6ff8e8ca93fc0 HTTP/1.1" 200 None 2026-05-03 05:06:10,615 - lava_callback - DEBUG - Processing node 69f434bf2fa6ff8e8ca93fc0: baseline-arm-clabbe 2026-05-03 05:06:10,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f434bf2fa6ff8e8ca93fc0 2026-05-03 05:06:10,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:06:10,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f434bf2fa6ff8e8ca93fc0 HTTP/1.1" 200 None 2026-05-03 05:06:10,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:06:10,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:06:10,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:06:10,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f434bf2fa6ff8e8ca93fc0 HTTP/1.1" 200 None 2026-05-03 05:06:10,663 - lava_callback - ERROR - Error processing callback for node 69f434bf2fa6ff8e8ca93fc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45300 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:07:10,712 - lava_callback - INFO - Received callback for node 69f434eb2fa6ff8e8ca93fca INFO: 172.20.0.1:46534 - "POST /node/69f434eb2fa6ff8e8ca93fca HTTP/1.0" 202 Accepted 2026-05-03 05:07:10,717 - lava_callback - INFO - Starting async job submit for node 69f434eb2fa6ff8e8ca93fca 2026-05-03 05:07:10,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:07:10,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f434eb2fa6ff8e8ca93fca HTTP/1.1" 200 None 2026-05-03 05:07:10,732 - lava_callback - DEBUG - Processing node 69f434eb2fa6ff8e8ca93fca: baseline-arm-clabbe 2026-05-03 05:07:10,732 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f434eb2fa6ff8e8ca93fca 2026-05-03 05:07:10,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:07:10,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f434eb2fa6ff8e8ca93fca HTTP/1.1" 200 None 2026-05-03 05:07:10,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:07:10,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:07:10,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:07:10,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f434eb2fa6ff8e8ca93fca HTTP/1.1" 200 None 2026-05-03 05:07:10,779 - lava_callback - ERROR - Error processing callback for node 69f434eb2fa6ff8e8ca93fca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35048 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:07:50,649 - lava_callback - INFO - Received callback for node 69f435132fa6ff8e8ca93fda INFO: 172.20.0.1:33640 - "POST /node/69f435132fa6ff8e8ca93fda HTTP/1.0" 202 Accepted 2026-05-03 05:07:50,655 - lava_callback - INFO - Starting async job submit for node 69f435132fa6ff8e8ca93fda 2026-05-03 05:07:50,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:07:50,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f435132fa6ff8e8ca93fda HTTP/1.1" 200 None 2026-05-03 05:07:50,670 - lava_callback - DEBUG - Processing node 69f435132fa6ff8e8ca93fda: baseline-arm-clabbe 2026-05-03 05:07:50,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f435132fa6ff8e8ca93fda 2026-05-03 05:07:50,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:07:50,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f435132fa6ff8e8ca93fda HTTP/1.1" 200 None 2026-05-03 05:07:50,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:07:50,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:07:50,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:07:50,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f435132fa6ff8e8ca93fda HTTP/1.1" 200 None 2026-05-03 05:07:50,717 - lava_callback - ERROR - Error processing callback for node 69f435132fa6ff8e8ca93fda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57840 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:08:30,741 - lava_callback - INFO - Received callback for node 69f4353b2fa6ff8e8ca93feb INFO: 172.20.0.1:47794 - "POST /node/69f4353b2fa6ff8e8ca93feb HTTP/1.0" 202 Accepted 2026-05-03 05:08:30,746 - lava_callback - INFO - Starting async job submit for node 69f4353b2fa6ff8e8ca93feb 2026-05-03 05:08:30,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:08:30,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4353b2fa6ff8e8ca93feb HTTP/1.1" 200 None 2026-05-03 05:08:30,761 - lava_callback - DEBUG - Processing node 69f4353b2fa6ff8e8ca93feb: baseline-arm-clabbe 2026-05-03 05:08:30,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4353b2fa6ff8e8ca93feb 2026-05-03 05:08:30,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:08:30,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4353b2fa6ff8e8ca93feb HTTP/1.1" 200 None 2026-05-03 05:08:30,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:08:30,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:08:30,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:08:30,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4353b2fa6ff8e8ca93feb HTTP/1.1" 200 None 2026-05-03 05:08:30,806 - lava_callback - ERROR - Error processing callback for node 69f4353b2fa6ff8e8ca93feb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60452 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:09:10,734 - lava_callback - INFO - Received callback for node 69f435662fa6ff8e8ca93ffa INFO: 172.20.0.1:38150 - "POST /node/69f435662fa6ff8e8ca93ffa HTTP/1.0" 202 Accepted 2026-05-03 05:09:10,739 - lava_callback - INFO - Starting async job submit for node 69f435662fa6ff8e8ca93ffa 2026-05-03 05:09:10,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:09:10,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f435662fa6ff8e8ca93ffa HTTP/1.1" 200 None 2026-05-03 05:09:10,755 - lava_callback - DEBUG - Processing node 69f435662fa6ff8e8ca93ffa: baseline-arm-clabbe 2026-05-03 05:09:10,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f435662fa6ff8e8ca93ffa 2026-05-03 05:09:10,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:09:10,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f435662fa6ff8e8ca93ffa HTTP/1.1" 200 None 2026-05-03 05:09:10,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:09:10,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:09:10,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:09:10,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f435662fa6ff8e8ca93ffa HTTP/1.1" 200 None 2026-05-03 05:09:10,813 - lava_callback - ERROR - Error processing callback for node 69f435662fa6ff8e8ca93ffa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51242 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:09:50,863 - lava_callback - INFO - Received callback for node 69f4358d2fa6ff8e8ca9400a INFO: 172.20.0.1:48028 - "POST /node/69f4358d2fa6ff8e8ca9400a HTTP/1.0" 202 Accepted 2026-05-03 05:09:50,868 - lava_callback - INFO - Starting async job submit for node 69f4358d2fa6ff8e8ca9400a 2026-05-03 05:09:50,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:09:50,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4358d2fa6ff8e8ca9400a HTTP/1.1" 200 None 2026-05-03 05:09:50,883 - lava_callback - DEBUG - Processing node 69f4358d2fa6ff8e8ca9400a: baseline-arm-clabbe 2026-05-03 05:09:50,884 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4358d2fa6ff8e8ca9400a 2026-05-03 05:09:50,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:09:50,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4358d2fa6ff8e8ca9400a HTTP/1.1" 200 None 2026-05-03 05:09:50,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:09:50,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:09:50,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:09:50,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4358d2fa6ff8e8ca9400a HTTP/1.1" 200 None 2026-05-03 05:09:50,959 - lava_callback - ERROR - Error processing callback for node 69f4358d2fa6ff8e8ca9400a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39538 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:10:30,762 - lava_callback - INFO - Received callback for node 69f435b62fa6ff8e8ca9401a INFO: 172.20.0.1:38296 - "POST /node/69f435b62fa6ff8e8ca9401a HTTP/1.0" 202 Accepted 2026-05-03 05:10:30,767 - lava_callback - INFO - Starting async job submit for node 69f435b62fa6ff8e8ca9401a 2026-05-03 05:10:30,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:10:30,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f435b62fa6ff8e8ca9401a HTTP/1.1" 200 None 2026-05-03 05:10:30,783 - lava_callback - DEBUG - Processing node 69f435b62fa6ff8e8ca9401a: baseline-arm-clabbe 2026-05-03 05:10:30,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f435b62fa6ff8e8ca9401a 2026-05-03 05:10:30,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:10:30,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f435b62fa6ff8e8ca9401a HTTP/1.1" 200 None 2026-05-03 05:10:30,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:10:30,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:10:30,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:10:30,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f435b62fa6ff8e8ca9401a HTTP/1.1" 200 None 2026-05-03 05:10:30,840 - lava_callback - ERROR - Error processing callback for node 69f435b62fa6ff8e8ca9401a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44986 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:11:10,807 - lava_callback - INFO - Received callback for node 69f435de2fa6ff8e8ca9402a INFO: 172.20.0.1:33204 - "POST /node/69f435de2fa6ff8e8ca9402a HTTP/1.0" 202 Accepted 2026-05-03 05:11:10,813 - lava_callback - INFO - Starting async job submit for node 69f435de2fa6ff8e8ca9402a 2026-05-03 05:11:10,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:11:10,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f435de2fa6ff8e8ca9402a HTTP/1.1" 200 None 2026-05-03 05:11:10,828 - lava_callback - DEBUG - Processing node 69f435de2fa6ff8e8ca9402a: baseline-arm-clabbe 2026-05-03 05:11:10,829 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f435de2fa6ff8e8ca9402a 2026-05-03 05:11:10,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:11:10,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f435de2fa6ff8e8ca9402a HTTP/1.1" 200 None 2026-05-03 05:11:10,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:11:10,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:11:10,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:11:10,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f435de2fa6ff8e8ca9402a HTTP/1.1" 200 None 2026-05-03 05:11:10,874 - lava_callback - ERROR - Error processing callback for node 69f435de2fa6ff8e8ca9402a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44702 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:11:50,809 - lava_callback - INFO - Received callback for node 69f436072fa6ff8e8ca94042 INFO: 172.20.0.1:52288 - "POST /node/69f436072fa6ff8e8ca94042 HTTP/1.0" 202 Accepted 2026-05-03 05:11:50,814 - lava_callback - INFO - Starting async job submit for node 69f436072fa6ff8e8ca94042 2026-05-03 05:11:50,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:11:50,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f436072fa6ff8e8ca94042 HTTP/1.1" 200 None 2026-05-03 05:11:50,830 - lava_callback - DEBUG - Processing node 69f436072fa6ff8e8ca94042: baseline-arm-clabbe 2026-05-03 05:11:50,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f436072fa6ff8e8ca94042 2026-05-03 05:11:50,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:11:50,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f436072fa6ff8e8ca94042 HTTP/1.1" 200 None 2026-05-03 05:11:50,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:11:50,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:11:50,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:11:50,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f436072fa6ff8e8ca94042 HTTP/1.1" 200 None 2026-05-03 05:11:50,875 - lava_callback - ERROR - Error processing callback for node 69f436072fa6ff8e8ca94042: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41028 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:12:30,959 - lava_callback - INFO - Received callback for node 69f436302fa6ff8e8ca9404b INFO: 172.20.0.1:50284 - "POST /node/69f436302fa6ff8e8ca9404b HTTP/1.0" 202 Accepted 2026-05-03 05:12:30,964 - lava_callback - INFO - Starting async job submit for node 69f436302fa6ff8e8ca9404b 2026-05-03 05:12:30,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:12:30,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f436302fa6ff8e8ca9404b HTTP/1.1" 200 None 2026-05-03 05:12:30,980 - lava_callback - DEBUG - Processing node 69f436302fa6ff8e8ca9404b: baseline-arm-clabbe 2026-05-03 05:12:30,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f436302fa6ff8e8ca9404b 2026-05-03 05:12:30,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:12:30,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f436302fa6ff8e8ca9404b HTTP/1.1" 200 None 2026-05-03 05:12:30,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:12:31,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-03 05:12:31,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:12:31,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f436302fa6ff8e8ca9404b HTTP/1.1" 200 None 2026-05-03 05:12:31,025 - lava_callback - ERROR - Error processing callback for node 69f436302fa6ff8e8ca9404b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36874 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:22:04,002 - lava_callback - INFO - Received callback for node 69f438722fa6ff8e8ca940fe INFO: 172.20.0.1:35918 - "POST /node/69f438722fa6ff8e8ca940fe HTTP/1.0" 202 Accepted 2026-05-03 05:22:04,007 - lava_callback - INFO - Starting async job submit for node 69f438722fa6ff8e8ca940fe 2026-05-03 05:22:04,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:22:04,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f438722fa6ff8e8ca940fe HTTP/1.1" 200 None 2026-05-03 05:22:04,023 - lava_callback - DEBUG - Processing node 69f438722fa6ff8e8ca940fe: baseline-arm64-baylibre 2026-05-03 05:22:04,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f438722fa6ff8e8ca940fe 2026-05-03 05:22:04,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:22:04,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f438722fa6ff8e8ca940fe HTTP/1.1" 200 None 2026-05-03 05:22:04,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:22:04,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-03 05:22:04,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:22:04,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f438722fa6ff8e8ca940fe HTTP/1.1" 200 None 2026-05-03 05:22:04,088 - lava_callback - ERROR - Error processing callback for node 69f438722fa6ff8e8ca940fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35564 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:23:31,342 - lava_callback - INFO - Received callback for node 69f438c12fa6ff8e8ca94128 INFO: 172.20.0.1:36824 - "POST /node/69f438c12fa6ff8e8ca94128 HTTP/1.0" 202 Accepted 2026-05-03 05:23:31,348 - lava_callback - INFO - Starting async job submit for node 69f438c12fa6ff8e8ca94128 2026-05-03 05:23:31,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:23:31,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f438c12fa6ff8e8ca94128 HTTP/1.1" 200 None 2026-05-03 05:23:31,363 - lava_callback - DEBUG - Processing node 69f438c12fa6ff8e8ca94128: baseline-arm64-clabbe 2026-05-03 05:23:31,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f438c12fa6ff8e8ca94128 2026-05-03 05:23:31,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:23:31,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f438c12fa6ff8e8ca94128 HTTP/1.1" 200 None 2026-05-03 05:23:31,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:23:31,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-03 05:23:31,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:23:31,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f438c12fa6ff8e8ca94128 HTTP/1.1" 200 None 2026-05-03 05:23:31,416 - lava_callback - ERROR - Error processing callback for node 69f438c12fa6ff8e8ca94128: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53366 - "GET /node/69f69d751f903fec0b0debe0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42204 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:25:11,482 - lava_callback - INFO - Received callback for node 69f4392c2fa6ff8e8ca9414a INFO: 172.20.0.1:45968 - "POST /node/69f4392c2fa6ff8e8ca9414a HTTP/1.0" 202 Accepted 2026-05-03 05:25:11,487 - lava_callback - INFO - Starting async job submit for node 69f4392c2fa6ff8e8ca9414a 2026-05-03 05:25:11,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:25:11,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4392c2fa6ff8e8ca9414a HTTP/1.1" 200 None 2026-05-03 05:25:11,507 - lava_callback - DEBUG - Processing node 69f4392c2fa6ff8e8ca9414a: baseline-arm64-clabbe 2026-05-03 05:25:11,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4392c2fa6ff8e8ca9414a 2026-05-03 05:25:11,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:25:11,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4392c2fa6ff8e8ca9414a HTTP/1.1" 200 None 2026-05-03 05:25:11,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:25:11,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-03 05:25:11,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:25:11,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4392c2fa6ff8e8ca9414a HTTP/1.1" 200 None 2026-05-03 05:25:11,552 - lava_callback - ERROR - Error processing callback for node 69f4392c2fa6ff8e8ca9414a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59864 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:26:31,490 - lava_callback - INFO - Received callback for node 69f439772fa6ff8e8ca94173 INFO: 172.20.0.1:45056 - "POST /node/69f439772fa6ff8e8ca94173 HTTP/1.0" 202 Accepted 2026-05-03 05:26:31,495 - lava_callback - INFO - Starting async job submit for node 69f439772fa6ff8e8ca94173 2026-05-03 05:26:31,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:26:31,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f439772fa6ff8e8ca94173 HTTP/1.1" 200 None 2026-05-03 05:26:31,511 - lava_callback - DEBUG - Processing node 69f439772fa6ff8e8ca94173: baseline-arm64-clabbe 2026-05-03 05:26:31,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f439772fa6ff8e8ca94173 2026-05-03 05:26:31,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:26:31,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f439772fa6ff8e8ca94173 HTTP/1.1" 200 None 2026-05-03 05:26:31,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:26:31,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-03 05:26:31,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:26:31,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f439772fa6ff8e8ca94173 HTTP/1.1" 200 None 2026-05-03 05:26:31,566 - lava_callback - ERROR - Error processing callback for node 69f439772fa6ff8e8ca94173: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47212 - "GET /HSsN HTTP/1.0" 404 Not Found INFO: 172.20.0.1:47218 - "GET /QBvT HTTP/1.0" 404 Not Found INFO: 172.20.0.1:47234 - "GET /aab8 HTTP/1.0" 404 Not Found INFO: 172.20.0.1:47238 - "GET /jquery-3.3.1.slim.min.js HTTP/1.0" 404 Not Found INFO: 172.20.0.1:47254 - "GET /aab9 HTTP/1.0" 404 Not Found INFO: 172.20.0.1:47256 - "GET /jquery-3.3.2.slim.min.js HTTP/1.0" 404 Not Found INFO: 172.20.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43152 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:27:51,521 - lava_callback - INFO - Received callback for node 69f439c42fa6ff8e8ca94196 INFO: 172.20.0.1:56378 - "POST /node/69f439c42fa6ff8e8ca94196 HTTP/1.0" 202 Accepted 2026-05-03 05:27:51,527 - lava_callback - INFO - Starting async job submit for node 69f439c42fa6ff8e8ca94196 2026-05-03 05:27:51,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:27:51,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f439c42fa6ff8e8ca94196 HTTP/1.1" 200 None 2026-05-03 05:27:51,542 - lava_callback - DEBUG - Processing node 69f439c42fa6ff8e8ca94196: baseline-arm64-clabbe 2026-05-03 05:27:51,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f439c42fa6ff8e8ca94196 2026-05-03 05:27:51,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:27:51,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f439c42fa6ff8e8ca94196 HTTP/1.1" 200 None 2026-05-03 05:27:51,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:27:51,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-03 05:27:51,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:27:51,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f439c42fa6ff8e8ca94196 HTTP/1.1" 200 None 2026-05-03 05:27:51,602 - lava_callback - ERROR - Error processing callback for node 69f439c42fa6ff8e8ca94196: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47786 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:28:51,618 - lava_callback - INFO - Received callback for node 69f43a102fa6ff8e8ca941be INFO: 172.20.0.1:39598 - "POST /node/69f43a102fa6ff8e8ca941be HTTP/1.0" 202 Accepted 2026-05-03 05:28:51,624 - lava_callback - INFO - Starting async job submit for node 69f43a102fa6ff8e8ca941be 2026-05-03 05:28:51,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:28:51,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43a102fa6ff8e8ca941be HTTP/1.1" 200 None 2026-05-03 05:28:51,638 - lava_callback - DEBUG - Processing node 69f43a102fa6ff8e8ca941be: baseline-arm64-clabbe 2026-05-03 05:28:51,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f43a102fa6ff8e8ca941be 2026-05-03 05:28:51,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:28:51,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43a102fa6ff8e8ca941be HTTP/1.1" 200 None 2026-05-03 05:28:51,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:28:51,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-03 05:28:51,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:28:51,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f43a102fa6ff8e8ca941be HTTP/1.1" 200 None 2026-05-03 05:28:51,683 - lava_callback - ERROR - Error processing callback for node 69f43a102fa6ff8e8ca941be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53456 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:30:11,650 - lava_callback - INFO - Received callback for node 69f43a5d2fa6ff8e8ca941f1 INFO: 172.20.0.1:54558 - "POST /node/69f43a5d2fa6ff8e8ca941f1 HTTP/1.0" 202 Accepted 2026-05-03 05:30:11,656 - lava_callback - INFO - Starting async job submit for node 69f43a5d2fa6ff8e8ca941f1 2026-05-03 05:30:11,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:30:11,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43a5d2fa6ff8e8ca941f1 HTTP/1.1" 200 None 2026-05-03 05:30:11,673 - lava_callback - DEBUG - Processing node 69f43a5d2fa6ff8e8ca941f1: baseline-arm64-clabbe 2026-05-03 05:30:11,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f43a5d2fa6ff8e8ca941f1 2026-05-03 05:30:11,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:30:11,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43a5d2fa6ff8e8ca941f1 HTTP/1.1" 200 None 2026-05-03 05:30:11,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:30:11,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-03 05:30:11,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:30:11,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f43a5d2fa6ff8e8ca941f1 HTTP/1.1" 200 None 2026-05-03 05:30:11,720 - lava_callback - ERROR - Error processing callback for node 69f43a5d2fa6ff8e8ca941f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56616 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:31:31,724 - lava_callback - INFO - Received callback for node 69f43aa92fa6ff8e8ca9420a INFO: 172.20.0.1:42948 - "POST /node/69f43aa92fa6ff8e8ca9420a HTTP/1.0" 202 Accepted 2026-05-03 05:31:31,730 - lava_callback - INFO - Starting async job submit for node 69f43aa92fa6ff8e8ca9420a 2026-05-03 05:31:31,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:31:31,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43aa92fa6ff8e8ca9420a HTTP/1.1" 200 None 2026-05-03 05:31:31,747 - lava_callback - DEBUG - Processing node 69f43aa92fa6ff8e8ca9420a: baseline-arm64-clabbe 2026-05-03 05:31:31,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f43aa92fa6ff8e8ca9420a 2026-05-03 05:31:31,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:31:31,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43aa92fa6ff8e8ca9420a HTTP/1.1" 200 None 2026-05-03 05:31:31,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:31:31,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-03 05:31:31,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:31:31,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f43aa92fa6ff8e8ca9420a HTTP/1.1" 200 None 2026-05-03 05:31:31,793 - lava_callback - ERROR - Error processing callback for node 69f43aa92fa6ff8e8ca9420a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46440 - "GET /node/69f5b9da8cb8354ccaa5f331%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45630 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:42:04,958 - lava_callback - INFO - Received callback for node 69f43d202fa6ff8e8ca94230 INFO: 172.20.0.1:48900 - "POST /node/69f43d202fa6ff8e8ca94230 HTTP/1.0" 202 Accepted 2026-05-03 05:42:04,964 - lava_callback - INFO - Starting async job submit for node 69f43d202fa6ff8e8ca94230 2026-05-03 05:42:04,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:42:04,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43d202fa6ff8e8ca94230 HTTP/1.1" 200 None 2026-05-03 05:42:04,979 - lava_callback - DEBUG - Processing node 69f43d202fa6ff8e8ca94230: baseline-arm64-baylibre 2026-05-03 05:42:04,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f43d202fa6ff8e8ca94230 2026-05-03 05:42:04,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:42:04,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43d202fa6ff8e8ca94230 HTTP/1.1" 200 None 2026-05-03 05:42:04,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:42:05,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 05:42:05,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:42:05,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f43d202fa6ff8e8ca94230 HTTP/1.1" 200 None 2026-05-03 05:42:05,024 - lava_callback - ERROR - Error processing callback for node 69f43d202fa6ff8e8ca94230: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59058 - "GET /node/69f5b82f8cb8354ccaa5f0b3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33202 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:44:45,040 - lava_callback - INFO - Received callback for node 69f43db72fa6ff8e8ca94275 INFO: 172.20.0.1:58182 - "POST /node/69f43db72fa6ff8e8ca94275 HTTP/1.0" 202 Accepted 2026-05-03 05:44:45,046 - lava_callback - INFO - Starting async job submit for node 69f43db72fa6ff8e8ca94275 2026-05-03 05:44:45,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:44:45,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43db72fa6ff8e8ca94275 HTTP/1.1" 200 None 2026-05-03 05:44:45,072 - lava_callback - DEBUG - Processing node 69f43db72fa6ff8e8ca94275: baseline-arm64-baylibre 2026-05-03 05:44:45,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f43db72fa6ff8e8ca94275 2026-05-03 05:44:45,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:44:45,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43db72fa6ff8e8ca94275 HTTP/1.1" 200 None 2026-05-03 05:44:45,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:44:45,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 05:44:45,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:44:45,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f43db72fa6ff8e8ca94275 HTTP/1.1" 200 None 2026-05-03 05:44:45,118 - lava_callback - ERROR - Error processing callback for node 69f43db72fa6ff8e8ca94275: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56750 - "GET /node/69f5b9db8cb8354ccaa5f334%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42516 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:47:05,306 - lava_callback - INFO - Received callback for node 69f43e4a2fa6ff8e8ca942bc INFO: 172.20.0.1:58772 - "POST /node/69f43e4a2fa6ff8e8ca942bc HTTP/1.0" 202 Accepted 2026-05-03 05:47:05,312 - lava_callback - INFO - Starting async job submit for node 69f43e4a2fa6ff8e8ca942bc 2026-05-03 05:47:05,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:47:05,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43e4a2fa6ff8e8ca942bc HTTP/1.1" 200 None 2026-05-03 05:47:05,327 - lava_callback - DEBUG - Processing node 69f43e4a2fa6ff8e8ca942bc: baseline-arm64-baylibre 2026-05-03 05:47:05,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f43e4a2fa6ff8e8ca942bc 2026-05-03 05:47:05,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:47:05,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43e4a2fa6ff8e8ca942bc HTTP/1.1" 200 None 2026-05-03 05:47:05,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:47:05,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 05:47:05,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:47:05,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f43e4a2fa6ff8e8ca942bc HTTP/1.1" 200 None 2026-05-03 05:47:05,384 - lava_callback - ERROR - Error processing callback for node 69f43e4a2fa6ff8e8ca942bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50562 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:48:25,331 - lava_callback - INFO - Received callback for node 69f43e952fa6ff8e8ca942ea INFO: 172.20.0.1:46090 - "POST /node/69f43e952fa6ff8e8ca942ea HTTP/1.0" 202 Accepted 2026-05-03 05:48:25,338 - lava_callback - INFO - Starting async job submit for node 69f43e952fa6ff8e8ca942ea 2026-05-03 05:48:25,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:48:25,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43e952fa6ff8e8ca942ea HTTP/1.1" 200 None 2026-05-03 05:48:25,354 - lava_callback - DEBUG - Processing node 69f43e952fa6ff8e8ca942ea: baseline-arm64-baylibre 2026-05-03 05:48:25,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f43e952fa6ff8e8ca942ea 2026-05-03 05:48:25,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:48:25,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43e952fa6ff8e8ca942ea HTTP/1.1" 200 None 2026-05-03 05:48:25,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:48:25,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 05:48:25,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:48:25,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f43e952fa6ff8e8ca942ea HTTP/1.1" 200 None 2026-05-03 05:48:25,407 - lava_callback - ERROR - Error processing callback for node 69f43e952fa6ff8e8ca942ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46616 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:50:49,307 - lava_callback - INFO - Received callback for node 69f43f2a2fa6ff8e8ca94323 INFO: 172.20.0.1:46620 - "POST /node/69f43f2a2fa6ff8e8ca94323 HTTP/1.0" 202 Accepted 2026-05-03 05:50:49,312 - lava_callback - INFO - Starting async job submit for node 69f43f2a2fa6ff8e8ca94323 2026-05-03 05:50:49,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:50:49,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43f2a2fa6ff8e8ca94323 HTTP/1.1" 200 None 2026-05-03 05:50:49,327 - lava_callback - DEBUG - Processing node 69f43f2a2fa6ff8e8ca94323: baseline-arm64-baylibre 2026-05-03 05:50:49,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f43f2a2fa6ff8e8ca94323 2026-05-03 05:50:49,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:50:49,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43f2a2fa6ff8e8ca94323 HTTP/1.1" 200 None 2026-05-03 05:50:49,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:50:49,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 05:50:49,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:50:49,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f43f2a2fa6ff8e8ca94323 HTTP/1.1" 200 None 2026-05-03 05:50:49,377 - lava_callback - ERROR - Error processing callback for node 69f43f2a2fa6ff8e8ca94323: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43928 - "GET /node/69f5b8318cb8354ccaa5f0bd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44994 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:53:25,490 - lava_callback - INFO - Received callback for node 69f43fc02fa6ff8e8ca9436f INFO: 172.20.0.1:58294 - "POST /node/69f43fc02fa6ff8e8ca9436f HTTP/1.0" 202 Accepted 2026-05-03 05:53:25,495 - lava_callback - INFO - Starting async job submit for node 69f43fc02fa6ff8e8ca9436f 2026-05-03 05:53:25,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:53:25,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43fc02fa6ff8e8ca9436f HTTP/1.1" 200 None 2026-05-03 05:53:25,511 - lava_callback - DEBUG - Processing node 69f43fc02fa6ff8e8ca9436f: baseline-arm64-baylibre 2026-05-03 05:53:25,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f43fc02fa6ff8e8ca9436f 2026-05-03 05:53:25,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:53:25,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f43fc02fa6ff8e8ca9436f HTTP/1.1" 200 None 2026-05-03 05:53:25,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:53:25,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 05:53:25,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:53:25,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f43fc02fa6ff8e8ca9436f HTTP/1.1" 200 None 2026-05-03 05:53:25,564 - lava_callback - ERROR - Error processing callback for node 69f43fc02fa6ff8e8ca9436f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46382 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:54:32,883 - lava_callback - INFO - Received callback for node 69f440102fa6ff8e8ca94396 INFO: 172.20.0.1:48960 - "POST /node/69f440102fa6ff8e8ca94396 HTTP/1.0" 202 Accepted 2026-05-03 05:54:32,888 - lava_callback - INFO - Starting async job submit for node 69f440102fa6ff8e8ca94396 2026-05-03 05:54:32,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:54:32,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f440102fa6ff8e8ca94396 HTTP/1.1" 200 None 2026-05-03 05:54:32,907 - lava_callback - DEBUG - Processing node 69f440102fa6ff8e8ca94396: baseline-arm64-clabbe 2026-05-03 05:54:32,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f440102fa6ff8e8ca94396 2026-05-03 05:54:32,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:54:32,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f440102fa6ff8e8ca94396 HTTP/1.1" 200 None 2026-05-03 05:54:32,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:54:32,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 05:54:32,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:54:32,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f440102fa6ff8e8ca94396 HTTP/1.1" 200 None 2026-05-03 05:54:32,964 - lava_callback - ERROR - Error processing callback for node 69f440102fa6ff8e8ca94396: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48962 - "GET /node/69f5b9dc8cb8354ccaa5f337%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35350 - "GET /node/69f5b8308cb8354ccaa5f0b6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37508 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:57:12,749 - lava_callback - INFO - Received callback for node 69f440a52fa6ff8e8ca943e4 INFO: 172.20.0.1:45268 - "POST /node/69f440a52fa6ff8e8ca943e4 HTTP/1.0" 202 Accepted 2026-05-03 05:57:12,755 - lava_callback - INFO - Starting async job submit for node 69f440a52fa6ff8e8ca943e4 2026-05-03 05:57:12,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:57:12,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f440a52fa6ff8e8ca943e4 HTTP/1.1" 200 None 2026-05-03 05:57:12,771 - lava_callback - DEBUG - Processing node 69f440a52fa6ff8e8ca943e4: baseline-arm64-clabbe 2026-05-03 05:57:12,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f440a52fa6ff8e8ca943e4 2026-05-03 05:57:12,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:57:12,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f440a52fa6ff8e8ca943e4 HTTP/1.1" 200 None 2026-05-03 05:57:12,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:57:12,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 05:57:12,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:57:12,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f440a52fa6ff8e8ca943e4 HTTP/1.1" 200 None 2026-05-03 05:57:12,816 - lava_callback - ERROR - Error processing callback for node 69f440a52fa6ff8e8ca943e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36788 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:58:12,833 - lava_callback - INFO - Received callback for node 69f440ef2fa6ff8e8ca94417 INFO: 172.20.0.1:43254 - "POST /node/69f440ef2fa6ff8e8ca94417 HTTP/1.0" 202 Accepted 2026-05-03 05:58:12,841 - lava_callback - INFO - Starting async job submit for node 69f440ef2fa6ff8e8ca94417 2026-05-03 05:58:12,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:58:12,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f440ef2fa6ff8e8ca94417 HTTP/1.1" 200 None 2026-05-03 05:58:12,858 - lava_callback - DEBUG - Processing node 69f440ef2fa6ff8e8ca94417: baseline-arm64-clabbe 2026-05-03 05:58:12,858 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f440ef2fa6ff8e8ca94417 2026-05-03 05:58:12,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:58:12,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f440ef2fa6ff8e8ca94417 HTTP/1.1" 200 None 2026-05-03 05:58:12,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:58:12,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 05:58:12,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:58:12,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f440ef2fa6ff8e8ca94417 HTTP/1.1" 200 None 2026-05-03 05:58:12,905 - lava_callback - ERROR - Error processing callback for node 69f440ef2fa6ff8e8ca94417: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34918 - "GET / HTTP/1.0" 200 OK 2026-05-03 05:59:25,805 - lava_callback - INFO - Received callback for node 69f441342fa6ff8e8ca9442f INFO: 172.20.0.1:37652 - "POST /node/69f441342fa6ff8e8ca9442f HTTP/1.0" 202 Accepted 2026-05-03 05:59:25,811 - lava_callback - INFO - Starting async job submit for node 69f441342fa6ff8e8ca9442f 2026-05-03 05:59:25,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:59:25,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f441342fa6ff8e8ca9442f HTTP/1.1" 200 None 2026-05-03 05:59:25,826 - lava_callback - DEBUG - Processing node 69f441342fa6ff8e8ca9442f: baseline-arm64-baylibre 2026-05-03 05:59:25,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f441342fa6ff8e8ca9442f 2026-05-03 05:59:25,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:59:25,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f441342fa6ff8e8ca9442f HTTP/1.1" 200 None 2026-05-03 05:59:25,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:59:25,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 05:59:25,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 05:59:25,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f441342fa6ff8e8ca9442f HTTP/1.1" 200 None 2026-05-03 05:59:25,873 - lava_callback - ERROR - Error processing callback for node 69f441342fa6ff8e8ca9442f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49320 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:00:52,910 - lava_callback - INFO - Received callback for node 69f441862fa6ff8e8ca9445f INFO: 172.20.0.1:56594 - "POST /node/69f441862fa6ff8e8ca9445f HTTP/1.0" 202 Accepted 2026-05-03 06:00:52,916 - lava_callback - INFO - Starting async job submit for node 69f441862fa6ff8e8ca9445f 2026-05-03 06:00:52,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:00:52,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f441862fa6ff8e8ca9445f HTTP/1.1" 200 None 2026-05-03 06:00:52,931 - lava_callback - DEBUG - Processing node 69f441862fa6ff8e8ca9445f: baseline-arm64-clabbe 2026-05-03 06:00:52,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f441862fa6ff8e8ca9445f 2026-05-03 06:00:52,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:00:52,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f441862fa6ff8e8ca9445f HTTP/1.1" 200 None 2026-05-03 06:00:52,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:00:52,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:00:52,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:00:52,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f441862fa6ff8e8ca9445f HTTP/1.1" 200 None 2026-05-03 06:00:52,998 - lava_callback - ERROR - Error processing callback for node 69f441862fa6ff8e8ca9445f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44336 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:02:13,006 - lava_callback - INFO - Received callback for node 69f441d42fa6ff8e8ca9447d INFO: 172.20.0.1:59374 - "POST /node/69f441d42fa6ff8e8ca9447d HTTP/1.0" 202 Accepted 2026-05-03 06:02:13,011 - lava_callback - INFO - Starting async job submit for node 69f441d42fa6ff8e8ca9447d 2026-05-03 06:02:13,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:02:13,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f441d42fa6ff8e8ca9447d HTTP/1.1" 200 None 2026-05-03 06:02:13,027 - lava_callback - DEBUG - Processing node 69f441d42fa6ff8e8ca9447d: baseline-arm64-clabbe 2026-05-03 06:02:13,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f441d42fa6ff8e8ca9447d 2026-05-03 06:02:13,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:02:13,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f441d42fa6ff8e8ca9447d HTTP/1.1" 200 None 2026-05-03 06:02:13,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:02:13,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:02:13,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:02:13,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f441d42fa6ff8e8ca9447d HTTP/1.1" 200 None 2026-05-03 06:02:13,073 - lava_callback - ERROR - Error processing callback for node 69f441d42fa6ff8e8ca9447d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34616 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:03:33,074 - lava_callback - INFO - Received callback for node 69f442202fa6ff8e8ca944a6 INFO: 172.20.0.1:53952 - "POST /node/69f442202fa6ff8e8ca944a6 HTTP/1.0" 202 Accepted 2026-05-03 06:03:33,079 - lava_callback - INFO - Starting async job submit for node 69f442202fa6ff8e8ca944a6 2026-05-03 06:03:33,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:03:33,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f442202fa6ff8e8ca944a6 HTTP/1.1" 200 None 2026-05-03 06:03:33,094 - lava_callback - DEBUG - Processing node 69f442202fa6ff8e8ca944a6: baseline-arm64-clabbe 2026-05-03 06:03:33,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f442202fa6ff8e8ca944a6 2026-05-03 06:03:33,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:03:33,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f442202fa6ff8e8ca944a6 HTTP/1.1" 200 None 2026-05-03 06:03:33,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:03:33,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:03:33,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:03:33,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f442202fa6ff8e8ca944a6 HTTP/1.1" 200 None 2026-05-03 06:03:33,147 - lava_callback - ERROR - Error processing callback for node 69f442202fa6ff8e8ca944a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45324 - "GET /node/69f2ab8ee2fa3d7693ba7289%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45330 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:04:33,077 - lava_callback - INFO - Received callback for node 69f4426d2fa6ff8e8ca944c6 INFO: 172.20.0.1:39666 - "POST /node/69f4426d2fa6ff8e8ca944c6 HTTP/1.0" 202 Accepted 2026-05-03 06:04:33,086 - lava_callback - INFO - Starting async job submit for node 69f4426d2fa6ff8e8ca944c6 2026-05-03 06:04:33,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:04:33,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4426d2fa6ff8e8ca944c6 HTTP/1.1" 200 None 2026-05-03 06:04:33,109 - lava_callback - DEBUG - Processing node 69f4426d2fa6ff8e8ca944c6: baseline-arm64-clabbe 2026-05-03 06:04:33,109 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4426d2fa6ff8e8ca944c6 2026-05-03 06:04:33,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:04:33,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4426d2fa6ff8e8ca944c6 HTTP/1.1" 200 None 2026-05-03 06:04:33,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:04:33,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:04:33,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:04:33,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4426d2fa6ff8e8ca944c6 HTTP/1.1" 200 None 2026-05-03 06:04:33,162 - lava_callback - ERROR - Error processing callback for node 69f4426d2fa6ff8e8ca944c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41824 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:05:46,183 - lava_callback - INFO - Received callback for node 69f442b32fa6ff8e8ca944f1 INFO: 172.20.0.1:33122 - "POST /node/69f442b32fa6ff8e8ca944f1 HTTP/1.0" 202 Accepted 2026-05-03 06:05:46,188 - lava_callback - INFO - Starting async job submit for node 69f442b32fa6ff8e8ca944f1 2026-05-03 06:05:46,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:05:46,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f442b32fa6ff8e8ca944f1 HTTP/1.1" 200 None 2026-05-03 06:05:46,205 - lava_callback - DEBUG - Processing node 69f442b32fa6ff8e8ca944f1: baseline-arm64-baylibre 2026-05-03 06:05:46,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f442b32fa6ff8e8ca944f1 2026-05-03 06:05:46,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:05:46,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f442b32fa6ff8e8ca944f1 HTTP/1.1" 200 None 2026-05-03 06:05:46,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:05:46,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:05:46,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:05:46,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f442b32fa6ff8e8ca944f1 HTTP/1.1" 200 None 2026-05-03 06:05:46,254 - lava_callback - ERROR - Error processing callback for node 69f442b32fa6ff8e8ca944f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36616 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:07:13,243 - lava_callback - INFO - Received callback for node 69f443032fa6ff8e8ca94513 INFO: 172.20.0.1:33102 - "POST /node/69f443032fa6ff8e8ca94513 HTTP/1.0" 202 Accepted 2026-05-03 06:07:13,248 - lava_callback - INFO - Starting async job submit for node 69f443032fa6ff8e8ca94513 2026-05-03 06:07:13,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:07:13,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f443032fa6ff8e8ca94513 HTTP/1.1" 200 None 2026-05-03 06:07:13,271 - lava_callback - DEBUG - Processing node 69f443032fa6ff8e8ca94513: baseline-arm64-clabbe 2026-05-03 06:07:13,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f443032fa6ff8e8ca94513 2026-05-03 06:07:13,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:07:13,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f443032fa6ff8e8ca94513 HTTP/1.1" 200 None 2026-05-03 06:07:13,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:07:13,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:07:13,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:07:13,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f443032fa6ff8e8ca94513 HTTP/1.1" 200 None 2026-05-03 06:07:13,325 - lava_callback - ERROR - Error processing callback for node 69f443032fa6ff8e8ca94513: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43992 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:08:33,293 - lava_callback - INFO - Received callback for node 69f443512fa6ff8e8ca9453c INFO: 172.20.0.1:54676 - "POST /node/69f443512fa6ff8e8ca9453c HTTP/1.0" 202 Accepted 2026-05-03 06:08:33,299 - lava_callback - INFO - Starting async job submit for node 69f443512fa6ff8e8ca9453c 2026-05-03 06:08:33,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:08:33,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f443512fa6ff8e8ca9453c HTTP/1.1" 200 None 2026-05-03 06:08:33,318 - lava_callback - DEBUG - Processing node 69f443512fa6ff8e8ca9453c: baseline-arm64-clabbe 2026-05-03 06:08:33,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f443512fa6ff8e8ca9453c 2026-05-03 06:08:33,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:08:33,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f443512fa6ff8e8ca9453c HTTP/1.1" 200 None 2026-05-03 06:08:33,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:08:33,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:08:33,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:08:33,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f443512fa6ff8e8ca9453c HTTP/1.1" 200 None 2026-05-03 06:08:33,383 - lava_callback - ERROR - Error processing callback for node 69f443512fa6ff8e8ca9453c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37398 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:09:53,364 - lava_callback - INFO - Received callback for node 69f4439d2fa6ff8e8ca9455f INFO: 172.20.0.1:47836 - "POST /node/69f4439d2fa6ff8e8ca9455f HTTP/1.0" 202 Accepted 2026-05-03 06:09:53,370 - lava_callback - INFO - Starting async job submit for node 69f4439d2fa6ff8e8ca9455f 2026-05-03 06:09:53,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:09:53,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4439d2fa6ff8e8ca9455f HTTP/1.1" 200 None 2026-05-03 06:09:53,388 - lava_callback - DEBUG - Processing node 69f4439d2fa6ff8e8ca9455f: baseline-arm64-clabbe 2026-05-03 06:09:53,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4439d2fa6ff8e8ca9455f 2026-05-03 06:09:53,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:09:53,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4439d2fa6ff8e8ca9455f HTTP/1.1" 200 None 2026-05-03 06:09:53,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:09:53,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:09:53,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:09:53,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4439d2fa6ff8e8ca9455f HTTP/1.1" 200 None 2026-05-03 06:09:53,446 - lava_callback - ERROR - Error processing callback for node 69f4439d2fa6ff8e8ca9455f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44198 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:10:53,466 - lava_callback - INFO - Received callback for node 69f443e82fa6ff8e8ca9458a INFO: 172.20.0.1:48600 - "POST /node/69f443e82fa6ff8e8ca9458a HTTP/1.0" 202 Accepted 2026-05-03 06:10:53,471 - lava_callback - INFO - Starting async job submit for node 69f443e82fa6ff8e8ca9458a 2026-05-03 06:10:53,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:10:53,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f443e82fa6ff8e8ca9458a HTTP/1.1" 200 None 2026-05-03 06:10:53,498 - lava_callback - DEBUG - Processing node 69f443e82fa6ff8e8ca9458a: baseline-arm64-clabbe 2026-05-03 06:10:53,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f443e82fa6ff8e8ca9458a 2026-05-03 06:10:53,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:10:53,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f443e82fa6ff8e8ca9458a HTTP/1.1" 200 None 2026-05-03 06:10:53,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:10:53,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:10:53,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:10:53,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f443e82fa6ff8e8ca9458a HTTP/1.1" 200 None 2026-05-03 06:10:53,542 - lava_callback - ERROR - Error processing callback for node 69f443e82fa6ff8e8ca9458a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59996 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:12:13,516 - lava_callback - INFO - Received callback for node 69f444382fa6ff8e8ca945b7 INFO: 172.20.0.1:41590 - "POST /node/69f444382fa6ff8e8ca945b7 HTTP/1.0" 202 Accepted 2026-05-03 06:12:13,521 - lava_callback - INFO - Starting async job submit for node 69f444382fa6ff8e8ca945b7 2026-05-03 06:12:13,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:12:13,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f444382fa6ff8e8ca945b7 HTTP/1.1" 200 None 2026-05-03 06:12:13,536 - lava_callback - DEBUG - Processing node 69f444382fa6ff8e8ca945b7: baseline-arm64-clabbe 2026-05-03 06:12:13,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f444382fa6ff8e8ca945b7 2026-05-03 06:12:13,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:12:13,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f444382fa6ff8e8ca945b7 HTTP/1.1" 200 None 2026-05-03 06:12:13,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:12:13,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:12:13,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:12:13,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f444382fa6ff8e8ca945b7 HTTP/1.1" 200 None 2026-05-03 06:12:13,593 - lava_callback - ERROR - Error processing callback for node 69f444382fa6ff8e8ca945b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56948 - "GET /node/69f2ab8de2fa3d7693ba7286%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43472 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:13:33,560 - lava_callback - INFO - Received callback for node 69f444852fa6ff8e8ca945d2 INFO: 172.20.0.1:53138 - "POST /node/69f444852fa6ff8e8ca945d2 HTTP/1.0" 202 Accepted 2026-05-03 06:13:33,567 - lava_callback - INFO - Starting async job submit for node 69f444852fa6ff8e8ca945d2 2026-05-03 06:13:33,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:13:33,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f444852fa6ff8e8ca945d2 HTTP/1.1" 200 None 2026-05-03 06:13:33,587 - lava_callback - DEBUG - Processing node 69f444852fa6ff8e8ca945d2: baseline-arm64-clabbe 2026-05-03 06:13:33,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f444852fa6ff8e8ca945d2 2026-05-03 06:13:33,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:13:33,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f444852fa6ff8e8ca945d2 HTTP/1.1" 200 None 2026-05-03 06:13:33,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:13:33,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:13:33,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:13:33,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f444852fa6ff8e8ca945d2 HTTP/1.1" 200 None 2026-05-03 06:13:33,640 - lava_callback - ERROR - Error processing callback for node 69f444852fa6ff8e8ca945d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39552 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:14:53,626 - lava_callback - INFO - Received callback for node 69f444d12fa6ff8e8ca94602 INFO: 172.20.0.1:35678 - "POST /node/69f444d12fa6ff8e8ca94602 HTTP/1.0" 202 Accepted 2026-05-03 06:14:53,631 - lava_callback - INFO - Starting async job submit for node 69f444d12fa6ff8e8ca94602 2026-05-03 06:14:53,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:14:53,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f444d12fa6ff8e8ca94602 HTTP/1.1" 200 None 2026-05-03 06:14:53,646 - lava_callback - DEBUG - Processing node 69f444d12fa6ff8e8ca94602: baseline-arm64-clabbe 2026-05-03 06:14:53,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f444d12fa6ff8e8ca94602 2026-05-03 06:14:53,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:14:53,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f444d12fa6ff8e8ca94602 HTTP/1.1" 200 None 2026-05-03 06:14:53,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:14:53,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:14:53,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:14:53,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f444d12fa6ff8e8ca94602 HTTP/1.1" 200 None 2026-05-03 06:14:53,701 - lava_callback - ERROR - Error processing callback for node 69f444d12fa6ff8e8ca94602: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36578 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:16:13,652 - lava_callback - INFO - Received callback for node 69f4451c2fa6ff8e8ca9461b INFO: 172.20.0.1:51656 - "POST /node/69f4451c2fa6ff8e8ca9461b HTTP/1.0" 202 Accepted 2026-05-03 06:16:13,657 - lava_callback - INFO - Starting async job submit for node 69f4451c2fa6ff8e8ca9461b 2026-05-03 06:16:13,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:16:13,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4451c2fa6ff8e8ca9461b HTTP/1.1" 200 None 2026-05-03 06:16:13,674 - lava_callback - DEBUG - Processing node 69f4451c2fa6ff8e8ca9461b: baseline-arm64-clabbe 2026-05-03 06:16:13,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4451c2fa6ff8e8ca9461b 2026-05-03 06:16:13,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:16:13,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4451c2fa6ff8e8ca9461b HTTP/1.1" 200 None 2026-05-03 06:16:13,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:16:13,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:16:13,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:16:13,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4451c2fa6ff8e8ca9461b HTTP/1.1" 200 None 2026-05-03 06:16:13,740 - lava_callback - ERROR - Error processing callback for node 69f4451c2fa6ff8e8ca9461b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57746 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:17:33,649 - lava_callback - INFO - Received callback for node 69f445692fa6ff8e8ca94645 INFO: 172.20.0.1:56526 - "POST /node/69f445692fa6ff8e8ca94645 HTTP/1.0" 202 Accepted 2026-05-03 06:17:33,654 - lava_callback - INFO - Starting async job submit for node 69f445692fa6ff8e8ca94645 2026-05-03 06:17:33,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:17:33,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f445692fa6ff8e8ca94645 HTTP/1.1" 200 None 2026-05-03 06:17:33,670 - lava_callback - DEBUG - Processing node 69f445692fa6ff8e8ca94645: baseline-arm64-clabbe 2026-05-03 06:17:33,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f445692fa6ff8e8ca94645 2026-05-03 06:17:33,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:17:33,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f445692fa6ff8e8ca94645 HTTP/1.1" 200 None 2026-05-03 06:17:33,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:17:33,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:17:33,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:17:33,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f445692fa6ff8e8ca94645 HTTP/1.1" 200 None 2026-05-03 06:17:33,724 - lava_callback - ERROR - Error processing callback for node 69f445692fa6ff8e8ca94645: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42274 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:18:33,733 - lava_callback - INFO - Received callback for node 69f445b52fa6ff8e8ca94661 INFO: 172.20.0.1:38076 - "POST /node/69f445b52fa6ff8e8ca94661 HTTP/1.0" 202 Accepted 2026-05-03 06:18:33,738 - lava_callback - INFO - Starting async job submit for node 69f445b52fa6ff8e8ca94661 2026-05-03 06:18:33,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:18:33,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f445b52fa6ff8e8ca94661 HTTP/1.1" 200 None 2026-05-03 06:18:33,754 - lava_callback - DEBUG - Processing node 69f445b52fa6ff8e8ca94661: baseline-arm64-clabbe 2026-05-03 06:18:33,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f445b52fa6ff8e8ca94661 2026-05-03 06:18:33,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:18:33,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f445b52fa6ff8e8ca94661 HTTP/1.1" 200 None 2026-05-03 06:18:33,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:18:33,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:18:33,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:18:33,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f445b52fa6ff8e8ca94661 HTTP/1.1" 200 None 2026-05-03 06:18:33,811 - lava_callback - ERROR - Error processing callback for node 69f445b52fa6ff8e8ca94661: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38110 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:19:53,743 - lava_callback - INFO - Received callback for node 69f446002fa6ff8e8ca9468a INFO: 172.20.0.1:58030 - "POST /node/69f446002fa6ff8e8ca9468a HTTP/1.0" 202 Accepted 2026-05-03 06:19:53,749 - lava_callback - INFO - Starting async job submit for node 69f446002fa6ff8e8ca9468a 2026-05-03 06:19:53,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:19:53,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f446002fa6ff8e8ca9468a HTTP/1.1" 200 None 2026-05-03 06:19:53,764 - lava_callback - DEBUG - Processing node 69f446002fa6ff8e8ca9468a: baseline-arm64-clabbe 2026-05-03 06:19:53,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f446002fa6ff8e8ca9468a 2026-05-03 06:19:53,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:19:53,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f446002fa6ff8e8ca9468a HTTP/1.1" 200 None 2026-05-03 06:19:53,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:19:53,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:19:53,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:19:53,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f446002fa6ff8e8ca9468a HTTP/1.1" 200 None 2026-05-03 06:19:53,829 - lava_callback - ERROR - Error processing callback for node 69f446002fa6ff8e8ca9468a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55772 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:21:13,848 - lava_callback - INFO - Received callback for node 69f4464d2fa6ff8e8ca946a7 INFO: 172.20.0.1:50624 - "POST /node/69f4464d2fa6ff8e8ca946a7 HTTP/1.0" 202 Accepted 2026-05-03 06:21:13,856 - lava_callback - INFO - Starting async job submit for node 69f4464d2fa6ff8e8ca946a7 2026-05-03 06:21:13,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:21:13,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4464d2fa6ff8e8ca946a7 HTTP/1.1" 200 None 2026-05-03 06:21:13,873 - lava_callback - DEBUG - Processing node 69f4464d2fa6ff8e8ca946a7: baseline-arm64-clabbe 2026-05-03 06:21:13,874 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4464d2fa6ff8e8ca946a7 2026-05-03 06:21:13,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:21:13,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4464d2fa6ff8e8ca946a7 HTTP/1.1" 200 None 2026-05-03 06:21:13,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:21:13,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:21:13,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:21:13,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4464d2fa6ff8e8ca946a7 HTTP/1.1" 200 None 2026-05-03 06:21:13,924 - lava_callback - ERROR - Error processing callback for node 69f4464d2fa6ff8e8ca946a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41774 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:22:33,940 - lava_callback - INFO - Received callback for node 69f446982fa6ff8e8ca946cd INFO: 172.20.0.1:34738 - "POST /node/69f446982fa6ff8e8ca946cd HTTP/1.0" 202 Accepted 2026-05-03 06:22:33,945 - lava_callback - INFO - Starting async job submit for node 69f446982fa6ff8e8ca946cd 2026-05-03 06:22:33,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:22:33,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f446982fa6ff8e8ca946cd HTTP/1.1" 200 None 2026-05-03 06:22:33,967 - lava_callback - DEBUG - Processing node 69f446982fa6ff8e8ca946cd: baseline-arm64-clabbe 2026-05-03 06:22:33,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f446982fa6ff8e8ca946cd 2026-05-03 06:22:33,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:22:33,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f446982fa6ff8e8ca946cd HTTP/1.1" 200 None 2026-05-03 06:22:33,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:22:33,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:22:33,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:22:34,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f446982fa6ff8e8ca946cd HTTP/1.1" 200 None 2026-05-03 06:22:34,014 - lava_callback - ERROR - Error processing callback for node 69f446982fa6ff8e8ca946cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59164 - "GET /node/69f24a26f5ce4820821f0bf2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47060 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:23:53,944 - lava_callback - INFO - Received callback for node 69f446e32fa6ff8e8ca946ed INFO: 172.20.0.1:54254 - "POST /node/69f446e32fa6ff8e8ca946ed HTTP/1.0" 202 Accepted 2026-05-03 06:23:53,950 - lava_callback - INFO - Starting async job submit for node 69f446e32fa6ff8e8ca946ed 2026-05-03 06:23:53,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:23:53,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f446e32fa6ff8e8ca946ed HTTP/1.1" 200 None 2026-05-03 06:23:53,976 - lava_callback - DEBUG - Processing node 69f446e32fa6ff8e8ca946ed: baseline-arm64-clabbe 2026-05-03 06:23:53,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f446e32fa6ff8e8ca946ed 2026-05-03 06:23:53,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:23:53,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f446e32fa6ff8e8ca946ed HTTP/1.1" 200 None 2026-05-03 06:23:53,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:23:54,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-03 06:23:54,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:23:54,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f446e32fa6ff8e8ca946ed HTTP/1.1" 200 None 2026-05-03 06:23:54,030 - lava_callback - ERROR - Error processing callback for node 69f446e32fa6ff8e8ca946ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48726 - "GET /node/6937e0b3a4c94886b94bf3d8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56638 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:29:14,165 - lava_callback - INFO - Received callback for node 69f448312fa6ff8e8ca9478a INFO: 172.20.0.1:53664 - "POST /node/69f448312fa6ff8e8ca9478a HTTP/1.0" 202 Accepted 2026-05-03 06:29:14,170 - lava_callback - INFO - Starting async job submit for node 69f448312fa6ff8e8ca9478a 2026-05-03 06:29:14,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:29:14,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f448312fa6ff8e8ca9478a HTTP/1.1" 200 None 2026-05-03 06:29:14,188 - lava_callback - DEBUG - Processing node 69f448312fa6ff8e8ca9478a: baseline-arm-clabbe 2026-05-03 06:29:14,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f448312fa6ff8e8ca9478a 2026-05-03 06:29:14,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:29:14,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f448312fa6ff8e8ca9478a HTTP/1.1" 200 None 2026-05-03 06:29:14,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:29:14,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 06:29:14,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:29:14,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f448312fa6ff8e8ca9478a HTTP/1.1" 200 None 2026-05-03 06:29:14,252 - lava_callback - ERROR - Error processing callback for node 69f448312fa6ff8e8ca9478a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39744 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:29:54,104 - lava_callback - INFO - Received callback for node 69f4485f2fa6ff8e8ca947a1 INFO: 172.20.0.1:55788 - "POST /node/69f4485f2fa6ff8e8ca947a1 HTTP/1.0" 202 Accepted 2026-05-03 06:29:54,110 - lava_callback - INFO - Starting async job submit for node 69f4485f2fa6ff8e8ca947a1 2026-05-03 06:29:54,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:29:54,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4485f2fa6ff8e8ca947a1 HTTP/1.1" 200 None 2026-05-03 06:29:54,139 - lava_callback - DEBUG - Processing node 69f4485f2fa6ff8e8ca947a1: baseline-arm-clabbe 2026-05-03 06:29:54,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4485f2fa6ff8e8ca947a1 2026-05-03 06:29:54,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:29:54,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4485f2fa6ff8e8ca947a1 HTTP/1.1" 200 None 2026-05-03 06:29:54,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:29:54,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 06:29:54,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:29:54,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4485f2fa6ff8e8ca947a1 HTTP/1.1" 200 None 2026-05-03 06:29:54,185 - lava_callback - ERROR - Error processing callback for node 69f4485f2fa6ff8e8ca947a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55924 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:30:34,432 - lava_callback - INFO - Received callback for node 69f448862fa6ff8e8ca947b2 INFO: 172.20.0.1:58836 - "POST /node/69f448862fa6ff8e8ca947b2 HTTP/1.0" 202 Accepted 2026-05-03 06:30:34,439 - lava_callback - INFO - Starting async job submit for node 69f448862fa6ff8e8ca947b2 2026-05-03 06:30:34,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:30:34,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f448862fa6ff8e8ca947b2 HTTP/1.1" 200 None 2026-05-03 06:30:34,458 - lava_callback - DEBUG - Processing node 69f448862fa6ff8e8ca947b2: baseline-arm-clabbe 2026-05-03 06:30:34,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f448862fa6ff8e8ca947b2 2026-05-03 06:30:34,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:30:34,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f448862fa6ff8e8ca947b2 HTTP/1.1" 200 None 2026-05-03 06:30:34,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:30:34,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 06:30:34,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:30:34,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f448862fa6ff8e8ca947b2 HTTP/1.1" 200 None 2026-05-03 06:30:34,514 - lava_callback - ERROR - Error processing callback for node 69f448862fa6ff8e8ca947b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53752 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:31:14,181 - lava_callback - INFO - Received callback for node 69f448ae2fa6ff8e8ca947cf INFO: 172.20.0.1:48052 - "POST /node/69f448ae2fa6ff8e8ca947cf HTTP/1.0" 202 Accepted 2026-05-03 06:31:14,187 - lava_callback - INFO - Starting async job submit for node 69f448ae2fa6ff8e8ca947cf 2026-05-03 06:31:14,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:31:14,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f448ae2fa6ff8e8ca947cf HTTP/1.1" 200 None 2026-05-03 06:31:14,203 - lava_callback - DEBUG - Processing node 69f448ae2fa6ff8e8ca947cf: baseline-arm-clabbe 2026-05-03 06:31:14,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f448ae2fa6ff8e8ca947cf 2026-05-03 06:31:14,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:31:14,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f448ae2fa6ff8e8ca947cf HTTP/1.1" 200 None 2026-05-03 06:31:14,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:31:14,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 06:31:14,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:31:14,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f448ae2fa6ff8e8ca947cf HTTP/1.1" 200 None 2026-05-03 06:31:14,259 - lava_callback - ERROR - Error processing callback for node 69f448ae2fa6ff8e8ca947cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50240 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:31:54,234 - lava_callback - INFO - Received callback for node 69f448d52fa6ff8e8ca947dd INFO: 172.20.0.1:39416 - "POST /node/69f448d52fa6ff8e8ca947dd HTTP/1.0" 202 Accepted 2026-05-03 06:31:54,240 - lava_callback - INFO - Starting async job submit for node 69f448d52fa6ff8e8ca947dd 2026-05-03 06:31:54,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:31:54,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f448d52fa6ff8e8ca947dd HTTP/1.1" 200 None 2026-05-03 06:31:54,260 - lava_callback - DEBUG - Processing node 69f448d52fa6ff8e8ca947dd: baseline-arm-clabbe 2026-05-03 06:31:54,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f448d52fa6ff8e8ca947dd 2026-05-03 06:31:54,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:31:54,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f448d52fa6ff8e8ca947dd HTTP/1.1" 200 None 2026-05-03 06:31:54,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:31:54,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 06:31:54,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:31:54,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f448d52fa6ff8e8ca947dd HTTP/1.1" 200 None 2026-05-03 06:31:54,305 - lava_callback - ERROR - Error processing callback for node 69f448d52fa6ff8e8ca947dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42140 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:32:34,195 - lava_callback - INFO - Received callback for node 69f448fb2fa6ff8e8ca947ee INFO: 172.20.0.1:50540 - "POST /node/69f448fb2fa6ff8e8ca947ee HTTP/1.0" 202 Accepted 2026-05-03 06:32:34,200 - lava_callback - INFO - Starting async job submit for node 69f448fb2fa6ff8e8ca947ee 2026-05-03 06:32:34,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:32:34,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f448fb2fa6ff8e8ca947ee HTTP/1.1" 200 None 2026-05-03 06:32:34,216 - lava_callback - DEBUG - Processing node 69f448fb2fa6ff8e8ca947ee: baseline-arm-clabbe 2026-05-03 06:32:34,216 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f448fb2fa6ff8e8ca947ee 2026-05-03 06:32:34,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:32:34,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f448fb2fa6ff8e8ca947ee HTTP/1.1" 200 None 2026-05-03 06:32:34,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:32:34,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 06:32:34,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:32:34,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f448fb2fa6ff8e8ca947ee HTTP/1.1" 200 None 2026-05-03 06:32:34,274 - lava_callback - ERROR - Error processing callback for node 69f448fb2fa6ff8e8ca947ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45056 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:33:14,321 - lava_callback - INFO - Received callback for node 69f449222fa6ff8e8ca94805 INFO: 172.20.0.1:60364 - "POST /node/69f449222fa6ff8e8ca94805 HTTP/1.0" 202 Accepted 2026-05-03 06:33:14,326 - lava_callback - INFO - Starting async job submit for node 69f449222fa6ff8e8ca94805 2026-05-03 06:33:14,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:33:14,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f449222fa6ff8e8ca94805 HTTP/1.1" 200 None 2026-05-03 06:33:14,341 - lava_callback - DEBUG - Processing node 69f449222fa6ff8e8ca94805: baseline-arm-clabbe 2026-05-03 06:33:14,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f449222fa6ff8e8ca94805 2026-05-03 06:33:14,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:33:14,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f449222fa6ff8e8ca94805 HTTP/1.1" 200 None 2026-05-03 06:33:14,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:33:14,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 06:33:14,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:33:14,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f449222fa6ff8e8ca94805 HTTP/1.1" 200 None 2026-05-03 06:33:14,393 - lava_callback - ERROR - Error processing callback for node 69f449222fa6ff8e8ca94805: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38668 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:33:54,271 - lava_callback - INFO - Received callback for node 69f449492fa6ff8e8ca9481a INFO: 172.20.0.1:34376 - "POST /node/69f449492fa6ff8e8ca9481a HTTP/1.0" 202 Accepted 2026-05-03 06:33:54,276 - lava_callback - INFO - Starting async job submit for node 69f449492fa6ff8e8ca9481a 2026-05-03 06:33:54,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:33:54,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f449492fa6ff8e8ca9481a HTTP/1.1" 200 None 2026-05-03 06:33:54,296 - lava_callback - DEBUG - Processing node 69f449492fa6ff8e8ca9481a: baseline-arm-clabbe 2026-05-03 06:33:54,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f449492fa6ff8e8ca9481a 2026-05-03 06:33:54,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:33:54,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f449492fa6ff8e8ca9481a HTTP/1.1" 200 None 2026-05-03 06:33:54,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:33:54,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 06:33:54,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:33:54,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f449492fa6ff8e8ca9481a HTTP/1.1" 200 None 2026-05-03 06:33:54,340 - lava_callback - ERROR - Error processing callback for node 69f449492fa6ff8e8ca9481a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49434 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:34:34,334 - lava_callback - INFO - Received callback for node 69f4496f2fa6ff8e8ca9482d INFO: 172.20.0.1:59474 - "POST /node/69f4496f2fa6ff8e8ca9482d HTTP/1.0" 202 Accepted 2026-05-03 06:34:34,343 - lava_callback - INFO - Starting async job submit for node 69f4496f2fa6ff8e8ca9482d 2026-05-03 06:34:34,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:34:34,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4496f2fa6ff8e8ca9482d HTTP/1.1" 200 None 2026-05-03 06:34:34,365 - lava_callback - DEBUG - Processing node 69f4496f2fa6ff8e8ca9482d: baseline-arm-clabbe 2026-05-03 06:34:34,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4496f2fa6ff8e8ca9482d 2026-05-03 06:34:34,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:34:34,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4496f2fa6ff8e8ca9482d HTTP/1.1" 200 None 2026-05-03 06:34:34,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:34:34,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-03 06:34:34,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:34:34,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4496f2fa6ff8e8ca9482d HTTP/1.1" 200 None 2026-05-03 06:34:34,420 - lava_callback - ERROR - Error processing callback for node 69f4496f2fa6ff8e8ca9482d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52330 - "GET /node/69e505e29a34686dd62eb1b5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54706 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:42:28,391 - lava_callback - INFO - Received callback for node 69f44b512fa6ff8e8ca948cf INFO: 172.20.0.1:54722 - "POST /node/69f44b512fa6ff8e8ca948cf HTTP/1.0" 202 Accepted 2026-05-03 06:42:28,396 - lava_callback - INFO - Starting async job submit for node 69f44b512fa6ff8e8ca948cf 2026-05-03 06:42:28,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:42:28,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44b512fa6ff8e8ca948cf HTTP/1.1" 200 None 2026-05-03 06:42:28,412 - lava_callback - DEBUG - Processing node 69f44b512fa6ff8e8ca948cf: baseline-arm-baylibre 2026-05-03 06:42:28,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44b512fa6ff8e8ca948cf 2026-05-03 06:42:28,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:42:28,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44b512fa6ff8e8ca948cf HTTP/1.1" 200 None 2026-05-03 06:42:28,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:42:28,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:42:28,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:42:28,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44b512fa6ff8e8ca948cf HTTP/1.1" 200 None 2026-05-03 06:42:28,471 - lava_callback - ERROR - Error processing callback for node 69f44b512fa6ff8e8ca948cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53592 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:44:28,308 - lava_callback - INFO - Received callback for node 69f44bc22fa6ff8e8ca94908 INFO: 172.20.0.1:53604 - "POST /node/69f44bc22fa6ff8e8ca94908 HTTP/1.0" 202 Accepted 2026-05-03 06:44:28,314 - lava_callback - INFO - Starting async job submit for node 69f44bc22fa6ff8e8ca94908 2026-05-03 06:44:28,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:44:28,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44bc22fa6ff8e8ca94908 HTTP/1.1" 200 None 2026-05-03 06:44:28,329 - lava_callback - DEBUG - Processing node 69f44bc22fa6ff8e8ca94908: baseline-arm-baylibre 2026-05-03 06:44:28,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44bc22fa6ff8e8ca94908 2026-05-03 06:44:28,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:44:28,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44bc22fa6ff8e8ca94908 HTTP/1.1" 200 None 2026-05-03 06:44:28,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:44:28,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:44:28,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:44:28,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44bc22fa6ff8e8ca94908 HTTP/1.1" 200 None 2026-05-03 06:44:28,375 - lava_callback - ERROR - Error processing callback for node 69f44bc22fa6ff8e8ca94908: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55084 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:45:08,282 - lava_callback - INFO - Received callback for node 69f44be82fa6ff8e8ca9491b INFO: 172.20.0.1:55088 - "POST /node/69f44be82fa6ff8e8ca9491b HTTP/1.0" 202 Accepted 2026-05-03 06:45:08,292 - lava_callback - INFO - Starting async job submit for node 69f44be82fa6ff8e8ca9491b 2026-05-03 06:45:08,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:45:08,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44be82fa6ff8e8ca9491b HTTP/1.1" 200 None 2026-05-03 06:45:08,307 - lava_callback - DEBUG - Processing node 69f44be82fa6ff8e8ca9491b: baseline-arm-baylibre 2026-05-03 06:45:08,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44be82fa6ff8e8ca9491b 2026-05-03 06:45:08,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:45:08,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44be82fa6ff8e8ca9491b HTTP/1.1" 200 None 2026-05-03 06:45:08,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:45:08,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:45:08,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:45:08,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44be82fa6ff8e8ca9491b HTTP/1.1" 200 None 2026-05-03 06:45:08,358 - lava_callback - ERROR - Error processing callback for node 69f44be82fa6ff8e8ca9491b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49362 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:45:48,505 - lava_callback - INFO - Received callback for node 69f44c0f2fa6ff8e8ca9492b INFO: 172.20.0.1:49376 - "POST /node/69f44c0f2fa6ff8e8ca9492b HTTP/1.0" 202 Accepted 2026-05-03 06:45:48,510 - lava_callback - INFO - Starting async job submit for node 69f44c0f2fa6ff8e8ca9492b 2026-05-03 06:45:48,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:45:48,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44c0f2fa6ff8e8ca9492b HTTP/1.1" 200 None 2026-05-03 06:45:48,535 - lava_callback - DEBUG - Processing node 69f44c0f2fa6ff8e8ca9492b: baseline-arm-baylibre 2026-05-03 06:45:48,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44c0f2fa6ff8e8ca9492b 2026-05-03 06:45:48,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:45:48,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44c0f2fa6ff8e8ca9492b HTTP/1.1" 200 None 2026-05-03 06:45:48,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:45:48,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:45:48,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:45:48,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44c0f2fa6ff8e8ca9492b HTTP/1.1" 200 None 2026-05-03 06:45:48,581 - lava_callback - ERROR - Error processing callback for node 69f44c0f2fa6ff8e8ca9492b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35712 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:46:28,408 - lava_callback - INFO - Received callback for node 69f44c362fa6ff8e8ca94940 INFO: 172.20.0.1:35716 - "POST /node/69f44c362fa6ff8e8ca94940 HTTP/1.0" 202 Accepted 2026-05-03 06:46:28,413 - lava_callback - INFO - Starting async job submit for node 69f44c362fa6ff8e8ca94940 2026-05-03 06:46:28,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:46:28,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44c362fa6ff8e8ca94940 HTTP/1.1" 200 None 2026-05-03 06:46:28,428 - lava_callback - DEBUG - Processing node 69f44c362fa6ff8e8ca94940: baseline-arm-baylibre 2026-05-03 06:46:28,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44c362fa6ff8e8ca94940 2026-05-03 06:46:28,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:46:28,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44c362fa6ff8e8ca94940 HTTP/1.1" 200 None 2026-05-03 06:46:28,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:46:28,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:46:28,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:46:28,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44c362fa6ff8e8ca94940 HTTP/1.1" 200 None 2026-05-03 06:46:28,477 - lava_callback - ERROR - Error processing callback for node 69f44c362fa6ff8e8ca94940: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42716 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:47:08,452 - lava_callback - INFO - Received callback for node 69f44c5a2fa6ff8e8ca94955 INFO: 172.20.0.1:42730 - "POST /node/69f44c5a2fa6ff8e8ca94955 HTTP/1.0" 202 Accepted 2026-05-03 06:47:08,461 - lava_callback - INFO - Starting async job submit for node 69f44c5a2fa6ff8e8ca94955 2026-05-03 06:47:08,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:47:08,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44c5a2fa6ff8e8ca94955 HTTP/1.1" 200 None 2026-05-03 06:47:08,480 - lava_callback - DEBUG - Processing node 69f44c5a2fa6ff8e8ca94955: baseline-arm-baylibre 2026-05-03 06:47:08,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44c5a2fa6ff8e8ca94955 2026-05-03 06:47:08,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:47:08,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44c5a2fa6ff8e8ca94955 HTTP/1.1" 200 None 2026-05-03 06:47:08,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:47:08,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:47:08,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:47:08,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44c5a2fa6ff8e8ca94955 HTTP/1.1" 200 None 2026-05-03 06:47:08,533 - lava_callback - ERROR - Error processing callback for node 69f44c5a2fa6ff8e8ca94955: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37464 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:47:34,876 - lava_callback - INFO - Received callback for node 69f44c832fa6ff8e8ca94967 INFO: 172.20.0.1:37374 - "POST /node/69f44c832fa6ff8e8ca94967 HTTP/1.0" 202 Accepted 2026-05-03 06:47:34,881 - lava_callback - INFO - Starting async job submit for node 69f44c832fa6ff8e8ca94967 2026-05-03 06:47:34,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:47:34,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44c832fa6ff8e8ca94967 HTTP/1.1" 200 None 2026-05-03 06:47:34,897 - lava_callback - DEBUG - Processing node 69f44c832fa6ff8e8ca94967: baseline-arm-clabbe 2026-05-03 06:47:34,897 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44c832fa6ff8e8ca94967 2026-05-03 06:47:34,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:47:34,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44c832fa6ff8e8ca94967 HTTP/1.1" 200 None 2026-05-03 06:47:34,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:47:34,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:47:34,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:47:34,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44c832fa6ff8e8ca94967 HTTP/1.1" 200 None 2026-05-03 06:47:34,942 - lava_callback - ERROR - Error processing callback for node 69f44c832fa6ff8e8ca94967: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55114 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:49:34,934 - lava_callback - INFO - Received callback for node 69f44cf22fa6ff8e8ca949a1 INFO: 172.20.0.1:51536 - "POST /node/69f44cf22fa6ff8e8ca949a1 HTTP/1.0" 202 Accepted 2026-05-03 06:49:34,939 - lava_callback - INFO - Starting async job submit for node 69f44cf22fa6ff8e8ca949a1 2026-05-03 06:49:34,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:49:34,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44cf22fa6ff8e8ca949a1 HTTP/1.1" 200 None 2026-05-03 06:49:34,954 - lava_callback - DEBUG - Processing node 69f44cf22fa6ff8e8ca949a1: baseline-arm-clabbe 2026-05-03 06:49:34,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44cf22fa6ff8e8ca949a1 2026-05-03 06:49:34,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:49:34,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44cf22fa6ff8e8ca949a1 HTTP/1.1" 200 None 2026-05-03 06:49:34,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:49:34,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:49:34,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:49:35,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44cf22fa6ff8e8ca949a1 HTTP/1.1" 200 None 2026-05-03 06:49:35,002 - lava_callback - ERROR - Error processing callback for node 69f44cf22fa6ff8e8ca949a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55968 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:50:14,920 - lava_callback - INFO - Received callback for node 69f44d192fa6ff8e8ca949b7 INFO: 172.20.0.1:36726 - "POST /node/69f44d192fa6ff8e8ca949b7 HTTP/1.0" 202 Accepted 2026-05-03 06:50:14,925 - lava_callback - INFO - Starting async job submit for node 69f44d192fa6ff8e8ca949b7 2026-05-03 06:50:14,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:50:14,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44d192fa6ff8e8ca949b7 HTTP/1.1" 200 None 2026-05-03 06:50:14,941 - lava_callback - DEBUG - Processing node 69f44d192fa6ff8e8ca949b7: baseline-arm-clabbe 2026-05-03 06:50:14,941 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44d192fa6ff8e8ca949b7 2026-05-03 06:50:14,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:50:14,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44d192fa6ff8e8ca949b7 HTTP/1.1" 200 None 2026-05-03 06:50:14,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:50:14,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:50:14,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:50:14,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44d192fa6ff8e8ca949b7 HTTP/1.1" 200 None 2026-05-03 06:50:14,994 - lava_callback - ERROR - Error processing callback for node 69f44d192fa6ff8e8ca949b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59030 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:50:54,971 - lava_callback - INFO - Received callback for node 69f44d3e2fa6ff8e8ca949d2 INFO: 172.20.0.1:57932 - "POST /node/69f44d3e2fa6ff8e8ca949d2 HTTP/1.0" 202 Accepted 2026-05-03 06:50:54,977 - lava_callback - INFO - Starting async job submit for node 69f44d3e2fa6ff8e8ca949d2 2026-05-03 06:50:54,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:50:54,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44d3e2fa6ff8e8ca949d2 HTTP/1.1" 200 None 2026-05-03 06:50:54,996 - lava_callback - DEBUG - Processing node 69f44d3e2fa6ff8e8ca949d2: baseline-arm-clabbe 2026-05-03 06:50:54,996 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44d3e2fa6ff8e8ca949d2 2026-05-03 06:50:54,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:50:55,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44d3e2fa6ff8e8ca949d2 HTTP/1.1" 200 None 2026-05-03 06:50:55,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:50:55,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:50:55,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:50:55,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44d3e2fa6ff8e8ca949d2 HTTP/1.1" 200 None 2026-05-03 06:50:55,053 - lava_callback - ERROR - Error processing callback for node 69f44d3e2fa6ff8e8ca949d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52336 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:51:34,974 - lava_callback - INFO - Received callback for node 69f44d652fa6ff8e8ca949e0 INFO: 172.20.0.1:48690 - "POST /node/69f44d652fa6ff8e8ca949e0 HTTP/1.0" 202 Accepted 2026-05-03 06:51:34,980 - lava_callback - INFO - Starting async job submit for node 69f44d652fa6ff8e8ca949e0 2026-05-03 06:51:34,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:51:34,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44d652fa6ff8e8ca949e0 HTTP/1.1" 200 None 2026-05-03 06:51:34,998 - lava_callback - DEBUG - Processing node 69f44d652fa6ff8e8ca949e0: baseline-arm-clabbe 2026-05-03 06:51:34,999 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44d652fa6ff8e8ca949e0 2026-05-03 06:51:34,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:51:35,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44d652fa6ff8e8ca949e0 HTTP/1.1" 200 None 2026-05-03 06:51:35,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:51:35,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:51:35,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:51:35,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44d652fa6ff8e8ca949e0 HTTP/1.1" 200 None 2026-05-03 06:51:35,056 - lava_callback - ERROR - Error processing callback for node 69f44d652fa6ff8e8ca949e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33808 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:52:15,145 - lava_callback - INFO - Received callback for node 69f44d8c2fa6ff8e8ca949f6 INFO: 172.20.0.1:51510 - "POST /node/69f44d8c2fa6ff8e8ca949f6 HTTP/1.0" 202 Accepted 2026-05-03 06:52:15,151 - lava_callback - INFO - Starting async job submit for node 69f44d8c2fa6ff8e8ca949f6 2026-05-03 06:52:15,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:52:15,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44d8c2fa6ff8e8ca949f6 HTTP/1.1" 200 None 2026-05-03 06:52:15,173 - lava_callback - DEBUG - Processing node 69f44d8c2fa6ff8e8ca949f6: baseline-arm-clabbe 2026-05-03 06:52:15,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44d8c2fa6ff8e8ca949f6 2026-05-03 06:52:15,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:51518 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-03 06:52:15,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44d8c2fa6ff8e8ca949f6 HTTP/1.1" 200 None 2026-05-03 06:52:15,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:52:15,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:52:15,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:52:15,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44d8c2fa6ff8e8ca949f6 HTTP/1.1" 200 None 2026-05-03 06:52:15,243 - lava_callback - ERROR - Error processing callback for node 69f44d8c2fa6ff8e8ca949f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60630 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:52:55,045 - lava_callback - INFO - Received callback for node 69f44db32fa6ff8e8ca94a09 INFO: 172.20.0.1:39590 - "POST /node/69f44db32fa6ff8e8ca94a09 HTTP/1.0" 202 Accepted 2026-05-03 06:52:55,050 - lava_callback - INFO - Starting async job submit for node 69f44db32fa6ff8e8ca94a09 2026-05-03 06:52:55,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:52:55,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44db32fa6ff8e8ca94a09 HTTP/1.1" 200 None 2026-05-03 06:52:55,067 - lava_callback - DEBUG - Processing node 69f44db32fa6ff8e8ca94a09: baseline-arm-clabbe 2026-05-03 06:52:55,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44db32fa6ff8e8ca94a09 2026-05-03 06:52:55,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:52:55,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44db32fa6ff8e8ca94a09 HTTP/1.1" 200 None 2026-05-03 06:52:55,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:52:55,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:52:55,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:52:55,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44db32fa6ff8e8ca94a09 HTTP/1.1" 200 None 2026-05-03 06:52:55,121 - lava_callback - ERROR - Error processing callback for node 69f44db32fa6ff8e8ca94a09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56728 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:53:35,098 - lava_callback - INFO - Received callback for node 69f44dd92fa6ff8e8ca94a1f INFO: 172.20.0.1:59622 - "POST /node/69f44dd92fa6ff8e8ca94a1f HTTP/1.0" 202 Accepted 2026-05-03 06:53:35,103 - lava_callback - INFO - Starting async job submit for node 69f44dd92fa6ff8e8ca94a1f 2026-05-03 06:53:35,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:53:35,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44dd92fa6ff8e8ca94a1f HTTP/1.1" 200 None 2026-05-03 06:53:35,123 - lava_callback - DEBUG - Processing node 69f44dd92fa6ff8e8ca94a1f: baseline-arm-clabbe 2026-05-03 06:53:35,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44dd92fa6ff8e8ca94a1f 2026-05-03 06:53:35,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:53:35,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44dd92fa6ff8e8ca94a1f HTTP/1.1" 200 None 2026-05-03 06:53:35,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:53:35,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:53:35,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:53:35,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44dd92fa6ff8e8ca94a1f HTTP/1.1" 200 None 2026-05-03 06:53:35,170 - lava_callback - ERROR - Error processing callback for node 69f44dd92fa6ff8e8ca94a1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52136 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:53:55,068 - lava_callback - INFO - Received callback for node 69f44dff2fa6ff8e8ca94a2e INFO: 172.20.0.1:37246 - "POST /node/69f44dff2fa6ff8e8ca94a2e HTTP/1.0" 202 Accepted 2026-05-03 06:53:55,074 - lava_callback - INFO - Starting async job submit for node 69f44dff2fa6ff8e8ca94a2e 2026-05-03 06:53:55,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:53:55,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44dff2fa6ff8e8ca94a2e HTTP/1.1" 200 None 2026-05-03 06:53:55,089 - lava_callback - DEBUG - Processing node 69f44dff2fa6ff8e8ca94a2e: baseline-arm-clabbe 2026-05-03 06:53:55,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44dff2fa6ff8e8ca94a2e 2026-05-03 06:53:55,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:53:55,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44dff2fa6ff8e8ca94a2e HTTP/1.1" 200 None 2026-05-03 06:53:55,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:53:55,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:53:55,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:53:55,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44dff2fa6ff8e8ca94a2e HTTP/1.1" 200 None 2026-05-03 06:53:55,145 - lava_callback - ERROR - Error processing callback for node 69f44dff2fa6ff8e8ca94a2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42820 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:54:35,172 - lava_callback - INFO - Received callback for node 69f44e262fa6ff8e8ca94a3f INFO: 172.20.0.1:54916 - "POST /node/69f44e262fa6ff8e8ca94a3f HTTP/1.0" 202 Accepted 2026-05-03 06:54:35,177 - lava_callback - INFO - Starting async job submit for node 69f44e262fa6ff8e8ca94a3f 2026-05-03 06:54:35,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:54:35,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44e262fa6ff8e8ca94a3f HTTP/1.1" 200 None 2026-05-03 06:54:35,193 - lava_callback - DEBUG - Processing node 69f44e262fa6ff8e8ca94a3f: baseline-arm-clabbe 2026-05-03 06:54:35,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44e262fa6ff8e8ca94a3f 2026-05-03 06:54:35,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:54:35,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44e262fa6ff8e8ca94a3f HTTP/1.1" 200 None 2026-05-03 06:54:35,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:54:35,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:54:35,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:54:35,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44e262fa6ff8e8ca94a3f HTTP/1.1" 200 None 2026-05-03 06:54:35,282 - lava_callback - ERROR - Error processing callback for node 69f44e262fa6ff8e8ca94a3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36326 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:55:15,138 - lava_callback - INFO - Received callback for node 69f44e4d2fa6ff8e8ca94a5b INFO: 172.20.0.1:44050 - "POST /node/69f44e4d2fa6ff8e8ca94a5b HTTP/1.0" 202 Accepted 2026-05-03 06:55:15,144 - lava_callback - INFO - Starting async job submit for node 69f44e4d2fa6ff8e8ca94a5b 2026-05-03 06:55:15,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:55:15,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44e4d2fa6ff8e8ca94a5b HTTP/1.1" 200 None 2026-05-03 06:55:15,160 - lava_callback - DEBUG - Processing node 69f44e4d2fa6ff8e8ca94a5b: baseline-arm-clabbe 2026-05-03 06:55:15,160 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44e4d2fa6ff8e8ca94a5b 2026-05-03 06:55:15,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:55:15,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44e4d2fa6ff8e8ca94a5b HTTP/1.1" 200 None 2026-05-03 06:55:15,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:55:15,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:55:15,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:44062 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-03 06:55:15,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44e4d2fa6ff8e8ca94a5b HTTP/1.1" 200 None 2026-05-03 06:55:15,209 - lava_callback - ERROR - Error processing callback for node 69f44e4d2fa6ff8e8ca94a5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39648 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:55:55,262 - lava_callback - INFO - Received callback for node 69f44e742fa6ff8e8ca94a67 INFO: 172.20.0.1:53190 - "POST /node/69f44e742fa6ff8e8ca94a67 HTTP/1.0" 202 Accepted 2026-05-03 06:55:55,268 - lava_callback - INFO - Starting async job submit for node 69f44e742fa6ff8e8ca94a67 2026-05-03 06:55:55,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:55:55,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44e742fa6ff8e8ca94a67 HTTP/1.1" 200 None 2026-05-03 06:55:55,290 - lava_callback - DEBUG - Processing node 69f44e742fa6ff8e8ca94a67: baseline-arm-clabbe 2026-05-03 06:55:55,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44e742fa6ff8e8ca94a67 2026-05-03 06:55:55,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:55:55,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44e742fa6ff8e8ca94a67 HTTP/1.1" 200 None 2026-05-03 06:55:55,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:55:55,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:55:55,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:55:55,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44e742fa6ff8e8ca94a67 HTTP/1.1" 200 None 2026-05-03 06:55:55,336 - lava_callback - ERROR - Error processing callback for node 69f44e742fa6ff8e8ca94a67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50378 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:56:35,163 - lava_callback - INFO - Received callback for node 69f44e9a2fa6ff8e8ca94a78 INFO: 172.20.0.1:57068 - "POST /node/69f44e9a2fa6ff8e8ca94a78 HTTP/1.0" 202 Accepted 2026-05-03 06:56:35,169 - lava_callback - INFO - Starting async job submit for node 69f44e9a2fa6ff8e8ca94a78 2026-05-03 06:56:35,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:56:35,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44e9a2fa6ff8e8ca94a78 HTTP/1.1" 200 None 2026-05-03 06:56:35,193 - lava_callback - DEBUG - Processing node 69f44e9a2fa6ff8e8ca94a78: baseline-arm-clabbe 2026-05-03 06:56:35,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44e9a2fa6ff8e8ca94a78 2026-05-03 06:56:35,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:56:35,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44e9a2fa6ff8e8ca94a78 HTTP/1.1" 200 None 2026-05-03 06:56:35,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:56:35,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:56:35,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:56:35,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44e9a2fa6ff8e8ca94a78 HTTP/1.1" 200 None 2026-05-03 06:56:35,258 - lava_callback - ERROR - Error processing callback for node 69f44e9a2fa6ff8e8ca94a78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36820 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-03 06:57:15,200 - lava_callback - INFO - Received callback for node 69f44ec02fa6ff8e8ca94a8c INFO: 172.20.0.1:36828 - "POST /node/69f44ec02fa6ff8e8ca94a8c HTTP/1.0" 202 Accepted 2026-05-03 06:57:15,205 - lava_callback - INFO - Starting async job submit for node 69f44ec02fa6ff8e8ca94a8c 2026-05-03 06:57:15,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:57:15,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44ec02fa6ff8e8ca94a8c HTTP/1.1" 200 None 2026-05-03 06:57:15,226 - lava_callback - DEBUG - Processing node 69f44ec02fa6ff8e8ca94a8c: baseline-arm-clabbe 2026-05-03 06:57:15,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44ec02fa6ff8e8ca94a8c 2026-05-03 06:57:15,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:57:15,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44ec02fa6ff8e8ca94a8c HTTP/1.1" 200 None 2026-05-03 06:57:15,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:57:15,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:57:15,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:57:15,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44ec02fa6ff8e8ca94a8c HTTP/1.1" 200 None 2026-05-03 06:57:15,271 - lava_callback - ERROR - Error processing callback for node 69f44ec02fa6ff8e8ca94a8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54760 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:57:55,185 - lava_callback - INFO - Received callback for node 69f44ee62fa6ff8e8ca94aa1 INFO: 172.20.0.1:43294 - "POST /node/69f44ee62fa6ff8e8ca94aa1 HTTP/1.0" 202 Accepted 2026-05-03 06:57:55,191 - lava_callback - INFO - Starting async job submit for node 69f44ee62fa6ff8e8ca94aa1 2026-05-03 06:57:55,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:57:55,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44ee62fa6ff8e8ca94aa1 HTTP/1.1" 200 None 2026-05-03 06:57:55,206 - lava_callback - DEBUG - Processing node 69f44ee62fa6ff8e8ca94aa1: baseline-arm-clabbe 2026-05-03 06:57:55,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44ee62fa6ff8e8ca94aa1 2026-05-03 06:57:55,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:57:55,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44ee62fa6ff8e8ca94aa1 HTTP/1.1" 200 None 2026-05-03 06:57:55,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:57:55,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:57:55,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:57:55,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44ee62fa6ff8e8ca94aa1 HTTP/1.1" 200 None 2026-05-03 06:57:55,262 - lava_callback - ERROR - Error processing callback for node 69f44ee62fa6ff8e8ca94aa1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53706 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:58:49,373 - lava_callback - INFO - Received callback for node 69f44f142fa6ff8e8ca94ab3 INFO: 172.20.0.1:53722 - "POST /node/69f44f142fa6ff8e8ca94ab3 HTTP/1.0" 202 Accepted 2026-05-03 06:58:49,379 - lava_callback - INFO - Starting async job submit for node 69f44f142fa6ff8e8ca94ab3 2026-05-03 06:58:49,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:58:49,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44f142fa6ff8e8ca94ab3 HTTP/1.1" 200 None 2026-05-03 06:58:49,394 - lava_callback - DEBUG - Processing node 69f44f142fa6ff8e8ca94ab3: baseline-arm64-baylibre 2026-05-03 06:58:49,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44f142fa6ff8e8ca94ab3 2026-05-03 06:58:49,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:53728 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:58:49,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44f142fa6ff8e8ca94ab3 HTTP/1.1" 200 None 2026-05-03 06:58:49,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:58:49,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 06:58:49,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:58:49,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44f142fa6ff8e8ca94ab3 HTTP/1.1" 200 None 2026-05-03 06:58:49,463 - lava_callback - ERROR - Error processing callback for node 69f44f142fa6ff8e8ca94ab3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50462 - "GET / HTTP/1.0" 200 OK 2026-05-03 06:59:55,355 - lava_callback - INFO - Received callback for node 69f44f572fa6ff8e8ca94ad5 INFO: 172.20.0.1:39378 - "POST /node/69f44f572fa6ff8e8ca94ad5 HTTP/1.0" 202 Accepted 2026-05-03 06:59:55,360 - lava_callback - INFO - Starting async job submit for node 69f44f572fa6ff8e8ca94ad5 2026-05-03 06:59:55,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:59:55,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44f572fa6ff8e8ca94ad5 HTTP/1.1" 200 None 2026-05-03 06:59:55,383 - lava_callback - DEBUG - Processing node 69f44f572fa6ff8e8ca94ad5: baseline-arm-clabbe 2026-05-03 06:59:55,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44f572fa6ff8e8ca94ad5 2026-05-03 06:59:55,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:59:55,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44f572fa6ff8e8ca94ad5 HTTP/1.1" 200 None 2026-05-03 06:59:55,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:59:55,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 06:59:55,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 06:59:55,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44f572fa6ff8e8ca94ad5 HTTP/1.1" 200 None 2026-05-03 06:59:55,436 - lava_callback - ERROR - Error processing callback for node 69f44f572fa6ff8e8ca94ad5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46186 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:00:35,335 - lava_callback - INFO - Received callback for node 69f44f7f2fa6ff8e8ca94aec INFO: 172.20.0.1:49802 - "POST /node/69f44f7f2fa6ff8e8ca94aec HTTP/1.0" 202 Accepted 2026-05-03 07:00:35,340 - lava_callback - INFO - Starting async job submit for node 69f44f7f2fa6ff8e8ca94aec 2026-05-03 07:00:35,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:00:35,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44f7f2fa6ff8e8ca94aec HTTP/1.1" 200 None 2026-05-03 07:00:35,355 - lava_callback - DEBUG - Processing node 69f44f7f2fa6ff8e8ca94aec: baseline-arm-clabbe 2026-05-03 07:00:35,355 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44f7f2fa6ff8e8ca94aec 2026-05-03 07:00:35,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:00:35,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44f7f2fa6ff8e8ca94aec HTTP/1.1" 200 None 2026-05-03 07:00:35,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:00:35,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 07:00:35,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:00:35,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44f7f2fa6ff8e8ca94aec HTTP/1.1" 200 None 2026-05-03 07:00:35,400 - lava_callback - ERROR - Error processing callback for node 69f44f7f2fa6ff8e8ca94aec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45024 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-03 07:01:15,400 - lava_callback - INFO - Received callback for node 69f44fb52fa6ff8e8ca94b0b INFO: 172.20.0.1:45034 - "POST /node/69f44fb52fa6ff8e8ca94b0b HTTP/1.0" 202 Accepted 2026-05-03 07:01:15,406 - lava_callback - INFO - Starting async job submit for node 69f44fb52fa6ff8e8ca94b0b 2026-05-03 07:01:15,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:01:15,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44fb52fa6ff8e8ca94b0b HTTP/1.1" 200 None 2026-05-03 07:01:15,425 - lava_callback - DEBUG - Processing node 69f44fb52fa6ff8e8ca94b0b: baseline-arm64-clabbe 2026-05-03 07:01:15,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44fb52fa6ff8e8ca94b0b 2026-05-03 07:01:15,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:01:15,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44fb52fa6ff8e8ca94b0b HTTP/1.1" 200 None 2026-05-03 07:01:15,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:01:15,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 07:01:15,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:01:15,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44fb52fa6ff8e8ca94b0b HTTP/1.1" 200 None 2026-05-03 07:01:15,474 - lava_callback - ERROR - Error processing callback for node 69f44fb52fa6ff8e8ca94b0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42000 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-03 07:02:15,444 - lava_callback - INFO - Received callback for node 69f44ff32fa6ff8e8ca94b2c INFO: 172.20.0.1:42014 - "POST /node/69f44ff32fa6ff8e8ca94b2c HTTP/1.0" 202 Accepted 2026-05-03 07:02:15,450 - lava_callback - INFO - Starting async job submit for node 69f44ff32fa6ff8e8ca94b2c 2026-05-03 07:02:15,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:02:15,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44ff32fa6ff8e8ca94b2c HTTP/1.1" 200 None 2026-05-03 07:02:15,465 - lava_callback - DEBUG - Processing node 69f44ff32fa6ff8e8ca94b2c: baseline-arm-clabbe 2026-05-03 07:02:15,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f44ff32fa6ff8e8ca94b2c 2026-05-03 07:02:15,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:02:15,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f44ff32fa6ff8e8ca94b2c HTTP/1.1" 200 None 2026-05-03 07:02:15,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:02:15,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e2b1c6f6c1a9f7050c0 HTTP/1.1" 200 None 2026-05-03 07:02:15,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:02:15,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f44ff32fa6ff8e8ca94b2c HTTP/1.1" 200 None 2026-05-03 07:02:15,513 - lava_callback - ERROR - Error processing callback for node 69f44ff32fa6ff8e8ca94b2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35622 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-03 07:03:15,485 - lava_callback - INFO - Received callback for node 69f450292fa6ff8e8ca94b3a INFO: 172.20.0.1:35626 - "POST /node/69f450292fa6ff8e8ca94b3a HTTP/1.0" 202 Accepted 2026-05-03 07:03:15,491 - lava_callback - INFO - Starting async job submit for node 69f450292fa6ff8e8ca94b3a 2026-05-03 07:03:15,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:03:15,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f450292fa6ff8e8ca94b3a HTTP/1.1" 200 None 2026-05-03 07:03:15,510 - lava_callback - DEBUG - Processing node 69f450292fa6ff8e8ca94b3a: baseline-arm64-clabbe 2026-05-03 07:03:15,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f450292fa6ff8e8ca94b3a 2026-05-03 07:03:15,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:03:15,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f450292fa6ff8e8ca94b3a HTTP/1.1" 200 None 2026-05-03 07:03:15,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:03:15,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 07:03:15,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:03:15,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f450292fa6ff8e8ca94b3a HTTP/1.1" 200 None 2026-05-03 07:03:15,569 - lava_callback - ERROR - Error processing callback for node 69f450292fa6ff8e8ca94b3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37722 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:04:35,516 - lava_callback - INFO - Received callback for node 69f450772fa6ff8e8ca94b5f INFO: 172.20.0.1:55852 - "POST /node/69f450772fa6ff8e8ca94b5f HTTP/1.0" 202 Accepted 2026-05-03 07:04:35,521 - lava_callback - INFO - Starting async job submit for node 69f450772fa6ff8e8ca94b5f 2026-05-03 07:04:35,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:04:35,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f450772fa6ff8e8ca94b5f HTTP/1.1" 200 None 2026-05-03 07:04:35,537 - lava_callback - DEBUG - Processing node 69f450772fa6ff8e8ca94b5f: baseline-arm64-clabbe 2026-05-03 07:04:35,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f450772fa6ff8e8ca94b5f 2026-05-03 07:04:35,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:04:35,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f450772fa6ff8e8ca94b5f HTTP/1.1" 200 None 2026-05-03 07:04:35,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:04:35,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 07:04:35,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:04:35,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f450772fa6ff8e8ca94b5f HTTP/1.1" 200 None 2026-05-03 07:04:35,584 - lava_callback - ERROR - Error processing callback for node 69f450772fa6ff8e8ca94b5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51250 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:05:55,590 - lava_callback - INFO - Received callback for node 69f450c62fa6ff8e8ca94b87 INFO: 172.20.0.1:40072 - "POST /node/69f450c62fa6ff8e8ca94b87 HTTP/1.0" 202 Accepted 2026-05-03 07:05:55,596 - lava_callback - INFO - Starting async job submit for node 69f450c62fa6ff8e8ca94b87 2026-05-03 07:05:55,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:05:55,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f450c62fa6ff8e8ca94b87 HTTP/1.1" 200 None 2026-05-03 07:05:55,611 - lava_callback - DEBUG - Processing node 69f450c62fa6ff8e8ca94b87: baseline-arm64-clabbe 2026-05-03 07:05:55,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f450c62fa6ff8e8ca94b87 2026-05-03 07:05:55,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:05:55,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f450c62fa6ff8e8ca94b87 HTTP/1.1" 200 None 2026-05-03 07:05:55,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:05:55,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 07:05:55,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:05:55,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f450c62fa6ff8e8ca94b87 HTTP/1.1" 200 None 2026-05-03 07:05:55,664 - lava_callback - ERROR - Error processing callback for node 69f450c62fa6ff8e8ca94b87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51548 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-03 07:07:15,561 - lava_callback - INFO - Received callback for node 69f451132fa6ff8e8ca94ba7 INFO: 172.20.0.1:51564 - "POST /node/69f451132fa6ff8e8ca94ba7 HTTP/1.0" 202 Accepted 2026-05-03 07:07:15,567 - lava_callback - INFO - Starting async job submit for node 69f451132fa6ff8e8ca94ba7 2026-05-03 07:07:15,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:07:15,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f451132fa6ff8e8ca94ba7 HTTP/1.1" 200 None 2026-05-03 07:07:15,582 - lava_callback - DEBUG - Processing node 69f451132fa6ff8e8ca94ba7: baseline-arm64-clabbe 2026-05-03 07:07:15,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f451132fa6ff8e8ca94ba7 2026-05-03 07:07:15,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:07:15,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f451132fa6ff8e8ca94ba7 HTTP/1.1" 200 None 2026-05-03 07:07:15,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:07:15,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 07:07:15,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:07:15,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f451132fa6ff8e8ca94ba7 HTTP/1.1" 200 None 2026-05-03 07:07:15,643 - lava_callback - ERROR - Error processing callback for node 69f451132fa6ff8e8ca94ba7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41080 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:08:35,615 - lava_callback - INFO - Received callback for node 69f451632fa6ff8e8ca94bc9 INFO: 172.20.0.1:48722 - "POST /node/69f451632fa6ff8e8ca94bc9 HTTP/1.0" 202 Accepted 2026-05-03 07:08:35,620 - lava_callback - INFO - Starting async job submit for node 69f451632fa6ff8e8ca94bc9 2026-05-03 07:08:35,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:08:35,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f451632fa6ff8e8ca94bc9 HTTP/1.1" 200 None 2026-05-03 07:08:35,639 - lava_callback - DEBUG - Processing node 69f451632fa6ff8e8ca94bc9: baseline-arm64-clabbe 2026-05-03 07:08:35,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f451632fa6ff8e8ca94bc9 2026-05-03 07:08:35,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:08:35,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f451632fa6ff8e8ca94bc9 HTTP/1.1" 200 None 2026-05-03 07:08:35,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:08:35,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 07:08:35,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:08:35,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f451632fa6ff8e8ca94bc9 HTTP/1.1" 200 None 2026-05-03 07:08:35,684 - lava_callback - ERROR - Error processing callback for node 69f451632fa6ff8e8ca94bc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37258 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:09:53,610 - lava_callback - INFO - Received callback for node 69f451a82fa6ff8e8ca94beb INFO: 172.20.0.1:60620 - "POST /node/69f451a82fa6ff8e8ca94beb HTTP/1.0" 202 Accepted 2026-05-03 07:09:53,615 - lava_callback - INFO - Starting async job submit for node 69f451a82fa6ff8e8ca94beb 2026-05-03 07:09:53,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:09:53,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f451a82fa6ff8e8ca94beb HTTP/1.1" 200 None 2026-05-03 07:09:53,633 - lava_callback - DEBUG - Processing node 69f451a82fa6ff8e8ca94beb: baseline-arm64-baylibre 2026-05-03 07:09:53,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f451a82fa6ff8e8ca94beb 2026-05-03 07:09:53,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:09:53,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f451a82fa6ff8e8ca94beb HTTP/1.1" 200 None 2026-05-03 07:09:53,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:09:53,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:09:53,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:09:53,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f451a82fa6ff8e8ca94beb HTTP/1.1" 200 None 2026-05-03 07:09:53,677 - lava_callback - ERROR - Error processing callback for node 69f451a82fa6ff8e8ca94beb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48706 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:10:49,644 - lava_callback - INFO - Received callback for node 69f451f32fa6ff8e8ca94c10 INFO: 172.20.0.1:48720 - "POST /node/69f451f32fa6ff8e8ca94c10 HTTP/1.0" 202 Accepted 2026-05-03 07:10:49,650 - lava_callback - INFO - Starting async job submit for node 69f451f32fa6ff8e8ca94c10 2026-05-03 07:10:49,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:10:49,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f451f32fa6ff8e8ca94c10 HTTP/1.1" 200 None 2026-05-03 07:10:49,677 - lava_callback - DEBUG - Processing node 69f451f32fa6ff8e8ca94c10: baseline-arm64-baylibre 2026-05-03 07:10:49,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f451f32fa6ff8e8ca94c10 2026-05-03 07:10:49,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:10:49,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f451f32fa6ff8e8ca94c10 HTTP/1.1" 200 None 2026-05-03 07:10:49,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:10:49,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:10:49,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:10:49,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f451f32fa6ff8e8ca94c10 HTTP/1.1" 200 None 2026-05-03 07:10:49,722 - lava_callback - ERROR - Error processing callback for node 69f451f32fa6ff8e8ca94c10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41638 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:13:29,772 - lava_callback - INFO - Received callback for node 69f452882fa6ff8e8ca94c54 INFO: 172.20.0.1:60014 - "POST /node/69f452882fa6ff8e8ca94c54 HTTP/1.0" 202 Accepted 2026-05-03 07:13:29,780 - lava_callback - INFO - Starting async job submit for node 69f452882fa6ff8e8ca94c54 2026-05-03 07:13:29,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:13:29,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f452882fa6ff8e8ca94c54 HTTP/1.1" 200 None 2026-05-03 07:13:29,796 - lava_callback - DEBUG - Processing node 69f452882fa6ff8e8ca94c54: baseline-arm64-baylibre 2026-05-03 07:13:29,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f452882fa6ff8e8ca94c54 2026-05-03 07:13:29,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:13:29,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f452882fa6ff8e8ca94c54 HTTP/1.1" 200 None 2026-05-03 07:13:29,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:13:29,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:13:29,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:13:29,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f452882fa6ff8e8ca94c54 HTTP/1.1" 200 None 2026-05-03 07:13:29,852 - lava_callback - ERROR - Error processing callback for node 69f452882fa6ff8e8ca94c54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37810 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:17:09,958 - lava_callback - INFO - Received callback for node 69f453692fa6ff8e8ca94cba INFO: 172.20.0.1:45936 - "POST /node/69f453692fa6ff8e8ca94cba HTTP/1.0" 202 Accepted 2026-05-03 07:17:09,963 - lava_callback - INFO - Starting async job submit for node 69f453692fa6ff8e8ca94cba 2026-05-03 07:17:09,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:17:10,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f453692fa6ff8e8ca94cba HTTP/1.1" 200 None 2026-05-03 07:17:10,034 - lava_callback - DEBUG - Processing node 69f453692fa6ff8e8ca94cba: baseline-arm64-baylibre 2026-05-03 07:17:10,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f453692fa6ff8e8ca94cba 2026-05-03 07:17:10,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:17:10,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f453692fa6ff8e8ca94cba HTTP/1.1" 200 None 2026-05-03 07:17:10,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:17:10,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:17:10,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:17:10,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f453692fa6ff8e8ca94cba HTTP/1.1" 200 None 2026-05-03 07:17:10,160 - lava_callback - ERROR - Error processing callback for node 69f453692fa6ff8e8ca94cba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34492 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:19:50,115 - lava_callback - INFO - Received callback for node 69f454012fa6ff8e8ca94d02 INFO: 172.20.0.1:34496 - "POST /node/69f454012fa6ff8e8ca94d02 HTTP/1.0" 202 Accepted 2026-05-03 07:19:50,121 - lava_callback - INFO - Starting async job submit for node 69f454012fa6ff8e8ca94d02 2026-05-03 07:19:50,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:19:50,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f454012fa6ff8e8ca94d02 HTTP/1.1" 200 None 2026-05-03 07:19:50,143 - lava_callback - DEBUG - Processing node 69f454012fa6ff8e8ca94d02: baseline-arm64-baylibre 2026-05-03 07:19:50,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f454012fa6ff8e8ca94d02 2026-05-03 07:19:50,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:19:50,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f454012fa6ff8e8ca94d02 HTTP/1.1" 200 None 2026-05-03 07:19:50,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:19:50,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:19:50,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:19:50,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f454012fa6ff8e8ca94d02 HTTP/1.1" 200 None 2026-05-03 07:19:50,189 - lava_callback - ERROR - Error processing callback for node 69f454012fa6ff8e8ca94d02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44192 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:20:50,131 - lava_callback - INFO - Received callback for node 69f4544d2fa6ff8e8ca94d2d INFO: 172.20.0.1:44196 - "POST /node/69f4544d2fa6ff8e8ca94d2d HTTP/1.0" 202 Accepted 2026-05-03 07:20:50,137 - lava_callback - INFO - Starting async job submit for node 69f4544d2fa6ff8e8ca94d2d 2026-05-03 07:20:50,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:20:50,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4544d2fa6ff8e8ca94d2d HTTP/1.1" 200 None 2026-05-03 07:20:50,152 - lava_callback - DEBUG - Processing node 69f4544d2fa6ff8e8ca94d2d: baseline-arm64-baylibre 2026-05-03 07:20:50,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4544d2fa6ff8e8ca94d2d 2026-05-03 07:20:50,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:20:50,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4544d2fa6ff8e8ca94d2d HTTP/1.1" 200 None 2026-05-03 07:20:50,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:20:50,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:20:50,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:20:50,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4544d2fa6ff8e8ca94d2d HTTP/1.1" 200 None 2026-05-03 07:20:50,198 - lava_callback - ERROR - Error processing callback for node 69f4544d2fa6ff8e8ca94d2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49498 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:23:36,191 - lava_callback - INFO - Received callback for node 69f454e92fa6ff8e8ca94d81 INFO: 172.20.0.1:44176 - "POST /node/69f454e92fa6ff8e8ca94d81 HTTP/1.0" 202 Accepted 2026-05-03 07:23:36,197 - lava_callback - INFO - Starting async job submit for node 69f454e92fa6ff8e8ca94d81 2026-05-03 07:23:36,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:23:36,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f454e92fa6ff8e8ca94d81 HTTP/1.1" 200 None 2026-05-03 07:23:36,212 - lava_callback - DEBUG - Processing node 69f454e92fa6ff8e8ca94d81: baseline-arm64-clabbe 2026-05-03 07:23:36,212 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f454e92fa6ff8e8ca94d81 2026-05-03 07:23:36,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:23:36,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f454e92fa6ff8e8ca94d81 HTTP/1.1" 200 None 2026-05-03 07:23:36,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:23:36,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:23:36,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:23:36,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f454e92fa6ff8e8ca94d81 HTTP/1.1" 200 None 2026-05-03 07:23:36,269 - lava_callback - ERROR - Error processing callback for node 69f454e92fa6ff8e8ca94d81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47608 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:24:50,446 - lava_callback - INFO - Received callback for node 69f455302fa6ff8e8ca94da4 INFO: 172.20.0.1:47620 - "POST /node/69f455302fa6ff8e8ca94da4 HTTP/1.0" 202 Accepted 2026-05-03 07:24:50,454 - lava_callback - INFO - Starting async job submit for node 69f455302fa6ff8e8ca94da4 2026-05-03 07:24:50,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:24:50,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f455302fa6ff8e8ca94da4 HTTP/1.1" 200 None 2026-05-03 07:24:50,477 - lava_callback - DEBUG - Processing node 69f455302fa6ff8e8ca94da4: baseline-arm64-baylibre 2026-05-03 07:24:50,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f455302fa6ff8e8ca94da4 2026-05-03 07:24:50,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:24:50,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f455302fa6ff8e8ca94da4 HTTP/1.1" 200 None 2026-05-03 07:24:50,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:24:50,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:24:50,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:24:50,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f455302fa6ff8e8ca94da4 HTTP/1.1" 200 None 2026-05-03 07:24:50,533 - lava_callback - ERROR - Error processing callback for node 69f455302fa6ff8e8ca94da4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54402 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:25:56,289 - lava_callback - INFO - Received callback for node 69f455802fa6ff8e8ca94dd3 INFO: 172.20.0.1:54414 - "POST /node/69f455802fa6ff8e8ca94dd3 HTTP/1.0" 202 Accepted 2026-05-03 07:25:56,295 - lava_callback - INFO - Starting async job submit for node 69f455802fa6ff8e8ca94dd3 2026-05-03 07:25:56,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:25:56,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f455802fa6ff8e8ca94dd3 HTTP/1.1" 200 None 2026-05-03 07:25:56,310 - lava_callback - DEBUG - Processing node 69f455802fa6ff8e8ca94dd3: baseline-arm64-clabbe 2026-05-03 07:25:56,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f455802fa6ff8e8ca94dd3 2026-05-03 07:25:56,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:25:56,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f455802fa6ff8e8ca94dd3 HTTP/1.1" 200 None 2026-05-03 07:25:56,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:25:56,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:25:56,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:25:56,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f455802fa6ff8e8ca94dd3 HTTP/1.1" 200 None 2026-05-03 07:25:56,355 - lava_callback - ERROR - Error processing callback for node 69f455802fa6ff8e8ca94dd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51502 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-03 07:27:16,319 - lava_callback - INFO - Received callback for node 69f455cb2fa6ff8e8ca94df9 INFO: 172.20.0.1:51518 - "POST /node/69f455cb2fa6ff8e8ca94df9 HTTP/1.0" 202 Accepted 2026-05-03 07:27:16,328 - lava_callback - INFO - Starting async job submit for node 69f455cb2fa6ff8e8ca94df9 2026-05-03 07:27:16,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:27:16,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f455cb2fa6ff8e8ca94df9 HTTP/1.1" 200 None 2026-05-03 07:27:16,349 - lava_callback - DEBUG - Processing node 69f455cb2fa6ff8e8ca94df9: baseline-arm64-clabbe 2026-05-03 07:27:16,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f455cb2fa6ff8e8ca94df9 2026-05-03 07:27:16,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:27:16,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f455cb2fa6ff8e8ca94df9 HTTP/1.1" 200 None 2026-05-03 07:27:16,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:27:16,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:27:16,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:27:16,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f455cb2fa6ff8e8ca94df9 HTTP/1.1" 200 None 2026-05-03 07:27:16,417 - lava_callback - ERROR - Error processing callback for node 69f455cb2fa6ff8e8ca94df9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46380 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:28:36,370 - lava_callback - INFO - Received callback for node 69f456182fa6ff8e8ca94e23 INFO: 172.20.0.1:47672 - "POST /node/69f456182fa6ff8e8ca94e23 HTTP/1.0" 202 Accepted 2026-05-03 07:28:36,375 - lava_callback - INFO - Starting async job submit for node 69f456182fa6ff8e8ca94e23 2026-05-03 07:28:36,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:28:36,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f456182fa6ff8e8ca94e23 HTTP/1.1" 200 None 2026-05-03 07:28:36,390 - lava_callback - DEBUG - Processing node 69f456182fa6ff8e8ca94e23: baseline-arm64-clabbe 2026-05-03 07:28:36,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f456182fa6ff8e8ca94e23 2026-05-03 07:28:36,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:28:36,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f456182fa6ff8e8ca94e23 HTTP/1.1" 200 None 2026-05-03 07:28:36,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:28:36,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:28:36,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:28:36,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f456182fa6ff8e8ca94e23 HTTP/1.1" 200 None 2026-05-03 07:28:36,436 - lava_callback - ERROR - Error processing callback for node 69f456182fa6ff8e8ca94e23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37930 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:29:56,542 - lava_callback - INFO - Received callback for node 69f456652fa6ff8e8ca94e53 INFO: 172.20.0.1:37940 - "POST /node/69f456652fa6ff8e8ca94e53 HTTP/1.0" 202 Accepted 2026-05-03 07:29:56,547 - lava_callback - INFO - Starting async job submit for node 69f456652fa6ff8e8ca94e53 2026-05-03 07:29:56,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:29:56,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f456652fa6ff8e8ca94e53 HTTP/1.1" 200 None 2026-05-03 07:29:56,563 - lava_callback - DEBUG - Processing node 69f456652fa6ff8e8ca94e53: baseline-arm64-clabbe 2026-05-03 07:29:56,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f456652fa6ff8e8ca94e53 2026-05-03 07:29:56,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:29:56,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f456652fa6ff8e8ca94e53 HTTP/1.1" 200 None 2026-05-03 07:29:56,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:29:56,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:29:56,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:29:56,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f456652fa6ff8e8ca94e53 HTTP/1.1" 200 None 2026-05-03 07:29:56,616 - lava_callback - ERROR - Error processing callback for node 69f456652fa6ff8e8ca94e53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40762 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:31:16,529 - lava_callback - INFO - Received callback for node 69f456b32fa6ff8e8ca94e6e INFO: 172.20.0.1:40770 - "POST /node/69f456b32fa6ff8e8ca94e6e HTTP/1.0" 202 Accepted 2026-05-03 07:31:16,534 - lava_callback - INFO - Starting async job submit for node 69f456b32fa6ff8e8ca94e6e 2026-05-03 07:31:16,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:31:16,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f456b32fa6ff8e8ca94e6e HTTP/1.1" 200 None 2026-05-03 07:31:16,556 - lava_callback - DEBUG - Processing node 69f456b32fa6ff8e8ca94e6e: baseline-arm64-clabbe 2026-05-03 07:31:16,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f456b32fa6ff8e8ca94e6e 2026-05-03 07:31:16,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:31:16,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f456b32fa6ff8e8ca94e6e HTTP/1.1" 200 None 2026-05-03 07:31:16,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:31:16,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:31:16,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:31:16,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f456b32fa6ff8e8ca94e6e HTTP/1.1" 200 None 2026-05-03 07:31:16,603 - lava_callback - ERROR - Error processing callback for node 69f456b32fa6ff8e8ca94e6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58280 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:32:36,529 - lava_callback - INFO - Received callback for node 69f457012fa6ff8e8ca94e99 INFO: 172.20.0.1:48358 - "POST /node/69f457012fa6ff8e8ca94e99 HTTP/1.0" 202 Accepted 2026-05-03 07:32:36,535 - lava_callback - INFO - Starting async job submit for node 69f457012fa6ff8e8ca94e99 2026-05-03 07:32:36,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:48372 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:32:36,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f457012fa6ff8e8ca94e99 HTTP/1.1" 200 None 2026-05-03 07:32:36,557 - lava_callback - DEBUG - Processing node 69f457012fa6ff8e8ca94e99: baseline-arm64-clabbe 2026-05-03 07:32:36,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f457012fa6ff8e8ca94e99 2026-05-03 07:32:36,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:32:36,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f457012fa6ff8e8ca94e99 HTTP/1.1" 200 None 2026-05-03 07:32:36,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:32:36,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:32:36,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:32:36,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f457012fa6ff8e8ca94e99 HTTP/1.1" 200 None 2026-05-03 07:32:36,604 - lava_callback - ERROR - Error processing callback for node 69f457012fa6ff8e8ca94e99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37266 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:33:56,583 - lava_callback - INFO - Received callback for node 69f4574e2fa6ff8e8ca94eba INFO: 172.20.0.1:37272 - "POST /node/69f4574e2fa6ff8e8ca94eba HTTP/1.0" 202 Accepted 2026-05-03 07:33:56,592 - lava_callback - INFO - Starting async job submit for node 69f4574e2fa6ff8e8ca94eba 2026-05-03 07:33:56,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:33:56,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4574e2fa6ff8e8ca94eba HTTP/1.1" 200 None 2026-05-03 07:33:56,611 - lava_callback - DEBUG - Processing node 69f4574e2fa6ff8e8ca94eba: baseline-arm64-clabbe 2026-05-03 07:33:56,612 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4574e2fa6ff8e8ca94eba 2026-05-03 07:33:56,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:33:56,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4574e2fa6ff8e8ca94eba HTTP/1.1" 200 None 2026-05-03 07:33:56,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:33:56,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:33:56,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:33:56,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4574e2fa6ff8e8ca94eba HTTP/1.1" 200 None 2026-05-03 07:33:56,672 - lava_callback - ERROR - Error processing callback for node 69f4574e2fa6ff8e8ca94eba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51788 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:34:56,590 - lava_callback - INFO - Received callback for node 69f4579c2fa6ff8e8ca94ee1 INFO: 172.20.0.1:51790 - "POST /node/69f4579c2fa6ff8e8ca94ee1 HTTP/1.0" 202 Accepted 2026-05-03 07:34:56,596 - lava_callback - INFO - Starting async job submit for node 69f4579c2fa6ff8e8ca94ee1 2026-05-03 07:34:56,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:34:56,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4579c2fa6ff8e8ca94ee1 HTTP/1.1" 200 None 2026-05-03 07:34:56,611 - lava_callback - DEBUG - Processing node 69f4579c2fa6ff8e8ca94ee1: baseline-arm64-clabbe 2026-05-03 07:34:56,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f4579c2fa6ff8e8ca94ee1 2026-05-03 07:34:56,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:34:56,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4579c2fa6ff8e8ca94ee1 HTTP/1.1" 200 None 2026-05-03 07:34:56,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:34:56,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:34:56,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:34:56,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f4579c2fa6ff8e8ca94ee1 HTTP/1.1" 200 None 2026-05-03 07:34:56,661 - lava_callback - ERROR - Error processing callback for node 69f4579c2fa6ff8e8ca94ee1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41092 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:36:16,691 - lava_callback - INFO - Received callback for node 69f457e82fa6ff8e8ca94f05 INFO: 172.20.0.1:41096 - "POST /node/69f457e82fa6ff8e8ca94f05 HTTP/1.0" 202 Accepted 2026-05-03 07:36:16,697 - lava_callback - INFO - Starting async job submit for node 69f457e82fa6ff8e8ca94f05 2026-05-03 07:36:16,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:36:16,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f457e82fa6ff8e8ca94f05 HTTP/1.1" 200 None 2026-05-03 07:36:16,712 - lava_callback - DEBUG - Processing node 69f457e82fa6ff8e8ca94f05: baseline-arm64-clabbe 2026-05-03 07:36:16,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f457e82fa6ff8e8ca94f05 2026-05-03 07:36:16,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:36:16,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f457e82fa6ff8e8ca94f05 HTTP/1.1" 200 None 2026-05-03 07:36:16,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:36:16,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:36:16,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:36:16,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f457e82fa6ff8e8ca94f05 HTTP/1.1" 200 None 2026-05-03 07:36:16,764 - lava_callback - ERROR - Error processing callback for node 69f457e82fa6ff8e8ca94f05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48174 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:37:36,745 - lava_callback - INFO - Received callback for node 69f458342fa6ff8e8ca94f32 INFO: 172.20.0.1:48186 - "POST /node/69f458342fa6ff8e8ca94f32 HTTP/1.0" 202 Accepted 2026-05-03 07:37:36,750 - lava_callback - INFO - Starting async job submit for node 69f458342fa6ff8e8ca94f32 2026-05-03 07:37:36,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:37:36,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f458342fa6ff8e8ca94f32 HTTP/1.1" 200 None 2026-05-03 07:37:36,773 - lava_callback - DEBUG - Processing node 69f458342fa6ff8e8ca94f32: baseline-arm64-clabbe 2026-05-03 07:37:36,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f458342fa6ff8e8ca94f32 2026-05-03 07:37:36,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:37:36,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f458342fa6ff8e8ca94f32 HTTP/1.1" 200 None 2026-05-03 07:37:36,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:37:36,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:37:36,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:37:36,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f458342fa6ff8e8ca94f32 HTTP/1.1" 200 None 2026-05-03 07:37:36,818 - lava_callback - ERROR - Error processing callback for node 69f458342fa6ff8e8ca94f32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49844 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:38:56,775 - lava_callback - INFO - Received callback for node 69f458812fa6ff8e8ca94f63 INFO: 172.20.0.1:49858 - "POST /node/69f458812fa6ff8e8ca94f63 HTTP/1.0" 202 Accepted 2026-05-03 07:38:56,780 - lava_callback - INFO - Starting async job submit for node 69f458812fa6ff8e8ca94f63 2026-05-03 07:38:56,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:38:56,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f458812fa6ff8e8ca94f63 HTTP/1.1" 200 None 2026-05-03 07:38:56,798 - lava_callback - DEBUG - Processing node 69f458812fa6ff8e8ca94f63: baseline-arm64-clabbe 2026-05-03 07:38:56,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f458812fa6ff8e8ca94f63 2026-05-03 07:38:56,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:38:56,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f458812fa6ff8e8ca94f63 HTTP/1.1" 200 None 2026-05-03 07:38:56,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:38:56,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:38:56,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:38:56,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f458812fa6ff8e8ca94f63 HTTP/1.1" 200 None 2026-05-03 07:38:56,848 - lava_callback - ERROR - Error processing callback for node 69f458812fa6ff8e8ca94f63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41234 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:40:16,841 - lava_callback - INFO - Received callback for node 69f458cc2fa6ff8e8ca94f80 INFO: 172.20.0.1:41240 - "POST /node/69f458cc2fa6ff8e8ca94f80 HTTP/1.0" 202 Accepted 2026-05-03 07:40:16,847 - lava_callback - INFO - Starting async job submit for node 69f458cc2fa6ff8e8ca94f80 2026-05-03 07:40:16,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:40:16,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f458cc2fa6ff8e8ca94f80 HTTP/1.1" 200 None 2026-05-03 07:40:16,861 - lava_callback - DEBUG - Processing node 69f458cc2fa6ff8e8ca94f80: baseline-arm64-clabbe 2026-05-03 07:40:16,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f458cc2fa6ff8e8ca94f80 2026-05-03 07:40:16,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:40:16,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f458cc2fa6ff8e8ca94f80 HTTP/1.1" 200 None 2026-05-03 07:40:16,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:40:16,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:40:16,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:40:16,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f458cc2fa6ff8e8ca94f80 HTTP/1.1" 200 None 2026-05-03 07:40:16,911 - lava_callback - ERROR - Error processing callback for node 69f458cc2fa6ff8e8ca94f80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40258 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:41:16,886 - lava_callback - INFO - Received callback for node 69f459172fa6ff8e8ca94fb1 INFO: 172.20.0.1:40264 - "POST /node/69f459172fa6ff8e8ca94fb1 HTTP/1.0" 202 Accepted 2026-05-03 07:41:16,893 - lava_callback - INFO - Starting async job submit for node 69f459172fa6ff8e8ca94fb1 2026-05-03 07:41:16,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:41:16,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f459172fa6ff8e8ca94fb1 HTTP/1.1" 200 None 2026-05-03 07:41:16,917 - lava_callback - DEBUG - Processing node 69f459172fa6ff8e8ca94fb1: baseline-arm64-clabbe 2026-05-03 07:41:16,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f459172fa6ff8e8ca94fb1 2026-05-03 07:41:16,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:41:16,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f459172fa6ff8e8ca94fb1 HTTP/1.1" 200 None 2026-05-03 07:41:16,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:41:16,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f14e391c6f6c1a9f7050cf HTTP/1.1" 200 None 2026-05-03 07:41:16,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:41:16,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f459172fa6ff8e8ca94fb1 HTTP/1.1" 200 None 2026-05-03 07:41:16,996 - lava_callback - ERROR - Error processing callback for node 69f459172fa6ff8e8ca94fb1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43650 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:42:36,979 - lava_callback - INFO - Received callback for node 69f459622fa6ff8e8ca94fcd INFO: 172.20.0.1:43660 - "POST /node/69f459622fa6ff8e8ca94fcd HTTP/1.0" 202 Accepted 2026-05-03 07:42:36,985 - lava_callback - INFO - Starting async job submit for node 69f459622fa6ff8e8ca94fcd 2026-05-03 07:42:36,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:42:37,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f459622fa6ff8e8ca94fcd HTTP/1.1" 200 None 2026-05-03 07:42:37,010 - lava_callback - DEBUG - Processing node 69f459622fa6ff8e8ca94fcd: baseline-arm64-clabbe 2026-05-03 07:42:37,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f459622fa6ff8e8ca94fcd 2026-05-03 07:42:37,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:42:37,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f459622fa6ff8e8ca94fcd HTTP/1.1" 200 None 2026-05-03 07:42:37,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:42:37,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-03 07:42:37,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:42:37,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f459622fa6ff8e8ca94fcd HTTP/1.1" 200 None 2026-05-03 07:42:37,064 - lava_callback - ERROR - Error processing callback for node 69f459622fa6ff8e8ca94fcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47588 - "GET /node/6993013631166481c8de003a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58710 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:46:17,123 - lava_callback - INFO - Received callback for node 69f45a332fa6ff8e8ca95027 INFO: 172.20.0.1:58716 - "POST /node/69f45a332fa6ff8e8ca95027 HTTP/1.0" 202 Accepted 2026-05-03 07:46:17,128 - lava_callback - INFO - Starting async job submit for node 69f45a332fa6ff8e8ca95027 2026-05-03 07:46:17,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:46:17,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45a332fa6ff8e8ca95027 HTTP/1.1" 200 None 2026-05-03 07:46:17,144 - lava_callback - DEBUG - Processing node 69f45a332fa6ff8e8ca95027: baseline-arm-clabbe 2026-05-03 07:46:17,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f45a332fa6ff8e8ca95027 2026-05-03 07:46:17,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:46:17,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45a332fa6ff8e8ca95027 HTTP/1.1" 200 None 2026-05-03 07:46:17,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:46:17,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 07:46:17,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:46:17,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f45a332fa6ff8e8ca95027 HTTP/1.1" 200 None 2026-05-03 07:46:17,192 - lava_callback - ERROR - Error processing callback for node 69f45a332fa6ff8e8ca95027: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48532 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:46:37,067 - lava_callback - INFO - Received callback for node 69f45a5a2fa6ff8e8ca95035 INFO: 172.20.0.1:48536 - "POST /node/69f45a5a2fa6ff8e8ca95035 HTTP/1.0" 202 Accepted 2026-05-03 07:46:37,072 - lava_callback - INFO - Starting async job submit for node 69f45a5a2fa6ff8e8ca95035 2026-05-03 07:46:37,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:46:37,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45a5a2fa6ff8e8ca95035 HTTP/1.1" 200 None 2026-05-03 07:46:37,093 - lava_callback - DEBUG - Processing node 69f45a5a2fa6ff8e8ca95035: baseline-arm-clabbe 2026-05-03 07:46:37,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f45a5a2fa6ff8e8ca95035 2026-05-03 07:46:37,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:46:37,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45a5a2fa6ff8e8ca95035 HTTP/1.1" 200 None 2026-05-03 07:46:37,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:46:37,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 07:46:37,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:46:37,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f45a5a2fa6ff8e8ca95035 HTTP/1.1" 200 None 2026-05-03 07:46:37,144 - lava_callback - ERROR - Error processing callback for node 69f45a5a2fa6ff8e8ca95035: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35566 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:47:17,188 - lava_callback - INFO - Received callback for node 69f45a812fa6ff8e8ca95043 INFO: 172.20.0.1:35580 - "POST /node/69f45a812fa6ff8e8ca95043 HTTP/1.0" 202 Accepted 2026-05-03 07:47:17,193 - lava_callback - INFO - Starting async job submit for node 69f45a812fa6ff8e8ca95043 2026-05-03 07:47:17,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:47:17,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45a812fa6ff8e8ca95043 HTTP/1.1" 200 None 2026-05-03 07:47:17,213 - lava_callback - DEBUG - Processing node 69f45a812fa6ff8e8ca95043: baseline-arm-clabbe 2026-05-03 07:47:17,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f45a812fa6ff8e8ca95043 2026-05-03 07:47:17,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:47:17,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45a812fa6ff8e8ca95043 HTTP/1.1" 200 None 2026-05-03 07:47:17,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:47:17,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 07:47:17,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:47:17,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f45a812fa6ff8e8ca95043 HTTP/1.1" 200 None 2026-05-03 07:47:17,262 - lava_callback - ERROR - Error processing callback for node 69f45a812fa6ff8e8ca95043: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54586 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:47:57,116 - lava_callback - INFO - Received callback for node 69f45aa82fa6ff8e8ca9504f INFO: 172.20.0.1:54592 - "POST /node/69f45aa82fa6ff8e8ca9504f HTTP/1.0" 202 Accepted 2026-05-03 07:47:57,121 - lava_callback - INFO - Starting async job submit for node 69f45aa82fa6ff8e8ca9504f 2026-05-03 07:47:57,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:47:57,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45aa82fa6ff8e8ca9504f HTTP/1.1" 200 None 2026-05-03 07:47:57,136 - lava_callback - DEBUG - Processing node 69f45aa82fa6ff8e8ca9504f: baseline-arm-clabbe 2026-05-03 07:47:57,136 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f45aa82fa6ff8e8ca9504f 2026-05-03 07:47:57,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:47:57,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45aa82fa6ff8e8ca9504f HTTP/1.1" 200 None 2026-05-03 07:47:57,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:47:57,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 07:47:57,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:47:57,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f45aa82fa6ff8e8ca9504f HTTP/1.1" 200 None 2026-05-03 07:47:57,180 - lava_callback - ERROR - Error processing callback for node 69f45aa82fa6ff8e8ca9504f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50802 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:48:37,220 - lava_callback - INFO - Received callback for node 69f45ad12fa6ff8e8ca9505d INFO: 172.20.0.1:50810 - "POST /node/69f45ad12fa6ff8e8ca9505d HTTP/1.0" 202 Accepted 2026-05-03 07:48:37,227 - lava_callback - INFO - Starting async job submit for node 69f45ad12fa6ff8e8ca9505d 2026-05-03 07:48:37,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:48:37,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45ad12fa6ff8e8ca9505d HTTP/1.1" 200 None 2026-05-03 07:48:37,245 - lava_callback - DEBUG - Processing node 69f45ad12fa6ff8e8ca9505d: baseline-arm-clabbe 2026-05-03 07:48:37,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f45ad12fa6ff8e8ca9505d 2026-05-03 07:48:37,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:48:37,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45ad12fa6ff8e8ca9505d HTTP/1.1" 200 None 2026-05-03 07:48:37,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:48:37,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 07:48:37,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:48:37,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f45ad12fa6ff8e8ca9505d HTTP/1.1" 200 None 2026-05-03 07:48:37,298 - lava_callback - ERROR - Error processing callback for node 69f45ad12fa6ff8e8ca9505d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50950 - "GET /node/691091bf8b15debe9dd50b83%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58202 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:49:17,187 - lava_callback - INFO - Received callback for node 69f45af72fa6ff8e8ca9506b INFO: 172.20.0.1:58208 - "POST /node/69f45af72fa6ff8e8ca9506b HTTP/1.0" 202 Accepted 2026-05-03 07:49:17,192 - lava_callback - INFO - Starting async job submit for node 69f45af72fa6ff8e8ca9506b 2026-05-03 07:49:17,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:49:17,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45af72fa6ff8e8ca9506b HTTP/1.1" 200 None 2026-05-03 07:49:17,207 - lava_callback - DEBUG - Processing node 69f45af72fa6ff8e8ca9506b: baseline-arm-clabbe 2026-05-03 07:49:17,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f45af72fa6ff8e8ca9506b 2026-05-03 07:49:17,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:49:17,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45af72fa6ff8e8ca9506b HTTP/1.1" 200 None 2026-05-03 07:49:17,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:49:17,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 07:49:17,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:49:17,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f45af72fa6ff8e8ca9506b HTTP/1.1" 200 None 2026-05-03 07:49:17,258 - lava_callback - ERROR - Error processing callback for node 69f45af72fa6ff8e8ca9506b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46458 - "GET /node/69f1f44699260e7077310f2c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42350 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:49:57,239 - lava_callback - INFO - Received callback for node 69f45b1e2fa6ff8e8ca95075 INFO: 172.20.0.1:42362 - "POST /node/69f45b1e2fa6ff8e8ca95075 HTTP/1.0" 202 Accepted 2026-05-03 07:49:57,245 - lava_callback - INFO - Starting async job submit for node 69f45b1e2fa6ff8e8ca95075 2026-05-03 07:49:57,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:49:57,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45b1e2fa6ff8e8ca95075 HTTP/1.1" 200 None 2026-05-03 07:49:57,295 - lava_callback - DEBUG - Processing node 69f45b1e2fa6ff8e8ca95075: baseline-arm-clabbe 2026-05-03 07:49:57,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f45b1e2fa6ff8e8ca95075 2026-05-03 07:49:57,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:49:57,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45b1e2fa6ff8e8ca95075 HTTP/1.1" 200 None 2026-05-03 07:49:57,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:49:57,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 07:49:57,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:49:57,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f45b1e2fa6ff8e8ca95075 HTTP/1.1" 200 None 2026-05-03 07:49:57,348 - lava_callback - ERROR - Error processing callback for node 69f45b1e2fa6ff8e8ca95075: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33242 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:50:37,242 - lava_callback - INFO - Received callback for node 69f45b442fa6ff8e8ca95083 INFO: 172.20.0.1:33254 - "POST /node/69f45b442fa6ff8e8ca95083 HTTP/1.0" 202 Accepted 2026-05-03 07:50:37,247 - lava_callback - INFO - Starting async job submit for node 69f45b442fa6ff8e8ca95083 2026-05-03 07:50:37,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:50:37,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45b442fa6ff8e8ca95083 HTTP/1.1" 200 None 2026-05-03 07:50:37,262 - lava_callback - DEBUG - Processing node 69f45b442fa6ff8e8ca95083: baseline-arm-clabbe 2026-05-03 07:50:37,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f45b442fa6ff8e8ca95083 2026-05-03 07:50:37,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:50:37,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45b442fa6ff8e8ca95083 HTTP/1.1" 200 None 2026-05-03 07:50:37,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:50:37,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 07:50:37,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:50:37,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f45b442fa6ff8e8ca95083 HTTP/1.1" 200 None 2026-05-03 07:50:37,308 - lava_callback - ERROR - Error processing callback for node 69f45b442fa6ff8e8ca95083: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35120 - "GET / HTTP/1.0" 200 OK 2026-05-03 07:51:17,289 - lava_callback - INFO - Received callback for node 69f45b6c2fa6ff8e8ca9508f INFO: 172.20.0.1:35136 - "POST /node/69f45b6c2fa6ff8e8ca9508f HTTP/1.0" 202 Accepted 2026-05-03 07:51:17,295 - lava_callback - INFO - Starting async job submit for node 69f45b6c2fa6ff8e8ca9508f 2026-05-03 07:51:17,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:51:17,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45b6c2fa6ff8e8ca9508f HTTP/1.1" 200 None 2026-05-03 07:51:17,315 - lava_callback - DEBUG - Processing node 69f45b6c2fa6ff8e8ca9508f: baseline-arm-clabbe 2026-05-03 07:51:17,315 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f45b6c2fa6ff8e8ca9508f 2026-05-03 07:51:17,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:51:17,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f45b6c2fa6ff8e8ca9508f HTTP/1.1" 200 None 2026-05-03 07:51:17,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:51:17,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-03 07:51:17,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-03 07:51:17,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f45b6c2fa6ff8e8ca9508f HTTP/1.1" 200 None 2026-05-03 07:51:17,363 - lava_callback - ERROR - Error processing callback for node 69f45b6c2fa6ff8e8ca9508f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42918 - "GET /node/6966e5e58f1d1c3c8eaac978%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51066 - "GET /node/699434e55ae459b9df3d3b39%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50484 - "GET /node/69deded0f490930782fb7234%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]