INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:45722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59542 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:13:25,850 - lava_callback - INFO - Received callback for node 69d2199aaa48d6fae7bb3dc4 2026-04-07 08:13:25,861 - lava_callback - INFO - Starting async job submit for node 69d2199aaa48d6fae7bb3dc4 INFO: 172.20.0.1:58278 - "POST /node/69d2199aaa48d6fae7bb3dc4 HTTP/1.0" 202 Accepted 2026-04-07 08:13:25,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:13:25,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2199aaa48d6fae7bb3dc4 HTTP/1.1" 200 None 2026-04-07 08:13:25,883 - lava_callback - DEBUG - Processing node 69d2199aaa48d6fae7bb3dc4: baseline-arm64-clabbe 2026-04-07 08:13:25,884 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2199aaa48d6fae7bb3dc4 2026-04-07 08:13:25,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:13:25,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2199aaa48d6fae7bb3dc4 HTTP/1.1" 200 None 2026-04-07 08:13:25,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:13:25,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 08:13:25,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:13:25,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2199aaa48d6fae7bb3dc4 HTTP/1.1" 200 None 2026-04-07 08:13:25,977 - lava_callback - ERROR - Error processing callback for node 69d2199aaa48d6fae7bb3dc4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60474 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:15:25,959 - lava_callback - INFO - Received callback for node 69d21a090d94ee66016fb0c9 INFO: 172.20.0.1:57498 - "POST /node/69d21a090d94ee66016fb0c9 HTTP/1.0" 202 Accepted 2026-04-07 08:15:25,967 - lava_callback - INFO - Starting async job submit for node 69d21a090d94ee66016fb0c9 2026-04-07 08:15:25,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:15:25,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a090d94ee66016fb0c9 HTTP/1.1" 200 None 2026-04-07 08:15:25,991 - lava_callback - DEBUG - Processing node 69d21a090d94ee66016fb0c9: baseline-arm64-clabbe 2026-04-07 08:15:25,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21a090d94ee66016fb0c9 2026-04-07 08:15:25,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:15:26,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a090d94ee66016fb0c9 HTTP/1.1" 200 None 2026-04-07 08:15:26,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:15:26,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 08:15:26,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:15:26,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21a090d94ee66016fb0c9 HTTP/1.1" 200 None 2026-04-07 08:15:26,070 - lava_callback - ERROR - Error processing callback for node 69d21a090d94ee66016fb0c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56186 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:16:25,990 - lava_callback - INFO - Received callback for node 69d21a4c0d94ee66016fb100 INFO: 172.20.0.1:38610 - "POST /node/69d21a4c0d94ee66016fb100 HTTP/1.0" 202 Accepted 2026-04-07 08:16:25,997 - lava_callback - INFO - Starting async job submit for node 69d21a4c0d94ee66016fb100 2026-04-07 08:16:25,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:16:26,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a4c0d94ee66016fb100 HTTP/1.1" 200 None 2026-04-07 08:16:26,015 - lava_callback - DEBUG - Processing node 69d21a4c0d94ee66016fb100: baseline-arm64-clabbe 2026-04-07 08:16:26,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21a4c0d94ee66016fb100 2026-04-07 08:16:26,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:16:26,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a4c0d94ee66016fb100 HTTP/1.1" 200 None 2026-04-07 08:16:26,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:16:26,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 08:16:26,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:16:26,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21a4c0d94ee66016fb100 HTTP/1.1" 200 None 2026-04-07 08:16:26,083 - lava_callback - ERROR - Error processing callback for node 69d21a4c0d94ee66016fb100: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37852 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:18:06,060 - lava_callback - INFO - Received callback for node 69d21abb0d94ee66016fb15d INFO: 172.20.0.1:51512 - "POST /node/69d21abb0d94ee66016fb15d HTTP/1.0" 202 Accepted 2026-04-07 08:18:06,065 - lava_callback - INFO - Starting async job submit for node 69d21abb0d94ee66016fb15d 2026-04-07 08:18:06,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:18:06,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21abb0d94ee66016fb15d HTTP/1.1" 200 None 2026-04-07 08:18:06,081 - lava_callback - DEBUG - Processing node 69d21abb0d94ee66016fb15d: baseline-arm64-clabbe 2026-04-07 08:18:06,081 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21abb0d94ee66016fb15d 2026-04-07 08:18:06,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:18:06,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21abb0d94ee66016fb15d HTTP/1.1" 200 None 2026-04-07 08:18:06,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:18:06,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 08:18:06,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:18:06,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21abb0d94ee66016fb15d HTTP/1.1" 200 None 2026-04-07 08:18:06,141 - lava_callback - ERROR - Error processing callback for node 69d21abb0d94ee66016fb15d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51528 - "GET /node/693e4a03407f32424eb5fdf0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51532 - "GET /node/698fc55776d4b6342e9d70e1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60890 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:19:26,140 - lava_callback - INFO - Received callback for node 69d21b020d94ee66016fb1b4 INFO: 172.20.0.1:34894 - "POST /node/69d21b020d94ee66016fb1b4 HTTP/1.0" 202 Accepted 2026-04-07 08:19:26,149 - lava_callback - INFO - Starting async job submit for node 69d21b020d94ee66016fb1b4 2026-04-07 08:19:26,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:19:26,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21b020d94ee66016fb1b4 HTTP/1.1" 200 None 2026-04-07 08:19:26,175 - lava_callback - DEBUG - Processing node 69d21b020d94ee66016fb1b4: baseline-arm64-clabbe 2026-04-07 08:19:26,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21b020d94ee66016fb1b4 2026-04-07 08:19:26,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:19:26,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21b020d94ee66016fb1b4 HTTP/1.1" 200 None 2026-04-07 08:19:26,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:19:26,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 08:19:26,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:19:26,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21b020d94ee66016fb1b4 HTTP/1.1" 200 None 2026-04-07 08:19:26,250 - lava_callback - ERROR - Error processing callback for node 69d21b020d94ee66016fb1b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37184 - "GET /node/693afd1efee8383e92b6dc7a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34778 - "GET /node/698f5cda3013abef95cf8c18%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-07 08:20:46,162 - lava_callback - INFO - Received callback for node 69d21b4c0d94ee66016fb1d2 INFO: 172.20.0.1:34792 - "POST /node/69d21b4c0d94ee66016fb1d2 HTTP/1.0" 202 Accepted 2026-04-07 08:20:46,168 - lava_callback - INFO - Starting async job submit for node 69d21b4c0d94ee66016fb1d2 2026-04-07 08:20:46,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:20:46,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21b4c0d94ee66016fb1d2 HTTP/1.1" 200 None 2026-04-07 08:20:46,184 - lava_callback - DEBUG - Processing node 69d21b4c0d94ee66016fb1d2: baseline-arm64-clabbe 2026-04-07 08:20:46,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21b4c0d94ee66016fb1d2 2026-04-07 08:20:46,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:20:46,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21b4c0d94ee66016fb1d2 HTTP/1.1" 200 None 2026-04-07 08:20:46,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:20:46,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 08:20:46,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:20:46,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21b4c0d94ee66016fb1d2 HTTP/1.1" 200 None 2026-04-07 08:20:46,248 - lava_callback - ERROR - Error processing callback for node 69d21b4c0d94ee66016fb1d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54880 - "GET /node/69903d7b985e4efca431e2f3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54888 - "GET /node/6986fd536e077e4126a7d854%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49432 - "GET /node/695323d431522df6df79b38f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49436 - "GET /node/694a21fe2060d3d847920ee9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38156 - "GET /node/698a84d6d9a1cfa777a23baf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38162 - "GET /node/69840be2969566dcb0d2bc3e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41562 - "GET /node/6992f07b31166481c8ddaa65%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41566 - "GET /node/6993795acebe99dd8e06b4ee%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45456 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:34:06,712 - lava_callback - INFO - Received callback for node 69d4c0fb932ecfe2320a1231 INFO: 172.20.0.1:45472 - "POST /node/69d4c0fb932ecfe2320a1231 HTTP/1.0" 202 Accepted 2026-04-07 08:34:06,718 - lava_callback - INFO - Starting async job submit for node 69d4c0fb932ecfe2320a1231 2026-04-07 08:34:06,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:34:06,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c0fb932ecfe2320a1231 HTTP/1.1" 200 None 2026-04-07 08:34:06,756 - lava_callback - DEBUG - Processing node 69d4c0fb932ecfe2320a1231: baseline-arm 2026-04-07 08:34:06,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:34:07,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:34:07,108 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c0fb932ecfe2320a1231/log.txt.gz 2026-04-07 08:34:07,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:34:07,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:34:07,452 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c0fb932ecfe2320a1231/lava-logs.yaml 2026-04-07 08:34:07,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:34:07,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:34:07,619 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c0fb932ecfe2320a1231/lava_callback.json.gz 2026-04-07 08:34:07,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:34:07,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c0fb932ecfe2320a1231 HTTP/1.1" 200 None 2026-04-07 08:34:07,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:34:07,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd70932ecfe2320a1012 HTTP/1.1" 200 None 2026-04-07 08:34:07,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:34:07,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c0fb932ecfe2320a1231 HTTP/1.1" 200 None 2026-04-07 08:34:07,728 - lava_callback - INFO - Completed processing callback for node 69d4c0fb932ecfe2320a1231 INFO: 172.20.0.1:50272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50286 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:34:25,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:34:26,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36940 - "GET /node/69927a9498a8bdb31c394594%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36954 - "GET /node/698a40c822b4cc0f227b05b9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59314 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:36:48,612 - lava_callback - INFO - Received callback for node 69d4c219932ecfe2320a1258 INFO: 172.20.0.1:59326 - "POST /node/69d4c219932ecfe2320a1258 HTTP/1.0" 202 Accepted 2026-04-07 08:36:48,618 - lava_callback - INFO - Starting async job submit for node 69d4c219932ecfe2320a1258 2026-04-07 08:36:48,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:36:48,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c219932ecfe2320a1258 HTTP/1.1" 200 None 2026-04-07 08:36:48,638 - lava_callback - DEBUG - Processing node 69d4c219932ecfe2320a1258: baseline-arm 2026-04-07 08:36:48,644 - lava_callback - WARNING - Failed to upload log 2026-04-07 08:36:48,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:36:48,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:36:48,795 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c219932ecfe2320a1258/lava-logs.yaml 2026-04-07 08:36:48,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:36:48,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:36:48,927 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c219932ecfe2320a1258/lava_callback.json.gz 2026-04-07 08:36:48,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:36:48,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c219932ecfe2320a1258 HTTP/1.1" 200 None 2026-04-07 08:36:48,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:36:48,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:36:48,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:36:48,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c219932ecfe2320a1258 HTTP/1.1" 200 None 2026-04-07 08:36:48,997 - lava_callback - INFO - Completed processing callback for node 69d4c219932ecfe2320a1258 2026-04-07 08:36:56,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:36:56,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48980 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:37:14,823 - lava_callback - INFO - Received callback for node 69d4c221932ecfe2320a126c INFO: 172.20.0.1:39486 - "POST /node/69d4c221932ecfe2320a126c HTTP/1.0" 202 Accepted 2026-04-07 08:37:14,829 - lava_callback - INFO - Starting async job submit for node 69d4c221932ecfe2320a126c 2026-04-07 08:37:14,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:14,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c221932ecfe2320a126c HTTP/1.1" 200 None 2026-04-07 08:37:14,855 - lava_callback - DEBUG - Processing node 69d4c221932ecfe2320a126c: baseline-arm 2026-04-07 08:37:14,864 - lava_callback - WARNING - Failed to upload log 2026-04-07 08:37:14,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:37:15,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:37:15,041 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c221932ecfe2320a126c/lava-logs.yaml 2026-04-07 08:37:15,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:39498 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 08:37:15,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:37:15,209 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c221932ecfe2320a126c/lava_callback.json.gz 2026-04-07 08:37:15,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:15,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c221932ecfe2320a126c HTTP/1.1" 200 None 2026-04-07 08:37:15,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:15,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:37:15,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:15,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c221932ecfe2320a126c HTTP/1.1" 200 None 2026-04-07 08:37:15,292 - lava_callback - INFO - Completed processing callback for node 69d4c221932ecfe2320a126c INFO: 172.20.0.1:39510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39520 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:37:26,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:26,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35504 - "GET /node/699197ba10b45da7d7d11e2a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57454 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:37:37,666 - lava_callback - INFO - Received callback for node 69d4c21a932ecfe2320a125b INFO: 172.20.0.1:57470 - "POST /node/69d4c21a932ecfe2320a125b HTTP/1.0" 202 Accepted 2026-04-07 08:37:37,714 - lava_callback - INFO - Starting async job submit for node 69d4c21a932ecfe2320a125b 2026-04-07 08:37:37,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:37,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c21a932ecfe2320a125b HTTP/1.1" 200 None 2026-04-07 08:37:37,755 - lava_callback - DEBUG - Processing node 69d4c21a932ecfe2320a125b: baseline-arm 2026-04-07 08:37:37,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:37:38,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:37:38,023 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c21a932ecfe2320a125b/log.txt.gz 2026-04-07 08:37:38,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:37:38,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:37:38,279 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c21a932ecfe2320a125b/lava-logs.yaml 2026-04-07 08:37:38,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:37:38,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:37:38,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c21a932ecfe2320a125b/lava_callback.json.gz 2026-04-07 08:37:38,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:38,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c21a932ecfe2320a125b HTTP/1.1" 200 None 2026-04-07 08:37:38,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:38,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:37:38,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:38,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c21a932ecfe2320a125b HTTP/1.1" 200 None 2026-04-07 08:37:38,512 - lava_callback - INFO - Completed processing callback for node 69d4c21a932ecfe2320a125b 2026-04-07 08:37:44,169 - lava_callback - INFO - Received callback for node 69d4c21d932ecfe2320a1264 INFO: 172.20.0.1:53510 - "POST /node/69d4c21d932ecfe2320a1264 HTTP/1.0" 202 Accepted 2026-04-07 08:37:44,218 - lava_callback - INFO - Starting async job submit for node 69d4c21d932ecfe2320a1264 2026-04-07 08:37:44,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:44,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c21d932ecfe2320a1264 HTTP/1.1" 200 None 2026-04-07 08:37:44,262 - lava_callback - DEBUG - Processing node 69d4c21d932ecfe2320a1264: baseline-arm 2026-04-07 08:37:44,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:37:44,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:37:44,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c21d932ecfe2320a1264/log.txt.gz 2026-04-07 08:37:44,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:37:44,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:37:44,840 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c21d932ecfe2320a1264/lava-logs.yaml 2026-04-07 08:37:44,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:37:44,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:37:44,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c21d932ecfe2320a1264/lava_callback.json.gz 2026-04-07 08:37:45,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:45,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c21d932ecfe2320a1264 HTTP/1.1" 200 None 2026-04-07 08:37:45,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:45,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:37:45,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:45,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c21d932ecfe2320a1264 HTTP/1.1" 200 None 2026-04-07 08:37:45,084 - lava_callback - INFO - Completed processing callback for node 69d4c21d932ecfe2320a1264 INFO: 172.20.0.1:53520 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:37:56,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:37:56,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36004 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:38:13,062 - lava_callback - INFO - Received callback for node 69d21f680d94ee66016fb441 INFO: 172.20.0.1:34326 - "POST /node/69d21f680d94ee66016fb441 HTTP/1.0" 202 Accepted 2026-04-07 08:38:13,069 - lava_callback - INFO - Starting async job submit for node 69d21f680d94ee66016fb441 2026-04-07 08:38:13,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:13,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f680d94ee66016fb441 HTTP/1.1" 200 None 2026-04-07 08:38:13,086 - lava_callback - DEBUG - Processing node 69d21f680d94ee66016fb441: baseline-arm-baylibre 2026-04-07 08:38:13,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f680d94ee66016fb441 2026-04-07 08:38:13,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:13,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f680d94ee66016fb441 HTTP/1.1" 200 None 2026-04-07 08:38:13,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:13,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:13,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:13,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f680d94ee66016fb441 HTTP/1.1" 200 None 2026-04-07 08:38:13,155 - lava_callback - ERROR - Error processing callback for node 69d21f680d94ee66016fb441: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:13,725 - lava_callback - INFO - Received callback for node 69d21f690d94ee66016fb444 INFO: 172.20.0.1:34338 - "POST /node/69d21f690d94ee66016fb444 HTTP/1.0" 202 Accepted 2026-04-07 08:38:13,731 - lava_callback - INFO - Starting async job submit for node 69d21f690d94ee66016fb444 2026-04-07 08:38:13,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:13,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f690d94ee66016fb444 HTTP/1.1" 200 None 2026-04-07 08:38:13,751 - lava_callback - DEBUG - Processing node 69d21f690d94ee66016fb444: baseline-arm-baylibre 2026-04-07 08:38:13,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f690d94ee66016fb444 2026-04-07 08:38:13,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:13,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f690d94ee66016fb444 HTTP/1.1" 200 None 2026-04-07 08:38:13,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:13,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:13,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:13,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f690d94ee66016fb444 HTTP/1.1" 200 None 2026-04-07 08:38:13,837 - lava_callback - ERROR - Error processing callback for node 69d21f690d94ee66016fb444: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:13,856 - lava_callback - INFO - Received callback for node 69d4c218932ecfe2320a1255 INFO: 172.20.0.1:34348 - "POST /node/69d4c218932ecfe2320a1255 HTTP/1.0" 202 Accepted 2026-04-07 08:38:13,905 - lava_callback - INFO - Starting async job submit for node 69d4c218932ecfe2320a1255 2026-04-07 08:38:13,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:13,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c218932ecfe2320a1255 HTTP/1.1" 200 None 2026-04-07 08:38:13,987 - lava_callback - DEBUG - Processing node 69d4c218932ecfe2320a1255: baseline-arm 2026-04-07 08:38:14,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:14,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:14,371 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c218932ecfe2320a1255/log.txt.gz 2026-04-07 08:38:14,394 - lava_callback - INFO - Received callback for node 69d21f6b0d94ee66016fb447 2026-04-07 08:38:14,409 - lava_callback - INFO - Starting async job submit for node 69d21f6b0d94ee66016fb447 INFO: 172.20.0.1:34354 - "POST /node/69d21f6b0d94ee66016fb447 HTTP/1.0" 202 Accepted 2026-04-07 08:38:14,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:14,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f6b0d94ee66016fb447 HTTP/1.1" 200 None 2026-04-07 08:38:14,498 - lava_callback - DEBUG - Processing node 69d21f6b0d94ee66016fb447: baseline-arm-baylibre 2026-04-07 08:38:14,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f6b0d94ee66016fb447 2026-04-07 08:38:14,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:14,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:14,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f6b0d94ee66016fb447 HTTP/1.1" 200 None 2026-04-07 08:38:14,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:14,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:14,714 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c218932ecfe2320a1255/lava-logs.yaml 2026-04-07 08:38:14,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:14,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:14,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:14,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f6b0d94ee66016fb447 HTTP/1.1" 200 None 2026-04-07 08:38:14,765 - lava_callback - ERROR - Error processing callback for node 69d21f6b0d94ee66016fb447: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:14,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:14,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c218932ecfe2320a1255/lava_callback.json.gz 2026-04-07 08:38:14,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:14,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c218932ecfe2320a1255 HTTP/1.1" 200 None 2026-04-07 08:38:14,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:15,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:38:15,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:15,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c218932ecfe2320a1255 HTTP/1.1" 200 None 2026-04-07 08:38:15,059 - lava_callback - INFO - Completed processing callback for node 69d4c218932ecfe2320a1255 2026-04-07 08:38:15,105 - lava_callback - INFO - Received callback for node 69d21f6c0d94ee66016fb44c INFO: 172.20.0.1:34356 - "POST /node/69d21f6c0d94ee66016fb44c HTTP/1.0" 202 Accepted 2026-04-07 08:38:15,115 - lava_callback - INFO - Starting async job submit for node 69d21f6c0d94ee66016fb44c 2026-04-07 08:38:15,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:15,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f6c0d94ee66016fb44c HTTP/1.1" 200 None 2026-04-07 08:38:15,145 - lava_callback - DEBUG - Processing node 69d21f6c0d94ee66016fb44c: baseline-arm-baylibre 2026-04-07 08:38:15,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f6c0d94ee66016fb44c 2026-04-07 08:38:15,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:15,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f6c0d94ee66016fb44c HTTP/1.1" 200 None INFO: 172.20.0.1:34366 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 08:38:15,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:15,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:15,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:15,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f6c0d94ee66016fb44c HTTP/1.1" 200 None 2026-04-07 08:38:15,212 - lava_callback - ERROR - Error processing callback for node 69d21f6c0d94ee66016fb44c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:15,795 - lava_callback - INFO - Received callback for node 69d21f700d94ee66016fb459 INFO: 172.20.0.1:34374 - "POST /node/69d21f700d94ee66016fb459 HTTP/1.0" 202 Accepted 2026-04-07 08:38:15,801 - lava_callback - INFO - Starting async job submit for node 69d21f700d94ee66016fb459 2026-04-07 08:38:15,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:15,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f700d94ee66016fb459 HTTP/1.1" 200 None 2026-04-07 08:38:15,826 - lava_callback - DEBUG - Processing node 69d21f700d94ee66016fb459: baseline-arm-baylibre 2026-04-07 08:38:15,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f700d94ee66016fb459 2026-04-07 08:38:15,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:15,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f700d94ee66016fb459 HTTP/1.1" 200 None 2026-04-07 08:38:15,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:15,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:15,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:15,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f700d94ee66016fb459 HTTP/1.1" 200 None 2026-04-07 08:38:15,886 - lava_callback - ERROR - Error processing callback for node 69d21f700d94ee66016fb459: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:16,481 - lava_callback - INFO - Received callback for node 69d21f720d94ee66016fb45e INFO: 172.20.0.1:34376 - "POST /node/69d21f720d94ee66016fb45e HTTP/1.0" 202 Accepted 2026-04-07 08:38:16,487 - lava_callback - INFO - Starting async job submit for node 69d21f720d94ee66016fb45e 2026-04-07 08:38:16,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:16,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f720d94ee66016fb45e HTTP/1.1" 200 None 2026-04-07 08:38:16,504 - lava_callback - DEBUG - Processing node 69d21f720d94ee66016fb45e: baseline-arm-baylibre 2026-04-07 08:38:16,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f720d94ee66016fb45e 2026-04-07 08:38:16,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:16,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f720d94ee66016fb45e HTTP/1.1" 200 None INFO: 172.20.0.1:34382 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:38:16,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:16,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:16,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:16,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f720d94ee66016fb45e HTTP/1.1" 200 None 2026-04-07 08:38:16,563 - lava_callback - ERROR - Error processing callback for node 69d21f720d94ee66016fb45e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34390 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:38:25,948 - lava_callback - INFO - Received callback for node 69d4c22b932ecfe2320a129c INFO: 172.20.0.1:53386 - "POST /node/69d4c22b932ecfe2320a129c HTTP/1.0" 202 Accepted 2026-04-07 08:38:25,954 - lava_callback - INFO - Starting async job submit for node 69d4c22b932ecfe2320a129c 2026-04-07 08:38:25,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:25,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c22b932ecfe2320a129c HTTP/1.1" 200 None 2026-04-07 08:38:25,993 - lava_callback - DEBUG - Processing node 69d4c22b932ecfe2320a129c: baseline-arm-broonie 2026-04-07 08:38:26,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:26,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 08:38:26,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:26,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:26,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4c22b932ecfe2320a129c/log.txt.gz INFO: 172.20.0.1:53402 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:38:26,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:26,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:26,864 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4c22b932ecfe2320a129c/lava-logs.yaml 2026-04-07 08:38:26,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:26,983 - lava_callback - INFO - Received callback for node 69d21f780d94ee66016fb495 INFO: 172.20.0.1:53410 - "POST /node/69d21f780d94ee66016fb495 HTTP/1.0" 202 Accepted 2026-04-07 08:38:26,990 - lava_callback - INFO - Starting async job submit for node 69d21f780d94ee66016fb495 2026-04-07 08:38:26,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:27,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f780d94ee66016fb495 HTTP/1.1" 200 None 2026-04-07 08:38:27,007 - lava_callback - DEBUG - Processing node 69d21f780d94ee66016fb495: baseline-arm-clabbe 2026-04-07 08:38:27,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f780d94ee66016fb495 2026-04-07 08:38:27,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:27,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f780d94ee66016fb495 HTTP/1.1" 200 None 2026-04-07 08:38:27,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:27,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:27,042 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4c22b932ecfe2320a129c/lava_callback.json.gz 2026-04-07 08:38:27,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:27,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:27,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:27,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c22b932ecfe2320a129c HTTP/1.1" 200 None 2026-04-07 08:38:27,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:27,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f780d94ee66016fb495 HTTP/1.1" 200 None 2026-04-07 08:38:27,108 - lava_callback - ERROR - Error processing callback for node 69d21f780d94ee66016fb495: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:27,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:38:27,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:27,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c22b932ecfe2320a129c HTTP/1.1" 200 None 2026-04-07 08:38:27,201 - lava_callback - INFO - Completed processing callback for node 69d4c22b932ecfe2320a129c 2026-04-07 08:38:27,456 - lava_callback - INFO - Received callback for node 69d4c22c932ecfe2320a129f INFO: 172.20.0.1:53424 - "POST /node/69d4c22c932ecfe2320a129f HTTP/1.0" 202 Accepted 2026-04-07 08:38:27,465 - lava_callback - INFO - Starting async job submit for node 69d4c22c932ecfe2320a129f 2026-04-07 08:38:27,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:27,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c22c932ecfe2320a129f HTTP/1.1" 200 None 2026-04-07 08:38:27,510 - lava_callback - DEBUG - Processing node 69d4c22c932ecfe2320a129f: baseline-arm-broonie 2026-04-07 08:38:27,687 - lava_callback - INFO - Received callback for node 69d21f7a0d94ee66016fb49b INFO: 172.20.0.1:53436 - "POST /node/69d21f7a0d94ee66016fb49b HTTP/1.0" 202 Accepted 2026-04-07 08:38:27,719 - lava_callback - INFO - Starting async job submit for node 69d21f7a0d94ee66016fb49b 2026-04-07 08:38:27,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:27,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:27,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7a0d94ee66016fb49b HTTP/1.1" 200 None 2026-04-07 08:38:27,780 - lava_callback - DEBUG - Processing node 69d21f7a0d94ee66016fb49b: baseline-arm-clabbe 2026-04-07 08:38:27,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f7a0d94ee66016fb49b 2026-04-07 08:38:27,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:27,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7a0d94ee66016fb49b HTTP/1.1" 200 None 2026-04-07 08:38:27,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:27,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:27,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:27,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f7a0d94ee66016fb49b HTTP/1.1" 200 None 2026-04-07 08:38:27,845 - lava_callback - ERROR - Error processing callback for node 69d21f7a0d94ee66016fb49b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:27,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:27,951 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4c22c932ecfe2320a129f/log.txt.gz 2026-04-07 08:38:28,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:28,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:28,324 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4c22c932ecfe2320a129f/lava-logs.yaml 2026-04-07 08:38:28,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:28,416 - lava_callback - INFO - Received callback for node 69d21f7b0d94ee66016fb49f INFO: 172.20.0.1:53448 - "POST /node/69d21f7b0d94ee66016fb49f HTTP/1.0" 202 Accepted 2026-04-07 08:38:28,423 - lava_callback - INFO - Starting async job submit for node 69d21f7b0d94ee66016fb49f 2026-04-07 08:38:28,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:28,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7b0d94ee66016fb49f HTTP/1.1" 200 None 2026-04-07 08:38:28,444 - lava_callback - DEBUG - Processing node 69d21f7b0d94ee66016fb49f: baseline-arm-clabbe 2026-04-07 08:38:28,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f7b0d94ee66016fb49f 2026-04-07 08:38:28,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:28,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7b0d94ee66016fb49f HTTP/1.1" 200 None 2026-04-07 08:38:28,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:28,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:28,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:28,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:28,490 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4c22c932ecfe2320a129f/lava_callback.json.gz 2026-04-07 08:38:28,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:28,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f7b0d94ee66016fb49f HTTP/1.1" 200 None 2026-04-07 08:38:28,541 - lava_callback - ERROR - Error processing callback for node 69d21f7b0d94ee66016fb49f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:28,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c22c932ecfe2320a129f HTTP/1.1" 200 None 2026-04-07 08:38:28,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:28,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:38:28,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:28,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c22c932ecfe2320a129f HTTP/1.1" 200 None 2026-04-07 08:38:28,647 - lava_callback - INFO - Completed processing callback for node 69d4c22c932ecfe2320a129f 2026-04-07 08:38:29,093 - lava_callback - INFO - Received callback for node 69d21f7c0d94ee66016fb4a2 INFO: 172.20.0.1:53454 - "POST /node/69d21f7c0d94ee66016fb4a2 HTTP/1.0" 202 Accepted 2026-04-07 08:38:29,102 - lava_callback - INFO - Starting async job submit for node 69d21f7c0d94ee66016fb4a2 2026-04-07 08:38:29,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:29,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7c0d94ee66016fb4a2 HTTP/1.1" 200 None 2026-04-07 08:38:29,118 - lava_callback - DEBUG - Processing node 69d21f7c0d94ee66016fb4a2: baseline-arm-clabbe 2026-04-07 08:38:29,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f7c0d94ee66016fb4a2 2026-04-07 08:38:29,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:29,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7c0d94ee66016fb4a2 HTTP/1.1" 200 None 2026-04-07 08:38:29,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:29,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:29,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:29,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f7c0d94ee66016fb4a2 HTTP/1.1" 200 None 2026-04-07 08:38:29,202 - lava_callback - ERROR - Error processing callback for node 69d21f7c0d94ee66016fb4a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:29,781 - lava_callback - INFO - Received callback for node 69d21f7d0d94ee66016fb4a5 INFO: 172.20.0.1:34244 - "POST /node/69d21f7d0d94ee66016fb4a5 HTTP/1.0" 202 Accepted 2026-04-07 08:38:29,786 - lava_callback - INFO - Starting async job submit for node 69d21f7d0d94ee66016fb4a5 2026-04-07 08:38:29,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:29,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7d0d94ee66016fb4a5 HTTP/1.1" 200 None 2026-04-07 08:38:29,802 - lava_callback - DEBUG - Processing node 69d21f7d0d94ee66016fb4a5: baseline-arm-clabbe 2026-04-07 08:38:29,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f7d0d94ee66016fb4a5 2026-04-07 08:38:29,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:29,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7d0d94ee66016fb4a5 HTTP/1.1" 200 None 2026-04-07 08:38:29,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:29,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:29,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:29,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f7d0d94ee66016fb4a5 HTTP/1.1" 200 None 2026-04-07 08:38:29,857 - lava_callback - ERROR - Error processing callback for node 69d21f7d0d94ee66016fb4a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:30,476 - lava_callback - INFO - Received callback for node 69d21f7e0d94ee66016fb4a8 INFO: 172.20.0.1:34252 - "POST /node/69d21f7e0d94ee66016fb4a8 HTTP/1.0" 202 Accepted 2026-04-07 08:38:30,482 - lava_callback - INFO - Starting async job submit for node 69d21f7e0d94ee66016fb4a8 2026-04-07 08:38:30,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:30,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7e0d94ee66016fb4a8 HTTP/1.1" 200 None 2026-04-07 08:38:30,498 - lava_callback - DEBUG - Processing node 69d21f7e0d94ee66016fb4a8: baseline-arm-clabbe 2026-04-07 08:38:30,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f7e0d94ee66016fb4a8 2026-04-07 08:38:30,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:30,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7e0d94ee66016fb4a8 HTTP/1.1" 200 None 2026-04-07 08:38:30,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:30,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:30,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:30,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f7e0d94ee66016fb4a8 HTTP/1.1" 200 None 2026-04-07 08:38:30,557 - lava_callback - ERROR - Error processing callback for node 69d21f7e0d94ee66016fb4a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:31,166 - lava_callback - INFO - Received callback for node 69d21f7e0d94ee66016fb4ab INFO: 172.20.0.1:34266 - "POST /node/69d21f7e0d94ee66016fb4ab HTTP/1.0" 202 Accepted 2026-04-07 08:38:31,174 - lava_callback - INFO - Starting async job submit for node 69d21f7e0d94ee66016fb4ab 2026-04-07 08:38:31,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:31,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7e0d94ee66016fb4ab HTTP/1.1" 200 None 2026-04-07 08:38:31,200 - lava_callback - DEBUG - Processing node 69d21f7e0d94ee66016fb4ab: baseline-arm-clabbe 2026-04-07 08:38:31,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f7e0d94ee66016fb4ab 2026-04-07 08:38:31,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:31,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7e0d94ee66016fb4ab HTTP/1.1" 200 None 2026-04-07 08:38:31,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:31,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:31,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:31,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f7e0d94ee66016fb4ab HTTP/1.1" 200 None 2026-04-07 08:38:31,276 - lava_callback - ERROR - Error processing callback for node 69d21f7e0d94ee66016fb4ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:31,876 - lava_callback - INFO - Received callback for node 69d21f7f0d94ee66016fb4ae INFO: 172.20.0.1:34282 - "POST /node/69d21f7f0d94ee66016fb4ae HTTP/1.0" 202 Accepted 2026-04-07 08:38:31,882 - lava_callback - INFO - Starting async job submit for node 69d21f7f0d94ee66016fb4ae 2026-04-07 08:38:31,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:31,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7f0d94ee66016fb4ae HTTP/1.1" 200 None 2026-04-07 08:38:31,898 - lava_callback - DEBUG - Processing node 69d21f7f0d94ee66016fb4ae: baseline-arm-clabbe 2026-04-07 08:38:31,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f7f0d94ee66016fb4ae 2026-04-07 08:38:31,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:31,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f7f0d94ee66016fb4ae HTTP/1.1" 200 None 2026-04-07 08:38:31,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:31,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:31,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:31,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f7f0d94ee66016fb4ae HTTP/1.1" 200 None 2026-04-07 08:38:31,962 - lava_callback - ERROR - Error processing callback for node 69d21f7f0d94ee66016fb4ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:32,549 - lava_callback - INFO - Received callback for node 69d21f800d94ee66016fb4b1 INFO: 172.20.0.1:34290 - "POST /node/69d21f800d94ee66016fb4b1 HTTP/1.0" 202 Accepted 2026-04-07 08:38:32,556 - lava_callback - INFO - Starting async job submit for node 69d21f800d94ee66016fb4b1 2026-04-07 08:38:32,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:32,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f800d94ee66016fb4b1 HTTP/1.1" 200 None 2026-04-07 08:38:32,578 - lava_callback - DEBUG - Processing node 69d21f800d94ee66016fb4b1: baseline-arm-clabbe 2026-04-07 08:38:32,578 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21f800d94ee66016fb4b1 2026-04-07 08:38:32,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:32,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f800d94ee66016fb4b1 HTTP/1.1" 200 None 2026-04-07 08:38:32,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:32,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 08:38:32,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:32,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f800d94ee66016fb4b1 HTTP/1.1" 200 None 2026-04-07 08:38:32,652 - lava_callback - ERROR - Error processing callback for node 69d21f800d94ee66016fb4b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:38:34,973 - lava_callback - INFO - Received callback for node 69d4c23f932ecfe2320a12e1 INFO: 172.20.0.1:34306 - "POST /node/69d4c23f932ecfe2320a12e1 HTTP/1.0" 202 Accepted 2026-04-07 08:38:35,021 - lava_callback - INFO - Starting async job submit for node 69d4c23f932ecfe2320a12e1 2026-04-07 08:38:35,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:35,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c23f932ecfe2320a12e1 HTTP/1.1" 200 None 2026-04-07 08:38:35,056 - lava_callback - DEBUG - Processing node 69d4c23f932ecfe2320a12e1: baseline-arm-pengutronix 2026-04-07 08:38:35,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:35,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:35,302 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4c23f932ecfe2320a12e1/log.txt.gz 2026-04-07 08:38:35,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:35,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:35,575 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4c23f932ecfe2320a12e1/lava-logs.yaml 2026-04-07 08:38:35,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:35,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:35,729 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4c23f932ecfe2320a12e1/lava_callback.json.gz 2026-04-07 08:38:35,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:35,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c23f932ecfe2320a12e1 HTTP/1.1" 200 None 2026-04-07 08:38:35,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:35,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:38:35,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:35,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c23f932ecfe2320a12e1 HTTP/1.1" 200 None 2026-04-07 08:38:35,811 - lava_callback - INFO - Completed processing callback for node 69d4c23f932ecfe2320a12e1 INFO: 172.20.0.1:34316 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:38:40,155 - lava_callback - INFO - Received callback for node 69d4c23e932ecfe2320a12de INFO: 172.20.0.1:36022 - "POST /node/69d4c23e932ecfe2320a12de HTTP/1.0" 202 Accepted 2026-04-07 08:38:40,161 - lava_callback - INFO - Starting async job submit for node 69d4c23e932ecfe2320a12de 2026-04-07 08:38:40,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:40,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c23e932ecfe2320a12de HTTP/1.1" 200 None 2026-04-07 08:38:40,214 - lava_callback - DEBUG - Processing node 69d4c23e932ecfe2320a12de: baseline-arm-pengutronix 2026-04-07 08:38:40,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:40,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:40,532 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4c23e932ecfe2320a12de/log.txt.gz 2026-04-07 08:38:40,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:40,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:40,873 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4c23e932ecfe2320a12de/lava-logs.yaml 2026-04-07 08:38:40,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:41,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:41,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4c23e932ecfe2320a12de/lava_callback.json.gz 2026-04-07 08:38:41,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:41,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c23e932ecfe2320a12de HTTP/1.1" 200 None 2026-04-07 08:38:41,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:41,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:38:41,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:41,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c23e932ecfe2320a12de HTTP/1.1" 200 None 2026-04-07 08:38:41,162 - lava_callback - INFO - Completed processing callback for node 69d4c23e932ecfe2320a12de 2026-04-07 08:38:41,804 - lava_callback - INFO - Received callback for node 69d4c23c932ecfe2320a12db INFO: 172.20.0.1:36034 - "POST /node/69d4c23c932ecfe2320a12db HTTP/1.0" 202 Accepted 2026-04-07 08:38:41,812 - lava_callback - INFO - Starting async job submit for node 69d4c23c932ecfe2320a12db 2026-04-07 08:38:41,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:41,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c23c932ecfe2320a12db HTTP/1.1" 200 None 2026-04-07 08:38:41,847 - lava_callback - DEBUG - Processing node 69d4c23c932ecfe2320a12db: baseline-arm-pengutronix 2026-04-07 08:38:41,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:42,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:42,125 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4c23c932ecfe2320a12db/log.txt.gz 2026-04-07 08:38:42,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:42,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:42,383 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4c23c932ecfe2320a12db/lava-logs.yaml 2026-04-07 08:38:42,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:42,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:42,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4c23c932ecfe2320a12db/lava_callback.json.gz 2026-04-07 08:38:42,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:42,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c23c932ecfe2320a12db HTTP/1.1" 200 None 2026-04-07 08:38:42,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:42,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:38:42,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:42,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c23c932ecfe2320a12db HTTP/1.1" 200 None 2026-04-07 08:38:42,603 - lava_callback - INFO - Completed processing callback for node 69d4c23c932ecfe2320a12db INFO: 172.20.0.1:36036 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:38:49,420 - lava_callback - INFO - Received callback for node 69d4c238932ecfe2320a12cb INFO: 172.20.0.1:36048 - "POST /node/69d4c238932ecfe2320a12cb HTTP/1.0" 202 Accepted 2026-04-07 08:38:49,429 - lava_callback - INFO - Starting async job submit for node 69d4c238932ecfe2320a12cb 2026-04-07 08:38:49,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:49,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c238932ecfe2320a12cb HTTP/1.1" 200 None 2026-04-07 08:38:49,469 - lava_callback - DEBUG - Processing node 69d4c238932ecfe2320a12cb: baseline-arm-kontron 2026-04-07 08:38:49,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:49,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:49,826 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d4c238932ecfe2320a12cb/log.txt.gz 2026-04-07 08:38:49,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:50,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:50,169 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d4c238932ecfe2320a12cb/lava-logs.yaml 2026-04-07 08:38:50,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:50,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:50,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d4c238932ecfe2320a12cb/lava_callback.json.gz 2026-04-07 08:38:50,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:50,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c238932ecfe2320a12cb HTTP/1.1" 200 None 2026-04-07 08:38:50,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:50,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:38:50,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:50,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c238932ecfe2320a12cb HTTP/1.1" 200 None 2026-04-07 08:38:50,395 - lava_callback - INFO - Completed processing callback for node 69d4c238932ecfe2320a12cb 2026-04-07 08:38:54,423 - lava_callback - INFO - Received callback for node 69d4c22d932ecfe2320a12a3 INFO: 172.20.0.1:50936 - "POST /node/69d4c22d932ecfe2320a12a3 HTTP/1.0" 202 Accepted 2026-04-07 08:38:54,429 - lava_callback - INFO - Starting async job submit for node 69d4c22d932ecfe2320a12a3 2026-04-07 08:38:54,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:54,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c22d932ecfe2320a12a3 HTTP/1.1" 200 None 2026-04-07 08:38:54,467 - lava_callback - DEBUG - Processing node 69d4c22d932ecfe2320a12a3: baseline-arm-broonie 2026-04-07 08:38:54,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:54,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:54,840 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4c22d932ecfe2320a12a3/log.txt.gz 2026-04-07 08:38:54,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:55,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:55,174 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4c22d932ecfe2320a12a3/lava-logs.yaml 2026-04-07 08:38:55,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:38:55,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:38:55,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4c22d932ecfe2320a12a3/lava_callback.json.gz 2026-04-07 08:38:55,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:55,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c22d932ecfe2320a12a3 HTTP/1.1" 200 None 2026-04-07 08:38:55,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:55,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:38:55,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:55,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c22d932ecfe2320a12a3 HTTP/1.1" 200 None 2026-04-07 08:38:55,402 - lava_callback - INFO - Completed processing callback for node 69d4c22d932ecfe2320a12a3 2026-04-07 08:38:56,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:38:56,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60262 - "GET /node/69884c68e408e9ea60fad255%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60268 - "GET /node/698f87343013abef95d0235d%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-07 08:39:09,583 - lava_callback - INFO - Received callback for node 69d4c23a932ecfe2320a12ce INFO: 172.20.0.1:60272 - "POST /node/69d4c23a932ecfe2320a12ce HTTP/1.0" 202 Accepted 2026-04-07 08:39:09,592 - lava_callback - INFO - Starting async job submit for node 69d4c23a932ecfe2320a12ce 2026-04-07 08:39:09,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:09,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c23a932ecfe2320a12ce HTTP/1.1" 200 None 2026-04-07 08:39:09,635 - lava_callback - DEBUG - Processing node 69d4c23a932ecfe2320a12ce: baseline-arm-kontron 2026-04-07 08:39:09,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:39:09,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:39:09,975 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d4c23a932ecfe2320a12ce/log.txt.gz 2026-04-07 08:39:10,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:39:10,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:39:10,334 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d4c23a932ecfe2320a12ce/lava-logs.yaml 2026-04-07 08:39:10,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:39:10,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:39:10,510 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d4c23a932ecfe2320a12ce/lava_callback.json.gz 2026-04-07 08:39:10,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:10,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c23a932ecfe2320a12ce HTTP/1.1" 200 None 2026-04-07 08:39:10,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:10,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:39:10,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:10,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c23a932ecfe2320a12ce HTTP/1.1" 200 None 2026-04-07 08:39:10,610 - lava_callback - INFO - Completed processing callback for node 69d4c23a932ecfe2320a12ce INFO: 172.20.0.1:45374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45402 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:39:26,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:26,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38798 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:39:31,935 - lava_callback - INFO - Received callback for node 69d4c2b2932ecfe2320a13eb INFO: 172.20.0.1:34488 - "POST /node/69d4c2b2932ecfe2320a13eb HTTP/1.0" 202 Accepted 2026-04-07 08:39:31,941 - lava_callback - INFO - Starting async job submit for node 69d4c2b2932ecfe2320a13eb 2026-04-07 08:39:31,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:31,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c2b2932ecfe2320a13eb HTTP/1.1" 200 None 2026-04-07 08:39:31,965 - lava_callback - DEBUG - Processing node 69d4c2b2932ecfe2320a13eb: baseline-arm 2026-04-07 08:39:31,970 - lava_callback - WARNING - Failed to upload log 2026-04-07 08:39:31,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:39:32,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:39:32,102 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c2b2932ecfe2320a13eb/lava-logs.yaml 2026-04-07 08:39:32,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:39:32,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:39:32,226 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c2b2932ecfe2320a13eb/lava_callback.json.gz 2026-04-07 08:39:32,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:32,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c2b2932ecfe2320a13eb HTTP/1.1" 200 None 2026-04-07 08:39:32,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:32,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:39:32,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:32,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c2b2932ecfe2320a13eb HTTP/1.1" 200 None 2026-04-07 08:39:32,296 - lava_callback - INFO - Completed processing callback for node 69d4c2b2932ecfe2320a13eb INFO: 172.20.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44906 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:39:54,514 - lava_callback - INFO - Received callback for node 69d4c229932ecfe2320a1299 INFO: 172.20.0.1:36574 - "POST /node/69d4c229932ecfe2320a1299 HTTP/1.0" 202 Accepted 2026-04-07 08:39:54,521 - lava_callback - INFO - Starting async job submit for node 69d4c229932ecfe2320a1299 2026-04-07 08:39:54,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:54,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c229932ecfe2320a1299 HTTP/1.1" 200 None 2026-04-07 08:39:54,568 - lava_callback - DEBUG - Processing node 69d4c229932ecfe2320a1299: baseline-arm-broonie 2026-04-07 08:39:54,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:39:54,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:39:54,993 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4c229932ecfe2320a1299/log.txt.gz 2026-04-07 08:39:55,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:39:55,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:39:55,342 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4c229932ecfe2320a1299/lava-logs.yaml 2026-04-07 08:39:55,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:39:55,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:39:55,494 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4c229932ecfe2320a1299/lava_callback.json.gz 2026-04-07 08:39:55,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:55,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c229932ecfe2320a1299 HTTP/1.1" 200 None 2026-04-07 08:39:55,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:55,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:39:55,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:55,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c229932ecfe2320a1299 HTTP/1.1" 200 None 2026-04-07 08:39:55,579 - lava_callback - INFO - Completed processing callback for node 69d4c229932ecfe2320a1299 2026-04-07 08:39:56,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:39:56,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58878 - "GET /node/6993602acebe99dd8e06312c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58884 - "GET /node/698bda531e517752bab8b8f7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42754 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:41:25,882 - lava_callback - INFO - Received callback for node 69d4c24e932ecfe2320a130f INFO: 172.20.0.1:55136 - "POST /node/69d4c24e932ecfe2320a130f HTTP/1.0" 202 Accepted 2026-04-07 08:41:25,892 - lava_callback - INFO - Starting async job submit for node 69d4c24e932ecfe2320a130f 2026-04-07 08:41:25,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:25,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c24e932ecfe2320a130f HTTP/1.1" 200 None 2026-04-07 08:41:25,971 - lava_callback - DEBUG - Processing node 69d4c24e932ecfe2320a130f: ltp-cap_bounds INFO: 172.20.0.1:55150 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:41:26,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:41:26,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:41:26,828 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d4c24e932ecfe2320a130f/log.txt.gz 2026-04-07 08:41:27,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:41:27,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:41:27,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d4c24e932ecfe2320a130f/lava-logs.yaml 2026-04-07 08:41:27,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:41:27,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:41:27,768 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d4c24e932ecfe2320a130f/lava_callback.json.gz 2026-04-07 08:41:27,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:27,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c24e932ecfe2320a130f HTTP/1.1" 200 None 2026-04-07 08:41:27,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:27,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:41:27,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:27,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c24e932ecfe2320a130f HTTP/1.1" 200 None 2026-04-07 08:41:27,884 - lava_callback - INFO - Completed processing callback for node 69d4c24e932ecfe2320a130f INFO: 172.20.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42508 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:41:54,740 - lava_callback - INFO - Received callback for node 69d4c250932ecfe2320a1312 INFO: 172.20.0.1:43348 - "POST /node/69d4c250932ecfe2320a1312 HTTP/1.0" 202 Accepted 2026-04-07 08:41:54,754 - lava_callback - INFO - Starting async job submit for node 69d4c250932ecfe2320a1312 2026-04-07 08:41:54,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:54,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c250932ecfe2320a1312 HTTP/1.1" 200 None 2026-04-07 08:41:54,821 - lava_callback - DEBUG - Processing node 69d4c250932ecfe2320a1312: ltp-containers 2026-04-07 08:41:55,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:41:55,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:41:55,595 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69d4c250932ecfe2320a1312/log.txt.gz 2026-04-07 08:41:55,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:41:56,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:56,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 08:41:56,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:41:56,370 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69d4c250932ecfe2320a1312/lava-logs.yaml 2026-04-07 08:41:56,371 - lava_callback - INFO - Received callback for node 69d4c25a932ecfe2320a1328 INFO: 172.20.0.1:43362 - "POST /node/69d4c25a932ecfe2320a1328 HTTP/1.0" 202 Accepted 2026-04-07 08:41:56,382 - lava_callback - INFO - Starting async job submit for node 69d4c25a932ecfe2320a1328 2026-04-07 08:41:56,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:56,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:41:56,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c25a932ecfe2320a1328 HTTP/1.1" 200 None 2026-04-07 08:41:56,434 - lava_callback - DEBUG - Processing node 69d4c25a932ecfe2320a1328: ltp-fs_bind INFO: 172.20.0.1:43368 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:41:57,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:41:57,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69d4c250932ecfe2320a1312/lava_callback.json.gz 2026-04-07 08:41:57,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:57,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:41:57,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c250932ecfe2320a1312 HTTP/1.1" 200 None 2026-04-07 08:41:57,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:57,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:41:57,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:57,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c250932ecfe2320a1312 HTTP/1.1" 200 None 2026-04-07 08:41:57,217 - lava_callback - INFO - Completed processing callback for node 69d4c250932ecfe2320a1312 2026-04-07 08:41:57,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:41:57,332 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d4c25a932ecfe2320a1328/log.txt.gz 2026-04-07 08:41:57,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:41:58,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:41:58,012 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d4c25a932ecfe2320a1328/lava-logs.yaml 2026-04-07 08:41:58,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:41:58,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:41:58,512 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d4c25a932ecfe2320a1328/lava_callback.json.gz 2026-04-07 08:41:58,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:58,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c25a932ecfe2320a1328 HTTP/1.1" 200 None 2026-04-07 08:41:58,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:58,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:41:58,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:41:58,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c25a932ecfe2320a1328 HTTP/1.1" 200 None 2026-04-07 08:41:58,677 - lava_callback - INFO - Completed processing callback for node 69d4c25a932ecfe2320a1328 INFO: 172.20.0.1:53302 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:42:14,912 - lava_callback - INFO - Received callback for node 69d4c265932ecfe2320a1360 INFO: 172.20.0.1:33730 - "POST /node/69d4c265932ecfe2320a1360 HTTP/1.0" 202 Accepted 2026-04-07 08:42:14,919 - lava_callback - INFO - Starting async job submit for node 69d4c265932ecfe2320a1360 2026-04-07 08:42:14,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:42:14,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c265932ecfe2320a1360 HTTP/1.1" 200 None 2026-04-07 08:42:14,964 - lava_callback - DEBUG - Processing node 69d4c265932ecfe2320a1360: ltp-syscalls INFO: 172.20.0.1:33738 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 08:42:15,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:42:16,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:42:16,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d4c265932ecfe2320a1360/log.txt.gz INFO: 172.20.0.1:33750 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:42:16,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:42:16,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:42:16,911 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d4c265932ecfe2320a1360/lava-logs.yaml 2026-04-07 08:42:16,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:42:17,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:42:17,075 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d4c265932ecfe2320a1360/lava_callback.json.gz 2026-04-07 08:42:17,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:42:17,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c265932ecfe2320a1360 HTTP/1.1" 200 None 2026-04-07 08:42:17,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:42:17,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:42:17,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:42:17,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c265932ecfe2320a1360 HTTP/1.1" 200 None 2026-04-07 08:42:17,164 - lava_callback - INFO - Completed processing callback for node 69d4c265932ecfe2320a1360 INFO: 172.20.0.1:33764 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:42:26,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:42:26,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57028 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:42:53,085 - lava_callback - INFO - Received callback for node 69d220810d94ee66016fb643 INFO: 172.20.0.1:40890 - "POST /node/69d220810d94ee66016fb643 HTTP/1.0" 202 Accepted 2026-04-07 08:42:53,094 - lava_callback - INFO - Starting async job submit for node 69d220810d94ee66016fb643 2026-04-07 08:42:53,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:42:53,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d220810d94ee66016fb643 HTTP/1.1" 200 None 2026-04-07 08:42:53,123 - lava_callback - DEBUG - Processing node 69d220810d94ee66016fb643: baseline-arm-baylibre 2026-04-07 08:42:53,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d220810d94ee66016fb643 2026-04-07 08:42:53,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:42:53,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d220810d94ee66016fb643 HTTP/1.1" 200 None 2026-04-07 08:42:53,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:42:53,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 08:42:53,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:42:53,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d220810d94ee66016fb643 HTTP/1.1" 200 None 2026-04-07 08:42:53,251 - lava_callback - ERROR - Error processing callback for node 69d220810d94ee66016fb643: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59130 - "GET /node/69477a984917c2d89a1ed726%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59132 - "GET /node/6992ed0231166481c8dd9af3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54838 - "GET /node/693f99200d8ce4018da987be%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54854 - "GET /node/698a7e36d9a1cfa777a22628%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50204 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:44:14,755 - lava_callback - INFO - Received callback for node 69d4c25c932ecfe2320a132b INFO: 172.20.0.1:40444 - "POST /node/69d4c25c932ecfe2320a132b HTTP/1.0" 202 Accepted 2026-04-07 08:44:14,765 - lava_callback - INFO - Starting async job submit for node 69d4c25c932ecfe2320a132b 2026-04-07 08:44:14,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:44:14,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c25c932ecfe2320a132b HTTP/1.1" 200 None 2026-04-07 08:44:14,851 - lava_callback - DEBUG - Processing node 69d4c25c932ecfe2320a132b: ltp-fsx INFO: 172.20.0.1:40452 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 08:44:15,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:44:15,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:44:15,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69d4c25c932ecfe2320a132b/log.txt.gz 2026-04-07 08:44:16,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:40468 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:44:16,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:44:16,870 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69d4c25c932ecfe2320a132b/lava-logs.yaml 2026-04-07 08:44:16,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:44:17,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:44:17,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69d4c25c932ecfe2320a132b/lava_callback.json.gz 2026-04-07 08:44:17,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:40474 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:44:17,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c25c932ecfe2320a132b HTTP/1.1" 200 None 2026-04-07 08:44:17,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:44:17,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:44:17,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:44:17,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c25c932ecfe2320a132b HTTP/1.1" 200 None 2026-04-07 08:44:17,592 - lava_callback - INFO - Completed processing callback for node 69d4c25c932ecfe2320a132b 2026-04-07 08:44:26,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:44:26,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51750 - "GET /node/695390c60b0495cf59cc58e9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51766 - "GET /node/6940b9ae1e3c24e95681b4a7%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-07 08:45:26,178 - lava_callback - INFO - Received callback for node 69d4c25d932ecfe2320a132e INFO: 172.20.0.1:51776 - "POST /node/69d4c25d932ecfe2320a132e HTTP/1.0" 202 Accepted 2026-04-07 08:45:26,185 - lava_callback - INFO - Starting async job submit for node 69d4c25d932ecfe2320a132e 2026-04-07 08:45:26,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:45:26,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c25d932ecfe2320a132e HTTP/1.1" 200 None 2026-04-07 08:45:26,226 - lava_callback - DEBUG - Processing node 69d4c25d932ecfe2320a132e: ltp-input INFO: 172.20.0.1:51792 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:45:26,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:45:26,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:45:26,826 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69d4c25d932ecfe2320a132e/log.txt.gz 2026-04-07 08:45:27,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:45:27,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:45:27,277 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69d4c25d932ecfe2320a132e/lava-logs.yaml 2026-04-07 08:45:27,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:45:27,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:45:27,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69d4c25d932ecfe2320a132e/lava_callback.json.gz 2026-04-07 08:45:27,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:45:27,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c25d932ecfe2320a132e HTTP/1.1" 200 None 2026-04-07 08:45:27,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:45:27,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:45:27,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:45:27,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c25d932ecfe2320a132e HTTP/1.1" 200 None 2026-04-07 08:45:27,588 - lava_callback - INFO - Completed processing callback for node 69d4c25d932ecfe2320a132e INFO: 172.20.0.1:49730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35810 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:45:54,892 - lava_callback - INFO - Received callback for node 69d4c25f932ecfe2320a1331 INFO: 172.20.0.1:46190 - "POST /node/69d4c25f932ecfe2320a1331 HTTP/1.0" 202 Accepted 2026-04-07 08:45:54,898 - lava_callback - INFO - Starting async job submit for node 69d4c25f932ecfe2320a1331 2026-04-07 08:45:54,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:45:54,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c25f932ecfe2320a1331 HTTP/1.1" 200 None 2026-04-07 08:45:54,938 - lava_callback - DEBUG - Processing node 69d4c25f932ecfe2320a1331: ltp-ipc 2026-04-07 08:45:55,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:45:55,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:45:55,446 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69d4c25f932ecfe2320a1331/log.txt.gz 2026-04-07 08:45:55,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:45:55,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:45:55,868 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69d4c25f932ecfe2320a1331/lava-logs.yaml 2026-04-07 08:45:55,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:45:56,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:45:56,096 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69d4c25f932ecfe2320a1331/lava_callback.json.gz 2026-04-07 08:45:56,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:45:56,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c25f932ecfe2320a1331 HTTP/1.1" 200 None 2026-04-07 08:45:56,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:45:56,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:45:56,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:45:56,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c25f932ecfe2320a1331 HTTP/1.1" 200 None 2026-04-07 08:45:56,189 - lava_callback - INFO - Completed processing callback for node 69d4c25f932ecfe2320a1331 2026-04-07 08:45:56,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:45:56,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50680 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:46:15,052 - lava_callback - INFO - Received callback for node 69d4c262932ecfe2320a1338 INFO: 172.20.0.1:43422 - "POST /node/69d4c262932ecfe2320a1338 HTTP/1.0" 202 Accepted 2026-04-07 08:46:15,058 - lava_callback - INFO - Starting async job submit for node 69d4c262932ecfe2320a1338 2026-04-07 08:46:15,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:15,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c262932ecfe2320a1338 HTTP/1.1" 200 None 2026-04-07 08:46:15,102 - lava_callback - DEBUG - Processing node 69d4c262932ecfe2320a1338: ltp-sched INFO: 172.20.0.1:43438 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 08:46:15,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:46:15,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:46:15,601 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69d4c262932ecfe2320a1338/log.txt.gz 2026-04-07 08:46:15,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:46:16,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:46:16,060 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69d4c262932ecfe2320a1338/lava-logs.yaml 2026-04-07 08:46:16,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:46:16,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:46:16,222 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69d4c262932ecfe2320a1338/lava_callback.json.gz 2026-04-07 08:46:16,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:16,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c262932ecfe2320a1338 HTTP/1.1" 200 None 2026-04-07 08:46:16,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:16,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:46:16,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:16,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c262932ecfe2320a1338 HTTP/1.1" 200 None 2026-04-07 08:46:16,318 - lava_callback - INFO - Completed processing callback for node 69d4c262932ecfe2320a1338 INFO: 172.20.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43466 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:46:26,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:26,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56740 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:46:33,370 - lava_callback - INFO - Received callback for node 69d221570d94ee66016fb736 INFO: 172.20.0.1:41222 - "POST /node/69d221570d94ee66016fb736 HTTP/1.0" 202 Accepted 2026-04-07 08:46:33,375 - lava_callback - INFO - Starting async job submit for node 69d221570d94ee66016fb736 2026-04-07 08:46:33,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:33,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221570d94ee66016fb736 HTTP/1.1" 200 None 2026-04-07 08:46:33,390 - lava_callback - DEBUG - Processing node 69d221570d94ee66016fb736: baseline-arm-baylibre 2026-04-07 08:46:33,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d221570d94ee66016fb736 2026-04-07 08:46:33,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:33,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221570d94ee66016fb736 HTTP/1.1" 200 None 2026-04-07 08:46:33,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:33,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 08:46:33,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:33,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221570d94ee66016fb736 HTTP/1.1" 200 None 2026-04-07 08:46:33,454 - lava_callback - ERROR - Error processing callback for node 69d221570d94ee66016fb736: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60506 - "GET /node/6992ea8331166481c8dd8d97%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60508 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:46:53,246 - lava_callback - INFO - Received callback for node 69d2217b0d94ee66016fb7c0 INFO: 172.20.0.1:60900 - "POST /node/69d2217b0d94ee66016fb7c0 HTTP/1.0" 202 Accepted 2026-04-07 08:46:53,253 - lava_callback - INFO - Starting async job submit for node 69d2217b0d94ee66016fb7c0 2026-04-07 08:46:53,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:53,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2217b0d94ee66016fb7c0 HTTP/1.1" 200 None 2026-04-07 08:46:53,269 - lava_callback - DEBUG - Processing node 69d2217b0d94ee66016fb7c0: baseline-arm64-baylibre 2026-04-07 08:46:53,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2217b0d94ee66016fb7c0 2026-04-07 08:46:53,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:53,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2217b0d94ee66016fb7c0 HTTP/1.1" 200 None 2026-04-07 08:46:53,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:53,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:46:53,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:46:53,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2217b0d94ee66016fb7c0 HTTP/1.1" 200 None 2026-04-07 08:46:53,328 - lava_callback - ERROR - Error processing callback for node 69d2217b0d94ee66016fb7c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58300 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:47:07,966 - lava_callback - INFO - Received callback for node 69d4c46c932ecfe2320a157b INFO: 172.20.0.1:58312 - "POST /node/69d4c46c932ecfe2320a157b HTTP/1.0" 202 Accepted 2026-04-07 08:47:07,974 - lava_callback - INFO - Starting async job submit for node 69d4c46c932ecfe2320a157b 2026-04-07 08:47:07,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:08,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c46c932ecfe2320a157b HTTP/1.1" 200 None 2026-04-07 08:47:08,015 - lava_callback - DEBUG - Processing node 69d4c46c932ecfe2320a157b: baseline-x86 2026-04-07 08:47:08,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:47:08,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:47:08,519 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c46c932ecfe2320a157b/log.txt.gz 2026-04-07 08:47:08,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:47:08,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:47:08,842 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c46c932ecfe2320a157b/lava-logs.yaml 2026-04-07 08:47:08,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:47:09,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:47:09,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c46c932ecfe2320a157b/lava_callback.json.gz 2026-04-07 08:47:09,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:09,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c46c932ecfe2320a157b HTTP/1.1" 200 None 2026-04-07 08:47:09,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:09,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd8d932ecfe2320a1035 HTTP/1.1" 200 None 2026-04-07 08:47:09,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:09,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c46c932ecfe2320a157b HTTP/1.1" 200 None 2026-04-07 08:47:09,112 - lava_callback - INFO - Completed processing callback for node 69d4c46c932ecfe2320a157b 2026-04-07 08:47:13,261 - lava_callback - INFO - Received callback for node 69d2217d0d94ee66016fb7c3 INFO: 172.20.0.1:58282 - "POST /node/69d2217d0d94ee66016fb7c3 HTTP/1.0" 202 Accepted 2026-04-07 08:47:13,267 - lava_callback - INFO - Starting async job submit for node 69d2217d0d94ee66016fb7c3 2026-04-07 08:47:13,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:13,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2217d0d94ee66016fb7c3 HTTP/1.1" 200 None 2026-04-07 08:47:13,283 - lava_callback - DEBUG - Processing node 69d2217d0d94ee66016fb7c3: baseline-arm64-baylibre 2026-04-07 08:47:13,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2217d0d94ee66016fb7c3 2026-04-07 08:47:13,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:13,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2217d0d94ee66016fb7c3 HTTP/1.1" 200 None 2026-04-07 08:47:13,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:13,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:47:13,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:13,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2217d0d94ee66016fb7c3 HTTP/1.1" 200 None 2026-04-07 08:47:13,351 - lava_callback - ERROR - Error processing callback for node 69d2217d0d94ee66016fb7c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:47:13,944 - lava_callback - INFO - Received callback for node 69d2217f0d94ee66016fb7ca INFO: 172.20.0.1:58288 - "POST /node/69d2217f0d94ee66016fb7ca HTTP/1.0" 202 Accepted 2026-04-07 08:47:13,949 - lava_callback - INFO - Starting async job submit for node 69d2217f0d94ee66016fb7ca 2026-04-07 08:47:13,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:13,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2217f0d94ee66016fb7ca HTTP/1.1" 200 None 2026-04-07 08:47:13,965 - lava_callback - DEBUG - Processing node 69d2217f0d94ee66016fb7ca: baseline-arm64-baylibre 2026-04-07 08:47:13,965 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2217f0d94ee66016fb7ca 2026-04-07 08:47:13,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:13,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2217f0d94ee66016fb7ca HTTP/1.1" 200 None 2026-04-07 08:47:13,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:13,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:47:13,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:14,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2217f0d94ee66016fb7ca HTTP/1.1" 200 None 2026-04-07 08:47:14,018 - lava_callback - ERROR - Error processing callback for node 69d2217f0d94ee66016fb7ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:47:14,590 - lava_callback - INFO - Received callback for node 69d221810d94ee66016fb7d1 INFO: 172.20.0.1:58292 - "POST /node/69d221810d94ee66016fb7d1 HTTP/1.0" 202 Accepted 2026-04-07 08:47:14,595 - lava_callback - INFO - Starting async job submit for node 69d221810d94ee66016fb7d1 2026-04-07 08:47:14,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:14,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221810d94ee66016fb7d1 HTTP/1.1" 200 None 2026-04-07 08:47:14,613 - lava_callback - DEBUG - Processing node 69d221810d94ee66016fb7d1: baseline-arm64-baylibre 2026-04-07 08:47:14,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d221810d94ee66016fb7d1 2026-04-07 08:47:14,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:14,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221810d94ee66016fb7d1 HTTP/1.1" 200 None 2026-04-07 08:47:14,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:14,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:47:14,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:14,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221810d94ee66016fb7d1 HTTP/1.1" 200 None 2026-04-07 08:47:14,679 - lava_callback - ERROR - Error processing callback for node 69d221810d94ee66016fb7d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58294 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 08:47:15,172 - lava_callback - INFO - Received callback for node 69d4c46e932ecfe2320a1584 INFO: 172.20.0.1:58304 - "POST /node/69d4c46e932ecfe2320a1584 HTTP/1.0" 202 Accepted 2026-04-07 08:47:15,178 - lava_callback - INFO - Starting async job submit for node 69d4c46e932ecfe2320a1584 2026-04-07 08:47:15,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:15,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c46e932ecfe2320a1584 HTTP/1.1" 200 None 2026-04-07 08:47:15,211 - lava_callback - DEBUG - Processing node 69d4c46e932ecfe2320a1584: baseline-x86 2026-04-07 08:47:15,265 - lava_callback - INFO - Received callback for node 69d221830d94ee66016fb7d4 INFO: 172.20.0.1:58314 - "POST /node/69d221830d94ee66016fb7d4 HTTP/1.0" 202 Accepted 2026-04-07 08:47:15,280 - lava_callback - INFO - Starting async job submit for node 69d221830d94ee66016fb7d4 2026-04-07 08:47:15,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:15,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221830d94ee66016fb7d4 HTTP/1.1" 200 None 2026-04-07 08:47:15,413 - lava_callback - DEBUG - Processing node 69d221830d94ee66016fb7d4: baseline-arm64-baylibre 2026-04-07 08:47:15,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d221830d94ee66016fb7d4 2026-04-07 08:47:15,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:15,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:47:15,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221830d94ee66016fb7d4 HTTP/1.1" 200 None 2026-04-07 08:47:15,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:15,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:47:15,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:15,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221830d94ee66016fb7d4 HTTP/1.1" 200 None 2026-04-07 08:47:15,497 - lava_callback - ERROR - Error processing callback for node 69d221830d94ee66016fb7d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:47:15,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:47:15,606 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c46e932ecfe2320a1584/log.txt.gz 2026-04-07 08:47:15,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:47:15,928 - lava_callback - INFO - Received callback for node 69d221840d94ee66016fb7d7 INFO: 172.20.0.1:58324 - "POST /node/69d221840d94ee66016fb7d7 HTTP/1.0" 202 Accepted 2026-04-07 08:47:15,934 - lava_callback - INFO - Starting async job submit for node 69d221840d94ee66016fb7d7 2026-04-07 08:47:15,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:15,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221840d94ee66016fb7d7 HTTP/1.1" 200 None 2026-04-07 08:47:15,950 - lava_callback - DEBUG - Processing node 69d221840d94ee66016fb7d7: baseline-arm64-baylibre 2026-04-07 08:47:15,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d221840d94ee66016fb7d7 2026-04-07 08:47:15,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:15,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221840d94ee66016fb7d7 HTTP/1.1" 200 None 2026-04-07 08:47:15,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:47:15,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:15,968 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c46e932ecfe2320a1584/lava-logs.yaml 2026-04-07 08:47:15,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:47:15,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:47:15,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:16,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221840d94ee66016fb7d7 HTTP/1.1" 200 None 2026-04-07 08:47:16,013 - lava_callback - ERROR - Error processing callback for node 69d221840d94ee66016fb7d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:47:16,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:47:16,234 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c46e932ecfe2320a1584/lava_callback.json.gz 2026-04-07 08:47:16,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:16,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c46e932ecfe2320a1584 HTTP/1.1" 200 None 2026-04-07 08:47:16,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:16,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd8d932ecfe2320a1035 HTTP/1.1" 200 None 2026-04-07 08:47:16,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:16,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c46e932ecfe2320a1584 HTTP/1.1" 200 None 2026-04-07 08:47:16,310 - lava_callback - INFO - Completed processing callback for node 69d4c46e932ecfe2320a1584 INFO: 172.20.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58338 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:47:26,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:26,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36124 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:47:27,383 - lava_callback - INFO - Received callback for node 69d221950d94ee66016fb832 INFO: 172.20.0.1:36136 - "POST /node/69d221950d94ee66016fb832 HTTP/1.0" 202 Accepted 2026-04-07 08:47:27,389 - lava_callback - INFO - Starting async job submit for node 69d221950d94ee66016fb832 2026-04-07 08:47:27,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:27,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221950d94ee66016fb832 HTTP/1.1" 200 None 2026-04-07 08:47:27,404 - lava_callback - DEBUG - Processing node 69d221950d94ee66016fb832: baseline-arm64-clabbe 2026-04-07 08:47:27,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d221950d94ee66016fb832 2026-04-07 08:47:27,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:27,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221950d94ee66016fb832 HTTP/1.1" 200 None 2026-04-07 08:47:27,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:27,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:47:27,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:27,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221950d94ee66016fb832 HTTP/1.1" 200 None 2026-04-07 08:47:27,457 - lava_callback - ERROR - Error processing callback for node 69d221950d94ee66016fb832: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:47:28,054 - lava_callback - INFO - Received callback for node 69d221970d94ee66016fb838 INFO: 172.20.0.1:36142 - "POST /node/69d221970d94ee66016fb838 HTTP/1.0" 202 Accepted 2026-04-07 08:47:28,060 - lava_callback - INFO - Starting async job submit for node 69d221970d94ee66016fb838 2026-04-07 08:47:28,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:28,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221970d94ee66016fb838 HTTP/1.1" 200 None 2026-04-07 08:47:28,076 - lava_callback - DEBUG - Processing node 69d221970d94ee66016fb838: baseline-arm64-clabbe 2026-04-07 08:47:28,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d221970d94ee66016fb838 2026-04-07 08:47:28,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:28,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221970d94ee66016fb838 HTTP/1.1" 200 None 2026-04-07 08:47:28,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:28,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:47:28,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:28,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221970d94ee66016fb838 HTTP/1.1" 200 None 2026-04-07 08:47:28,127 - lava_callback - ERROR - Error processing callback for node 69d221970d94ee66016fb838: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:47:28,733 - lava_callback - INFO - Received callback for node 69d221980d94ee66016fb83d INFO: 172.20.0.1:36146 - "POST /node/69d221980d94ee66016fb83d HTTP/1.0" 202 Accepted 2026-04-07 08:47:28,739 - lava_callback - INFO - Starting async job submit for node 69d221980d94ee66016fb83d 2026-04-07 08:47:28,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:28,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221980d94ee66016fb83d HTTP/1.1" 200 None 2026-04-07 08:47:28,762 - lava_callback - DEBUG - Processing node 69d221980d94ee66016fb83d: baseline-arm64-clabbe 2026-04-07 08:47:28,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d221980d94ee66016fb83d 2026-04-07 08:47:28,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:28,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221980d94ee66016fb83d HTTP/1.1" 200 None 2026-04-07 08:47:28,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:28,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:47:28,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:28,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221980d94ee66016fb83d HTTP/1.1" 200 None 2026-04-07 08:47:28,839 - lava_callback - ERROR - Error processing callback for node 69d221980d94ee66016fb83d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:47:29,411 - lava_callback - INFO - Received callback for node 69d221990d94ee66016fb840 INFO: 172.20.0.1:36160 - "POST /node/69d221990d94ee66016fb840 HTTP/1.0" 202 Accepted 2026-04-07 08:47:29,417 - lava_callback - INFO - Starting async job submit for node 69d221990d94ee66016fb840 2026-04-07 08:47:29,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:29,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221990d94ee66016fb840 HTTP/1.1" 200 None 2026-04-07 08:47:29,433 - lava_callback - DEBUG - Processing node 69d221990d94ee66016fb840: baseline-arm64-clabbe 2026-04-07 08:47:29,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d221990d94ee66016fb840 2026-04-07 08:47:29,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:29,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221990d94ee66016fb840 HTTP/1.1" 200 None 2026-04-07 08:47:29,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:29,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:47:29,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:29,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221990d94ee66016fb840 HTTP/1.1" 200 None 2026-04-07 08:47:29,485 - lava_callback - ERROR - Error processing callback for node 69d221990d94ee66016fb840: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:47:30,116 - lava_callback - INFO - Received callback for node 69d2219a0d94ee66016fb847 INFO: 172.20.0.1:60926 - "POST /node/69d2219a0d94ee66016fb847 HTTP/1.0" 202 Accepted 2026-04-07 08:47:30,121 - lava_callback - INFO - Starting async job submit for node 69d2219a0d94ee66016fb847 2026-04-07 08:47:30,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:30,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2219a0d94ee66016fb847 HTTP/1.1" 200 None 2026-04-07 08:47:30,137 - lava_callback - DEBUG - Processing node 69d2219a0d94ee66016fb847: baseline-arm64-clabbe 2026-04-07 08:47:30,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2219a0d94ee66016fb847 2026-04-07 08:47:30,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:30,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2219a0d94ee66016fb847 HTTP/1.1" 200 None 2026-04-07 08:47:30,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:30,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:47:30,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:30,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2219a0d94ee66016fb847 HTTP/1.1" 200 None 2026-04-07 08:47:30,194 - lava_callback - ERROR - Error processing callback for node 69d2219a0d94ee66016fb847: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:47:30,791 - lava_callback - INFO - Received callback for node 69d2219b0d94ee66016fb84d INFO: 172.20.0.1:60930 - "POST /node/69d2219b0d94ee66016fb84d HTTP/1.0" 202 Accepted 2026-04-07 08:47:30,797 - lava_callback - INFO - Starting async job submit for node 69d2219b0d94ee66016fb84d 2026-04-07 08:47:30,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:30,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2219b0d94ee66016fb84d HTTP/1.1" 200 None 2026-04-07 08:47:30,815 - lava_callback - DEBUG - Processing node 69d2219b0d94ee66016fb84d: baseline-arm64-clabbe 2026-04-07 08:47:30,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2219b0d94ee66016fb84d 2026-04-07 08:47:30,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:30,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2219b0d94ee66016fb84d HTTP/1.1" 200 None 2026-04-07 08:47:30,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:30,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:47:30,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:30,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2219b0d94ee66016fb84d HTTP/1.1" 200 None 2026-04-07 08:47:30,877 - lava_callback - ERROR - Error processing callback for node 69d2219b0d94ee66016fb84d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 08:47:31,461 - lava_callback - INFO - Received callback for node 69d2219b0d94ee66016fb84a INFO: 172.20.0.1:60932 - "POST /node/69d2219b0d94ee66016fb84a HTTP/1.0" 202 Accepted 2026-04-07 08:47:31,467 - lava_callback - INFO - Starting async job submit for node 69d2219b0d94ee66016fb84a 2026-04-07 08:47:31,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:31,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2219b0d94ee66016fb84a HTTP/1.1" 200 None 2026-04-07 08:47:31,482 - lava_callback - DEBUG - Processing node 69d2219b0d94ee66016fb84a: baseline-arm64-clabbe 2026-04-07 08:47:31,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2219b0d94ee66016fb84a 2026-04-07 08:47:31,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:31,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2219b0d94ee66016fb84a HTTP/1.1" 200 None 2026-04-07 08:47:31,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:31,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 08:47:31,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:47:31,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2219b0d94ee66016fb84a HTTP/1.1" 200 None 2026-04-07 08:47:31,533 - lava_callback - ERROR - Error processing callback for node 69d2219b0d94ee66016fb84a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60126 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:48:35,183 - lava_callback - INFO - Received callback for node 69d4c264932ecfe2320a135d INFO: 172.20.0.1:35902 - "POST /node/69d4c264932ecfe2320a135d HTTP/1.0" 202 Accepted 2026-04-07 08:48:35,189 - lava_callback - INFO - Starting async job submit for node 69d4c264932ecfe2320a135d 2026-04-07 08:48:35,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:48:35,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c264932ecfe2320a135d HTTP/1.1" 200 None 2026-04-07 08:48:35,229 - lava_callback - DEBUG - Processing node 69d4c264932ecfe2320a135d: ltp-smoke 2026-04-07 08:48:35,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:48:35,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:48:35,739 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d4c264932ecfe2320a135d/log.txt.gz 2026-04-07 08:48:35,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:48:36,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:48:36,211 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d4c264932ecfe2320a135d/lava-logs.yaml 2026-04-07 08:48:36,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:48:36,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:48:36,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d4c264932ecfe2320a135d/lava_callback.json.gz 2026-04-07 08:48:36,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:48:36,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c264932ecfe2320a135d HTTP/1.1" 200 None 2026-04-07 08:48:36,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:48:36,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:48:36,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:48:36,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c264932ecfe2320a135d HTTP/1.1" 200 None 2026-04-07 08:48:36,515 - lava_callback - INFO - Completed processing callback for node 69d4c264932ecfe2320a135d INFO: 172.20.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60476 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:48:56,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:48:56,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51882 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:49:26,953 - lava_callback - INFO - Received callback for node 69d4c268932ecfe2320a1367 INFO: 172.20.0.1:51888 - "POST /node/69d4c268932ecfe2320a1367 HTTP/1.0" 202 Accepted 2026-04-07 08:49:26,959 - lava_callback - INFO - Starting async job submit for node 69d4c268932ecfe2320a1367 2026-04-07 08:49:26,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:49:26,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c268932ecfe2320a1367 HTTP/1.1" 200 None 2026-04-07 08:49:26,998 - lava_callback - DEBUG - Processing node 69d4c268932ecfe2320a1367: ltp-timers 2026-04-07 08:49:27,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:49:27,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:49:27,491 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69d4c268932ecfe2320a1367/log.txt.gz 2026-04-07 08:49:27,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:49:27,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:49:27,921 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69d4c268932ecfe2320a1367/lava-logs.yaml 2026-04-07 08:49:27,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:49:28,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:49:28,095 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69d4c268932ecfe2320a1367/lava_callback.json.gz 2026-04-07 08:49:28,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:49:28,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c268932ecfe2320a1367 HTTP/1.1" 200 None 2026-04-07 08:49:28,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:49:28,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:49:28,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:49:28,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c268932ecfe2320a1367 HTTP/1.1" 200 None 2026-04-07 08:49:28,209 - lava_callback - INFO - Completed processing callback for node 69d4c268932ecfe2320a1367 INFO: 172.20.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53146 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:49:54,989 - lava_callback - INFO - Received callback for node 69d4c269932ecfe2320a136a INFO: 172.20.0.1:55236 - "POST /node/69d4c269932ecfe2320a136a HTTP/1.0" 202 Accepted 2026-04-07 08:49:54,996 - lava_callback - INFO - Starting async job submit for node 69d4c269932ecfe2320a136a 2026-04-07 08:49:55,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:49:55,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c269932ecfe2320a136a HTTP/1.1" 200 None 2026-04-07 08:49:55,037 - lava_callback - DEBUG - Processing node 69d4c269932ecfe2320a136a: ltp-watchqueue 2026-04-07 08:49:55,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:49:55,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:49:55,544 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d4c269932ecfe2320a136a/log.txt.gz 2026-04-07 08:49:55,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:49:55,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:49:55,972 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d4c269932ecfe2320a136a/lava-logs.yaml 2026-04-07 08:49:55,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:49:56,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:49:56,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d4c269932ecfe2320a136a/lava_callback.json.gz 2026-04-07 08:49:56,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:49:56,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c269932ecfe2320a136a HTTP/1.1" 200 None 2026-04-07 08:49:56,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:49:56,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:49:56,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:49:56,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c269932ecfe2320a136a HTTP/1.1" 200 None 2026-04-07 08:49:56,432 - lava_callback - INFO - Completed processing callback for node 69d4c269932ecfe2320a136a 2026-04-07 08:49:56,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:49:56,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51636 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 08:50:15,691 - lava_callback - INFO - Received callback for node 69d4c377932ecfe2320a14b5 INFO: 172.20.0.1:51648 - "POST /node/69d4c377932ecfe2320a14b5 HTTP/1.0" 202 Accepted 2026-04-07 08:50:15,697 - lava_callback - INFO - Starting async job submit for node 69d4c377932ecfe2320a14b5 2026-04-07 08:50:15,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:50:15,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c377932ecfe2320a14b5 HTTP/1.1" 200 None 2026-04-07 08:50:15,744 - lava_callback - DEBUG - Processing node 69d4c377932ecfe2320a14b5: ltp-controllers 2026-04-07 08:50:16,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:50:16,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:50:16,327 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69d4c377932ecfe2320a14b5/log.txt.gz INFO: 172.20.0.1:51660 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:50:16,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:50:16,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:50:16,791 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69d4c377932ecfe2320a14b5/lava-logs.yaml 2026-04-07 08:50:16,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:50:16,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:50:16,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69d4c377932ecfe2320a14b5/lava_callback.json.gz 2026-04-07 08:50:17,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:50:17,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c377932ecfe2320a14b5 HTTP/1.1" 200 None 2026-04-07 08:50:17,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:50:17,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:50:17,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:50:17,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c377932ecfe2320a14b5 HTTP/1.1" 200 None 2026-04-07 08:50:17,100 - lava_callback - INFO - Completed processing callback for node 69d4c377932ecfe2320a14b5 INFO: 172.20.0.1:51670 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:50:26,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:50:26,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60248 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:50:53,472 - lava_callback - INFO - Received callback for node 69d222600d94ee66016fba2b INFO: 172.20.0.1:44732 - "POST /node/69d222600d94ee66016fba2b HTTP/1.0" 202 Accepted 2026-04-07 08:50:53,480 - lava_callback - INFO - Starting async job submit for node 69d222600d94ee66016fba2b 2026-04-07 08:50:53,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:50:53,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d222600d94ee66016fba2b HTTP/1.1" 200 None 2026-04-07 08:50:53,502 - lava_callback - DEBUG - Processing node 69d222600d94ee66016fba2b: baseline-arm-baylibre 2026-04-07 08:50:53,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d222600d94ee66016fba2b 2026-04-07 08:50:53,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:50:53,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d222600d94ee66016fba2b HTTP/1.1" 200 None 2026-04-07 08:50:53,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:50:53,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 08:50:53,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:50:53,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d222600d94ee66016fba2b HTTP/1.1" 200 None 2026-04-07 08:50:53,580 - lava_callback - ERROR - Error processing callback for node 69d222600d94ee66016fba2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60416 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:51:46,368 - lava_callback - INFO - Received callback for node 69d4c0fd932ecfe2320a1234 INFO: 172.20.0.1:48112 - "POST /node/69d4c0fd932ecfe2320a1234 HTTP/1.0" 202 Accepted 2026-04-07 08:51:46,379 - lava_callback - INFO - Starting async job submit for node 69d4c0fd932ecfe2320a1234 2026-04-07 08:51:46,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:51:46,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c0fd932ecfe2320a1234 HTTP/1.1" 200 None 2026-04-07 08:51:46,479 - lava_callback - DEBUG - Processing node 69d4c0fd932ecfe2320a1234: ltp-smoke INFO: 172.20.0.1:48114 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:51:47,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:51:47,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:51:47,152 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d4c0fd932ecfe2320a1234/log.txt.gz 2026-04-07 08:51:47,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:51:47,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:51:47,961 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d4c0fd932ecfe2320a1234/lava-logs.yaml 2026-04-07 08:51:47,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:51:48,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:51:48,113 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d4c0fd932ecfe2320a1234/lava_callback.json.gz 2026-04-07 08:51:48,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:51:48,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c0fd932ecfe2320a1234 HTTP/1.1" 200 None 2026-04-07 08:51:48,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:51:48,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd70932ecfe2320a1012 HTTP/1.1" 200 None 2026-04-07 08:51:48,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:51:48,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c0fd932ecfe2320a1234 HTTP/1.1" 200 None 2026-04-07 08:51:48,535 - lava_callback - INFO - Completed processing callback for node 69d4c0fd932ecfe2320a1234 INFO: 172.20.0.1:32786 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:51:56,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:51:56,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42716 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:52:07,511 - lava_callback - INFO - Received callback for node 69d222a20d94ee66016fbab4 INFO: 172.20.0.1:42720 - "POST /node/69d222a20d94ee66016fbab4 HTTP/1.0" 202 Accepted 2026-04-07 08:52:07,517 - lava_callback - INFO - Starting async job submit for node 69d222a20d94ee66016fbab4 2026-04-07 08:52:07,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:52:07,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d222a20d94ee66016fbab4 HTTP/1.1" 200 None 2026-04-07 08:52:07,537 - lava_callback - DEBUG - Processing node 69d222a20d94ee66016fbab4: baseline-arm-clabbe 2026-04-07 08:52:07,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d222a20d94ee66016fbab4 2026-04-07 08:52:07,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:52:07,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d222a20d94ee66016fbab4 HTTP/1.1" 200 None 2026-04-07 08:52:07,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:52:07,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 08:52:07,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:52:07,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d222a20d94ee66016fbab4 HTTP/1.1" 200 None 2026-04-07 08:52:07,613 - lava_callback - ERROR - Error processing callback for node 69d222a20d94ee66016fbab4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33304 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:52:55,249 - lava_callback - INFO - Received callback for node 69d4c3bd932ecfe2320a14f8 INFO: 172.20.0.1:46248 - "POST /node/69d4c3bd932ecfe2320a14f8 HTTP/1.0" 202 Accepted 2026-04-07 08:52:55,259 - lava_callback - INFO - Starting async job submit for node 69d4c3bd932ecfe2320a14f8 2026-04-07 08:52:55,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:52:55,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c3bd932ecfe2320a14f8 HTTP/1.1" 200 None 2026-04-07 08:52:55,305 - lava_callback - DEBUG - Processing node 69d4c3bd932ecfe2320a14f8: ltp-pty 2026-04-07 08:52:55,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:52:55,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:52:55,829 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69d4c3bd932ecfe2320a14f8/log.txt.gz 2026-04-07 08:52:56,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:52:56,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:52:56,274 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69d4c3bd932ecfe2320a14f8/lava-logs.yaml 2026-04-07 08:52:56,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:52:56,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:52:56,461 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69d4c3bd932ecfe2320a14f8/lava_callback.json.gz 2026-04-07 08:52:56,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:52:56,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c3bd932ecfe2320a14f8 HTTP/1.1" 200 None 2026-04-07 08:52:56,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:52:56,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:52:56,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:46260 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:52:56,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c3bd932ecfe2320a14f8 HTTP/1.1" 200 None 2026-04-07 08:52:56,548 - lava_callback - INFO - Completed processing callback for node 69d4c3bd932ecfe2320a14f8 INFO: 172.20.0.1:55436 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:53:07,615 - lava_callback - INFO - Received callback for node 69d222e80d94ee66016fbae8 INFO: 172.20.0.1:55452 - "POST /node/69d222e80d94ee66016fbae8 HTTP/1.0" 202 Accepted 2026-04-07 08:53:07,621 - lava_callback - INFO - Starting async job submit for node 69d222e80d94ee66016fbae8 2026-04-07 08:53:07,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:07,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d222e80d94ee66016fbae8 HTTP/1.1" 200 None 2026-04-07 08:53:07,638 - lava_callback - DEBUG - Processing node 69d222e80d94ee66016fbae8: baseline-arm-clabbe 2026-04-07 08:53:07,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d222e80d94ee66016fbae8 2026-04-07 08:53:07,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:07,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d222e80d94ee66016fbae8 HTTP/1.1" 200 None 2026-04-07 08:53:07,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:07,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 08:53:07,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:07,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d222e80d94ee66016fbae8 HTTP/1.1" 200 None 2026-04-07 08:53:07,702 - lava_callback - ERROR - Error processing callback for node 69d222e80d94ee66016fbae8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57446 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:53:26,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:26,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 08:53:26,668 - lava_callback - INFO - Received callback for node 69d4c3e5932ecfe2320a151d INFO: 172.20.0.1:57454 - "POST /node/69d4c3e5932ecfe2320a151d HTTP/1.0" 202 Accepted 2026-04-07 08:53:26,675 - lava_callback - INFO - Starting async job submit for node 69d4c3e5932ecfe2320a151d 2026-04-07 08:53:26,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:26,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c3e5932ecfe2320a151d HTTP/1.1" 200 None 2026-04-07 08:53:26,719 - lava_callback - DEBUG - Processing node 69d4c3e5932ecfe2320a151d: ltp-syscalls-ipc 2026-04-07 08:53:27,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:53:27,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:53:27,241 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d4c3e5932ecfe2320a151d/log.txt.gz 2026-04-07 08:53:27,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:53:27,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:53:27,667 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d4c3e5932ecfe2320a151d/lava-logs.yaml 2026-04-07 08:53:27,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:53:27,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:53:27,863 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d4c3e5932ecfe2320a151d/lava_callback.json.gz 2026-04-07 08:53:27,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:27,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c3e5932ecfe2320a151d HTTP/1.1" 200 None 2026-04-07 08:53:27,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:27,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:53:27,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:27,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c3e5932ecfe2320a151d HTTP/1.1" 200 None 2026-04-07 08:53:27,958 - lava_callback - INFO - Completed processing callback for node 69d4c3e5932ecfe2320a151d INFO: 172.20.0.1:35932 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:53:39,426 - lava_callback - INFO - Received callback for node 69d4c46d932ecfe2320a157e INFO: 172.20.0.1:35936 - "POST /node/69d4c46d932ecfe2320a157e HTTP/1.0" 202 Accepted 2026-04-07 08:53:39,432 - lava_callback - INFO - Starting async job submit for node 69d4c46d932ecfe2320a157e 2026-04-07 08:53:39,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:39,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c46d932ecfe2320a157e HTTP/1.1" 200 None 2026-04-07 08:53:39,471 - lava_callback - DEBUG - Processing node 69d4c46d932ecfe2320a157e: baseline-x86 2026-04-07 08:53:39,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:53:39,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:53:39,935 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c46d932ecfe2320a157e/log.txt.gz 2026-04-07 08:53:40,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:53:40,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:53:40,353 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c46d932ecfe2320a157e/lava-logs.yaml 2026-04-07 08:53:40,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:53:40,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:53:40,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c46d932ecfe2320a157e/lava_callback.json.gz 2026-04-07 08:53:40,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:40,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c46d932ecfe2320a157e HTTP/1.1" 200 None 2026-04-07 08:53:40,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:40,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd8d932ecfe2320a1035 HTTP/1.1" 200 None 2026-04-07 08:53:40,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:40,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c46d932ecfe2320a157e HTTP/1.1" 200 None 2026-04-07 08:53:40,614 - lava_callback - INFO - Completed processing callback for node 69d4c46d932ecfe2320a157e INFO: 172.20.0.1:60780 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:53:47,569 - lava_callback - INFO - Received callback for node 69d223080d94ee66016fbb0c INFO: 172.20.0.1:60792 - "POST /node/69d223080d94ee66016fbb0c HTTP/1.0" 202 Accepted 2026-04-07 08:53:47,577 - lava_callback - INFO - Starting async job submit for node 69d223080d94ee66016fbb0c 2026-04-07 08:53:47,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:47,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d223080d94ee66016fbb0c HTTP/1.1" 200 None 2026-04-07 08:53:47,593 - lava_callback - DEBUG - Processing node 69d223080d94ee66016fbb0c: baseline-arm-clabbe 2026-04-07 08:53:47,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d223080d94ee66016fbb0c 2026-04-07 08:53:47,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:47,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d223080d94ee66016fbb0c HTTP/1.1" 200 None 2026-04-07 08:53:47,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:47,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 08:53:47,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:47,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d223080d94ee66016fbb0c HTTP/1.1" 200 None 2026-04-07 08:53:47,662 - lava_callback - ERROR - Error processing callback for node 69d223080d94ee66016fbb0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41800 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:53:56,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:53:56,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55660 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:54:07,331 - lava_callback - INFO - Received callback for node 69d4c61d932ecfe2320a17db INFO: 172.20.0.1:55672 - "POST /node/69d4c61d932ecfe2320a17db HTTP/1.0" 202 Accepted 2026-04-07 08:54:07,337 - lava_callback - INFO - Starting async job submit for node 69d4c61d932ecfe2320a17db 2026-04-07 08:54:07,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:07,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c61d932ecfe2320a17db HTTP/1.1" 200 None 2026-04-07 08:54:07,355 - lava_callback - DEBUG - Processing node 69d4c61d932ecfe2320a17db: baseline-arm 2026-04-07 08:54:07,360 - lava_callback - WARNING - Failed to upload log 2026-04-07 08:54:07,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:54:07,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:54:07,488 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c61d932ecfe2320a17db/lava-logs.yaml 2026-04-07 08:54:07,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:54:07,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:54:07,606 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c61d932ecfe2320a17db/lava_callback.json.gz 2026-04-07 08:54:07,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:07,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c61d932ecfe2320a17db HTTP/1.1" 200 None 2026-04-07 08:54:07,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:07,626 - lava_callback - INFO - Received callback for node 69d223280d94ee66016fbb25 INFO: 172.20.0.1:55678 - "POST /node/69d223280d94ee66016fbb25 HTTP/1.0" 202 Accepted 2026-04-07 08:54:07,632 - lava_callback - INFO - Starting async job submit for node 69d223280d94ee66016fbb25 2026-04-07 08:54:07,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:07,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:54:07,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:07,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d223280d94ee66016fbb25 HTTP/1.1" 200 None 2026-04-07 08:54:07,648 - lava_callback - DEBUG - Processing node 69d223280d94ee66016fbb25: baseline-arm-clabbe 2026-04-07 08:54:07,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d223280d94ee66016fbb25 2026-04-07 08:54:07,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:07,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d223280d94ee66016fbb25 HTTP/1.1" 200 None 2026-04-07 08:54:07,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:07,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c61d932ecfe2320a17db HTTP/1.1" 200 None 2026-04-07 08:54:07,681 - lava_callback - INFO - Completed processing callback for node 69d4c61d932ecfe2320a17db 2026-04-07 08:54:07,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 08:54:07,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:07,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d223280d94ee66016fbb25 HTTP/1.1" 200 None 2026-04-07 08:54:07,766 - lava_callback - ERROR - Error processing callback for node 69d223280d94ee66016fbb25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47732 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:54:26,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:26,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60674 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:54:37,460 - lava_callback - INFO - Received callback for node 69d4c21a932ecfe2320a125e INFO: 172.20.0.1:60676 - "POST /node/69d4c21a932ecfe2320a125e HTTP/1.0" 202 Accepted 2026-04-07 08:54:37,467 - lava_callback - INFO - Starting async job submit for node 69d4c21a932ecfe2320a125e 2026-04-07 08:54:37,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:37,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c21a932ecfe2320a125e HTTP/1.1" 200 None 2026-04-07 08:54:37,546 - lava_callback - DEBUG - Processing node 69d4c21a932ecfe2320a125e: baseline-arm 2026-04-07 08:54:38,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:54:38,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:54:38,282 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c21a932ecfe2320a125e/log.txt.gz 2026-04-07 08:54:38,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:54:38,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:54:38,932 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c21a932ecfe2320a125e/lava-logs.yaml 2026-04-07 08:54:38,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 08:54:39,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 08:54:39,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c21a932ecfe2320a125e/lava_callback.json.gz DEBUG: Setup failed for 69d4c21a932ecfe2320a125e. Transitting job node result: incomplete -> fail 2026-04-07 08:54:39,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:39,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c21a932ecfe2320a125e HTTP/1.1" 200 None 2026-04-07 08:54:39,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:39,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 08:54:39,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:39,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c21a932ecfe2320a125e HTTP/1.1" 200 None 2026-04-07 08:54:39,401 - lava_callback - INFO - Completed processing callback for node 69d4c21a932ecfe2320a125e INFO: 172.20.0.1:35292 - "GET /node/693af598fee8383e92b6b45d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35298 - "GET /node/694bd8acc19e09af58d4988b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35310 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:54:47,636 - lava_callback - INFO - Received callback for node 69d2234b0d94ee66016fbb4c INFO: 172.20.0.1:35322 - "POST /node/69d2234b0d94ee66016fbb4c HTTP/1.0" 202 Accepted 2026-04-07 08:54:47,643 - lava_callback - INFO - Starting async job submit for node 69d2234b0d94ee66016fbb4c 2026-04-07 08:54:47,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:47,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2234b0d94ee66016fbb4c HTTP/1.1" 200 None 2026-04-07 08:54:47,659 - lava_callback - DEBUG - Processing node 69d2234b0d94ee66016fbb4c: baseline-arm-clabbe 2026-04-07 08:54:47,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2234b0d94ee66016fbb4c 2026-04-07 08:54:47,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:47,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2234b0d94ee66016fbb4c HTTP/1.1" 200 None 2026-04-07 08:54:47,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:47,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 08:54:47,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:47,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2234b0d94ee66016fbb4c HTTP/1.1" 200 None 2026-04-07 08:54:47,720 - lava_callback - ERROR - Error processing callback for node 69d2234b0d94ee66016fbb4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60094 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:54:56,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:54:56,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK 2026-04-07 08:55:07,693 - lava_callback - INFO - Received callback for node 69d223670d94ee66016fbb70 INFO: 172.20.0.1:43792 - "POST /node/69d223670d94ee66016fbb70 HTTP/1.0" 202 Accepted 2026-04-07 08:55:07,698 - lava_callback - INFO - Starting async job submit for node 69d223670d94ee66016fbb70 2026-04-07 08:55:07,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:55:07,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d223670d94ee66016fbb70 HTTP/1.1" 200 None 2026-04-07 08:55:07,714 - lava_callback - DEBUG - Processing node 69d223670d94ee66016fbb70: baseline-arm-clabbe 2026-04-07 08:55:07,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d223670d94ee66016fbb70 2026-04-07 08:55:07,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:55:07,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d223670d94ee66016fbb70 HTTP/1.1" 200 None 2026-04-07 08:55:07,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:55:07,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 08:55:07,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 08:55:07,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d223670d94ee66016fbb70 HTTP/1.1" 200 None 2026-04-07 08:55:07,765 - lava_callback - ERROR - Error processing callback for node 69d223670d94ee66016fbb70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51964 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 09:01:15,402 - lava_callback - INFO - Received callback for node 69d4c6e8932ecfe2320a1904 INFO: 172.20.0.1:51970 - "POST /node/69d4c6e8932ecfe2320a1904 HTTP/1.0" 202 Accepted 2026-04-07 09:01:15,408 - lava_callback - INFO - Starting async job submit for node 69d4c6e8932ecfe2320a1904 2026-04-07 09:01:15,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:01:15,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c6e8932ecfe2320a1904 HTTP/1.1" 200 None 2026-04-07 09:01:15,449 - lava_callback - DEBUG - Processing node 69d4c6e8932ecfe2320a1904: ltp-cve 2026-04-07 09:01:15,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:01:16,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:01:16,212 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69d4c6e8932ecfe2320a1904/log.txt.gz 2026-04-07 09:01:16,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:51982 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:01:16,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:01:16,687 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69d4c6e8932ecfe2320a1904/lava-logs.yaml 2026-04-07 09:01:16,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:01:16,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:01:16,871 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69d4c6e8932ecfe2320a1904/lava_callback.json.gz 2026-04-07 09:01:16,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:01:16,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c6e8932ecfe2320a1904 HTTP/1.1" 200 None 2026-04-07 09:01:16,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:01:16,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 09:01:16,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:01:16,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c6e8932ecfe2320a1904 HTTP/1.1" 200 None 2026-04-07 09:01:16,968 - lava_callback - INFO - Completed processing callback for node 69d4c6e8932ecfe2320a1904 INFO: 172.20.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53538 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:01:26,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:01:26,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38386 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:02:27,965 - lava_callback - INFO - Received callback for node 69d4c46e932ecfe2320a1581 INFO: 172.20.0.1:38392 - "POST /node/69d4c46e932ecfe2320a1581 HTTP/1.0" 202 Accepted 2026-04-07 09:02:27,971 - lava_callback - INFO - Starting async job submit for node 69d4c46e932ecfe2320a1581 2026-04-07 09:02:28,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:02:28,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c46e932ecfe2320a1581 HTTP/1.1" 200 None 2026-04-07 09:02:28,031 - lava_callback - DEBUG - Processing node 69d4c46e932ecfe2320a1581: baseline-x86 2026-04-07 09:02:28,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:02:29,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:02:29,108 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c46e932ecfe2320a1581/log.txt.gz 2026-04-07 09:02:29,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:02:29,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:02:29,828 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c46e932ecfe2320a1581/lava-logs.yaml 2026-04-07 09:02:29,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:02:30,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:02:30,026 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c46e932ecfe2320a1581/lava_callback.json.gz DEBUG: Setup failed for 69d4c46e932ecfe2320a1581. Transitting job node result: incomplete -> fail 2026-04-07 09:02:30,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:02:30,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c46e932ecfe2320a1581 HTTP/1.1" 200 None 2026-04-07 09:02:30,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:02:30,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd8d932ecfe2320a1035 HTTP/1.1" 200 None 2026-04-07 09:02:30,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:02:30,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c46e932ecfe2320a1581 HTTP/1.1" 200 None 2026-04-07 09:02:30,289 - lava_callback - INFO - Completed processing callback for node 69d4c46e932ecfe2320a1581 INFO: 172.20.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48452 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:02:56,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:02:56,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44684 - "GET /node/69903a49985e4efca431d8ac%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43528 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:09:11,733 - lava_callback - INFO - Received callback for node 69d4c988932ecfe2320a1ac4 INFO: 172.20.0.1:35596 - "POST /node/69d4c988932ecfe2320a1ac4 HTTP/1.0" 202 Accepted 2026-04-07 09:09:11,739 - lava_callback - INFO - Starting async job submit for node 69d4c988932ecfe2320a1ac4 2026-04-07 09:09:11,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:11,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c988932ecfe2320a1ac4 HTTP/1.1" 200 None 2026-04-07 09:09:11,773 - lava_callback - DEBUG - Processing node 69d4c988932ecfe2320a1ac4: baseline-arm64 2026-04-07 09:09:12,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:12,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:12,177 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c988932ecfe2320a1ac4/log.txt.gz 2026-04-07 09:09:12,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:12,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:12,467 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c988932ecfe2320a1ac4/lava-logs.yaml 2026-04-07 09:09:12,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:12,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:12,677 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c988932ecfe2320a1ac4/lava_callback.json.gz 2026-04-07 09:09:12,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:12,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c988932ecfe2320a1ac4 HTTP/1.1" 200 None 2026-04-07 09:09:12,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:12,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:09:12,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:12,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c988932ecfe2320a1ac4 HTTP/1.1" 200 None 2026-04-07 09:09:12,760 - lava_callback - INFO - Completed processing callback for node 69d4c988932ecfe2320a1ac4 INFO: 172.20.0.1:35604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35610 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:09:20,832 - lava_callback - INFO - Received callback for node 69d4c9a4932ecfe2320a1b28 INFO: 172.20.0.1:56032 - "POST /node/69d4c9a4932ecfe2320a1b28 HTTP/1.0" 202 Accepted 2026-04-07 09:09:20,838 - lava_callback - INFO - Starting async job submit for node 69d4c9a4932ecfe2320a1b28 2026-04-07 09:09:20,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:20,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a4932ecfe2320a1b28 HTTP/1.1" 200 None 2026-04-07 09:09:20,857 - lava_callback - DEBUG - Processing node 69d4c9a4932ecfe2320a1b28: baseline-nfs-arm64 2026-04-07 09:09:20,859 - lava_callback - WARNING - Failed to upload log 2026-04-07 09:09:20,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:20,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:20,980 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a4932ecfe2320a1b28/lava-logs.yaml 2026-04-07 09:09:20,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:21,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:21,102 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a4932ecfe2320a1b28/lava_callback.json.gz 2026-04-07 09:09:21,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:21,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a4932ecfe2320a1b28 HTTP/1.1" 200 None 2026-04-07 09:09:21,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:21,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:09:21,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:21,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9a4932ecfe2320a1b28 HTTP/1.1" 200 None 2026-04-07 09:09:21,206 - lava_callback - INFO - Completed processing callback for node 69d4c9a4932ecfe2320a1b28 2026-04-07 09:09:22,123 - lava_callback - INFO - Received callback for node 69d4c994932ecfe2320a1b00 INFO: 172.20.0.1:56034 - "POST /node/69d4c994932ecfe2320a1b00 HTTP/1.0" 202 Accepted 2026-04-07 09:09:22,130 - lava_callback - INFO - Starting async job submit for node 69d4c994932ecfe2320a1b00 2026-04-07 09:09:22,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:22,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c994932ecfe2320a1b00 HTTP/1.1" 200 None 2026-04-07 09:09:22,170 - lava_callback - DEBUG - Processing node 69d4c994932ecfe2320a1b00: baseline-arm64 2026-04-07 09:09:22,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:22,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:22,591 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c994932ecfe2320a1b00/log.txt.gz 2026-04-07 09:09:22,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:22,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:22,929 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c994932ecfe2320a1b00/lava-logs.yaml 2026-04-07 09:09:22,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:23,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:23,075 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c994932ecfe2320a1b00/lava_callback.json.gz 2026-04-07 09:09:23,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:23,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c994932ecfe2320a1b00 HTTP/1.1" 200 None 2026-04-07 09:09:23,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:23,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:09:23,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:23,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c994932ecfe2320a1b00 HTTP/1.1" 200 None 2026-04-07 09:09:23,160 - lava_callback - INFO - Completed processing callback for node 69d4c994932ecfe2320a1b00 INFO: 172.20.0.1:56040 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:09:26,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:26,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 09:09:34,678 - lava_callback - INFO - Received callback for node 69d226ba0d94ee66016fbe80 INFO: 172.20.0.1:41750 - "POST /node/69d226ba0d94ee66016fbe80 HTTP/1.0" 202 Accepted 2026-04-07 09:09:34,683 - lava_callback - INFO - Starting async job submit for node 69d226ba0d94ee66016fbe80 2026-04-07 09:09:34,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:34,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d226ba0d94ee66016fbe80 HTTP/1.1" 200 None 2026-04-07 09:09:34,699 - lava_callback - DEBUG - Processing node 69d226ba0d94ee66016fbe80: baseline-arm64-baylibre 2026-04-07 09:09:34,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d226ba0d94ee66016fbe80 2026-04-07 09:09:34,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:34,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d226ba0d94ee66016fbe80 HTTP/1.1" 200 None 2026-04-07 09:09:34,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:34,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 09:09:34,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:34,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d226ba0d94ee66016fbe80 HTTP/1.1" 200 None 2026-04-07 09:09:34,759 - lava_callback - ERROR - Error processing callback for node 69d226ba0d94ee66016fbe80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41754 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:09:37,887 - lava_callback - INFO - Received callback for node 69d4c98b932ecfe2320a1aeb INFO: 172.20.0.1:41758 - "POST /node/69d4c98b932ecfe2320a1aeb HTTP/1.0" 202 Accepted 2026-04-07 09:09:37,902 - lava_callback - INFO - Starting async job submit for node 69d4c98b932ecfe2320a1aeb 2026-04-07 09:09:37,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:37,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c98b932ecfe2320a1aeb HTTP/1.1" 200 None 2026-04-07 09:09:37,977 - lava_callback - DEBUG - Processing node 69d4c98b932ecfe2320a1aeb: baseline-arm64 2026-04-07 09:09:38,181 - lava_callback - WARNING - Failed to upload log 2026-04-07 09:09:38,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:38,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:38,419 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98b932ecfe2320a1aeb/lava-logs.yaml 2026-04-07 09:09:38,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:38,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:38,577 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98b932ecfe2320a1aeb/lava_callback.json.gz 2026-04-07 09:09:38,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:38,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c98b932ecfe2320a1aeb HTTP/1.1" 200 None 2026-04-07 09:09:38,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:38,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:09:38,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:38,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c98b932ecfe2320a1aeb HTTP/1.1" 200 None 2026-04-07 09:09:38,749 - lava_callback - INFO - Completed processing callback for node 69d4c98b932ecfe2320a1aeb 2026-04-07 09:09:41,891 - lava_callback - INFO - Received callback for node 69d4c989932ecfe2320a1ace INFO: 172.20.0.1:56736 - "POST /node/69d4c989932ecfe2320a1ace HTTP/1.0" 202 Accepted 2026-04-07 09:09:41,901 - lava_callback - INFO - Starting async job submit for node 69d4c989932ecfe2320a1ace 2026-04-07 09:09:41,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:41,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c989932ecfe2320a1ace HTTP/1.1" 200 None 2026-04-07 09:09:41,957 - lava_callback - DEBUG - Processing node 69d4c989932ecfe2320a1ace: baseline-arm64 2026-04-07 09:09:42,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:42,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:42,457 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c989932ecfe2320a1ace/log.txt.gz 2026-04-07 09:09:42,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:42,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:42,887 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c989932ecfe2320a1ace/lava-logs.yaml 2026-04-07 09:09:42,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:43,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:43,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c989932ecfe2320a1ace/lava_callback.json.gz 2026-04-07 09:09:43,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:43,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c989932ecfe2320a1ace HTTP/1.1" 200 None 2026-04-07 09:09:43,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:43,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:09:43,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:43,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c989932ecfe2320a1ace HTTP/1.1" 200 None 2026-04-07 09:09:43,121 - lava_callback - INFO - Completed processing callback for node 69d4c989932ecfe2320a1ace INFO: 172.20.0.1:56750 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:09:46,690 - lava_callback - INFO - Received callback for node 69d4c990932ecfe2320a1af7 INFO: 172.20.0.1:56758 - "POST /node/69d4c990932ecfe2320a1af7 HTTP/1.0" 202 Accepted 2026-04-07 09:09:46,697 - lava_callback - INFO - Starting async job submit for node 69d4c990932ecfe2320a1af7 2026-04-07 09:09:46,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:46,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c990932ecfe2320a1af7 HTTP/1.1" 200 None 2026-04-07 09:09:46,738 - lava_callback - DEBUG - Processing node 69d4c990932ecfe2320a1af7: baseline-arm64 2026-04-07 09:09:47,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:47,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:47,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c990932ecfe2320a1af7/log.txt.gz 2026-04-07 09:09:47,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:47,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:47,657 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c990932ecfe2320a1af7/lava-logs.yaml 2026-04-07 09:09:47,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:47,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:47,803 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c990932ecfe2320a1af7/lava_callback.json.gz 2026-04-07 09:09:47,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:47,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c990932ecfe2320a1af7 HTTP/1.1" 200 None 2026-04-07 09:09:47,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:47,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:09:47,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:47,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c990932ecfe2320a1af7 HTTP/1.1" 200 None 2026-04-07 09:09:47,883 - lava_callback - INFO - Completed processing callback for node 69d4c990932ecfe2320a1af7 INFO: 172.20.0.1:45194 - "GET /node/6939aef25206d8a4495e96b1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45196 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:09:56,667 - lava_callback - INFO - Received callback for node 69d4c98d932ecfe2320a1aee INFO: 172.20.0.1:45210 - "POST /node/69d4c98d932ecfe2320a1aee HTTP/1.0" 202 Accepted 2026-04-07 09:09:56,676 - lava_callback - INFO - Starting async job submit for node 69d4c98d932ecfe2320a1aee 2026-04-07 09:09:56,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:56,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c98d932ecfe2320a1aee HTTP/1.1" 200 None 2026-04-07 09:09:56,723 - lava_callback - DEBUG - Processing node 69d4c98d932ecfe2320a1aee: baseline-arm64 2026-04-07 09:09:56,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:56,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 09:09:56,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:57,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:57,077 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98d932ecfe2320a1aee/log.txt.gz 2026-04-07 09:09:57,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:57,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:57,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98d932ecfe2320a1aee/lava-logs.yaml 2026-04-07 09:09:57,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:09:57,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:09:57,510 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98d932ecfe2320a1aee/lava_callback.json.gz 2026-04-07 09:09:57,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:57,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c98d932ecfe2320a1aee HTTP/1.1" 200 None 2026-04-07 09:09:57,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:57,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:09:57,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:09:57,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c98d932ecfe2320a1aee HTTP/1.1" 200 None 2026-04-07 09:09:57,668 - lava_callback - INFO - Completed processing callback for node 69d4c98d932ecfe2320a1aee INFO: 172.20.0.1:48676 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:10:11,154 - lava_callback - INFO - Received callback for node 69d4c998932ecfe2320a1b09 INFO: 172.20.0.1:34394 - "POST /node/69d4c998932ecfe2320a1b09 HTTP/1.0" 202 Accepted 2026-04-07 09:10:11,161 - lava_callback - INFO - Starting async job submit for node 69d4c998932ecfe2320a1b09 2026-04-07 09:10:11,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:11,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c998932ecfe2320a1b09 HTTP/1.1" 200 None 2026-04-07 09:10:11,197 - lava_callback - DEBUG - Processing node 69d4c998932ecfe2320a1b09: baseline-arm64 2026-04-07 09:10:11,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:11,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:11,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c998932ecfe2320a1b09/log.txt.gz 2026-04-07 09:10:11,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:12,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:12,072 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c998932ecfe2320a1b09/lava-logs.yaml 2026-04-07 09:10:12,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:12,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:12,235 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c998932ecfe2320a1b09/lava_callback.json.gz 2026-04-07 09:10:12,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:12,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c998932ecfe2320a1b09 HTTP/1.1" 200 None 2026-04-07 09:10:12,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:12,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:12,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:12,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c998932ecfe2320a1b09 HTTP/1.1" 200 None 2026-04-07 09:10:12,316 - lava_callback - INFO - Completed processing callback for node 69d4c998932ecfe2320a1b09 INFO: 172.20.0.1:34408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34424 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:10:19,443 - lava_callback - INFO - Received callback for node 69d4c99a932ecfe2320a1b10 INFO: 172.20.0.1:34436 - "POST /node/69d4c99a932ecfe2320a1b10 HTTP/1.0" 202 Accepted 2026-04-07 09:10:19,449 - lava_callback - INFO - Starting async job submit for node 69d4c99a932ecfe2320a1b10 2026-04-07 09:10:19,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:19,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c99a932ecfe2320a1b10 HTTP/1.1" 200 None 2026-04-07 09:10:19,485 - lava_callback - DEBUG - Processing node 69d4c99a932ecfe2320a1b10: baseline-arm64 2026-04-07 09:10:19,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:19,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:19,885 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c99a932ecfe2320a1b10/log.txt.gz 2026-04-07 09:10:20,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:20,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:20,273 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c99a932ecfe2320a1b10/lava-logs.yaml 2026-04-07 09:10:20,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:20,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:20,415 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c99a932ecfe2320a1b10/lava_callback.json.gz 2026-04-07 09:10:20,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:20,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c99a932ecfe2320a1b10 HTTP/1.1" 200 None 2026-04-07 09:10:20,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:20,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:20,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:20,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c99a932ecfe2320a1b10 HTTP/1.1" 200 None 2026-04-07 09:10:20,499 - lava_callback - INFO - Completed processing callback for node 69d4c99a932ecfe2320a1b10 2026-04-07 09:10:25,588 - lava_callback - INFO - Received callback for node 69d4c989932ecfe2320a1ac9 INFO: 172.20.0.1:43072 - "POST /node/69d4c989932ecfe2320a1ac9 HTTP/1.0" 202 Accepted 2026-04-07 09:10:25,595 - lava_callback - INFO - Starting async job submit for node 69d4c989932ecfe2320a1ac9 2026-04-07 09:10:25,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:25,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c989932ecfe2320a1ac9 HTTP/1.1" 200 None 2026-04-07 09:10:25,636 - lava_callback - DEBUG - Processing node 69d4c989932ecfe2320a1ac9: baseline-arm64 2026-04-07 09:10:25,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:25,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:25,983 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c989932ecfe2320a1ac9/log.txt.gz 2026-04-07 09:10:26,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:26,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:26,354 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c989932ecfe2320a1ac9/lava-logs.yaml 2026-04-07 09:10:26,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:26,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:26,496 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c989932ecfe2320a1ac9/lava_callback.json.gz INFO: 172.20.0.1:43086 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:10:26,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:26,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c989932ecfe2320a1ac9 HTTP/1.1" 200 None 2026-04-07 09:10:26,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:26,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:26,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:26,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c989932ecfe2320a1ac9 HTTP/1.1" 200 None 2026-04-07 09:10:26,586 - lava_callback - INFO - Completed processing callback for node 69d4c989932ecfe2320a1ac9 2026-04-07 09:10:26,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:26,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-07 09:10:27,164 - lava_callback - INFO - Received callback for node 69d4c9b7932ecfe2320a1b71 INFO: 172.20.0.1:43092 - "POST /node/69d4c9b7932ecfe2320a1b71 HTTP/1.0" 202 Accepted 2026-04-07 09:10:27,170 - lava_callback - INFO - Starting async job submit for node 69d4c9b7932ecfe2320a1b71 2026-04-07 09:10:27,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:27,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9b7932ecfe2320a1b71 HTTP/1.1" 200 None 2026-04-07 09:10:27,210 - lava_callback - DEBUG - Processing node 69d4c9b7932ecfe2320a1b71: baseline-arm64-broonie 2026-04-07 09:10:27,433 - lava_callback - INFO - Received callback for node 69d4c98f932ecfe2320a1af4 INFO: 172.20.0.1:43106 - "POST /node/69d4c98f932ecfe2320a1af4 HTTP/1.0" 202 Accepted 2026-04-07 09:10:27,446 - lava_callback - INFO - Starting async job submit for node 69d4c98f932ecfe2320a1af4 2026-04-07 09:10:27,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:27,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:27,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c98f932ecfe2320a1af4 HTTP/1.1" 200 None 2026-04-07 09:10:27,485 - lava_callback - DEBUG - Processing node 69d4c98f932ecfe2320a1af4: baseline-arm64 2026-04-07 09:10:27,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:27,635 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9b7932ecfe2320a1b71/log.txt.gz 2026-04-07 09:10:27,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:27,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:28,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:28,029 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98f932ecfe2320a1af4/log.txt.gz 2026-04-07 09:10:28,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:28,207 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9b7932ecfe2320a1b71/lava-logs.yaml 2026-04-07 09:10:28,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:28,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:28,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:28,376 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9b7932ecfe2320a1b71/lava_callback.json.gz 2026-04-07 09:10:28,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:28,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:28,411 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98f932ecfe2320a1af4/lava-logs.yaml 2026-04-07 09:10:28,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9b7932ecfe2320a1b71 HTTP/1.1" 200 None 2026-04-07 09:10:28,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:28,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:28,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:28,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:28,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9b7932ecfe2320a1b71 HTTP/1.1" 200 None 2026-04-07 09:10:28,460 - lava_callback - INFO - Completed processing callback for node 69d4c9b7932ecfe2320a1b71 2026-04-07 09:10:28,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:28,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98f932ecfe2320a1af4/lava_callback.json.gz 2026-04-07 09:10:28,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:28,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c98f932ecfe2320a1af4 HTTP/1.1" 200 None 2026-04-07 09:10:28,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:28,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:28,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:28,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c98f932ecfe2320a1af4 HTTP/1.1" 200 None 2026-04-07 09:10:28,778 - lava_callback - INFO - Completed processing callback for node 69d4c98f932ecfe2320a1af4 2026-04-07 09:10:31,111 - lava_callback - INFO - Received callback for node 69d4c9cc932ecfe2320a1bd8 INFO: 172.20.0.1:59980 - "POST /node/69d4c9cc932ecfe2320a1bd8 HTTP/1.0" 202 Accepted 2026-04-07 09:10:31,117 - lava_callback - INFO - Starting async job submit for node 69d4c9cc932ecfe2320a1bd8 2026-04-07 09:10:31,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:31,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9cc932ecfe2320a1bd8 HTTP/1.1" 200 None 2026-04-07 09:10:31,154 - lava_callback - DEBUG - Processing node 69d4c9cc932ecfe2320a1bd8: baseline-arm64-kontron 2026-04-07 09:10:31,231 - lava_callback - INFO - Received callback for node 69d4c9d3932ecfe2320a1beb INFO: 172.20.0.1:59990 - "POST /node/69d4c9d3932ecfe2320a1beb HTTP/1.0" 202 Accepted 2026-04-07 09:10:31,275 - lava_callback - INFO - Starting async job submit for node 69d4c9d3932ecfe2320a1beb 2026-04-07 09:10:31,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:31,410 - lava_callback - INFO - Received callback for node 69d4c9d1932ecfe2320a1be6 2026-04-07 09:10:31,429 - lava_callback - INFO - Starting async job submit for node 69d4c9d1932ecfe2320a1be6 INFO: 172.20.0.1:59996 - "POST /node/69d4c9d1932ecfe2320a1be6 HTTP/1.0" 202 Accepted 2026-04-07 09:10:31,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9d3932ecfe2320a1beb HTTP/1.1" 200 None 2026-04-07 09:10:31,461 - lava_callback - DEBUG - Processing node 69d4c9d3932ecfe2320a1beb: baseline-arm64-foundriesio 2026-04-07 09:10:31,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:31,497 - lava_callback - INFO - Received callback for node 69d4c992932ecfe2320a1afa 2026-04-07 09:10:31,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:31,525 - lava_callback - INFO - Starting async job submit for node 69d4c992932ecfe2320a1afa INFO: 172.20.0.1:59998 - "POST /node/69d4c992932ecfe2320a1afa HTTP/1.0" 202 Accepted 2026-04-07 09:10:31,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:31,569 - lava_callback - INFO - Received callback for node 69d4c9a5932ecfe2320a1b2b 2026-04-07 09:10:31,600 - lava_callback - INFO - Starting async job submit for node 69d4c9a5932ecfe2320a1b2b INFO: 172.20.0.1:60014 - "POST /node/69d4c9a5932ecfe2320a1b2b HTTP/1.0" 202 Accepted 2026-04-07 09:10:31,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9d1932ecfe2320a1be6 HTTP/1.1" 200 None 2026-04-07 09:10:31,665 - lava_callback - DEBUG - Processing node 69d4c9d1932ecfe2320a1be6: baseline-arm64-foundriesio 2026-04-07 09:10:31,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:31,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c992932ecfe2320a1afa HTTP/1.1" 200 None 2026-04-07 09:10:31,775 - lava_callback - DEBUG - Processing node 69d4c992932ecfe2320a1afa: baseline-arm64 2026-04-07 09:10:31,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:32,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a5932ecfe2320a1b2b HTTP/1.1" 200 None 2026-04-07 09:10:32,058 - lava_callback - DEBUG - Processing node 69d4c9a5932ecfe2320a1b2b: baseline-nfs-arm64 2026-04-07 09:10:32,226 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d4c9cc932ecfe2320a1bd8/log.txt.gz 2026-04-07 09:10:32,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:32,731 - lava_callback - INFO - Received callback for node 69d4c9ce932ecfe2320a1bdb 2026-04-07 09:10:32,753 - lava_callback - INFO - Starting async job submit for node 69d4c9ce932ecfe2320a1bdb INFO: 172.20.0.1:60018 - "POST /node/69d4c9ce932ecfe2320a1bdb HTTP/1.0" 202 Accepted 2026-04-07 09:10:32,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:32,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:32,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:33,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9ce932ecfe2320a1bdb HTTP/1.1" 200 None 2026-04-07 09:10:33,047 - lava_callback - DEBUG - Processing node 69d4c9ce932ecfe2320a1bdb: baseline-arm64-kontron 2026-04-07 09:10:33,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:33,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:33,287 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d4c9d1932ecfe2320a1be6/log.txt.gz 2026-04-07 09:10:33,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:33,300 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d4c9d3932ecfe2320a1beb/log.txt.gz 2026-04-07 09:10:33,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:33,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:33,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:33,480 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d4c9cc932ecfe2320a1bd8/lava-logs.yaml 2026-04-07 09:10:33,480 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a5932ecfe2320a1b2b/log.txt.gz 2026-04-07 09:10:33,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:34,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:34,053 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c992932ecfe2320a1afa/log.txt.gz 2026-04-07 09:10:34,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:34,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:34,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:34,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:34,438 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d4c9cc932ecfe2320a1bd8/lava_callback.json.gz 2026-04-07 09:10:34,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:34,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:34,499 - lava_callback - INFO - Received callback for node 69d227020d94ee66016fbea6 2026-04-07 09:10:34,527 - lava_callback - INFO - Starting async job submit for node 69d227020d94ee66016fbea6 INFO: 172.20.0.1:60028 - "POST /node/69d227020d94ee66016fbea6 HTTP/1.0" 202 Accepted 2026-04-07 09:10:34,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:34,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9cc932ecfe2320a1bd8 HTTP/1.1" 200 None 2026-04-07 09:10:34,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:34,636 - lava_callback - INFO - Received callback for node 69d4c98a932ecfe2320a1ad1 2026-04-07 09:10:34,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d227020d94ee66016fbea6 HTTP/1.1" 200 None 2026-04-07 09:10:34,662 - lava_callback - DEBUG - Processing node 69d227020d94ee66016fbea6: baseline-arm64-baylibre 2026-04-07 09:10:34,666 - lava_callback - WARNING - No log data found in callback INFO: 172.20.0.1:60036 - "POST /node/69d4c98a932ecfe2320a1ad1 HTTP/1.0" 202 Accepted Job failure metadata not found for node: 69d227020d94ee66016fbea6 2026-04-07 09:10:34,667 - lava_callback - INFO - Starting async job submit for node 69d4c98a932ecfe2320a1ad1 2026-04-07 09:10:34,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:34,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:34,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:34,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:34,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d4c9ce932ecfe2320a1bdb/log.txt.gz 2026-04-07 09:10:34,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d227020d94ee66016fbea6 HTTP/1.1" 200 None 2026-04-07 09:10:34,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:34,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:34,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:34,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c98a932ecfe2320a1ad1 HTTP/1.1" 200 None 2026-04-07 09:10:34,810 - lava_callback - DEBUG - Processing node 69d4c98a932ecfe2320a1ad1: baseline-arm64 2026-04-07 09:10:34,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:34,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:34,844 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d4c9d3932ecfe2320a1beb/lava-logs.yaml 2026-04-07 09:10:34,845 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d4c9d1932ecfe2320a1be6/lava-logs.yaml 2026-04-07 09:10:34,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 09:10:34,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:34,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:34,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:34,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a5932ecfe2320a1b2b/lava-logs.yaml 2026-04-07 09:10:34,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9cc932ecfe2320a1bd8 HTTP/1.1" 200 None 2026-04-07 09:10:34,916 - lava_callback - INFO - Completed processing callback for node 69d4c9cc932ecfe2320a1bd8 2026-04-07 09:10:34,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:34,982 - lava_callback - INFO - Received callback for node 69d4c9cf932ecfe2320a1be0 INFO: 172.20.0.1:60042 - "POST /node/69d4c9cf932ecfe2320a1be0 HTTP/1.0" 202 Accepted 2026-04-07 09:10:35,024 - lava_callback - INFO - Starting async job submit for node 69d4c9cf932ecfe2320a1be0 2026-04-07 09:10:35,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:35,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d227020d94ee66016fbea6 HTTP/1.1" 200 None 2026-04-07 09:10:35,169 - lava_callback - ERROR - Error processing callback for node 69d227020d94ee66016fbea6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 09:10:35,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:35,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9cf932ecfe2320a1be0 HTTP/1.1" 200 None 2026-04-07 09:10:35,285 - lava_callback - DEBUG - Processing node 69d4c9cf932ecfe2320a1be0: baseline-arm64-pengutronix 2026-04-07 09:10:35,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:35,324 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c992932ecfe2320a1afa/lava-logs.yaml 2026-04-07 09:10:35,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:35,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:35,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:35,571 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d4c9d1932ecfe2320a1be6/lava_callback.json.gz 2026-04-07 09:10:35,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:35,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:35,659 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a5932ecfe2320a1b2b/lava_callback.json.gz 2026-04-07 09:10:35,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:35,796 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d4c9d3932ecfe2320a1beb/lava_callback.json.gz 2026-04-07 09:10:35,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:35,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9d1932ecfe2320a1be6 HTTP/1.1" 200 None 2026-04-07 09:10:35,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:35,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:35,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:35,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a5932ecfe2320a1b2b HTTP/1.1" 200 None 2026-04-07 09:10:36,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:36,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c992932ecfe2320a1afa/lava_callback.json.gz 2026-04-07 09:10:36,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:36,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9d3932ecfe2320a1beb HTTP/1.1" 200 None 2026-04-07 09:10:36,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:36,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:36,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:36,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:36,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:36,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:36,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:36,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:36,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:36,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c992932ecfe2320a1afa HTTP/1.1" 200 None 2026-04-07 09:10:36,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:36,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9d1932ecfe2320a1be6 HTTP/1.1" 200 None 2026-04-07 09:10:36,228 - lava_callback - INFO - Completed processing callback for node 69d4c9d1932ecfe2320a1be6 2026-04-07 09:10:36,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9a5932ecfe2320a1b2b HTTP/1.1" 200 None 2026-04-07 09:10:36,283 - lava_callback - INFO - Completed processing callback for node 69d4c9a5932ecfe2320a1b2b 2026-04-07 09:10:36,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:36,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:36,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9d3932ecfe2320a1beb HTTP/1.1" 200 None 2026-04-07 09:10:36,418 - lava_callback - INFO - Completed processing callback for node 69d4c9d3932ecfe2320a1beb 2026-04-07 09:10:36,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c992932ecfe2320a1afa HTTP/1.1" 200 None 2026-04-07 09:10:36,446 - lava_callback - INFO - Completed processing callback for node 69d4c992932ecfe2320a1afa 2026-04-07 09:10:36,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:36,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98a932ecfe2320a1ad1/log.txt.gz 2026-04-07 09:10:36,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:36,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d4c9ce932ecfe2320a1bdb/lava-logs.yaml 2026-04-07 09:10:36,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:36,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d4c9cf932ecfe2320a1be0/log.txt.gz INFO: 172.20.0.1:60056 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:10:36,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:36,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:36,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:36,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:36,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d4c9ce932ecfe2320a1bdb/lava_callback.json.gz 2026-04-07 09:10:36,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:37,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9ce932ecfe2320a1bdb HTTP/1.1" 200 None 2026-04-07 09:10:37,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:37,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:37,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:37,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9ce932ecfe2320a1bdb HTTP/1.1" 200 None 2026-04-07 09:10:37,101 - lava_callback - INFO - Completed processing callback for node 69d4c9ce932ecfe2320a1bdb 2026-04-07 09:10:37,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:37,226 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d4c9cf932ecfe2320a1be0/lava-logs.yaml 2026-04-07 09:10:37,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:37,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:37,266 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98a932ecfe2320a1ad1/lava-logs.yaml 2026-04-07 09:10:37,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:37,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:37,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d4c9cf932ecfe2320a1be0/lava_callback.json.gz 2026-04-07 09:10:37,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:37,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:37,490 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98a932ecfe2320a1ad1/lava_callback.json.gz 2026-04-07 09:10:37,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:37,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9cf932ecfe2320a1be0 HTTP/1.1" 200 None 2026-04-07 09:10:37,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:37,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c98a932ecfe2320a1ad1 HTTP/1.1" 200 None 2026-04-07 09:10:37,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:37,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:37,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:37,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:37,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:37,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9cf932ecfe2320a1be0 HTTP/1.1" 200 None 2026-04-07 09:10:37,623 - lava_callback - INFO - Completed processing callback for node 69d4c9cf932ecfe2320a1be0 2026-04-07 09:10:37,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c98a932ecfe2320a1ad1 HTTP/1.1" 200 None 2026-04-07 09:10:37,744 - lava_callback - INFO - Completed processing callback for node 69d4c98a932ecfe2320a1ad1 2026-04-07 09:10:44,394 - lava_callback - INFO - Received callback for node 69d4c9d0932ecfe2320a1be3 INFO: 172.20.0.1:48938 - "POST /node/69d4c9d0932ecfe2320a1be3 HTTP/1.0" 202 Accepted 2026-04-07 09:10:44,400 - lava_callback - INFO - Starting async job submit for node 69d4c9d0932ecfe2320a1be3 2026-04-07 09:10:44,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:44,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9d0932ecfe2320a1be3 HTTP/1.1" 200 None 2026-04-07 09:10:44,435 - lava_callback - DEBUG - Processing node 69d4c9d0932ecfe2320a1be3: baseline-arm64-pengutronix 2026-04-07 09:10:44,475 - lava_callback - INFO - Received callback for node 69d4c99c932ecfe2320a1b16 INFO: 172.20.0.1:48940 - "POST /node/69d4c99c932ecfe2320a1b16 HTTP/1.0" 202 Accepted 2026-04-07 09:10:44,502 - lava_callback - INFO - Starting async job submit for node 69d4c99c932ecfe2320a1b16 2026-04-07 09:10:44,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:44,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c99c932ecfe2320a1b16 HTTP/1.1" 200 None 2026-04-07 09:10:44,667 - lava_callback - DEBUG - Processing node 69d4c99c932ecfe2320a1b16: baseline-nfs-arm64 2026-04-07 09:10:44,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:44,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:45,027 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d4c9d0932ecfe2320a1be3/log.txt.gz 2026-04-07 09:10:45,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:45,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:45,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:45,346 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c99c932ecfe2320a1b16/log.txt.gz 2026-04-07 09:10:45,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:45,451 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d4c9d0932ecfe2320a1be3/lava-logs.yaml 2026-04-07 09:10:45,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:45,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:45,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:45,720 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d4c9d0932ecfe2320a1be3/lava_callback.json.gz 2026-04-07 09:10:45,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:45,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9d0932ecfe2320a1be3 HTTP/1.1" 200 None 2026-04-07 09:10:45,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:45,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:45,778 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c99c932ecfe2320a1b16/lava-logs.yaml 2026-04-07 09:10:45,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:45,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:45,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:45,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9d0932ecfe2320a1be3 HTTP/1.1" 200 None 2026-04-07 09:10:45,812 - lava_callback - INFO - Completed processing callback for node 69d4c9d0932ecfe2320a1be3 2026-04-07 09:10:45,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:45,997 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c99c932ecfe2320a1b16/lava_callback.json.gz 2026-04-07 09:10:46,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:46,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c99c932ecfe2320a1b16 HTTP/1.1" 200 None 2026-04-07 09:10:46,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:46,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:10:46,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:46,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c99c932ecfe2320a1b16 HTTP/1.1" 200 None 2026-04-07 09:10:46,080 - lava_callback - INFO - Completed processing callback for node 69d4c99c932ecfe2320a1b16 INFO: 172.20.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53974 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:10:56,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:56,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-07 09:10:58,959 - lava_callback - INFO - Received callback for node 69d4c993932ecfe2320a1afd INFO: 172.20.0.1:53978 - "POST /node/69d4c993932ecfe2320a1afd HTTP/1.0" 202 Accepted 2026-04-07 09:10:58,965 - lava_callback - INFO - Starting async job submit for node 69d4c993932ecfe2320a1afd 2026-04-07 09:10:58,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:10:59,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c993932ecfe2320a1afd HTTP/1.1" 200 None 2026-04-07 09:10:59,005 - lava_callback - DEBUG - Processing node 69d4c993932ecfe2320a1afd: baseline-arm64 2026-04-07 09:10:59,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:59,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:59,539 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c993932ecfe2320a1afd/log.txt.gz 2026-04-07 09:10:59,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:10:59,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:10:59,984 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c993932ecfe2320a1afd/lava-logs.yaml 2026-04-07 09:10:59,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:00,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:00,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c993932ecfe2320a1afd/lava_callback.json.gz 2026-04-07 09:11:00,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:00,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c993932ecfe2320a1afd HTTP/1.1" 200 None 2026-04-07 09:11:00,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:00,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:11:00,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:00,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c993932ecfe2320a1afd HTTP/1.1" 200 None 2026-04-07 09:11:00,301 - lava_callback - INFO - Completed processing callback for node 69d4c993932ecfe2320a1afd INFO: 172.20.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45620 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 09:11:15,677 - lava_callback - INFO - Received callback for node 69d4c9ba932ecfe2320a1b7b INFO: 172.20.0.1:45632 - "POST /node/69d4c9ba932ecfe2320a1b7b HTTP/1.0" 202 Accepted 2026-04-07 09:11:15,683 - lava_callback - INFO - Starting async job submit for node 69d4c9ba932ecfe2320a1b7b 2026-04-07 09:11:15,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:15,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9ba932ecfe2320a1b7b HTTP/1.1" 200 None 2026-04-07 09:11:15,721 - lava_callback - DEBUG - Processing node 69d4c9ba932ecfe2320a1b7b: baseline-arm64-broonie 2026-04-07 09:11:15,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:16,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:16,135 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9ba932ecfe2320a1b7b/log.txt.gz 2026-04-07 09:11:16,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:16,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:16,489 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9ba932ecfe2320a1b7b/lava-logs.yaml 2026-04-07 09:11:16,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:45638 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:11:16,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:16,632 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9ba932ecfe2320a1b7b/lava_callback.json.gz 2026-04-07 09:11:16,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:16,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9ba932ecfe2320a1b7b HTTP/1.1" 200 None 2026-04-07 09:11:16,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:16,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:11:16,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:16,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9ba932ecfe2320a1b7b HTTP/1.1" 200 None 2026-04-07 09:11:16,714 - lava_callback - INFO - Completed processing callback for node 69d4c9ba932ecfe2320a1b7b 2026-04-07 09:11:17,154 - lava_callback - INFO - Received callback for node 69d4c9bb932ecfe2320a1b7e INFO: 172.20.0.1:45644 - "POST /node/69d4c9bb932ecfe2320a1b7e HTTP/1.0" 202 Accepted 2026-04-07 09:11:17,164 - lava_callback - INFO - Starting async job submit for node 69d4c9bb932ecfe2320a1b7e 2026-04-07 09:11:17,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:17,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9bb932ecfe2320a1b7e HTTP/1.1" 200 None 2026-04-07 09:11:17,207 - lava_callback - DEBUG - Processing node 69d4c9bb932ecfe2320a1b7e: baseline-arm64-broonie 2026-04-07 09:11:17,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:17,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:17,596 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9bb932ecfe2320a1b7e/log.txt.gz 2026-04-07 09:11:17,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:45648 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:11:17,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:17,942 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9bb932ecfe2320a1b7e/lava-logs.yaml 2026-04-07 09:11:17,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:18,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:18,086 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9bb932ecfe2320a1b7e/lava_callback.json.gz 2026-04-07 09:11:18,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:18,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9bb932ecfe2320a1b7e HTTP/1.1" 200 None 2026-04-07 09:11:18,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:18,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:11:18,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:18,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9bb932ecfe2320a1b7e HTTP/1.1" 200 None 2026-04-07 09:11:18,179 - lava_callback - INFO - Completed processing callback for node 69d4c9bb932ecfe2320a1b7e 2026-04-07 09:11:20,890 - lava_callback - INFO - Received callback for node 69d4c99f932ecfe2320a1b1c INFO: 172.20.0.1:51604 - "POST /node/69d4c99f932ecfe2320a1b1c HTTP/1.0" 202 Accepted 2026-04-07 09:11:20,897 - lava_callback - INFO - Starting async job submit for node 69d4c99f932ecfe2320a1b1c 2026-04-07 09:11:20,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:20,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c99f932ecfe2320a1b1c HTTP/1.1" 200 None 2026-04-07 09:11:20,934 - lava_callback - DEBUG - Processing node 69d4c99f932ecfe2320a1b1c: baseline-nfs-arm64 2026-04-07 09:11:21,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:21,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:21,380 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c99f932ecfe2320a1b1c/log.txt.gz 2026-04-07 09:11:21,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:21,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:21,795 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c99f932ecfe2320a1b1c/lava-logs.yaml 2026-04-07 09:11:21,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:21,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:21,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c99f932ecfe2320a1b1c/lava_callback.json.gz 2026-04-07 09:11:21,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:21,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c99f932ecfe2320a1b1c HTTP/1.1" 200 None 2026-04-07 09:11:21,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:22,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:11:22,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:22,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c99f932ecfe2320a1b1c HTTP/1.1" 200 None 2026-04-07 09:11:22,038 - lava_callback - INFO - Completed processing callback for node 69d4c99f932ecfe2320a1b1c 2026-04-07 09:11:22,596 - lava_callback - INFO - Received callback for node 69d4c9a9932ecfe2320a1b58 INFO: 172.20.0.1:51606 - "POST /node/69d4c9a9932ecfe2320a1b58 HTTP/1.0" 202 Accepted 2026-04-07 09:11:22,603 - lava_callback - INFO - Starting async job submit for node 69d4c9a9932ecfe2320a1b58 2026-04-07 09:11:22,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:22,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a9932ecfe2320a1b58 HTTP/1.1" 200 None 2026-04-07 09:11:22,642 - lava_callback - DEBUG - Processing node 69d4c9a9932ecfe2320a1b58: baseline-nfs-arm64 2026-04-07 09:11:23,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:23,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:23,177 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a9932ecfe2320a1b58/log.txt.gz 2026-04-07 09:11:23,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:23,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:23,590 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a9932ecfe2320a1b58/lava-logs.yaml 2026-04-07 09:11:23,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:23,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:23,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a9932ecfe2320a1b58/lava_callback.json.gz 2026-04-07 09:11:23,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:23,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a9932ecfe2320a1b58 HTTP/1.1" 200 None 2026-04-07 09:11:23,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:23,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:11:23,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:23,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9a9932ecfe2320a1b58 HTTP/1.1" 200 None 2026-04-07 09:11:23,857 - lava_callback - INFO - Completed processing callback for node 69d4c9a9932ecfe2320a1b58 INFO: 172.20.0.1:51608 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:11:26,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:26,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-07 09:11:29,010 - lava_callback - INFO - Received callback for node 69d4c995932ecfe2320a1b03 INFO: 172.20.0.1:51614 - "POST /node/69d4c995932ecfe2320a1b03 HTTP/1.0" 202 Accepted 2026-04-07 09:11:29,016 - lava_callback - INFO - Starting async job submit for node 69d4c995932ecfe2320a1b03 2026-04-07 09:11:29,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:29,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c995932ecfe2320a1b03 HTTP/1.1" 200 None 2026-04-07 09:11:29,055 - lava_callback - DEBUG - Processing node 69d4c995932ecfe2320a1b03: baseline-arm64 2026-04-07 09:11:29,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:29,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:29,405 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c995932ecfe2320a1b03/log.txt.gz 2026-04-07 09:11:29,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:29,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:29,725 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c995932ecfe2320a1b03/lava-logs.yaml 2026-04-07 09:11:29,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:29,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:29,907 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c995932ecfe2320a1b03/lava_callback.json.gz 2026-04-07 09:11:29,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:29,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c995932ecfe2320a1b03 HTTP/1.1" 200 None 2026-04-07 09:11:29,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:29,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:11:29,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:29,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c995932ecfe2320a1b03 HTTP/1.1" 200 None 2026-04-07 09:11:29,996 - lava_callback - INFO - Completed processing callback for node 69d4c995932ecfe2320a1b03 2026-04-07 09:11:35,655 - lava_callback - INFO - Received callback for node 69d4c9c0932ecfe2320a1b8b INFO: 172.20.0.1:39234 - "POST /node/69d4c9c0932ecfe2320a1b8b HTTP/1.0" 202 Accepted 2026-04-07 09:11:35,662 - lava_callback - INFO - Starting async job submit for node 69d4c9c0932ecfe2320a1b8b 2026-04-07 09:11:35,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:35,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c0932ecfe2320a1b8b HTTP/1.1" 200 None 2026-04-07 09:11:35,699 - lava_callback - DEBUG - Processing node 69d4c9c0932ecfe2320a1b8b: baseline-arm64-broonie 2026-04-07 09:11:35,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:36,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:36,196 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9c0932ecfe2320a1b8b/log.txt.gz 2026-04-07 09:11:36,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:39250 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:11:36,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:36,533 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9c0932ecfe2320a1b8b/lava-logs.yaml 2026-04-07 09:11:36,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:36,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:36,672 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9c0932ecfe2320a1b8b/lava_callback.json.gz 2026-04-07 09:11:36,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:36,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c0932ecfe2320a1b8b HTTP/1.1" 200 None 2026-04-07 09:11:36,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:36,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:11:36,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:36,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9c0932ecfe2320a1b8b HTTP/1.1" 200 None 2026-04-07 09:11:36,927 - lava_callback - INFO - Completed processing callback for node 69d4c9c0932ecfe2320a1b8b INFO: 172.20.0.1:48226 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:11:46,884 - lava_callback - INFO - Received callback for node 69d4c9b8932ecfe2320a1b74 INFO: 172.20.0.1:48228 - "POST /node/69d4c9b8932ecfe2320a1b74 HTTP/1.0" 202 Accepted 2026-04-07 09:11:46,890 - lava_callback - INFO - Starting async job submit for node 69d4c9b8932ecfe2320a1b74 2026-04-07 09:11:46,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:46,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9b8932ecfe2320a1b74 HTTP/1.1" 200 None 2026-04-07 09:11:46,928 - lava_callback - DEBUG - Processing node 69d4c9b8932ecfe2320a1b74: baseline-arm64-broonie 2026-04-07 09:11:47,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:47,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:47,300 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9b8932ecfe2320a1b74/log.txt.gz 2026-04-07 09:11:47,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:47,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:47,619 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9b8932ecfe2320a1b74/lava-logs.yaml 2026-04-07 09:11:47,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:47,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:47,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9b8932ecfe2320a1b74/lava_callback.json.gz 2026-04-07 09:11:47,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:47,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9b8932ecfe2320a1b74 HTTP/1.1" 200 None 2026-04-07 09:11:47,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:47,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:11:47,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:47,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9b8932ecfe2320a1b74 HTTP/1.1" 200 None 2026-04-07 09:11:47,886 - lava_callback - INFO - Completed processing callback for node 69d4c9b8932ecfe2320a1b74 2026-04-07 09:11:53,963 - lava_callback - INFO - Received callback for node 69d4c9a7932ecfe2320a1b31 INFO: 172.20.0.1:52592 - "POST /node/69d4c9a7932ecfe2320a1b31 HTTP/1.0" 202 Accepted 2026-04-07 09:11:53,970 - lava_callback - INFO - Starting async job submit for node 69d4c9a7932ecfe2320a1b31 2026-04-07 09:11:53,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:54,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a7932ecfe2320a1b31 HTTP/1.1" 200 None 2026-04-07 09:11:54,007 - lava_callback - DEBUG - Processing node 69d4c9a7932ecfe2320a1b31: baseline-nfs-arm64 2026-04-07 09:11:54,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:54,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:54,527 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a7932ecfe2320a1b31/log.txt.gz 2026-04-07 09:11:54,643 - lava_callback - INFO - Received callback for node 69d2274c0d94ee66016fbec1 INFO: 172.20.0.1:52598 - "POST /node/69d2274c0d94ee66016fbec1 HTTP/1.0" 202 Accepted 2026-04-07 09:11:54,659 - lava_callback - INFO - Starting async job submit for node 69d2274c0d94ee66016fbec1 2026-04-07 09:11:54,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:54,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2274c0d94ee66016fbec1 HTTP/1.1" 200 None 2026-04-07 09:11:54,745 - lava_callback - DEBUG - Processing node 69d2274c0d94ee66016fbec1: baseline-arm64-baylibre 2026-04-07 09:11:54,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2274c0d94ee66016fbec1 2026-04-07 09:11:54,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:54,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:54,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2274c0d94ee66016fbec1 HTTP/1.1" 200 None 2026-04-07 09:11:54,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:54,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 09:11:54,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:54,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2274c0d94ee66016fbec1 HTTP/1.1" 200 None 2026-04-07 09:11:54,818 - lava_callback - ERROR - Error processing callback for node 69d2274c0d94ee66016fbec1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 09:11:55,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:55,022 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a7932ecfe2320a1b31/lava-logs.yaml 2026-04-07 09:11:55,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:11:55,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:11:55,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a7932ecfe2320a1b31/lava_callback.json.gz 2026-04-07 09:11:55,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:55,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a7932ecfe2320a1b31 HTTP/1.1" 200 None 2026-04-07 09:11:55,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:55,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:11:55,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:55,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9a7932ecfe2320a1b31 HTTP/1.1" 200 None 2026-04-07 09:11:55,492 - lava_callback - INFO - Completed processing callback for node 69d4c9a7932ecfe2320a1b31 INFO: 172.20.0.1:52612 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:11:56,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:11:56,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:44278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58176 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:12:36,541 - lava_callback - INFO - Received callback for node 69d4c98e932ecfe2320a1af1 INFO: 172.20.0.1:58178 - "POST /node/69d4c98e932ecfe2320a1af1 HTTP/1.0" 202 Accepted 2026-04-07 09:12:36,547 - lava_callback - INFO - Starting async job submit for node 69d4c98e932ecfe2320a1af1 2026-04-07 09:12:36,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:12:36,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c98e932ecfe2320a1af1 HTTP/1.1" 200 None 2026-04-07 09:12:36,580 - lava_callback - DEBUG - Processing node 69d4c98e932ecfe2320a1af1: baseline-arm64 2026-04-07 09:12:36,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:12:37,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:12:37,068 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98e932ecfe2320a1af1/log.txt.gz 2026-04-07 09:12:37,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:12:37,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:12:37,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98e932ecfe2320a1af1/lava-logs.yaml 2026-04-07 09:12:37,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:12:37,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:12:37,646 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c98e932ecfe2320a1af1/lava_callback.json.gz 2026-04-07 09:12:37,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:12:37,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c98e932ecfe2320a1af1 HTTP/1.1" 200 None 2026-04-07 09:12:37,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:12:37,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:12:37,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:12:37,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c98e932ecfe2320a1af1 HTTP/1.1" 200 None 2026-04-07 09:12:37,720 - lava_callback - INFO - Completed processing callback for node 69d4c98e932ecfe2320a1af1 INFO: 172.20.0.1:38822 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:12:49,651 - lava_callback - INFO - Received callback for node 69d4c99d932ecfe2320a1b19 INFO: 172.20.0.1:38838 - "POST /node/69d4c99d932ecfe2320a1b19 HTTP/1.0" 202 Accepted 2026-04-07 09:12:49,657 - lava_callback - INFO - Starting async job submit for node 69d4c99d932ecfe2320a1b19 2026-04-07 09:12:49,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:12:49,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c99d932ecfe2320a1b19 HTTP/1.1" 200 None 2026-04-07 09:12:49,692 - lava_callback - DEBUG - Processing node 69d4c99d932ecfe2320a1b19: baseline-nfs-arm64 2026-04-07 09:12:50,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:12:50,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:12:50,286 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c99d932ecfe2320a1b19/log.txt.gz 2026-04-07 09:12:50,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:12:50,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:12:50,730 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c99d932ecfe2320a1b19/lava-logs.yaml 2026-04-07 09:12:50,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:12:50,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:12:50,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c99d932ecfe2320a1b19/lava_callback.json.gz 2026-04-07 09:12:50,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:12:50,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c99d932ecfe2320a1b19 HTTP/1.1" 200 None 2026-04-07 09:12:50,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:12:50,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:12:50,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:12:50,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c99d932ecfe2320a1b19 HTTP/1.1" 200 None 2026-04-07 09:12:50,992 - lava_callback - INFO - Completed processing callback for node 69d4c99d932ecfe2320a1b19 INFO: 172.20.0.1:33390 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:12:56,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:12:56,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39786 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:13:08,460 - lava_callback - INFO - Received callback for node 69d227940d94ee66016fbf0b INFO: 172.20.0.1:39792 - "POST /node/69d227940d94ee66016fbf0b HTTP/1.0" 202 Accepted 2026-04-07 09:13:08,466 - lava_callback - INFO - Starting async job submit for node 69d227940d94ee66016fbf0b 2026-04-07 09:13:08,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:13:08,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d227940d94ee66016fbf0b HTTP/1.1" 200 None 2026-04-07 09:13:08,482 - lava_callback - DEBUG - Processing node 69d227940d94ee66016fbf0b: baseline-arm64-clabbe 2026-04-07 09:13:08,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d227940d94ee66016fbf0b 2026-04-07 09:13:08,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:13:08,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d227940d94ee66016fbf0b HTTP/1.1" 200 None 2026-04-07 09:13:08,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:13:08,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 09:13:08,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:13:08,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d227940d94ee66016fbf0b HTTP/1.1" 200 None 2026-04-07 09:13:08,551 - lava_callback - ERROR - Error processing callback for node 69d227940d94ee66016fbf0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 09:13:12,009 - lava_callback - INFO - Received callback for node 69d4c9bd932ecfe2320a1b81 INFO: 172.20.0.1:53278 - "POST /node/69d4c9bd932ecfe2320a1b81 HTTP/1.0" 202 Accepted 2026-04-07 09:13:12,015 - lava_callback - INFO - Starting async job submit for node 69d4c9bd932ecfe2320a1b81 2026-04-07 09:13:12,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:13:12,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9bd932ecfe2320a1b81 HTTP/1.1" 200 None 2026-04-07 09:13:12,052 - lava_callback - DEBUG - Processing node 69d4c9bd932ecfe2320a1b81: baseline-arm64-broonie 2026-04-07 09:13:12,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:13:12,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:13:12,447 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9bd932ecfe2320a1b81/log.txt.gz 2026-04-07 09:13:12,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:13:12,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:13:12,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9bd932ecfe2320a1b81/lava-logs.yaml 2026-04-07 09:13:12,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:13:12,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:13:12,984 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9bd932ecfe2320a1b81/lava_callback.json.gz 2026-04-07 09:13:13,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:13:13,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9bd932ecfe2320a1b81 HTTP/1.1" 200 None 2026-04-07 09:13:13,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:13:13,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:13:13,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:13:13,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9bd932ecfe2320a1b81 HTTP/1.1" 200 None 2026-04-07 09:13:13,076 - lava_callback - INFO - Completed processing callback for node 69d4c9bd932ecfe2320a1b81 INFO: 172.20.0.1:53292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56750 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:13:26,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:13:27,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43830 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:14:08,423 - lava_callback - INFO - Received callback for node 69d227d30d94ee66016fbf54 INFO: 172.20.0.1:43842 - "POST /node/69d227d30d94ee66016fbf54 HTTP/1.0" 202 Accepted 2026-04-07 09:14:08,429 - lava_callback - INFO - Starting async job submit for node 69d227d30d94ee66016fbf54 2026-04-07 09:14:08,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:14:08,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d227d30d94ee66016fbf54 HTTP/1.1" 200 None 2026-04-07 09:14:08,456 - lava_callback - DEBUG - Processing node 69d227d30d94ee66016fbf54: baseline-arm64-clabbe 2026-04-07 09:14:08,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d227d30d94ee66016fbf54 2026-04-07 09:14:08,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:14:08,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d227d30d94ee66016fbf54 HTTP/1.1" 200 None 2026-04-07 09:14:08,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:14:08,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 09:14:08,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:14:08,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d227d30d94ee66016fbf54 HTTP/1.1" 200 None 2026-04-07 09:14:08,525 - lava_callback - ERROR - Error processing callback for node 69d227d30d94ee66016fbf54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42638 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:15:08,429 - lava_callback - INFO - Received callback for node 69d228150d94ee66016fbfab INFO: 172.20.0.1:42650 - "POST /node/69d228150d94ee66016fbfab HTTP/1.0" 202 Accepted 2026-04-07 09:15:08,435 - lava_callback - INFO - Starting async job submit for node 69d228150d94ee66016fbfab 2026-04-07 09:15:08,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:15:08,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d228150d94ee66016fbfab HTTP/1.1" 200 None 2026-04-07 09:15:08,450 - lava_callback - DEBUG - Processing node 69d228150d94ee66016fbfab: baseline-arm64-clabbe 2026-04-07 09:15:08,451 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d228150d94ee66016fbfab 2026-04-07 09:15:08,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:15:08,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d228150d94ee66016fbfab HTTP/1.1" 200 None 2026-04-07 09:15:08,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:15:08,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 09:15:08,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:15:08,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d228150d94ee66016fbfab HTTP/1.1" 200 None 2026-04-07 09:15:08,510 - lava_callback - ERROR - Error processing callback for node 69d228150d94ee66016fbfab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36718 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:16:07,152 - lava_callback - INFO - Received callback for node 69d4c9bf932ecfe2320a1b88 INFO: 172.20.0.1:36734 - "POST /node/69d4c9bf932ecfe2320a1b88 HTTP/1.0" 202 Accepted 2026-04-07 09:16:07,159 - lava_callback - INFO - Starting async job submit for node 69d4c9bf932ecfe2320a1b88 2026-04-07 09:16:07,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:16:07,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9bf932ecfe2320a1b88 HTTP/1.1" 200 None 2026-04-07 09:16:07,215 - lava_callback - DEBUG - Processing node 69d4c9bf932ecfe2320a1b88: baseline-arm64-broonie 2026-04-07 09:16:07,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:16:07,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:16:07,985 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9bf932ecfe2320a1b88/log.txt.gz 2026-04-07 09:16:08,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:16:08,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:16:08,517 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9bf932ecfe2320a1b88/lava-logs.yaml 2026-04-07 09:16:08,519 - lava_callback - INFO - Received callback for node 69d228550d94ee66016fbffc INFO: 172.20.0.1:36742 - "POST /node/69d228550d94ee66016fbffc HTTP/1.0" 202 Accepted 2026-04-07 09:16:08,527 - lava_callback - INFO - Starting async job submit for node 69d228550d94ee66016fbffc 2026-04-07 09:16:08,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:16:08,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:16:08,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d228550d94ee66016fbffc HTTP/1.1" 200 None 2026-04-07 09:16:08,547 - lava_callback - DEBUG - Processing node 69d228550d94ee66016fbffc: baseline-arm64-clabbe 2026-04-07 09:16:08,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d228550d94ee66016fbffc 2026-04-07 09:16:08,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:16:08,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d228550d94ee66016fbffc HTTP/1.1" 200 None 2026-04-07 09:16:08,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:16:08,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 09:16:08,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:16:08,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d228550d94ee66016fbffc HTTP/1.1" 200 None 2026-04-07 09:16:08,605 - lava_callback - ERROR - Error processing callback for node 69d228550d94ee66016fbffc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 09:16:08,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:16:08,903 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4c9bf932ecfe2320a1b88/lava_callback.json.gz 2026-04-07 09:16:08,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:16:08,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9bf932ecfe2320a1b88 HTTP/1.1" 200 None 2026-04-07 09:16:08,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:16:08,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:16:08,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:16:08,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9bf932ecfe2320a1b88 HTTP/1.1" 200 None 2026-04-07 09:16:09,074 - lava_callback - INFO - Completed processing callback for node 69d4c9bf932ecfe2320a1b88 INFO: 172.20.0.1:60364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48016 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:16:27,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:16:27,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 09:16:33,721 - lava_callback - INFO - Received callback for node 69d4c9a1932ecfe2320a1b22 INFO: 172.20.0.1:46936 - "POST /node/69d4c9a1932ecfe2320a1b22 HTTP/1.0" 202 Accepted 2026-04-07 09:16:33,851 - lava_callback - INFO - Starting async job submit for node 69d4c9a1932ecfe2320a1b22 2026-04-07 09:16:33,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:16:33,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a1932ecfe2320a1b22 HTTP/1.1" 200 None 2026-04-07 09:16:33,935 - lava_callback - DEBUG - Processing node 69d4c9a1932ecfe2320a1b22: baseline-nfs-arm64 INFO: 172.20.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38838 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:17:21,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:17:22,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:17:22,046 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a1932ecfe2320a1b22/log.txt.gz INFO: 172.20.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54720 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:17:51,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:17:52,683 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:17:52,714 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a1932ecfe2320a1b22/lava-logs.yaml 2026-04-07 09:17:53,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:17:53,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:17:53,567 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a1932ecfe2320a1b22/lava_callback.json.gz 2026-04-07 09:17:53,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:17:53,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a1932ecfe2320a1b22 HTTP/1.1" 200 None 2026-04-07 09:17:53,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:17:53,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:17:53,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:17:53,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9a1932ecfe2320a1b22 HTTP/1.1" 200 None 2026-04-07 09:17:53,664 - lava_callback - INFO - Completed processing callback for node 69d4c9a1932ecfe2320a1b22 INFO: 172.20.0.1:44102 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:17:57,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:17:57,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42650 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:18:42,293 - lava_callback - INFO - Received callback for node 69d4c99b932ecfe2320a1b13 INFO: 172.20.0.1:45244 - "POST /node/69d4c99b932ecfe2320a1b13 HTTP/1.0" 202 Accepted 2026-04-07 09:18:42,300 - lava_callback - INFO - Starting async job submit for node 69d4c99b932ecfe2320a1b13 2026-04-07 09:18:42,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:18:42,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c99b932ecfe2320a1b13 HTTP/1.1" 200 None 2026-04-07 09:18:42,354 - lava_callback - DEBUG - Processing node 69d4c99b932ecfe2320a1b13: baseline-arm64 2026-04-07 09:18:42,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:18:42,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:18:42,866 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c99b932ecfe2320a1b13/log.txt.gz 2026-04-07 09:18:43,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:18:43,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:18:43,288 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c99b932ecfe2320a1b13/lava-logs.yaml 2026-04-07 09:18:43,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:18:43,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:18:43,463 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c99b932ecfe2320a1b13/lava_callback.json.gz DEBUG: Setup failed for 69d4c99b932ecfe2320a1b13. Transitting job node result: incomplete -> fail 2026-04-07 09:18:43,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:18:43,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c99b932ecfe2320a1b13 HTTP/1.1" 200 None 2026-04-07 09:18:43,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:18:43,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:18:43,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:18:43,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c99b932ecfe2320a1b13 HTTP/1.1" 200 None 2026-04-07 09:18:43,692 - lava_callback - INFO - Completed processing callback for node 69d4c99b932ecfe2320a1b13 INFO: 172.20.0.1:45254 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:18:48,687 - lava_callback - INFO - Received callback for node 69d228e40d94ee66016fc042 INFO: 172.20.0.1:45260 - "POST /node/69d228e40d94ee66016fc042 HTTP/1.0" 202 Accepted 2026-04-07 09:18:48,696 - lava_callback - INFO - Starting async job submit for node 69d228e40d94ee66016fc042 2026-04-07 09:18:48,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:18:48,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d228e40d94ee66016fc042 HTTP/1.1" 200 None 2026-04-07 09:18:48,723 - lava_callback - DEBUG - Processing node 69d228e40d94ee66016fc042: baseline-arm64-clabbe 2026-04-07 09:18:48,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d228e40d94ee66016fc042 2026-04-07 09:18:48,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:18:48,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d228e40d94ee66016fc042 HTTP/1.1" 200 None 2026-04-07 09:18:48,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:18:48,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 09:18:48,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:18:48,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d228e40d94ee66016fc042 HTTP/1.1" 200 None 2026-04-07 09:18:48,791 - lava_callback - ERROR - Error processing callback for node 69d228e40d94ee66016fc042: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33744 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:18:57,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:18:57,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52254 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:19:48,720 - lava_callback - INFO - Received callback for node 69d2292c0d94ee66016fc05e INFO: 172.20.0.1:52256 - "POST /node/69d2292c0d94ee66016fc05e HTTP/1.0" 202 Accepted 2026-04-07 09:19:48,725 - lava_callback - INFO - Starting async job submit for node 69d2292c0d94ee66016fc05e 2026-04-07 09:19:48,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:19:48,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2292c0d94ee66016fc05e HTTP/1.1" 200 None 2026-04-07 09:19:48,743 - lava_callback - DEBUG - Processing node 69d2292c0d94ee66016fc05e: baseline-arm64-clabbe 2026-04-07 09:19:48,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2292c0d94ee66016fc05e 2026-04-07 09:19:48,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:19:48,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2292c0d94ee66016fc05e HTTP/1.1" 200 None 2026-04-07 09:19:48,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:19:48,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 09:19:48,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:19:48,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2292c0d94ee66016fc05e HTTP/1.1" 200 None 2026-04-07 09:19:48,793 - lava_callback - ERROR - Error processing callback for node 69d2292c0d94ee66016fc05e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45886 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:20:07,167 - lava_callback - INFO - Received callback for node 69d4c996932ecfe2320a1b06 INFO: 172.20.0.1:45888 - "POST /node/69d4c996932ecfe2320a1b06 HTTP/1.0" 202 Accepted 2026-04-07 09:20:07,173 - lava_callback - INFO - Starting async job submit for node 69d4c996932ecfe2320a1b06 2026-04-07 09:20:07,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:20:07,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c996932ecfe2320a1b06 HTTP/1.1" 200 None 2026-04-07 09:20:07,220 - lava_callback - DEBUG - Processing node 69d4c996932ecfe2320a1b06: baseline-arm64 2026-04-07 09:20:07,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:20:07,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:20:07,864 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c996932ecfe2320a1b06/log.txt.gz 2026-04-07 09:20:08,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:20:08,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:20:08,336 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c996932ecfe2320a1b06/lava-logs.yaml 2026-04-07 09:20:08,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:20:08,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:20:08,551 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4c996932ecfe2320a1b06/lava_callback.json.gz 2026-04-07 09:20:08,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:20:08,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c996932ecfe2320a1b06 HTTP/1.1" 200 None 2026-04-07 09:20:08,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:20:08,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:20:08,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:20:08,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c996932ecfe2320a1b06 HTTP/1.1" 200 None 2026-04-07 09:20:08,729 - lava_callback - INFO - Completed processing callback for node 69d4c996932ecfe2320a1b06 INFO: 172.20.0.1:43436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43452 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:20:24,268 - lava_callback - INFO - Received callback for node 69d4c9a6932ecfe2320a1b2e INFO: 172.20.0.1:33370 - "POST /node/69d4c9a6932ecfe2320a1b2e HTTP/1.0" 202 Accepted 2026-04-07 09:20:24,274 - lava_callback - INFO - Starting async job submit for node 69d4c9a6932ecfe2320a1b2e 2026-04-07 09:20:24,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:20:24,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a6932ecfe2320a1b2e HTTP/1.1" 200 None 2026-04-07 09:20:24,318 - lava_callback - DEBUG - Processing node 69d4c9a6932ecfe2320a1b2e: baseline-nfs-arm64 2026-04-07 09:20:24,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:20:24,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:20:24,986 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a6932ecfe2320a1b2e/log.txt.gz 2026-04-07 09:20:25,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:20:25,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:20:25,530 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a6932ecfe2320a1b2e/lava-logs.yaml 2026-04-07 09:20:25,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:20:25,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:20:25,733 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a6932ecfe2320a1b2e/lava_callback.json.gz 2026-04-07 09:20:25,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:20:25,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a6932ecfe2320a1b2e HTTP/1.1" 200 None 2026-04-07 09:20:25,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:20:25,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:20:25,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:20:25,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9a6932ecfe2320a1b2e HTTP/1.1" 200 None 2026-04-07 09:20:25,875 - lava_callback - INFO - Completed processing callback for node 69d4c9a6932ecfe2320a1b2e INFO: 172.20.0.1:33372 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:20:27,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:20:27,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52812 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:22:55,317 - lava_callback - INFO - Received callback for node 69d229e70d94ee66016fc0f2 INFO: 172.20.0.1:58676 - "POST /node/69d229e70d94ee66016fc0f2 HTTP/1.0" 202 Accepted 2026-04-07 09:22:55,323 - lava_callback - INFO - Starting async job submit for node 69d229e70d94ee66016fc0f2 2026-04-07 09:22:55,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:22:55,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d229e70d94ee66016fc0f2 HTTP/1.1" 200 None 2026-04-07 09:22:55,344 - lava_callback - DEBUG - Processing node 69d229e70d94ee66016fc0f2: baseline-arm-baylibre 2026-04-07 09:22:55,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d229e70d94ee66016fc0f2 2026-04-07 09:22:55,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:22:55,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d229e70d94ee66016fc0f2 HTTP/1.1" 200 None 2026-04-07 09:22:55,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:22:55,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:22:55,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:22:55,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d229e70d94ee66016fc0f2 HTTP/1.1" 200 None 2026-04-07 09:22:55,399 - lava_callback - ERROR - Error processing callback for node 69d229e70d94ee66016fc0f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40092 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:23:35,181 - lava_callback - INFO - Received callback for node 69d22a070d94ee66016fc112 INFO: 172.20.0.1:54226 - "POST /node/69d22a070d94ee66016fc112 HTTP/1.0" 202 Accepted 2026-04-07 09:23:35,189 - lava_callback - INFO - Starting async job submit for node 69d22a070d94ee66016fc112 2026-04-07 09:23:35,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:23:35,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22a070d94ee66016fc112 HTTP/1.1" 200 None 2026-04-07 09:23:35,205 - lava_callback - DEBUG - Processing node 69d22a070d94ee66016fc112: baseline-arm-baylibre 2026-04-07 09:23:35,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22a070d94ee66016fc112 2026-04-07 09:23:35,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:23:35,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22a070d94ee66016fc112 HTTP/1.1" 200 None 2026-04-07 09:23:35,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:23:35,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:23:35,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:23:35,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22a070d94ee66016fc112 HTTP/1.1" 200 None 2026-04-07 09:23:35,277 - lava_callback - ERROR - Error processing callback for node 69d22a070d94ee66016fc112: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34004 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:23:55,158 - lava_callback - INFO - Received callback for node 69d22a270d94ee66016fc132 INFO: 172.20.0.1:52450 - "POST /node/69d22a270d94ee66016fc132 HTTP/1.0" 202 Accepted 2026-04-07 09:23:55,166 - lava_callback - INFO - Starting async job submit for node 69d22a270d94ee66016fc132 2026-04-07 09:23:55,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:23:55,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22a270d94ee66016fc132 HTTP/1.1" 200 None 2026-04-07 09:23:55,186 - lava_callback - DEBUG - Processing node 69d22a270d94ee66016fc132: baseline-arm-baylibre 2026-04-07 09:23:55,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22a270d94ee66016fc132 2026-04-07 09:23:55,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:23:55,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22a270d94ee66016fc132 HTTP/1.1" 200 None 2026-04-07 09:23:55,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:23:55,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:23:55,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:23:55,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22a270d94ee66016fc132 HTTP/1.1" 200 None 2026-04-07 09:23:55,248 - lava_callback - ERROR - Error processing callback for node 69d22a270d94ee66016fc132: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46002 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:24:35,251 - lava_callback - INFO - Received callback for node 69d22a4b0d94ee66016fc145 INFO: 172.20.0.1:50556 - "POST /node/69d22a4b0d94ee66016fc145 HTTP/1.0" 202 Accepted 2026-04-07 09:24:35,260 - lava_callback - INFO - Starting async job submit for node 69d22a4b0d94ee66016fc145 2026-04-07 09:24:35,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:24:35,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22a4b0d94ee66016fc145 HTTP/1.1" 200 None 2026-04-07 09:24:35,277 - lava_callback - DEBUG - Processing node 69d22a4b0d94ee66016fc145: baseline-arm-baylibre 2026-04-07 09:24:35,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22a4b0d94ee66016fc145 2026-04-07 09:24:35,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:24:35,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22a4b0d94ee66016fc145 HTTP/1.1" 200 None 2026-04-07 09:24:35,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:24:35,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:24:35,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:24:35,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22a4b0d94ee66016fc145 HTTP/1.1" 200 None 2026-04-07 09:24:35,371 - lava_callback - ERROR - Error processing callback for node 69d22a4b0d94ee66016fc145: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47282 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 09:25:15,254 - lava_callback - INFO - Received callback for node 69d22a6d0d94ee66016fc15e INFO: 172.20.0.1:47296 - "POST /node/69d22a6d0d94ee66016fc15e HTTP/1.0" 202 Accepted 2026-04-07 09:25:15,263 - lava_callback - INFO - Starting async job submit for node 69d22a6d0d94ee66016fc15e 2026-04-07 09:25:15,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:25:15,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22a6d0d94ee66016fc15e HTTP/1.1" 200 None 2026-04-07 09:25:15,286 - lava_callback - DEBUG - Processing node 69d22a6d0d94ee66016fc15e: baseline-arm-baylibre 2026-04-07 09:25:15,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22a6d0d94ee66016fc15e 2026-04-07 09:25:15,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:25:15,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22a6d0d94ee66016fc15e HTTP/1.1" 200 None 2026-04-07 09:25:15,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:25:15,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:25:15,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:25:15,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22a6d0d94ee66016fc15e HTTP/1.1" 200 None 2026-04-07 09:25:15,345 - lava_callback - ERROR - Error processing callback for node 69d22a6d0d94ee66016fc15e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36632 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:25:35,262 - lava_callback - INFO - Received callback for node 69d22a8b0d94ee66016fc17a INFO: 172.20.0.1:60724 - "POST /node/69d22a8b0d94ee66016fc17a HTTP/1.0" 202 Accepted 2026-04-07 09:25:35,272 - lava_callback - INFO - Starting async job submit for node 69d22a8b0d94ee66016fc17a 2026-04-07 09:25:35,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:25:35,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22a8b0d94ee66016fc17a HTTP/1.1" 200 None 2026-04-07 09:25:35,289 - lava_callback - DEBUG - Processing node 69d22a8b0d94ee66016fc17a: baseline-arm-baylibre 2026-04-07 09:25:35,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22a8b0d94ee66016fc17a 2026-04-07 09:25:35,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:25:35,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22a8b0d94ee66016fc17a HTTP/1.1" 200 None 2026-04-07 09:25:35,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:25:35,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:25:35,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:25:35,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22a8b0d94ee66016fc17a HTTP/1.1" 200 None 2026-04-07 09:25:35,353 - lava_callback - ERROR - Error processing callback for node 69d22a8b0d94ee66016fc17a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46520 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:26:29,008 - lava_callback - INFO - Received callback for node 69d22aaf0d94ee66016fc1a1 INFO: 172.20.0.1:46522 - "POST /node/69d22aaf0d94ee66016fc1a1 HTTP/1.0" 202 Accepted 2026-04-07 09:26:29,015 - lava_callback - INFO - Starting async job submit for node 69d22aaf0d94ee66016fc1a1 2026-04-07 09:26:29,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:26:29,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22aaf0d94ee66016fc1a1 HTTP/1.1" 200 None 2026-04-07 09:26:29,036 - lava_callback - DEBUG - Processing node 69d22aaf0d94ee66016fc1a1: baseline-arm-clabbe 2026-04-07 09:26:29,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22aaf0d94ee66016fc1a1 2026-04-07 09:26:29,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:26:29,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22aaf0d94ee66016fc1a1 HTTP/1.1" 200 None 2026-04-07 09:26:29,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:26:29,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:26:29,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:26:29,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22aaf0d94ee66016fc1a1 HTTP/1.1" 200 None 2026-04-07 09:26:29,096 - lava_callback - ERROR - Error processing callback for node 69d22aaf0d94ee66016fc1a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37752 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:26:49,013 - lava_callback - INFO - Received callback for node 69d22ad00d94ee66016fc1b7 INFO: 172.20.0.1:37768 - "POST /node/69d22ad00d94ee66016fc1b7 HTTP/1.0" 202 Accepted 2026-04-07 09:26:49,019 - lava_callback - INFO - Starting async job submit for node 69d22ad00d94ee66016fc1b7 2026-04-07 09:26:49,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:26:49,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22ad00d94ee66016fc1b7 HTTP/1.1" 200 None 2026-04-07 09:26:49,036 - lava_callback - DEBUG - Processing node 69d22ad00d94ee66016fc1b7: baseline-arm-clabbe 2026-04-07 09:26:49,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22ad00d94ee66016fc1b7 2026-04-07 09:26:49,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:26:49,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22ad00d94ee66016fc1b7 HTTP/1.1" 200 None 2026-04-07 09:26:49,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:26:49,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:26:49,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:26:49,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22ad00d94ee66016fc1b7 HTTP/1.1" 200 None 2026-04-07 09:26:49,090 - lava_callback - ERROR - Error processing callback for node 69d22ad00d94ee66016fc1b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46306 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:27:29,006 - lava_callback - INFO - Received callback for node 69d22af40d94ee66016fc1e7 INFO: 172.20.0.1:46314 - "POST /node/69d22af40d94ee66016fc1e7 HTTP/1.0" 202 Accepted 2026-04-07 09:27:29,016 - lava_callback - INFO - Starting async job submit for node 69d22af40d94ee66016fc1e7 2026-04-07 09:27:29,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:27:29,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22af40d94ee66016fc1e7 HTTP/1.1" 200 None 2026-04-07 09:27:29,032 - lava_callback - DEBUG - Processing node 69d22af40d94ee66016fc1e7: baseline-arm-clabbe 2026-04-07 09:27:29,032 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22af40d94ee66016fc1e7 2026-04-07 09:27:29,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:27:29,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22af40d94ee66016fc1e7 HTTP/1.1" 200 None 2026-04-07 09:27:29,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:27:29,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:27:29,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:27:29,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22af40d94ee66016fc1e7 HTTP/1.1" 200 None 2026-04-07 09:27:29,096 - lava_callback - ERROR - Error processing callback for node 69d22af40d94ee66016fc1e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48106 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:28:09,006 - lava_callback - INFO - Received callback for node 69d22b180d94ee66016fc1fa INFO: 172.20.0.1:48118 - "POST /node/69d22b180d94ee66016fc1fa HTTP/1.0" 202 Accepted 2026-04-07 09:28:09,011 - lava_callback - INFO - Starting async job submit for node 69d22b180d94ee66016fc1fa 2026-04-07 09:28:09,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:28:09,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22b180d94ee66016fc1fa HTTP/1.1" 200 None 2026-04-07 09:28:09,028 - lava_callback - DEBUG - Processing node 69d22b180d94ee66016fc1fa: baseline-arm-clabbe 2026-04-07 09:28:09,028 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22b180d94ee66016fc1fa 2026-04-07 09:28:09,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:28:09,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22b180d94ee66016fc1fa HTTP/1.1" 200 None 2026-04-07 09:28:09,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:28:09,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:28:09,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:28:09,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22b180d94ee66016fc1fa HTTP/1.1" 200 None 2026-04-07 09:28:09,104 - lava_callback - ERROR - Error processing callback for node 69d22b180d94ee66016fc1fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58782 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:28:49,121 - lava_callback - INFO - Received callback for node 69d22b3d0d94ee66016fc202 INFO: 172.20.0.1:58794 - "POST /node/69d22b3d0d94ee66016fc202 HTTP/1.0" 202 Accepted 2026-04-07 09:28:49,126 - lava_callback - INFO - Starting async job submit for node 69d22b3d0d94ee66016fc202 2026-04-07 09:28:49,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:28:49,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22b3d0d94ee66016fc202 HTTP/1.1" 200 None 2026-04-07 09:28:49,148 - lava_callback - DEBUG - Processing node 69d22b3d0d94ee66016fc202: baseline-arm-clabbe 2026-04-07 09:28:49,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22b3d0d94ee66016fc202 2026-04-07 09:28:49,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:28:49,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22b3d0d94ee66016fc202 HTTP/1.1" 200 None 2026-04-07 09:28:49,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:28:49,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:28:49,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:28:49,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22b3d0d94ee66016fc202 HTTP/1.1" 200 None 2026-04-07 09:28:49,266 - lava_callback - ERROR - Error processing callback for node 69d22b3d0d94ee66016fc202: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46952 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:29:09,064 - lava_callback - INFO - Received callback for node 69d22b5f0d94ee66016fc20f INFO: 172.20.0.1:46956 - "POST /node/69d22b5f0d94ee66016fc20f HTTP/1.0" 202 Accepted 2026-04-07 09:29:09,070 - lava_callback - INFO - Starting async job submit for node 69d22b5f0d94ee66016fc20f 2026-04-07 09:29:09,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:09,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22b5f0d94ee66016fc20f HTTP/1.1" 200 None 2026-04-07 09:29:09,093 - lava_callback - DEBUG - Processing node 69d22b5f0d94ee66016fc20f: baseline-arm-clabbe 2026-04-07 09:29:09,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22b5f0d94ee66016fc20f 2026-04-07 09:29:09,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:09,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22b5f0d94ee66016fc20f HTTP/1.1" 200 None 2026-04-07 09:29:09,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:09,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:29:09,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:09,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22b5f0d94ee66016fc20f HTTP/1.1" 200 None 2026-04-07 09:29:09,168 - lava_callback - ERROR - Error processing callback for node 69d22b5f0d94ee66016fc20f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56262 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:29:28,354 - lava_callback - INFO - Received callback for node 69d4c9a3932ecfe2320a1b25 INFO: 172.20.0.1:56266 - "POST /node/69d4c9a3932ecfe2320a1b25 HTTP/1.0" 202 Accepted 2026-04-07 09:29:28,361 - lava_callback - INFO - Starting async job submit for node 69d4c9a3932ecfe2320a1b25 2026-04-07 09:29:28,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:28,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a3932ecfe2320a1b25 HTTP/1.1" 200 None 2026-04-07 09:29:28,415 - lava_callback - DEBUG - Processing node 69d4c9a3932ecfe2320a1b25: baseline-nfs-arm64 2026-04-07 09:29:29,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:29:29,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:29:29,238 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a3932ecfe2320a1b25/log.txt.gz 2026-04-07 09:29:29,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:29:29,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:29:29,933 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a3932ecfe2320a1b25/lava-logs.yaml 2026-04-07 09:29:29,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:29:30,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:29:30,141 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a3932ecfe2320a1b25/lava_callback.json.gz DEBUG: Setup failed for 69d4c9a3932ecfe2320a1b25. Transitting job node result: incomplete -> fail 2026-04-07 09:29:30,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:30,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a3932ecfe2320a1b25 HTTP/1.1" 200 None 2026-04-07 09:29:30,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:30,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:29:30,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:30,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9a3932ecfe2320a1b25 HTTP/1.1" 200 None 2026-04-07 09:29:30,357 - lava_callback - INFO - Completed processing callback for node 69d4c9a3932ecfe2320a1b25 2026-04-07 09:29:35,829 - lava_callback - INFO - Received callback for node 69d4c9a0932ecfe2320a1b1f INFO: 172.20.0.1:39624 - "POST /node/69d4c9a0932ecfe2320a1b1f HTTP/1.0" 202 Accepted 2026-04-07 09:29:35,837 - lava_callback - INFO - Starting async job submit for node 69d4c9a0932ecfe2320a1b1f 2026-04-07 09:29:35,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:35,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a0932ecfe2320a1b1f HTTP/1.1" 200 None 2026-04-07 09:29:35,916 - lava_callback - DEBUG - Processing node 69d4c9a0932ecfe2320a1b1f: baseline-nfs-arm64 INFO: 172.20.0.1:39630 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:29:37,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:29:37,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:29:37,190 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a0932ecfe2320a1b1f/log.txt.gz 2026-04-07 09:29:37,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:29:38,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:29:38,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a0932ecfe2320a1b1f/lava-logs.yaml 2026-04-07 09:29:38,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:29:38,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:29:38,372 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4c9a0932ecfe2320a1b1f/lava_callback.json.gz DEBUG: Setup failed for 69d4c9a0932ecfe2320a1b1f. Transitting job node result: incomplete -> fail 2026-04-07 09:29:38,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:38,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9a0932ecfe2320a1b1f HTTP/1.1" 200 None 2026-04-07 09:29:38,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:38,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:29:38,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:38,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9a0932ecfe2320a1b1f HTTP/1.1" 200 None 2026-04-07 09:29:38,627 - lava_callback - INFO - Completed processing callback for node 69d4c9a0932ecfe2320a1b1f INFO: 172.20.0.1:42400 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:29:49,146 - lava_callback - INFO - Received callback for node 69d22b7f0d94ee66016fc232 INFO: 172.20.0.1:42402 - "POST /node/69d22b7f0d94ee66016fc232 HTTP/1.0" 202 Accepted 2026-04-07 09:29:49,155 - lava_callback - INFO - Starting async job submit for node 69d22b7f0d94ee66016fc232 2026-04-07 09:29:49,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:49,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22b7f0d94ee66016fc232 HTTP/1.1" 200 None 2026-04-07 09:29:49,171 - lava_callback - DEBUG - Processing node 69d22b7f0d94ee66016fc232: baseline-arm-clabbe 2026-04-07 09:29:49,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22b7f0d94ee66016fc232 2026-04-07 09:29:49,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:49,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22b7f0d94ee66016fc232 HTTP/1.1" 200 None 2026-04-07 09:29:49,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:49,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 09:29:49,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:49,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22b7f0d94ee66016fc232 HTTP/1.1" 200 None 2026-04-07 09:29:49,234 - lava_callback - ERROR - Error processing callback for node 69d22b7f0d94ee66016fc232: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50628 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:29:57,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:29:57,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33078 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:30:13,838 - lava_callback - INFO - Received callback for node 69d4ce9f932ecfe2320a20c5 INFO: 172.20.0.1:51816 - "POST /node/69d4ce9f932ecfe2320a20c5 HTTP/1.0" 202 Accepted 2026-04-07 09:30:13,848 - lava_callback - INFO - Starting async job submit for node 69d4ce9f932ecfe2320a20c5 2026-04-07 09:30:13,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:30:13,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ce9f932ecfe2320a20c5 HTTP/1.1" 200 None 2026-04-07 09:30:13,869 - lava_callback - DEBUG - Processing node 69d4ce9f932ecfe2320a20c5: baseline-nfs-arm64 2026-04-07 09:30:13,871 - lava_callback - WARNING - Failed to upload log 2026-04-07 09:30:13,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:30:14,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:30:14,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4ce9f932ecfe2320a20c5/lava-logs.yaml 2026-04-07 09:30:14,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:30:14,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:30:14,186 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4ce9f932ecfe2320a20c5/lava_callback.json.gz 2026-04-07 09:30:14,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:30:14,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ce9f932ecfe2320a20c5 HTTP/1.1" 200 None 2026-04-07 09:30:14,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:30:14,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:30:14,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:30:14,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4ce9f932ecfe2320a20c5 HTTP/1.1" 200 None 2026-04-07 09:30:14,257 - lava_callback - INFO - Completed processing callback for node 69d4ce9f932ecfe2320a20c5 INFO: 172.20.0.1:51822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49456 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:30:27,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:30:27,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 09:30:27,605 - lava_callback - INFO - Received callback for node 69d4ce66932ecfe2320a206c INFO: 172.20.0.1:49466 - "POST /node/69d4ce66932ecfe2320a206c HTTP/1.0" 202 Accepted 2026-04-07 09:30:27,611 - lava_callback - INFO - Starting async job submit for node 69d4ce66932ecfe2320a206c 2026-04-07 09:30:27,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:30:27,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ce66932ecfe2320a206c HTTP/1.1" 200 None 2026-04-07 09:30:27,649 - lava_callback - DEBUG - Processing node 69d4ce66932ecfe2320a206c: baseline-arm64-broonie 2026-04-07 09:30:27,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:30:28,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:30:28,044 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4ce66932ecfe2320a206c/log.txt.gz 2026-04-07 09:30:28,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:30:28,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:30:28,389 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4ce66932ecfe2320a206c/lava-logs.yaml 2026-04-07 09:30:28,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:30:28,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:30:28,573 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4ce66932ecfe2320a206c/lava_callback.json.gz 2026-04-07 09:30:28,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:30:28,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ce66932ecfe2320a206c HTTP/1.1" 200 None 2026-04-07 09:30:28,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:30:28,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:30:28,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:30:28,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4ce66932ecfe2320a206c HTTP/1.1" 200 None 2026-04-07 09:30:28,673 - lava_callback - INFO - Completed processing callback for node 69d4ce66932ecfe2320a206c INFO: 172.20.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57240 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:30:57,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:30:57,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55430 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:34:36,447 - lava_callback - INFO - Received callback for node 69d4cf39932ecfe2320a2115 INFO: 172.20.0.1:48150 - "POST /node/69d4cf39932ecfe2320a2115 HTTP/1.0" 202 Accepted 2026-04-07 09:34:36,453 - lava_callback - INFO - Starting async job submit for node 69d4cf39932ecfe2320a2115 2026-04-07 09:34:36,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:34:36,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cf39932ecfe2320a2115 HTTP/1.1" 200 None 2026-04-07 09:34:36,509 - lava_callback - DEBUG - Processing node 69d4cf39932ecfe2320a2115: baseline-arm64-broonie INFO: 172.20.0.1:48160 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:34:36,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:34:36,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:34:36,908 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4cf39932ecfe2320a2115/log.txt.gz 2026-04-07 09:34:37,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:34:37,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:34:37,261 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4cf39932ecfe2320a2115/lava-logs.yaml 2026-04-07 09:34:37,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:34:37,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:34:37,428 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4cf39932ecfe2320a2115/lava_callback.json.gz 2026-04-07 09:34:37,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:34:37,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cf39932ecfe2320a2115 HTTP/1.1" 200 None 2026-04-07 09:34:37,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:34:37,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:34:37,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:34:37,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cf39932ecfe2320a2115 HTTP/1.1" 200 None 2026-04-07 09:34:37,506 - lava_callback - INFO - Completed processing callback for node 69d4cf39932ecfe2320a2115 INFO: 172.20.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54088 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:34:57,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:34:57,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47808 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:35:56,633 - lava_callback - INFO - Received callback for node 69d4cf82932ecfe2320a212c INFO: 172.20.0.1:47814 - "POST /node/69d4cf82932ecfe2320a212c HTTP/1.0" 202 Accepted 2026-04-07 09:35:56,639 - lava_callback - INFO - Starting async job submit for node 69d4cf82932ecfe2320a212c 2026-04-07 09:35:56,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:35:56,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cf82932ecfe2320a212c HTTP/1.1" 200 None 2026-04-07 09:35:56,677 - lava_callback - DEBUG - Processing node 69d4cf82932ecfe2320a212c: baseline-arm64-broonie 2026-04-07 09:35:56,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:35:57,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:35:57,092 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4cf82932ecfe2320a212c/log.txt.gz 2026-04-07 09:35:57,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:35:57,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:35:57,449 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4cf82932ecfe2320a212c/lava-logs.yaml 2026-04-07 09:35:57,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:35:57,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:35:57,644 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4cf82932ecfe2320a212c/lava_callback.json.gz 2026-04-07 09:35:57,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:35:57,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cf82932ecfe2320a212c HTTP/1.1" 200 None 2026-04-07 09:35:57,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:35:57,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:35:57,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:35:57,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cf82932ecfe2320a212c HTTP/1.1" 200 None 2026-04-07 09:35:57,746 - lava_callback - INFO - Completed processing callback for node 69d4cf82932ecfe2320a212c INFO: 172.20.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56384 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:36:27,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:36:27,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43728 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:37:16,800 - lava_callback - INFO - Received callback for node 69d4cff6932ecfe2320a218b INFO: 172.20.0.1:43744 - "POST /node/69d4cff6932ecfe2320a218b HTTP/1.0" 202 Accepted 2026-04-07 09:37:16,807 - lava_callback - INFO - Starting async job submit for node 69d4cff6932ecfe2320a218b 2026-04-07 09:37:16,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:37:16,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cff6932ecfe2320a218b HTTP/1.1" 200 None 2026-04-07 09:37:16,861 - lava_callback - DEBUG - Processing node 69d4cff6932ecfe2320a218b: baseline-arm64 2026-04-07 09:37:17,011 - lava_callback - WARNING - Failed to upload log 2026-04-07 09:37:17,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:43748 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:37:21,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:37:21,120 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4cff6932ecfe2320a218b/lava-logs.yaml 2026-04-07 09:37:21,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:37:21,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:37:21,268 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4cff6932ecfe2320a218b/lava_callback.json.gz 2026-04-07 09:37:21,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:37:21,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cff6932ecfe2320a218b HTTP/1.1" 200 None 2026-04-07 09:37:21,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:37:21,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:37:21,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:37:21,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cff6932ecfe2320a218b HTTP/1.1" 200 None 2026-04-07 09:37:21,418 - lava_callback - INFO - Completed processing callback for node 69d4cff6932ecfe2320a218b INFO: 172.20.0.1:45414 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:37:27,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:37:27,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41808 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:37:58,224 - lava_callback - INFO - Received callback for node 69d4d03c932ecfe2320a21d7 INFO: 172.20.0.1:41820 - "POST /node/69d4d03c932ecfe2320a21d7 HTTP/1.0" 202 Accepted 2026-04-07 09:37:58,231 - lava_callback - INFO - Starting async job submit for node 69d4d03c932ecfe2320a21d7 2026-04-07 09:37:58,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:37:58,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d03c932ecfe2320a21d7 HTTP/1.1" 200 None 2026-04-07 09:37:58,276 - lava_callback - DEBUG - Processing node 69d4d03c932ecfe2320a21d7: baseline-arm64 2026-04-07 09:37:58,428 - lava_callback - WARNING - Failed to upload log 2026-04-07 09:37:58,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:37:58,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:37:58,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d03c932ecfe2320a21d7/lava-logs.yaml 2026-04-07 09:37:58,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:37:58,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:37:58,875 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d03c932ecfe2320a21d7/lava_callback.json.gz 2026-04-07 09:37:58,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:37:58,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d03c932ecfe2320a21d7 HTTP/1.1" 200 None 2026-04-07 09:37:58,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:37:58,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:37:58,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:37:58,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d03c932ecfe2320a21d7 HTTP/1.1" 200 None 2026-04-07 09:37:59,043 - lava_callback - INFO - Completed processing callback for node 69d4d03c932ecfe2320a21d7 INFO: 172.20.0.1:50364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40686 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:38:27,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:38:27,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 09:38:34,903 - lava_callback - INFO - Received callback for node 69d4cc66932ecfe2320a1ea2 INFO: 172.20.0.1:33190 - "POST /node/69d4cc66932ecfe2320a1ea2 HTTP/1.0" 202 Accepted 2026-04-07 09:38:34,910 - lava_callback - INFO - Starting async job submit for node 69d4cc66932ecfe2320a1ea2 2026-04-07 09:38:34,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:38:34,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cc66932ecfe2320a1ea2 HTTP/1.1" 200 None 2026-04-07 09:38:34,979 - lava_callback - DEBUG - Processing node 69d4cc66932ecfe2320a1ea2: baseline-arm 2026-04-07 09:38:35,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:38:35,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:38:35,772 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d4cc66932ecfe2320a1ea2/log.txt.gz 2026-04-07 09:38:36,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:38:36,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:38:36,463 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4cc66932ecfe2320a1ea2/lava-logs.yaml 2026-04-07 09:38:36,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:33196 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:38:36,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:38:36,657 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4cc66932ecfe2320a1ea2/lava_callback.json.gz DEBUG: Setup failed for 69d4cc66932ecfe2320a1ea2. Transitting job node result: incomplete -> fail 2026-04-07 09:38:36,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:38:36,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cc66932ecfe2320a1ea2 HTTP/1.1" 200 None 2026-04-07 09:38:36,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:38:36,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 09:38:36,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:38:36,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cc66932ecfe2320a1ea2 HTTP/1.1" 200 None 2026-04-07 09:38:36,966 - lava_callback - INFO - Completed processing callback for node 69d4cc66932ecfe2320a1ea2 INFO: 172.20.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60434 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:38:57,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:38:57,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36950 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:41:01,644 - lava_callback - INFO - Received callback for node 69d4d0c3932ecfe2320a2243 INFO: 172.20.0.1:50684 - "POST /node/69d4d0c3932ecfe2320a2243 HTTP/1.0" 202 Accepted 2026-04-07 09:41:01,651 - lava_callback - INFO - Starting async job submit for node 69d4d0c3932ecfe2320a2243 2026-04-07 09:41:01,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:01,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d0c3932ecfe2320a2243 HTTP/1.1" 200 None 2026-04-07 09:41:01,693 - lava_callback - DEBUG - Processing node 69d4d0c3932ecfe2320a2243: baseline-arm64 2026-04-07 09:41:01,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:41:02,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:41:02,163 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d0c3932ecfe2320a2243/log.txt.gz 2026-04-07 09:41:02,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:41:02,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:41:02,591 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d0c3932ecfe2320a2243/lava-logs.yaml 2026-04-07 09:41:02,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:41:02,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:41:02,759 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d0c3932ecfe2320a2243/lava_callback.json.gz 2026-04-07 09:41:02,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:02,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d0c3932ecfe2320a2243 HTTP/1.1" 200 None 2026-04-07 09:41:02,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:02,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:41:02,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:02,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d0c3932ecfe2320a2243 HTTP/1.1" 200 None 2026-04-07 09:41:02,936 - lava_callback - INFO - Completed processing callback for node 69d4d0c3932ecfe2320a2243 INFO: 172.20.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56982 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 09:41:15,981 - lava_callback - INFO - Received callback for node 69d4cd84932ecfe2320a1f7f INFO: 172.20.0.1:56998 - "POST /node/69d4cd84932ecfe2320a1f7f HTTP/1.0" 202 Accepted 2026-04-07 09:41:15,988 - lava_callback - INFO - Starting async job submit for node 69d4cd84932ecfe2320a1f7f 2026-04-07 09:41:16,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:16,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cd84932ecfe2320a1f7f HTTP/1.1" 200 None 2026-04-07 09:41:16,049 - lava_callback - DEBUG - Processing node 69d4cd84932ecfe2320a1f7f: baseline-x86 INFO: 172.20.0.1:57008 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:41:16,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:41:17,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:41:17,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d4cd84932ecfe2320a1f7f/log.txt.gz 2026-04-07 09:41:17,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:41:17,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:41:17,834 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d4cd84932ecfe2320a1f7f/lava-logs.yaml 2026-04-07 09:41:17,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:41:18,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:41:18,032 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d4cd84932ecfe2320a1f7f/lava_callback.json.gz DEBUG: Setup failed for 69d4cd84932ecfe2320a1f7f. Transitting job node result: incomplete -> fail 2026-04-07 09:41:18,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:18,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cd84932ecfe2320a1f7f HTTP/1.1" 200 None 2026-04-07 09:41:18,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:18,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd8d932ecfe2320a1035 HTTP/1.1" 200 None 2026-04-07 09:41:18,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:18,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cd84932ecfe2320a1f7f HTTP/1.1" 200 None 2026-04-07 09:41:18,264 - lava_callback - INFO - Completed processing callback for node 69d4cd84932ecfe2320a1f7f INFO: 172.20.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46032 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:41:27,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:27,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 09:41:34,378 - lava_callback - INFO - Received callback for node 69d4d10f932ecfe2320a2277 INFO: 172.20.0.1:33664 - "POST /node/69d4d10f932ecfe2320a2277 HTTP/1.0" 202 Accepted 2026-04-07 09:41:34,387 - lava_callback - INFO - Starting async job submit for node 69d4d10f932ecfe2320a2277 2026-04-07 09:41:34,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:34,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d10f932ecfe2320a2277 HTTP/1.1" 200 None 2026-04-07 09:41:34,432 - lava_callback - DEBUG - Processing node 69d4d10f932ecfe2320a2277: baseline-arm64 2026-04-07 09:41:34,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:41:35,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:41:35,052 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d10f932ecfe2320a2277/log.txt.gz 2026-04-07 09:41:35,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:41:35,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:41:35,488 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d10f932ecfe2320a2277/lava-logs.yaml 2026-04-07 09:41:35,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:41:35,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:41:35,627 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d10f932ecfe2320a2277/lava_callback.json.gz 2026-04-07 09:41:35,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:35,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d10f932ecfe2320a2277 HTTP/1.1" 200 None 2026-04-07 09:41:35,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:35,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:41:35,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:35,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d10f932ecfe2320a2277 HTTP/1.1" 200 None 2026-04-07 09:41:35,714 - lava_callback - INFO - Completed processing callback for node 69d4d10f932ecfe2320a2277 INFO: 172.20.0.1:33674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44014 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:41:57,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:41:57,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52446 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:42:42,863 - lava_callback - INFO - Received callback for node 69d4c21c932ecfe2320a1261 INFO: 172.20.0.1:51806 - "POST /node/69d4c21c932ecfe2320a1261 HTTP/1.0" 202 Accepted 2026-04-07 09:42:42,869 - lava_callback - INFO - Starting async job submit for node 69d4c21c932ecfe2320a1261 2026-04-07 09:42:42,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:42:42,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c21c932ecfe2320a1261 HTTP/1.1" 200 None 2026-04-07 09:42:42,906 - lava_callback - DEBUG - Processing node 69d4c21c932ecfe2320a1261: baseline-arm 2026-04-07 09:42:43,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:42:43,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:42:43,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c21c932ecfe2320a1261/log.txt.gz 2026-04-07 09:42:43,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:42:43,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:42:43,614 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c21c932ecfe2320a1261/lava-logs.yaml 2026-04-07 09:42:43,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:42:43,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:42:43,785 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4c21c932ecfe2320a1261/lava_callback.json.gz 2026-04-07 09:42:43,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:42:43,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c21c932ecfe2320a1261 HTTP/1.1" 200 None 2026-04-07 09:42:43,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:42:43,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 09:42:43,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:42:43,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c21c932ecfe2320a1261 HTTP/1.1" 200 None 2026-04-07 09:42:43,880 - lava_callback - INFO - Completed processing callback for node 69d4c21c932ecfe2320a1261 INFO: 172.20.0.1:51814 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:42:56,257 - lava_callback - INFO - Received callback for node 69d22e9b0d94ee66016fc4e6 INFO: 172.20.0.1:50228 - "POST /node/69d22e9b0d94ee66016fc4e6 HTTP/1.0" 202 Accepted 2026-04-07 09:42:56,266 - lava_callback - INFO - Starting async job submit for node 69d22e9b0d94ee66016fc4e6 2026-04-07 09:42:56,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:42:56,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22e9b0d94ee66016fc4e6 HTTP/1.1" 200 None 2026-04-07 09:42:56,281 - lava_callback - DEBUG - Processing node 69d22e9b0d94ee66016fc4e6: baseline-arm-baylibre 2026-04-07 09:42:56,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d22e9b0d94ee66016fc4e6 2026-04-07 09:42:56,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:42:56,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22e9b0d94ee66016fc4e6 HTTP/1.1" 200 None 2026-04-07 09:42:56,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:42:56,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-07 09:42:56,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:42:56,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22e9b0d94ee66016fc4e6 HTTP/1.1" 200 None 2026-04-07 09:42:56,351 - lava_callback - ERROR - Error processing callback for node 69d22e9b0d94ee66016fc4e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50230 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:42:57,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:42:57,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41318 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:44:25,660 - lava_callback - INFO - Received callback for node 69d4c255932ecfe2320a1321 INFO: 172.20.0.1:44020 - "POST /node/69d4c255932ecfe2320a1321 HTTP/1.0" 202 Accepted 2026-04-07 09:44:25,667 - lava_callback - INFO - Starting async job submit for node 69d4c255932ecfe2320a1321 2026-04-07 09:44:25,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:44:25,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c255932ecfe2320a1321 HTTP/1.1" 200 None 2026-04-07 09:44:25,713 - lava_callback - DEBUG - Processing node 69d4c255932ecfe2320a1321: ltp-dio 2026-04-07 09:44:26,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:44:26,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:44:26,271 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69d4c255932ecfe2320a1321/log.txt.gz 2026-04-07 09:44:26,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:44026 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:44:26,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:44:26,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69d4c255932ecfe2320a1321/lava-logs.yaml 2026-04-07 09:44:26,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:44:26,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:44:26,939 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69d4c255932ecfe2320a1321/lava_callback.json.gz 2026-04-07 09:44:26,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:44:26,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c255932ecfe2320a1321 HTTP/1.1" 200 None 2026-04-07 09:44:26,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:44:27,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 09:44:27,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:44:27,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c255932ecfe2320a1321 HTTP/1.1" 200 None 2026-04-07 09:44:27,043 - lava_callback - INFO - Completed processing callback for node 69d4c255932ecfe2320a1321 2026-04-07 09:44:27,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:44:27,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34004 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:49:16,668 - lava_callback - INFO - Received callback for node 69d2301b0d94ee66016fc5dc INFO: 172.20.0.1:34008 - "POST /node/69d2301b0d94ee66016fc5dc HTTP/1.0" 202 Accepted 2026-04-07 09:49:16,674 - lava_callback - INFO - Starting async job submit for node 69d2301b0d94ee66016fc5dc 2026-04-07 09:49:16,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:49:16,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2301b0d94ee66016fc5dc HTTP/1.1" 200 None 2026-04-07 09:49:16,690 - lava_callback - DEBUG - Processing node 69d2301b0d94ee66016fc5dc: baseline-arm-baylibre 2026-04-07 09:49:16,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2301b0d94ee66016fc5dc 2026-04-07 09:49:16,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:49:16,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2301b0d94ee66016fc5dc HTTP/1.1" 200 None 2026-04-07 09:49:16,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:49:16,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-07 09:49:16,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:49:16,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2301b0d94ee66016fc5dc HTTP/1.1" 200 None 2026-04-07 09:49:16,749 - lava_callback - ERROR - Error processing callback for node 69d2301b0d94ee66016fc5dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60486 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:49:56,518 - lava_callback - INFO - Received callback for node 69d230370d94ee66016fc5ea INFO: 172.20.0.1:60864 - "POST /node/69d230370d94ee66016fc5ea HTTP/1.0" 202 Accepted 2026-04-07 09:49:56,523 - lava_callback - INFO - Starting async job submit for node 69d230370d94ee66016fc5ea 2026-04-07 09:49:56,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:60878 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:49:56,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d230370d94ee66016fc5ea HTTP/1.1" 200 None 2026-04-07 09:49:56,545 - lava_callback - DEBUG - Processing node 69d230370d94ee66016fc5ea: baseline-arm-baylibre 2026-04-07 09:49:56,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d230370d94ee66016fc5ea 2026-04-07 09:49:56,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:49:56,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d230370d94ee66016fc5ea HTTP/1.1" 200 None 2026-04-07 09:49:56,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:49:56,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-07 09:49:56,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:49:56,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d230370d94ee66016fc5ea HTTP/1.1" 200 None 2026-04-07 09:49:56,609 - lava_callback - ERROR - Error processing callback for node 69d230370d94ee66016fc5ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35590 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:51:30,159 - lava_callback - INFO - Received callback for node 69d2309e0d94ee66016fc675 INFO: 172.20.0.1:39852 - "POST /node/69d2309e0d94ee66016fc675 HTTP/1.0" 202 Accepted 2026-04-07 09:51:30,165 - lava_callback - INFO - Starting async job submit for node 69d2309e0d94ee66016fc675 2026-04-07 09:51:30,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:51:30,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2309e0d94ee66016fc675 HTTP/1.1" 200 None 2026-04-07 09:51:30,182 - lava_callback - DEBUG - Processing node 69d2309e0d94ee66016fc675: baseline-arm-clabbe 2026-04-07 09:51:30,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2309e0d94ee66016fc675 2026-04-07 09:51:30,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:51:30,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2309e0d94ee66016fc675 HTTP/1.1" 200 None 2026-04-07 09:51:30,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:51:30,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-07 09:51:30,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:51:30,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2309e0d94ee66016fc675 HTTP/1.1" 200 None 2026-04-07 09:51:30,267 - lava_callback - ERROR - Error processing callback for node 69d2309e0d94ee66016fc675: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32794 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:52:10,154 - lava_callback - INFO - Received callback for node 69d230c20d94ee66016fc68c INFO: 172.20.0.1:43194 - "POST /node/69d230c20d94ee66016fc68c HTTP/1.0" 202 Accepted 2026-04-07 09:52:10,162 - lava_callback - INFO - Starting async job submit for node 69d230c20d94ee66016fc68c 2026-04-07 09:52:10,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:52:10,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d230c20d94ee66016fc68c HTTP/1.1" 200 None 2026-04-07 09:52:10,180 - lava_callback - DEBUG - Processing node 69d230c20d94ee66016fc68c: baseline-arm-clabbe 2026-04-07 09:52:10,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d230c20d94ee66016fc68c 2026-04-07 09:52:10,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:52:10,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d230c20d94ee66016fc68c HTTP/1.1" 200 None 2026-04-07 09:52:10,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:52:10,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-07 09:52:10,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:52:10,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d230c20d94ee66016fc68c HTTP/1.1" 200 None 2026-04-07 09:52:10,257 - lava_callback - ERROR - Error processing callback for node 69d230c20d94ee66016fc68c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40216 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:52:50,168 - lava_callback - INFO - Received callback for node 69d230e70d94ee66016fc698 INFO: 172.20.0.1:41522 - "POST /node/69d230e70d94ee66016fc698 HTTP/1.0" 202 Accepted 2026-04-07 09:52:50,174 - lava_callback - INFO - Starting async job submit for node 69d230e70d94ee66016fc698 2026-04-07 09:52:50,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:52:50,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d230e70d94ee66016fc698 HTTP/1.1" 200 None 2026-04-07 09:52:50,189 - lava_callback - DEBUG - Processing node 69d230e70d94ee66016fc698: baseline-arm-clabbe 2026-04-07 09:52:50,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d230e70d94ee66016fc698 2026-04-07 09:52:50,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:52:50,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d230e70d94ee66016fc698 HTTP/1.1" 200 None 2026-04-07 09:52:50,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:52:50,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-07 09:52:50,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:52:50,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d230e70d94ee66016fc698 HTTP/1.1" 200 None 2026-04-07 09:52:50,241 - lava_callback - ERROR - Error processing callback for node 69d230e70d94ee66016fc698: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43602 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:53:30,152 - lava_callback - INFO - Received callback for node 69d231060d94ee66016fc6aa INFO: 172.20.0.1:35636 - "POST /node/69d231060d94ee66016fc6aa HTTP/1.0" 202 Accepted 2026-04-07 09:53:30,158 - lava_callback - INFO - Starting async job submit for node 69d231060d94ee66016fc6aa 2026-04-07 09:53:30,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:53:30,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d231060d94ee66016fc6aa HTTP/1.1" 200 None 2026-04-07 09:53:30,174 - lava_callback - DEBUG - Processing node 69d231060d94ee66016fc6aa: baseline-arm-clabbe 2026-04-07 09:53:30,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d231060d94ee66016fc6aa 2026-04-07 09:53:30,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:53:30,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d231060d94ee66016fc6aa HTTP/1.1" 200 None 2026-04-07 09:53:30,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:53:30,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-07 09:53:30,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:53:30,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d231060d94ee66016fc6aa HTTP/1.1" 200 None 2026-04-07 09:53:30,246 - lava_callback - ERROR - Error processing callback for node 69d231060d94ee66016fc6aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46008 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:53:50,203 - lava_callback - INFO - Received callback for node 69d231230d94ee66016fc6d9 INFO: 172.20.0.1:44278 - "POST /node/69d231230d94ee66016fc6d9 HTTP/1.0" 202 Accepted 2026-04-07 09:53:50,209 - lava_callback - INFO - Starting async job submit for node 69d231230d94ee66016fc6d9 2026-04-07 09:53:50,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:53:50,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d231230d94ee66016fc6d9 HTTP/1.1" 200 None 2026-04-07 09:53:50,225 - lava_callback - DEBUG - Processing node 69d231230d94ee66016fc6d9: baseline-arm-clabbe 2026-04-07 09:53:50,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d231230d94ee66016fc6d9 2026-04-07 09:53:50,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:53:50,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d231230d94ee66016fc6d9 HTTP/1.1" 200 None 2026-04-07 09:53:50,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:53:50,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-07 09:53:50,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:53:50,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d231230d94ee66016fc6d9 HTTP/1.1" 200 None 2026-04-07 09:53:50,305 - lava_callback - ERROR - Error processing callback for node 69d231230d94ee66016fc6d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49018 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:54:36,808 - lava_callback - INFO - Received callback for node 69d2314c0d94ee66016fc715 INFO: 172.20.0.1:49034 - "POST /node/69d2314c0d94ee66016fc715 HTTP/1.0" 202 Accepted 2026-04-07 09:54:36,816 - lava_callback - INFO - Starting async job submit for node 69d2314c0d94ee66016fc715 2026-04-07 09:54:36,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:54:36,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2314c0d94ee66016fc715 HTTP/1.1" 200 None 2026-04-07 09:54:36,835 - lava_callback - DEBUG - Processing node 69d2314c0d94ee66016fc715: baseline-arm64-baylibre 2026-04-07 09:54:36,835 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2314c0d94ee66016fc715 2026-04-07 09:54:36,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:54:36,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2314c0d94ee66016fc715 HTTP/1.1" 200 None 2026-04-07 09:54:36,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:54:36,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-07 09:54:36,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:54:36,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2314c0d94ee66016fc715 HTTP/1.1" 200 None 2026-04-07 09:54:36,900 - lava_callback - ERROR - Error processing callback for node 69d2314c0d94ee66016fc715: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41784 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:55:36,814 - lava_callback - INFO - Received callback for node 69d2318c0d94ee66016fc75f INFO: 172.20.0.1:41798 - "POST /node/69d2318c0d94ee66016fc75f HTTP/1.0" 202 Accepted 2026-04-07 09:55:36,820 - lava_callback - INFO - Starting async job submit for node 69d2318c0d94ee66016fc75f 2026-04-07 09:55:36,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:55:36,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2318c0d94ee66016fc75f HTTP/1.1" 200 None 2026-04-07 09:55:36,836 - lava_callback - DEBUG - Processing node 69d2318c0d94ee66016fc75f: baseline-arm64-baylibre 2026-04-07 09:55:36,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2318c0d94ee66016fc75f 2026-04-07 09:55:36,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:55:36,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2318c0d94ee66016fc75f HTTP/1.1" 200 None 2026-04-07 09:55:36,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:55:36,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 09:55:36,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:55:36,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2318c0d94ee66016fc75f HTTP/1.1" 200 None 2026-04-07 09:55:36,886 - lava_callback - ERROR - Error processing callback for node 69d2318c0d94ee66016fc75f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58194 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:56:19,007 - lava_callback - INFO - Received callback for node 69d4d2f5932ecfe2320a2432 INFO: 172.20.0.1:58196 - "POST /node/69d4d2f5932ecfe2320a2432 HTTP/1.0" 202 Accepted 2026-04-07 09:56:19,015 - lava_callback - INFO - Starting async job submit for node 69d4d2f5932ecfe2320a2432 2026-04-07 09:56:19,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:56:19,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d2f5932ecfe2320a2432 HTTP/1.1" 200 None 2026-04-07 09:56:19,080 - lava_callback - DEBUG - Processing node 69d4d2f5932ecfe2320a2432: baseline-arm64 2026-04-07 09:56:19,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:56:19,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:56:19,666 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d2f5932ecfe2320a2432/log.txt.gz 2026-04-07 09:56:19,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:56:20,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:56:20,185 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d2f5932ecfe2320a2432/lava-logs.yaml 2026-04-07 09:56:20,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 09:56:20,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 09:56:20,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d2f5932ecfe2320a2432/lava_callback.json.gz DEBUG: Setup failed for 69d4d2f5932ecfe2320a2432. Transitting job node result: incomplete -> fail 2026-04-07 09:56:20,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:56:20,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d2f5932ecfe2320a2432 HTTP/1.1" 200 None 2026-04-07 09:56:20,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:56:20,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 09:56:20,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:56:20,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d2f5932ecfe2320a2432 HTTP/1.1" 200 None 2026-04-07 09:56:20,655 - lava_callback - INFO - Completed processing callback for node 69d4d2f5932ecfe2320a2432 INFO: 172.20.0.1:39854 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:56:27,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:56:27,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35502 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:56:56,950 - lava_callback - INFO - Received callback for node 69d231d60d94ee66016fc77c INFO: 172.20.0.1:35512 - "POST /node/69d231d60d94ee66016fc77c HTTP/1.0" 202 Accepted 2026-04-07 09:56:56,955 - lava_callback - INFO - Starting async job submit for node 69d231d60d94ee66016fc77c 2026-04-07 09:56:56,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:56:56,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d231d60d94ee66016fc77c HTTP/1.1" 200 None 2026-04-07 09:56:56,971 - lava_callback - DEBUG - Processing node 69d231d60d94ee66016fc77c: baseline-arm64-baylibre 2026-04-07 09:56:56,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d231d60d94ee66016fc77c 2026-04-07 09:56:56,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:56:56,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d231d60d94ee66016fc77c HTTP/1.1" 200 None 2026-04-07 09:56:56,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:56:57,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 09:56:57,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:56:57,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d231d60d94ee66016fc77c HTTP/1.1" 200 None 2026-04-07 09:56:57,041 - lava_callback - ERROR - Error processing callback for node 69d231d60d94ee66016fc77c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35954 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:57:56,937 - lava_callback - INFO - Received callback for node 69d2321e0d94ee66016fc7b3 INFO: 172.20.0.1:35964 - "POST /node/69d2321e0d94ee66016fc7b3 HTTP/1.0" 202 Accepted 2026-04-07 09:57:56,943 - lava_callback - INFO - Starting async job submit for node 69d2321e0d94ee66016fc7b3 2026-04-07 09:57:56,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:57:56,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2321e0d94ee66016fc7b3 HTTP/1.1" 200 None 2026-04-07 09:57:56,968 - lava_callback - DEBUG - Processing node 69d2321e0d94ee66016fc7b3: baseline-arm64-baylibre 2026-04-07 09:57:56,969 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2321e0d94ee66016fc7b3 2026-04-07 09:57:56,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:57:56,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2321e0d94ee66016fc7b3 HTTP/1.1" 200 None 2026-04-07 09:57:56,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:57:57,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 09:57:57,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:57:57,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2321e0d94ee66016fc7b3 HTTP/1.1" 200 None 2026-04-07 09:57:57,028 - lava_callback - ERROR - Error processing callback for node 69d2321e0d94ee66016fc7b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56202 - "GET / HTTP/1.0" 200 OK 2026-04-07 09:59:17,068 - lava_callback - INFO - Received callback for node 69d232650d94ee66016fc7d1 INFO: 172.20.0.1:56216 - "POST /node/69d232650d94ee66016fc7d1 HTTP/1.0" 202 Accepted 2026-04-07 09:59:17,076 - lava_callback - INFO - Starting async job submit for node 69d232650d94ee66016fc7d1 2026-04-07 09:59:17,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:59:17,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d232650d94ee66016fc7d1 HTTP/1.1" 200 None 2026-04-07 09:59:17,106 - lava_callback - DEBUG - Processing node 69d232650d94ee66016fc7d1: baseline-arm64-baylibre 2026-04-07 09:59:17,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d232650d94ee66016fc7d1 2026-04-07 09:59:17,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:59:17,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d232650d94ee66016fc7d1 HTTP/1.1" 200 None 2026-04-07 09:59:17,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:59:17,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 09:59:17,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 09:59:17,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d232650d94ee66016fc7d1 HTTP/1.1" 200 None 2026-04-07 09:59:17,179 - lava_callback - ERROR - Error processing callback for node 69d232650d94ee66016fc7d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35150 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:00:37,113 - lava_callback - INFO - Received callback for node 69d232b20d94ee66016fc7e6 INFO: 172.20.0.1:35166 - "POST /node/69d232b20d94ee66016fc7e6 HTTP/1.0" 202 Accepted 2026-04-07 10:00:37,119 - lava_callback - INFO - Starting async job submit for node 69d232b20d94ee66016fc7e6 2026-04-07 10:00:37,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:00:37,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d232b20d94ee66016fc7e6 HTTP/1.1" 200 None 2026-04-07 10:00:37,136 - lava_callback - DEBUG - Processing node 69d232b20d94ee66016fc7e6: baseline-arm64-baylibre 2026-04-07 10:00:37,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d232b20d94ee66016fc7e6 2026-04-07 10:00:37,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:00:37,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d232b20d94ee66016fc7e6 HTTP/1.1" 200 None 2026-04-07 10:00:37,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:00:37,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 10:00:37,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:00:37,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d232b20d94ee66016fc7e6 HTTP/1.1" 200 None 2026-04-07 10:00:37,194 - lava_callback - ERROR - Error processing callback for node 69d232b20d94ee66016fc7e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57442 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:01:50,627 - lava_callback - INFO - Received callback for node 69d233000d94ee66016fc81c INFO: 172.20.0.1:43652 - "POST /node/69d233000d94ee66016fc81c HTTP/1.0" 202 Accepted 2026-04-07 10:01:50,633 - lava_callback - INFO - Starting async job submit for node 69d233000d94ee66016fc81c 2026-04-07 10:01:50,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:01:50,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d233000d94ee66016fc81c HTTP/1.1" 200 None 2026-04-07 10:01:50,656 - lava_callback - DEBUG - Processing node 69d233000d94ee66016fc81c: baseline-arm64-clabbe 2026-04-07 10:01:50,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d233000d94ee66016fc81c 2026-04-07 10:01:50,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:01:50,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d233000d94ee66016fc81c HTTP/1.1" 200 None 2026-04-07 10:01:50,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:01:50,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 10:01:50,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:01:50,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d233000d94ee66016fc81c HTTP/1.1" 200 None 2026-04-07 10:01:50,712 - lava_callback - ERROR - Error processing callback for node 69d233000d94ee66016fc81c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58892 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:02:34,117 - lava_callback - INFO - Received callback for node 69d4d3ca932ecfe2320a24a9 INFO: 172.20.0.1:36026 - "POST /node/69d4d3ca932ecfe2320a24a9 HTTP/1.0" 202 Accepted 2026-04-07 10:02:34,123 - lava_callback - INFO - Starting async job submit for node 69d4d3ca932ecfe2320a24a9 2026-04-07 10:02:34,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:02:34,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d3ca932ecfe2320a24a9 HTTP/1.1" 200 None 2026-04-07 10:02:34,178 - lava_callback - DEBUG - Processing node 69d4d3ca932ecfe2320a24a9: baseline-arm64 2026-04-07 10:02:34,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:02:34,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:02:34,933 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d3ca932ecfe2320a24a9/log.txt.gz 2026-04-07 10:02:35,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:02:35,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:02:35,456 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d3ca932ecfe2320a24a9/lava-logs.yaml 2026-04-07 10:02:35,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:02:35,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:02:35,648 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d3ca932ecfe2320a24a9/lava_callback.json.gz 2026-04-07 10:02:35,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:02:35,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d3ca932ecfe2320a24a9 HTTP/1.1" 200 None 2026-04-07 10:02:35,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:02:35,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:02:35,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:02:35,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d3ca932ecfe2320a24a9 HTTP/1.1" 200 None 2026-04-07 10:02:35,780 - lava_callback - INFO - Completed processing callback for node 69d4d3ca932ecfe2320a24a9 INFO: 172.20.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60282 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:02:57,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:02:57,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39092 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:03:10,692 - lava_callback - INFO - Received callback for node 69d233490d94ee66016fc83b INFO: 172.20.0.1:34298 - "POST /node/69d233490d94ee66016fc83b HTTP/1.0" 202 Accepted 2026-04-07 10:03:10,698 - lava_callback - INFO - Starting async job submit for node 69d233490d94ee66016fc83b 2026-04-07 10:03:10,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:03:10,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d233490d94ee66016fc83b HTTP/1.1" 200 None 2026-04-07 10:03:10,715 - lava_callback - DEBUG - Processing node 69d233490d94ee66016fc83b: baseline-arm64-clabbe 2026-04-07 10:03:10,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d233490d94ee66016fc83b 2026-04-07 10:03:10,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:03:10,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d233490d94ee66016fc83b HTTP/1.1" 200 None 2026-04-07 10:03:10,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:03:10,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 10:03:10,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:03:10,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d233490d94ee66016fc83b HTTP/1.1" 200 None 2026-04-07 10:03:10,787 - lava_callback - ERROR - Error processing callback for node 69d233490d94ee66016fc83b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48676 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:04:05,551 - lava_callback - INFO - Received callback for node 69d4d417932ecfe2320a24c2 INFO: 172.20.0.1:38796 - "POST /node/69d4d417932ecfe2320a24c2 HTTP/1.0" 202 Accepted 2026-04-07 10:04:05,561 - lava_callback - INFO - Starting async job submit for node 69d4d417932ecfe2320a24c2 2026-04-07 10:04:05,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:04:05,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d417932ecfe2320a24c2 HTTP/1.1" 200 None 2026-04-07 10:04:05,615 - lava_callback - DEBUG - Processing node 69d4d417932ecfe2320a24c2: baseline-nfs-arm64 2026-04-07 10:04:06,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:38800 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:04:06,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:04:06,800 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4d417932ecfe2320a24c2/log.txt.gz 2026-04-07 10:04:07,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:04:07,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:04:07,406 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4d417932ecfe2320a24c2/lava-logs.yaml 2026-04-07 10:04:07,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:04:07,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:04:07,596 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4d417932ecfe2320a24c2/lava_callback.json.gz 2026-04-07 10:04:07,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:04:07,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d417932ecfe2320a24c2 HTTP/1.1" 200 None 2026-04-07 10:04:07,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:04:07,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:04:07,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:04:07,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d417932ecfe2320a24c2 HTTP/1.1" 200 None 2026-04-07 10:04:07,766 - lava_callback - INFO - Completed processing callback for node 69d4d417932ecfe2320a24c2 2026-04-07 10:04:10,677 - lava_callback - INFO - Received callback for node 69d2338d0d94ee66016fc86e INFO: 172.20.0.1:44416 - "POST /node/69d2338d0d94ee66016fc86e HTTP/1.0" 202 Accepted 2026-04-07 10:04:10,686 - lava_callback - INFO - Starting async job submit for node 69d2338d0d94ee66016fc86e 2026-04-07 10:04:10,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:04:10,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2338d0d94ee66016fc86e HTTP/1.1" 200 None 2026-04-07 10:04:10,709 - lava_callback - DEBUG - Processing node 69d2338d0d94ee66016fc86e: baseline-arm64-clabbe 2026-04-07 10:04:10,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2338d0d94ee66016fc86e 2026-04-07 10:04:10,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:04:10,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2338d0d94ee66016fc86e HTTP/1.1" 200 None 2026-04-07 10:04:10,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:04:10,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 10:04:10,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:04:10,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2338d0d94ee66016fc86e HTTP/1.1" 200 None 2026-04-07 10:04:10,783 - lava_callback - ERROR - Error processing callback for node 69d2338d0d94ee66016fc86e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35040 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:04:27,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:04:27,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36044 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:05:30,752 - lava_callback - INFO - Received callback for node 69d233d40d94ee66016fc890 INFO: 172.20.0.1:48090 - "POST /node/69d233d40d94ee66016fc890 HTTP/1.0" 202 Accepted 2026-04-07 10:05:30,758 - lava_callback - INFO - Starting async job submit for node 69d233d40d94ee66016fc890 2026-04-07 10:05:30,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:05:30,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d233d40d94ee66016fc890 HTTP/1.1" 200 None 2026-04-07 10:05:30,774 - lava_callback - DEBUG - Processing node 69d233d40d94ee66016fc890: baseline-arm64-clabbe 2026-04-07 10:05:30,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d233d40d94ee66016fc890 2026-04-07 10:05:30,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:05:30,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d233d40d94ee66016fc890 HTTP/1.1" 200 None 2026-04-07 10:05:30,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:05:30,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 10:05:30,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:05:30,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d233d40d94ee66016fc890 HTTP/1.1" 200 None 2026-04-07 10:05:30,826 - lava_callback - ERROR - Error processing callback for node 69d233d40d94ee66016fc890: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39388 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:06:30,823 - lava_callback - INFO - Received callback for node 69d234190d94ee66016fc8d6 INFO: 172.20.0.1:43996 - "POST /node/69d234190d94ee66016fc8d6 HTTP/1.0" 202 Accepted 2026-04-07 10:06:30,828 - lava_callback - INFO - Starting async job submit for node 69d234190d94ee66016fc8d6 2026-04-07 10:06:30,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:06:30,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d234190d94ee66016fc8d6 HTTP/1.1" 200 None 2026-04-07 10:06:30,844 - lava_callback - DEBUG - Processing node 69d234190d94ee66016fc8d6: baseline-arm64-clabbe 2026-04-07 10:06:30,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d234190d94ee66016fc8d6 2026-04-07 10:06:30,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:06:30,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d234190d94ee66016fc8d6 HTTP/1.1" 200 None 2026-04-07 10:06:30,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:06:30,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 10:06:30,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:06:30,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d234190d94ee66016fc8d6 HTTP/1.1" 200 None 2026-04-07 10:06:30,901 - lava_callback - ERROR - Error processing callback for node 69d234190d94ee66016fc8d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32918 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:07:12,969 - lava_callback - INFO - Received callback for node 69d4d6f9932ecfe2320a2708 INFO: 172.20.0.1:33056 - "POST /node/69d4d6f9932ecfe2320a2708 HTTP/1.0" 202 Accepted 2026-04-07 10:07:12,976 - lava_callback - INFO - Starting async job submit for node 69d4d6f9932ecfe2320a2708 2026-04-07 10:07:12,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:07:13,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d6f9932ecfe2320a2708 HTTP/1.1" 200 None 2026-04-07 10:07:13,014 - lava_callback - DEBUG - Processing node 69d4d6f9932ecfe2320a2708: baseline-nfs-arm64 2026-04-07 10:07:13,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:07:13,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:07:13,649 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4d6f9932ecfe2320a2708/log.txt.gz 2026-04-07 10:07:13,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:07:14,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:07:14,183 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4d6f9932ecfe2320a2708/lava-logs.yaml 2026-04-07 10:07:14,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:07:14,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:07:14,361 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4d6f9932ecfe2320a2708/lava_callback.json.gz 2026-04-07 10:07:14,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:07:14,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d6f9932ecfe2320a2708 HTTP/1.1" 200 None 2026-04-07 10:07:14,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:07:14,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:07:14,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:07:14,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d6f9932ecfe2320a2708 HTTP/1.1" 200 None 2026-04-07 10:07:14,446 - lava_callback - INFO - Completed processing callback for node 69d4d6f9932ecfe2320a2708 INFO: 172.20.0.1:33072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51594 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:07:27,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:07:27,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37538 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:08:50,937 - lava_callback - INFO - Received callback for node 69d2349f0d94ee66016fc95a INFO: 172.20.0.1:51966 - "POST /node/69d2349f0d94ee66016fc95a HTTP/1.0" 202 Accepted 2026-04-07 10:08:50,942 - lava_callback - INFO - Starting async job submit for node 69d2349f0d94ee66016fc95a 2026-04-07 10:08:50,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:08:50,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2349f0d94ee66016fc95a HTTP/1.1" 200 None 2026-04-07 10:08:50,966 - lava_callback - DEBUG - Processing node 69d2349f0d94ee66016fc95a: baseline-arm64-clabbe 2026-04-07 10:08:50,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2349f0d94ee66016fc95a 2026-04-07 10:08:50,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:08:50,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2349f0d94ee66016fc95a HTTP/1.1" 200 None 2026-04-07 10:08:50,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:08:51,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 10:08:51,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:08:51,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2349f0d94ee66016fc95a HTTP/1.1" 200 None 2026-04-07 10:08:51,040 - lava_callback - ERROR - Error processing callback for node 69d2349f0d94ee66016fc95a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51970 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:09:02,885 - lava_callback - INFO - Received callback for node 69d4d7a6932ecfe2320a2795 INFO: 172.20.0.1:33140 - "POST /node/69d4d7a6932ecfe2320a2795 HTTP/1.0" 202 Accepted 2026-04-07 10:09:02,891 - lava_callback - INFO - Starting async job submit for node 69d4d7a6932ecfe2320a2795 2026-04-07 10:09:02,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:09:02,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d7a6932ecfe2320a2795 HTTP/1.1" 200 None 2026-04-07 10:09:02,908 - lava_callback - DEBUG - Processing node 69d4d7a6932ecfe2320a2795: baseline-nfs-arm64 2026-04-07 10:09:02,910 - lava_callback - WARNING - Failed to upload log 2026-04-07 10:09:02,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:09:03,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:09:03,057 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4d7a6932ecfe2320a2795/lava-logs.yaml 2026-04-07 10:09:03,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:09:03,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:09:03,397 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4d7a6932ecfe2320a2795/lava_callback.json.gz 2026-04-07 10:09:03,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:09:03,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d7a6932ecfe2320a2795 HTTP/1.1" 200 None 2026-04-07 10:09:03,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:09:03,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:09:03,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:09:03,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d7a6932ecfe2320a2795 HTTP/1.1" 200 None 2026-04-07 10:09:03,475 - lava_callback - INFO - Completed processing callback for node 69d4d7a6932ecfe2320a2795 INFO: 172.20.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36288 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:09:27,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:09:27,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36150 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:10:39,486 - lava_callback - INFO - Received callback for node 69d4d7e6932ecfe2320a27bf INFO: 172.20.0.1:36160 - "POST /node/69d4d7e6932ecfe2320a27bf HTTP/1.0" 202 Accepted 2026-04-07 10:10:39,492 - lava_callback - INFO - Starting async job submit for node 69d4d7e6932ecfe2320a27bf 2026-04-07 10:10:39,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:10:39,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d7e6932ecfe2320a27bf HTTP/1.1" 200 None 2026-04-07 10:10:39,538 - lava_callback - DEBUG - Processing node 69d4d7e6932ecfe2320a27bf: baseline-arm64 2026-04-07 10:10:39,673 - lava_callback - WARNING - Failed to upload log 2026-04-07 10:10:39,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:10:39,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:10:39,976 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d7e6932ecfe2320a27bf/lava-logs.yaml 2026-04-07 10:10:39,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:10:40,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:10:40,105 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d7e6932ecfe2320a27bf/lava_callback.json.gz 2026-04-07 10:10:40,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:10:40,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d7e6932ecfe2320a27bf HTTP/1.1" 200 None 2026-04-07 10:10:40,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:10:40,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:10:40,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:10:40,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d7e6932ecfe2320a27bf HTTP/1.1" 200 None 2026-04-07 10:10:40,275 - lava_callback - INFO - Completed processing callback for node 69d4d7e6932ecfe2320a27bf INFO: 172.20.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48956 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:10:57,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:10:57,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50822 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:11:57,848 - lava_callback - INFO - Received callback for node 69d235600d94ee66016fc9f6 INFO: 172.20.0.1:50834 - "POST /node/69d235600d94ee66016fc9f6 HTTP/1.0" 202 Accepted 2026-04-07 10:11:57,854 - lava_callback - INFO - Starting async job submit for node 69d235600d94ee66016fc9f6 2026-04-07 10:11:57,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:11:57,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d235600d94ee66016fc9f6 HTTP/1.1" 200 None 2026-04-07 10:11:57,869 - lava_callback - DEBUG - Processing node 69d235600d94ee66016fc9f6: baseline-arm64-baylibre 2026-04-07 10:11:57,869 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d235600d94ee66016fc9f6 2026-04-07 10:11:57,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:11:57,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d235600d94ee66016fc9f6 HTTP/1.1" 200 None 2026-04-07 10:11:57,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:11:57,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-07 10:11:57,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:11:57,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d235600d94ee66016fc9f6 HTTP/1.1" 200 None 2026-04-07 10:11:57,944 - lava_callback - ERROR - Error processing callback for node 69d235600d94ee66016fc9f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 10:11:59,791 - lava_callback - INFO - Received callback for node 69d4d82c932ecfe2320a27f3 INFO: 172.20.0.1:50644 - "POST /node/69d4d82c932ecfe2320a27f3 HTTP/1.0" 202 Accepted 2026-04-07 10:11:59,798 - lava_callback - INFO - Starting async job submit for node 69d4d82c932ecfe2320a27f3 2026-04-07 10:11:59,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:11:59,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d82c932ecfe2320a27f3 HTTP/1.1" 200 None 2026-04-07 10:11:59,845 - lava_callback - DEBUG - Processing node 69d4d82c932ecfe2320a27f3: baseline-arm64 2026-04-07 10:11:59,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:12:00,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:12:00,160 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d82c932ecfe2320a27f3/log.txt.gz 2026-04-07 10:12:00,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:12:00,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:12:00,451 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d82c932ecfe2320a27f3/lava-logs.yaml 2026-04-07 10:12:00,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:12:00,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:12:00,600 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d82c932ecfe2320a27f3/lava_callback.json.gz 2026-04-07 10:12:00,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:12:00,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d82c932ecfe2320a27f3 HTTP/1.1" 200 None 2026-04-07 10:12:00,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:12:00,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:12:00,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:12:00,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d82c932ecfe2320a27f3 HTTP/1.1" 200 None 2026-04-07 10:12:00,754 - lava_callback - INFO - Completed processing callback for node 69d4d82c932ecfe2320a27f3 INFO: 172.20.0.1:50650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47372 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:12:27,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:12:27,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36558 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:14:09,049 - lava_callback - INFO - Received callback for node 69d4d895932ecfe2320a282b INFO: 172.20.0.1:36574 - "POST /node/69d4d895932ecfe2320a282b HTTP/1.0" 202 Accepted 2026-04-07 10:14:09,056 - lava_callback - INFO - Starting async job submit for node 69d4d895932ecfe2320a282b 2026-04-07 10:14:09,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:14:09,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d895932ecfe2320a282b HTTP/1.1" 200 None 2026-04-07 10:14:09,093 - lava_callback - DEBUG - Processing node 69d4d895932ecfe2320a282b: baseline-arm64 2026-04-07 10:14:09,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:14:09,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:14:09,461 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d895932ecfe2320a282b/log.txt.gz 2026-04-07 10:14:09,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:14:09,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:14:09,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d895932ecfe2320a282b/lava-logs.yaml 2026-04-07 10:14:09,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:14:09,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:14:09,997 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d895932ecfe2320a282b/lava_callback.json.gz 2026-04-07 10:14:10,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:14:10,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d895932ecfe2320a282b HTTP/1.1" 200 None 2026-04-07 10:14:10,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:14:10,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:14:10,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:14:10,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d895932ecfe2320a282b HTTP/1.1" 200 None 2026-04-07 10:14:10,104 - lava_callback - INFO - Completed processing callback for node 69d4d895932ecfe2320a282b INFO: 172.20.0.1:39596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39606 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:14:17,901 - lava_callback - INFO - Received callback for node 69d235e60d94ee66016fca85 INFO: 172.20.0.1:39610 - "POST /node/69d235e60d94ee66016fca85 HTTP/1.0" 202 Accepted 2026-04-07 10:14:17,907 - lava_callback - INFO - Starting async job submit for node 69d235e60d94ee66016fca85 2026-04-07 10:14:17,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:14:17,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d235e60d94ee66016fca85 HTTP/1.1" 200 None 2026-04-07 10:14:17,924 - lava_callback - DEBUG - Processing node 69d235e60d94ee66016fca85: baseline-arm64-baylibre 2026-04-07 10:14:17,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d235e60d94ee66016fca85 2026-04-07 10:14:17,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:14:17,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d235e60d94ee66016fca85 HTTP/1.1" 200 None 2026-04-07 10:14:17,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:14:17,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-07 10:14:17,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:14:17,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d235e60d94ee66016fca85 HTTP/1.1" 200 None 2026-04-07 10:14:17,996 - lava_callback - ERROR - Error processing callback for node 69d235e60d94ee66016fca85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35116 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:14:27,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:14:27,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54454 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 10:16:15,391 - lava_callback - INFO - Received callback for node 69d4d919932ecfe2320a285a INFO: 172.20.0.1:54460 - "POST /node/69d4d919932ecfe2320a285a HTTP/1.0" 202 Accepted 2026-04-07 10:16:15,397 - lava_callback - INFO - Starting async job submit for node 69d4d919932ecfe2320a285a 2026-04-07 10:16:15,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:16:15,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d919932ecfe2320a285a HTTP/1.1" 200 None 2026-04-07 10:16:15,431 - lava_callback - DEBUG - Processing node 69d4d919932ecfe2320a285a: baseline-x86 2026-04-07 10:16:15,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:16:15,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:16:15,975 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d4d919932ecfe2320a285a/log.txt.gz 2026-04-07 10:16:16,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:16:16,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:16:16,375 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d4d919932ecfe2320a285a/lava-logs.yaml 2026-04-07 10:16:16,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:54468 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:16:16,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:16:16,545 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d4d919932ecfe2320a285a/lava_callback.json.gz 2026-04-07 10:16:16,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:16:16,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d919932ecfe2320a285a HTTP/1.1" 200 None 2026-04-07 10:16:16,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:16:16,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd8d932ecfe2320a1035 HTTP/1.1" 200 None 2026-04-07 10:16:16,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:16:16,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d919932ecfe2320a285a HTTP/1.1" 200 None 2026-04-07 10:16:16,638 - lava_callback - INFO - Completed processing callback for node 69d4d919932ecfe2320a285a 2026-04-07 10:16:17,992 - lava_callback - INFO - Received callback for node 69d2366a0d94ee66016fcb00 INFO: 172.20.0.1:54470 - "POST /node/69d2366a0d94ee66016fcb00 HTTP/1.0" 202 Accepted 2026-04-07 10:16:17,998 - lava_callback - INFO - Starting async job submit for node 69d2366a0d94ee66016fcb00 2026-04-07 10:16:17,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:16:18,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2366a0d94ee66016fcb00 HTTP/1.1" 200 None 2026-04-07 10:16:18,016 - lava_callback - DEBUG - Processing node 69d2366a0d94ee66016fcb00: baseline-arm64-baylibre 2026-04-07 10:16:18,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2366a0d94ee66016fcb00 2026-04-07 10:16:18,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:16:18,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2366a0d94ee66016fcb00 HTTP/1.1" 200 None 2026-04-07 10:16:18,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:16:18,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-07 10:16:18,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:16:18,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2366a0d94ee66016fcb00 HTTP/1.1" 200 None 2026-04-07 10:16:18,076 - lava_callback - ERROR - Error processing callback for node 69d2366a0d94ee66016fcb00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45290 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:16:27,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:16:27,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49224 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:19:51,378 - lava_callback - INFO - Received callback for node 69d2373c0d94ee66016fcb9f INFO: 172.20.0.1:51124 - "POST /node/69d2373c0d94ee66016fcb9f HTTP/1.0" 202 Accepted 2026-04-07 10:19:51,384 - lava_callback - INFO - Starting async job submit for node 69d2373c0d94ee66016fcb9f 2026-04-07 10:19:51,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:19:51,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2373c0d94ee66016fcb9f HTTP/1.1" 200 None 2026-04-07 10:19:51,400 - lava_callback - DEBUG - Processing node 69d2373c0d94ee66016fcb9f: baseline-arm64-clabbe 2026-04-07 10:19:51,400 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2373c0d94ee66016fcb9f 2026-04-07 10:19:51,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:19:51,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2373c0d94ee66016fcb9f HTTP/1.1" 200 None 2026-04-07 10:19:51,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:19:51,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-07 10:19:51,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:19:51,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2373c0d94ee66016fcb9f HTTP/1.1" 200 None 2026-04-07 10:19:51,469 - lava_callback - ERROR - Error processing callback for node 69d2373c0d94ee66016fcb9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38122 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:21:40,579 - lava_callback - INFO - Received callback for node 69d4d96b932ecfe2320a2890 INFO: 172.20.0.1:55844 - "POST /node/69d4d96b932ecfe2320a2890 HTTP/1.0" 202 Accepted 2026-04-07 10:21:40,587 - lava_callback - INFO - Starting async job submit for node 69d4d96b932ecfe2320a2890 2026-04-07 10:21:40,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:21:40,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d96b932ecfe2320a2890 HTTP/1.1" 200 None 2026-04-07 10:21:40,638 - lava_callback - DEBUG - Processing node 69d4d96b932ecfe2320a2890: baseline-arm64 2026-04-07 10:21:41,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:21:41,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:21:41,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d96b932ecfe2320a2890/log.txt.gz 2026-04-07 10:21:41,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:21:41,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:21:41,653 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d96b932ecfe2320a2890/lava-logs.yaml 2026-04-07 10:21:41,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:21:41,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:21:41,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4d96b932ecfe2320a2890/lava_callback.json.gz DEBUG: Setup failed for 69d4d96b932ecfe2320a2890. Transitting job node result: incomplete -> fail 2026-04-07 10:21:41,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:21:41,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d96b932ecfe2320a2890 HTTP/1.1" 200 None 2026-04-07 10:21:41,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:21:41,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:21:41,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:21:41,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d96b932ecfe2320a2890 HTTP/1.1" 200 None 2026-04-07 10:21:42,093 - lava_callback - INFO - Completed processing callback for node 69d4d96b932ecfe2320a2890 INFO: 172.20.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43522 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:21:57,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:21:57,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37042 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:23:11,631 - lava_callback - INFO - Received callback for node 69d238080d94ee66016fcc52 INFO: 172.20.0.1:44656 - "POST /node/69d238080d94ee66016fcc52 HTTP/1.0" 202 Accepted 2026-04-07 10:23:11,636 - lava_callback - INFO - Starting async job submit for node 69d238080d94ee66016fcc52 2026-04-07 10:23:11,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:23:11,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d238080d94ee66016fcc52 HTTP/1.1" 200 None 2026-04-07 10:23:11,652 - lava_callback - DEBUG - Processing node 69d238080d94ee66016fcc52: baseline-arm64-clabbe 2026-04-07 10:23:11,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d238080d94ee66016fcc52 2026-04-07 10:23:11,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:23:11,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d238080d94ee66016fcc52 HTTP/1.1" 200 None 2026-04-07 10:23:11,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:23:11,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-07 10:23:11,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:23:11,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d238080d94ee66016fcc52 HTTP/1.1" 200 None 2026-04-07 10:23:11,728 - lava_callback - ERROR - Error processing callback for node 69d238080d94ee66016fcc52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55722 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:25:11,708 - lava_callback - INFO - Received callback for node 69d238730d94ee66016fcc8a INFO: 172.20.0.1:43556 - "POST /node/69d238730d94ee66016fcc8a HTTP/1.0" 202 Accepted 2026-04-07 10:25:11,714 - lava_callback - INFO - Starting async job submit for node 69d238730d94ee66016fcc8a 2026-04-07 10:25:11,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:25:11,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d238730d94ee66016fcc8a HTTP/1.1" 200 None 2026-04-07 10:25:11,729 - lava_callback - DEBUG - Processing node 69d238730d94ee66016fcc8a: baseline-arm64-clabbe 2026-04-07 10:25:11,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d238730d94ee66016fcc8a 2026-04-07 10:25:11,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:25:11,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d238730d94ee66016fcc8a HTTP/1.1" 200 None 2026-04-07 10:25:11,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:25:11,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-07 10:25:11,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:25:11,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d238730d94ee66016fcc8a HTTP/1.1" 200 None 2026-04-07 10:25:11,784 - lava_callback - ERROR - Error processing callback for node 69d238730d94ee66016fcc8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38626 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:26:11,687 - lava_callback - INFO - Received callback for node 69d238bc0d94ee66016fcc9f INFO: 172.20.0.1:41350 - "POST /node/69d238bc0d94ee66016fcc9f HTTP/1.0" 202 Accepted 2026-04-07 10:26:11,694 - lava_callback - INFO - Starting async job submit for node 69d238bc0d94ee66016fcc9f 2026-04-07 10:26:11,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:26:11,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d238bc0d94ee66016fcc9f HTTP/1.1" 200 None 2026-04-07 10:26:11,715 - lava_callback - DEBUG - Processing node 69d238bc0d94ee66016fcc9f: baseline-arm64-clabbe 2026-04-07 10:26:11,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d238bc0d94ee66016fcc9f 2026-04-07 10:26:11,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:26:11,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d238bc0d94ee66016fcc9f HTTP/1.1" 200 None 2026-04-07 10:26:11,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:26:11,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-07 10:26:11,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:26:11,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d238bc0d94ee66016fcc9f HTTP/1.1" 200 None 2026-04-07 10:26:11,771 - lava_callback - ERROR - Error processing callback for node 69d238bc0d94ee66016fcc9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58786 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:26:47,467 - lava_callback - INFO - Received callback for node 69d4d73c932ecfe2320a2735 INFO: 172.20.0.1:58790 - "POST /node/69d4d73c932ecfe2320a2735 HTTP/1.0" 202 Accepted 2026-04-07 10:26:47,475 - lava_callback - INFO - Starting async job submit for node 69d4d73c932ecfe2320a2735 2026-04-07 10:26:47,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:26:47,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d73c932ecfe2320a2735 HTTP/1.1" 200 None 2026-04-07 10:26:47,537 - lava_callback - DEBUG - Processing node 69d4d73c932ecfe2320a2735: baseline-nfs-arm64 2026-04-07 10:26:48,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:26:48,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:26:48,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4d73c932ecfe2320a2735/log.txt.gz 2026-04-07 10:26:49,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:26:49,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:26:49,658 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4d73c932ecfe2320a2735/lava-logs.yaml 2026-04-07 10:26:49,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:26:49,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:26:49,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4d73c932ecfe2320a2735/lava_callback.json.gz DEBUG: Setup failed for 69d4d73c932ecfe2320a2735. Transitting job node result: incomplete -> fail 2026-04-07 10:26:49,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:26:49,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d73c932ecfe2320a2735 HTTP/1.1" 200 None 2026-04-07 10:26:49,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:26:49,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:26:49,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:26:50,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d73c932ecfe2320a2735 HTTP/1.1" 200 None 2026-04-07 10:26:50,103 - lava_callback - INFO - Completed processing callback for node 69d4d73c932ecfe2320a2735 INFO: 172.20.0.1:37352 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:26:57,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:26:57,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39368 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:27:31,775 - lava_callback - INFO - Received callback for node 69d239020d94ee66016fccc5 INFO: 172.20.0.1:47216 - "POST /node/69d239020d94ee66016fccc5 HTTP/1.0" 202 Accepted 2026-04-07 10:27:31,781 - lava_callback - INFO - Starting async job submit for node 69d239020d94ee66016fccc5 2026-04-07 10:27:31,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:27:31,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d239020d94ee66016fccc5 HTTP/1.1" 200 None 2026-04-07 10:27:31,797 - lava_callback - DEBUG - Processing node 69d239020d94ee66016fccc5: baseline-arm64-clabbe 2026-04-07 10:27:31,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d239020d94ee66016fccc5 2026-04-07 10:27:31,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:27:31,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d239020d94ee66016fccc5 HTTP/1.1" 200 None 2026-04-07 10:27:31,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:27:31,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-07 10:27:31,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:27:31,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d239020d94ee66016fccc5 HTTP/1.1" 200 None 2026-04-07 10:27:31,863 - lava_callback - ERROR - Error processing callback for node 69d239020d94ee66016fccc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40424 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:28:31,783 - lava_callback - INFO - Received callback for node 69d239440d94ee66016fcd1f INFO: 172.20.0.1:45282 - "POST /node/69d239440d94ee66016fcd1f HTTP/1.0" 202 Accepted 2026-04-07 10:28:31,789 - lava_callback - INFO - Starting async job submit for node 69d239440d94ee66016fcd1f 2026-04-07 10:28:31,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:28:31,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d239440d94ee66016fcd1f HTTP/1.1" 200 None 2026-04-07 10:28:31,805 - lava_callback - DEBUG - Processing node 69d239440d94ee66016fcd1f: baseline-arm64-clabbe 2026-04-07 10:28:31,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d239440d94ee66016fcd1f 2026-04-07 10:28:31,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:28:31,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d239440d94ee66016fcd1f HTTP/1.1" 200 None 2026-04-07 10:28:31,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:28:31,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-07 10:28:31,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:28:31,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d239440d94ee66016fcd1f HTTP/1.1" 200 None 2026-04-07 10:28:31,868 - lava_callback - ERROR - Error processing callback for node 69d239440d94ee66016fcd1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40206 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:29:30,443 - lava_callback - INFO - Received callback for node 69d4d875932ecfe2320a2814 INFO: 172.20.0.1:48068 - "POST /node/69d4d875932ecfe2320a2814 HTTP/1.0" 202 Accepted 2026-04-07 10:29:30,450 - lava_callback - INFO - Starting async job submit for node 69d4d875932ecfe2320a2814 2026-04-07 10:29:30,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:29:30,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d875932ecfe2320a2814 HTTP/1.1" 200 None 2026-04-07 10:29:30,520 - lava_callback - DEBUG - Processing node 69d4d875932ecfe2320a2814: baseline-arm 2026-04-07 10:29:31,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:29:31,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:29:31,279 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d4d875932ecfe2320a2814/log.txt.gz 2026-04-07 10:29:31,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:29:31,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:29:31,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4d875932ecfe2320a2814/lava-logs.yaml 2026-04-07 10:29:31,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:29:32,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:29:32,087 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4d875932ecfe2320a2814/lava_callback.json.gz DEBUG: Setup failed for 69d4d875932ecfe2320a2814. Transitting job node result: incomplete -> fail 2026-04-07 10:29:32,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:29:32,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d875932ecfe2320a2814 HTTP/1.1" 200 None 2026-04-07 10:29:32,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:29:32,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 10:29:32,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:29:32,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d875932ecfe2320a2814 HTTP/1.1" 200 None 2026-04-07 10:29:32,387 - lava_callback - INFO - Completed processing callback for node 69d4d875932ecfe2320a2814 INFO: 172.20.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33502 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:29:57,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:29:57,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49498 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:32:09,901 - lava_callback - INFO - Received callback for node 69d4d91d932ecfe2320a285d INFO: 172.20.0.1:45390 - "POST /node/69d4d91d932ecfe2320a285d HTTP/1.0" 202 Accepted 2026-04-07 10:32:09,909 - lava_callback - INFO - Starting async job submit for node 69d4d91d932ecfe2320a285d 2026-04-07 10:32:09,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:32:09,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d91d932ecfe2320a285d HTTP/1.1" 200 None 2026-04-07 10:32:09,990 - lava_callback - DEBUG - Processing node 69d4d91d932ecfe2320a285d: ltp-smoke 2026-04-07 10:32:10,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:32:10,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:32:10,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d4d91d932ecfe2320a285d/log.txt.gz 2026-04-07 10:32:11,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:32:11,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:32:11,489 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d4d91d932ecfe2320a285d/lava-logs.yaml 2026-04-07 10:32:11,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:32:11,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:32:11,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d4d91d932ecfe2320a285d/lava_callback.json.gz 2026-04-07 10:32:11,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:32:11,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d91d932ecfe2320a285d HTTP/1.1" 200 None 2026-04-07 10:32:11,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:32:11,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd70932ecfe2320a1012 HTTP/1.1" 200 None 2026-04-07 10:32:11,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:32:11,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d91d932ecfe2320a285d HTTP/1.1" 200 None 2026-04-07 10:32:11,971 - lava_callback - INFO - Completed processing callback for node 69d4d91d932ecfe2320a285d INFO: 172.20.0.1:45404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:32:27,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:32:27,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59892 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:35:04,248 - lava_callback - INFO - Received callback for node 69d4ddc5932ecfe2320a2bb5 INFO: 172.20.0.1:48366 - "POST /node/69d4ddc5932ecfe2320a2bb5 HTTP/1.0" 202 Accepted 2026-04-07 10:35:04,253 - lava_callback - INFO - Starting async job submit for node 69d4ddc5932ecfe2320a2bb5 2026-04-07 10:35:04,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:35:04,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ddc5932ecfe2320a2bb5 HTTP/1.1" 200 None 2026-04-07 10:35:04,271 - lava_callback - DEBUG - Processing node 69d4ddc5932ecfe2320a2bb5: baseline-nfs-arm64 2026-04-07 10:35:04,272 - lava_callback - WARNING - Failed to upload log 2026-04-07 10:35:04,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:35:04,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:35:04,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4ddc5932ecfe2320a2bb5/lava-logs.yaml 2026-04-07 10:35:04,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:35:04,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:35:04,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4ddc5932ecfe2320a2bb5/lava_callback.json.gz 2026-04-07 10:35:04,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:35:04,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ddc5932ecfe2320a2bb5 HTTP/1.1" 200 None 2026-04-07 10:35:04,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:35:04,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:35:04,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:35:04,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4ddc5932ecfe2320a2bb5 HTTP/1.1" 200 None 2026-04-07 10:35:04,662 - lava_callback - INFO - Completed processing callback for node 69d4ddc5932ecfe2320a2bb5 INFO: 172.20.0.1:48370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43840 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:35:27,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:35:27,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50940 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:36:39,979 - lava_callback - INFO - Received callback for node 69d4de01932ecfe2320a2beb INFO: 172.20.0.1:45000 - "POST /node/69d4de01932ecfe2320a2beb HTTP/1.0" 202 Accepted 2026-04-07 10:36:39,987 - lava_callback - INFO - Starting async job submit for node 69d4de01932ecfe2320a2beb 2026-04-07 10:36:40,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:36:40,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4de01932ecfe2320a2beb HTTP/1.1" 200 None 2026-04-07 10:36:40,045 - lava_callback - DEBUG - Processing node 69d4de01932ecfe2320a2beb: baseline-arm64 2026-04-07 10:36:40,187 - lava_callback - WARNING - Failed to upload log 2026-04-07 10:36:40,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:36:40,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:36:40,469 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4de01932ecfe2320a2beb/lava-logs.yaml 2026-04-07 10:36:40,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:36:40,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:36:40,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4de01932ecfe2320a2beb/lava_callback.json.gz 2026-04-07 10:36:40,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:36:40,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4de01932ecfe2320a2beb HTTP/1.1" 200 None 2026-04-07 10:36:40,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:36:40,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:36:40,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:36:40,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4de01932ecfe2320a2beb HTTP/1.1" 200 None 2026-04-07 10:36:40,950 - lava_callback - INFO - Completed processing callback for node 69d4de01932ecfe2320a2beb INFO: 172.20.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47614 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:36:57,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:36:57,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59004 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:38:07,356 - lava_callback - INFO - Received callback for node 69d4de45932ecfe2320a2c1a INFO: 172.20.0.1:59006 - "POST /node/69d4de45932ecfe2320a2c1a HTTP/1.0" 202 Accepted 2026-04-07 10:38:07,367 - lava_callback - INFO - Starting async job submit for node 69d4de45932ecfe2320a2c1a 2026-04-07 10:38:07,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:38:07,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4de45932ecfe2320a2c1a HTTP/1.1" 200 None 2026-04-07 10:38:07,427 - lava_callback - DEBUG - Processing node 69d4de45932ecfe2320a2c1a: baseline-arm64 2026-04-07 10:38:07,627 - lava_callback - WARNING - Failed to upload log 2026-04-07 10:38:07,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:38:07,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:38:07,936 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4de45932ecfe2320a2c1a/lava-logs.yaml 2026-04-07 10:38:07,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:38:08,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:38:08,087 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4de45932ecfe2320a2c1a/lava_callback.json.gz 2026-04-07 10:38:08,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:38:08,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4de45932ecfe2320a2c1a HTTP/1.1" 200 None 2026-04-07 10:38:08,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:38:08,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:38:08,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:38:08,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4de45932ecfe2320a2c1a HTTP/1.1" 200 None 2026-04-07 10:38:08,289 - lava_callback - INFO - Completed processing callback for node 69d4de45932ecfe2320a2c1a INFO: 172.20.0.1:53022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35674 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:38:27,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:38:27,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57836 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:42:09,194 - lava_callback - INFO - Received callback for node 69d4dc5e932ecfe2320a2aed INFO: 172.20.0.1:57852 - "POST /node/69d4dc5e932ecfe2320a2aed HTTP/1.0" 202 Accepted 2026-04-07 10:42:09,201 - lava_callback - INFO - Starting async job submit for node 69d4dc5e932ecfe2320a2aed 2026-04-07 10:42:09,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:42:09,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dc5e932ecfe2320a2aed HTTP/1.1" 200 None 2026-04-07 10:42:09,253 - lava_callback - DEBUG - Processing node 69d4dc5e932ecfe2320a2aed: baseline-nfs-arm64 2026-04-07 10:42:09,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:42:10,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:42:10,131 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4dc5e932ecfe2320a2aed/log.txt.gz 2026-04-07 10:42:10,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:42:10,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:42:10,624 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4dc5e932ecfe2320a2aed/lava-logs.yaml 2026-04-07 10:42:10,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:42:10,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:42:10,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4dc5e932ecfe2320a2aed/lava_callback.json.gz 2026-04-07 10:42:10,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:42:10,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dc5e932ecfe2320a2aed HTTP/1.1" 200 None 2026-04-07 10:42:10,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:42:10,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:42:10,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:42:10,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4dc5e932ecfe2320a2aed HTTP/1.1" 200 None 2026-04-07 10:42:11,028 - lava_callback - INFO - Completed processing callback for node 69d4dc5e932ecfe2320a2aed 2026-04-07 10:42:13,350 - lava_callback - INFO - Received callback for node 69d4db81932ecfe2320a2a97 INFO: 172.20.0.1:39952 - "POST /node/69d4db81932ecfe2320a2a97 HTTP/1.0" 202 Accepted 2026-04-07 10:42:13,357 - lava_callback - INFO - Starting async job submit for node 69d4db81932ecfe2320a2a97 2026-04-07 10:42:13,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:42:13,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4db81932ecfe2320a2a97 HTTP/1.1" 200 None 2026-04-07 10:42:13,396 - lava_callback - DEBUG - Processing node 69d4db81932ecfe2320a2a97: baseline-arm64 2026-04-07 10:42:13,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:42:14,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:42:14,071 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4db81932ecfe2320a2a97/log.txt.gz 2026-04-07 10:42:14,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:42:14,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:42:14,537 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4db81932ecfe2320a2a97/lava-logs.yaml 2026-04-07 10:42:14,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:42:14,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:42:14,722 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4db81932ecfe2320a2a97/lava_callback.json.gz 2026-04-07 10:42:14,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:42:14,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4db81932ecfe2320a2a97 HTTP/1.1" 200 None 2026-04-07 10:42:14,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:42:14,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:42:14,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:42:14,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4db81932ecfe2320a2a97 HTTP/1.1" 200 None 2026-04-07 10:42:14,876 - lava_callback - INFO - Completed processing callback for node 69d4db81932ecfe2320a2a97 INFO: 172.20.0.1:39962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39488 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:42:27,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:42:27,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42040 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:45:27,064 - lava_callback - INFO - Received callback for node 69d4de8f932ecfe2320a2c5a INFO: 172.20.0.1:42046 - "POST /node/69d4de8f932ecfe2320a2c5a HTTP/1.0" 202 Accepted 2026-04-07 10:45:27,071 - lava_callback - INFO - Starting async job submit for node 69d4de8f932ecfe2320a2c5a 2026-04-07 10:45:27,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:45:27,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4de8f932ecfe2320a2c5a HTTP/1.1" 200 None 2026-04-07 10:45:27,124 - lava_callback - DEBUG - Processing node 69d4de8f932ecfe2320a2c5a: baseline-arm64 2026-04-07 10:45:27,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:45:27,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:45:27,657 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4de8f932ecfe2320a2c5a/log.txt.gz 2026-04-07 10:45:27,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:45:28,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:45:28,094 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4de8f932ecfe2320a2c5a/lava-logs.yaml 2026-04-07 10:45:28,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:45:28,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:45:28,309 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4de8f932ecfe2320a2c5a/lava_callback.json.gz DEBUG: Setup failed for 69d4de8f932ecfe2320a2c5a. Transitting job node result: incomplete -> fail 2026-04-07 10:45:28,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:45:28,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4de8f932ecfe2320a2c5a HTTP/1.1" 200 None 2026-04-07 10:45:28,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:45:28,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:45:28,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:45:28,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4de8f932ecfe2320a2c5a HTTP/1.1" 200 None 2026-04-07 10:45:28,560 - lava_callback - INFO - Completed processing callback for node 69d4de8f932ecfe2320a2c5a INFO: 172.20.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55872 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:45:57,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:45:57,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42840 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:52:40,400 - lava_callback - INFO - Received callback for node 69d4df8e932ecfe2320a2d11 INFO: 172.20.0.1:52484 - "POST /node/69d4df8e932ecfe2320a2d11 HTTP/1.0" 202 Accepted 2026-04-07 10:52:40,406 - lava_callback - INFO - Starting async job submit for node 69d4df8e932ecfe2320a2d11 2026-04-07 10:52:40,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:52:40,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4df8e932ecfe2320a2d11 HTTP/1.1" 200 None 2026-04-07 10:52:40,449 - lava_callback - DEBUG - Processing node 69d4df8e932ecfe2320a2d11: baseline-nfs-arm64 2026-04-07 10:52:40,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:52:41,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:52:41,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4df8e932ecfe2320a2d11/log.txt.gz 2026-04-07 10:52:41,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:52:41,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:52:41,598 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4df8e932ecfe2320a2d11/lava-logs.yaml 2026-04-07 10:52:41,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:52:41,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:52:41,954 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4df8e932ecfe2320a2d11/lava_callback.json.gz 2026-04-07 10:52:41,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:52:41,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4df8e932ecfe2320a2d11 HTTP/1.1" 200 None 2026-04-07 10:52:41,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:52:42,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:52:42,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:52:42,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4df8e932ecfe2320a2d11 HTTP/1.1" 200 None 2026-04-07 10:52:42,104 - lava_callback - INFO - Completed processing callback for node 69d4df8e932ecfe2320a2d11 INFO: 172.20.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56530 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:52:57,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:52:57,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49546 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 10:54:16,104 - lava_callback - INFO - Received callback for node 69d4dfd2932ecfe2320a2d1d INFO: 172.20.0.1:49560 - "POST /node/69d4dfd2932ecfe2320a2d1d HTTP/1.0" 202 Accepted 2026-04-07 10:54:16,111 - lava_callback - INFO - Starting async job submit for node 69d4dfd2932ecfe2320a2d1d 2026-04-07 10:54:16,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:54:16,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dfd2932ecfe2320a2d1d HTTP/1.1" 200 None 2026-04-07 10:54:16,152 - lava_callback - DEBUG - Processing node 69d4dfd2932ecfe2320a2d1d: baseline-arm64 INFO: 172.20.0.1:49562 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:54:16,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:54:16,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:54:16,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4dfd2932ecfe2320a2d1d/log.txt.gz 2026-04-07 10:54:17,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:54:17,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:54:17,362 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4dfd2932ecfe2320a2d1d/lava-logs.yaml 2026-04-07 10:54:17,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:54:17,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:54:17,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4dfd2932ecfe2320a2d1d/lava_callback.json.gz 2026-04-07 10:54:17,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:54:17,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dfd2932ecfe2320a2d1d HTTP/1.1" 200 None 2026-04-07 10:54:17,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:54:17,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:54:17,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:54:17,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4dfd2932ecfe2320a2d1d HTTP/1.1" 200 None 2026-04-07 10:54:17,697 - lava_callback - INFO - Completed processing callback for node 69d4dfd2932ecfe2320a2d1d INFO: 172.20.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43100 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:54:27,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:54:27,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39340 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:58:20,062 - lava_callback - INFO - Received callback for node 69d4df0a932ecfe2320a2cde INFO: 172.20.0.1:56276 - "POST /node/69d4df0a932ecfe2320a2cde HTTP/1.0" 202 Accepted 2026-04-07 10:58:20,069 - lava_callback - INFO - Starting async job submit for node 69d4df0a932ecfe2320a2cde 2026-04-07 10:58:20,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:58:20,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4df0a932ecfe2320a2cde HTTP/1.1" 200 None 2026-04-07 10:58:20,146 - lava_callback - DEBUG - Processing node 69d4df0a932ecfe2320a2cde: baseline-arm 2026-04-07 10:58:20,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:58:20,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:58:20,896 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d4df0a932ecfe2320a2cde/log.txt.gz 2026-04-07 10:58:21,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:58:21,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:58:21,511 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4df0a932ecfe2320a2cde/lava-logs.yaml 2026-04-07 10:58:21,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:58:21,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:58:21,725 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4df0a932ecfe2320a2cde/lava_callback.json.gz DEBUG: Setup failed for 69d4df0a932ecfe2320a2cde. Transitting job node result: incomplete -> fail 2026-04-07 10:58:21,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:58:21,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4df0a932ecfe2320a2cde HTTP/1.1" 200 None 2026-04-07 10:58:21,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:58:21,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-07 10:58:21,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:58:21,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4df0a932ecfe2320a2cde HTTP/1.1" 200 None 2026-04-07 10:58:22,065 - lava_callback - INFO - Completed processing callback for node 69d4df0a932ecfe2320a2cde INFO: 172.20.0.1:56278 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:58:27,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:58:27,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55742 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:59:07,698 - lava_callback - INFO - Received callback for node 69d4decf932ecfe2320a2cab INFO: 172.20.0.1:55748 - "POST /node/69d4decf932ecfe2320a2cab HTTP/1.0" 202 Accepted 2026-04-07 10:59:07,705 - lava_callback - INFO - Starting async job submit for node 69d4decf932ecfe2320a2cab 2026-04-07 10:59:07,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:59:07,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4decf932ecfe2320a2cab HTTP/1.1" 200 None 2026-04-07 10:59:07,768 - lava_callback - DEBUG - Processing node 69d4decf932ecfe2320a2cab: baseline-nfs-arm64 2026-04-07 10:59:08,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:59:08,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:59:08,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4decf932ecfe2320a2cab/log.txt.gz 2026-04-07 10:59:09,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:59:09,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:59:09,764 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4decf932ecfe2320a2cab/lava-logs.yaml 2026-04-07 10:59:09,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 10:59:10,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 10:59:10,099 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4decf932ecfe2320a2cab/lava_callback.json.gz DEBUG: Setup failed for 69d4decf932ecfe2320a2cab. Transitting job node result: incomplete -> fail 2026-04-07 10:59:10,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:59:10,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4decf932ecfe2320a2cab HTTP/1.1" 200 None 2026-04-07 10:59:10,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:59:10,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 10:59:10,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:59:10,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4decf932ecfe2320a2cab HTTP/1.1" 200 None 2026-04-07 10:59:10,367 - lava_callback - INFO - Completed processing callback for node 69d4decf932ecfe2320a2cab INFO: 172.20.0.1:56986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46572 - "GET / HTTP/1.0" 200 OK 2026-04-07 10:59:27,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 10:59:27,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44138 - "GET / HTTP/1.0" 200 OK 2026-04-07 11:19:08,019 - lava_callback - INFO - Received callback for node 69d4e387932ecfe2320a2d48 INFO: 172.20.0.1:44146 - "POST /node/69d4e387932ecfe2320a2d48 HTTP/1.0" 202 Accepted 2026-04-07 11:19:08,027 - lava_callback - INFO - Starting async job submit for node 69d4e387932ecfe2320a2d48 2026-04-07 11:19:08,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 11:19:08,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4e387932ecfe2320a2d48 HTTP/1.1" 200 None 2026-04-07 11:19:08,091 - lava_callback - DEBUG - Processing node 69d4e387932ecfe2320a2d48: baseline-nfs-arm64 2026-04-07 11:19:09,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 11:19:09,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 11:19:09,447 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4e387932ecfe2320a2d48/log.txt.gz 2026-04-07 11:19:10,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 11:19:10,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 11:19:10,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4e387932ecfe2320a2d48/lava-logs.yaml 2026-04-07 11:19:10,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 11:19:10,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 11:19:10,507 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4e387932ecfe2320a2d48/lava_callback.json.gz DEBUG: Setup failed for 69d4e387932ecfe2320a2d48. Transitting job node result: incomplete -> fail 2026-04-07 11:19:10,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 11:19:10,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4e387932ecfe2320a2d48 HTTP/1.1" 200 None 2026-04-07 11:19:10,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 11:19:10,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-07 11:19:10,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 11:19:10,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4e387932ecfe2320a2d48 HTTP/1.1" 200 None 2026-04-07 11:19:10,752 - lava_callback - INFO - Completed processing callback for node 69d4e387932ecfe2320a2d48 INFO: 172.20.0.1:35892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39270 - "GET / HTTP/1.0" 200 OK 2026-04-07 11:19:27,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 11:19:27,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49722 - "GET /node/69a77f55a255cc0324eb021d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41296 - "GET /node/6988c2cf9fc35f969e1ee15a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51704 - "GET /node/68ba037f09efb230970abe59%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55778 - "GET /node/69537d5731522df6df79ed2c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34572 - "GET /node/69939c31cebe99dd8e0760dc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45720 - "GET /node/698403ef969566dcb0d2b8b6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45734 - "GET /node/69a161b9a41e9451dcf4133c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38692 - "GET /node/693f53870d8ce4018da89681%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35210 - "GET /node/694cdb6acb0ae69445cb2825%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35226 - "GET /node/69afe0bdae557f2600f0fb06%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38914 - "GET /node/69830f3a409235c29c0de703%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34430 - "GET /node/691143f8f15111fc8ce47b3e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34442 - "GET /node/6984586a3a8748f282084e99%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55356 - "GET /node/6948935948abaf7e25584e4a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36240 - "GET /node/6988b39ee408e9ea60fb167a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36040 - "GET /node/69871c0f6e077e4126a7f2bc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33094 - "GET /node/693f73770d8ce4018da93aef%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42730 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:46:06,408 - lava_callback - INFO - Received callback for node 69d2598c0d94ee66016fcf7a INFO: 172.20.0.1:40770 - "POST /node/69d2598c0d94ee66016fcf7a HTTP/1.0" 202 Accepted 2026-04-07 12:46:06,413 - lava_callback - INFO - Starting async job submit for node 69d2598c0d94ee66016fcf7a 2026-04-07 12:46:06,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:46:06,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2598c0d94ee66016fcf7a HTTP/1.1" 200 None 2026-04-07 12:46:06,429 - lava_callback - DEBUG - Processing node 69d2598c0d94ee66016fcf7a: baseline-arm-baylibre 2026-04-07 12:46:06,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2598c0d94ee66016fcf7a 2026-04-07 12:46:06,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:46:06,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2598c0d94ee66016fcf7a HTTP/1.1" 200 None 2026-04-07 12:46:06,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:46:06,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:46:06,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:46:06,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2598c0d94ee66016fcf7a HTTP/1.1" 200 None 2026-04-07 12:46:06,486 - lava_callback - ERROR - Error processing callback for node 69d2598c0d94ee66016fcf7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34556 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:46:46,259 - lava_callback - INFO - Received callback for node 69d259ae0d94ee66016fcf8a INFO: 172.20.0.1:36354 - "POST /node/69d259ae0d94ee66016fcf8a HTTP/1.0" 202 Accepted 2026-04-07 12:46:46,265 - lava_callback - INFO - Starting async job submit for node 69d259ae0d94ee66016fcf8a 2026-04-07 12:46:46,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:46:46,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d259ae0d94ee66016fcf8a HTTP/1.1" 200 None 2026-04-07 12:46:46,281 - lava_callback - DEBUG - Processing node 69d259ae0d94ee66016fcf8a: baseline-arm-baylibre 2026-04-07 12:46:46,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d259ae0d94ee66016fcf8a 2026-04-07 12:46:46,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:46:46,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d259ae0d94ee66016fcf8a HTTP/1.1" 200 None 2026-04-07 12:46:46,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:46:46,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:46:46,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:46:46,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d259ae0d94ee66016fcf8a HTTP/1.1" 200 None 2026-04-07 12:46:46,352 - lava_callback - ERROR - Error processing callback for node 69d259ae0d94ee66016fcf8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43708 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:47:26,319 - lava_callback - INFO - Received callback for node 69d259cd0d94ee66016fcfaa INFO: 172.20.0.1:43720 - "POST /node/69d259cd0d94ee66016fcfaa HTTP/1.0" 202 Accepted 2026-04-07 12:47:26,325 - lava_callback - INFO - Starting async job submit for node 69d259cd0d94ee66016fcfaa 2026-04-07 12:47:26,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:47:26,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d259cd0d94ee66016fcfaa HTTP/1.1" 200 None 2026-04-07 12:47:26,341 - lava_callback - DEBUG - Processing node 69d259cd0d94ee66016fcfaa: baseline-arm-baylibre 2026-04-07 12:47:26,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d259cd0d94ee66016fcfaa 2026-04-07 12:47:26,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:47:26,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d259cd0d94ee66016fcfaa HTTP/1.1" 200 None 2026-04-07 12:47:26,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:47:26,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:47:26,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:47:26,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d259cd0d94ee66016fcfaa HTTP/1.1" 200 None 2026-04-07 12:47:26,400 - lava_callback - ERROR - Error processing callback for node 69d259cd0d94ee66016fcfaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49596 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:48:06,350 - lava_callback - INFO - Received callback for node 69d259f10d94ee66016fcfcd INFO: 172.20.0.1:49662 - "POST /node/69d259f10d94ee66016fcfcd HTTP/1.0" 202 Accepted 2026-04-07 12:48:06,356 - lava_callback - INFO - Starting async job submit for node 69d259f10d94ee66016fcfcd 2026-04-07 12:48:06,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:48:06,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d259f10d94ee66016fcfcd HTTP/1.1" 200 None 2026-04-07 12:48:06,376 - lava_callback - DEBUG - Processing node 69d259f10d94ee66016fcfcd: baseline-arm-baylibre 2026-04-07 12:48:06,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d259f10d94ee66016fcfcd 2026-04-07 12:48:06,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:48:06,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d259f10d94ee66016fcfcd HTTP/1.1" 200 None 2026-04-07 12:48:06,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:48:06,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:48:06,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:48:06,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d259f10d94ee66016fcfcd HTTP/1.1" 200 None 2026-04-07 12:48:06,427 - lava_callback - ERROR - Error processing callback for node 69d259f10d94ee66016fcfcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35412 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:48:26,378 - lava_callback - INFO - Received callback for node 69d25a120d94ee66016fcfdb INFO: 172.20.0.1:35428 - "POST /node/69d25a120d94ee66016fcfdb HTTP/1.0" 202 Accepted 2026-04-07 12:48:26,383 - lava_callback - INFO - Starting async job submit for node 69d25a120d94ee66016fcfdb 2026-04-07 12:48:26,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:48:26,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25a120d94ee66016fcfdb HTTP/1.1" 200 None 2026-04-07 12:48:26,406 - lava_callback - DEBUG - Processing node 69d25a120d94ee66016fcfdb: baseline-arm-baylibre 2026-04-07 12:48:26,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25a120d94ee66016fcfdb 2026-04-07 12:48:26,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:48:26,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25a120d94ee66016fcfdb HTTP/1.1" 200 None 2026-04-07 12:48:26,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:48:26,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:48:26,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:48:26,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25a120d94ee66016fcfdb HTTP/1.1" 200 None 2026-04-07 12:48:26,461 - lava_callback - ERROR - Error processing callback for node 69d25a120d94ee66016fcfdb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57498 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:49:06,425 - lava_callback - INFO - Received callback for node 69d25a330d94ee66016fd012 INFO: 172.20.0.1:38624 - "POST /node/69d25a330d94ee66016fd012 HTTP/1.0" 202 Accepted 2026-04-07 12:49:06,431 - lava_callback - INFO - Starting async job submit for node 69d25a330d94ee66016fd012 2026-04-07 12:49:06,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:49:06,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25a330d94ee66016fd012 HTTP/1.1" 200 None 2026-04-07 12:49:06,446 - lava_callback - DEBUG - Processing node 69d25a330d94ee66016fd012: baseline-arm-baylibre 2026-04-07 12:49:06,446 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25a330d94ee66016fd012 2026-04-07 12:49:06,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:49:06,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25a330d94ee66016fd012 HTTP/1.1" 200 None 2026-04-07 12:49:06,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:49:06,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:49:06,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:49:06,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25a330d94ee66016fd012 HTTP/1.1" 200 None 2026-04-07 12:49:06,501 - lava_callback - ERROR - Error processing callback for node 69d25a330d94ee66016fd012: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34324 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:50:58,040 - lava_callback - INFO - Received callback for node 69d25aa10d94ee66016fd066 INFO: 172.20.0.1:34338 - "POST /node/69d25aa10d94ee66016fd066 HTTP/1.0" 202 Accepted 2026-04-07 12:50:58,045 - lava_callback - INFO - Starting async job submit for node 69d25aa10d94ee66016fd066 2026-04-07 12:50:58,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:50:58,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25aa10d94ee66016fd066 HTTP/1.1" 200 None 2026-04-07 12:50:58,062 - lava_callback - DEBUG - Processing node 69d25aa10d94ee66016fd066: baseline-arm-clabbe 2026-04-07 12:50:58,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25aa10d94ee66016fd066 2026-04-07 12:50:58,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:50:58,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25aa10d94ee66016fd066 HTTP/1.1" 200 None 2026-04-07 12:50:58,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:50:58,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:50:58,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:50:58,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25aa10d94ee66016fd066 HTTP/1.1" 200 None 2026-04-07 12:50:58,113 - lava_callback - ERROR - Error processing callback for node 69d25aa10d94ee66016fd066: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52466 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:51:17,969 - lava_callback - INFO - Received callback for node 69d25ac10d94ee66016fd082 INFO: 172.20.0.1:52480 - "POST /node/69d25ac10d94ee66016fd082 HTTP/1.0" 202 Accepted 2026-04-07 12:51:17,974 - lava_callback - INFO - Starting async job submit for node 69d25ac10d94ee66016fd082 2026-04-07 12:51:17,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:51:17,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25ac10d94ee66016fd082 HTTP/1.1" 200 None 2026-04-07 12:51:17,991 - lava_callback - DEBUG - Processing node 69d25ac10d94ee66016fd082: baseline-arm-clabbe 2026-04-07 12:51:17,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25ac10d94ee66016fd082 2026-04-07 12:51:17,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:51:18,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25ac10d94ee66016fd082 HTTP/1.1" 200 None 2026-04-07 12:51:18,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:51:18,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:51:18,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:51:18,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25ac10d94ee66016fd082 HTTP/1.1" 200 None 2026-04-07 12:51:18,046 - lava_callback - ERROR - Error processing callback for node 69d25ac10d94ee66016fd082: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59096 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:51:58,047 - lava_callback - INFO - Received callback for node 69d25ae10d94ee66016fd0a3 INFO: 172.20.0.1:59108 - "POST /node/69d25ae10d94ee66016fd0a3 HTTP/1.0" 202 Accepted 2026-04-07 12:51:58,053 - lava_callback - INFO - Starting async job submit for node 69d25ae10d94ee66016fd0a3 2026-04-07 12:51:58,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:51:58,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25ae10d94ee66016fd0a3 HTTP/1.1" 200 None 2026-04-07 12:51:58,070 - lava_callback - DEBUG - Processing node 69d25ae10d94ee66016fd0a3: baseline-arm-clabbe 2026-04-07 12:51:58,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25ae10d94ee66016fd0a3 2026-04-07 12:51:58,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:51:58,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25ae10d94ee66016fd0a3 HTTP/1.1" 200 None 2026-04-07 12:51:58,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:51:58,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:51:58,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:51:58,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25ae10d94ee66016fd0a3 HTTP/1.1" 200 None 2026-04-07 12:51:58,144 - lava_callback - ERROR - Error processing callback for node 69d25ae10d94ee66016fd0a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59390 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:52:38,034 - lava_callback - INFO - Received callback for node 69d25b020d94ee66016fd0d0 INFO: 172.20.0.1:59402 - "POST /node/69d25b020d94ee66016fd0d0 HTTP/1.0" 202 Accepted 2026-04-07 12:52:38,040 - lava_callback - INFO - Starting async job submit for node 69d25b020d94ee66016fd0d0 2026-04-07 12:52:38,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:52:38,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25b020d94ee66016fd0d0 HTTP/1.1" 200 None 2026-04-07 12:52:38,056 - lava_callback - DEBUG - Processing node 69d25b020d94ee66016fd0d0: baseline-arm-clabbe 2026-04-07 12:52:38,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25b020d94ee66016fd0d0 2026-04-07 12:52:38,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:52:38,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25b020d94ee66016fd0d0 HTTP/1.1" 200 None 2026-04-07 12:52:38,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:52:38,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:52:38,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:52:38,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25b020d94ee66016fd0d0 HTTP/1.1" 200 None 2026-04-07 12:52:38,113 - lava_callback - ERROR - Error processing callback for node 69d25b020d94ee66016fd0d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48218 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:52:58,145 - lava_callback - INFO - Received callback for node 69d25b260d94ee66016fd0ee INFO: 172.20.0.1:48234 - "POST /node/69d25b260d94ee66016fd0ee HTTP/1.0" 202 Accepted 2026-04-07 12:52:58,153 - lava_callback - INFO - Starting async job submit for node 69d25b260d94ee66016fd0ee 2026-04-07 12:52:58,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:52:58,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25b260d94ee66016fd0ee HTTP/1.1" 200 None 2026-04-07 12:52:58,172 - lava_callback - DEBUG - Processing node 69d25b260d94ee66016fd0ee: baseline-arm-clabbe 2026-04-07 12:52:58,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25b260d94ee66016fd0ee 2026-04-07 12:52:58,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:52:58,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25b260d94ee66016fd0ee HTTP/1.1" 200 None 2026-04-07 12:52:58,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:52:58,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:52:58,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:52:58,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25b260d94ee66016fd0ee HTTP/1.1" 200 None 2026-04-07 12:52:58,234 - lava_callback - ERROR - Error processing callback for node 69d25b260d94ee66016fd0ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40232 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:53:38,065 - lava_callback - INFO - Received callback for node 69d25b470d94ee66016fd10c INFO: 172.20.0.1:40238 - "POST /node/69d25b470d94ee66016fd10c HTTP/1.0" 202 Accepted 2026-04-07 12:53:38,070 - lava_callback - INFO - Starting async job submit for node 69d25b470d94ee66016fd10c 2026-04-07 12:53:38,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:53:38,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25b470d94ee66016fd10c HTTP/1.1" 200 None 2026-04-07 12:53:38,086 - lava_callback - DEBUG - Processing node 69d25b470d94ee66016fd10c: baseline-arm-clabbe 2026-04-07 12:53:38,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25b470d94ee66016fd10c 2026-04-07 12:53:38,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:53:38,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25b470d94ee66016fd10c HTTP/1.1" 200 None 2026-04-07 12:53:38,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:53:38,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:53:38,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:53:38,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25b470d94ee66016fd10c HTTP/1.1" 200 None 2026-04-07 12:53:38,149 - lava_callback - ERROR - Error processing callback for node 69d25b470d94ee66016fd10c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33996 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:54:18,166 - lava_callback - INFO - Received callback for node 69d25b660d94ee66016fd138 INFO: 172.20.0.1:34010 - "POST /node/69d25b660d94ee66016fd138 HTTP/1.0" 202 Accepted 2026-04-07 12:54:18,172 - lava_callback - INFO - Starting async job submit for node 69d25b660d94ee66016fd138 2026-04-07 12:54:18,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:54:18,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25b660d94ee66016fd138 HTTP/1.1" 200 None 2026-04-07 12:54:18,195 - lava_callback - DEBUG - Processing node 69d25b660d94ee66016fd138: baseline-arm-clabbe 2026-04-07 12:54:18,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25b660d94ee66016fd138 2026-04-07 12:54:18,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:54:18,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25b660d94ee66016fd138 HTTP/1.1" 200 None 2026-04-07 12:54:18,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:54:18,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:54:18,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:54:18,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25b660d94ee66016fd138 HTTP/1.1" 200 None 2026-04-07 12:54:18,254 - lava_callback - ERROR - Error processing callback for node 69d25b660d94ee66016fd138: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40036 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:54:38,119 - lava_callback - INFO - Received callback for node 69d25b880d94ee66016fd14e INFO: 172.20.0.1:40052 - "POST /node/69d25b880d94ee66016fd14e HTTP/1.0" 202 Accepted 2026-04-07 12:54:38,125 - lava_callback - INFO - Starting async job submit for node 69d25b880d94ee66016fd14e 2026-04-07 12:54:38,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:54:38,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25b880d94ee66016fd14e HTTP/1.1" 200 None 2026-04-07 12:54:38,142 - lava_callback - DEBUG - Processing node 69d25b880d94ee66016fd14e: baseline-arm-clabbe 2026-04-07 12:54:38,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25b880d94ee66016fd14e 2026-04-07 12:54:38,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:54:38,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25b880d94ee66016fd14e HTTP/1.1" 200 None 2026-04-07 12:54:38,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:54:38,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 12:54:38,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:54:38,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25b880d94ee66016fd14e HTTP/1.1" 200 None 2026-04-07 12:54:38,214 - lava_callback - ERROR - Error processing callback for node 69d25b880d94ee66016fd14e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56152 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:55:06,792 - lava_callback - INFO - Received callback for node 69d25ba00d94ee66016fd172 INFO: 172.20.0.1:56166 - "POST /node/69d25ba00d94ee66016fd172 HTTP/1.0" 202 Accepted 2026-04-07 12:55:06,798 - lava_callback - INFO - Starting async job submit for node 69d25ba00d94ee66016fd172 2026-04-07 12:55:06,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:55:06,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25ba00d94ee66016fd172 HTTP/1.1" 200 None 2026-04-07 12:55:06,816 - lava_callback - DEBUG - Processing node 69d25ba00d94ee66016fd172: baseline-arm-baylibre 2026-04-07 12:55:06,816 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25ba00d94ee66016fd172 2026-04-07 12:55:06,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:55:06,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25ba00d94ee66016fd172 HTTP/1.1" 200 None 2026-04-07 12:55:06,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:55:06,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 12:55:06,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:55:06,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25ba00d94ee66016fd172 HTTP/1.1" 200 None 2026-04-07 12:55:06,867 - lava_callback - ERROR - Error processing callback for node 69d25ba00d94ee66016fd172: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37504 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:55:46,732 - lava_callback - INFO - Received callback for node 69d25bc50d94ee66016fd195 INFO: 172.20.0.1:37508 - "POST /node/69d25bc50d94ee66016fd195 HTTP/1.0" 202 Accepted 2026-04-07 12:55:46,739 - lava_callback - INFO - Starting async job submit for node 69d25bc50d94ee66016fd195 2026-04-07 12:55:46,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:55:46,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25bc50d94ee66016fd195 HTTP/1.1" 200 None 2026-04-07 12:55:46,756 - lava_callback - DEBUG - Processing node 69d25bc50d94ee66016fd195: baseline-arm-baylibre 2026-04-07 12:55:46,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25bc50d94ee66016fd195 2026-04-07 12:55:46,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:55:46,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25bc50d94ee66016fd195 HTTP/1.1" 200 None 2026-04-07 12:55:46,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:55:46,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 12:55:46,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:55:46,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25bc50d94ee66016fd195 HTTP/1.1" 200 None 2026-04-07 12:55:46,811 - lava_callback - ERROR - Error processing callback for node 69d25bc50d94ee66016fd195: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59792 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:57:26,899 - lava_callback - INFO - Received callback for node 69d25c250d94ee66016fd1c4 INFO: 172.20.0.1:59802 - "POST /node/69d25c250d94ee66016fd1c4 HTTP/1.0" 202 Accepted 2026-04-07 12:57:26,904 - lava_callback - INFO - Starting async job submit for node 69d25c250d94ee66016fd1c4 2026-04-07 12:57:26,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:57:26,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25c250d94ee66016fd1c4 HTTP/1.1" 200 None 2026-04-07 12:57:26,920 - lava_callback - DEBUG - Processing node 69d25c250d94ee66016fd1c4: baseline-arm-baylibre 2026-04-07 12:57:26,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25c250d94ee66016fd1c4 2026-04-07 12:57:26,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:57:26,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25c250d94ee66016fd1c4 HTTP/1.1" 200 None 2026-04-07 12:57:26,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:57:26,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 12:57:26,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:57:26,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25c250d94ee66016fd1c4 HTTP/1.1" 200 None 2026-04-07 12:57:26,981 - lava_callback - ERROR - Error processing callback for node 69d25c250d94ee66016fd1c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58164 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:58:06,862 - lava_callback - INFO - Received callback for node 69d25c520d94ee66016fd1f7 INFO: 172.20.0.1:58176 - "POST /node/69d25c520d94ee66016fd1f7 HTTP/1.0" 202 Accepted 2026-04-07 12:58:06,868 - lava_callback - INFO - Starting async job submit for node 69d25c520d94ee66016fd1f7 2026-04-07 12:58:06,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:58:06,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25c520d94ee66016fd1f7 HTTP/1.1" 200 None 2026-04-07 12:58:06,885 - lava_callback - DEBUG - Processing node 69d25c520d94ee66016fd1f7: baseline-arm-baylibre 2026-04-07 12:58:06,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25c520d94ee66016fd1f7 2026-04-07 12:58:06,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:58:06,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25c520d94ee66016fd1f7 HTTP/1.1" 200 None 2026-04-07 12:58:06,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:58:06,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 12:58:06,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:58:06,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25c520d94ee66016fd1f7 HTTP/1.1" 200 None 2026-04-07 12:58:06,952 - lava_callback - ERROR - Error processing callback for node 69d25c520d94ee66016fd1f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48992 - "GET / HTTP/1.0" 200 OK 2026-04-07 12:58:46,980 - lava_callback - INFO - Received callback for node 69d25c7b0d94ee66016fd209 INFO: 172.20.0.1:48996 - "POST /node/69d25c7b0d94ee66016fd209 HTTP/1.0" 202 Accepted 2026-04-07 12:58:46,985 - lava_callback - INFO - Starting async job submit for node 69d25c7b0d94ee66016fd209 2026-04-07 12:58:46,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:58:47,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25c7b0d94ee66016fd209 HTTP/1.1" 200 None 2026-04-07 12:58:47,003 - lava_callback - DEBUG - Processing node 69d25c7b0d94ee66016fd209: baseline-arm-baylibre 2026-04-07 12:58:47,003 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25c7b0d94ee66016fd209 2026-04-07 12:58:47,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:58:47,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25c7b0d94ee66016fd209 HTTP/1.1" 200 None 2026-04-07 12:58:47,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:58:47,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 12:58:47,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 12:58:47,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25c7b0d94ee66016fd209 HTTP/1.1" 200 None 2026-04-07 12:58:47,236 - lava_callback - ERROR - Error processing callback for node 69d25c7b0d94ee66016fd209: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33362 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:00:58,440 - lava_callback - INFO - Received callback for node 69d25cf50d94ee66016fd237 INFO: 172.20.0.1:33372 - "POST /node/69d25cf50d94ee66016fd237 HTTP/1.0" 202 Accepted 2026-04-07 13:00:58,445 - lava_callback - INFO - Starting async job submit for node 69d25cf50d94ee66016fd237 2026-04-07 13:00:58,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:00:58,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25cf50d94ee66016fd237 HTTP/1.1" 200 None 2026-04-07 13:00:58,462 - lava_callback - DEBUG - Processing node 69d25cf50d94ee66016fd237: baseline-arm-clabbe 2026-04-07 13:00:58,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25cf50d94ee66016fd237 2026-04-07 13:00:58,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:00:58,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25cf50d94ee66016fd237 HTTP/1.1" 200 None 2026-04-07 13:00:58,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:00:58,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:00:58,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:00:58,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25cf50d94ee66016fd237 HTTP/1.1" 200 None 2026-04-07 13:00:58,516 - lava_callback - ERROR - Error processing callback for node 69d25cf50d94ee66016fd237: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36858 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:01:38,416 - lava_callback - INFO - Received callback for node 69d25d1d0d94ee66016fd247 INFO: 172.20.0.1:36872 - "POST /node/69d25d1d0d94ee66016fd247 HTTP/1.0" 202 Accepted 2026-04-07 13:01:38,421 - lava_callback - INFO - Starting async job submit for node 69d25d1d0d94ee66016fd247 2026-04-07 13:01:38,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:01:38,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25d1d0d94ee66016fd247 HTTP/1.1" 200 None 2026-04-07 13:01:38,437 - lava_callback - DEBUG - Processing node 69d25d1d0d94ee66016fd247: baseline-arm-clabbe 2026-04-07 13:01:38,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25d1d0d94ee66016fd247 2026-04-07 13:01:38,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:01:38,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25d1d0d94ee66016fd247 HTTP/1.1" 200 None 2026-04-07 13:01:38,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:01:38,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:01:38,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:01:38,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25d1d0d94ee66016fd247 HTTP/1.1" 200 None 2026-04-07 13:01:38,498 - lava_callback - ERROR - Error processing callback for node 69d25d1d0d94ee66016fd247: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56388 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:02:18,509 - lava_callback - INFO - Received callback for node 69d25d440d94ee66016fd280 INFO: 172.20.0.1:56398 - "POST /node/69d25d440d94ee66016fd280 HTTP/1.0" 202 Accepted 2026-04-07 13:02:18,514 - lava_callback - INFO - Starting async job submit for node 69d25d440d94ee66016fd280 2026-04-07 13:02:18,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:02:18,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25d440d94ee66016fd280 HTTP/1.1" 200 None 2026-04-07 13:02:18,530 - lava_callback - DEBUG - Processing node 69d25d440d94ee66016fd280: baseline-arm-clabbe 2026-04-07 13:02:18,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25d440d94ee66016fd280 2026-04-07 13:02:18,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:02:18,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25d440d94ee66016fd280 HTTP/1.1" 200 None 2026-04-07 13:02:18,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:02:18,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:02:18,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:02:18,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25d440d94ee66016fd280 HTTP/1.1" 200 None 2026-04-07 13:02:18,587 - lava_callback - ERROR - Error processing callback for node 69d25d440d94ee66016fd280: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57966 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:02:38,460 - lava_callback - INFO - Received callback for node 69d25d690d94ee66016fd296 INFO: 172.20.0.1:57976 - "POST /node/69d25d690d94ee66016fd296 HTTP/1.0" 202 Accepted 2026-04-07 13:02:38,466 - lava_callback - INFO - Starting async job submit for node 69d25d690d94ee66016fd296 2026-04-07 13:02:38,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:02:38,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25d690d94ee66016fd296 HTTP/1.1" 200 None 2026-04-07 13:02:38,481 - lava_callback - DEBUG - Processing node 69d25d690d94ee66016fd296: baseline-arm-clabbe 2026-04-07 13:02:38,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25d690d94ee66016fd296 2026-04-07 13:02:38,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:02:38,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25d690d94ee66016fd296 HTTP/1.1" 200 None 2026-04-07 13:02:38,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:02:38,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 13:02:38,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:02:38,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25d690d94ee66016fd296 HTTP/1.1" 200 None 2026-04-07 13:02:38,553 - lava_callback - ERROR - Error processing callback for node 69d25d690d94ee66016fd296: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51996 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:03:18,541 - lava_callback - INFO - Received callback for node 69d25d8b0d94ee66016fd2b3 INFO: 172.20.0.1:51998 - "POST /node/69d25d8b0d94ee66016fd2b3 HTTP/1.0" 202 Accepted 2026-04-07 13:03:18,547 - lava_callback - INFO - Starting async job submit for node 69d25d8b0d94ee66016fd2b3 2026-04-07 13:03:18,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:03:18,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25d8b0d94ee66016fd2b3 HTTP/1.1" 200 None 2026-04-07 13:03:18,563 - lava_callback - DEBUG - Processing node 69d25d8b0d94ee66016fd2b3: baseline-arm-clabbe 2026-04-07 13:03:18,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25d8b0d94ee66016fd2b3 2026-04-07 13:03:18,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:03:18,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25d8b0d94ee66016fd2b3 HTTP/1.1" 200 None 2026-04-07 13:03:18,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:03:18,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:03:18,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:03:18,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25d8b0d94ee66016fd2b3 HTTP/1.1" 200 None 2026-04-07 13:03:18,631 - lava_callback - ERROR - Error processing callback for node 69d25d8b0d94ee66016fd2b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48578 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:03:58,507 - lava_callback - INFO - Received callback for node 69d25daa0d94ee66016fd2db INFO: 172.20.0.1:48592 - "POST /node/69d25daa0d94ee66016fd2db HTTP/1.0" 202 Accepted 2026-04-07 13:03:58,512 - lava_callback - INFO - Starting async job submit for node 69d25daa0d94ee66016fd2db 2026-04-07 13:03:58,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:03:58,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25daa0d94ee66016fd2db HTTP/1.1" 200 None 2026-04-07 13:03:58,535 - lava_callback - DEBUG - Processing node 69d25daa0d94ee66016fd2db: baseline-arm-clabbe 2026-04-07 13:03:58,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25daa0d94ee66016fd2db 2026-04-07 13:03:58,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:03:58,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25daa0d94ee66016fd2db HTTP/1.1" 200 None 2026-04-07 13:03:58,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:03:58,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:03:58,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:03:58,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25daa0d94ee66016fd2db HTTP/1.1" 200 None 2026-04-07 13:03:58,590 - lava_callback - ERROR - Error processing callback for node 69d25daa0d94ee66016fd2db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54000 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:08:47,682 - lava_callback - INFO - Received callback for node 69d25eda0d94ee66016fd3b5 INFO: 172.20.0.1:54014 - "POST /node/69d25eda0d94ee66016fd3b5 HTTP/1.0" 202 Accepted 2026-04-07 13:08:47,687 - lava_callback - INFO - Starting async job submit for node 69d25eda0d94ee66016fd3b5 2026-04-07 13:08:47,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:08:47,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25eda0d94ee66016fd3b5 HTTP/1.1" 200 None 2026-04-07 13:08:47,704 - lava_callback - DEBUG - Processing node 69d25eda0d94ee66016fd3b5: baseline-arm-baylibre 2026-04-07 13:08:47,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25eda0d94ee66016fd3b5 2026-04-07 13:08:47,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:08:47,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25eda0d94ee66016fd3b5 HTTP/1.1" 200 None 2026-04-07 13:08:47,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:08:47,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:08:47,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:08:47,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25eda0d94ee66016fd3b5 HTTP/1.1" 200 None 2026-04-07 13:08:47,772 - lava_callback - ERROR - Error processing callback for node 69d25eda0d94ee66016fd3b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37302 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:09:27,517 - lava_callback - INFO - Received callback for node 69d25efe0d94ee66016fd3e3 INFO: 172.20.0.1:37308 - "POST /node/69d25efe0d94ee66016fd3e3 HTTP/1.0" 202 Accepted 2026-04-07 13:09:27,522 - lava_callback - INFO - Starting async job submit for node 69d25efe0d94ee66016fd3e3 2026-04-07 13:09:27,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:09:27,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25efe0d94ee66016fd3e3 HTTP/1.1" 200 None 2026-04-07 13:09:27,541 - lava_callback - DEBUG - Processing node 69d25efe0d94ee66016fd3e3: baseline-arm64-baylibre 2026-04-07 13:09:27,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25efe0d94ee66016fd3e3 2026-04-07 13:09:27,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:09:27,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25efe0d94ee66016fd3e3 HTTP/1.1" 200 None 2026-04-07 13:09:27,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:09:27,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:09:27,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:09:27,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25efe0d94ee66016fd3e3 HTTP/1.1" 200 None 2026-04-07 13:09:27,602 - lava_callback - ERROR - Error processing callback for node 69d25efe0d94ee66016fd3e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36762 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:10:47,698 - lava_callback - INFO - Received callback for node 69d25f480d94ee66016fd42f INFO: 172.20.0.1:36766 - "POST /node/69d25f480d94ee66016fd42f HTTP/1.0" 202 Accepted 2026-04-07 13:10:47,704 - lava_callback - INFO - Starting async job submit for node 69d25f480d94ee66016fd42f 2026-04-07 13:10:47,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:10:47,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25f480d94ee66016fd42f HTTP/1.1" 200 None 2026-04-07 13:10:47,727 - lava_callback - DEBUG - Processing node 69d25f480d94ee66016fd42f: baseline-arm64-baylibre 2026-04-07 13:10:47,727 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25f480d94ee66016fd42f 2026-04-07 13:10:47,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:10:47,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25f480d94ee66016fd42f HTTP/1.1" 200 None 2026-04-07 13:10:47,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:10:47,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:10:47,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:10:47,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25f480d94ee66016fd42f HTTP/1.1" 200 None 2026-04-07 13:10:47,787 - lava_callback - ERROR - Error processing callback for node 69d25f480d94ee66016fd42f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37960 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:11:47,626 - lava_callback - INFO - Received callback for node 69d25f910d94ee66016fd43f INFO: 172.20.0.1:37964 - "POST /node/69d25f910d94ee66016fd43f HTTP/1.0" 202 Accepted 2026-04-07 13:11:47,632 - lava_callback - INFO - Starting async job submit for node 69d25f910d94ee66016fd43f 2026-04-07 13:11:47,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:11:47,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25f910d94ee66016fd43f HTTP/1.1" 200 None 2026-04-07 13:11:47,651 - lava_callback - DEBUG - Processing node 69d25f910d94ee66016fd43f: baseline-arm64-baylibre 2026-04-07 13:11:47,651 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25f910d94ee66016fd43f 2026-04-07 13:11:47,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:11:47,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25f910d94ee66016fd43f HTTP/1.1" 200 None 2026-04-07 13:11:47,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:11:47,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:11:47,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:11:47,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25f910d94ee66016fd43f HTTP/1.1" 200 None 2026-04-07 13:11:47,728 - lava_callback - ERROR - Error processing callback for node 69d25f910d94ee66016fd43f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50064 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:12:47,752 - lava_callback - INFO - Received callback for node 69d25fcc0d94ee66016fd491 INFO: 172.20.0.1:50072 - "POST /node/69d25fcc0d94ee66016fd491 HTTP/1.0" 202 Accepted 2026-04-07 13:12:47,758 - lava_callback - INFO - Starting async job submit for node 69d25fcc0d94ee66016fd491 2026-04-07 13:12:47,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:12:47,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25fcc0d94ee66016fd491 HTTP/1.1" 200 None 2026-04-07 13:12:47,775 - lava_callback - DEBUG - Processing node 69d25fcc0d94ee66016fd491: baseline-arm64-baylibre 2026-04-07 13:12:47,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d25fcc0d94ee66016fd491 2026-04-07 13:12:47,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:12:47,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d25fcc0d94ee66016fd491 HTTP/1.1" 200 None 2026-04-07 13:12:47,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:12:47,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:12:47,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:12:47,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d25fcc0d94ee66016fd491 HTTP/1.1" 200 None 2026-04-07 13:12:47,838 - lava_callback - ERROR - Error processing callback for node 69d25fcc0d94ee66016fd491: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38784 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:14:07,859 - lava_callback - INFO - Received callback for node 69d260140d94ee66016fd4c9 INFO: 172.20.0.1:38792 - "POST /node/69d260140d94ee66016fd4c9 HTTP/1.0" 202 Accepted 2026-04-07 13:14:07,865 - lava_callback - INFO - Starting async job submit for node 69d260140d94ee66016fd4c9 2026-04-07 13:14:07,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:14:07,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d260140d94ee66016fd4c9 HTTP/1.1" 200 None 2026-04-07 13:14:07,880 - lava_callback - DEBUG - Processing node 69d260140d94ee66016fd4c9: baseline-arm64-baylibre 2026-04-07 13:14:07,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d260140d94ee66016fd4c9 2026-04-07 13:14:07,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:14:07,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d260140d94ee66016fd4c9 HTTP/1.1" 200 None 2026-04-07 13:14:07,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:14:07,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:14:07,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:14:07,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d260140d94ee66016fd4c9 HTTP/1.1" 200 None 2026-04-07 13:14:07,941 - lava_callback - ERROR - Error processing callback for node 69d260140d94ee66016fd4c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34890 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:15:07,813 - lava_callback - INFO - Received callback for node 69d260570d94ee66016fd505 INFO: 172.20.0.1:34898 - "POST /node/69d260570d94ee66016fd505 HTTP/1.0" 202 Accepted 2026-04-07 13:15:07,818 - lava_callback - INFO - Starting async job submit for node 69d260570d94ee66016fd505 2026-04-07 13:15:07,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:15:07,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d260570d94ee66016fd505 HTTP/1.1" 200 None 2026-04-07 13:15:07,844 - lava_callback - DEBUG - Processing node 69d260570d94ee66016fd505: baseline-arm64-baylibre 2026-04-07 13:15:07,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d260570d94ee66016fd505 2026-04-07 13:15:07,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:15:07,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d260570d94ee66016fd505 HTTP/1.1" 200 None 2026-04-07 13:15:07,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:15:07,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:15:07,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:15:07,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d260570d94ee66016fd505 HTTP/1.1" 200 None 2026-04-07 13:15:07,908 - lava_callback - ERROR - Error processing callback for node 69d260570d94ee66016fd505: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50646 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:16:27,927 - lava_callback - INFO - Received callback for node 69d260a10d94ee66016fd519 INFO: 172.20.0.1:50650 - "POST /node/69d260a10d94ee66016fd519 HTTP/1.0" 202 Accepted 2026-04-07 13:16:27,932 - lava_callback - INFO - Starting async job submit for node 69d260a10d94ee66016fd519 2026-04-07 13:16:27,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:16:27,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d260a10d94ee66016fd519 HTTP/1.1" 200 None 2026-04-07 13:16:27,951 - lava_callback - DEBUG - Processing node 69d260a10d94ee66016fd519: baseline-arm64-baylibre 2026-04-07 13:16:27,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d260a10d94ee66016fd519 2026-04-07 13:16:27,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:16:27,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d260a10d94ee66016fd519 HTTP/1.1" 200 None 2026-04-07 13:16:27,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:16:27,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:16:27,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:16:28,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d260a10d94ee66016fd519 HTTP/1.1" 200 None 2026-04-07 13:16:28,032 - lava_callback - ERROR - Error processing callback for node 69d260a10d94ee66016fd519: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36006 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:17:39,213 - lava_callback - INFO - Received callback for node 69d260e80d94ee66016fd556 INFO: 172.20.0.1:36012 - "POST /node/69d260e80d94ee66016fd556 HTTP/1.0" 202 Accepted 2026-04-07 13:17:39,219 - lava_callback - INFO - Starting async job submit for node 69d260e80d94ee66016fd556 2026-04-07 13:17:39,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:17:39,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d260e80d94ee66016fd556 HTTP/1.1" 200 None 2026-04-07 13:17:39,244 - lava_callback - DEBUG - Processing node 69d260e80d94ee66016fd556: baseline-arm64-clabbe 2026-04-07 13:17:39,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d260e80d94ee66016fd556 2026-04-07 13:17:39,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:17:39,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d260e80d94ee66016fd556 HTTP/1.1" 200 None 2026-04-07 13:17:39,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:17:39,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:17:39,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:17:39,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d260e80d94ee66016fd556 HTTP/1.1" 200 None 2026-04-07 13:17:39,308 - lava_callback - ERROR - Error processing callback for node 69d260e80d94ee66016fd556: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36416 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:18:59,276 - lava_callback - INFO - Received callback for node 69d261310d94ee66016fd584 INFO: 172.20.0.1:36424 - "POST /node/69d261310d94ee66016fd584 HTTP/1.0" 202 Accepted 2026-04-07 13:18:59,282 - lava_callback - INFO - Starting async job submit for node 69d261310d94ee66016fd584 2026-04-07 13:18:59,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:18:59,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d261310d94ee66016fd584 HTTP/1.1" 200 None 2026-04-07 13:18:59,299 - lava_callback - DEBUG - Processing node 69d261310d94ee66016fd584: baseline-arm64-clabbe 2026-04-07 13:18:59,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d261310d94ee66016fd584 2026-04-07 13:18:59,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:18:59,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d261310d94ee66016fd584 HTTP/1.1" 200 None 2026-04-07 13:18:59,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:18:59,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:18:59,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:18:59,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d261310d94ee66016fd584 HTTP/1.1" 200 None 2026-04-07 13:18:59,355 - lava_callback - ERROR - Error processing callback for node 69d261310d94ee66016fd584: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54210 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:19:59,313 - lava_callback - INFO - Received callback for node 69d261720d94ee66016fd5c3 INFO: 172.20.0.1:54214 - "POST /node/69d261720d94ee66016fd5c3 HTTP/1.0" 202 Accepted 2026-04-07 13:19:59,318 - lava_callback - INFO - Starting async job submit for node 69d261720d94ee66016fd5c3 2026-04-07 13:19:59,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:19:59,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d261720d94ee66016fd5c3 HTTP/1.1" 200 None 2026-04-07 13:19:59,339 - lava_callback - DEBUG - Processing node 69d261720d94ee66016fd5c3: baseline-arm64-clabbe 2026-04-07 13:19:59,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d261720d94ee66016fd5c3 2026-04-07 13:19:59,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:19:59,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d261720d94ee66016fd5c3 HTTP/1.1" 200 None 2026-04-07 13:19:59,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:19:59,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:19:59,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:19:59,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d261720d94ee66016fd5c3 HTTP/1.1" 200 None 2026-04-07 13:19:59,392 - lava_callback - ERROR - Error processing callback for node 69d261720d94ee66016fd5c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55900 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:21:19,410 - lava_callback - INFO - Received callback for node 69d261ba0d94ee66016fd5e4 INFO: 172.20.0.1:55910 - "POST /node/69d261ba0d94ee66016fd5e4 HTTP/1.0" 202 Accepted 2026-04-07 13:21:19,416 - lava_callback - INFO - Starting async job submit for node 69d261ba0d94ee66016fd5e4 2026-04-07 13:21:19,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:21:19,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d261ba0d94ee66016fd5e4 HTTP/1.1" 200 None 2026-04-07 13:21:19,431 - lava_callback - DEBUG - Processing node 69d261ba0d94ee66016fd5e4: baseline-arm64-clabbe 2026-04-07 13:21:19,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d261ba0d94ee66016fd5e4 2026-04-07 13:21:19,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:21:19,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d261ba0d94ee66016fd5e4 HTTP/1.1" 200 None 2026-04-07 13:21:19,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:21:19,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:21:19,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:21:19,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d261ba0d94ee66016fd5e4 HTTP/1.1" 200 None 2026-04-07 13:21:19,487 - lava_callback - ERROR - Error processing callback for node 69d261ba0d94ee66016fd5e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55674 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:22:19,412 - lava_callback - INFO - Received callback for node 69d261ff0d94ee66016fd61a INFO: 172.20.0.1:55690 - "POST /node/69d261ff0d94ee66016fd61a HTTP/1.0" 202 Accepted 2026-04-07 13:22:19,418 - lava_callback - INFO - Starting async job submit for node 69d261ff0d94ee66016fd61a 2026-04-07 13:22:19,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:22:19,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d261ff0d94ee66016fd61a HTTP/1.1" 200 None 2026-04-07 13:22:19,435 - lava_callback - DEBUG - Processing node 69d261ff0d94ee66016fd61a: baseline-arm64-clabbe 2026-04-07 13:22:19,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d261ff0d94ee66016fd61a 2026-04-07 13:22:19,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:22:19,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d261ff0d94ee66016fd61a HTTP/1.1" 200 None 2026-04-07 13:22:19,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:22:19,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:22:19,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:22:19,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d261ff0d94ee66016fd61a HTTP/1.1" 200 None 2026-04-07 13:22:19,517 - lava_callback - ERROR - Error processing callback for node 69d261ff0d94ee66016fd61a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43218 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:23:39,508 - lava_callback - INFO - Received callback for node 69d262460d94ee66016fd644 INFO: 172.20.0.1:43222 - "POST /node/69d262460d94ee66016fd644 HTTP/1.0" 202 Accepted 2026-04-07 13:23:39,514 - lava_callback - INFO - Starting async job submit for node 69d262460d94ee66016fd644 2026-04-07 13:23:39,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:23:39,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d262460d94ee66016fd644 HTTP/1.1" 200 None 2026-04-07 13:23:39,531 - lava_callback - DEBUG - Processing node 69d262460d94ee66016fd644: baseline-arm64-clabbe 2026-04-07 13:23:39,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d262460d94ee66016fd644 2026-04-07 13:23:39,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:23:39,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d262460d94ee66016fd644 HTTP/1.1" 200 None 2026-04-07 13:23:39,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:23:39,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:23:39,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:23:39,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d262460d94ee66016fd644 HTTP/1.1" 200 None 2026-04-07 13:23:39,591 - lava_callback - ERROR - Error processing callback for node 69d262460d94ee66016fd644: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42552 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:24:39,522 - lava_callback - INFO - Received callback for node 69d2628e0d94ee66016fd675 INFO: 172.20.0.1:42560 - "POST /node/69d2628e0d94ee66016fd675 HTTP/1.0" 202 Accepted 2026-04-07 13:24:39,527 - lava_callback - INFO - Starting async job submit for node 69d2628e0d94ee66016fd675 2026-04-07 13:24:39,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:24:39,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2628e0d94ee66016fd675 HTTP/1.1" 200 None 2026-04-07 13:24:39,544 - lava_callback - DEBUG - Processing node 69d2628e0d94ee66016fd675: baseline-arm64-clabbe 2026-04-07 13:24:39,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2628e0d94ee66016fd675 2026-04-07 13:24:39,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:24:39,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2628e0d94ee66016fd675 HTTP/1.1" 200 None 2026-04-07 13:24:39,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:24:39,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:24:39,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:24:39,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2628e0d94ee66016fd675 HTTP/1.1" 200 None 2026-04-07 13:24:39,604 - lava_callback - ERROR - Error processing callback for node 69d2628e0d94ee66016fd675: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52988 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:25:39,538 - lava_callback - INFO - Received callback for node 69d262cc0d94ee66016fd6d7 INFO: 172.20.0.1:52998 - "POST /node/69d262cc0d94ee66016fd6d7 HTTP/1.0" 202 Accepted 2026-04-07 13:25:39,543 - lava_callback - INFO - Starting async job submit for node 69d262cc0d94ee66016fd6d7 2026-04-07 13:25:39,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:25:39,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d262cc0d94ee66016fd6d7 HTTP/1.1" 200 None 2026-04-07 13:25:39,582 - lava_callback - DEBUG - Processing node 69d262cc0d94ee66016fd6d7: baseline-arm64-clabbe 2026-04-07 13:25:39,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d262cc0d94ee66016fd6d7 2026-04-07 13:25:39,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:25:39,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d262cc0d94ee66016fd6d7 HTTP/1.1" 200 None 2026-04-07 13:25:39,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:25:39,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:25:39,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:25:39,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d262cc0d94ee66016fd6d7 HTTP/1.1" 200 None 2026-04-07 13:25:39,635 - lava_callback - ERROR - Error processing callback for node 69d262cc0d94ee66016fd6d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40454 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:26:59,623 - lava_callback - INFO - Received callback for node 69d263140d94ee66016fd6ec INFO: 172.20.0.1:40470 - "POST /node/69d263140d94ee66016fd6ec HTTP/1.0" 202 Accepted 2026-04-07 13:26:59,629 - lava_callback - INFO - Starting async job submit for node 69d263140d94ee66016fd6ec 2026-04-07 13:26:59,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:26:59,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d263140d94ee66016fd6ec HTTP/1.1" 200 None 2026-04-07 13:26:59,645 - lava_callback - DEBUG - Processing node 69d263140d94ee66016fd6ec: baseline-arm64-clabbe 2026-04-07 13:26:59,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d263140d94ee66016fd6ec 2026-04-07 13:26:59,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:26:59,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d263140d94ee66016fd6ec HTTP/1.1" 200 None 2026-04-07 13:26:59,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:26:59,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:26:59,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:26:59,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d263140d94ee66016fd6ec HTTP/1.1" 200 None 2026-04-07 13:26:59,696 - lava_callback - ERROR - Error processing callback for node 69d263140d94ee66016fd6ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56980 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:27:59,668 - lava_callback - INFO - Received callback for node 69d2634e0d94ee66016fd765 INFO: 172.20.0.1:56994 - "POST /node/69d2634e0d94ee66016fd765 HTTP/1.0" 202 Accepted 2026-04-07 13:27:59,673 - lava_callback - INFO - Starting async job submit for node 69d2634e0d94ee66016fd765 2026-04-07 13:27:59,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:27:59,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2634e0d94ee66016fd765 HTTP/1.1" 200 None 2026-04-07 13:27:59,688 - lava_callback - DEBUG - Processing node 69d2634e0d94ee66016fd765: baseline-arm64-clabbe 2026-04-07 13:27:59,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2634e0d94ee66016fd765 2026-04-07 13:27:59,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:27:59,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2634e0d94ee66016fd765 HTTP/1.1" 200 None 2026-04-07 13:27:59,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:27:59,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:27:59,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:27:59,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2634e0d94ee66016fd765 HTTP/1.1" 200 None 2026-04-07 13:27:59,742 - lava_callback - ERROR - Error processing callback for node 69d2634e0d94ee66016fd765: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38358 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:28:59,757 - lava_callback - INFO - Received callback for node 69d263900d94ee66016fd7a3 INFO: 172.20.0.1:47724 - "POST /node/69d263900d94ee66016fd7a3 HTTP/1.0" 202 Accepted 2026-04-07 13:28:59,762 - lava_callback - INFO - Starting async job submit for node 69d263900d94ee66016fd7a3 2026-04-07 13:28:59,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:28:59,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d263900d94ee66016fd7a3 HTTP/1.1" 200 None 2026-04-07 13:28:59,779 - lava_callback - DEBUG - Processing node 69d263900d94ee66016fd7a3: baseline-arm64-clabbe 2026-04-07 13:28:59,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d263900d94ee66016fd7a3 2026-04-07 13:28:59,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:28:59,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d263900d94ee66016fd7a3 HTTP/1.1" 200 None 2026-04-07 13:28:59,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:28:59,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:28:59,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:28:59,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d263900d94ee66016fd7a3 HTTP/1.1" 200 None 2026-04-07 13:28:59,835 - lava_callback - ERROR - Error processing callback for node 69d263900d94ee66016fd7a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44792 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:30:19,821 - lava_callback - INFO - Received callback for node 69d263d60d94ee66016fd7da INFO: 172.20.0.1:40532 - "POST /node/69d263d60d94ee66016fd7da HTTP/1.0" 202 Accepted 2026-04-07 13:30:19,827 - lava_callback - INFO - Starting async job submit for node 69d263d60d94ee66016fd7da 2026-04-07 13:30:19,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:30:19,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d263d60d94ee66016fd7da HTTP/1.1" 200 None 2026-04-07 13:30:19,843 - lava_callback - DEBUG - Processing node 69d263d60d94ee66016fd7da: baseline-arm64-clabbe 2026-04-07 13:30:19,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d263d60d94ee66016fd7da 2026-04-07 13:30:19,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:30:19,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d263d60d94ee66016fd7da HTTP/1.1" 200 None 2026-04-07 13:30:19,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:30:19,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:30:19,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:30:19,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d263d60d94ee66016fd7da HTTP/1.1" 200 None 2026-04-07 13:30:19,927 - lava_callback - ERROR - Error processing callback for node 69d263d60d94ee66016fd7da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46420 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:31:08,822 - lava_callback - INFO - Received callback for node 69d264090d94ee66016fd7f4 INFO: 172.20.0.1:46434 - "POST /node/69d264090d94ee66016fd7f4 HTTP/1.0" 202 Accepted 2026-04-07 13:31:08,828 - lava_callback - INFO - Starting async job submit for node 69d264090d94ee66016fd7f4 2026-04-07 13:31:08,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:31:08,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d264090d94ee66016fd7f4 HTTP/1.1" 200 None 2026-04-07 13:31:08,845 - lava_callback - DEBUG - Processing node 69d264090d94ee66016fd7f4: baseline-arm-baylibre 2026-04-07 13:31:08,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d264090d94ee66016fd7f4 2026-04-07 13:31:08,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:31:08,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d264090d94ee66016fd7f4 HTTP/1.1" 200 None 2026-04-07 13:31:08,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:31:08,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:31:08,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:31:08,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d264090d94ee66016fd7f4 HTTP/1.1" 200 None 2026-04-07 13:31:08,904 - lava_callback - ERROR - Error processing callback for node 69d264090d94ee66016fd7f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39284 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:31:28,727 - lava_callback - INFO - Received callback for node 69d2642c0d94ee66016fd81b INFO: 172.20.0.1:39290 - "POST /node/69d2642c0d94ee66016fd81b HTTP/1.0" 202 Accepted 2026-04-07 13:31:28,732 - lava_callback - INFO - Starting async job submit for node 69d2642c0d94ee66016fd81b 2026-04-07 13:31:28,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:31:28,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2642c0d94ee66016fd81b HTTP/1.1" 200 None 2026-04-07 13:31:28,748 - lava_callback - DEBUG - Processing node 69d2642c0d94ee66016fd81b: baseline-arm-baylibre 2026-04-07 13:31:28,749 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2642c0d94ee66016fd81b 2026-04-07 13:31:28,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:31:28,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2642c0d94ee66016fd81b HTTP/1.1" 200 None 2026-04-07 13:31:28,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:31:28,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:31:28,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:31:28,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2642c0d94ee66016fd81b HTTP/1.1" 200 None 2026-04-07 13:31:28,821 - lava_callback - ERROR - Error processing callback for node 69d2642c0d94ee66016fd81b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54490 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:32:08,756 - lava_callback - INFO - Received callback for node 69d2644c0d94ee66016fd842 INFO: 172.20.0.1:54492 - "POST /node/69d2644c0d94ee66016fd842 HTTP/1.0" 202 Accepted 2026-04-07 13:32:08,762 - lava_callback - INFO - Starting async job submit for node 69d2644c0d94ee66016fd842 2026-04-07 13:32:08,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:32:08,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2644c0d94ee66016fd842 HTTP/1.1" 200 None 2026-04-07 13:32:08,778 - lava_callback - DEBUG - Processing node 69d2644c0d94ee66016fd842: baseline-arm-baylibre 2026-04-07 13:32:08,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2644c0d94ee66016fd842 2026-04-07 13:32:08,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:32:08,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2644c0d94ee66016fd842 HTTP/1.1" 200 None 2026-04-07 13:32:08,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:32:08,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:32:08,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:32:08,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2644c0d94ee66016fd842 HTTP/1.1" 200 None 2026-04-07 13:32:08,837 - lava_callback - ERROR - Error processing callback for node 69d2644c0d94ee66016fd842: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56992 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:32:48,815 - lava_callback - INFO - Received callback for node 69d2646e0d94ee66016fd860 INFO: 172.20.0.1:57008 - "POST /node/69d2646e0d94ee66016fd860 HTTP/1.0" 202 Accepted 2026-04-07 13:32:48,821 - lava_callback - INFO - Starting async job submit for node 69d2646e0d94ee66016fd860 2026-04-07 13:32:48,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:32:48,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2646e0d94ee66016fd860 HTTP/1.1" 200 None 2026-04-07 13:32:48,839 - lava_callback - DEBUG - Processing node 69d2646e0d94ee66016fd860: baseline-arm-baylibre 2026-04-07 13:32:48,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2646e0d94ee66016fd860 2026-04-07 13:32:48,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:32:48,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2646e0d94ee66016fd860 HTTP/1.1" 200 None 2026-04-07 13:32:48,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:32:48,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:32:48,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:32:48,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2646e0d94ee66016fd860 HTTP/1.1" 200 None 2026-04-07 13:32:48,896 - lava_callback - ERROR - Error processing callback for node 69d2646e0d94ee66016fd860: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51448 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:33:08,833 - lava_callback - INFO - Received callback for node 69d2648f0d94ee66016fd86a INFO: 172.20.0.1:51460 - "POST /node/69d2648f0d94ee66016fd86a HTTP/1.0" 202 Accepted 2026-04-07 13:33:08,839 - lava_callback - INFO - Starting async job submit for node 69d2648f0d94ee66016fd86a 2026-04-07 13:33:08,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:33:08,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2648f0d94ee66016fd86a HTTP/1.1" 200 None 2026-04-07 13:33:08,855 - lava_callback - DEBUG - Processing node 69d2648f0d94ee66016fd86a: baseline-arm-baylibre 2026-04-07 13:33:08,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2648f0d94ee66016fd86a 2026-04-07 13:33:08,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:33:08,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2648f0d94ee66016fd86a HTTP/1.1" 200 None 2026-04-07 13:33:08,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:33:08,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:33:08,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:33:08,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2648f0d94ee66016fd86a HTTP/1.1" 200 None 2026-04-07 13:33:08,907 - lava_callback - ERROR - Error processing callback for node 69d2648f0d94ee66016fd86a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44024 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:33:39,944 - lava_callback - INFO - Received callback for node 69d264b10d94ee66016fd886 INFO: 172.20.0.1:60054 - "POST /node/69d264b10d94ee66016fd886 HTTP/1.0" 202 Accepted 2026-04-07 13:33:39,949 - lava_callback - INFO - Starting async job submit for node 69d264b10d94ee66016fd886 2026-04-07 13:33:39,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:33:39,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d264b10d94ee66016fd886 HTTP/1.1" 200 None 2026-04-07 13:33:39,977 - lava_callback - DEBUG - Processing node 69d264b10d94ee66016fd886: baseline-arm-clabbe 2026-04-07 13:33:39,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d264b10d94ee66016fd886 2026-04-07 13:33:39,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:33:39,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d264b10d94ee66016fd886 HTTP/1.1" 200 None 2026-04-07 13:33:39,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:33:40,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:33:40,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:33:40,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d264b10d94ee66016fd886 HTTP/1.1" 200 None 2026-04-07 13:33:40,035 - lava_callback - ERROR - Error processing callback for node 69d264b10d94ee66016fd886: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54452 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:34:19,924 - lava_callback - INFO - Received callback for node 69d264d40d94ee66016fd8ad INFO: 172.20.0.1:45380 - "POST /node/69d264d40d94ee66016fd8ad HTTP/1.0" 202 Accepted 2026-04-07 13:34:19,930 - lava_callback - INFO - Starting async job submit for node 69d264d40d94ee66016fd8ad 2026-04-07 13:34:19,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:34:19,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d264d40d94ee66016fd8ad HTTP/1.1" 200 None 2026-04-07 13:34:19,948 - lava_callback - DEBUG - Processing node 69d264d40d94ee66016fd8ad: baseline-arm-clabbe 2026-04-07 13:34:19,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d264d40d94ee66016fd8ad 2026-04-07 13:34:19,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:34:19,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d264d40d94ee66016fd8ad HTTP/1.1" 200 None 2026-04-07 13:34:19,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:34:19,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:34:19,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:34:20,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d264d40d94ee66016fd8ad HTTP/1.1" 200 None 2026-04-07 13:34:20,011 - lava_callback - ERROR - Error processing callback for node 69d264d40d94ee66016fd8ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43360 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:34:48,926 - lava_callback - INFO - Received callback for node 69d264f30d94ee66016fd8c7 INFO: 172.20.0.1:43370 - "POST /node/69d264f30d94ee66016fd8c7 HTTP/1.0" 202 Accepted 2026-04-07 13:34:48,932 - lava_callback - INFO - Starting async job submit for node 69d264f30d94ee66016fd8c7 2026-04-07 13:34:48,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:34:48,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d264f30d94ee66016fd8c7 HTTP/1.1" 200 None 2026-04-07 13:34:48,948 - lava_callback - DEBUG - Processing node 69d264f30d94ee66016fd8c7: baseline-arm-baylibre 2026-04-07 13:34:48,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d264f30d94ee66016fd8c7 2026-04-07 13:34:48,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:34:48,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d264f30d94ee66016fd8c7 HTTP/1.1" 200 None 2026-04-07 13:34:48,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:34:48,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:34:48,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:34:49,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d264f30d94ee66016fd8c7 HTTP/1.1" 200 None 2026-04-07 13:34:49,009 - lava_callback - ERROR - Error processing callback for node 69d264f30d94ee66016fd8c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59914 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:35:20,082 - lava_callback - INFO - Received callback for node 69d265150d94ee66016fd8d5 INFO: 172.20.0.1:47736 - "POST /node/69d265150d94ee66016fd8d5 HTTP/1.0" 202 Accepted 2026-04-07 13:35:20,087 - lava_callback - INFO - Starting async job submit for node 69d265150d94ee66016fd8d5 2026-04-07 13:35:20,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:35:20,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d265150d94ee66016fd8d5 HTTP/1.1" 200 None 2026-04-07 13:35:20,104 - lava_callback - DEBUG - Processing node 69d265150d94ee66016fd8d5: baseline-arm-clabbe 2026-04-07 13:35:20,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d265150d94ee66016fd8d5 2026-04-07 13:35:20,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:35:20,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d265150d94ee66016fd8d5 HTTP/1.1" 200 None 2026-04-07 13:35:20,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:35:20,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:35:20,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:35:20,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d265150d94ee66016fd8d5 HTTP/1.1" 200 None 2026-04-07 13:35:20,165 - lava_callback - ERROR - Error processing callback for node 69d265150d94ee66016fd8d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34688 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:36:00,082 - lava_callback - INFO - Received callback for node 69d265320d94ee66016fd934 INFO: 172.20.0.1:53604 - "POST /node/69d265320d94ee66016fd934 HTTP/1.0" 202 Accepted 2026-04-07 13:36:00,088 - lava_callback - INFO - Starting async job submit for node 69d265320d94ee66016fd934 2026-04-07 13:36:00,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:36:00,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d265320d94ee66016fd934 HTTP/1.1" 200 None 2026-04-07 13:36:00,104 - lava_callback - DEBUG - Processing node 69d265320d94ee66016fd934: baseline-arm-clabbe 2026-04-07 13:36:00,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d265320d94ee66016fd934 2026-04-07 13:36:00,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:36:00,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d265320d94ee66016fd934 HTTP/1.1" 200 None 2026-04-07 13:36:00,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:36:00,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:36:00,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:36:00,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d265320d94ee66016fd934 HTTP/1.1" 200 None 2026-04-07 13:36:00,193 - lava_callback - ERROR - Error processing callback for node 69d265320d94ee66016fd934: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53008 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:36:29,062 - lava_callback - INFO - Received callback for node 69d265510d94ee66016fd93b INFO: 172.20.0.1:53024 - "POST /node/69d265510d94ee66016fd93b HTTP/1.0" 202 Accepted 2026-04-07 13:36:29,068 - lava_callback - INFO - Starting async job submit for node 69d265510d94ee66016fd93b 2026-04-07 13:36:29,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:36:29,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d265510d94ee66016fd93b HTTP/1.1" 200 None 2026-04-07 13:36:29,084 - lava_callback - DEBUG - Processing node 69d265510d94ee66016fd93b: baseline-arm-baylibre 2026-04-07 13:36:29,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d265510d94ee66016fd93b 2026-04-07 13:36:29,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:36:29,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d265510d94ee66016fd93b HTTP/1.1" 200 None 2026-04-07 13:36:29,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:36:29,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:36:29,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:36:29,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d265510d94ee66016fd93b HTTP/1.1" 200 None 2026-04-07 13:36:29,153 - lava_callback - ERROR - Error processing callback for node 69d265510d94ee66016fd93b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52660 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:37:20,075 - lava_callback - INFO - Received callback for node 69d265790d94ee66016fd951 INFO: 172.20.0.1:39886 - "POST /node/69d265790d94ee66016fd951 HTTP/1.0" 202 Accepted 2026-04-07 13:37:20,081 - lava_callback - INFO - Starting async job submit for node 69d265790d94ee66016fd951 2026-04-07 13:37:20,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:37:20,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d265790d94ee66016fd951 HTTP/1.1" 200 None 2026-04-07 13:37:20,117 - lava_callback - DEBUG - Processing node 69d265790d94ee66016fd951: baseline-arm-clabbe 2026-04-07 13:37:20,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d265790d94ee66016fd951 2026-04-07 13:37:20,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:37:20,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d265790d94ee66016fd951 HTTP/1.1" 200 None 2026-04-07 13:37:20,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:37:20,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:37:20,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:37:20,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d265790d94ee66016fd951 HTTP/1.1" 200 None 2026-04-07 13:37:20,182 - lava_callback - ERROR - Error processing callback for node 69d265790d94ee66016fd951: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39910 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:37:29,053 - lava_callback - INFO - Received callback for node 69d265920d94ee66016fd989 INFO: 172.20.0.1:39916 - "POST /node/69d265920d94ee66016fd989 HTTP/1.0" 202 Accepted 2026-04-07 13:37:29,058 - lava_callback - INFO - Starting async job submit for node 69d265920d94ee66016fd989 2026-04-07 13:37:29,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:37:29,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d265920d94ee66016fd989 HTTP/1.1" 200 None 2026-04-07 13:37:29,076 - lava_callback - DEBUG - Processing node 69d265920d94ee66016fd989: baseline-arm-baylibre 2026-04-07 13:37:29,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d265920d94ee66016fd989 2026-04-07 13:37:29,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:37:29,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d265920d94ee66016fd989 HTTP/1.1" 200 None 2026-04-07 13:37:29,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:37:29,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:37:29,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:37:29,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d265920d94ee66016fd989 HTTP/1.1" 200 None 2026-04-07 13:37:29,137 - lava_callback - ERROR - Error processing callback for node 69d265920d94ee66016fd989: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50476 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:39:20,616 - lava_callback - INFO - Received callback for node 69d265f40d94ee66016fd9e3 INFO: 172.20.0.1:60476 - "POST /node/69d265f40d94ee66016fd9e3 HTTP/1.0" 202 Accepted 2026-04-07 13:39:20,622 - lava_callback - INFO - Starting async job submit for node 69d265f40d94ee66016fd9e3 2026-04-07 13:39:20,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:39:20,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d265f40d94ee66016fd9e3 HTTP/1.1" 200 None 2026-04-07 13:39:20,638 - lava_callback - DEBUG - Processing node 69d265f40d94ee66016fd9e3: baseline-arm-clabbe 2026-04-07 13:39:20,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d265f40d94ee66016fd9e3 2026-04-07 13:39:20,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:39:20,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d265f40d94ee66016fd9e3 HTTP/1.1" 200 None 2026-04-07 13:39:20,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:39:20,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:39:20,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:39:20,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d265f40d94ee66016fd9e3 HTTP/1.1" 200 None 2026-04-07 13:39:20,707 - lava_callback - ERROR - Error processing callback for node 69d265f40d94ee66016fd9e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36142 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:39:40,159 - lava_callback - INFO - Received callback for node 69d266170d94ee66016fd9fc INFO: 172.20.0.1:48578 - "POST /node/69d266170d94ee66016fd9fc HTTP/1.0" 202 Accepted 2026-04-07 13:39:40,165 - lava_callback - INFO - Starting async job submit for node 69d266170d94ee66016fd9fc 2026-04-07 13:39:40,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:39:40,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d266170d94ee66016fd9fc HTTP/1.1" 200 None 2026-04-07 13:39:40,193 - lava_callback - DEBUG - Processing node 69d266170d94ee66016fd9fc: baseline-arm-clabbe 2026-04-07 13:39:40,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d266170d94ee66016fd9fc 2026-04-07 13:39:40,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:39:40,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d266170d94ee66016fd9fc HTTP/1.1" 200 None 2026-04-07 13:39:40,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:39:40,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:39:40,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:39:40,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d266170d94ee66016fd9fc HTTP/1.1" 200 None 2026-04-07 13:39:40,251 - lava_callback - ERROR - Error processing callback for node 69d266170d94ee66016fd9fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44572 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:40:20,168 - lava_callback - INFO - Received callback for node 69d2663a0d94ee66016fda0d INFO: 172.20.0.1:36914 - "POST /node/69d2663a0d94ee66016fda0d HTTP/1.0" 202 Accepted 2026-04-07 13:40:20,174 - lava_callback - INFO - Starting async job submit for node 69d2663a0d94ee66016fda0d 2026-04-07 13:40:20,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:40:20,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2663a0d94ee66016fda0d HTTP/1.1" 200 None 2026-04-07 13:40:20,191 - lava_callback - DEBUG - Processing node 69d2663a0d94ee66016fda0d: baseline-arm-clabbe 2026-04-07 13:40:20,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2663a0d94ee66016fda0d 2026-04-07 13:40:20,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:40:20,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2663a0d94ee66016fda0d HTTP/1.1" 200 None 2026-04-07 13:40:20,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:40:20,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:40:20,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:40:20,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2663a0d94ee66016fda0d HTTP/1.1" 200 None 2026-04-07 13:40:20,260 - lava_callback - ERROR - Error processing callback for node 69d2663a0d94ee66016fda0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46958 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:41:00,163 - lava_callback - INFO - Received callback for node 69d2665f0d94ee66016fda22 INFO: 172.20.0.1:59526 - "POST /node/69d2665f0d94ee66016fda22 HTTP/1.0" 202 Accepted 2026-04-07 13:41:00,168 - lava_callback - INFO - Starting async job submit for node 69d2665f0d94ee66016fda22 2026-04-07 13:41:00,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:41:00,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2665f0d94ee66016fda22 HTTP/1.1" 200 None 2026-04-07 13:41:00,191 - lava_callback - DEBUG - Processing node 69d2665f0d94ee66016fda22: baseline-arm-clabbe 2026-04-07 13:41:00,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2665f0d94ee66016fda22 2026-04-07 13:41:00,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:41:00,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2665f0d94ee66016fda22 HTTP/1.1" 200 None 2026-04-07 13:41:00,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:41:00,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:41:00,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:41:00,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2665f0d94ee66016fda22 HTTP/1.1" 200 None 2026-04-07 13:41:00,247 - lava_callback - ERROR - Error processing callback for node 69d2665f0d94ee66016fda22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35212 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:41:20,285 - lava_callback - INFO - Received callback for node 69d2667d0d94ee66016fda30 INFO: 172.20.0.1:43168 - "POST /node/69d2667d0d94ee66016fda30 HTTP/1.0" 202 Accepted 2026-04-07 13:41:20,291 - lava_callback - INFO - Starting async job submit for node 69d2667d0d94ee66016fda30 2026-04-07 13:41:20,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:41:20,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2667d0d94ee66016fda30 HTTP/1.1" 200 None 2026-04-07 13:41:20,307 - lava_callback - DEBUG - Processing node 69d2667d0d94ee66016fda30: baseline-arm-clabbe 2026-04-07 13:41:20,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2667d0d94ee66016fda30 2026-04-07 13:41:20,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:41:20,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2667d0d94ee66016fda30 HTTP/1.1" 200 None 2026-04-07 13:41:20,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:41:20,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:41:20,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:41:20,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2667d0d94ee66016fda30 HTTP/1.1" 200 None 2026-04-07 13:41:20,381 - lava_callback - ERROR - Error processing callback for node 69d2667d0d94ee66016fda30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38240 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:42:00,237 - lava_callback - INFO - Received callback for node 69d2669e0d94ee66016fda61 INFO: 172.20.0.1:53538 - "POST /node/69d2669e0d94ee66016fda61 HTTP/1.0" 202 Accepted 2026-04-07 13:42:00,243 - lava_callback - INFO - Starting async job submit for node 69d2669e0d94ee66016fda61 2026-04-07 13:42:00,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:42:00,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2669e0d94ee66016fda61 HTTP/1.1" 200 None 2026-04-07 13:42:00,260 - lava_callback - DEBUG - Processing node 69d2669e0d94ee66016fda61: baseline-arm-clabbe 2026-04-07 13:42:00,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2669e0d94ee66016fda61 2026-04-07 13:42:00,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:42:00,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2669e0d94ee66016fda61 HTTP/1.1" 200 None 2026-04-07 13:42:00,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:42:00,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 13:42:00,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:42:00,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2669e0d94ee66016fda61 HTTP/1.1" 200 None 2026-04-07 13:42:00,315 - lava_callback - ERROR - Error processing callback for node 69d2669e0d94ee66016fda61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59874 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:42:49,461 - lava_callback - INFO - Received callback for node 69d266cb0d94ee66016fda8a INFO: 172.20.0.1:59882 - "POST /node/69d266cb0d94ee66016fda8a HTTP/1.0" 202 Accepted 2026-04-07 13:42:49,468 - lava_callback - INFO - Starting async job submit for node 69d266cb0d94ee66016fda8a 2026-04-07 13:42:49,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:42:49,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d266cb0d94ee66016fda8a HTTP/1.1" 200 None 2026-04-07 13:42:49,500 - lava_callback - DEBUG - Processing node 69d266cb0d94ee66016fda8a: baseline-arm64-baylibre 2026-04-07 13:42:49,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d266cb0d94ee66016fda8a 2026-04-07 13:42:49,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:42:49,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d266cb0d94ee66016fda8a HTTP/1.1" 200 None 2026-04-07 13:42:49,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:42:49,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:42:49,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:42:49,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d266cb0d94ee66016fda8a HTTP/1.1" 200 None 2026-04-07 13:42:49,572 - lava_callback - ERROR - Error processing callback for node 69d266cb0d94ee66016fda8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48388 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:44:00,361 - lava_callback - INFO - Received callback for node 69d267150d94ee66016fdaba INFO: 172.20.0.1:50232 - "POST /node/69d267150d94ee66016fdaba HTTP/1.0" 202 Accepted 2026-04-07 13:44:00,369 - lava_callback - INFO - Starting async job submit for node 69d267150d94ee66016fdaba 2026-04-07 13:44:00,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:44:00,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d267150d94ee66016fdaba HTTP/1.1" 200 None 2026-04-07 13:44:00,385 - lava_callback - DEBUG - Processing node 69d267150d94ee66016fdaba: baseline-arm64-clabbe 2026-04-07 13:44:00,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d267150d94ee66016fdaba 2026-04-07 13:44:00,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:44:00,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d267150d94ee66016fdaba HTTP/1.1" 200 None 2026-04-07 13:44:00,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:44:00,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:44:00,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:44:00,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d267150d94ee66016fdaba HTTP/1.1" 200 None 2026-04-07 13:44:00,444 - lava_callback - ERROR - Error processing callback for node 69d267150d94ee66016fdaba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56108 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:45:20,506 - lava_callback - INFO - Received callback for node 69d2675b0d94ee66016fdaf2 INFO: 172.20.0.1:37818 - "POST /node/69d2675b0d94ee66016fdaf2 HTTP/1.0" 202 Accepted 2026-04-07 13:45:20,512 - lava_callback - INFO - Starting async job submit for node 69d2675b0d94ee66016fdaf2 2026-04-07 13:45:20,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:45:20,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2675b0d94ee66016fdaf2 HTTP/1.1" 200 None 2026-04-07 13:45:20,529 - lava_callback - DEBUG - Processing node 69d2675b0d94ee66016fdaf2: baseline-arm64-clabbe 2026-04-07 13:45:20,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2675b0d94ee66016fdaf2 2026-04-07 13:45:20,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:45:20,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2675b0d94ee66016fdaf2 HTTP/1.1" 200 None 2026-04-07 13:45:20,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:45:20,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:45:20,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:45:20,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2675b0d94ee66016fdaf2 HTTP/1.1" 200 None 2026-04-07 13:45:20,588 - lava_callback - ERROR - Error processing callback for node 69d2675b0d94ee66016fdaf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60558 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:46:09,548 - lava_callback - INFO - Received callback for node 69d267950d94ee66016fdb33 INFO: 172.20.0.1:60566 - "POST /node/69d267950d94ee66016fdb33 HTTP/1.0" 202 Accepted 2026-04-07 13:46:09,557 - lava_callback - INFO - Starting async job submit for node 69d267950d94ee66016fdb33 2026-04-07 13:46:09,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:46:09,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d267950d94ee66016fdb33 HTTP/1.1" 200 None 2026-04-07 13:46:09,575 - lava_callback - DEBUG - Processing node 69d267950d94ee66016fdb33: baseline-arm64-baylibre 2026-04-07 13:46:09,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d267950d94ee66016fdb33 2026-04-07 13:46:09,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:46:09,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d267950d94ee66016fdb33 HTTP/1.1" 200 None 2026-04-07 13:46:09,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:46:09,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:46:09,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:46:09,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d267950d94ee66016fdb33 HTTP/1.1" 200 None 2026-04-07 13:46:09,641 - lava_callback - ERROR - Error processing callback for node 69d267950d94ee66016fdb33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51406 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:47:20,540 - lava_callback - INFO - Received callback for node 69d267db0d94ee66016fdb83 INFO: 172.20.0.1:41228 - "POST /node/69d267db0d94ee66016fdb83 HTTP/1.0" 202 Accepted 2026-04-07 13:47:20,549 - lava_callback - INFO - Starting async job submit for node 69d267db0d94ee66016fdb83 2026-04-07 13:47:20,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:47:20,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d267db0d94ee66016fdb83 HTTP/1.1" 200 None 2026-04-07 13:47:20,567 - lava_callback - DEBUG - Processing node 69d267db0d94ee66016fdb83: baseline-arm64-clabbe 2026-04-07 13:47:20,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d267db0d94ee66016fdb83 2026-04-07 13:47:20,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:47:20,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d267db0d94ee66016fdb83 HTTP/1.1" 200 None 2026-04-07 13:47:20,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:47:20,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:47:20,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:47:20,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d267db0d94ee66016fdb83 HTTP/1.1" 200 None 2026-04-07 13:47:20,636 - lava_callback - ERROR - Error processing callback for node 69d267db0d94ee66016fdb83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48300 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:48:29,712 - lava_callback - INFO - Received callback for node 69d2681a0d94ee66016fdbc4 INFO: 172.20.0.1:54818 - "POST /node/69d2681a0d94ee66016fdbc4 HTTP/1.0" 202 Accepted 2026-04-07 13:48:29,719 - lava_callback - INFO - Starting async job submit for node 69d2681a0d94ee66016fdbc4 2026-04-07 13:48:29,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:48:29,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2681a0d94ee66016fdbc4 HTTP/1.1" 200 None 2026-04-07 13:48:29,736 - lava_callback - DEBUG - Processing node 69d2681a0d94ee66016fdbc4: baseline-arm64-baylibre 2026-04-07 13:48:29,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2681a0d94ee66016fdbc4 2026-04-07 13:48:29,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:48:29,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2681a0d94ee66016fdbc4 HTTP/1.1" 200 None 2026-04-07 13:48:29,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:48:29,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:48:29,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:48:29,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2681a0d94ee66016fdbc4 HTTP/1.1" 200 None 2026-04-07 13:48:29,801 - lava_callback - ERROR - Error processing callback for node 69d2681a0d94ee66016fdbc4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45882 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:49:40,665 - lava_callback - INFO - Received callback for node 69d268660d94ee66016fdbe5 INFO: 172.20.0.1:36418 - "POST /node/69d268660d94ee66016fdbe5 HTTP/1.0" 202 Accepted 2026-04-07 13:49:40,671 - lava_callback - INFO - Starting async job submit for node 69d268660d94ee66016fdbe5 2026-04-07 13:49:40,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:49:40,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d268660d94ee66016fdbe5 HTTP/1.1" 200 None 2026-04-07 13:49:40,687 - lava_callback - DEBUG - Processing node 69d268660d94ee66016fdbe5: baseline-arm64-clabbe 2026-04-07 13:49:40,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d268660d94ee66016fdbe5 2026-04-07 13:49:40,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:49:40,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d268660d94ee66016fdbe5 HTTP/1.1" 200 None 2026-04-07 13:49:40,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:49:40,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:49:40,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:49:40,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d268660d94ee66016fdbe5 HTTP/1.1" 200 None 2026-04-07 13:49:40,744 - lava_callback - ERROR - Error processing callback for node 69d268660d94ee66016fdbe5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39884 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:50:40,659 - lava_callback - INFO - Received callback for node 69d268a60d94ee66016fdc35 INFO: 172.20.0.1:60672 - "POST /node/69d268a60d94ee66016fdc35 HTTP/1.0" 202 Accepted 2026-04-07 13:50:40,666 - lava_callback - INFO - Starting async job submit for node 69d268a60d94ee66016fdc35 2026-04-07 13:50:40,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:50:40,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d268a60d94ee66016fdc35 HTTP/1.1" 200 None 2026-04-07 13:50:40,682 - lava_callback - DEBUG - Processing node 69d268a60d94ee66016fdc35: baseline-arm64-clabbe 2026-04-07 13:50:40,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d268a60d94ee66016fdc35 2026-04-07 13:50:40,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:50:40,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d268a60d94ee66016fdc35 HTTP/1.1" 200 None 2026-04-07 13:50:40,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:50:40,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:50:40,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:50:40,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d268a60d94ee66016fdc35 HTTP/1.1" 200 None 2026-04-07 13:50:40,746 - lava_callback - ERROR - Error processing callback for node 69d268a60d94ee66016fdc35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54264 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:51:40,691 - lava_callback - INFO - Received callback for node 69d268e90d94ee66016fdc75 INFO: 172.20.0.1:47708 - "POST /node/69d268e90d94ee66016fdc75 HTTP/1.0" 202 Accepted 2026-04-07 13:51:40,696 - lava_callback - INFO - Starting async job submit for node 69d268e90d94ee66016fdc75 2026-04-07 13:51:40,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:51:40,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d268e90d94ee66016fdc75 HTTP/1.1" 200 None 2026-04-07 13:51:40,713 - lava_callback - DEBUG - Processing node 69d268e90d94ee66016fdc75: baseline-arm64-clabbe 2026-04-07 13:51:40,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d268e90d94ee66016fdc75 2026-04-07 13:51:40,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:51:40,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d268e90d94ee66016fdc75 HTTP/1.1" 200 None 2026-04-07 13:51:40,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:51:40,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:51:40,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:51:40,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d268e90d94ee66016fdc75 HTTP/1.1" 200 None 2026-04-07 13:51:40,773 - lava_callback - ERROR - Error processing callback for node 69d268e90d94ee66016fdc75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53980 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:53:00,718 - lava_callback - INFO - Received callback for node 69d2692c0d94ee66016fdcac INFO: 172.20.0.1:47818 - "POST /node/69d2692c0d94ee66016fdcac HTTP/1.0" 202 Accepted 2026-04-07 13:53:00,724 - lava_callback - INFO - Starting async job submit for node 69d2692c0d94ee66016fdcac 2026-04-07 13:53:00,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:53:00,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2692c0d94ee66016fdcac HTTP/1.1" 200 None 2026-04-07 13:53:00,745 - lava_callback - DEBUG - Processing node 69d2692c0d94ee66016fdcac: baseline-arm64-clabbe 2026-04-07 13:53:00,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2692c0d94ee66016fdcac 2026-04-07 13:53:00,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:53:00,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2692c0d94ee66016fdcac HTTP/1.1" 200 None 2026-04-07 13:53:00,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:53:00,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:53:00,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:53:00,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2692c0d94ee66016fdcac HTTP/1.1" 200 None 2026-04-07 13:53:00,828 - lava_callback - ERROR - Error processing callback for node 69d2692c0d94ee66016fdcac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48422 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:54:00,773 - lava_callback - INFO - Received callback for node 69d2696d0d94ee66016fdcf1 INFO: 172.20.0.1:48800 - "POST /node/69d2696d0d94ee66016fdcf1 HTTP/1.0" 202 Accepted 2026-04-07 13:54:00,782 - lava_callback - INFO - Starting async job submit for node 69d2696d0d94ee66016fdcf1 2026-04-07 13:54:00,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:54:00,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2696d0d94ee66016fdcf1 HTTP/1.1" 200 None 2026-04-07 13:54:00,808 - lava_callback - DEBUG - Processing node 69d2696d0d94ee66016fdcf1: baseline-arm64-clabbe 2026-04-07 13:54:00,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2696d0d94ee66016fdcf1 2026-04-07 13:54:00,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:54:00,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2696d0d94ee66016fdcf1 HTTP/1.1" 200 None 2026-04-07 13:54:00,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:54:00,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:54:00,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:54:00,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2696d0d94ee66016fdcf1 HTTP/1.1" 200 None 2026-04-07 13:54:00,893 - lava_callback - ERROR - Error processing callback for node 69d2696d0d94ee66016fdcf1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49050 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:55:00,774 - lava_callback - INFO - Received callback for node 69d269b00d94ee66016fdd38 INFO: 172.20.0.1:40932 - "POST /node/69d269b00d94ee66016fdd38 HTTP/1.0" 202 Accepted 2026-04-07 13:55:00,780 - lava_callback - INFO - Starting async job submit for node 69d269b00d94ee66016fdd38 2026-04-07 13:55:00,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:55:00,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d269b00d94ee66016fdd38 HTTP/1.1" 200 None 2026-04-07 13:55:00,796 - lava_callback - DEBUG - Processing node 69d269b00d94ee66016fdd38: baseline-arm64-clabbe 2026-04-07 13:55:00,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d269b00d94ee66016fdd38 2026-04-07 13:55:00,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:55:00,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d269b00d94ee66016fdd38 HTTP/1.1" 200 None 2026-04-07 13:55:00,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:55:00,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:55:00,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:55:00,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d269b00d94ee66016fdd38 HTTP/1.1" 200 None 2026-04-07 13:55:00,853 - lava_callback - ERROR - Error processing callback for node 69d269b00d94ee66016fdd38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54240 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:56:20,893 - lava_callback - INFO - Received callback for node 69d269f40d94ee66016fdd71 INFO: 172.20.0.1:47120 - "POST /node/69d269f40d94ee66016fdd71 HTTP/1.0" 202 Accepted 2026-04-07 13:56:20,899 - lava_callback - INFO - Starting async job submit for node 69d269f40d94ee66016fdd71 2026-04-07 13:56:20,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:56:20,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d269f40d94ee66016fdd71 HTTP/1.1" 200 None 2026-04-07 13:56:20,925 - lava_callback - DEBUG - Processing node 69d269f40d94ee66016fdd71: baseline-arm64-clabbe 2026-04-07 13:56:20,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d269f40d94ee66016fdd71 2026-04-07 13:56:20,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:56:20,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d269f40d94ee66016fdd71 HTTP/1.1" 200 None 2026-04-07 13:56:20,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:56:20,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:56:20,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:56:20,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d269f40d94ee66016fdd71 HTTP/1.1" 200 None 2026-04-07 13:56:20,993 - lava_callback - ERROR - Error processing callback for node 69d269f40d94ee66016fdd71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47806 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:57:20,919 - lava_callback - INFO - Received callback for node 69d26a3d0d94ee66016fdd8b INFO: 172.20.0.1:33576 - "POST /node/69d26a3d0d94ee66016fdd8b HTTP/1.0" 202 Accepted 2026-04-07 13:57:20,925 - lava_callback - INFO - Starting async job submit for node 69d26a3d0d94ee66016fdd8b 2026-04-07 13:57:20,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:57:20,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d26a3d0d94ee66016fdd8b HTTP/1.1" 200 None 2026-04-07 13:57:20,941 - lava_callback - DEBUG - Processing node 69d26a3d0d94ee66016fdd8b: baseline-arm64-clabbe 2026-04-07 13:57:20,941 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d26a3d0d94ee66016fdd8b 2026-04-07 13:57:20,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:57:20,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d26a3d0d94ee66016fdd8b HTTP/1.1" 200 None 2026-04-07 13:57:20,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:57:20,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:57:20,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:57:21,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d26a3d0d94ee66016fdd8b HTTP/1.1" 200 None 2026-04-07 13:57:21,006 - lava_callback - ERROR - Error processing callback for node 69d26a3d0d94ee66016fdd8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47922 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:47926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58442 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:58:40,961 - lava_callback - INFO - Received callback for node 69d26a800d94ee66016fddbe INFO: 172.20.0.1:52228 - "POST /node/69d26a800d94ee66016fddbe HTTP/1.0" 202 Accepted 2026-04-07 13:58:40,968 - lava_callback - INFO - Starting async job submit for node 69d26a800d94ee66016fddbe 2026-04-07 13:58:40,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:58:40,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d26a800d94ee66016fddbe HTTP/1.1" 200 None 2026-04-07 13:58:40,985 - lava_callback - DEBUG - Processing node 69d26a800d94ee66016fddbe: baseline-arm64-clabbe 2026-04-07 13:58:40,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d26a800d94ee66016fddbe 2026-04-07 13:58:40,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:58:41,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d26a800d94ee66016fddbe HTTP/1.1" 200 None 2026-04-07 13:58:41,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:58:41,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 13:58:41,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:58:41,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d26a800d94ee66016fddbe HTTP/1.1" 200 None 2026-04-07 13:58:41,057 - lava_callback - ERROR - Error processing callback for node 69d26a800d94ee66016fddbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60018 - "GET / HTTP/1.0" 200 OK 2026-04-07 13:59:41,026 - lava_callback - INFO - Received callback for node 69d26ac60d94ee66016fddfa INFO: 172.20.0.1:59310 - "POST /node/69d26ac60d94ee66016fddfa HTTP/1.0" 202 Accepted 2026-04-07 13:59:41,035 - lava_callback - INFO - Starting async job submit for node 69d26ac60d94ee66016fddfa 2026-04-07 13:59:41,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:59:41,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d26ac60d94ee66016fddfa HTTP/1.1" 200 None 2026-04-07 13:59:41,057 - lava_callback - DEBUG - Processing node 69d26ac60d94ee66016fddfa: baseline-arm64-clabbe 2026-04-07 13:59:41,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d26ac60d94ee66016fddfa 2026-04-07 13:59:41,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:59:41,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d26ac60d94ee66016fddfa HTTP/1.1" 200 None 2026-04-07 13:59:41,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:59:41,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 13:59:41,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 13:59:41,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d26ac60d94ee66016fddfa HTTP/1.1" 200 None 2026-04-07 13:59:41,119 - lava_callback - ERROR - Error processing callback for node 69d26ac60d94ee66016fddfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35228 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:39:32,501 - lava_callback - INFO - Received callback for node 69d274160d94ee66016fdec9 INFO: 172.20.0.1:41472 - "POST /node/69d274160d94ee66016fdec9 HTTP/1.0" 202 Accepted 2026-04-07 14:39:32,507 - lava_callback - INFO - Starting async job submit for node 69d274160d94ee66016fdec9 2026-04-07 14:39:32,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:39:32,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d274160d94ee66016fdec9 HTTP/1.1" 200 None 2026-04-07 14:39:32,523 - lava_callback - DEBUG - Processing node 69d274160d94ee66016fdec9: baseline-arm-baylibre 2026-04-07 14:39:32,523 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d274160d94ee66016fdec9 2026-04-07 14:39:32,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:39:32,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d274160d94ee66016fdec9 HTTP/1.1" 200 None 2026-04-07 14:39:32,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:39:32,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 14:39:32,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:39:32,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d274160d94ee66016fdec9 HTTP/1.1" 200 None 2026-04-07 14:39:32,592 - lava_callback - ERROR - Error processing callback for node 69d274160d94ee66016fdec9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43678 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:40:12,371 - lava_callback - INFO - Received callback for node 69d274390d94ee66016fdef2 INFO: 172.20.0.1:56136 - "POST /node/69d274390d94ee66016fdef2 HTTP/1.0" 202 Accepted 2026-04-07 14:40:12,377 - lava_callback - INFO - Starting async job submit for node 69d274390d94ee66016fdef2 2026-04-07 14:40:12,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:40:12,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d274390d94ee66016fdef2 HTTP/1.1" 200 None 2026-04-07 14:40:12,402 - lava_callback - DEBUG - Processing node 69d274390d94ee66016fdef2: baseline-arm-baylibre 2026-04-07 14:40:12,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d274390d94ee66016fdef2 2026-04-07 14:40:12,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:40:12,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d274390d94ee66016fdef2 HTTP/1.1" 200 None 2026-04-07 14:40:12,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:40:12,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 14:40:12,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:40:12,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d274390d94ee66016fdef2 HTTP/1.1" 200 None 2026-04-07 14:40:12,467 - lava_callback - ERROR - Error processing callback for node 69d274390d94ee66016fdef2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58786 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:40:32,429 - lava_callback - INFO - Received callback for node 69d274560d94ee66016fdf2e INFO: 172.20.0.1:42388 - "POST /node/69d274560d94ee66016fdf2e HTTP/1.0" 202 Accepted 2026-04-07 14:40:32,434 - lava_callback - INFO - Starting async job submit for node 69d274560d94ee66016fdf2e 2026-04-07 14:40:32,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:40:32,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d274560d94ee66016fdf2e HTTP/1.1" 200 None 2026-04-07 14:40:32,451 - lava_callback - DEBUG - Processing node 69d274560d94ee66016fdf2e: baseline-arm-baylibre 2026-04-07 14:40:32,451 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d274560d94ee66016fdf2e 2026-04-07 14:40:32,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:40:32,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d274560d94ee66016fdf2e HTTP/1.1" 200 None 2026-04-07 14:40:32,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:40:32,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 14:40:32,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:40:32,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d274560d94ee66016fdf2e HTTP/1.1" 200 None 2026-04-07 14:40:32,504 - lava_callback - ERROR - Error processing callback for node 69d274560d94ee66016fdf2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46238 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:42:52,592 - lava_callback - INFO - Received callback for node 69d274da0d94ee66016fdf8d INFO: 172.20.0.1:51462 - "POST /node/69d274da0d94ee66016fdf8d HTTP/1.0" 202 Accepted 2026-04-07 14:42:52,602 - lava_callback - INFO - Starting async job submit for node 69d274da0d94ee66016fdf8d 2026-04-07 14:42:52,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:42:52,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d274da0d94ee66016fdf8d HTTP/1.1" 200 None 2026-04-07 14:42:52,623 - lava_callback - DEBUG - Processing node 69d274da0d94ee66016fdf8d: baseline-arm-baylibre 2026-04-07 14:42:52,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d274da0d94ee66016fdf8d 2026-04-07 14:42:52,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:42:52,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d274da0d94ee66016fdf8d HTTP/1.1" 200 None 2026-04-07 14:42:52,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:42:52,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 14:42:52,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:42:52,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d274da0d94ee66016fdf8d HTTP/1.1" 200 None 2026-04-07 14:42:52,682 - lava_callback - ERROR - Error processing callback for node 69d274da0d94ee66016fdf8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33050 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:44:23,358 - lava_callback - INFO - Received callback for node 69d2753b0d94ee66016fdff1 INFO: 172.20.0.1:33058 - "POST /node/69d2753b0d94ee66016fdff1 HTTP/1.0" 202 Accepted 2026-04-07 14:44:23,364 - lava_callback - INFO - Starting async job submit for node 69d2753b0d94ee66016fdff1 2026-04-07 14:44:23,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:44:23,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2753b0d94ee66016fdff1 HTTP/1.1" 200 None 2026-04-07 14:44:23,381 - lava_callback - DEBUG - Processing node 69d2753b0d94ee66016fdff1: baseline-arm-clabbe 2026-04-07 14:44:23,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2753b0d94ee66016fdff1 2026-04-07 14:44:23,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:44:23,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2753b0d94ee66016fdff1 HTTP/1.1" 200 None 2026-04-07 14:44:23,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:44:23,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 14:44:23,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:44:23,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2753b0d94ee66016fdff1 HTTP/1.1" 200 None 2026-04-07 14:44:23,467 - lava_callback - ERROR - Error processing callback for node 69d2753b0d94ee66016fdff1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57216 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:45:03,054 - lava_callback - INFO - Received callback for node 69d2755e0d94ee66016fe021 INFO: 172.20.0.1:42378 - "POST /node/69d2755e0d94ee66016fe021 HTTP/1.0" 202 Accepted 2026-04-07 14:45:03,060 - lava_callback - INFO - Starting async job submit for node 69d2755e0d94ee66016fe021 2026-04-07 14:45:03,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:45:03,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2755e0d94ee66016fe021 HTTP/1.1" 200 None 2026-04-07 14:45:03,105 - lava_callback - DEBUG - Processing node 69d2755e0d94ee66016fe021: baseline-arm-clabbe 2026-04-07 14:45:03,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2755e0d94ee66016fe021 2026-04-07 14:45:03,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:45:03,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2755e0d94ee66016fe021 HTTP/1.1" 200 None 2026-04-07 14:45:03,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:45:03,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 14:45:03,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:45:03,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2755e0d94ee66016fe021 HTTP/1.1" 200 None 2026-04-07 14:45:03,157 - lava_callback - ERROR - Error processing callback for node 69d2755e0d94ee66016fe021: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39058 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:45:23,196 - lava_callback - INFO - Received callback for node 69d2757c0d94ee66016fe03c INFO: 172.20.0.1:39062 - "POST /node/69d2757c0d94ee66016fe03c HTTP/1.0" 202 Accepted 2026-04-07 14:45:23,202 - lava_callback - INFO - Starting async job submit for node 69d2757c0d94ee66016fe03c 2026-04-07 14:45:23,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:45:23,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2757c0d94ee66016fe03c HTTP/1.1" 200 None 2026-04-07 14:45:23,218 - lava_callback - DEBUG - Processing node 69d2757c0d94ee66016fe03c: baseline-arm-clabbe 2026-04-07 14:45:23,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2757c0d94ee66016fe03c 2026-04-07 14:45:23,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:45:23,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2757c0d94ee66016fe03c HTTP/1.1" 200 None 2026-04-07 14:45:23,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:45:23,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 14:45:23,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:45:23,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2757c0d94ee66016fe03c HTTP/1.1" 200 None 2026-04-07 14:45:23,279 - lava_callback - ERROR - Error processing callback for node 69d2757c0d94ee66016fe03c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37058 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:46:03,088 - lava_callback - INFO - Received callback for node 69d2759c0d94ee66016fe071 INFO: 172.20.0.1:39422 - "POST /node/69d2759c0d94ee66016fe071 HTTP/1.0" 202 Accepted 2026-04-07 14:46:03,094 - lava_callback - INFO - Starting async job submit for node 69d2759c0d94ee66016fe071 2026-04-07 14:46:03,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:46:03,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2759c0d94ee66016fe071 HTTP/1.1" 200 None 2026-04-07 14:46:03,116 - lava_callback - DEBUG - Processing node 69d2759c0d94ee66016fe071: baseline-arm-clabbe 2026-04-07 14:46:03,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2759c0d94ee66016fe071 2026-04-07 14:46:03,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:46:03,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2759c0d94ee66016fe071 HTTP/1.1" 200 None 2026-04-07 14:46:03,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:46:03,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 14:46:03,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:46:03,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2759c0d94ee66016fe071 HTTP/1.1" 200 None 2026-04-07 14:46:03,180 - lava_callback - ERROR - Error processing callback for node 69d2759c0d94ee66016fe071: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35858 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:46:23,160 - lava_callback - INFO - Received callback for node 69d275bc0d94ee66016fe0a6 INFO: 172.20.0.1:35870 - "POST /node/69d275bc0d94ee66016fe0a6 HTTP/1.0" 202 Accepted 2026-04-07 14:46:23,165 - lava_callback - INFO - Starting async job submit for node 69d275bc0d94ee66016fe0a6 2026-04-07 14:46:23,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:46:23,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d275bc0d94ee66016fe0a6 HTTP/1.1" 200 None 2026-04-07 14:46:23,182 - lava_callback - DEBUG - Processing node 69d275bc0d94ee66016fe0a6: baseline-arm-clabbe 2026-04-07 14:46:23,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d275bc0d94ee66016fe0a6 2026-04-07 14:46:23,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:46:23,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d275bc0d94ee66016fe0a6 HTTP/1.1" 200 None 2026-04-07 14:46:23,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:46:23,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 14:46:23,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:46:23,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d275bc0d94ee66016fe0a6 HTTP/1.1" 200 None 2026-04-07 14:46:23,237 - lava_callback - ERROR - Error processing callback for node 69d275bc0d94ee66016fe0a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44180 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:47:03,143 - lava_callback - INFO - Received callback for node 69d275e00d94ee66016fe0d6 INFO: 172.20.0.1:58060 - "POST /node/69d275e00d94ee66016fe0d6 HTTP/1.0" 202 Accepted 2026-04-07 14:47:03,152 - lava_callback - INFO - Starting async job submit for node 69d275e00d94ee66016fe0d6 2026-04-07 14:47:03,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:47:03,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d275e00d94ee66016fe0d6 HTTP/1.1" 200 None 2026-04-07 14:47:03,168 - lava_callback - DEBUG - Processing node 69d275e00d94ee66016fe0d6: baseline-arm-clabbe 2026-04-07 14:47:03,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d275e00d94ee66016fe0d6 2026-04-07 14:47:03,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:47:03,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d275e00d94ee66016fe0d6 HTTP/1.1" 200 None 2026-04-07 14:47:03,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:47:03,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 14:47:03,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:47:03,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d275e00d94ee66016fe0d6 HTTP/1.1" 200 None 2026-04-07 14:47:03,242 - lava_callback - ERROR - Error processing callback for node 69d275e00d94ee66016fe0d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41186 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:47:43,171 - lava_callback - INFO - Received callback for node 69d275fc0d94ee66016fe122 INFO: 172.20.0.1:60154 - "POST /node/69d275fc0d94ee66016fe122 HTTP/1.0" 202 Accepted 2026-04-07 14:47:43,176 - lava_callback - INFO - Starting async job submit for node 69d275fc0d94ee66016fe122 2026-04-07 14:47:43,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:47:43,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d275fc0d94ee66016fe122 HTTP/1.1" 200 None 2026-04-07 14:47:43,192 - lava_callback - DEBUG - Processing node 69d275fc0d94ee66016fe122: baseline-arm-clabbe 2026-04-07 14:47:43,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d275fc0d94ee66016fe122 2026-04-07 14:47:43,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:47:43,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d275fc0d94ee66016fe122 HTTP/1.1" 200 None 2026-04-07 14:47:43,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:47:43,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 14:47:43,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:47:43,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d275fc0d94ee66016fe122 HTTP/1.1" 200 None 2026-04-07 14:47:43,248 - lava_callback - ERROR - Error processing callback for node 69d275fc0d94ee66016fe122: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53988 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:48:03,166 - lava_callback - INFO - Received callback for node 69d2761f0d94ee66016fe13e INFO: 172.20.0.1:52266 - "POST /node/69d2761f0d94ee66016fe13e HTTP/1.0" 202 Accepted 2026-04-07 14:48:03,172 - lava_callback - INFO - Starting async job submit for node 69d2761f0d94ee66016fe13e 2026-04-07 14:48:03,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:48:03,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2761f0d94ee66016fe13e HTTP/1.1" 200 None 2026-04-07 14:48:03,192 - lava_callback - DEBUG - Processing node 69d2761f0d94ee66016fe13e: baseline-arm-clabbe 2026-04-07 14:48:03,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2761f0d94ee66016fe13e 2026-04-07 14:48:03,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:48:03,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2761f0d94ee66016fe13e HTTP/1.1" 200 None 2026-04-07 14:48:03,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:48:03,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 14:48:03,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:48:03,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2761f0d94ee66016fe13e HTTP/1.1" 200 None 2026-04-07 14:48:03,242 - lava_callback - ERROR - Error processing callback for node 69d2761f0d94ee66016fe13e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49064 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:48:43,236 - lava_callback - INFO - Received callback for node 69d2763e0d94ee66016fe178 INFO: 172.20.0.1:41288 - "POST /node/69d2763e0d94ee66016fe178 HTTP/1.0" 202 Accepted 2026-04-07 14:48:43,243 - lava_callback - INFO - Starting async job submit for node 69d2763e0d94ee66016fe178 2026-04-07 14:48:43,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:48:43,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2763e0d94ee66016fe178 HTTP/1.1" 200 None 2026-04-07 14:48:43,260 - lava_callback - DEBUG - Processing node 69d2763e0d94ee66016fe178: baseline-arm-clabbe 2026-04-07 14:48:43,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2763e0d94ee66016fe178 2026-04-07 14:48:43,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:48:43,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2763e0d94ee66016fe178 HTTP/1.1" 200 None 2026-04-07 14:48:43,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:48:43,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-07 14:48:43,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:48:43,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2763e0d94ee66016fe178 HTTP/1.1" 200 None 2026-04-07 14:48:43,334 - lava_callback - ERROR - Error processing callback for node 69d2763e0d94ee66016fe178: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56860 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:49:13,087 - lava_callback - INFO - Received callback for node 69d276580d94ee66016fe1b4 INFO: 172.20.0.1:43426 - "POST /node/69d276580d94ee66016fe1b4 HTTP/1.0" 202 Accepted 2026-04-07 14:49:13,093 - lava_callback - INFO - Starting async job submit for node 69d276580d94ee66016fe1b4 2026-04-07 14:49:13,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:49:13,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d276580d94ee66016fe1b4 HTTP/1.1" 200 None 2026-04-07 14:49:13,110 - lava_callback - DEBUG - Processing node 69d276580d94ee66016fe1b4: baseline-arm-baylibre 2026-04-07 14:49:13,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d276580d94ee66016fe1b4 2026-04-07 14:49:13,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:49:13,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d276580d94ee66016fe1b4 HTTP/1.1" 200 None 2026-04-07 14:49:13,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:49:13,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 14:49:13,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:49:13,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d276580d94ee66016fe1b4 HTTP/1.1" 200 None 2026-04-07 14:49:13,183 - lava_callback - ERROR - Error processing callback for node 69d276580d94ee66016fe1b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60142 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:49:32,874 - lava_callback - INFO - Received callback for node 69d276760d94ee66016fe1df INFO: 172.20.0.1:57890 - "POST /node/69d276760d94ee66016fe1df HTTP/1.0" 202 Accepted 2026-04-07 14:49:32,879 - lava_callback - INFO - Starting async job submit for node 69d276760d94ee66016fe1df 2026-04-07 14:49:32,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:49:32,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d276760d94ee66016fe1df HTTP/1.1" 200 None 2026-04-07 14:49:32,896 - lava_callback - DEBUG - Processing node 69d276760d94ee66016fe1df: baseline-arm-baylibre 2026-04-07 14:49:32,896 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d276760d94ee66016fe1df 2026-04-07 14:49:32,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:49:32,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d276760d94ee66016fe1df HTTP/1.1" 200 None 2026-04-07 14:49:32,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:49:32,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 14:49:32,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:49:32,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d276760d94ee66016fe1df HTTP/1.1" 200 None 2026-04-07 14:49:32,955 - lava_callback - ERROR - Error processing callback for node 69d276760d94ee66016fe1df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48432 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:50:12,902 - lava_callback - INFO - Received callback for node 69d276900d94ee66016fe214 INFO: 172.20.0.1:49910 - "POST /node/69d276900d94ee66016fe214 HTTP/1.0" 202 Accepted 2026-04-07 14:50:12,908 - lava_callback - INFO - Starting async job submit for node 69d276900d94ee66016fe214 2026-04-07 14:50:12,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:50:12,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d276900d94ee66016fe214 HTTP/1.1" 200 None 2026-04-07 14:50:12,933 - lava_callback - DEBUG - Processing node 69d276900d94ee66016fe214: baseline-arm-baylibre 2026-04-07 14:50:12,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d276900d94ee66016fe214 2026-04-07 14:50:12,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:50:12,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d276900d94ee66016fe214 HTTP/1.1" 200 None 2026-04-07 14:50:12,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:50:12,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 14:50:12,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:50:12,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d276900d94ee66016fe214 HTTP/1.1" 200 None 2026-04-07 14:50:12,985 - lava_callback - ERROR - Error processing callback for node 69d276900d94ee66016fe214: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55934 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:50:32,994 - lava_callback - INFO - Received callback for node 69d276b00d94ee66016fe242 INFO: 172.20.0.1:43896 - "POST /node/69d276b00d94ee66016fe242 HTTP/1.0" 202 Accepted 2026-04-07 14:50:33,003 - lava_callback - INFO - Starting async job submit for node 69d276b00d94ee66016fe242 2026-04-07 14:50:33,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:50:33,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d276b00d94ee66016fe242 HTTP/1.1" 200 None 2026-04-07 14:50:33,027 - lava_callback - DEBUG - Processing node 69d276b00d94ee66016fe242: baseline-arm-baylibre 2026-04-07 14:50:33,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d276b00d94ee66016fe242 2026-04-07 14:50:33,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:50:33,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d276b00d94ee66016fe242 HTTP/1.1" 200 None 2026-04-07 14:50:33,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:50:33,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 14:50:33,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:50:33,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d276b00d94ee66016fe242 HTTP/1.1" 200 None 2026-04-07 14:50:33,092 - lava_callback - ERROR - Error processing callback for node 69d276b00d94ee66016fe242: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43762 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:51:23,359 - lava_callback - INFO - Received callback for node 69d276d60d94ee66016fe25e INFO: 172.20.0.1:43766 - "POST /node/69d276d60d94ee66016fe25e HTTP/1.0" 202 Accepted 2026-04-07 14:51:23,368 - lava_callback - INFO - Starting async job submit for node 69d276d60d94ee66016fe25e 2026-04-07 14:51:23,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:51:23,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d276d60d94ee66016fe25e HTTP/1.1" 200 None 2026-04-07 14:51:23,385 - lava_callback - DEBUG - Processing node 69d276d60d94ee66016fe25e: baseline-arm-clabbe 2026-04-07 14:51:23,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d276d60d94ee66016fe25e 2026-04-07 14:51:23,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:51:23,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d276d60d94ee66016fe25e HTTP/1.1" 200 None 2026-04-07 14:51:23,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:51:23,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 14:51:23,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:51:23,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d276d60d94ee66016fe25e HTTP/1.1" 200 None 2026-04-07 14:51:23,460 - lava_callback - ERROR - Error processing callback for node 69d276d60d94ee66016fe25e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45326 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:51:43,371 - lava_callback - INFO - Received callback for node 69d276fa0d94ee66016fe26c INFO: 172.20.0.1:46616 - "POST /node/69d276fa0d94ee66016fe26c HTTP/1.0" 202 Accepted 2026-04-07 14:51:43,377 - lava_callback - INFO - Starting async job submit for node 69d276fa0d94ee66016fe26c 2026-04-07 14:51:43,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:51:43,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d276fa0d94ee66016fe26c HTTP/1.1" 200 None 2026-04-07 14:51:43,406 - lava_callback - DEBUG - Processing node 69d276fa0d94ee66016fe26c: baseline-arm-clabbe 2026-04-07 14:51:43,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d276fa0d94ee66016fe26c 2026-04-07 14:51:43,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:51:43,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d276fa0d94ee66016fe26c HTTP/1.1" 200 None 2026-04-07 14:51:43,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:51:43,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 14:51:43,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:51:43,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d276fa0d94ee66016fe26c HTTP/1.1" 200 None 2026-04-07 14:51:43,484 - lava_callback - ERROR - Error processing callback for node 69d276fa0d94ee66016fe26c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54690 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:52:23,479 - lava_callback - INFO - Received callback for node 69d277190d94ee66016fe289 INFO: 172.20.0.1:54692 - "POST /node/69d277190d94ee66016fe289 HTTP/1.0" 202 Accepted 2026-04-07 14:52:23,485 - lava_callback - INFO - Starting async job submit for node 69d277190d94ee66016fe289 2026-04-07 14:52:23,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:52:23,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d277190d94ee66016fe289 HTTP/1.1" 200 None 2026-04-07 14:52:23,501 - lava_callback - DEBUG - Processing node 69d277190d94ee66016fe289: baseline-arm-clabbe 2026-04-07 14:52:23,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d277190d94ee66016fe289 2026-04-07 14:52:23,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:52:23,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d277190d94ee66016fe289 HTTP/1.1" 200 None 2026-04-07 14:52:23,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:52:23,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 14:52:23,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:52:23,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d277190d94ee66016fe289 HTTP/1.1" 200 None 2026-04-07 14:52:23,561 - lava_callback - ERROR - Error processing callback for node 69d277190d94ee66016fe289: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39002 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:52:53,118 - lava_callback - INFO - Received callback for node 69d277380d94ee66016fe2ab INFO: 172.20.0.1:38470 - "POST /node/69d277380d94ee66016fe2ab HTTP/1.0" 202 Accepted 2026-04-07 14:52:53,124 - lava_callback - INFO - Starting async job submit for node 69d277380d94ee66016fe2ab 2026-04-07 14:52:53,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:52:53,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d277380d94ee66016fe2ab HTTP/1.1" 200 None 2026-04-07 14:52:53,140 - lava_callback - DEBUG - Processing node 69d277380d94ee66016fe2ab: baseline-arm-baylibre 2026-04-07 14:52:53,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d277380d94ee66016fe2ab 2026-04-07 14:52:53,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:52:53,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d277380d94ee66016fe2ab HTTP/1.1" 200 None 2026-04-07 14:52:53,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:52:53,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 14:52:53,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:52:53,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d277380d94ee66016fe2ab HTTP/1.1" 200 None 2026-04-07 14:52:53,200 - lava_callback - ERROR - Error processing callback for node 69d277380d94ee66016fe2ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39866 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:53:43,452 - lava_callback - INFO - Received callback for node 69d277620d94ee66016fe2c0 INFO: 172.20.0.1:36546 - "POST /node/69d277620d94ee66016fe2c0 HTTP/1.0" 202 Accepted 2026-04-07 14:53:43,457 - lava_callback - INFO - Starting async job submit for node 69d277620d94ee66016fe2c0 2026-04-07 14:53:43,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:53:43,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d277620d94ee66016fe2c0 HTTP/1.1" 200 None 2026-04-07 14:53:43,472 - lava_callback - DEBUG - Processing node 69d277620d94ee66016fe2c0: baseline-arm-clabbe 2026-04-07 14:53:43,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d277620d94ee66016fe2c0 2026-04-07 14:53:43,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:53:43,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d277620d94ee66016fe2c0 HTTP/1.1" 200 None 2026-04-07 14:53:43,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:53:43,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 14:53:43,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:53:43,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d277620d94ee66016fe2c0 HTTP/1.1" 200 None 2026-04-07 14:53:43,534 - lava_callback - ERROR - Error processing callback for node 69d277620d94ee66016fe2c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55618 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:54:03,441 - lava_callback - INFO - Received callback for node 69d277850d94ee66016fe2d3 INFO: 172.20.0.1:36946 - "POST /node/69d277850d94ee66016fe2d3 HTTP/1.0" 202 Accepted 2026-04-07 14:54:03,446 - lava_callback - INFO - Starting async job submit for node 69d277850d94ee66016fe2d3 2026-04-07 14:54:03,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:54:03,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d277850d94ee66016fe2d3 HTTP/1.1" 200 None 2026-04-07 14:54:03,468 - lava_callback - DEBUG - Processing node 69d277850d94ee66016fe2d3: baseline-arm-clabbe 2026-04-07 14:54:03,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d277850d94ee66016fe2d3 2026-04-07 14:54:03,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:54:03,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d277850d94ee66016fe2d3 HTTP/1.1" 200 None 2026-04-07 14:54:03,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:54:03,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 14:54:03,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:54:03,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d277850d94ee66016fe2d3 HTTP/1.1" 200 None 2026-04-07 14:54:03,519 - lava_callback - ERROR - Error processing callback for node 69d277850d94ee66016fe2d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47610 - "GET / HTTP/1.0" 200 OK 2026-04-07 14:54:43,560 - lava_callback - INFO - Received callback for node 69d277a90d94ee66016fe2e4 INFO: 172.20.0.1:44232 - "POST /node/69d277a90d94ee66016fe2e4 HTTP/1.0" 202 Accepted 2026-04-07 14:54:43,565 - lava_callback - INFO - Starting async job submit for node 69d277a90d94ee66016fe2e4 2026-04-07 14:54:43,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:54:43,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d277a90d94ee66016fe2e4 HTTP/1.1" 200 None 2026-04-07 14:54:43,587 - lava_callback - DEBUG - Processing node 69d277a90d94ee66016fe2e4: baseline-arm-clabbe 2026-04-07 14:54:43,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d277a90d94ee66016fe2e4 2026-04-07 14:54:43,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:54:43,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d277a90d94ee66016fe2e4 HTTP/1.1" 200 None 2026-04-07 14:54:43,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:54:43,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 14:54:43,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 14:54:43,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d277a90d94ee66016fe2e4 HTTP/1.1" 200 None 2026-04-07 14:54:43,654 - lava_callback - ERROR - Error processing callback for node 69d277a90d94ee66016fe2e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33726 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.20.0.1:33732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47666 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:00:03,873 - lava_callback - INFO - Received callback for node 69d278ee0d94ee66016fe362 INFO: 172.20.0.1:42032 - "POST /node/69d278ee0d94ee66016fe362 HTTP/1.0" 202 Accepted 2026-04-07 15:00:03,879 - lava_callback - INFO - Starting async job submit for node 69d278ee0d94ee66016fe362 2026-04-07 15:00:03,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:00:03,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d278ee0d94ee66016fe362 HTTP/1.1" 200 None 2026-04-07 15:00:03,895 - lava_callback - DEBUG - Processing node 69d278ee0d94ee66016fe362: baseline-arm-clabbe 2026-04-07 15:00:03,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d278ee0d94ee66016fe362 2026-04-07 15:00:03,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:00:03,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d278ee0d94ee66016fe362 HTTP/1.1" 200 None 2026-04-07 15:00:03,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:00:03,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:00:03,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:00:03,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d278ee0d94ee66016fe362 HTTP/1.1" 200 None 2026-04-07 15:00:03,951 - lava_callback - ERROR - Error processing callback for node 69d278ee0d94ee66016fe362: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50266 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:00:43,751 - lava_callback - INFO - Received callback for node 69d2790e0d94ee66016fe38f INFO: 172.20.0.1:55880 - "POST /node/69d2790e0d94ee66016fe38f HTTP/1.0" 202 Accepted 2026-04-07 15:00:43,756 - lava_callback - INFO - Starting async job submit for node 69d2790e0d94ee66016fe38f 2026-04-07 15:00:43,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:00:43,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2790e0d94ee66016fe38f HTTP/1.1" 200 None 2026-04-07 15:00:43,772 - lava_callback - DEBUG - Processing node 69d2790e0d94ee66016fe38f: baseline-arm-clabbe 2026-04-07 15:00:43,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2790e0d94ee66016fe38f 2026-04-07 15:00:43,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:00:43,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2790e0d94ee66016fe38f HTTP/1.1" 200 None 2026-04-07 15:00:43,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:00:43,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:00:43,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:00:43,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2790e0d94ee66016fe38f HTTP/1.1" 200 None 2026-04-07 15:00:43,833 - lava_callback - ERROR - Error processing callback for node 69d2790e0d94ee66016fe38f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57898 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:01:13,730 - lava_callback - INFO - Received callback for node 69d2792d0d94ee66016fe39c INFO: 172.20.0.1:36566 - "POST /node/69d2792d0d94ee66016fe39c HTTP/1.0" 202 Accepted 2026-04-07 15:01:13,736 - lava_callback - INFO - Starting async job submit for node 69d2792d0d94ee66016fe39c 2026-04-07 15:01:13,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:01:13,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2792d0d94ee66016fe39c HTTP/1.1" 200 None 2026-04-07 15:01:13,753 - lava_callback - DEBUG - Processing node 69d2792d0d94ee66016fe39c: baseline-arm-baylibre 2026-04-07 15:01:13,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2792d0d94ee66016fe39c 2026-04-07 15:01:13,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:01:13,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2792d0d94ee66016fe39c HTTP/1.1" 200 None 2026-04-07 15:01:13,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:01:13,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:01:13,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:01:13,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2792d0d94ee66016fe39c HTTP/1.1" 200 None 2026-04-07 15:01:13,804 - lava_callback - ERROR - Error processing callback for node 69d2792d0d94ee66016fe39c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59772 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:01:53,586 - lava_callback - INFO - Received callback for node 69d279590d94ee66016fe3b9 INFO: 172.20.0.1:56172 - "POST /node/69d279590d94ee66016fe3b9 HTTP/1.0" 202 Accepted 2026-04-07 15:01:53,592 - lava_callback - INFO - Starting async job submit for node 69d279590d94ee66016fe3b9 2026-04-07 15:01:53,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:01:53,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d279590d94ee66016fe3b9 HTTP/1.1" 200 None 2026-04-07 15:01:53,615 - lava_callback - DEBUG - Processing node 69d279590d94ee66016fe3b9: baseline-arm64-baylibre 2026-04-07 15:01:53,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d279590d94ee66016fe3b9 2026-04-07 15:01:53,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:01:53,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d279590d94ee66016fe3b9 HTTP/1.1" 200 None 2026-04-07 15:01:53,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:01:53,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:01:53,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:01:53,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d279590d94ee66016fe3b9 HTTP/1.1" 200 None 2026-04-07 15:01:53,690 - lava_callback - ERROR - Error processing callback for node 69d279590d94ee66016fe3b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53878 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:03:13,896 - lava_callback - INFO - Received callback for node 69d2799e0d94ee66016fe3f1 INFO: 172.20.0.1:35292 - "POST /node/69d2799e0d94ee66016fe3f1 HTTP/1.0" 202 Accepted 2026-04-07 15:03:13,902 - lava_callback - INFO - Starting async job submit for node 69d2799e0d94ee66016fe3f1 2026-04-07 15:03:13,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:03:13,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2799e0d94ee66016fe3f1 HTTP/1.1" 200 None 2026-04-07 15:03:13,920 - lava_callback - DEBUG - Processing node 69d2799e0d94ee66016fe3f1: baseline-arm64-baylibre 2026-04-07 15:03:13,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2799e0d94ee66016fe3f1 2026-04-07 15:03:13,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:03:13,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2799e0d94ee66016fe3f1 HTTP/1.1" 200 None 2026-04-07 15:03:13,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:03:13,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:03:13,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:03:14,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2799e0d94ee66016fe3f1 HTTP/1.1" 200 None 2026-04-07 15:03:14,008 - lava_callback - ERROR - Error processing callback for node 69d2799e0d94ee66016fe3f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37332 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:04:13,701 - lava_callback - INFO - Received callback for node 69d279e60d94ee66016fe40f INFO: 172.20.0.1:40522 - "POST /node/69d279e60d94ee66016fe40f HTTP/1.0" 202 Accepted 2026-04-07 15:04:13,706 - lava_callback - INFO - Starting async job submit for node 69d279e60d94ee66016fe40f 2026-04-07 15:04:13,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:04:13,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d279e60d94ee66016fe40f HTTP/1.1" 200 None 2026-04-07 15:04:13,722 - lava_callback - DEBUG - Processing node 69d279e60d94ee66016fe40f: baseline-arm64-baylibre 2026-04-07 15:04:13,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d279e60d94ee66016fe40f 2026-04-07 15:04:13,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:04:13,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d279e60d94ee66016fe40f HTTP/1.1" 200 None 2026-04-07 15:04:13,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:04:13,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:04:13,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:04:13,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d279e60d94ee66016fe40f HTTP/1.1" 200 None 2026-04-07 15:04:13,773 - lava_callback - ERROR - Error processing callback for node 69d279e60d94ee66016fe40f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35950 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:05:33,792 - lava_callback - INFO - Received callback for node 69d27a2d0d94ee66016fe43d INFO: 172.20.0.1:39740 - "POST /node/69d27a2d0d94ee66016fe43d HTTP/1.0" 202 Accepted 2026-04-07 15:05:33,797 - lava_callback - INFO - Starting async job submit for node 69d27a2d0d94ee66016fe43d 2026-04-07 15:05:33,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:05:33,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27a2d0d94ee66016fe43d HTTP/1.1" 200 None 2026-04-07 15:05:33,813 - lava_callback - DEBUG - Processing node 69d27a2d0d94ee66016fe43d: baseline-arm64-baylibre 2026-04-07 15:05:33,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27a2d0d94ee66016fe43d 2026-04-07 15:05:33,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:05:33,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27a2d0d94ee66016fe43d HTTP/1.1" 200 None 2026-04-07 15:05:33,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:05:33,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:05:33,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:05:33,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27a2d0d94ee66016fe43d HTTP/1.1" 200 None 2026-04-07 15:05:33,869 - lava_callback - ERROR - Error processing callback for node 69d27a2d0d94ee66016fe43d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39782 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:06:33,820 - lava_callback - INFO - Received callback for node 69d27a730d94ee66016fe471 INFO: 172.20.0.1:37084 - "POST /node/69d27a730d94ee66016fe471 HTTP/1.0" 202 Accepted 2026-04-07 15:06:33,826 - lava_callback - INFO - Starting async job submit for node 69d27a730d94ee66016fe471 2026-04-07 15:06:33,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:06:33,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27a730d94ee66016fe471 HTTP/1.1" 200 None 2026-04-07 15:06:33,854 - lava_callback - DEBUG - Processing node 69d27a730d94ee66016fe471: baseline-arm64-baylibre 2026-04-07 15:06:33,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27a730d94ee66016fe471 2026-04-07 15:06:33,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:06:33,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27a730d94ee66016fe471 HTTP/1.1" 200 None 2026-04-07 15:06:33,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:06:33,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:06:33,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:06:33,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27a730d94ee66016fe471 HTTP/1.1" 200 None 2026-04-07 15:06:33,914 - lava_callback - ERROR - Error processing callback for node 69d27a730d94ee66016fe471: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48994 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:07:53,974 - lava_callback - INFO - Received callback for node 69d27ab80d94ee66016fe4a7 INFO: 172.20.0.1:45902 - "POST /node/69d27ab80d94ee66016fe4a7 HTTP/1.0" 202 Accepted 2026-04-07 15:07:53,980 - lava_callback - INFO - Starting async job submit for node 69d27ab80d94ee66016fe4a7 2026-04-07 15:07:53,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:07:53,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27ab80d94ee66016fe4a7 HTTP/1.1" 200 None 2026-04-07 15:07:53,995 - lava_callback - DEBUG - Processing node 69d27ab80d94ee66016fe4a7: baseline-arm64-baylibre 2026-04-07 15:07:53,996 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27ab80d94ee66016fe4a7 2026-04-07 15:07:53,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:07:54,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27ab80d94ee66016fe4a7 HTTP/1.1" 200 None 2026-04-07 15:07:54,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:07:54,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:07:54,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:07:54,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27ab80d94ee66016fe4a7 HTTP/1.1" 200 None 2026-04-07 15:07:54,048 - lava_callback - ERROR - Error processing callback for node 69d27ab80d94ee66016fe4a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41760 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:08:44,217 - lava_callback - INFO - Received callback for node 69d27af10d94ee66016fe4ed INFO: 172.20.0.1:42414 - "POST /node/69d27af10d94ee66016fe4ed HTTP/1.0" 202 Accepted 2026-04-07 15:08:44,223 - lava_callback - INFO - Starting async job submit for node 69d27af10d94ee66016fe4ed 2026-04-07 15:08:44,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:08:44,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27af10d94ee66016fe4ed HTTP/1.1" 200 None 2026-04-07 15:08:44,239 - lava_callback - DEBUG - Processing node 69d27af10d94ee66016fe4ed: baseline-arm-clabbe 2026-04-07 15:08:44,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27af10d94ee66016fe4ed 2026-04-07 15:08:44,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:08:44,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27af10d94ee66016fe4ed HTTP/1.1" 200 None 2026-04-07 15:08:44,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:08:44,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:08:44,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:08:44,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27af10d94ee66016fe4ed HTTP/1.1" 200 None 2026-04-07 15:08:44,293 - lava_callback - ERROR - Error processing callback for node 69d27af10d94ee66016fe4ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54788 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:09:44,238 - lava_callback - INFO - Received callback for node 69d27b220d94ee66016fe500 INFO: 172.20.0.1:36388 - "POST /node/69d27b220d94ee66016fe500 HTTP/1.0" 202 Accepted 2026-04-07 15:09:44,247 - lava_callback - INFO - Starting async job submit for node 69d27b220d94ee66016fe500 2026-04-07 15:09:44,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:09:44,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27b220d94ee66016fe500 HTTP/1.1" 200 None 2026-04-07 15:09:44,268 - lava_callback - DEBUG - Processing node 69d27b220d94ee66016fe500: baseline-arm64-clabbe 2026-04-07 15:09:44,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27b220d94ee66016fe500 2026-04-07 15:09:44,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:09:44,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27b220d94ee66016fe500 HTTP/1.1" 200 None 2026-04-07 15:09:44,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:09:44,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:09:44,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:09:44,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27b220d94ee66016fe500 HTTP/1.1" 200 None 2026-04-07 15:09:44,374 - lava_callback - ERROR - Error processing callback for node 69d27b220d94ee66016fe500: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38736 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:10:44,261 - lava_callback - INFO - Received callback for node 69d27b6d0d94ee66016fe520 INFO: 172.20.0.1:56004 - "POST /node/69d27b6d0d94ee66016fe520 HTTP/1.0" 202 Accepted 2026-04-07 15:10:44,267 - lava_callback - INFO - Starting async job submit for node 69d27b6d0d94ee66016fe520 2026-04-07 15:10:44,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:10:44,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27b6d0d94ee66016fe520 HTTP/1.1" 200 None 2026-04-07 15:10:44,283 - lava_callback - DEBUG - Processing node 69d27b6d0d94ee66016fe520: baseline-arm64-clabbe 2026-04-07 15:10:44,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27b6d0d94ee66016fe520 2026-04-07 15:10:44,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:10:44,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27b6d0d94ee66016fe520 HTTP/1.1" 200 None 2026-04-07 15:10:44,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:10:44,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:10:44,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:10:44,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27b6d0d94ee66016fe520 HTTP/1.1" 200 None 2026-04-07 15:10:44,343 - lava_callback - ERROR - Error processing callback for node 69d27b6d0d94ee66016fe520: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35640 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:12:04,319 - lava_callback - INFO - Received callback for node 69d27bb00d94ee66016fe566 INFO: 172.20.0.1:37708 - "POST /node/69d27bb00d94ee66016fe566 HTTP/1.0" 202 Accepted 2026-04-07 15:12:04,325 - lava_callback - INFO - Starting async job submit for node 69d27bb00d94ee66016fe566 2026-04-07 15:12:04,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:12:04,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27bb00d94ee66016fe566 HTTP/1.1" 200 None 2026-04-07 15:12:04,344 - lava_callback - DEBUG - Processing node 69d27bb00d94ee66016fe566: baseline-arm64-clabbe 2026-04-07 15:12:04,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27bb00d94ee66016fe566 2026-04-07 15:12:04,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:12:04,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27bb00d94ee66016fe566 HTTP/1.1" 200 None 2026-04-07 15:12:04,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:12:04,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:12:04,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:12:04,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27bb00d94ee66016fe566 HTTP/1.1" 200 None 2026-04-07 15:12:04,411 - lava_callback - ERROR - Error processing callback for node 69d27bb00d94ee66016fe566: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50318 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:13:04,368 - lava_callback - INFO - Received callback for node 69d27bf80d94ee66016fe598 INFO: 172.20.0.1:39666 - "POST /node/69d27bf80d94ee66016fe598 HTTP/1.0" 202 Accepted 2026-04-07 15:13:04,374 - lava_callback - INFO - Starting async job submit for node 69d27bf80d94ee66016fe598 2026-04-07 15:13:04,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:13:04,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27bf80d94ee66016fe598 HTTP/1.1" 200 None 2026-04-07 15:13:04,391 - lava_callback - DEBUG - Processing node 69d27bf80d94ee66016fe598: baseline-arm64-clabbe 2026-04-07 15:13:04,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27bf80d94ee66016fe598 2026-04-07 15:13:04,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:13:04,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27bf80d94ee66016fe598 HTTP/1.1" 200 None 2026-04-07 15:13:04,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:13:04,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:13:04,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:13:04,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27bf80d94ee66016fe598 HTTP/1.1" 200 None 2026-04-07 15:13:04,446 - lava_callback - ERROR - Error processing callback for node 69d27bf80d94ee66016fe598: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43932 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:14:24,447 - lava_callback - INFO - Received callback for node 69d27c3d0d94ee66016fe5ce INFO: 172.20.0.1:43942 - "POST /node/69d27c3d0d94ee66016fe5ce HTTP/1.0" 202 Accepted 2026-04-07 15:14:24,453 - lava_callback - INFO - Starting async job submit for node 69d27c3d0d94ee66016fe5ce 2026-04-07 15:14:24,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:14:24,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27c3d0d94ee66016fe5ce HTTP/1.1" 200 None 2026-04-07 15:14:24,469 - lava_callback - DEBUG - Processing node 69d27c3d0d94ee66016fe5ce: baseline-arm64-clabbe 2026-04-07 15:14:24,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27c3d0d94ee66016fe5ce 2026-04-07 15:14:24,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:14:24,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27c3d0d94ee66016fe5ce HTTP/1.1" 200 None 2026-04-07 15:14:24,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:14:24,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:14:24,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:14:24,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27c3d0d94ee66016fe5ce HTTP/1.1" 200 None 2026-04-07 15:14:24,541 - lava_callback - ERROR - Error processing callback for node 69d27c3d0d94ee66016fe5ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34424 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:15:24,483 - lava_callback - INFO - Received callback for node 69d27c810d94ee66016fe60c INFO: 172.20.0.1:34426 - "POST /node/69d27c810d94ee66016fe60c HTTP/1.0" 202 Accepted 2026-04-07 15:15:24,488 - lava_callback - INFO - Starting async job submit for node 69d27c810d94ee66016fe60c 2026-04-07 15:15:24,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:15:24,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27c810d94ee66016fe60c HTTP/1.1" 200 None 2026-04-07 15:15:24,505 - lava_callback - DEBUG - Processing node 69d27c810d94ee66016fe60c: baseline-arm64-clabbe 2026-04-07 15:15:24,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27c810d94ee66016fe60c 2026-04-07 15:15:24,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:15:24,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27c810d94ee66016fe60c HTTP/1.1" 200 None 2026-04-07 15:15:24,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:15:24,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:15:24,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:15:24,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27c810d94ee66016fe60c HTTP/1.1" 200 None 2026-04-07 15:15:24,561 - lava_callback - ERROR - Error processing callback for node 69d27c810d94ee66016fe60c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54902 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:16:44,547 - lava_callback - INFO - Received callback for node 69d27cc60d94ee66016fe642 INFO: 172.20.0.1:34412 - "POST /node/69d27cc60d94ee66016fe642 HTTP/1.0" 202 Accepted 2026-04-07 15:16:44,553 - lava_callback - INFO - Starting async job submit for node 69d27cc60d94ee66016fe642 2026-04-07 15:16:44,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:16:44,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27cc60d94ee66016fe642 HTTP/1.1" 200 None 2026-04-07 15:16:44,570 - lava_callback - DEBUG - Processing node 69d27cc60d94ee66016fe642: baseline-arm64-clabbe 2026-04-07 15:16:44,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27cc60d94ee66016fe642 2026-04-07 15:16:44,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:16:44,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27cc60d94ee66016fe642 HTTP/1.1" 200 None 2026-04-07 15:16:44,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:16:44,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-07 15:16:44,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:16:44,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27cc60d94ee66016fe642 HTTP/1.1" 200 None 2026-04-07 15:16:44,632 - lava_callback - ERROR - Error processing callback for node 69d27cc60d94ee66016fe642: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53220 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:17:24,549 - lava_callback - INFO - Received callback for node 69d27d000d94ee66016fe65f INFO: 172.20.0.1:53224 - "POST /node/69d27d000d94ee66016fe65f HTTP/1.0" 202 Accepted 2026-04-07 15:17:24,554 - lava_callback - INFO - Starting async job submit for node 69d27d000d94ee66016fe65f 2026-04-07 15:17:24,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:17:24,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27d000d94ee66016fe65f HTTP/1.1" 200 None 2026-04-07 15:17:24,571 - lava_callback - DEBUG - Processing node 69d27d000d94ee66016fe65f: baseline-arm-clabbe 2026-04-07 15:17:24,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27d000d94ee66016fe65f 2026-04-07 15:17:24,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:17:24,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27d000d94ee66016fe65f HTTP/1.1" 200 None 2026-04-07 15:17:24,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:17:24,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:17:24,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:17:24,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27d000d94ee66016fe65f HTTP/1.1" 200 None 2026-04-07 15:17:24,627 - lava_callback - ERROR - Error processing callback for node 69d27d000d94ee66016fe65f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60956 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:18:04,615 - lava_callback - INFO - Received callback for node 69d27d230d94ee66016fe68c INFO: 172.20.0.1:59682 - "POST /node/69d27d230d94ee66016fe68c HTTP/1.0" 202 Accepted 2026-04-07 15:18:04,620 - lava_callback - INFO - Starting async job submit for node 69d27d230d94ee66016fe68c 2026-04-07 15:18:04,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:18:04,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27d230d94ee66016fe68c HTTP/1.1" 200 None 2026-04-07 15:18:04,636 - lava_callback - DEBUG - Processing node 69d27d230d94ee66016fe68c: baseline-arm-clabbe 2026-04-07 15:18:04,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27d230d94ee66016fe68c 2026-04-07 15:18:04,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:18:04,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27d230d94ee66016fe68c HTTP/1.1" 200 None 2026-04-07 15:18:04,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:18:04,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:18:04,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:18:04,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27d230d94ee66016fe68c HTTP/1.1" 200 None 2026-04-07 15:18:04,696 - lava_callback - ERROR - Error processing callback for node 69d27d230d94ee66016fe68c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35868 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:18:44,609 - lava_callback - INFO - Received callback for node 69d27d470d94ee66016fe6a4 INFO: 172.20.0.1:46990 - "POST /node/69d27d470d94ee66016fe6a4 HTTP/1.0" 202 Accepted 2026-04-07 15:18:44,620 - lava_callback - INFO - Starting async job submit for node 69d27d470d94ee66016fe6a4 2026-04-07 15:18:44,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:18:44,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27d470d94ee66016fe6a4 HTTP/1.1" 200 None 2026-04-07 15:18:44,662 - lava_callback - DEBUG - Processing node 69d27d470d94ee66016fe6a4: baseline-arm-clabbe 2026-04-07 15:18:44,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27d470d94ee66016fe6a4 2026-04-07 15:18:44,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:18:44,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27d470d94ee66016fe6a4 HTTP/1.1" 200 None 2026-04-07 15:18:44,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:18:44,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:18:44,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:18:44,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27d470d94ee66016fe6a4 HTTP/1.1" 200 None 2026-04-07 15:18:44,731 - lava_callback - ERROR - Error processing callback for node 69d27d470d94ee66016fe6a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51784 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:19:14,714 - lava_callback - INFO - Received callback for node 69d27d640d94ee66016fe6c1 INFO: 172.20.0.1:57974 - "POST /node/69d27d640d94ee66016fe6c1 HTTP/1.0" 202 Accepted 2026-04-07 15:19:14,720 - lava_callback - INFO - Starting async job submit for node 69d27d640d94ee66016fe6c1 2026-04-07 15:19:14,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:19:14,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27d640d94ee66016fe6c1 HTTP/1.1" 200 None 2026-04-07 15:19:14,736 - lava_callback - DEBUG - Processing node 69d27d640d94ee66016fe6c1: baseline-arm-baylibre 2026-04-07 15:19:14,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27d640d94ee66016fe6c1 2026-04-07 15:19:14,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:19:14,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27d640d94ee66016fe6c1 HTTP/1.1" 200 None 2026-04-07 15:19:14,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:19:14,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:19:14,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:19:14,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27d640d94ee66016fe6c1 HTTP/1.1" 200 None 2026-04-07 15:19:14,796 - lava_callback - ERROR - Error processing callback for node 69d27d640d94ee66016fe6c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38854 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:19:44,726 - lava_callback - INFO - Received callback for node 69d27d890d94ee66016fe6d5 INFO: 172.20.0.1:36620 - "POST /node/69d27d890d94ee66016fe6d5 HTTP/1.0" 202 Accepted 2026-04-07 15:19:44,736 - lava_callback - INFO - Starting async job submit for node 69d27d890d94ee66016fe6d5 2026-04-07 15:19:44,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:19:44,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27d890d94ee66016fe6d5 HTTP/1.1" 200 None 2026-04-07 15:19:44,784 - lava_callback - DEBUG - Processing node 69d27d890d94ee66016fe6d5: baseline-arm-clabbe 2026-04-07 15:19:44,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27d890d94ee66016fe6d5 2026-04-07 15:19:44,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:19:44,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27d890d94ee66016fe6d5 HTTP/1.1" 200 None 2026-04-07 15:19:44,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:19:44,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:19:44,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:19:44,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27d890d94ee66016fe6d5 HTTP/1.1" 200 None 2026-04-07 15:19:44,887 - lava_callback - ERROR - Error processing callback for node 69d27d890d94ee66016fe6d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45624 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:20:24,682 - lava_callback - INFO - Received callback for node 69d27daa0d94ee66016fe6fb INFO: 172.20.0.1:45626 - "POST /node/69d27daa0d94ee66016fe6fb HTTP/1.0" 202 Accepted 2026-04-07 15:20:24,687 - lava_callback - INFO - Starting async job submit for node 69d27daa0d94ee66016fe6fb 2026-04-07 15:20:24,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:20:24,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27daa0d94ee66016fe6fb HTTP/1.1" 200 None 2026-04-07 15:20:24,708 - lava_callback - DEBUG - Processing node 69d27daa0d94ee66016fe6fb: baseline-arm-clabbe 2026-04-07 15:20:24,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27daa0d94ee66016fe6fb 2026-04-07 15:20:24,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:20:24,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27daa0d94ee66016fe6fb HTTP/1.1" 200 None 2026-04-07 15:20:24,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:20:24,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:20:24,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:20:24,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27daa0d94ee66016fe6fb HTTP/1.1" 200 None 2026-04-07 15:20:24,764 - lava_callback - ERROR - Error processing callback for node 69d27daa0d94ee66016fe6fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42456 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:21:04,731 - lava_callback - INFO - Received callback for node 69d27dce0d94ee66016fe70f INFO: 172.20.0.1:49526 - "POST /node/69d27dce0d94ee66016fe70f HTTP/1.0" 202 Accepted 2026-04-07 15:21:04,736 - lava_callback - INFO - Starting async job submit for node 69d27dce0d94ee66016fe70f 2026-04-07 15:21:04,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:21:04,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27dce0d94ee66016fe70f HTTP/1.1" 200 None 2026-04-07 15:21:04,755 - lava_callback - DEBUG - Processing node 69d27dce0d94ee66016fe70f: baseline-arm-clabbe 2026-04-07 15:21:04,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27dce0d94ee66016fe70f 2026-04-07 15:21:04,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:21:04,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27dce0d94ee66016fe70f HTTP/1.1" 200 None 2026-04-07 15:21:04,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:21:04,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:21:04,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:21:04,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27dce0d94ee66016fe70f HTTP/1.1" 200 None 2026-04-07 15:21:04,817 - lava_callback - ERROR - Error processing callback for node 69d27dce0d94ee66016fe70f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56416 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:21:24,769 - lava_callback - INFO - Received callback for node 69d27dec0d94ee66016fe724 INFO: 172.20.0.1:56422 - "POST /node/69d27dec0d94ee66016fe724 HTTP/1.0" 202 Accepted 2026-04-07 15:21:24,775 - lava_callback - INFO - Starting async job submit for node 69d27dec0d94ee66016fe724 2026-04-07 15:21:24,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:21:24,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27dec0d94ee66016fe724 HTTP/1.1" 200 None 2026-04-07 15:21:24,791 - lava_callback - DEBUG - Processing node 69d27dec0d94ee66016fe724: baseline-arm-clabbe 2026-04-07 15:21:24,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27dec0d94ee66016fe724 2026-04-07 15:21:24,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:21:24,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27dec0d94ee66016fe724 HTTP/1.1" 200 None 2026-04-07 15:21:24,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:21:24,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:21:24,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:21:24,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27dec0d94ee66016fe724 HTTP/1.1" 200 None 2026-04-07 15:21:24,853 - lava_callback - ERROR - Error processing callback for node 69d27dec0d94ee66016fe724: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60182 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:22:04,807 - lava_callback - INFO - Received callback for node 69d27e0b0d94ee66016fe753 INFO: 172.20.0.1:48874 - "POST /node/69d27e0b0d94ee66016fe753 HTTP/1.0" 202 Accepted 2026-04-07 15:22:04,816 - lava_callback - INFO - Starting async job submit for node 69d27e0b0d94ee66016fe753 2026-04-07 15:22:04,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:22:04,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27e0b0d94ee66016fe753 HTTP/1.1" 200 None 2026-04-07 15:22:04,838 - lava_callback - DEBUG - Processing node 69d27e0b0d94ee66016fe753: baseline-arm-clabbe 2026-04-07 15:22:04,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27e0b0d94ee66016fe753 2026-04-07 15:22:04,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:22:04,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27e0b0d94ee66016fe753 HTTP/1.1" 200 None 2026-04-07 15:22:04,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:22:04,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:22:04,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:22:04,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27e0b0d94ee66016fe753 HTTP/1.1" 200 None 2026-04-07 15:22:04,905 - lava_callback - ERROR - Error processing callback for node 69d27e0b0d94ee66016fe753: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53174 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:22:24,770 - lava_callback - INFO - Received callback for node 69d27e2d0d94ee66016fe77b INFO: 172.20.0.1:53184 - "POST /node/69d27e2d0d94ee66016fe77b HTTP/1.0" 202 Accepted 2026-04-07 15:22:24,777 - lava_callback - INFO - Starting async job submit for node 69d27e2d0d94ee66016fe77b 2026-04-07 15:22:24,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:22:24,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27e2d0d94ee66016fe77b HTTP/1.1" 200 None 2026-04-07 15:22:24,803 - lava_callback - DEBUG - Processing node 69d27e2d0d94ee66016fe77b: baseline-arm-clabbe 2026-04-07 15:22:24,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27e2d0d94ee66016fe77b 2026-04-07 15:22:24,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:22:24,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27e2d0d94ee66016fe77b HTTP/1.1" 200 None 2026-04-07 15:22:24,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:22:24,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-07 15:22:24,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:22:24,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27e2d0d94ee66016fe77b HTTP/1.1" 200 None 2026-04-07 15:22:24,867 - lava_callback - ERROR - Error processing callback for node 69d27e2d0d94ee66016fe77b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32890 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:23:14,764 - lava_callback - INFO - Received callback for node 69d27e540d94ee66016fe7aa INFO: 172.20.0.1:53414 - "POST /node/69d27e540d94ee66016fe7aa HTTP/1.0" 202 Accepted 2026-04-07 15:23:14,773 - lava_callback - INFO - Starting async job submit for node 69d27e540d94ee66016fe7aa 2026-04-07 15:23:14,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:23:14,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27e540d94ee66016fe7aa HTTP/1.1" 200 None 2026-04-07 15:23:14,795 - lava_callback - DEBUG - Processing node 69d27e540d94ee66016fe7aa: baseline-arm64-baylibre 2026-04-07 15:23:14,795 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27e540d94ee66016fe7aa 2026-04-07 15:23:14,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:23:14,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27e540d94ee66016fe7aa HTTP/1.1" 200 None 2026-04-07 15:23:14,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:23:14,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:23:14,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:23:14,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27e540d94ee66016fe7aa HTTP/1.1" 200 None 2026-04-07 15:23:14,872 - lava_callback - ERROR - Error processing callback for node 69d27e540d94ee66016fe7aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40652 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:24:14,793 - lava_callback - INFO - Received callback for node 69d27e980d94ee66016fe7e9 INFO: 172.20.0.1:34440 - "POST /node/69d27e980d94ee66016fe7e9 HTTP/1.0" 202 Accepted 2026-04-07 15:24:14,802 - lava_callback - INFO - Starting async job submit for node 69d27e980d94ee66016fe7e9 2026-04-07 15:24:14,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:24:14,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27e980d94ee66016fe7e9 HTTP/1.1" 200 None 2026-04-07 15:24:14,819 - lava_callback - DEBUG - Processing node 69d27e980d94ee66016fe7e9: baseline-arm64-baylibre 2026-04-07 15:24:14,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27e980d94ee66016fe7e9 2026-04-07 15:24:14,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:24:14,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27e980d94ee66016fe7e9 HTTP/1.1" 200 None 2026-04-07 15:24:14,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:24:14,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:24:14,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:24:14,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27e980d94ee66016fe7e9 HTTP/1.1" 200 None 2026-04-07 15:24:14,892 - lava_callback - ERROR - Error processing callback for node 69d27e980d94ee66016fe7e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55628 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:25:34,874 - lava_callback - INFO - Received callback for node 69d27edf0d94ee66016fe828 INFO: 172.20.0.1:34500 - "POST /node/69d27edf0d94ee66016fe828 HTTP/1.0" 202 Accepted 2026-04-07 15:25:34,879 - lava_callback - INFO - Starting async job submit for node 69d27edf0d94ee66016fe828 2026-04-07 15:25:34,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:25:34,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27edf0d94ee66016fe828 HTTP/1.1" 200 None 2026-04-07 15:25:34,898 - lava_callback - DEBUG - Processing node 69d27edf0d94ee66016fe828: baseline-arm64-baylibre 2026-04-07 15:25:34,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27edf0d94ee66016fe828 2026-04-07 15:25:34,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:25:34,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27edf0d94ee66016fe828 HTTP/1.1" 200 None 2026-04-07 15:25:34,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:25:34,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:25:34,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:25:34,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27edf0d94ee66016fe828 HTTP/1.1" 200 None 2026-04-07 15:25:34,951 - lava_callback - ERROR - Error processing callback for node 69d27edf0d94ee66016fe828: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35574 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:26:45,064 - lava_callback - INFO - Received callback for node 69d27f2e0d94ee66016fe842 INFO: 172.20.0.1:39148 - "POST /node/69d27f2e0d94ee66016fe842 HTTP/1.0" 202 Accepted 2026-04-07 15:26:45,070 - lava_callback - INFO - Starting async job submit for node 69d27f2e0d94ee66016fe842 2026-04-07 15:26:45,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:26:45,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27f2e0d94ee66016fe842 HTTP/1.1" 200 None 2026-04-07 15:26:45,086 - lava_callback - DEBUG - Processing node 69d27f2e0d94ee66016fe842: baseline-arm64-clabbe 2026-04-07 15:26:45,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27f2e0d94ee66016fe842 2026-04-07 15:26:45,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:26:45,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27f2e0d94ee66016fe842 HTTP/1.1" 200 None 2026-04-07 15:26:45,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:26:45,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:26:45,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:26:45,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27f2e0d94ee66016fe842 HTTP/1.1" 200 None 2026-04-07 15:26:45,151 - lava_callback - ERROR - Error processing callback for node 69d27f2e0d94ee66016fe842: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34168 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:28:05,106 - lava_callback - INFO - Received callback for node 69d27f780d94ee66016fe862 INFO: 172.20.0.1:58790 - "POST /node/69d27f780d94ee66016fe862 HTTP/1.0" 202 Accepted 2026-04-07 15:28:05,116 - lava_callback - INFO - Starting async job submit for node 69d27f780d94ee66016fe862 2026-04-07 15:28:05,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:28:05,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27f780d94ee66016fe862 HTTP/1.1" 200 None 2026-04-07 15:28:05,136 - lava_callback - DEBUG - Processing node 69d27f780d94ee66016fe862: baseline-arm64-clabbe 2026-04-07 15:28:05,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27f780d94ee66016fe862 2026-04-07 15:28:05,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:28:05,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27f780d94ee66016fe862 HTTP/1.1" 200 None 2026-04-07 15:28:05,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:28:05,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:28:05,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:28:05,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27f780d94ee66016fe862 HTTP/1.1" 200 None 2026-04-07 15:28:05,205 - lava_callback - ERROR - Error processing callback for node 69d27f780d94ee66016fe862: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57236 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:28:36,587 - lava_callback - INFO - Received callback for node 69d4c470932ecfe2320a1587 INFO: 172.20.0.1:57250 - "POST /node/69d4c470932ecfe2320a1587 HTTP/1.0" 202 Accepted 2026-04-07 15:28:36,592 - lava_callback - INFO - Starting async job submit for node 69d4c470932ecfe2320a1587 2026-04-07 15:28:36,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:28:36,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c470932ecfe2320a1587 HTTP/1.1" 200 None 2026-04-07 15:28:36,625 - lava_callback - DEBUG - Processing node 69d4c470932ecfe2320a1587: baseline-x86 2026-04-07 15:28:36,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 15:28:37,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 15:28:37,101 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c470932ecfe2320a1587/log.txt.gz 2026-04-07 15:28:37,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 15:28:37,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 15:28:37,476 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c470932ecfe2320a1587/lava-logs.yaml 2026-04-07 15:28:37,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 15:28:37,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 15:28:37,615 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d4c470932ecfe2320a1587/lava_callback.json.gz 2026-04-07 15:28:37,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:28:37,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c470932ecfe2320a1587 HTTP/1.1" 200 None 2026-04-07 15:28:37,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:28:37,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd8d932ecfe2320a1035 HTTP/1.1" 200 None 2026-04-07 15:28:37,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:28:37,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c470932ecfe2320a1587 HTTP/1.1" 200 None 2026-04-07 15:28:37,697 - lava_callback - INFO - Completed processing callback for node 69d4c470932ecfe2320a1587 INFO: 172.20.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55840 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:28:57,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:28:57,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35394 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:29:25,116 - lava_callback - INFO - Received callback for node 69d27fc20d94ee66016fe887 INFO: 172.20.0.1:35408 - "POST /node/69d27fc20d94ee66016fe887 HTTP/1.0" 202 Accepted 2026-04-07 15:29:25,122 - lava_callback - INFO - Starting async job submit for node 69d27fc20d94ee66016fe887 2026-04-07 15:29:25,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:29:25,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27fc20d94ee66016fe887 HTTP/1.1" 200 None 2026-04-07 15:29:25,138 - lava_callback - DEBUG - Processing node 69d27fc20d94ee66016fe887: baseline-arm64-clabbe 2026-04-07 15:29:25,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d27fc20d94ee66016fe887 2026-04-07 15:29:25,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:29:25,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d27fc20d94ee66016fe887 HTTP/1.1" 200 None 2026-04-07 15:29:25,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:29:25,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:29:25,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:29:25,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d27fc20d94ee66016fe887 HTTP/1.1" 200 None 2026-04-07 15:29:25,210 - lava_callback - ERROR - Error processing callback for node 69d27fc20d94ee66016fe887: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54444 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:30:25,396 - lava_callback - INFO - Received callback for node 69d280070d94ee66016fe8bf INFO: 172.20.0.1:54452 - "POST /node/69d280070d94ee66016fe8bf HTTP/1.0" 202 Accepted 2026-04-07 15:30:25,402 - lava_callback - INFO - Starting async job submit for node 69d280070d94ee66016fe8bf 2026-04-07 15:30:25,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:30:25,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d280070d94ee66016fe8bf HTTP/1.1" 200 None 2026-04-07 15:30:25,419 - lava_callback - DEBUG - Processing node 69d280070d94ee66016fe8bf: baseline-arm64-clabbe 2026-04-07 15:30:25,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d280070d94ee66016fe8bf 2026-04-07 15:30:25,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:30:25,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d280070d94ee66016fe8bf HTTP/1.1" 200 None 2026-04-07 15:30:25,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:30:25,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:30:25,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:30:25,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d280070d94ee66016fe8bf HTTP/1.1" 200 None 2026-04-07 15:30:25,510 - lava_callback - ERROR - Error processing callback for node 69d280070d94ee66016fe8bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53734 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:31:45,262 - lava_callback - INFO - Received callback for node 69d2804b0d94ee66016fe8e8 INFO: 172.20.0.1:48134 - "POST /node/69d2804b0d94ee66016fe8e8 HTTP/1.0" 202 Accepted 2026-04-07 15:31:45,271 - lava_callback - INFO - Starting async job submit for node 69d2804b0d94ee66016fe8e8 2026-04-07 15:31:45,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:31:45,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2804b0d94ee66016fe8e8 HTTP/1.1" 200 None 2026-04-07 15:31:45,294 - lava_callback - DEBUG - Processing node 69d2804b0d94ee66016fe8e8: baseline-arm64-clabbe 2026-04-07 15:31:45,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2804b0d94ee66016fe8e8 2026-04-07 15:31:45,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:31:45,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2804b0d94ee66016fe8e8 HTTP/1.1" 200 None 2026-04-07 15:31:45,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:31:45,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:31:45,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:31:45,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2804b0d94ee66016fe8e8 HTTP/1.1" 200 None 2026-04-07 15:31:45,359 - lava_callback - ERROR - Error processing callback for node 69d2804b0d94ee66016fe8e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38880 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:32:45,279 - lava_callback - INFO - Received callback for node 69d280930d94ee66016fe91f INFO: 172.20.0.1:49230 - "POST /node/69d280930d94ee66016fe91f HTTP/1.0" 202 Accepted 2026-04-07 15:32:45,285 - lava_callback - INFO - Starting async job submit for node 69d280930d94ee66016fe91f 2026-04-07 15:32:45,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:32:45,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d280930d94ee66016fe91f HTTP/1.1" 200 None 2026-04-07 15:32:45,300 - lava_callback - DEBUG - Processing node 69d280930d94ee66016fe91f: baseline-arm64-clabbe 2026-04-07 15:32:45,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d280930d94ee66016fe91f 2026-04-07 15:32:45,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:32:45,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d280930d94ee66016fe91f HTTP/1.1" 200 None 2026-04-07 15:32:45,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:32:45,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:32:45,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:32:45,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d280930d94ee66016fe91f HTTP/1.1" 200 None 2026-04-07 15:32:45,351 - lava_callback - ERROR - Error processing callback for node 69d280930d94ee66016fe91f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44676 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:33:35,423 - lava_callback - INFO - Received callback for node 69d280c90d94ee66016fe934 INFO: 172.20.0.1:58862 - "POST /node/69d280c90d94ee66016fe934 HTTP/1.0" 202 Accepted 2026-04-07 15:33:35,428 - lava_callback - INFO - Starting async job submit for node 69d280c90d94ee66016fe934 2026-04-07 15:33:35,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:33:35,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d280c90d94ee66016fe934 HTTP/1.1" 200 None 2026-04-07 15:33:35,455 - lava_callback - DEBUG - Processing node 69d280c90d94ee66016fe934: baseline-arm-baylibre 2026-04-07 15:33:35,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d280c90d94ee66016fe934 2026-04-07 15:33:35,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:33:35,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d280c90d94ee66016fe934 HTTP/1.1" 200 None 2026-04-07 15:33:35,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:33:35,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:33:35,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:33:35,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d280c90d94ee66016fe934 HTTP/1.1" 200 None 2026-04-07 15:33:35,506 - lava_callback - ERROR - Error processing callback for node 69d280c90d94ee66016fe934: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39856 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 15:34:15,306 - lava_callback - INFO - Received callback for node 69d280ed0d94ee66016fe93e INFO: 172.20.0.1:39872 - "POST /node/69d280ed0d94ee66016fe93e HTTP/1.0" 202 Accepted 2026-04-07 15:34:15,312 - lava_callback - INFO - Starting async job submit for node 69d280ed0d94ee66016fe93e 2026-04-07 15:34:15,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:34:15,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d280ed0d94ee66016fe93e HTTP/1.1" 200 None 2026-04-07 15:34:15,328 - lava_callback - DEBUG - Processing node 69d280ed0d94ee66016fe93e: baseline-arm-baylibre 2026-04-07 15:34:15,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d280ed0d94ee66016fe93e 2026-04-07 15:34:15,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:34:15,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d280ed0d94ee66016fe93e HTTP/1.1" 200 None 2026-04-07 15:34:15,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:34:15,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:34:15,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:34:15,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d280ed0d94ee66016fe93e HTTP/1.1" 200 None 2026-04-07 15:34:15,404 - lava_callback - ERROR - Error processing callback for node 69d280ed0d94ee66016fe93e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44544 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:34:55,502 - lava_callback - INFO - Received callback for node 69d281180d94ee66016fe958 INFO: 172.20.0.1:40490 - "POST /node/69d281180d94ee66016fe958 HTTP/1.0" 202 Accepted 2026-04-07 15:34:55,508 - lava_callback - INFO - Starting async job submit for node 69d281180d94ee66016fe958 2026-04-07 15:34:55,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:34:55,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d281180d94ee66016fe958 HTTP/1.1" 200 None 2026-04-07 15:34:55,530 - lava_callback - DEBUG - Processing node 69d281180d94ee66016fe958: baseline-arm64-baylibre 2026-04-07 15:34:55,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d281180d94ee66016fe958 2026-04-07 15:34:55,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:34:55,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d281180d94ee66016fe958 HTTP/1.1" 200 None 2026-04-07 15:34:55,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:34:55,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:34:55,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:34:55,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d281180d94ee66016fe958 HTTP/1.1" 200 None 2026-04-07 15:34:55,594 - lava_callback - ERROR - Error processing callback for node 69d281180d94ee66016fe958: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45150 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:35:55,431 - lava_callback - INFO - Received callback for node 69d281560d94ee66016fe97c INFO: 172.20.0.1:48728 - "POST /node/69d281560d94ee66016fe97c HTTP/1.0" 202 Accepted 2026-04-07 15:35:55,436 - lava_callback - INFO - Starting async job submit for node 69d281560d94ee66016fe97c 2026-04-07 15:35:55,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:35:55,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d281560d94ee66016fe97c HTTP/1.1" 200 None 2026-04-07 15:35:55,454 - lava_callback - DEBUG - Processing node 69d281560d94ee66016fe97c: baseline-arm-baylibre 2026-04-07 15:35:55,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d281560d94ee66016fe97c 2026-04-07 15:35:55,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:35:55,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d281560d94ee66016fe97c HTTP/1.1" 200 None 2026-04-07 15:35:55,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:35:55,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:35:55,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:35:55,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d281560d94ee66016fe97c HTTP/1.1" 200 None 2026-04-07 15:35:55,525 - lava_callback - ERROR - Error processing callback for node 69d281560d94ee66016fe97c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42380 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:36:35,536 - lava_callback - INFO - Received callback for node 69d2817a0d94ee66016fe99d INFO: 172.20.0.1:54252 - "POST /node/69d2817a0d94ee66016fe99d HTTP/1.0" 202 Accepted 2026-04-07 15:36:35,544 - lava_callback - INFO - Starting async job submit for node 69d2817a0d94ee66016fe99d 2026-04-07 15:36:35,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:36:35,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2817a0d94ee66016fe99d HTTP/1.1" 200 None 2026-04-07 15:36:35,565 - lava_callback - DEBUG - Processing node 69d2817a0d94ee66016fe99d: baseline-arm-baylibre 2026-04-07 15:36:35,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2817a0d94ee66016fe99d 2026-04-07 15:36:35,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:36:35,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2817a0d94ee66016fe99d HTTP/1.1" 200 None 2026-04-07 15:36:35,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:36:35,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:36:35,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:36:35,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2817a0d94ee66016fe99d HTTP/1.1" 200 None 2026-04-07 15:36:35,647 - lava_callback - ERROR - Error processing callback for node 69d2817a0d94ee66016fe99d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54608 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 15:37:15,510 - lava_callback - INFO - Received callback for node 69d281a00d94ee66016fe9c7 INFO: 172.20.0.1:54616 - "POST /node/69d281a00d94ee66016fe9c7 HTTP/1.0" 202 Accepted 2026-04-07 15:37:15,516 - lava_callback - INFO - Starting async job submit for node 69d281a00d94ee66016fe9c7 2026-04-07 15:37:15,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:37:15,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d281a00d94ee66016fe9c7 HTTP/1.1" 200 None 2026-04-07 15:37:15,531 - lava_callback - DEBUG - Processing node 69d281a00d94ee66016fe9c7: baseline-arm64-baylibre 2026-04-07 15:37:15,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d281a00d94ee66016fe9c7 2026-04-07 15:37:15,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:37:15,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d281a00d94ee66016fe9c7 HTTP/1.1" 200 None 2026-04-07 15:37:15,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:37:15,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:37:15,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:37:15,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d281a00d94ee66016fe9c7 HTTP/1.1" 200 None 2026-04-07 15:37:15,596 - lava_callback - ERROR - Error processing callback for node 69d281a00d94ee66016fe9c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33518 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:38:25,488 - lava_callback - INFO - Received callback for node 69d281e10d94ee66016fe9de INFO: 172.20.0.1:33530 - "POST /node/69d281e10d94ee66016fe9de HTTP/1.0" 202 Accepted 2026-04-07 15:38:25,495 - lava_callback - INFO - Starting async job submit for node 69d281e10d94ee66016fe9de 2026-04-07 15:38:25,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:38:25,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d281e10d94ee66016fe9de HTTP/1.1" 200 None 2026-04-07 15:38:25,510 - lava_callback - DEBUG - Processing node 69d281e10d94ee66016fe9de: baseline-arm-clabbe 2026-04-07 15:38:25,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d281e10d94ee66016fe9de 2026-04-07 15:38:25,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:38:25,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d281e10d94ee66016fe9de HTTP/1.1" 200 None 2026-04-07 15:38:25,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:38:25,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:38:25,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:38:25,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d281e10d94ee66016fe9de HTTP/1.1" 200 None 2026-04-07 15:38:25,566 - lava_callback - ERROR - Error processing callback for node 69d281e10d94ee66016fe9de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55588 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:38:45,498 - lava_callback - INFO - Received callback for node 69d282000d94ee66016fea0b INFO: 172.20.0.1:41120 - "POST /node/69d282000d94ee66016fea0b HTTP/1.0" 202 Accepted 2026-04-07 15:38:45,504 - lava_callback - INFO - Starting async job submit for node 69d282000d94ee66016fea0b 2026-04-07 15:38:45,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:38:45,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d282000d94ee66016fea0b HTTP/1.1" 200 None 2026-04-07 15:38:45,520 - lava_callback - DEBUG - Processing node 69d282000d94ee66016fea0b: baseline-arm-clabbe 2026-04-07 15:38:45,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d282000d94ee66016fea0b 2026-04-07 15:38:45,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:38:45,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d282000d94ee66016fea0b HTTP/1.1" 200 None 2026-04-07 15:38:45,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:38:45,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:38:45,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:38:45,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d282000d94ee66016fea0b HTTP/1.1" 200 None 2026-04-07 15:38:45,579 - lava_callback - ERROR - Error processing callback for node 69d282000d94ee66016fea0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51948 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:39:31,758 - lava_callback - INFO - Received callback for node 69d51b2d932ecfe2320a45ce INFO: 172.20.0.1:53164 - "POST /node/69d51b2d932ecfe2320a45ce HTTP/1.0" 202 Accepted 2026-04-07 15:39:31,764 - lava_callback - INFO - Starting async job submit for node 69d51b2d932ecfe2320a45ce 2026-04-07 15:39:31,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:39:31,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51b2d932ecfe2320a45ce HTTP/1.1" 200 None 2026-04-07 15:39:31,797 - lava_callback - DEBUG - Processing node 69d51b2d932ecfe2320a45ce: baseline-x86 2026-04-07 15:39:32,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 15:39:32,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 15:39:32,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d51b2d932ecfe2320a45ce/log.txt.gz 2026-04-07 15:39:32,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 15:39:32,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 15:39:32,677 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d51b2d932ecfe2320a45ce/lava-logs.yaml 2026-04-07 15:39:32,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 15:39:32,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 15:39:32,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d51b2d932ecfe2320a45ce/lava_callback.json.gz 2026-04-07 15:39:32,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:39:32,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51b2d932ecfe2320a45ce HTTP/1.1" 200 None 2026-04-07 15:39:32,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:39:32,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd8d932ecfe2320a1035 HTTP/1.1" 200 None 2026-04-07 15:39:32,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:39:32,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51b2d932ecfe2320a45ce HTTP/1.1" 200 None 2026-04-07 15:39:32,979 - lava_callback - INFO - Completed processing callback for node 69d51b2d932ecfe2320a45ce 2026-04-07 15:39:36,200 - lava_callback - INFO - Received callback for node 69d2822a0d94ee66016fea2e INFO: 172.20.0.1:53180 - "POST /node/69d2822a0d94ee66016fea2e HTTP/1.0" 202 Accepted 2026-04-07 15:39:36,209 - lava_callback - INFO - Starting async job submit for node 69d2822a0d94ee66016fea2e 2026-04-07 15:39:36,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:39:36,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2822a0d94ee66016fea2e HTTP/1.1" 200 None 2026-04-07 15:39:36,230 - lava_callback - DEBUG - Processing node 69d2822a0d94ee66016fea2e: baseline-arm64-baylibre 2026-04-07 15:39:36,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2822a0d94ee66016fea2e 2026-04-07 15:39:36,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:39:36,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2822a0d94ee66016fea2e HTTP/1.1" 200 None 2026-04-07 15:39:36,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:39:36,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:39:36,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:39:36,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2822a0d94ee66016fea2e HTTP/1.1" 200 None 2026-04-07 15:39:36,298 - lava_callback - ERROR - Error processing callback for node 69d2822a0d94ee66016fea2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41686 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:39:57,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:39:58,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39176 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:40:25,570 - lava_callback - INFO - Received callback for node 69d282650d94ee66016fea66 INFO: 172.20.0.1:39180 - "POST /node/69d282650d94ee66016fea66 HTTP/1.0" 202 Accepted 2026-04-07 15:40:25,579 - lava_callback - INFO - Starting async job submit for node 69d282650d94ee66016fea66 2026-04-07 15:40:25,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:40:25,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d282650d94ee66016fea66 HTTP/1.1" 200 None 2026-04-07 15:40:25,608 - lava_callback - DEBUG - Processing node 69d282650d94ee66016fea66: baseline-arm-clabbe 2026-04-07 15:40:25,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d282650d94ee66016fea66 2026-04-07 15:40:25,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:40:25,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d282650d94ee66016fea66 HTTP/1.1" 200 None 2026-04-07 15:40:25,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:40:25,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:40:25,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:40:25,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d282650d94ee66016fea66 HTTP/1.1" 200 None 2026-04-07 15:40:25,676 - lava_callback - ERROR - Error processing callback for node 69d282650d94ee66016fea66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44620 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:41:05,590 - lava_callback - INFO - Received callback for node 69d2828a0d94ee66016fea7d INFO: 172.20.0.1:52384 - "POST /node/69d2828a0d94ee66016fea7d HTTP/1.0" 202 Accepted 2026-04-07 15:41:05,595 - lava_callback - INFO - Starting async job submit for node 69d2828a0d94ee66016fea7d 2026-04-07 15:41:05,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:41:05,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2828a0d94ee66016fea7d HTTP/1.1" 200 None 2026-04-07 15:41:05,613 - lava_callback - DEBUG - Processing node 69d2828a0d94ee66016fea7d: baseline-arm-clabbe 2026-04-07 15:41:05,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2828a0d94ee66016fea7d 2026-04-07 15:41:05,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:41:05,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2828a0d94ee66016fea7d HTTP/1.1" 200 None 2026-04-07 15:41:05,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:41:05,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:41:05,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:41:05,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2828a0d94ee66016fea7d HTTP/1.1" 200 None 2026-04-07 15:41:05,698 - lava_callback - ERROR - Error processing callback for node 69d2828a0d94ee66016fea7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41086 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:42:05,673 - lava_callback - INFO - Received callback for node 69d282bb0d94ee66016fea89 INFO: 172.20.0.1:54928 - "POST /node/69d282bb0d94ee66016fea89 HTTP/1.0" 202 Accepted 2026-04-07 15:42:05,679 - lava_callback - INFO - Starting async job submit for node 69d282bb0d94ee66016fea89 2026-04-07 15:42:05,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:42:05,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d282bb0d94ee66016fea89 HTTP/1.1" 200 None 2026-04-07 15:42:05,697 - lava_callback - DEBUG - Processing node 69d282bb0d94ee66016fea89: baseline-arm64-clabbe 2026-04-07 15:42:05,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d282bb0d94ee66016fea89 2026-04-07 15:42:05,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:42:05,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d282bb0d94ee66016fea89 HTTP/1.1" 200 None 2026-04-07 15:42:05,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:42:05,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:42:05,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:42:05,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d282bb0d94ee66016fea89 HTTP/1.1" 200 None 2026-04-07 15:42:05,765 - lava_callback - ERROR - Error processing callback for node 69d282bb0d94ee66016fea89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32856 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:42:45,631 - lava_callback - INFO - Received callback for node 69d282f30d94ee66016feaa7 INFO: 172.20.0.1:57260 - "POST /node/69d282f30d94ee66016feaa7 HTTP/1.0" 202 Accepted 2026-04-07 15:42:45,637 - lava_callback - INFO - Starting async job submit for node 69d282f30d94ee66016feaa7 2026-04-07 15:42:45,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:42:45,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d282f30d94ee66016feaa7 HTTP/1.1" 200 None 2026-04-07 15:42:45,656 - lava_callback - DEBUG - Processing node 69d282f30d94ee66016feaa7: baseline-arm-clabbe 2026-04-07 15:42:45,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d282f30d94ee66016feaa7 2026-04-07 15:42:45,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:42:45,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d282f30d94ee66016feaa7 HTTP/1.1" 200 None 2026-04-07 15:42:45,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:42:45,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:42:45,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:42:45,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d282f30d94ee66016feaa7 HTTP/1.1" 200 None 2026-04-07 15:42:45,713 - lava_callback - ERROR - Error processing callback for node 69d282f30d94ee66016feaa7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54872 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:43:45,698 - lava_callback - INFO - Received callback for node 69d2831f0d94ee66016feaf0 INFO: 172.20.0.1:37894 - "POST /node/69d2831f0d94ee66016feaf0 HTTP/1.0" 202 Accepted 2026-04-07 15:43:45,704 - lava_callback - INFO - Starting async job submit for node 69d2831f0d94ee66016feaf0 2026-04-07 15:43:45,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:43:45,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2831f0d94ee66016feaf0 HTTP/1.1" 200 None 2026-04-07 15:43:45,720 - lava_callback - DEBUG - Processing node 69d2831f0d94ee66016feaf0: baseline-arm64-clabbe 2026-04-07 15:43:45,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2831f0d94ee66016feaf0 2026-04-07 15:43:45,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:43:45,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2831f0d94ee66016feaf0 HTTP/1.1" 200 None 2026-04-07 15:43:45,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:43:45,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:43:45,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:43:45,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2831f0d94ee66016feaf0 HTTP/1.1" 200 None 2026-04-07 15:43:45,775 - lava_callback - ERROR - Error processing callback for node 69d2831f0d94ee66016feaf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53448 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:44:45,812 - lava_callback - INFO - Received callback for node 69d2835a0d94ee66016feb0f INFO: 172.20.0.1:34870 - "POST /node/69d2835a0d94ee66016feb0f HTTP/1.0" 202 Accepted 2026-04-07 15:44:45,818 - lava_callback - INFO - Starting async job submit for node 69d2835a0d94ee66016feb0f 2026-04-07 15:44:45,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:44:45,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2835a0d94ee66016feb0f HTTP/1.1" 200 None 2026-04-07 15:44:45,835 - lava_callback - DEBUG - Processing node 69d2835a0d94ee66016feb0f: baseline-arm-clabbe 2026-04-07 15:44:45,835 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2835a0d94ee66016feb0f 2026-04-07 15:44:45,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:44:45,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2835a0d94ee66016feb0f HTTP/1.1" 200 None 2026-04-07 15:44:45,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:44:45,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:44:45,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:44:45,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2835a0d94ee66016feb0f HTTP/1.1" 200 None 2026-04-07 15:44:45,885 - lava_callback - ERROR - Error processing callback for node 69d2835a0d94ee66016feb0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46292 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:45:05,744 - lava_callback - INFO - Received callback for node 69d2837b0d94ee66016feb2a INFO: 172.20.0.1:49896 - "POST /node/69d2837b0d94ee66016feb2a HTTP/1.0" 202 Accepted 2026-04-07 15:45:05,750 - lava_callback - INFO - Starting async job submit for node 69d2837b0d94ee66016feb2a 2026-04-07 15:45:05,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:45:05,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2837b0d94ee66016feb2a HTTP/1.1" 200 None 2026-04-07 15:45:05,767 - lava_callback - DEBUG - Processing node 69d2837b0d94ee66016feb2a: baseline-arm-clabbe 2026-04-07 15:45:05,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2837b0d94ee66016feb2a 2026-04-07 15:45:05,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:45:05,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2837b0d94ee66016feb2a HTTP/1.1" 200 None 2026-04-07 15:45:05,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:45:05,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:45:05,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:45:05,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2837b0d94ee66016feb2a HTTP/1.1" 200 None 2026-04-07 15:45:05,833 - lava_callback - ERROR - Error processing callback for node 69d2837b0d94ee66016feb2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44336 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:46:05,798 - lava_callback - INFO - Received callback for node 69d283ae0d94ee66016feb38 INFO: 172.20.0.1:57390 - "POST /node/69d283ae0d94ee66016feb38 HTTP/1.0" 202 Accepted 2026-04-07 15:46:05,803 - lava_callback - INFO - Starting async job submit for node 69d283ae0d94ee66016feb38 2026-04-07 15:46:05,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:46:05,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d283ae0d94ee66016feb38 HTTP/1.1" 200 None 2026-04-07 15:46:05,819 - lava_callback - DEBUG - Processing node 69d283ae0d94ee66016feb38: baseline-arm64-clabbe 2026-04-07 15:46:05,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d283ae0d94ee66016feb38 2026-04-07 15:46:05,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:46:05,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d283ae0d94ee66016feb38 HTTP/1.1" 200 None 2026-04-07 15:46:05,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:46:05,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:46:05,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:46:05,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d283ae0d94ee66016feb38 HTTP/1.1" 200 None 2026-04-07 15:46:05,873 - lava_callback - ERROR - Error processing callback for node 69d283ae0d94ee66016feb38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33976 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:47:05,828 - lava_callback - INFO - Received callback for node 69d283f60d94ee66016feb4d INFO: 172.20.0.1:43308 - "POST /node/69d283f60d94ee66016feb4d HTTP/1.0" 202 Accepted 2026-04-07 15:47:05,834 - lava_callback - INFO - Starting async job submit for node 69d283f60d94ee66016feb4d 2026-04-07 15:47:05,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:47:05,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d283f60d94ee66016feb4d HTTP/1.1" 200 None 2026-04-07 15:47:05,850 - lava_callback - DEBUG - Processing node 69d283f60d94ee66016feb4d: baseline-arm64-clabbe 2026-04-07 15:47:05,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d283f60d94ee66016feb4d 2026-04-07 15:47:05,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:47:05,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d283f60d94ee66016feb4d HTTP/1.1" 200 None 2026-04-07 15:47:05,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:47:05,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:47:05,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:47:05,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d283f60d94ee66016feb4d HTTP/1.1" 200 None 2026-04-07 15:47:05,908 - lava_callback - ERROR - Error processing callback for node 69d283f60d94ee66016feb4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50338 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:48:05,897 - lava_callback - INFO - Received callback for node 69d284330d94ee66016febaa INFO: 172.20.0.1:48548 - "POST /node/69d284330d94ee66016febaa HTTP/1.0" 202 Accepted 2026-04-07 15:48:05,903 - lava_callback - INFO - Starting async job submit for node 69d284330d94ee66016febaa 2026-04-07 15:48:05,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:48:05,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d284330d94ee66016febaa HTTP/1.1" 200 None 2026-04-07 15:48:05,920 - lava_callback - DEBUG - Processing node 69d284330d94ee66016febaa: baseline-arm64-clabbe 2026-04-07 15:48:05,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d284330d94ee66016febaa 2026-04-07 15:48:05,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:48:05,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d284330d94ee66016febaa HTTP/1.1" 200 None 2026-04-07 15:48:05,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:48:05,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:48:05,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:48:05,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d284330d94ee66016febaa HTTP/1.1" 200 None 2026-04-07 15:48:05,988 - lava_callback - ERROR - Error processing callback for node 69d284330d94ee66016febaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40872 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:49:25,977 - lava_callback - INFO - Received callback for node 69d2847a0d94ee66016febcd INFO: 172.20.0.1:40886 - "POST /node/69d2847a0d94ee66016febcd HTTP/1.0" 202 Accepted 2026-04-07 15:49:25,983 - lava_callback - INFO - Starting async job submit for node 69d2847a0d94ee66016febcd 2026-04-07 15:49:25,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:49:26,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2847a0d94ee66016febcd HTTP/1.1" 200 None 2026-04-07 15:49:26,005 - lava_callback - DEBUG - Processing node 69d2847a0d94ee66016febcd: baseline-arm64-clabbe 2026-04-07 15:49:26,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2847a0d94ee66016febcd 2026-04-07 15:49:26,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:49:26,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2847a0d94ee66016febcd HTTP/1.1" 200 None 2026-04-07 15:49:26,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:49:26,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-07 15:49:26,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:49:26,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2847a0d94ee66016febcd HTTP/1.1" 200 None 2026-04-07 15:49:26,069 - lava_callback - ERROR - Error processing callback for node 69d2847a0d94ee66016febcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46188 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 15:50:16,313 - lava_callback - INFO - Received callback for node 69d284ae0d94ee66016febf5 INFO: 172.20.0.1:46190 - "POST /node/69d284ae0d94ee66016febf5 HTTP/1.0" 202 Accepted 2026-04-07 15:50:16,320 - lava_callback - INFO - Starting async job submit for node 69d284ae0d94ee66016febf5 2026-04-07 15:50:16,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:50:16,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d284ae0d94ee66016febf5 HTTP/1.1" 200 None 2026-04-07 15:50:16,344 - lava_callback - DEBUG - Processing node 69d284ae0d94ee66016febf5: baseline-arm-baylibre 2026-04-07 15:50:16,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d284ae0d94ee66016febf5 2026-04-07 15:50:16,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:50:16,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d284ae0d94ee66016febf5 HTTP/1.1" 200 None 2026-04-07 15:50:16,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:50:16,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:50:16,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:50:16,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d284ae0d94ee66016febf5 HTTP/1.1" 200 None 2026-04-07 15:50:16,407 - lava_callback - ERROR - Error processing callback for node 69d284ae0d94ee66016febf5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44196 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:50:56,308 - lava_callback - INFO - Received callback for node 69d284d20d94ee66016fec02 INFO: 172.20.0.1:55052 - "POST /node/69d284d20d94ee66016fec02 HTTP/1.0" 202 Accepted 2026-04-07 15:50:56,314 - lava_callback - INFO - Starting async job submit for node 69d284d20d94ee66016fec02 2026-04-07 15:50:56,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:50:56,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d284d20d94ee66016fec02 HTTP/1.1" 200 None 2026-04-07 15:50:56,332 - lava_callback - DEBUG - Processing node 69d284d20d94ee66016fec02: baseline-arm-baylibre 2026-04-07 15:50:56,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d284d20d94ee66016fec02 2026-04-07 15:50:56,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:50:56,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d284d20d94ee66016fec02 HTTP/1.1" 200 None 2026-04-07 15:50:56,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:50:56,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:50:56,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:50:56,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d284d20d94ee66016fec02 HTTP/1.1" 200 None 2026-04-07 15:50:56,397 - lava_callback - ERROR - Error processing callback for node 69d284d20d94ee66016fec02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34786 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 15:51:16,292 - lava_callback - INFO - Received callback for node 69d284f10d94ee66016fec17 INFO: 172.20.0.1:34802 - "POST /node/69d284f10d94ee66016fec17 HTTP/1.0" 202 Accepted 2026-04-07 15:51:16,301 - lava_callback - INFO - Starting async job submit for node 69d284f10d94ee66016fec17 2026-04-07 15:51:16,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:51:16,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d284f10d94ee66016fec17 HTTP/1.1" 200 None 2026-04-07 15:51:16,318 - lava_callback - DEBUG - Processing node 69d284f10d94ee66016fec17: baseline-arm-baylibre 2026-04-07 15:51:16,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d284f10d94ee66016fec17 2026-04-07 15:51:16,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:51:16,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d284f10d94ee66016fec17 HTTP/1.1" 200 None 2026-04-07 15:51:16,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:51:16,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:51:16,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:51:16,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d284f10d94ee66016fec17 HTTP/1.1" 200 None 2026-04-07 15:51:16,374 - lava_callback - ERROR - Error processing callback for node 69d284f10d94ee66016fec17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59904 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:52:36,418 - lava_callback - INFO - Received callback for node 69d285350d94ee66016fec44 INFO: 172.20.0.1:34272 - "POST /node/69d285350d94ee66016fec44 HTTP/1.0" 202 Accepted 2026-04-07 15:52:36,426 - lava_callback - INFO - Starting async job submit for node 69d285350d94ee66016fec44 2026-04-07 15:52:36,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:52:36,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d285350d94ee66016fec44 HTTP/1.1" 200 None 2026-04-07 15:52:36,441 - lava_callback - DEBUG - Processing node 69d285350d94ee66016fec44: baseline-arm-baylibre 2026-04-07 15:52:36,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d285350d94ee66016fec44 2026-04-07 15:52:36,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:52:36,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d285350d94ee66016fec44 HTTP/1.1" 200 None 2026-04-07 15:52:36,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:52:36,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:52:36,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:52:36,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d285350d94ee66016fec44 HTTP/1.1" 200 None 2026-04-07 15:52:36,505 - lava_callback - ERROR - Error processing callback for node 69d285350d94ee66016fec44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48784 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:53:46,186 - lava_callback - INFO - Received callback for node 69d2857b0d94ee66016fec88 INFO: 172.20.0.1:33372 - "POST /node/69d2857b0d94ee66016fec88 HTTP/1.0" 202 Accepted 2026-04-07 15:53:46,192 - lava_callback - INFO - Starting async job submit for node 69d2857b0d94ee66016fec88 2026-04-07 15:53:46,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:53:46,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2857b0d94ee66016fec88 HTTP/1.1" 200 None 2026-04-07 15:53:46,208 - lava_callback - DEBUG - Processing node 69d2857b0d94ee66016fec88: baseline-arm-clabbe 2026-04-07 15:53:46,208 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2857b0d94ee66016fec88 2026-04-07 15:53:46,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:53:46,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2857b0d94ee66016fec88 HTTP/1.1" 200 None 2026-04-07 15:53:46,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:53:46,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:53:46,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:53:46,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2857b0d94ee66016fec88 HTTP/1.1" 200 None 2026-04-07 15:53:46,259 - lava_callback - ERROR - Error processing callback for node 69d2857b0d94ee66016fec88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50064 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:54:16,932 - lava_callback - INFO - Received callback for node 69d285a10d94ee66016fecbb INFO: 172.20.0.1:50070 - "POST /node/69d285a10d94ee66016fecbb HTTP/1.0" 202 Accepted 2026-04-07 15:54:16,938 - lava_callback - INFO - Starting async job submit for node 69d285a10d94ee66016fecbb 2026-04-07 15:54:16,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:54:16,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d285a10d94ee66016fecbb HTTP/1.1" 200 None 2026-04-07 15:54:16,953 - lava_callback - DEBUG - Processing node 69d285a10d94ee66016fecbb: baseline-arm64-baylibre 2026-04-07 15:54:16,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d285a10d94ee66016fecbb 2026-04-07 15:54:16,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:54:16,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d285a10d94ee66016fecbb HTTP/1.1" 200 None 2026-04-07 15:54:16,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:54:16,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 15:54:16,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:54:17,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d285a10d94ee66016fecbb HTTP/1.1" 200 None 2026-04-07 15:54:17,010 - lava_callback - ERROR - Error processing callback for node 69d285a10d94ee66016fecbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54546 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:55:26,300 - lava_callback - INFO - Received callback for node 69d285e30d94ee66016fece6 INFO: 172.20.0.1:54562 - "POST /node/69d285e30d94ee66016fece6 HTTP/1.0" 202 Accepted 2026-04-07 15:55:26,305 - lava_callback - INFO - Starting async job submit for node 69d285e30d94ee66016fece6 2026-04-07 15:55:26,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:55:26,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d285e30d94ee66016fece6 HTTP/1.1" 200 None 2026-04-07 15:55:26,322 - lava_callback - DEBUG - Processing node 69d285e30d94ee66016fece6: baseline-arm-clabbe 2026-04-07 15:55:26,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d285e30d94ee66016fece6 2026-04-07 15:55:26,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:55:26,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d285e30d94ee66016fece6 HTTP/1.1" 200 None 2026-04-07 15:55:26,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:55:26,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:55:26,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:55:26,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d285e30d94ee66016fece6 HTTP/1.1" 200 None 2026-04-07 15:55:26,384 - lava_callback - ERROR - Error processing callback for node 69d285e30d94ee66016fece6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38656 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:56:06,255 - lava_callback - INFO - Received callback for node 69d286040d94ee66016fecfa INFO: 172.20.0.1:54862 - "POST /node/69d286040d94ee66016fecfa HTTP/1.0" 202 Accepted 2026-04-07 15:56:06,260 - lava_callback - INFO - Starting async job submit for node 69d286040d94ee66016fecfa 2026-04-07 15:56:06,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:56:06,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d286040d94ee66016fecfa HTTP/1.1" 200 None 2026-04-07 15:56:06,278 - lava_callback - DEBUG - Processing node 69d286040d94ee66016fecfa: baseline-arm-clabbe 2026-04-07 15:56:06,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d286040d94ee66016fecfa 2026-04-07 15:56:06,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:56:06,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d286040d94ee66016fecfa HTTP/1.1" 200 None 2026-04-07 15:56:06,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:56:06,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:56:06,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:56:06,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d286040d94ee66016fecfa HTTP/1.1" 200 None 2026-04-07 15:56:06,335 - lava_callback - ERROR - Error processing callback for node 69d286040d94ee66016fecfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34368 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:56:46,325 - lava_callback - INFO - Received callback for node 69d286280d94ee66016fed1c INFO: 172.20.0.1:49906 - "POST /node/69d286280d94ee66016fed1c HTTP/1.0" 202 Accepted 2026-04-07 15:56:46,331 - lava_callback - INFO - Starting async job submit for node 69d286280d94ee66016fed1c 2026-04-07 15:56:46,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:56:46,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d286280d94ee66016fed1c HTTP/1.1" 200 None 2026-04-07 15:56:46,347 - lava_callback - DEBUG - Processing node 69d286280d94ee66016fed1c: baseline-arm-clabbe 2026-04-07 15:56:46,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d286280d94ee66016fed1c 2026-04-07 15:56:46,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:56:46,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d286280d94ee66016fed1c HTTP/1.1" 200 None 2026-04-07 15:56:46,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:56:46,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:56:46,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:56:46,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d286280d94ee66016fed1c HTTP/1.1" 200 None 2026-04-07 15:56:46,404 - lava_callback - ERROR - Error processing callback for node 69d286280d94ee66016fed1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44206 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:57:16,730 - lava_callback - INFO - Received callback for node 69d2864e0d94ee66016fed4c INFO: 172.20.0.1:44220 - "POST /node/69d2864e0d94ee66016fed4c HTTP/1.0" 202 Accepted 2026-04-07 15:57:16,736 - lava_callback - INFO - Starting async job submit for node 69d2864e0d94ee66016fed4c 2026-04-07 15:57:16,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:57:16,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2864e0d94ee66016fed4c HTTP/1.1" 200 None 2026-04-07 15:57:16,752 - lava_callback - DEBUG - Processing node 69d2864e0d94ee66016fed4c: baseline-arm64-baylibre 2026-04-07 15:57:16,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2864e0d94ee66016fed4c 2026-04-07 15:57:16,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:57:16,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2864e0d94ee66016fed4c HTTP/1.1" 200 None 2026-04-07 15:57:16,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:57:16,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 15:57:16,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:57:16,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2864e0d94ee66016fed4c HTTP/1.1" 200 None 2026-04-07 15:57:16,816 - lava_callback - ERROR - Error processing callback for node 69d2864e0d94ee66016fed4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37756 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:58:26,422 - lava_callback - INFO - Received callback for node 69d2868e0d94ee66016fed76 INFO: 172.20.0.1:37758 - "POST /node/69d2868e0d94ee66016fed76 HTTP/1.0" 202 Accepted 2026-04-07 15:58:26,427 - lava_callback - INFO - Starting async job submit for node 69d2868e0d94ee66016fed76 2026-04-07 15:58:26,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:58:26,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2868e0d94ee66016fed76 HTTP/1.1" 200 None 2026-04-07 15:58:26,451 - lava_callback - DEBUG - Processing node 69d2868e0d94ee66016fed76: baseline-arm-clabbe 2026-04-07 15:58:26,451 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2868e0d94ee66016fed76 2026-04-07 15:58:26,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:58:26,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2868e0d94ee66016fed76 HTTP/1.1" 200 None 2026-04-07 15:58:26,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:58:26,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:58:26,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:58:26,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2868e0d94ee66016fed76 HTTP/1.1" 200 None 2026-04-07 15:58:26,508 - lava_callback - ERROR - Error processing callback for node 69d2868e0d94ee66016fed76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39714 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:58:46,356 - lava_callback - INFO - Received callback for node 69d286b10d94ee66016fed97 INFO: 172.20.0.1:35060 - "POST /node/69d286b10d94ee66016fed97 HTTP/1.0" 202 Accepted 2026-04-07 15:58:46,362 - lava_callback - INFO - Starting async job submit for node 69d286b10d94ee66016fed97 2026-04-07 15:58:46,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:58:46,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d286b10d94ee66016fed97 HTTP/1.1" 200 None 2026-04-07 15:58:46,377 - lava_callback - DEBUG - Processing node 69d286b10d94ee66016fed97: baseline-arm-clabbe 2026-04-07 15:58:46,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d286b10d94ee66016fed97 2026-04-07 15:58:46,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:58:46,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d286b10d94ee66016fed97 HTTP/1.1" 200 None 2026-04-07 15:58:46,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:58:46,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 15:58:46,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:58:46,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d286b10d94ee66016fed97 HTTP/1.1" 200 None 2026-04-07 15:58:46,438 - lava_callback - ERROR - Error processing callback for node 69d286b10d94ee66016fed97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51480 - "GET / HTTP/1.0" 200 OK 2026-04-07 15:59:36,844 - lava_callback - INFO - Received callback for node 69d286db0d94ee66016fedaa INFO: 172.20.0.1:51490 - "POST /node/69d286db0d94ee66016fedaa HTTP/1.0" 202 Accepted 2026-04-07 15:59:36,851 - lava_callback - INFO - Starting async job submit for node 69d286db0d94ee66016fedaa 2026-04-07 15:59:36,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:59:36,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d286db0d94ee66016fedaa HTTP/1.1" 200 None 2026-04-07 15:59:36,871 - lava_callback - DEBUG - Processing node 69d286db0d94ee66016fedaa: baseline-arm64-baylibre 2026-04-07 15:59:36,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d286db0d94ee66016fedaa 2026-04-07 15:59:36,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:59:36,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d286db0d94ee66016fedaa HTTP/1.1" 200 None 2026-04-07 15:59:36,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:59:36,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 15:59:36,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 15:59:36,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d286db0d94ee66016fedaa HTTP/1.1" 200 None 2026-04-07 15:59:36,945 - lava_callback - ERROR - Error processing callback for node 69d286db0d94ee66016fedaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34438 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52472 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:00:46,514 - lava_callback - INFO - Received callback for node 69d287190d94ee66016feddf INFO: 172.20.0.1:33542 - "POST /node/69d287190d94ee66016feddf HTTP/1.0" 202 Accepted 2026-04-07 16:00:46,519 - lava_callback - INFO - Starting async job submit for node 69d287190d94ee66016feddf 2026-04-07 16:00:46,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:33544 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:00:46,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d287190d94ee66016feddf HTTP/1.1" 200 None 2026-04-07 16:00:46,536 - lava_callback - DEBUG - Processing node 69d287190d94ee66016feddf: baseline-arm-clabbe 2026-04-07 16:00:46,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d287190d94ee66016feddf 2026-04-07 16:00:46,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:00:46,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d287190d94ee66016feddf HTTP/1.1" 200 None 2026-04-07 16:00:46,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:00:46,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-07 16:00:46,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:00:46,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d287190d94ee66016feddf HTTP/1.1" 200 None 2026-04-07 16:00:46,598 - lava_callback - ERROR - Error processing callback for node 69d287190d94ee66016feddf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59386 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:01:16,953 - lava_callback - INFO - Received callback for node 69d287440d94ee66016fee17 INFO: 172.20.0.1:59400 - "POST /node/69d287440d94ee66016fee17 HTTP/1.0" 202 Accepted 2026-04-07 16:01:16,959 - lava_callback - INFO - Starting async job submit for node 69d287440d94ee66016fee17 2026-04-07 16:01:16,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:01:16,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d287440d94ee66016fee17 HTTP/1.1" 200 None 2026-04-07 16:01:17,000 - lava_callback - DEBUG - Processing node 69d287440d94ee66016fee17: baseline-arm64-baylibre 2026-04-07 16:01:17,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d287440d94ee66016fee17 2026-04-07 16:01:17,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:01:17,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d287440d94ee66016fee17 HTTP/1.1" 200 None 2026-04-07 16:01:17,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:01:17,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 16:01:17,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:01:17,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d287440d94ee66016fee17 HTTP/1.1" 200 None 2026-04-07 16:01:17,059 - lava_callback - ERROR - Error processing callback for node 69d287440d94ee66016fee17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54474 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:02:37,095 - lava_callback - INFO - Received callback for node 69d2878a0d94ee66016fee38 INFO: 172.20.0.1:54480 - "POST /node/69d2878a0d94ee66016fee38 HTTP/1.0" 202 Accepted 2026-04-07 16:02:37,101 - lava_callback - INFO - Starting async job submit for node 69d2878a0d94ee66016fee38 2026-04-07 16:02:37,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:02:37,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2878a0d94ee66016fee38 HTTP/1.1" 200 None 2026-04-07 16:02:37,122 - lava_callback - DEBUG - Processing node 69d2878a0d94ee66016fee38: baseline-arm64-baylibre 2026-04-07 16:02:37,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2878a0d94ee66016fee38 2026-04-07 16:02:37,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:02:37,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2878a0d94ee66016fee38 HTTP/1.1" 200 None 2026-04-07 16:02:37,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:02:37,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 16:02:37,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:02:37,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2878a0d94ee66016fee38 HTTP/1.1" 200 None 2026-04-07 16:02:37,174 - lava_callback - ERROR - Error processing callback for node 69d2878a0d94ee66016fee38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35950 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:03:46,672 - lava_callback - INFO - Received callback for node 69d287d40d94ee66016fee74 INFO: 172.20.0.1:35952 - "POST /node/69d287d40d94ee66016fee74 HTTP/1.0" 202 Accepted 2026-04-07 16:03:46,678 - lava_callback - INFO - Starting async job submit for node 69d287d40d94ee66016fee74 2026-04-07 16:03:46,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:03:46,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d287d40d94ee66016fee74 HTTP/1.1" 200 None 2026-04-07 16:03:46,693 - lava_callback - DEBUG - Processing node 69d287d40d94ee66016fee74: baseline-arm64-clabbe 2026-04-07 16:03:46,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d287d40d94ee66016fee74 2026-04-07 16:03:46,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:03:46,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d287d40d94ee66016fee74 HTTP/1.1" 200 None 2026-04-07 16:03:46,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:03:46,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 16:03:46,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:03:46,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d287d40d94ee66016fee74 HTTP/1.1" 200 None 2026-04-07 16:03:46,744 - lava_callback - ERROR - Error processing callback for node 69d287d40d94ee66016fee74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50376 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:04:46,748 - lava_callback - INFO - Received callback for node 69d288190d94ee66016feeb4 INFO: 172.20.0.1:50382 - "POST /node/69d288190d94ee66016feeb4 HTTP/1.0" 202 Accepted 2026-04-07 16:04:46,754 - lava_callback - INFO - Starting async job submit for node 69d288190d94ee66016feeb4 2026-04-07 16:04:46,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:04:46,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d288190d94ee66016feeb4 HTTP/1.1" 200 None 2026-04-07 16:04:46,769 - lava_callback - DEBUG - Processing node 69d288190d94ee66016feeb4: baseline-arm64-clabbe 2026-04-07 16:04:46,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d288190d94ee66016feeb4 2026-04-07 16:04:46,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:04:46,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d288190d94ee66016feeb4 HTTP/1.1" 200 None 2026-04-07 16:04:46,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:04:46,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 16:04:46,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:04:46,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d288190d94ee66016feeb4 HTTP/1.1" 200 None 2026-04-07 16:04:46,835 - lava_callback - ERROR - Error processing callback for node 69d288190d94ee66016feeb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52506 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:06:06,809 - lava_callback - INFO - Received callback for node 69d288600d94ee66016feee3 INFO: 172.20.0.1:52508 - "POST /node/69d288600d94ee66016feee3 HTTP/1.0" 202 Accepted 2026-04-07 16:06:06,815 - lava_callback - INFO - Starting async job submit for node 69d288600d94ee66016feee3 2026-04-07 16:06:06,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:06:06,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d288600d94ee66016feee3 HTTP/1.1" 200 None 2026-04-07 16:06:06,836 - lava_callback - DEBUG - Processing node 69d288600d94ee66016feee3: baseline-arm64-clabbe 2026-04-07 16:06:06,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d288600d94ee66016feee3 2026-04-07 16:06:06,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:06:06,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d288600d94ee66016feee3 HTTP/1.1" 200 None 2026-04-07 16:06:06,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:06:06,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 16:06:06,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:06:06,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d288600d94ee66016feee3 HTTP/1.1" 200 None 2026-04-07 16:06:06,890 - lava_callback - ERROR - Error processing callback for node 69d288600d94ee66016feee3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58324 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:07:06,861 - lava_callback - INFO - Received callback for node 69d288a50d94ee66016fef1f INFO: 172.20.0.1:58340 - "POST /node/69d288a50d94ee66016fef1f HTTP/1.0" 202 Accepted 2026-04-07 16:07:06,867 - lava_callback - INFO - Starting async job submit for node 69d288a50d94ee66016fef1f 2026-04-07 16:07:06,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:07:06,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d288a50d94ee66016fef1f HTTP/1.1" 200 None 2026-04-07 16:07:06,884 - lava_callback - DEBUG - Processing node 69d288a50d94ee66016fef1f: baseline-arm64-clabbe 2026-04-07 16:07:06,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d288a50d94ee66016fef1f 2026-04-07 16:07:06,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:07:06,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d288a50d94ee66016fef1f HTTP/1.1" 200 None 2026-04-07 16:07:06,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:07:06,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 16:07:06,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:07:06,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d288a50d94ee66016fef1f HTTP/1.1" 200 None 2026-04-07 16:07:06,960 - lava_callback - ERROR - Error processing callback for node 69d288a50d94ee66016fef1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49284 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:08:17,390 - lava_callback - INFO - Received callback for node 69d288e70d94ee66016fef3a INFO: 172.20.0.1:49296 - "POST /node/69d288e70d94ee66016fef3a HTTP/1.0" 202 Accepted 2026-04-07 16:08:17,399 - lava_callback - INFO - Starting async job submit for node 69d288e70d94ee66016fef3a 2026-04-07 16:08:17,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:08:17,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d288e70d94ee66016fef3a HTTP/1.1" 200 None 2026-04-07 16:08:17,418 - lava_callback - DEBUG - Processing node 69d288e70d94ee66016fef3a: baseline-arm64-baylibre 2026-04-07 16:08:17,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d288e70d94ee66016fef3a 2026-04-07 16:08:17,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:08:17,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d288e70d94ee66016fef3a HTTP/1.1" 200 None 2026-04-07 16:08:17,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:08:17,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 16:08:17,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:08:17,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d288e70d94ee66016fef3a HTTP/1.1" 200 None 2026-04-07 16:08:17,489 - lava_callback - ERROR - Error processing callback for node 69d288e70d94ee66016fef3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44592 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:09:47,009 - lava_callback - INFO - Received callback for node 69d289350d94ee66016fef59 INFO: 172.20.0.1:44598 - "POST /node/69d289350d94ee66016fef59 HTTP/1.0" 202 Accepted 2026-04-07 16:09:47,015 - lava_callback - INFO - Starting async job submit for node 69d289350d94ee66016fef59 2026-04-07 16:09:47,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:09:47,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d289350d94ee66016fef59 HTTP/1.1" 200 None 2026-04-07 16:09:47,033 - lava_callback - DEBUG - Processing node 69d289350d94ee66016fef59: baseline-arm64-clabbe 2026-04-07 16:09:47,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d289350d94ee66016fef59 2026-04-07 16:09:47,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:09:47,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d289350d94ee66016fef59 HTTP/1.1" 200 None 2026-04-07 16:09:47,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:09:47,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 16:09:47,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:09:47,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d289350d94ee66016fef59 HTTP/1.1" 200 None 2026-04-07 16:09:47,097 - lava_callback - ERROR - Error processing callback for node 69d289350d94ee66016fef59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45814 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:10:37,392 - lava_callback - INFO - Received callback for node 69d289700d94ee66016fef96 INFO: 172.20.0.1:45822 - "POST /node/69d289700d94ee66016fef96 HTTP/1.0" 202 Accepted 2026-04-07 16:10:37,397 - lava_callback - INFO - Starting async job submit for node 69d289700d94ee66016fef96 2026-04-07 16:10:37,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:10:37,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d289700d94ee66016fef96 HTTP/1.1" 200 None 2026-04-07 16:10:37,440 - lava_callback - DEBUG - Processing node 69d289700d94ee66016fef96: baseline-arm64-baylibre 2026-04-07 16:10:37,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d289700d94ee66016fef96 2026-04-07 16:10:37,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:10:37,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d289700d94ee66016fef96 HTTP/1.1" 200 None 2026-04-07 16:10:37,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:10:37,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 16:10:37,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:10:37,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d289700d94ee66016fef96 HTTP/1.1" 200 None 2026-04-07 16:10:37,497 - lava_callback - ERROR - Error processing callback for node 69d289700d94ee66016fef96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43406 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:11:47,062 - lava_callback - INFO - Received callback for node 69d289bb0d94ee66016feff3 INFO: 172.20.0.1:43418 - "POST /node/69d289bb0d94ee66016feff3 HTTP/1.0" 202 Accepted 2026-04-07 16:11:47,071 - lava_callback - INFO - Starting async job submit for node 69d289bb0d94ee66016feff3 2026-04-07 16:11:47,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:11:47,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d289bb0d94ee66016feff3 HTTP/1.1" 200 None 2026-04-07 16:11:47,088 - lava_callback - DEBUG - Processing node 69d289bb0d94ee66016feff3: baseline-arm64-clabbe 2026-04-07 16:11:47,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d289bb0d94ee66016feff3 2026-04-07 16:11:47,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:11:47,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d289bb0d94ee66016feff3 HTTP/1.1" 200 None 2026-04-07 16:11:47,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:11:47,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 16:11:47,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:11:47,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d289bb0d94ee66016feff3 HTTP/1.1" 200 None 2026-04-07 16:11:47,154 - lava_callback - ERROR - Error processing callback for node 69d289bb0d94ee66016feff3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56784 - "GET / HTTP/1.0" 200 OK 2026-04-07 16:12:57,544 - lava_callback - INFO - Received callback for node 69d289fe0d94ee66016ff009 INFO: 172.20.0.1:56798 - "POST /node/69d289fe0d94ee66016ff009 HTTP/1.0" 202 Accepted 2026-04-07 16:12:57,552 - lava_callback - INFO - Starting async job submit for node 69d289fe0d94ee66016ff009 2026-04-07 16:12:57,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:12:57,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d289fe0d94ee66016ff009 HTTP/1.1" 200 None 2026-04-07 16:12:57,567 - lava_callback - DEBUG - Processing node 69d289fe0d94ee66016ff009: baseline-arm64-baylibre 2026-04-07 16:12:57,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d289fe0d94ee66016ff009 2026-04-07 16:12:57,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:12:57,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d289fe0d94ee66016ff009 HTTP/1.1" 200 None 2026-04-07 16:12:57,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:12:57,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-07 16:12:57,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 16:12:57,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d289fe0d94ee66016ff009 HTTP/1.1" 200 None 2026-04-07 16:12:57,620 - lava_callback - ERROR - Error processing callback for node 69d289fe0d94ee66016ff009: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]