INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51544 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:15:05,158 - lava_callback - INFO - Received callback for node 69f5420546dc69a3a70bb141 2026-05-04 00:15:05,165 - lava_callback - INFO - Starting async job submit for node 69f5420546dc69a3a70bb141 INFO: 172.20.0.1:49276 - "POST /node/69f5420546dc69a3a70bb141 HTTP/1.0" 202 Accepted 2026-05-04 00:15:05,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:15:05,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5420546dc69a3a70bb141 HTTP/1.1" 200 None 2026-05-04 00:15:05,185 - lava_callback - DEBUG - Processing node 69f5420546dc69a3a70bb141: baseline-arm64-baylibre 2026-05-04 00:15:05,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5420546dc69a3a70bb141 2026-05-04 00:15:05,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:15:05,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5420546dc69a3a70bb141 HTTP/1.1" 200 None 2026-05-04 00:15:05,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:15:05,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 00:15:05,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:15:05,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5420546dc69a3a70bb141 HTTP/1.1" 200 None 2026-05-04 00:15:05,237 - lava_callback - ERROR - Error processing callback for node 69f5420546dc69a3a70bb141: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48302 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:16:25,288 - lava_callback - INFO - Received callback for node 69f5425446dc69a3a70bb168 INFO: 172.20.0.1:53526 - "POST /node/69f5425446dc69a3a70bb168 HTTP/1.0" 202 Accepted 2026-05-04 00:16:25,294 - lava_callback - INFO - Starting async job submit for node 69f5425446dc69a3a70bb168 2026-05-04 00:16:25,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:16:25,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5425446dc69a3a70bb168 HTTP/1.1" 200 None 2026-05-04 00:16:25,338 - lava_callback - DEBUG - Processing node 69f5425446dc69a3a70bb168: baseline-arm64-baylibre 2026-05-04 00:16:25,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5425446dc69a3a70bb168 2026-05-04 00:16:25,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:16:25,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5425446dc69a3a70bb168 HTTP/1.1" 200 None 2026-05-04 00:16:25,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:16:25,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 00:16:25,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:16:25,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5425446dc69a3a70bb168 HTTP/1.1" 200 None 2026-05-04 00:16:25,417 - lava_callback - ERROR - Error processing callback for node 69f5425446dc69a3a70bb168: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34954 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:17:45,394 - lava_callback - INFO - Received callback for node 69f542a346dc69a3a70bb18d INFO: 172.20.0.1:40660 - "POST /node/69f542a346dc69a3a70bb18d HTTP/1.0" 202 Accepted 2026-05-04 00:17:45,401 - lava_callback - INFO - Starting async job submit for node 69f542a346dc69a3a70bb18d 2026-05-04 00:17:45,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:17:45,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f542a346dc69a3a70bb18d HTTP/1.1" 200 None 2026-05-04 00:17:45,418 - lava_callback - DEBUG - Processing node 69f542a346dc69a3a70bb18d: baseline-arm64-baylibre 2026-05-04 00:17:45,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f542a346dc69a3a70bb18d 2026-05-04 00:17:45,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:17:45,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f542a346dc69a3a70bb18d HTTP/1.1" 200 None 2026-05-04 00:17:45,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:17:45,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 00:17:45,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:17:45,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f542a346dc69a3a70bb18d HTTP/1.1" 200 None 2026-05-04 00:17:45,468 - lava_callback - ERROR - Error processing callback for node 69f542a346dc69a3a70bb18d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57864 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:19:05,459 - lava_callback - INFO - Received callback for node 69f542f046dc69a3a70bb1ad INFO: 172.20.0.1:41318 - "POST /node/69f542f046dc69a3a70bb1ad HTTP/1.0" 202 Accepted 2026-05-04 00:19:05,464 - lava_callback - INFO - Starting async job submit for node 69f542f046dc69a3a70bb1ad 2026-05-04 00:19:05,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:19:05,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f542f046dc69a3a70bb1ad HTTP/1.1" 200 None 2026-05-04 00:19:05,480 - lava_callback - DEBUG - Processing node 69f542f046dc69a3a70bb1ad: baseline-arm64-baylibre 2026-05-04 00:19:05,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f542f046dc69a3a70bb1ad 2026-05-04 00:19:05,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:19:05,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f542f046dc69a3a70bb1ad HTTP/1.1" 200 None 2026-05-04 00:19:05,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:41322 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:19:05,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 00:19:05,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:19:05,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f542f046dc69a3a70bb1ad HTTP/1.1" 200 None 2026-05-04 00:19:05,556 - lava_callback - ERROR - Error processing callback for node 69f542f046dc69a3a70bb1ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49924 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:20:05,477 - lava_callback - INFO - Received callback for node 69f5433046dc69a3a70bb1d1 INFO: 172.20.0.1:35042 - "POST /node/69f5433046dc69a3a70bb1d1 HTTP/1.0" 202 Accepted 2026-05-04 00:20:05,482 - lava_callback - INFO - Starting async job submit for node 69f5433046dc69a3a70bb1d1 2026-05-04 00:20:05,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:20:05,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5433046dc69a3a70bb1d1 HTTP/1.1" 200 None 2026-05-04 00:20:05,497 - lava_callback - DEBUG - Processing node 69f5433046dc69a3a70bb1d1: baseline-arm-baylibre 2026-05-04 00:20:05,497 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5433046dc69a3a70bb1d1 2026-05-04 00:20:05,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:35048 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:20:05,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5433046dc69a3a70bb1d1 HTTP/1.1" 200 None 2026-05-04 00:20:05,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:20:05,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf5199260e707730df4a HTTP/1.1" 200 None 2026-05-04 00:20:05,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:20:05,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5433046dc69a3a70bb1d1 HTTP/1.1" 200 None 2026-05-04 00:20:05,591 - lava_callback - ERROR - Error processing callback for node 69f5433046dc69a3a70bb1d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37416 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:20:45,502 - lava_callback - INFO - Received callback for node 69f5435446dc69a3a70bb1df INFO: 172.20.0.1:49966 - "POST /node/69f5435446dc69a3a70bb1df HTTP/1.0" 202 Accepted 2026-05-04 00:20:45,508 - lava_callback - INFO - Starting async job submit for node 69f5435446dc69a3a70bb1df 2026-05-04 00:20:45,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:20:45,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5435446dc69a3a70bb1df HTTP/1.1" 200 None 2026-05-04 00:20:45,525 - lava_callback - DEBUG - Processing node 69f5435446dc69a3a70bb1df: baseline-arm-baylibre 2026-05-04 00:20:45,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5435446dc69a3a70bb1df 2026-05-04 00:20:45,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:20:45,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5435446dc69a3a70bb1df HTTP/1.1" 200 None 2026-05-04 00:20:45,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:20:45,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf5199260e707730df4a HTTP/1.1" 200 None 2026-05-04 00:20:45,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:20:45,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5435446dc69a3a70bb1df HTTP/1.1" 200 None 2026-05-04 00:20:45,583 - lava_callback - ERROR - Error processing callback for node 69f5435446dc69a3a70bb1df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36638 - "GET /node/69f0e3ec94b553ffc6903e64%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47530 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:29:24,132 - lava_callback - INFO - Received callback for node 69f54550ed4ed40b0223db4a INFO: 172.20.0.1:57992 - "POST /node/69f54550ed4ed40b0223db4a HTTP/1.0" 202 Accepted 2026-05-04 00:29:24,138 - lava_callback - INFO - Starting async job submit for node 69f54550ed4ed40b0223db4a 2026-05-04 00:29:24,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:29:24,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54550ed4ed40b0223db4a HTTP/1.1" 200 None 2026-05-04 00:29:24,154 - lava_callback - DEBUG - Processing node 69f54550ed4ed40b0223db4a: baseline-arm64-clabbe 2026-05-04 00:29:24,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54550ed4ed40b0223db4a 2026-05-04 00:29:24,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:29:24,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54550ed4ed40b0223db4a HTTP/1.1" 200 None 2026-05-04 00:29:24,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:29:24,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:29:24,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:29:24,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54550ed4ed40b0223db4a HTTP/1.1" 200 None 2026-05-04 00:29:24,199 - lava_callback - ERROR - Error processing callback for node 69f54550ed4ed40b0223db4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53510 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:31:24,264 - lava_callback - INFO - Received callback for node 69f545c7ed4ed40b0223db74 INFO: 172.20.0.1:36932 - "POST /node/69f545c7ed4ed40b0223db74 HTTP/1.0" 202 Accepted 2026-05-04 00:31:24,269 - lava_callback - INFO - Starting async job submit for node 69f545c7ed4ed40b0223db74 2026-05-04 00:31:24,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:31:24,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f545c7ed4ed40b0223db74 HTTP/1.1" 200 None 2026-05-04 00:31:24,287 - lava_callback - DEBUG - Processing node 69f545c7ed4ed40b0223db74: baseline-arm64-clabbe 2026-05-04 00:31:24,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f545c7ed4ed40b0223db74 2026-05-04 00:31:24,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:31:24,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f545c7ed4ed40b0223db74 HTTP/1.1" 200 None 2026-05-04 00:31:24,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:31:24,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:31:24,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:31:24,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f545c7ed4ed40b0223db74 HTTP/1.1" 200 None 2026-05-04 00:31:24,350 - lava_callback - ERROR - Error processing callback for node 69f545c7ed4ed40b0223db74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60352 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:32:10,311 - lava_callback - INFO - Received callback for node 69f7e88f559eef1735ba7f1a INFO: 172.20.0.1:51936 - "POST /node/69f7e88f559eef1735ba7f1a HTTP/1.0" 202 Accepted 2026-05-04 00:32:10,317 - lava_callback - INFO - Starting async job submit for node 69f7e88f559eef1735ba7f1a 2026-05-04 00:32:10,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:32:10,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e88f559eef1735ba7f1a HTTP/1.1" 200 None 2026-05-04 00:32:10,356 - lava_callback - DEBUG - Processing node 69f7e88f559eef1735ba7f1a: baseline-arm 2026-05-04 00:32:10,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:32:10,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:32:10,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f7e88f559eef1735ba7f1a/log.txt.gz 2026-05-04 00:32:10,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:32:11,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:32:11,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f7e88f559eef1735ba7f1a/lava-logs.yaml 2026-05-04 00:32:11,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:32:11,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:32:11,172 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f7e88f559eef1735ba7f1a/lava_callback.json.gz 2026-05-04 00:32:11,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:32:11,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e88f559eef1735ba7f1a HTTP/1.1" 200 None 2026-05-04 00:32:11,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:32:11,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5be559eef1735ba573d HTTP/1.1" 200 None 2026-05-04 00:32:11,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:32:11,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e88f559eef1735ba7f1a HTTP/1.1" 200 None 2026-05-04 00:32:11,246 - lava_callback - INFO - Completed processing callback for node 69f7e88f559eef1735ba7f1a INFO: 172.20.0.1:51940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57812 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:32:35,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:32:35,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46102 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:36:24,408 - lava_callback - INFO - Received callback for node 69f546f4ed4ed40b02240286 INFO: 172.20.0.1:44180 - "POST /node/69f546f4ed4ed40b02240286 HTTP/1.0" 202 Accepted 2026-05-04 00:36:24,413 - lava_callback - INFO - Starting async job submit for node 69f546f4ed4ed40b02240286 2026-05-04 00:36:24,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:36:24,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f546f4ed4ed40b02240286 HTTP/1.1" 200 None 2026-05-04 00:36:24,430 - lava_callback - DEBUG - Processing node 69f546f4ed4ed40b02240286: baseline-arm64-clabbe 2026-05-04 00:36:24,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f546f4ed4ed40b02240286 2026-05-04 00:36:24,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:36:24,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f546f4ed4ed40b02240286 HTTP/1.1" 200 None 2026-05-04 00:36:24,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:36:24,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:36:24,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:36:24,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f546f4ed4ed40b02240286 HTTP/1.1" 200 None 2026-05-04 00:36:24,486 - lava_callback - ERROR - Error processing callback for node 69f546f4ed4ed40b02240286: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45926 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:37:26,482 - lava_callback - INFO - Received callback for node 69f54738ed4ed40b022402b3 INFO: 172.20.0.1:46952 - "POST /node/69f54738ed4ed40b022402b3 HTTP/1.0" 202 Accepted 2026-05-04 00:37:26,488 - lava_callback - INFO - Starting async job submit for node 69f54738ed4ed40b022402b3 2026-05-04 00:37:26,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:37:26,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54738ed4ed40b022402b3 HTTP/1.1" 200 None 2026-05-04 00:37:26,503 - lava_callback - DEBUG - Processing node 69f54738ed4ed40b022402b3: baseline-arm64-baylibre 2026-05-04 00:37:26,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54738ed4ed40b022402b3 2026-05-04 00:37:26,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:37:26,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54738ed4ed40b022402b3 HTTP/1.1" 200 None 2026-05-04 00:37:26,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:37:26,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:37:26,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:46968 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:37:26,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54738ed4ed40b022402b3 HTTP/1.1" 200 None 2026-05-04 00:37:26,555 - lava_callback - ERROR - Error processing callback for node 69f54738ed4ed40b022402b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60854 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:38:44,495 - lava_callback - INFO - Received callback for node 69f5478bed4ed40b022402d7 INFO: 172.20.0.1:35294 - "POST /node/69f5478bed4ed40b022402d7 HTTP/1.0" 202 Accepted 2026-05-04 00:38:44,501 - lava_callback - INFO - Starting async job submit for node 69f5478bed4ed40b022402d7 2026-05-04 00:38:44,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:38:44,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5478bed4ed40b022402d7 HTTP/1.1" 200 None 2026-05-04 00:38:44,516 - lava_callback - DEBUG - Processing node 69f5478bed4ed40b022402d7: baseline-arm64-clabbe 2026-05-04 00:38:44,516 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5478bed4ed40b022402d7 2026-05-04 00:38:44,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:38:44,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5478bed4ed40b022402d7 HTTP/1.1" 200 None 2026-05-04 00:38:44,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:38:44,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:38:44,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:38:44,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5478bed4ed40b022402d7 HTTP/1.1" 200 None 2026-05-04 00:38:44,569 - lava_callback - ERROR - Error processing callback for node 69f5478bed4ed40b022402d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47140 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:39:46,605 - lava_callback - INFO - Received callback for node 69f547ceed4ed40b02240302 INFO: 172.20.0.1:47156 - "POST /node/69f547ceed4ed40b02240302 HTTP/1.0" 202 Accepted 2026-05-04 00:39:46,611 - lava_callback - INFO - Starting async job submit for node 69f547ceed4ed40b02240302 2026-05-04 00:39:46,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:39:46,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f547ceed4ed40b02240302 HTTP/1.1" 200 None 2026-05-04 00:39:46,626 - lava_callback - DEBUG - Processing node 69f547ceed4ed40b02240302: baseline-arm64-baylibre 2026-05-04 00:39:46,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f547ceed4ed40b02240302 2026-05-04 00:39:46,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:39:46,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f547ceed4ed40b02240302 HTTP/1.1" 200 None 2026-05-04 00:39:46,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:39:46,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:39:46,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:39:46,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f547ceed4ed40b02240302 HTTP/1.1" 200 None 2026-05-04 00:39:46,678 - lava_callback - ERROR - Error processing callback for node 69f547ceed4ed40b02240302: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43370 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:41:06,685 - lava_callback - INFO - Received callback for node 69f54819ed4ed40b02240327 INFO: 172.20.0.1:43384 - "POST /node/69f54819ed4ed40b02240327 HTTP/1.0" 202 Accepted 2026-05-04 00:41:06,691 - lava_callback - INFO - Starting async job submit for node 69f54819ed4ed40b02240327 2026-05-04 00:41:06,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:41:06,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54819ed4ed40b02240327 HTTP/1.1" 200 None 2026-05-04 00:41:06,707 - lava_callback - DEBUG - Processing node 69f54819ed4ed40b02240327: baseline-arm64-baylibre 2026-05-04 00:41:06,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54819ed4ed40b02240327 2026-05-04 00:41:06,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:41:06,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54819ed4ed40b02240327 HTTP/1.1" 200 None 2026-05-04 00:41:06,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:41:06,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:41:06,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:41:06,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54819ed4ed40b02240327 HTTP/1.1" 200 None 2026-05-04 00:41:06,800 - lava_callback - ERROR - Error processing callback for node 69f54819ed4ed40b02240327: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45912 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:41:39,723 - lava_callback - INFO - Received callback for node 69f7eb2d559eef1735ba7f4f INFO: 172.20.0.1:41216 - "POST /node/69f7eb2d559eef1735ba7f4f HTTP/1.0" 202 Accepted 2026-05-04 00:41:39,741 - lava_callback - INFO - Starting async job submit for node 69f7eb2d559eef1735ba7f4f 2026-05-04 00:41:39,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:41:39,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb2d559eef1735ba7f4f HTTP/1.1" 200 None 2026-05-04 00:41:39,775 - lava_callback - DEBUG - Processing node 69f7eb2d559eef1735ba7f4f: baseline-arm 2026-05-04 00:41:39,784 - lava_callback - WARNING - Failed to upload log 2026-05-04 00:41:39,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:41:39,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:41:39,924 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb2d559eef1735ba7f4f/lava-logs.yaml 2026-05-04 00:41:39,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:41:40,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:41:40,086 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb2d559eef1735ba7f4f/lava_callback.json.gz 2026-05-04 00:41:40,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:41:40,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb2d559eef1735ba7f4f HTTP/1.1" 200 None 2026-05-04 00:41:40,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:41:40,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:41:40,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:41:40,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb2d559eef1735ba7f4f HTTP/1.1" 200 None 2026-05-04 00:41:40,229 - lava_callback - INFO - Completed processing callback for node 69f7eb2d559eef1735ba7f4f INFO: 172.20.0.1:41220 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:41:49,242 - lava_callback - INFO - Received callback for node 69f7eb2e559eef1735ba7f52 INFO: 172.20.0.1:41222 - "POST /node/69f7eb2e559eef1735ba7f52 HTTP/1.0" 202 Accepted 2026-05-04 00:41:49,296 - lava_callback - INFO - Starting async job submit for node 69f7eb2e559eef1735ba7f52 2026-05-04 00:41:49,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:41:49,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb2e559eef1735ba7f52 HTTP/1.1" 200 None 2026-05-04 00:41:49,335 - lava_callback - DEBUG - Processing node 69f7eb2e559eef1735ba7f52: baseline-arm 2026-05-04 00:41:49,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:41:49,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:41:49,642 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb2e559eef1735ba7f52/log.txt.gz 2026-05-04 00:41:49,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:41:49,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:41:49,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb2e559eef1735ba7f52/lava-logs.yaml 2026-05-04 00:41:49,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:41:49,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:41:49,930 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb2e559eef1735ba7f52/lava_callback.json.gz 2026-05-04 00:41:49,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:41:49,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb2e559eef1735ba7f52 HTTP/1.1" 200 None 2026-05-04 00:41:49,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:41:49,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:41:49,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:41:50,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb2e559eef1735ba7f52 HTTP/1.1" 200 None 2026-05-04 00:41:50,011 - lava_callback - INFO - Completed processing callback for node 69f7eb2e559eef1735ba7f52 INFO: 172.20.0.1:54044 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:42:05,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:05,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54146 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:42:06,490 - lava_callback - INFO - Received callback for node 69f7eb31559eef1735ba7f5b INFO: 172.20.0.1:54152 - "POST /node/69f7eb31559eef1735ba7f5b HTTP/1.0" 202 Accepted 2026-05-04 00:42:06,538 - lava_callback - INFO - Starting async job submit for node 69f7eb31559eef1735ba7f5b INFO: 172.20.0.1:54158 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:42:06,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:06,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb31559eef1735ba7f5b HTTP/1.1" 200 None 2026-05-04 00:42:06,591 - lava_callback - DEBUG - Processing node 69f7eb31559eef1735ba7f5b: baseline-arm 2026-05-04 00:42:06,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:06,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:06,839 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb31559eef1735ba7f5b/log.txt.gz 2026-05-04 00:42:06,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:07,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:07,068 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb31559eef1735ba7f5b/lava-logs.yaml 2026-05-04 00:42:07,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:07,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:07,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb31559eef1735ba7f5b/lava_callback.json.gz 2026-05-04 00:42:07,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:07,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb31559eef1735ba7f5b HTTP/1.1" 200 None 2026-05-04 00:42:07,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:07,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:42:07,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:07,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb31559eef1735ba7f5b HTTP/1.1" 200 None 2026-05-04 00:42:07,292 - lava_callback - INFO - Completed processing callback for node 69f7eb31559eef1735ba7f5b INFO: 172.20.0.1:58998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50236 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:42:33,177 - lava_callback - INFO - Received callback for node 69f7eb30559eef1735ba7f58 INFO: 172.20.0.1:55054 - "POST /node/69f7eb30559eef1735ba7f58 HTTP/1.0" 202 Accepted 2026-05-04 00:42:33,183 - lava_callback - INFO - Starting async job submit for node 69f7eb30559eef1735ba7f58 2026-05-04 00:42:33,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:33,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb30559eef1735ba7f58 HTTP/1.1" 200 None 2026-05-04 00:42:33,239 - lava_callback - DEBUG - Processing node 69f7eb30559eef1735ba7f58: baseline-arm 2026-05-04 00:42:33,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:33,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:33,569 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb30559eef1735ba7f58/log.txt.gz 2026-05-04 00:42:33,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:33,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:33,886 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb30559eef1735ba7f58/lava-logs.yaml 2026-05-04 00:42:33,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:34,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:34,015 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb30559eef1735ba7f58/lava_callback.json.gz 2026-05-04 00:42:34,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:34,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb30559eef1735ba7f58 HTTP/1.1" 200 None 2026-05-04 00:42:34,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:34,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:42:34,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:34,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb30559eef1735ba7f58 HTTP/1.1" 200 None 2026-05-04 00:42:34,125 - lava_callback - INFO - Completed processing callback for node 69f7eb30559eef1735ba7f58 2026-05-04 00:42:35,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:35,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55068 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:42:43,975 - lava_callback - INFO - Received callback for node 69f7eb52559eef1735ba7fe7 INFO: 172.20.0.1:35026 - "POST /node/69f7eb52559eef1735ba7fe7 HTTP/1.0" 202 Accepted 2026-05-04 00:42:44,025 - lava_callback - INFO - Starting async job submit for node 69f7eb52559eef1735ba7fe7 2026-05-04 00:42:44,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:44,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb52559eef1735ba7fe7 HTTP/1.1" 200 None 2026-05-04 00:42:44,059 - lava_callback - DEBUG - Processing node 69f7eb52559eef1735ba7fe7: baseline-arm-pengutronix 2026-05-04 00:42:44,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:44,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:44,246 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f7eb52559eef1735ba7fe7/log.txt.gz 2026-05-04 00:42:44,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:44,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:44,441 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f7eb52559eef1735ba7fe7/lava-logs.yaml 2026-05-04 00:42:44,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:44,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:44,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f7eb52559eef1735ba7fe7/lava_callback.json.gz 2026-05-04 00:42:44,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:44,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb52559eef1735ba7fe7 HTTP/1.1" 200 None 2026-05-04 00:42:44,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:44,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:42:44,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:44,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb52559eef1735ba7fe7 HTTP/1.1" 200 None 2026-05-04 00:42:44,616 - lava_callback - INFO - Completed processing callback for node 69f7eb52559eef1735ba7fe7 INFO: 172.20.0.1:35036 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:42:48,856 - lava_callback - INFO - Received callback for node 69f7eb2d559eef1735ba7f4c INFO: 172.20.0.1:35044 - "POST /node/69f7eb2d559eef1735ba7f4c HTTP/1.0" 202 Accepted 2026-05-04 00:42:48,862 - lava_callback - INFO - Starting async job submit for node 69f7eb2d559eef1735ba7f4c 2026-05-04 00:42:48,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:48,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb2d559eef1735ba7f4c HTTP/1.1" 200 None 2026-05-04 00:42:48,897 - lava_callback - DEBUG - Processing node 69f7eb2d559eef1735ba7f4c: baseline-arm 2026-05-04 00:42:49,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:49,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:49,270 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb2d559eef1735ba7f4c/log.txt.gz 2026-05-04 00:42:49,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:49,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:49,585 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb2d559eef1735ba7f4c/lava-logs.yaml 2026-05-04 00:42:49,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:49,669 - lava_callback - INFO - Received callback for node 69f7eb51559eef1735ba7fe4 2026-05-04 00:42:49,676 - lava_callback - INFO - Starting async job submit for node 69f7eb51559eef1735ba7fe4 INFO: 172.20.0.1:35048 - "POST /node/69f7eb51559eef1735ba7fe4 HTTP/1.0" 202 Accepted 2026-05-04 00:42:49,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:49,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:49,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb51559eef1735ba7fe4 HTTP/1.1" 200 None 2026-05-04 00:42:49,734 - lava_callback - DEBUG - Processing node 69f7eb51559eef1735ba7fe4: baseline-arm-pengutronix 2026-05-04 00:42:49,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb2d559eef1735ba7f4c/lava_callback.json.gz 2026-05-04 00:42:49,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:49,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb2d559eef1735ba7f4c HTTP/1.1" 200 None 2026-05-04 00:42:49,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:49,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:49,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:42:49,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:49,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb2d559eef1735ba7f4c HTTP/1.1" 200 None 2026-05-04 00:42:49,974 - lava_callback - INFO - Completed processing callback for node 69f7eb2d559eef1735ba7f4c 2026-05-04 00:42:50,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:50,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f7eb51559eef1735ba7fe4/log.txt.gz 2026-05-04 00:42:50,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:50,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:50,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f7eb51559eef1735ba7fe4/lava-logs.yaml 2026-05-04 00:42:50,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:50,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:50,389 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f7eb51559eef1735ba7fe4/lava_callback.json.gz 2026-05-04 00:42:50,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:50,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb51559eef1735ba7fe4 HTTP/1.1" 200 None 2026-05-04 00:42:50,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:50,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:42:50,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:50,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb51559eef1735ba7fe4 HTTP/1.1" 200 None 2026-05-04 00:42:50,458 - lava_callback - INFO - Completed processing callback for node 69f7eb51559eef1735ba7fe4 2026-05-04 00:42:50,634 - lava_callback - INFO - Received callback for node 69f7eb50559eef1735ba7fe1 INFO: 172.20.0.1:36250 - "POST /node/69f7eb50559eef1735ba7fe1 HTTP/1.0" 202 Accepted 2026-05-04 00:42:50,640 - lava_callback - INFO - Starting async job submit for node 69f7eb50559eef1735ba7fe1 2026-05-04 00:42:50,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:50,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb50559eef1735ba7fe1 HTTP/1.1" 200 None 2026-05-04 00:42:50,674 - lava_callback - DEBUG - Processing node 69f7eb50559eef1735ba7fe1: baseline-arm-pengutronix 2026-05-04 00:42:50,772 - lava_callback - INFO - Received callback for node 69f7eb3d559eef1735ba7f7f INFO: 172.20.0.1:36260 - "POST /node/69f7eb3d559eef1735ba7f7f HTTP/1.0" 202 Accepted 2026-05-04 00:42:50,783 - lava_callback - INFO - Starting async job submit for node 69f7eb3d559eef1735ba7f7f 2026-05-04 00:42:50,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:50,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:50,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb3d559eef1735ba7f7f HTTP/1.1" 200 None 2026-05-04 00:42:50,869 - lava_callback - DEBUG - Processing node 69f7eb3d559eef1735ba7f7f: baseline-arm-broonie 2026-05-04 00:42:50,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:50,978 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f7eb50559eef1735ba7fe1/log.txt.gz 2026-05-04 00:42:51,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:51,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:51,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:51,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f7eb3d559eef1735ba7f7f/log.txt.gz 2026-05-04 00:42:51,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:51,368 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f7eb50559eef1735ba7fe1/lava-logs.yaml 2026-05-04 00:42:51,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:51,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:51,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:51,482 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f7eb50559eef1735ba7fe1/lava_callback.json.gz 2026-05-04 00:42:51,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:51,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb50559eef1735ba7fe1 HTTP/1.1" 200 None 2026-05-04 00:42:51,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:51,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:51,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f7eb3d559eef1735ba7f7f/lava-logs.yaml 2026-05-04 00:42:51,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:51,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:42:51,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:51,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb50559eef1735ba7fe1 HTTP/1.1" 200 None 2026-05-04 00:42:51,569 - lava_callback - INFO - Completed processing callback for node 69f7eb50559eef1735ba7fe1 2026-05-04 00:42:51,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:51,682 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f7eb3d559eef1735ba7f7f/lava_callback.json.gz 2026-05-04 00:42:51,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:51,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb3d559eef1735ba7f7f HTTP/1.1" 200 None 2026-05-04 00:42:51,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:51,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:42:51,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:51,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb3d559eef1735ba7f7f HTTP/1.1" 200 None 2026-05-04 00:42:51,786 - lava_callback - INFO - Completed processing callback for node 69f7eb3d559eef1735ba7f7f 2026-05-04 00:42:52,236 - lava_callback - INFO - Received callback for node 69f7eb3f559eef1735ba7f82 INFO: 172.20.0.1:36268 - "POST /node/69f7eb3f559eef1735ba7f82 HTTP/1.0" 202 Accepted 2026-05-04 00:42:52,242 - lava_callback - INFO - Starting async job submit for node 69f7eb3f559eef1735ba7f82 2026-05-04 00:42:52,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:52,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb3f559eef1735ba7f82 HTTP/1.1" 200 None 2026-05-04 00:42:52,280 - lava_callback - DEBUG - Processing node 69f7eb3f559eef1735ba7f82: baseline-arm-broonie 2026-05-04 00:42:52,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:52,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:52,596 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f7eb3f559eef1735ba7f82/log.txt.gz 2026-05-04 00:42:52,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:52,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:52,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f7eb3f559eef1735ba7f82/lava-logs.yaml 2026-05-04 00:42:52,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:42:52,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:42:52,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f7eb3f559eef1735ba7f82/lava_callback.json.gz 2026-05-04 00:42:52,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:52,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb3f559eef1735ba7f82 HTTP/1.1" 200 None 2026-05-04 00:42:52,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:53,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:42:53,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:42:53,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb3f559eef1735ba7f82 HTTP/1.1" 200 None 2026-05-04 00:42:53,033 - lava_callback - INFO - Completed processing callback for node 69f7eb3f559eef1735ba7f82 INFO: 172.20.0.1:36270 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:43:05,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:05,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36648 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:43:17,660 - lava_callback - INFO - Received callback for node 69f7eb40559eef1735ba7f85 INFO: 172.20.0.1:36654 - "POST /node/69f7eb40559eef1735ba7f85 HTTP/1.0" 202 Accepted 2026-05-04 00:43:17,666 - lava_callback - INFO - Starting async job submit for node 69f7eb40559eef1735ba7f85 2026-05-04 00:43:17,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:17,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb40559eef1735ba7f85 HTTP/1.1" 200 None 2026-05-04 00:43:17,702 - lava_callback - DEBUG - Processing node 69f7eb40559eef1735ba7f85: baseline-arm-broonie 2026-05-04 00:43:17,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:18,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:18,020 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f7eb40559eef1735ba7f85/log.txt.gz 2026-05-04 00:43:18,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:18,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:18,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f7eb40559eef1735ba7f85/lava-logs.yaml 2026-05-04 00:43:18,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:18,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:18,388 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f7eb40559eef1735ba7f85/lava_callback.json.gz 2026-05-04 00:43:18,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:18,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb40559eef1735ba7f85 HTTP/1.1" 200 None 2026-05-04 00:43:18,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:18,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:43:18,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:18,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb40559eef1735ba7f85 HTTP/1.1" 200 None 2026-05-04 00:43:18,481 - lava_callback - INFO - Completed processing callback for node 69f7eb40559eef1735ba7f85 2026-05-04 00:43:26,048 - lava_callback - INFO - Received callback for node 69f7eb4c559eef1735ba7fcf INFO: 172.20.0.1:56272 - "POST /node/69f7eb4c559eef1735ba7fcf HTTP/1.0" 202 Accepted 2026-05-04 00:43:26,054 - lava_callback - INFO - Starting async job submit for node 69f7eb4c559eef1735ba7fcf 2026-05-04 00:43:26,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:26,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb4c559eef1735ba7fcf HTTP/1.1" 200 None 2026-05-04 00:43:26,092 - lava_callback - DEBUG - Processing node 69f7eb4c559eef1735ba7fcf: baseline-arm-kontron 2026-05-04 00:43:26,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:26,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:26,340 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f7eb4c559eef1735ba7fcf/log.txt.gz 2026-05-04 00:43:26,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:56284 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:43:26,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:26,586 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f7eb4c559eef1735ba7fcf/lava-logs.yaml 2026-05-04 00:43:26,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:26,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:26,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f7eb4c559eef1735ba7fcf/lava_callback.json.gz 2026-05-04 00:43:26,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:26,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb4c559eef1735ba7fcf HTTP/1.1" 200 None 2026-05-04 00:43:26,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:26,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:43:26,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:26,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb4c559eef1735ba7fcf HTTP/1.1" 200 None 2026-05-04 00:43:26,771 - lava_callback - INFO - Completed processing callback for node 69f7eb4c559eef1735ba7fcf 2026-05-04 00:43:27,268 - lava_callback - INFO - Received callback for node 69f7eb4d559eef1735ba7fd2 INFO: 172.20.0.1:56298 - "POST /node/69f7eb4d559eef1735ba7fd2 HTTP/1.0" 202 Accepted 2026-05-04 00:43:27,274 - lava_callback - INFO - Starting async job submit for node 69f7eb4d559eef1735ba7fd2 2026-05-04 00:43:27,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:27,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb4d559eef1735ba7fd2 HTTP/1.1" 200 None 2026-05-04 00:43:27,314 - lava_callback - DEBUG - Processing node 69f7eb4d559eef1735ba7fd2: baseline-arm-kontron 2026-05-04 00:43:27,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:27,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:27,690 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f7eb4d559eef1735ba7fd2/log.txt.gz 2026-05-04 00:43:27,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:28,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:28,022 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f7eb4d559eef1735ba7fd2/lava-logs.yaml 2026-05-04 00:43:28,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:28,097 - lava_callback - INFO - Received callback for node 69f7eb44559eef1735ba7fb3 2026-05-04 00:43:28,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:28,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f7eb4d559eef1735ba7fd2/lava_callback.json.gz INFO: 172.20.0.1:56312 - "POST /node/69f7eb44559eef1735ba7fb3 HTTP/1.0" 202 Accepted 2026-05-04 00:43:28,160 - lava_callback - INFO - Starting async job submit for node 69f7eb44559eef1735ba7fb3 2026-05-04 00:43:28,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:28,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:28,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb4d559eef1735ba7fd2 HTTP/1.1" 200 None 2026-05-04 00:43:28,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:28,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb44559eef1735ba7fb3 HTTP/1.1" 200 None 2026-05-04 00:43:28,220 - lava_callback - DEBUG - Processing node 69f7eb44559eef1735ba7fb3: baseline-arm-clabbe 2026-05-04 00:43:28,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:43:28,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:28,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:28,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb4d559eef1735ba7fd2 HTTP/1.1" 200 None 2026-05-04 00:43:28,356 - lava_callback - INFO - Completed processing callback for node 69f7eb4d559eef1735ba7fd2 2026-05-04 00:43:28,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:28,430 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f7eb44559eef1735ba7fb3/log.txt.gz 2026-05-04 00:43:28,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:28,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:28,609 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f7eb44559eef1735ba7fb3/lava-logs.yaml 2026-05-04 00:43:28,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:28,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:28,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f7eb44559eef1735ba7fb3/lava_callback.json.gz 2026-05-04 00:43:28,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:28,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb44559eef1735ba7fb3 HTTP/1.1" 200 None 2026-05-04 00:43:28,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:28,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:43:28,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:28,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb44559eef1735ba7fb3 HTTP/1.1" 200 None 2026-05-04 00:43:28,830 - lava_callback - INFO - Completed processing callback for node 69f7eb44559eef1735ba7fb3 2026-05-04 00:43:31,109 - lava_callback - INFO - Received callback for node 69f7eb3c559eef1735ba7f78 INFO: 172.20.0.1:47232 - "POST /node/69f7eb3c559eef1735ba7f78 HTTP/1.0" 202 Accepted 2026-05-04 00:43:31,115 - lava_callback - INFO - Starting async job submit for node 69f7eb3c559eef1735ba7f78 2026-05-04 00:43:31,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:31,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb3c559eef1735ba7f78 HTTP/1.1" 200 None 2026-05-04 00:43:31,155 - lava_callback - DEBUG - Processing node 69f7eb3c559eef1735ba7f78: baseline-arm-broonie 2026-05-04 00:43:31,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:31,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:31,443 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f7eb3c559eef1735ba7f78/log.txt.gz 2026-05-04 00:43:31,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:31,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:31,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f7eb3c559eef1735ba7f78/lava-logs.yaml 2026-05-04 00:43:31,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:43:31,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:43:31,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f7eb3c559eef1735ba7f78/lava_callback.json.gz 2026-05-04 00:43:31,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:31,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb3c559eef1735ba7f78 HTTP/1.1" 200 None 2026-05-04 00:43:31,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:31,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:43:31,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:31,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb3c559eef1735ba7f78 HTTP/1.1" 200 None 2026-05-04 00:43:31,869 - lava_callback - INFO - Completed processing callback for node 69f7eb3c559eef1735ba7f78 2026-05-04 00:43:35,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:35,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:47244 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:43:44,593 - lava_callback - INFO - Received callback for node 69f548b7ed4ed40b0224037b INFO: 172.20.0.1:39442 - "POST /node/69f548b7ed4ed40b0224037b HTTP/1.0" 202 Accepted 2026-05-04 00:43:44,599 - lava_callback - INFO - Starting async job submit for node 69f548b7ed4ed40b0224037b 2026-05-04 00:43:44,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:44,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f548b7ed4ed40b0224037b HTTP/1.1" 200 None 2026-05-04 00:43:44,614 - lava_callback - DEBUG - Processing node 69f548b7ed4ed40b0224037b: baseline-arm64-clabbe 2026-05-04 00:43:44,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f548b7ed4ed40b0224037b 2026-05-04 00:43:44,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:44,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f548b7ed4ed40b0224037b HTTP/1.1" 200 None 2026-05-04 00:43:44,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:44,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:43:44,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:43:44,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f548b7ed4ed40b0224037b HTTP/1.1" 200 None 2026-05-04 00:43:44,695 - lava_callback - ERROR - Error processing callback for node 69f548b7ed4ed40b0224037b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57262 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:44:08,089 - lava_callback - INFO - Received callback for node 69f7eb69559eef1735ba8021 INFO: 172.20.0.1:57274 - "POST /node/69f7eb69559eef1735ba8021 HTTP/1.0" 202 Accepted 2026-05-04 00:44:08,097 - lava_callback - INFO - Starting async job submit for node 69f7eb69559eef1735ba8021 2026-05-04 00:44:08,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:08,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb69559eef1735ba8021 HTTP/1.1" 200 None 2026-05-04 00:44:08,171 - lava_callback - DEBUG - Processing node 69f7eb69559eef1735ba8021: ltp-dio 2026-05-04 00:44:08,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:44:08,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:44:08,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69f7eb69559eef1735ba8021/log.txt.gz 2026-05-04 00:44:08,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:44:09,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:44:09,177 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69f7eb69559eef1735ba8021/lava-logs.yaml 2026-05-04 00:44:09,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:44:09,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:44:09,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69f7eb69559eef1735ba8021/lava_callback.json.gz 2026-05-04 00:44:09,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:09,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb69559eef1735ba8021 HTTP/1.1" 200 None 2026-05-04 00:44:09,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:09,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:44:09,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:09,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb69559eef1735ba8021 HTTP/1.1" 200 None 2026-05-04 00:44:09,397 - lava_callback - INFO - Completed processing callback for node 69f7eb69559eef1735ba8021 INFO: 172.20.0.1:57978 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 00:44:15,743 - lava_callback - INFO - Received callback for node 69f7ebcc559eef1735ba80d0 INFO: 172.20.0.1:57986 - "POST /node/69f7ebcc559eef1735ba80d0 HTTP/1.0" 202 Accepted 2026-05-04 00:44:15,749 - lava_callback - INFO - Starting async job submit for node 69f7ebcc559eef1735ba80d0 2026-05-04 00:44:15,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:15,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ebcc559eef1735ba80d0 HTTP/1.1" 200 None 2026-05-04 00:44:15,771 - lava_callback - DEBUG - Processing node 69f7ebcc559eef1735ba80d0: baseline-arm 2026-05-04 00:44:15,778 - lava_callback - WARNING - Failed to upload log 2026-05-04 00:44:15,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:44:15,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:44:15,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f7ebcc559eef1735ba80d0/lava-logs.yaml 2026-05-04 00:44:15,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:44:15,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:44:15,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f7ebcc559eef1735ba80d0/lava_callback.json.gz 2026-05-04 00:44:15,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:15,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ebcc559eef1735ba80d0 HTTP/1.1" 200 None 2026-05-04 00:44:15,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:15,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:44:15,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:16,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ebcc559eef1735ba80d0 HTTP/1.1" 200 None 2026-05-04 00:44:16,024 - lava_callback - INFO - Completed processing callback for node 69f7ebcc559eef1735ba80d0 INFO: 172.20.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36632 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:44:29,583 - lava_callback - INFO - Received callback for node 69f7ebd0559eef1735ba80d3 INFO: 172.20.0.1:36646 - "POST /node/69f7ebd0559eef1735ba80d3 HTTP/1.0" 202 Accepted 2026-05-04 00:44:29,590 - lava_callback - INFO - Starting async job submit for node 69f7ebd0559eef1735ba80d3 2026-05-04 00:44:29,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:29,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ebd0559eef1735ba80d3 HTTP/1.1" 200 None 2026-05-04 00:44:29,626 - lava_callback - DEBUG - Processing node 69f7ebd0559eef1735ba80d3: baseline-x86 2026-05-04 00:44:29,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:44:29,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:44:29,933 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd0559eef1735ba80d3/log.txt.gz 2026-05-04 00:44:30,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:44:30,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:44:30,232 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd0559eef1735ba80d3/lava-logs.yaml 2026-05-04 00:44:30,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:44:30,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:44:30,338 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd0559eef1735ba80d3/lava_callback.json.gz 2026-05-04 00:44:30,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:30,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ebd0559eef1735ba80d3 HTTP/1.1" 200 None 2026-05-04 00:44:30,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:30,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5de559eef1735ba5778 HTTP/1.1" 200 None 2026-05-04 00:44:30,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:30,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ebd0559eef1735ba80d3 HTTP/1.1" 200 None 2026-05-04 00:44:30,412 - lava_callback - INFO - Completed processing callback for node 69f7ebd0559eef1735ba80d3 2026-05-04 00:44:35,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:35,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58274 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:44:37,663 - lava_callback - INFO - Received callback for node 69f7ebd3559eef1735ba80dc INFO: 172.20.0.1:58278 - "POST /node/69f7ebd3559eef1735ba80dc HTTP/1.0" 202 Accepted 2026-05-04 00:44:37,670 - lava_callback - INFO - Starting async job submit for node 69f7ebd3559eef1735ba80dc 2026-05-04 00:44:37,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:37,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ebd3559eef1735ba80dc HTTP/1.1" 200 None 2026-05-04 00:44:37,713 - lava_callback - DEBUG - Processing node 69f7ebd3559eef1735ba80dc: baseline-x86 2026-05-04 00:44:37,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:44:38,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:44:38,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd3559eef1735ba80dc/log.txt.gz 2026-05-04 00:44:38,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:44:38,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:44:38,321 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd3559eef1735ba80dc/lava-logs.yaml 2026-05-04 00:44:38,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:44:38,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:44:38,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd3559eef1735ba80dc/lava_callback.json.gz 2026-05-04 00:44:38,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:38,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ebd3559eef1735ba80dc HTTP/1.1" 200 None 2026-05-04 00:44:38,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:38,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5de559eef1735ba5778 HTTP/1.1" 200 None 2026-05-04 00:44:38,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:38,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ebd3559eef1735ba80dc HTTP/1.1" 200 None 2026-05-04 00:44:38,608 - lava_callback - INFO - Completed processing callback for node 69f7ebd3559eef1735ba80dc INFO: 172.20.0.1:35074 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:44:47,094 - lava_callback - INFO - Received callback for node 69f548fded4ed40b022403ad INFO: 172.20.0.1:35078 - "POST /node/69f548fded4ed40b022403ad HTTP/1.0" 202 Accepted 2026-05-04 00:44:47,101 - lava_callback - INFO - Starting async job submit for node 69f548fded4ed40b022403ad 2026-05-04 00:44:47,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:47,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f548fded4ed40b022403ad HTTP/1.1" 200 None 2026-05-04 00:44:47,120 - lava_callback - DEBUG - Processing node 69f548fded4ed40b022403ad: baseline-arm64-baylibre 2026-05-04 00:44:47,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f548fded4ed40b022403ad 2026-05-04 00:44:47,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:47,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f548fded4ed40b022403ad HTTP/1.1" 200 None 2026-05-04 00:44:47,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:47,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:44:47,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:44:47,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f548fded4ed40b022403ad HTTP/1.1" 200 None 2026-05-04 00:44:47,171 - lava_callback - ERROR - Error processing callback for node 69f548fded4ed40b022403ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50752 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:45:05,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:45:05,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32856 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:46:17,971 - lava_callback - INFO - Received callback for node 69f7eb64559eef1735ba8018 INFO: 172.20.0.1:32868 - "POST /node/69f7eb64559eef1735ba8018 HTTP/1.0" 202 Accepted 2026-05-04 00:46:17,977 - lava_callback - INFO - Starting async job submit for node 69f7eb64559eef1735ba8018 2026-05-04 00:46:18,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:18,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb64559eef1735ba8018 HTTP/1.1" 200 None 2026-05-04 00:46:18,021 - lava_callback - DEBUG - Processing node 69f7eb64559eef1735ba8018: ltp-containers 2026-05-04 00:46:18,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:46:18,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:46:18,653 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69f7eb64559eef1735ba8018/log.txt.gz 2026-05-04 00:46:18,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:46:19,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:46:19,038 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69f7eb64559eef1735ba8018/lava-logs.yaml 2026-05-04 00:46:19,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:46:19,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:46:19,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69f7eb64559eef1735ba8018/lava_callback.json.gz 2026-05-04 00:46:19,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:19,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb64559eef1735ba8018 HTTP/1.1" 200 None 2026-05-04 00:46:19,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:19,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:46:19,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:19,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb64559eef1735ba8018 HTTP/1.1" 200 None 2026-05-04 00:46:19,285 - lava_callback - INFO - Completed processing callback for node 69f7eb64559eef1735ba8018 2026-05-04 00:46:19,584 - lava_callback - INFO - Received callback for node 69f7eb65559eef1735ba801b INFO: 172.20.0.1:32876 - "POST /node/69f7eb65559eef1735ba801b HTTP/1.0" 202 Accepted 2026-05-04 00:46:19,591 - lava_callback - INFO - Starting async job submit for node 69f7eb65559eef1735ba801b 2026-05-04 00:46:19,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:19,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb65559eef1735ba801b HTTP/1.1" 200 None 2026-05-04 00:46:19,633 - lava_callback - DEBUG - Processing node 69f7eb65559eef1735ba801b: ltp-controllers 2026-05-04 00:46:20,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:46:20,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:46:20,197 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69f7eb65559eef1735ba801b/log.txt.gz 2026-05-04 00:46:20,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:46:20,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:46:20,627 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69f7eb65559eef1735ba801b/lava-logs.yaml 2026-05-04 00:46:20,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:46:20,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:46:20,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69f7eb65559eef1735ba801b/lava_callback.json.gz 2026-05-04 00:46:20,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:20,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb65559eef1735ba801b HTTP/1.1" 200 None 2026-05-04 00:46:20,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:20,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:46:20,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:20,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb65559eef1735ba801b HTTP/1.1" 200 None 2026-05-04 00:46:20,830 - lava_callback - INFO - Completed processing callback for node 69f7eb65559eef1735ba801b 2026-05-04 00:46:24,790 - lava_callback - INFO - Received callback for node 69f5494ded4ed40b022403d0 INFO: 172.20.0.1:51372 - "POST /node/69f5494ded4ed40b022403d0 HTTP/1.0" 202 Accepted 2026-05-04 00:46:24,796 - lava_callback - INFO - Starting async job submit for node 69f5494ded4ed40b022403d0 2026-05-04 00:46:24,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:24,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5494ded4ed40b022403d0 HTTP/1.1" 200 None 2026-05-04 00:46:24,817 - lava_callback - DEBUG - Processing node 69f5494ded4ed40b022403d0: baseline-arm64-clabbe 2026-05-04 00:46:24,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5494ded4ed40b022403d0 2026-05-04 00:46:24,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:24,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5494ded4ed40b022403d0 HTTP/1.1" 200 None 2026-05-04 00:46:24,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:24,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:46:24,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:24,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5494ded4ed40b022403d0 HTTP/1.1" 200 None 2026-05-04 00:46:24,862 - lava_callback - ERROR - Error processing callback for node 69f5494ded4ed40b022403d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51374 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:46:35,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:35,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51088 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:46:38,179 - lava_callback - INFO - Received callback for node 69f7eb74559eef1735ba8039 INFO: 172.20.0.1:51102 - "POST /node/69f7eb74559eef1735ba8039 HTTP/1.0" 202 Accepted 2026-05-04 00:46:38,188 - lava_callback - INFO - Starting async job submit for node 69f7eb74559eef1735ba8039 2026-05-04 00:46:38,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:38,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb74559eef1735ba8039 HTTP/1.1" 200 None 2026-05-04 00:46:38,226 - lava_callback - DEBUG - Processing node 69f7eb74559eef1735ba8039: ltp-syscalls 2026-05-04 00:46:38,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:46:39,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:46:39,036 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69f7eb74559eef1735ba8039/log.txt.gz 2026-05-04 00:46:39,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:46:39,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:46:39,599 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69f7eb74559eef1735ba8039/lava-logs.yaml 2026-05-04 00:46:39,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:46:39,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:46:39,740 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69f7eb74559eef1735ba8039/lava_callback.json.gz 2026-05-04 00:46:39,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:39,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb74559eef1735ba8039 HTTP/1.1" 200 None 2026-05-04 00:46:39,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:39,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:46:39,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:39,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb74559eef1735ba8039 HTTP/1.1" 200 None 2026-05-04 00:46:39,814 - lava_callback - INFO - Completed processing callback for node 69f7eb74559eef1735ba8039 INFO: 172.20.0.1:38354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49344 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:46:58,136 - lava_callback - INFO - Received callback for node 69f7eb62559eef1735ba8015 INFO: 172.20.0.1:49352 - "POST /node/69f7eb62559eef1735ba8015 HTTP/1.0" 202 Accepted 2026-05-04 00:46:58,143 - lava_callback - INFO - Starting async job submit for node 69f7eb62559eef1735ba8015 2026-05-04 00:46:58,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:58,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb62559eef1735ba8015 HTTP/1.1" 200 None 2026-05-04 00:46:58,182 - lava_callback - DEBUG - Processing node 69f7eb62559eef1735ba8015: ltp-cap_bounds 2026-05-04 00:46:58,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:46:58,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:46:58,672 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69f7eb62559eef1735ba8015/log.txt.gz 2026-05-04 00:46:58,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:46:59,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:46:59,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69f7eb62559eef1735ba8015/lava-logs.yaml 2026-05-04 00:46:59,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:46:59,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:46:59,169 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69f7eb62559eef1735ba8015/lava_callback.json.gz 2026-05-04 00:46:59,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:59,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb62559eef1735ba8015 HTTP/1.1" 200 None 2026-05-04 00:46:59,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:59,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:46:59,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:46:59,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb62559eef1735ba8015 HTTP/1.1" 200 None 2026-05-04 00:46:59,242 - lava_callback - INFO - Completed processing callback for node 69f7eb62559eef1735ba8015 2026-05-04 00:47:05,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:47:05,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35852 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:47:26,934 - lava_callback - INFO - Received callback for node 69f54995ed4ed40b022403f9 INFO: 172.20.0.1:35856 - "POST /node/69f54995ed4ed40b022403f9 HTTP/1.0" 202 Accepted 2026-05-04 00:47:26,940 - lava_callback - INFO - Starting async job submit for node 69f54995ed4ed40b022403f9 2026-05-04 00:47:26,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:47:26,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54995ed4ed40b022403f9 HTTP/1.1" 200 None 2026-05-04 00:47:26,954 - lava_callback - DEBUG - Processing node 69f54995ed4ed40b022403f9: baseline-arm64-baylibre 2026-05-04 00:47:26,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54995ed4ed40b022403f9 2026-05-04 00:47:26,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:47:26,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54995ed4ed40b022403f9 HTTP/1.1" 200 None 2026-05-04 00:47:26,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:47:26,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:47:26,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:47:26,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54995ed4ed40b022403f9 HTTP/1.1" 200 None 2026-05-04 00:47:26,999 - lava_callback - ERROR - Error processing callback for node 69f54995ed4ed40b022403f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:47:31,390 - lava_callback - INFO - Received callback for node 69f7eb67559eef1735ba801e INFO: 172.20.0.1:43234 - "POST /node/69f7eb67559eef1735ba801e HTTP/1.0" 202 Accepted 2026-05-04 00:47:31,396 - lava_callback - INFO - Starting async job submit for node 69f7eb67559eef1735ba801e 2026-05-04 00:47:31,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:47:31,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb67559eef1735ba801e HTTP/1.1" 200 None 2026-05-04 00:47:31,435 - lava_callback - DEBUG - Processing node 69f7eb67559eef1735ba801e: ltp-cve 2026-05-04 00:47:31,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:47:31,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:47:31,933 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69f7eb67559eef1735ba801e/log.txt.gz 2026-05-04 00:47:32,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:47:32,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:47:32,344 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69f7eb67559eef1735ba801e/lava-logs.yaml 2026-05-04 00:47:32,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:47:32,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:47:32,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69f7eb67559eef1735ba801e/lava_callback.json.gz 2026-05-04 00:47:32,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:47:32,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb67559eef1735ba801e HTTP/1.1" 200 None 2026-05-04 00:47:32,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:47:32,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:47:32,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:47:32,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb67559eef1735ba801e HTTP/1.1" 200 None 2026-05-04 00:47:32,575 - lava_callback - INFO - Completed processing callback for node 69f7eb67559eef1735ba801e 2026-05-04 00:47:35,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:47:35,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60942 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:48:47,022 - lava_callback - INFO - Received callback for node 69f549e3ed4ed40b0224043d INFO: 172.20.0.1:60954 - "POST /node/69f549e3ed4ed40b0224043d HTTP/1.0" 202 Accepted 2026-05-04 00:48:47,027 - lava_callback - INFO - Starting async job submit for node 69f549e3ed4ed40b0224043d 2026-05-04 00:48:47,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:47,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549e3ed4ed40b0224043d HTTP/1.1" 200 None 2026-05-04 00:48:47,042 - lava_callback - DEBUG - Processing node 69f549e3ed4ed40b0224043d: baseline-arm-baylibre 2026-05-04 00:48:47,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f549e3ed4ed40b0224043d 2026-05-04 00:48:47,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:47,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549e3ed4ed40b0224043d HTTP/1.1" 200 None 2026-05-04 00:48:47,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:47,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 00:48:47,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:47,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f549e3ed4ed40b0224043d HTTP/1.1" 200 None 2026-05-04 00:48:47,095 - lava_callback - ERROR - Error processing callback for node 69f549e3ed4ed40b0224043d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:48:47,686 - lava_callback - INFO - Received callback for node 69f549e4ed4ed40b02240440 INFO: 172.20.0.1:60968 - "POST /node/69f549e4ed4ed40b02240440 HTTP/1.0" 202 Accepted 2026-05-04 00:48:47,692 - lava_callback - INFO - Starting async job submit for node 69f549e4ed4ed40b02240440 2026-05-04 00:48:47,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:47,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549e4ed4ed40b02240440 HTTP/1.1" 200 None 2026-05-04 00:48:47,706 - lava_callback - DEBUG - Processing node 69f549e4ed4ed40b02240440: baseline-arm-baylibre 2026-05-04 00:48:47,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f549e4ed4ed40b02240440 2026-05-04 00:48:47,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:47,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549e4ed4ed40b02240440 HTTP/1.1" 200 None 2026-05-04 00:48:47,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:47,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 00:48:47,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:47,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f549e4ed4ed40b02240440 HTTP/1.1" 200 None 2026-05-04 00:48:47,752 - lava_callback - ERROR - Error processing callback for node 69f549e4ed4ed40b02240440: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:48:48,351 - lava_callback - INFO - Received callback for node 69f549e1ed4ed40b0224043a INFO: 172.20.0.1:60984 - "POST /node/69f549e1ed4ed40b0224043a HTTP/1.0" 202 Accepted 2026-05-04 00:48:48,359 - lava_callback - INFO - Starting async job submit for node 69f549e1ed4ed40b0224043a 2026-05-04 00:48:48,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:48,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549e1ed4ed40b0224043a HTTP/1.1" 200 None 2026-05-04 00:48:48,376 - lava_callback - DEBUG - Processing node 69f549e1ed4ed40b0224043a: baseline-arm64-baylibre 2026-05-04 00:48:48,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f549e1ed4ed40b0224043a 2026-05-04 00:48:48,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:48,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549e1ed4ed40b0224043a HTTP/1.1" 200 None 2026-05-04 00:48:48,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:48,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:48:48,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:48,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f549e1ed4ed40b0224043a HTTP/1.1" 200 None 2026-05-04 00:48:48,422 - lava_callback - ERROR - Error processing callback for node 69f549e1ed4ed40b0224043a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:48:49,009 - lava_callback - INFO - Received callback for node 69f549e7ed4ed40b0224044d INFO: 172.20.0.1:60994 - "POST /node/69f549e7ed4ed40b0224044d HTTP/1.0" 202 Accepted 2026-05-04 00:48:49,014 - lava_callback - INFO - Starting async job submit for node 69f549e7ed4ed40b0224044d 2026-05-04 00:48:49,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:49,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549e7ed4ed40b0224044d HTTP/1.1" 200 None 2026-05-04 00:48:49,032 - lava_callback - DEBUG - Processing node 69f549e7ed4ed40b0224044d: baseline-arm-baylibre 2026-05-04 00:48:49,032 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f549e7ed4ed40b0224044d 2026-05-04 00:48:49,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:49,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549e7ed4ed40b0224044d HTTP/1.1" 200 None 2026-05-04 00:48:49,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:49,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 00:48:49,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:49,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f549e7ed4ed40b0224044d HTTP/1.1" 200 None 2026-05-04 00:48:49,080 - lava_callback - ERROR - Error processing callback for node 69f549e7ed4ed40b0224044d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:48:49,649 - lava_callback - INFO - Received callback for node 69f549e8ed4ed40b02240471 INFO: 172.20.0.1:32778 - "POST /node/69f549e8ed4ed40b02240471 HTTP/1.0" 202 Accepted 2026-05-04 00:48:49,654 - lava_callback - INFO - Starting async job submit for node 69f549e8ed4ed40b02240471 2026-05-04 00:48:49,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:49,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549e8ed4ed40b02240471 HTTP/1.1" 200 None 2026-05-04 00:48:49,670 - lava_callback - DEBUG - Processing node 69f549e8ed4ed40b02240471: baseline-arm-baylibre 2026-05-04 00:48:49,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f549e8ed4ed40b02240471 2026-05-04 00:48:49,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:49,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549e8ed4ed40b02240471 HTTP/1.1" 200 None 2026-05-04 00:48:49,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:49,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 00:48:49,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:48:49,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f549e8ed4ed40b02240471 HTTP/1.1" 200 None 2026-05-04 00:48:49,725 - lava_callback - ERROR - Error processing callback for node 69f549e8ed4ed40b02240471: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57474 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:49:05,084 - lava_callback - INFO - Received callback for node 69f549efed4ed40b02240488 INFO: 172.20.0.1:60852 - "POST /node/69f549efed4ed40b02240488 HTTP/1.0" 202 Accepted 2026-05-04 00:49:05,089 - lava_callback - INFO - Starting async job submit for node 69f549efed4ed40b02240488 2026-05-04 00:49:05,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:05,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549efed4ed40b02240488 HTTP/1.1" 200 None 2026-05-04 00:49:05,104 - lava_callback - DEBUG - Processing node 69f549efed4ed40b02240488: baseline-arm-clabbe 2026-05-04 00:49:05,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f549efed4ed40b02240488 2026-05-04 00:49:05,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:05,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549efed4ed40b02240488 HTTP/1.1" 200 None 2026-05-04 00:49:05,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:05,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 00:49:05,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:05,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f549efed4ed40b02240488 HTTP/1.1" 200 None 2026-05-04 00:49:05,153 - lava_callback - ERROR - Error processing callback for node 69f549efed4ed40b02240488: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:49:05,768 - lava_callback - INFO - Received callback for node 69f549f3ed4ed40b02240495 INFO: 172.20.0.1:60862 - "POST /node/69f549f3ed4ed40b02240495 HTTP/1.0" 202 Accepted 2026-05-04 00:49:05,774 - lava_callback - INFO - Starting async job submit for node 69f549f3ed4ed40b02240495 2026-05-04 00:49:05,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:05,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549f3ed4ed40b02240495 HTTP/1.1" 200 None 2026-05-04 00:49:05,793 - lava_callback - DEBUG - Processing node 69f549f3ed4ed40b02240495: baseline-arm-clabbe 2026-05-04 00:49:05,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f549f3ed4ed40b02240495 2026-05-04 00:49:05,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:05,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549f3ed4ed40b02240495 HTTP/1.1" 200 None 2026-05-04 00:49:05,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:05,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 00:49:05,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:05,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f549f3ed4ed40b02240495 HTTP/1.1" 200 None 2026-05-04 00:49:05,840 - lava_callback - ERROR - Error processing callback for node 69f549f3ed4ed40b02240495: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60876 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:49:06,695 - lava_callback - INFO - Received callback for node 69f549f3ed4ed40b02240498 INFO: 172.20.0.1:60886 - "POST /node/69f549f3ed4ed40b02240498 HTTP/1.0" 202 Accepted 2026-05-04 00:49:06,700 - lava_callback - INFO - Starting async job submit for node 69f549f3ed4ed40b02240498 2026-05-04 00:49:06,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:06,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549f3ed4ed40b02240498 HTTP/1.1" 200 None 2026-05-04 00:49:06,736 - lava_callback - DEBUG - Processing node 69f549f3ed4ed40b02240498: baseline-arm-clabbe 2026-05-04 00:49:06,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f549f3ed4ed40b02240498 2026-05-04 00:49:06,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:06,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549f3ed4ed40b02240498 HTTP/1.1" 200 None 2026-05-04 00:49:06,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:06,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 00:49:06,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:06,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f549f3ed4ed40b02240498 HTTP/1.1" 200 None 2026-05-04 00:49:06,870 - lava_callback - ERROR - Error processing callback for node 69f549f3ed4ed40b02240498: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:49:07,393 - lava_callback - INFO - Received callback for node 69f549f4ed4ed40b0224049c INFO: 172.20.0.1:60888 - "POST /node/69f549f4ed4ed40b0224049c HTTP/1.0" 202 Accepted 2026-05-04 00:49:07,399 - lava_callback - INFO - Starting async job submit for node 69f549f4ed4ed40b0224049c 2026-05-04 00:49:07,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:07,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549f4ed4ed40b0224049c HTTP/1.1" 200 None 2026-05-04 00:49:07,420 - lava_callback - DEBUG - Processing node 69f549f4ed4ed40b0224049c: baseline-arm-clabbe 2026-05-04 00:49:07,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f549f4ed4ed40b0224049c 2026-05-04 00:49:07,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:07,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549f4ed4ed40b0224049c HTTP/1.1" 200 None 2026-05-04 00:49:07,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:07,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 00:49:07,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:07,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f549f4ed4ed40b0224049c HTTP/1.1" 200 None 2026-05-04 00:49:07,476 - lava_callback - ERROR - Error processing callback for node 69f549f4ed4ed40b0224049c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:49:08,083 - lava_callback - INFO - Received callback for node 69f549f6ed4ed40b022404a5 INFO: 172.20.0.1:60894 - "POST /node/69f549f6ed4ed40b022404a5 HTTP/1.0" 202 Accepted 2026-05-04 00:49:08,088 - lava_callback - INFO - Starting async job submit for node 69f549f6ed4ed40b022404a5 2026-05-04 00:49:08,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:08,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549f6ed4ed40b022404a5 HTTP/1.1" 200 None 2026-05-04 00:49:08,106 - lava_callback - DEBUG - Processing node 69f549f6ed4ed40b022404a5: baseline-arm-clabbe 2026-05-04 00:49:08,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f549f6ed4ed40b022404a5 2026-05-04 00:49:08,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:08,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f549f6ed4ed40b022404a5 HTTP/1.1" 200 None 2026-05-04 00:49:08,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:08,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 00:49:08,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:08,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f549f6ed4ed40b022404a5 HTTP/1.1" 200 None 2026-05-04 00:49:08,152 - lava_callback - ERROR - Error processing callback for node 69f549f6ed4ed40b022404a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58970 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 00:49:15,462 - lava_callback - INFO - Received callback for node 69f7eb48559eef1735ba7fc6 INFO: 172.20.0.1:58986 - "POST /node/69f7eb48559eef1735ba7fc6 HTTP/1.0" 202 Accepted 2026-05-04 00:49:15,509 - lava_callback - INFO - Starting async job submit for node 69f7eb48559eef1735ba7fc6 2026-05-04 00:49:15,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:15,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb48559eef1735ba7fc6 HTTP/1.1" 200 None 2026-05-04 00:49:15,572 - lava_callback - DEBUG - Processing node 69f7eb48559eef1735ba7fc6: baseline-arm-clabbe 2026-05-04 00:49:15,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:49:15,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:49:15,785 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f7eb48559eef1735ba7fc6/log.txt.gz 2026-05-04 00:49:15,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:49:16,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:49:16,020 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f7eb48559eef1735ba7fc6/lava-logs.yaml 2026-05-04 00:49:16,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:49:16,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:49:16,280 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f7eb48559eef1735ba7fc6/lava_callback.json.gz 2026-05-04 00:49:16,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:16,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb48559eef1735ba7fc6 HTTP/1.1" 200 None 2026-05-04 00:49:16,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:16,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:49:16,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:16,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb48559eef1735ba7fc6 HTTP/1.1" 200 None 2026-05-04 00:49:16,432 - lava_callback - INFO - Completed processing callback for node 69f7eb48559eef1735ba7fc6 INFO: 172.20.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59454 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:49:35,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:35,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55428 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:49:51,225 - lava_callback - INFO - Received callback for node 69f7e890559eef1735ba7f1e INFO: 172.20.0.1:53538 - "POST /node/69f7e890559eef1735ba7f1e HTTP/1.0" 202 Accepted 2026-05-04 00:49:51,243 - lava_callback - INFO - Starting async job submit for node 69f7e890559eef1735ba7f1e 2026-05-04 00:49:51,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:51,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e890559eef1735ba7f1e HTTP/1.1" 200 None 2026-05-04 00:49:51,390 - lava_callback - DEBUG - Processing node 69f7e890559eef1735ba7f1e: ltp-smoke 2026-05-04 00:49:52,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:49:52,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:49:52,483 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7e890559eef1735ba7f1e/log.txt.gz 2026-05-04 00:49:53,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:49:53,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:49:53,275 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7e890559eef1735ba7f1e/lava-logs.yaml 2026-05-04 00:49:53,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:49:53,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:49:53,461 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7e890559eef1735ba7f1e/lava_callback.json.gz 2026-05-04 00:49:53,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:53,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e890559eef1735ba7f1e HTTP/1.1" 200 None 2026-05-04 00:49:53,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:53,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5be559eef1735ba573d HTTP/1.1" 200 None 2026-05-04 00:49:53,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:49:53,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e890559eef1735ba7f1e HTTP/1.1" 200 None 2026-05-04 00:49:53,930 - lava_callback - INFO - Completed processing callback for node 69f7e890559eef1735ba7f1e INFO: 172.20.0.1:53546 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:50:05,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:05,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59718 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 00:50:15,854 - lava_callback - INFO - Received callback for node 69f7ed2f559eef1735ba81b0 INFO: 172.20.0.1:59730 - "POST /node/69f7ed2f559eef1735ba81b0 HTTP/1.0" 202 Accepted 2026-05-04 00:50:15,860 - lava_callback - INFO - Starting async job submit for node 69f7ed2f559eef1735ba81b0 2026-05-04 00:50:15,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:15,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ed2f559eef1735ba81b0 HTTP/1.1" 200 None 2026-05-04 00:50:15,878 - lava_callback - DEBUG - Processing node 69f7ed2f559eef1735ba81b0: baseline-arm 2026-05-04 00:50:15,883 - lava_callback - WARNING - Failed to upload log 2026-05-04 00:50:15,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:50:15,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:50:15,965 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f7ed2f559eef1735ba81b0/lava-logs.yaml 2026-05-04 00:50:15,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:50:16,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:50:16,049 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f7ed2f559eef1735ba81b0/lava_callback.json.gz 2026-05-04 00:50:16,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:16,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ed2f559eef1735ba81b0 HTTP/1.1" 200 None 2026-05-04 00:50:16,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:16,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:50:16,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:16,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ed2f559eef1735ba81b0 HTTP/1.1" 200 None 2026-05-04 00:50:16,116 - lava_callback - INFO - Completed processing callback for node 69f7ed2f559eef1735ba81b0 INFO: 172.20.0.1:59736 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:50:18,100 - lava_callback - INFO - Received callback for node 69f7eb6a559eef1735ba8024 INFO: 172.20.0.1:59746 - "POST /node/69f7eb6a559eef1735ba8024 HTTP/1.0" 202 Accepted 2026-05-04 00:50:18,106 - lava_callback - INFO - Starting async job submit for node 69f7eb6a559eef1735ba8024 2026-05-04 00:50:18,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:18,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb6a559eef1735ba8024 HTTP/1.1" 200 None 2026-05-04 00:50:18,146 - lava_callback - DEBUG - Processing node 69f7eb6a559eef1735ba8024: ltp-fs_bind 2026-05-04 00:50:18,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:50:18,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:50:18,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69f7eb6a559eef1735ba8024/log.txt.gz 2026-05-04 00:50:18,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:50:19,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:50:19,020 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69f7eb6a559eef1735ba8024/lava-logs.yaml 2026-05-04 00:50:19,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:50:19,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:50:19,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69f7eb6a559eef1735ba8024/lava_callback.json.gz 2026-05-04 00:50:19,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:19,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb6a559eef1735ba8024 HTTP/1.1" 200 None 2026-05-04 00:50:19,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:19,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:50:19,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:19,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb6a559eef1735ba8024 HTTP/1.1" 200 None 2026-05-04 00:50:19,236 - lava_callback - INFO - Completed processing callback for node 69f7eb6a559eef1735ba8024 INFO: 172.20.0.1:55498 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:50:35,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:35,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50028 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:50:38,333 - lava_callback - INFO - Received callback for node 69f7eb6b559eef1735ba8027 INFO: 172.20.0.1:50034 - "POST /node/69f7eb6b559eef1735ba8027 HTTP/1.0" 202 Accepted 2026-05-04 00:50:38,339 - lava_callback - INFO - Starting async job submit for node 69f7eb6b559eef1735ba8027 2026-05-04 00:50:38,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:38,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb6b559eef1735ba8027 HTTP/1.1" 200 None 2026-05-04 00:50:38,379 - lava_callback - DEBUG - Processing node 69f7eb6b559eef1735ba8027: ltp-fsx 2026-05-04 00:50:38,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:50:39,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:50:39,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69f7eb6b559eef1735ba8027/log.txt.gz 2026-05-04 00:50:39,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:50:39,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:50:39,501 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69f7eb6b559eef1735ba8027/lava-logs.yaml 2026-05-04 00:50:39,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:50:39,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:50:39,626 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69f7eb6b559eef1735ba8027/lava_callback.json.gz 2026-05-04 00:50:39,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:39,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb6b559eef1735ba8027 HTTP/1.1" 200 None 2026-05-04 00:50:39,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:39,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:50:39,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:50:39,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb6b559eef1735ba8027 HTTP/1.1" 200 None 2026-05-04 00:50:39,702 - lava_callback - INFO - Completed processing callback for node 69f7eb6b559eef1735ba8027 INFO: 172.20.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48670 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:51:05,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:05,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56578 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:51:06,325 - lava_callback - INFO - Received callback for node 69f7ebd1559eef1735ba80d6 INFO: 172.20.0.1:56580 - "POST /node/69f7ebd1559eef1735ba80d6 HTTP/1.0" 202 Accepted 2026-05-04 00:51:06,332 - lava_callback - INFO - Starting async job submit for node 69f7ebd1559eef1735ba80d6 2026-05-04 00:51:06,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:06,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ebd1559eef1735ba80d6 HTTP/1.1" 200 None 2026-05-04 00:51:06,376 - lava_callback - DEBUG - Processing node 69f7ebd1559eef1735ba80d6: baseline-x86 INFO: 172.20.0.1:56590 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:51:06,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:51:06,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:51:06,810 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd1559eef1735ba80d6/log.txt.gz 2026-05-04 00:51:07,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:51:07,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:51:07,250 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd1559eef1735ba80d6/lava-logs.yaml 2026-05-04 00:51:07,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:51:07,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:51:07,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd1559eef1735ba80d6/lava_callback.json.gz 2026-05-04 00:51:07,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:07,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ebd1559eef1735ba80d6 HTTP/1.1" 200 None 2026-05-04 00:51:07,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:07,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5de559eef1735ba5778 HTTP/1.1" 200 None 2026-05-04 00:51:07,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:07,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ebd1559eef1735ba80d6 HTTP/1.1" 200 None 2026-05-04 00:51:07,480 - lava_callback - INFO - Completed processing callback for node 69f7ebd1559eef1735ba80d6 INFO: 172.20.0.1:54724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59112 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:51:31,479 - lava_callback - INFO - Received callback for node 69f7eb6e559eef1735ba802d INFO: 172.20.0.1:37998 - "POST /node/69f7eb6e559eef1735ba802d HTTP/1.0" 202 Accepted 2026-05-04 00:51:31,486 - lava_callback - INFO - Starting async job submit for node 69f7eb6e559eef1735ba802d 2026-05-04 00:51:31,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:31,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb6e559eef1735ba802d HTTP/1.1" 200 None 2026-05-04 00:51:31,544 - lava_callback - DEBUG - Processing node 69f7eb6e559eef1735ba802d: ltp-ipc 2026-05-04 00:51:31,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:51:31,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:51:31,989 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69f7eb6e559eef1735ba802d/log.txt.gz 2026-05-04 00:51:32,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:51:32,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:51:32,398 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69f7eb6e559eef1735ba802d/lava-logs.yaml 2026-05-04 00:51:32,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:51:32,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:51:32,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69f7eb6e559eef1735ba802d/lava_callback.json.gz 2026-05-04 00:51:32,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:32,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb6e559eef1735ba802d HTTP/1.1" 200 None 2026-05-04 00:51:32,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:32,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:51:32,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:32,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb6e559eef1735ba802d HTTP/1.1" 200 None 2026-05-04 00:51:32,591 - lava_callback - INFO - Completed processing callback for node 69f7eb6e559eef1735ba802d 2026-05-04 00:51:35,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:35,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38012 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:51:38,121 - lava_callback - INFO - Received callback for node 69f7eb6d559eef1735ba802a INFO: 172.20.0.1:38028 - "POST /node/69f7eb6d559eef1735ba802a HTTP/1.0" 202 Accepted 2026-05-04 00:51:38,127 - lava_callback - INFO - Starting async job submit for node 69f7eb6d559eef1735ba802a 2026-05-04 00:51:38,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:38,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb6d559eef1735ba802a HTTP/1.1" 200 None 2026-05-04 00:51:38,200 - lava_callback - DEBUG - Processing node 69f7eb6d559eef1735ba802a: ltp-input 2026-05-04 00:51:38,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:51:38,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:51:38,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69f7eb6d559eef1735ba802a/log.txt.gz 2026-05-04 00:51:38,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:51:39,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:51:39,129 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69f7eb6d559eef1735ba802a/lava-logs.yaml 2026-05-04 00:51:39,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:51:39,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:51:39,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69f7eb6d559eef1735ba802a/lava_callback.json.gz 2026-05-04 00:51:39,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:39,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb6d559eef1735ba802a HTTP/1.1" 200 None 2026-05-04 00:51:39,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:39,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:51:39,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:51:39,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb6d559eef1735ba802a HTTP/1.1" 200 None 2026-05-04 00:51:39,367 - lava_callback - INFO - Completed processing callback for node 69f7eb6d559eef1735ba802a INFO: 172.20.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34042 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:52:05,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:52:05,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52292 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:53:45,168 - lava_callback - INFO - Received callback for node 69f54b14ed4ed40b0224064c INFO: 172.20.0.1:59426 - "POST /node/69f54b14ed4ed40b0224064c HTTP/1.0" 202 Accepted 2026-05-04 00:53:45,173 - lava_callback - INFO - Starting async job submit for node 69f54b14ed4ed40b0224064c 2026-05-04 00:53:45,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:53:45,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54b14ed4ed40b0224064c HTTP/1.1" 200 None 2026-05-04 00:53:45,194 - lava_callback - DEBUG - Processing node 69f54b14ed4ed40b0224064c: baseline-arm64-clabbe 2026-05-04 00:53:45,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54b14ed4ed40b0224064c 2026-05-04 00:53:45,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:53:45,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54b14ed4ed40b0224064c HTTP/1.1" 200 None 2026-05-04 00:53:45,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:53:45,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 00:53:45,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:53:45,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54b14ed4ed40b0224064c HTTP/1.1" 200 None 2026-05-04 00:53:45,240 - lava_callback - ERROR - Error processing callback for node 69f54b14ed4ed40b0224064c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60944 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:54:18,300 - lava_callback - INFO - Received callback for node 69f7eb6f559eef1735ba8030 INFO: 172.20.0.1:60950 - "POST /node/69f7eb6f559eef1735ba8030 HTTP/1.0" 202 Accepted 2026-05-04 00:54:18,311 - lava_callback - INFO - Starting async job submit for node 69f7eb6f559eef1735ba8030 2026-05-04 00:54:18,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:54:18,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb6f559eef1735ba8030 HTTP/1.1" 200 None 2026-05-04 00:54:18,388 - lava_callback - DEBUG - Processing node 69f7eb6f559eef1735ba8030: ltp-pty 2026-05-04 00:54:18,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:54:18,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:54:18,839 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69f7eb6f559eef1735ba8030/log.txt.gz 2026-05-04 00:54:19,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:54:19,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:54:19,219 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69f7eb6f559eef1735ba8030/lava-logs.yaml 2026-05-04 00:54:19,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:54:19,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:54:19,349 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69f7eb6f559eef1735ba8030/lava_callback.json.gz 2026-05-04 00:54:19,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:54:19,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb6f559eef1735ba8030 HTTP/1.1" 200 None 2026-05-04 00:54:19,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:54:19,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:54:19,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:54:19,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb6f559eef1735ba8030 HTTP/1.1" 200 None 2026-05-04 00:54:19,424 - lava_callback - INFO - Completed processing callback for node 69f7eb6f559eef1735ba8030 INFO: 172.20.0.1:34840 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:54:35,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:54:35,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51788 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:54:38,659 - lava_callback - INFO - Received callback for node 69f7eb71559eef1735ba8033 INFO: 172.20.0.1:51792 - "POST /node/69f7eb71559eef1735ba8033 HTTP/1.0" 202 Accepted 2026-05-04 00:54:38,668 - lava_callback - INFO - Starting async job submit for node 69f7eb71559eef1735ba8033 2026-05-04 00:54:38,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:54:38,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb71559eef1735ba8033 HTTP/1.1" 200 None 2026-05-04 00:54:38,725 - lava_callback - DEBUG - Processing node 69f7eb71559eef1735ba8033: ltp-sched 2026-05-04 00:54:39,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:54:39,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:54:39,242 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69f7eb71559eef1735ba8033/log.txt.gz 2026-05-04 00:54:39,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:54:39,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:54:39,608 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69f7eb71559eef1735ba8033/lava-logs.yaml 2026-05-04 00:54:39,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:54:39,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:54:39,739 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69f7eb71559eef1735ba8033/lava_callback.json.gz 2026-05-04 00:54:39,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:54:39,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb71559eef1735ba8033 HTTP/1.1" 200 None 2026-05-04 00:54:39,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:54:39,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:54:39,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:54:39,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb71559eef1735ba8033 HTTP/1.1" 200 None 2026-05-04 00:54:39,843 - lava_callback - INFO - Completed processing callback for node 69f7eb71559eef1735ba8033 INFO: 172.20.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46464 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:55:05,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:55:05,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34068 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:55:52,998 - lava_callback - INFO - Received callback for node 69f7eb72559eef1735ba8036 INFO: 172.20.0.1:53816 - "POST /node/69f7eb72559eef1735ba8036 HTTP/1.0" 202 Accepted 2026-05-04 00:55:53,006 - lava_callback - INFO - Starting async job submit for node 69f7eb72559eef1735ba8036 2026-05-04 00:55:53,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:55:53,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb72559eef1735ba8036 HTTP/1.1" 200 None 2026-05-04 00:55:53,046 - lava_callback - DEBUG - Processing node 69f7eb72559eef1735ba8036: ltp-smoke 2026-05-04 00:55:53,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:55:53,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:55:53,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7eb72559eef1735ba8036/log.txt.gz 2026-05-04 00:55:53,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:55:54,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:55:54,097 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7eb72559eef1735ba8036/lava-logs.yaml 2026-05-04 00:55:54,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:55:54,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:55:54,266 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7eb72559eef1735ba8036/lava_callback.json.gz 2026-05-04 00:55:54,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:55:54,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb72559eef1735ba8036 HTTP/1.1" 200 None 2026-05-04 00:55:54,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:55:54,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:55:54,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:55:54,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb72559eef1735ba8036 HTTP/1.1" 200 None 2026-05-04 00:55:54,390 - lava_callback - INFO - Completed processing callback for node 69f7eb72559eef1735ba8036 INFO: 172.20.0.1:53818 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:56:05,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:56:05,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60704 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:57:47,483 - lava_callback - INFO - Received callback for node 69f54c02ed4ed40b02240774 INFO: 172.20.0.1:60714 - "POST /node/69f54c02ed4ed40b02240774 HTTP/1.0" 202 Accepted 2026-05-04 00:57:47,488 - lava_callback - INFO - Starting async job submit for node 69f54c02ed4ed40b02240774 2026-05-04 00:57:47,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:47,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c02ed4ed40b02240774 HTTP/1.1" 200 None 2026-05-04 00:57:47,506 - lava_callback - DEBUG - Processing node 69f54c02ed4ed40b02240774: baseline-arm64-baylibre 2026-05-04 00:57:47,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54c02ed4ed40b02240774 2026-05-04 00:57:47,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:47,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c02ed4ed40b02240774 HTTP/1.1" 200 None 2026-05-04 00:57:47,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:47,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 00:57:47,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:47,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54c02ed4ed40b02240774 HTTP/1.1" 200 None 2026-05-04 00:57:47,553 - lava_callback - ERROR - Error processing callback for node 69f54c02ed4ed40b02240774: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:57:48,127 - lava_callback - INFO - Received callback for node 69f54c04ed4ed40b02240777 INFO: 172.20.0.1:60718 - "POST /node/69f54c04ed4ed40b02240777 HTTP/1.0" 202 Accepted 2026-05-04 00:57:48,132 - lava_callback - INFO - Starting async job submit for node 69f54c04ed4ed40b02240777 2026-05-04 00:57:48,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:48,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c04ed4ed40b02240777 HTTP/1.1" 200 None 2026-05-04 00:57:48,147 - lava_callback - DEBUG - Processing node 69f54c04ed4ed40b02240777: baseline-arm64-baylibre 2026-05-04 00:57:48,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54c04ed4ed40b02240777 2026-05-04 00:57:48,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:48,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c04ed4ed40b02240777 HTTP/1.1" 200 None 2026-05-04 00:57:48,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:48,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 00:57:48,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:48,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54c04ed4ed40b02240777 HTTP/1.1" 200 None 2026-05-04 00:57:48,192 - lava_callback - ERROR - Error processing callback for node 69f54c04ed4ed40b02240777: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:57:48,799 - lava_callback - INFO - Received callback for node 69f54c05ed4ed40b0224079e INFO: 172.20.0.1:60726 - "POST /node/69f54c05ed4ed40b0224079e HTTP/1.0" 202 Accepted 2026-05-04 00:57:48,804 - lava_callback - INFO - Starting async job submit for node 69f54c05ed4ed40b0224079e 2026-05-04 00:57:48,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:48,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c05ed4ed40b0224079e HTTP/1.1" 200 None 2026-05-04 00:57:48,820 - lava_callback - DEBUG - Processing node 69f54c05ed4ed40b0224079e: baseline-arm64-baylibre 2026-05-04 00:57:48,820 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54c05ed4ed40b0224079e 2026-05-04 00:57:48,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:48,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c05ed4ed40b0224079e HTTP/1.1" 200 None 2026-05-04 00:57:48,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:48,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 00:57:48,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:48,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54c05ed4ed40b0224079e HTTP/1.1" 200 None 2026-05-04 00:57:48,881 - lava_callback - ERROR - Error processing callback for node 69f54c05ed4ed40b0224079e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:57:49,487 - lava_callback - INFO - Received callback for node 69f54c07ed4ed40b022407a5 INFO: 172.20.0.1:60730 - "POST /node/69f54c07ed4ed40b022407a5 HTTP/1.0" 202 Accepted 2026-05-04 00:57:49,492 - lava_callback - INFO - Starting async job submit for node 69f54c07ed4ed40b022407a5 2026-05-04 00:57:49,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:49,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c07ed4ed40b022407a5 HTTP/1.1" 200 None 2026-05-04 00:57:49,508 - lava_callback - DEBUG - Processing node 69f54c07ed4ed40b022407a5: baseline-arm64-baylibre 2026-05-04 00:57:49,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54c07ed4ed40b022407a5 2026-05-04 00:57:49,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:49,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c07ed4ed40b022407a5 HTTP/1.1" 200 None 2026-05-04 00:57:49,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:49,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 00:57:49,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:49,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54c07ed4ed40b022407a5 HTTP/1.1" 200 None 2026-05-04 00:57:49,563 - lava_callback - ERROR - Error processing callback for node 69f54c07ed4ed40b022407a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:57:50,180 - lava_callback - INFO - Received callback for node 69f54c08ed4ed40b022407aa INFO: 172.20.0.1:48322 - "POST /node/69f54c08ed4ed40b022407aa HTTP/1.0" 202 Accepted 2026-05-04 00:57:50,186 - lava_callback - INFO - Starting async job submit for node 69f54c08ed4ed40b022407aa 2026-05-04 00:57:50,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:50,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c08ed4ed40b022407aa HTTP/1.1" 200 None 2026-05-04 00:57:50,202 - lava_callback - DEBUG - Processing node 69f54c08ed4ed40b022407aa: baseline-arm64-baylibre 2026-05-04 00:57:50,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54c08ed4ed40b022407aa 2026-05-04 00:57:50,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:50,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c08ed4ed40b022407aa HTTP/1.1" 200 None 2026-05-04 00:57:50,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:50,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 00:57:50,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:50,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54c08ed4ed40b022407aa HTTP/1.1" 200 None 2026-05-04 00:57:50,308 - lava_callback - ERROR - Error processing callback for node 69f54c08ed4ed40b022407aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:57:50,823 - lava_callback - INFO - Received callback for node 69f54c09ed4ed40b022407ad INFO: 172.20.0.1:48338 - "POST /node/69f54c09ed4ed40b022407ad HTTP/1.0" 202 Accepted 2026-05-04 00:57:50,828 - lava_callback - INFO - Starting async job submit for node 69f54c09ed4ed40b022407ad 2026-05-04 00:57:50,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:50,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c09ed4ed40b022407ad HTTP/1.1" 200 None 2026-05-04 00:57:50,844 - lava_callback - DEBUG - Processing node 69f54c09ed4ed40b022407ad: baseline-arm64-baylibre 2026-05-04 00:57:50,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54c09ed4ed40b022407ad 2026-05-04 00:57:50,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:50,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c09ed4ed40b022407ad HTTP/1.1" 200 None 2026-05-04 00:57:50,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:50,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 00:57:50,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:57:50,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54c09ed4ed40b022407ad HTTP/1.1" 200 None 2026-05-04 00:57:50,899 - lava_callback - ERROR - Error processing callback for node 69f54c09ed4ed40b022407ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48348 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:58:05,344 - lava_callback - INFO - Received callback for node 69f54c18ed4ed40b022407e2 INFO: 172.20.0.1:60430 - "POST /node/69f54c18ed4ed40b022407e2 HTTP/1.0" 202 Accepted 2026-05-04 00:58:05,349 - lava_callback - INFO - Starting async job submit for node 69f54c18ed4ed40b022407e2 2026-05-04 00:58:05,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:05,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c18ed4ed40b022407e2 HTTP/1.1" 200 None 2026-05-04 00:58:05,365 - lava_callback - DEBUG - Processing node 69f54c18ed4ed40b022407e2: baseline-arm64-clabbe 2026-05-04 00:58:05,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54c18ed4ed40b022407e2 2026-05-04 00:58:05,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:05,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c18ed4ed40b022407e2 HTTP/1.1" 200 None 2026-05-04 00:58:05,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:05,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 00:58:05,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:05,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54c18ed4ed40b022407e2 HTTP/1.1" 200 None 2026-05-04 00:58:05,422 - lava_callback - ERROR - Error processing callback for node 69f54c18ed4ed40b022407e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:58:05,975 - lava_callback - INFO - Received callback for node 69f54c1aed4ed40b022407e5 INFO: 172.20.0.1:60446 - "POST /node/69f54c1aed4ed40b022407e5 HTTP/1.0" 202 Accepted 2026-05-04 00:58:05,980 - lava_callback - INFO - Starting async job submit for node 69f54c1aed4ed40b022407e5 2026-05-04 00:58:05,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:05,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c1aed4ed40b022407e5 HTTP/1.1" 200 None 2026-05-04 00:58:05,996 - lava_callback - DEBUG - Processing node 69f54c1aed4ed40b022407e5: baseline-arm64-clabbe 2026-05-04 00:58:05,996 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54c1aed4ed40b022407e5 2026-05-04 00:58:05,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:06,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c1aed4ed40b022407e5 HTTP/1.1" 200 None 2026-05-04 00:58:06,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:06,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 00:58:06,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:06,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54c1aed4ed40b022407e5 HTTP/1.1" 200 None 2026-05-04 00:58:06,047 - lava_callback - ERROR - Error processing callback for node 69f54c1aed4ed40b022407e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60472 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:58:06,594 - lava_callback - INFO - Received callback for node 69f54c1bed4ed40b022407e8 INFO: 172.20.0.1:60486 - "POST /node/69f54c1bed4ed40b022407e8 HTTP/1.0" 202 Accepted 2026-05-04 00:58:06,602 - lava_callback - INFO - Starting async job submit for node 69f54c1bed4ed40b022407e8 2026-05-04 00:58:06,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:06,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c1bed4ed40b022407e8 HTTP/1.1" 200 None 2026-05-04 00:58:06,618 - lava_callback - DEBUG - Processing node 69f54c1bed4ed40b022407e8: baseline-arm64-clabbe 2026-05-04 00:58:06,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54c1bed4ed40b022407e8 2026-05-04 00:58:06,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:06,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c1bed4ed40b022407e8 HTTP/1.1" 200 None 2026-05-04 00:58:06,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:06,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 00:58:06,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:06,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54c1bed4ed40b022407e8 HTTP/1.1" 200 None 2026-05-04 00:58:06,718 - lava_callback - ERROR - Error processing callback for node 69f54c1bed4ed40b022407e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:58:07,231 - lava_callback - INFO - Received callback for node 69f54c1ced4ed40b022407eb INFO: 172.20.0.1:60490 - "POST /node/69f54c1ced4ed40b022407eb HTTP/1.0" 202 Accepted 2026-05-04 00:58:07,237 - lava_callback - INFO - Starting async job submit for node 69f54c1ced4ed40b022407eb 2026-05-04 00:58:07,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:07,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c1ced4ed40b022407eb HTTP/1.1" 200 None 2026-05-04 00:58:07,252 - lava_callback - DEBUG - Processing node 69f54c1ced4ed40b022407eb: baseline-arm64-clabbe 2026-05-04 00:58:07,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54c1ced4ed40b022407eb 2026-05-04 00:58:07,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:07,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c1ced4ed40b022407eb HTTP/1.1" 200 None 2026-05-04 00:58:07,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:07,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 00:58:07,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:07,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54c1ced4ed40b022407eb HTTP/1.1" 200 None 2026-05-04 00:58:07,301 - lava_callback - ERROR - Error processing callback for node 69f54c1ced4ed40b022407eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49628 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:58:25,379 - lava_callback - INFO - Received callback for node 69f54c1eed4ed40b022407f4 INFO: 172.20.0.1:33258 - "POST /node/69f54c1eed4ed40b022407f4 HTTP/1.0" 202 Accepted 2026-05-04 00:58:25,384 - lava_callback - INFO - Starting async job submit for node 69f54c1eed4ed40b022407f4 2026-05-04 00:58:25,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:25,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c1eed4ed40b022407f4 HTTP/1.1" 200 None 2026-05-04 00:58:25,412 - lava_callback - DEBUG - Processing node 69f54c1eed4ed40b022407f4: baseline-arm64-clabbe 2026-05-04 00:58:25,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54c1eed4ed40b022407f4 2026-05-04 00:58:25,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:25,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c1eed4ed40b022407f4 HTTP/1.1" 200 None 2026-05-04 00:58:25,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:25,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 00:58:25,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:25,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54c1eed4ed40b022407f4 HTTP/1.1" 200 None 2026-05-04 00:58:25,458 - lava_callback - ERROR - Error processing callback for node 69f54c1eed4ed40b022407f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 00:58:26,015 - lava_callback - INFO - Received callback for node 69f54c1ded4ed40b022407f1 INFO: 172.20.0.1:33274 - "POST /node/69f54c1ded4ed40b022407f1 HTTP/1.0" 202 Accepted 2026-05-04 00:58:26,021 - lava_callback - INFO - Starting async job submit for node 69f54c1ded4ed40b022407f1 2026-05-04 00:58:26,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:26,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c1ded4ed40b022407f1 HTTP/1.1" 200 None 2026-05-04 00:58:26,041 - lava_callback - DEBUG - Processing node 69f54c1ded4ed40b022407f1: baseline-arm64-clabbe 2026-05-04 00:58:26,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54c1ded4ed40b022407f1 2026-05-04 00:58:26,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:26,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54c1ded4ed40b022407f1 HTTP/1.1" 200 None 2026-05-04 00:58:26,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:26,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 00:58:26,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:26,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54c1ded4ed40b022407f1 HTTP/1.1" 200 None 2026-05-04 00:58:26,088 - lava_callback - ERROR - Error processing callback for node 69f54c1ded4ed40b022407f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33286 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:58:30,482 - lava_callback - INFO - Received callback for node 69f7eb2f559eef1735ba7f55 INFO: 172.20.0.1:60110 - "POST /node/69f7eb2f559eef1735ba7f55 HTTP/1.0" 202 Accepted 2026-05-04 00:58:30,489 - lava_callback - INFO - Starting async job submit for node 69f7eb2f559eef1735ba7f55 2026-05-04 00:58:30,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:30,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb2f559eef1735ba7f55 HTTP/1.1" 200 None 2026-05-04 00:58:30,556 - lava_callback - DEBUG - Processing node 69f7eb2f559eef1735ba7f55: baseline-arm 2026-05-04 00:58:31,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:58:31,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:58:31,263 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb2f559eef1735ba7f55/log.txt.gz 2026-05-04 00:58:31,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:58:31,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:58:31,824 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb2f559eef1735ba7f55/lava-logs.yaml 2026-05-04 00:58:31,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:58:31,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:58:31,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f7eb2f559eef1735ba7f55/lava_callback.json.gz DEBUG: Setup failed for 69f7eb2f559eef1735ba7f55. Transitting job node result: incomplete -> fail 2026-05-04 00:58:32,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:32,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb2f559eef1735ba7f55 HTTP/1.1" 200 None 2026-05-04 00:58:32,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:32,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 00:58:32,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:32,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb2f559eef1735ba7f55 HTTP/1.1" 200 None 2026-05-04 00:58:32,261 - lava_callback - INFO - Completed processing callback for node 69f7eb2f559eef1735ba7f55 2026-05-04 00:58:35,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:58:35,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56590 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:59:44,730 - lava_callback - INFO - Received callback for node 69f7ebd2559eef1735ba80d9 INFO: 172.20.0.1:57510 - "POST /node/69f7ebd2559eef1735ba80d9 HTTP/1.0" 202 Accepted 2026-05-04 00:59:44,737 - lava_callback - INFO - Starting async job submit for node 69f7ebd2559eef1735ba80d9 2026-05-04 00:59:44,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:59:44,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ebd2559eef1735ba80d9 HTTP/1.1" 200 None 2026-05-04 00:59:44,795 - lava_callback - DEBUG - Processing node 69f7ebd2559eef1735ba80d9: baseline-x86 2026-05-04 00:59:45,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:59:45,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:59:45,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd2559eef1735ba80d9/log.txt.gz 2026-05-04 00:59:46,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:57520 - "GET / HTTP/1.0" 200 OK 2026-05-04 00:59:46,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:59:46,655 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd2559eef1735ba80d9/lava-logs.yaml 2026-05-04 00:59:46,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 00:59:46,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 00:59:46,825 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd2559eef1735ba80d9/lava_callback.json.gz DEBUG: Setup failed for 69f7ebd2559eef1735ba80d9. Transitting job node result: incomplete -> fail 2026-05-04 00:59:46,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:59:46,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ebd2559eef1735ba80d9 HTTP/1.1" 200 None 2026-05-04 00:59:46,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:59:46,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5de559eef1735ba5778 HTTP/1.1" 200 None 2026-05-04 00:59:46,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 00:59:46,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ebd2559eef1735ba80d9 HTTP/1.1" 200 None 2026-05-04 00:59:47,052 - lava_callback - INFO - Completed processing callback for node 69f7ebd2559eef1735ba80d9 INFO: 172.20.0.1:47196 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:00:05,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:00:05,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55792 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:01:05,995 - lava_callback - INFO - Received callback for node 69f54cbded4ed40b02240922 INFO: 172.20.0.1:55172 - "POST /node/69f54cbded4ed40b02240922 HTTP/1.0" 202 Accepted 2026-05-04 01:01:06,000 - lava_callback - INFO - Starting async job submit for node 69f54cbded4ed40b02240922 2026-05-04 01:01:06,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:01:06,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54cbded4ed40b02240922 HTTP/1.1" 200 None 2026-05-04 01:01:06,022 - lava_callback - DEBUG - Processing node 69f54cbded4ed40b02240922: baseline-arm64-clabbe 2026-05-04 01:01:06,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54cbded4ed40b02240922 2026-05-04 01:01:06,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:01:06,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54cbded4ed40b02240922 HTTP/1.1" 200 None 2026-05-04 01:01:06,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:01:06,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 01:01:06,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:01:06,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54cbded4ed40b02240922 HTTP/1.1" 200 None 2026-05-04 01:01:06,067 - lava_callback - ERROR - Error processing callback for node 69f54cbded4ed40b02240922: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55190 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:01:13,998 - lava_callback - INFO - Received callback for node 69f7efc8559eef1735ba82ff INFO: 172.20.0.1:48368 - "POST /node/69f7efc8559eef1735ba82ff HTTP/1.0" 202 Accepted 2026-05-04 01:01:14,004 - lava_callback - INFO - Starting async job submit for node 69f7efc8559eef1735ba82ff 2026-05-04 01:01:14,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:01:14,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7efc8559eef1735ba82ff HTTP/1.1" 200 None 2026-05-04 01:01:14,031 - lava_callback - DEBUG - Processing node 69f7efc8559eef1735ba82ff: baseline-arm 2026-05-04 01:01:14,036 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:01:14,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:01:14,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:01:14,182 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f7efc8559eef1735ba82ff/lava-logs.yaml 2026-05-04 01:01:14,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:01:14,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:01:14,309 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f7efc8559eef1735ba82ff/lava_callback.json.gz 2026-05-04 01:01:14,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:01:14,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7efc8559eef1735ba82ff HTTP/1.1" 200 None 2026-05-04 01:01:14,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:01:14,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 01:01:14,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:01:14,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7efc8559eef1735ba82ff HTTP/1.1" 200 None 2026-05-04 01:01:14,441 - lava_callback - INFO - Completed processing callback for node 69f7efc8559eef1735ba82ff INFO: 172.20.0.1:48380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38230 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:01:35,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:01:35,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35434 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:02:19,898 - lava_callback - INFO - Received callback for node 69f7eb45559eef1735ba7fb9 INFO: 172.20.0.1:58724 - "POST /node/69f7eb45559eef1735ba7fb9 HTTP/1.0" 202 Accepted 2026-05-04 01:02:19,945 - lava_callback - INFO - Starting async job submit for node 69f7eb45559eef1735ba7fb9 2026-05-04 01:02:19,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:02:19,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb45559eef1735ba7fb9 HTTP/1.1" 200 None 2026-05-04 01:02:19,991 - lava_callback - DEBUG - Processing node 69f7eb45559eef1735ba7fb9: baseline-arm-clabbe 2026-05-04 01:02:20,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:02:20,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:02:20,205 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f7eb45559eef1735ba7fb9/log.txt.gz 2026-05-04 01:02:20,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:02:20,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:02:20,380 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f7eb45559eef1735ba7fb9/lava-logs.yaml 2026-05-04 01:02:20,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:02:20,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:02:20,633 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f7eb45559eef1735ba7fb9/lava_callback.json.gz 2026-05-04 01:02:20,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:02:20,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb45559eef1735ba7fb9 HTTP/1.1" 200 None 2026-05-04 01:02:20,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:02:20,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 01:02:20,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:02:20,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb45559eef1735ba7fb9 HTTP/1.1" 200 None 2026-05-04 01:02:20,775 - lava_callback - INFO - Completed processing callback for node 69f7eb45559eef1735ba7fb9 INFO: 172.20.0.1:58728 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:02:35,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:02:35,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57238 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:03:45,643 - lava_callback - INFO - Received callback for node 69f54d5bed4ed40b022409a2 INFO: 172.20.0.1:55676 - "POST /node/69f54d5bed4ed40b022409a2 HTTP/1.0" 202 Accepted 2026-05-04 01:03:45,648 - lava_callback - INFO - Starting async job submit for node 69f54d5bed4ed40b022409a2 2026-05-04 01:03:45,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:03:45,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54d5bed4ed40b022409a2 HTTP/1.1" 200 None 2026-05-04 01:03:45,663 - lava_callback - DEBUG - Processing node 69f54d5bed4ed40b022409a2: baseline-arm64-clabbe 2026-05-04 01:03:45,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54d5bed4ed40b022409a2 2026-05-04 01:03:45,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:03:45,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54d5bed4ed40b022409a2 HTTP/1.1" 200 None 2026-05-04 01:03:45,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:03:45,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 01:03:45,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:03:45,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54d5bed4ed40b022409a2 HTTP/1.1" 200 None 2026-05-04 01:03:45,713 - lava_callback - ERROR - Error processing callback for node 69f54d5bed4ed40b022409a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48516 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:07:03,033 - lava_callback - INFO - Received callback for node 69f7ebd4559eef1735ba80df INFO: 172.20.0.1:38314 - "POST /node/69f7ebd4559eef1735ba80df HTTP/1.0" 202 Accepted 2026-05-04 01:07:03,038 - lava_callback - INFO - Starting async job submit for node 69f7ebd4559eef1735ba80df 2026-05-04 01:07:03,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:07:03,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ebd4559eef1735ba80df HTTP/1.1" 200 None 2026-05-04 01:07:03,082 - lava_callback - DEBUG - Processing node 69f7ebd4559eef1735ba80df: baseline-x86 2026-05-04 01:07:03,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:07:03,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:07:03,668 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd4559eef1735ba80df/log.txt.gz 2026-05-04 01:07:03,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:07:03,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:07:03,977 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd4559eef1735ba80df/lava-logs.yaml 2026-05-04 01:07:03,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:07:04,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:07:04,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f7ebd4559eef1735ba80df/lava_callback.json.gz 2026-05-04 01:07:04,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:07:04,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ebd4559eef1735ba80df HTTP/1.1" 200 None 2026-05-04 01:07:04,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:07:04,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5de559eef1735ba5778 HTTP/1.1" 200 None 2026-05-04 01:07:04,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:07:04,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ebd4559eef1735ba80df HTTP/1.1" 200 None 2026-05-04 01:07:04,181 - lava_callback - INFO - Completed processing callback for node 69f7ebd4559eef1735ba80df 2026-05-04 01:07:05,808 - lava_callback - INFO - Received callback for node 69f54e2ded4ed40b02240a0c INFO: 172.20.0.1:38318 - "POST /node/69f54e2ded4ed40b02240a0c HTTP/1.0" 202 Accepted 2026-05-04 01:07:05,813 - lava_callback - INFO - Starting async job submit for node 69f54e2ded4ed40b02240a0c 2026-05-04 01:07:05,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:07:05,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54e2ded4ed40b02240a0c HTTP/1.1" 200 None 2026-05-04 01:07:05,827 - lava_callback - DEBUG - Processing node 69f54e2ded4ed40b02240a0c: baseline-arm64-clabbe 2026-05-04 01:07:05,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54e2ded4ed40b02240a0c 2026-05-04 01:07:05,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:07:05,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:07:05,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54e2ded4ed40b02240a0c HTTP/1.1" 200 None 2026-05-04 01:07:05,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:07:05,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 01:07:05,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 01:07:05,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:07:05,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54e2ded4ed40b02240a0c HTTP/1.1" 200 None 2026-05-04 01:07:05,874 - lava_callback - ERROR - Error processing callback for node 69f54e2ded4ed40b02240a0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34288 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:08:28,064 - lava_callback - INFO - Received callback for node 69f54e78ed4ed40b02240a41 INFO: 172.20.0.1:34290 - "POST /node/69f54e78ed4ed40b02240a41 HTTP/1.0" 202 Accepted 2026-05-04 01:08:28,071 - lava_callback - INFO - Starting async job submit for node 69f54e78ed4ed40b02240a41 2026-05-04 01:08:28,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:08:28,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54e78ed4ed40b02240a41 HTTP/1.1" 200 None 2026-05-04 01:08:28,088 - lava_callback - DEBUG - Processing node 69f54e78ed4ed40b02240a41: baseline-arm64-baylibre 2026-05-04 01:08:28,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54e78ed4ed40b02240a41 2026-05-04 01:08:28,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:08:28,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54e78ed4ed40b02240a41 HTTP/1.1" 200 None 2026-05-04 01:08:28,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:08:28,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 01:08:28,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:08:28,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54e78ed4ed40b02240a41 HTTP/1.1" 200 None 2026-05-04 01:08:28,140 - lava_callback - ERROR - Error processing callback for node 69f54e78ed4ed40b02240a41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48736 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:11:06,114 - lava_callback - INFO - Received callback for node 69f54f21ed4ed40b02240ac4 INFO: 172.20.0.1:46002 - "POST /node/69f54f21ed4ed40b02240ac4 HTTP/1.0" 202 Accepted 2026-05-04 01:11:06,121 - lava_callback - INFO - Starting async job submit for node 69f54f21ed4ed40b02240ac4 2026-05-04 01:11:06,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:11:06,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54f21ed4ed40b02240ac4 HTTP/1.1" 200 None 2026-05-04 01:11:06,137 - lava_callback - DEBUG - Processing node 69f54f21ed4ed40b02240ac4: baseline-arm64-clabbe 2026-05-04 01:11:06,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54f21ed4ed40b02240ac4 2026-05-04 01:11:06,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:11:06,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54f21ed4ed40b02240ac4 HTTP/1.1" 200 None 2026-05-04 01:11:06,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:11:06,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 01:11:06,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:11:06,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54f21ed4ed40b02240ac4 HTTP/1.1" 200 None 2026-05-04 01:11:06,193 - lava_callback - ERROR - Error processing callback for node 69f54f21ed4ed40b02240ac4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46010 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:11:06,402 - lava_callback - INFO - Received callback for node 69f7eb49559eef1735ba7fc9 INFO: 172.20.0.1:46022 - "POST /node/69f7eb49559eef1735ba7fc9 HTTP/1.0" 202 Accepted 2026-05-04 01:11:06,454 - lava_callback - INFO - Starting async job submit for node 69f7eb49559eef1735ba7fc9 2026-05-04 01:11:06,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:11:06,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb49559eef1735ba7fc9 HTTP/1.1" 200 None 2026-05-04 01:11:06,505 - lava_callback - DEBUG - Processing node 69f7eb49559eef1735ba7fc9: baseline-arm-clabbe INFO: 172.20.0.1:46038 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:11:06,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:11:06,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:11:06,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f7eb49559eef1735ba7fc9/log.txt.gz 2026-05-04 01:11:06,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:11:06,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:11:06,896 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f7eb49559eef1735ba7fc9/lava-logs.yaml 2026-05-04 01:11:06,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:11:06,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:11:06,993 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f7eb49559eef1735ba7fc9/lava_callback.json.gz 2026-05-04 01:11:07,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:11:07,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb49559eef1735ba7fc9 HTTP/1.1" 200 None 2026-05-04 01:11:07,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:11:07,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 01:11:07,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:11:07,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb49559eef1735ba7fc9 HTTP/1.1" 200 None 2026-05-04 01:11:07,148 - lava_callback - INFO - Completed processing callback for node 69f7eb49559eef1735ba7fc9 INFO: 172.20.0.1:54940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59944 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:11:35,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:11:35,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54422 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:12:46,288 - lava_callback - INFO - Received callback for node 69f54f7ced4ed40b02240af2 INFO: 172.20.0.1:50456 - "POST /node/69f54f7ced4ed40b02240af2 HTTP/1.0" 202 Accepted 2026-05-04 01:12:46,294 - lava_callback - INFO - Starting async job submit for node 69f54f7ced4ed40b02240af2 2026-05-04 01:12:46,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:12:46,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54f7ced4ed40b02240af2 HTTP/1.1" 200 None 2026-05-04 01:12:46,310 - lava_callback - DEBUG - Processing node 69f54f7ced4ed40b02240af2: baseline-arm64-clabbe 2026-05-04 01:12:46,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54f7ced4ed40b02240af2 2026-05-04 01:12:46,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:12:46,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54f7ced4ed40b02240af2 HTTP/1.1" 200 None 2026-05-04 01:12:46,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:12:46,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 01:12:46,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:12:46,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54f7ced4ed40b02240af2 HTTP/1.1" 200 None 2026-05-04 01:12:46,370 - lava_callback - ERROR - Error processing callback for node 69f54f7ced4ed40b02240af2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34170 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:13:52,558 - lava_callback - INFO - Received callback for node 69f7eb75559eef1735ba803c INFO: 172.20.0.1:54674 - "POST /node/69f7eb75559eef1735ba803c HTTP/1.0" 202 Accepted 2026-05-04 01:13:52,565 - lava_callback - INFO - Starting async job submit for node 69f7eb75559eef1735ba803c 2026-05-04 01:13:52,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:13:52,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb75559eef1735ba803c HTTP/1.1" 200 None 2026-05-04 01:13:52,621 - lava_callback - DEBUG - Processing node 69f7eb75559eef1735ba803c: ltp-syscalls-ipc 2026-05-04 01:13:53,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:13:53,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:13:53,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69f7eb75559eef1735ba803c/log.txt.gz 2026-05-04 01:13:53,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:13:53,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:13:53,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69f7eb75559eef1735ba803c/lava-logs.yaml 2026-05-04 01:13:53,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:13:53,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:13:53,943 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69f7eb75559eef1735ba803c/lava_callback.json.gz 2026-05-04 01:13:53,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:13:53,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb75559eef1735ba803c HTTP/1.1" 200 None 2026-05-04 01:13:53,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:13:54,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 01:13:54,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:13:54,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb75559eef1735ba803c HTTP/1.1" 200 None 2026-05-04 01:13:54,028 - lava_callback - INFO - Completed processing callback for node 69f7eb75559eef1735ba803c INFO: 172.20.0.1:54676 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:14:05,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:14:05,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 01:14:06,147 - lava_callback - INFO - Received callback for node 69f54fd1ed4ed40b02240b1a INFO: 172.20.0.1:58594 - "POST /node/69f54fd1ed4ed40b02240b1a HTTP/1.0" 202 Accepted 2026-05-04 01:14:06,153 - lava_callback - INFO - Starting async job submit for node 69f54fd1ed4ed40b02240b1a 2026-05-04 01:14:06,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:14:06,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54fd1ed4ed40b02240b1a HTTP/1.1" 200 None 2026-05-04 01:14:06,167 - lava_callback - DEBUG - Processing node 69f54fd1ed4ed40b02240b1a: baseline-arm64-clabbe 2026-05-04 01:14:06,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f54fd1ed4ed40b02240b1a 2026-05-04 01:14:06,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:14:06,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f54fd1ed4ed40b02240b1a HTTP/1.1" 200 None 2026-05-04 01:14:06,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:14:06,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 01:14:06,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:14:06,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f54fd1ed4ed40b02240b1a HTTP/1.1" 200 None 2026-05-04 01:14:06,214 - lava_callback - ERROR - Error processing callback for node 69f54fd1ed4ed40b02240b1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43968 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:14:59,247 - lava_callback - INFO - Received callback for node 69f7eb77559eef1735ba803f INFO: 172.20.0.1:43974 - "POST /node/69f7eb77559eef1735ba803f HTTP/1.0" 202 Accepted 2026-05-04 01:14:59,254 - lava_callback - INFO - Starting async job submit for node 69f7eb77559eef1735ba803f 2026-05-04 01:14:59,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:14:59,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb77559eef1735ba803f HTTP/1.1" 200 None 2026-05-04 01:14:59,296 - lava_callback - DEBUG - Processing node 69f7eb77559eef1735ba803f: ltp-timers 2026-05-04 01:14:59,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:14:59,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:14:59,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69f7eb77559eef1735ba803f/log.txt.gz 2026-05-04 01:15:00,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:15:00,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:15:00,292 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69f7eb77559eef1735ba803f/lava-logs.yaml 2026-05-04 01:15:00,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:15:00,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:15:00,457 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69f7eb77559eef1735ba803f/lava_callback.json.gz 2026-05-04 01:15:00,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:15:00,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb77559eef1735ba803f HTTP/1.1" 200 None 2026-05-04 01:15:00,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:15:00,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 01:15:00,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:15:00,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb77559eef1735ba803f HTTP/1.1" 200 None 2026-05-04 01:15:00,532 - lava_callback - INFO - Completed processing callback for node 69f7eb77559eef1735ba803f 2026-05-04 01:15:05,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:15:05,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38574 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:17:06,379 - lava_callback - INFO - Received callback for node 69f5507eed4ed40b02240b7a INFO: 172.20.0.1:57588 - "POST /node/69f5507eed4ed40b02240b7a HTTP/1.0" 202 Accepted 2026-05-04 01:17:06,385 - lava_callback - INFO - Starting async job submit for node 69f5507eed4ed40b02240b7a 2026-05-04 01:17:06,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:57596 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:17:06,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5507eed4ed40b02240b7a HTTP/1.1" 200 None 2026-05-04 01:17:06,404 - lava_callback - DEBUG - Processing node 69f5507eed4ed40b02240b7a: baseline-arm64-clabbe 2026-05-04 01:17:06,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5507eed4ed40b02240b7a 2026-05-04 01:17:06,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:17:06,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5507eed4ed40b02240b7a HTTP/1.1" 200 None 2026-05-04 01:17:06,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:17:06,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 01:17:06,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:17:06,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5507eed4ed40b02240b7a HTTP/1.1" 200 None 2026-05-04 01:17:06,473 - lava_callback - ERROR - Error processing callback for node 69f5507eed4ed40b02240b7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59156 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:18:19,227 - lava_callback - INFO - Received callback for node 69f7eb78559eef1735ba8042 INFO: 172.20.0.1:59160 - "POST /node/69f7eb78559eef1735ba8042 HTTP/1.0" 202 Accepted 2026-05-04 01:18:19,241 - lava_callback - INFO - Starting async job submit for node 69f7eb78559eef1735ba8042 2026-05-04 01:18:19,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:19,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb78559eef1735ba8042 HTTP/1.1" 200 None 2026-05-04 01:18:19,301 - lava_callback - DEBUG - Processing node 69f7eb78559eef1735ba8042: ltp-watchqueue 2026-05-04 01:18:19,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:18:19,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:18:19,855 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69f7eb78559eef1735ba8042/log.txt.gz 2026-05-04 01:18:20,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:18:20,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:18:20,219 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69f7eb78559eef1735ba8042/lava-logs.yaml 2026-05-04 01:18:20,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:18:20,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:18:20,354 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69f7eb78559eef1735ba8042/lava_callback.json.gz 2026-05-04 01:18:20,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:20,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7eb78559eef1735ba8042 HTTP/1.1" 200 None 2026-05-04 01:18:20,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:20,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 01:18:20,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:20,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7eb78559eef1735ba8042 HTTP/1.1" 200 None 2026-05-04 01:18:20,471 - lava_callback - INFO - Completed processing callback for node 69f7eb78559eef1735ba8042 INFO: 172.20.0.1:58968 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:18:35,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:35,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60782 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:18:42,310 - lava_callback - INFO - Received callback for node 69f7f3d5559eef1735ba8531 INFO: 172.20.0.1:51992 - "POST /node/69f7f3d5559eef1735ba8531 HTTP/1.0" 202 Accepted 2026-05-04 01:18:42,317 - lava_callback - INFO - Starting async job submit for node 69f7f3d5559eef1735ba8531 2026-05-04 01:18:42,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:42,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d5559eef1735ba8531 HTTP/1.1" 200 None 2026-05-04 01:18:42,352 - lava_callback - DEBUG - Processing node 69f7f3d5559eef1735ba8531: baseline-arm64 2026-05-04 01:18:42,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:18:42,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:18:42,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d5559eef1735ba8531/log.txt.gz 2026-05-04 01:18:42,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:18:42,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:18:42,876 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d5559eef1735ba8531/lava-logs.yaml 2026-05-04 01:18:42,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:18:42,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:18:42,976 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d5559eef1735ba8531/lava_callback.json.gz 2026-05-04 01:18:42,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:43,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d5559eef1735ba8531 HTTP/1.1" 200 None 2026-05-04 01:18:43,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:43,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:18:43,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:43,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3d5559eef1735ba8531 HTTP/1.1" 200 None 2026-05-04 01:18:43,047 - lava_callback - INFO - Completed processing callback for node 69f7f3d5559eef1735ba8531 2026-05-04 01:18:43,106 - lava_callback - INFO - Received callback for node 69f7f3e4559eef1735ba855c INFO: 172.20.0.1:51994 - "POST /node/69f7f3e4559eef1735ba855c HTTP/1.0" 202 Accepted 2026-05-04 01:18:43,116 - lava_callback - INFO - Starting async job submit for node 69f7f3e4559eef1735ba855c 2026-05-04 01:18:43,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:43,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e4559eef1735ba855c HTTP/1.1" 200 None 2026-05-04 01:18:43,139 - lava_callback - DEBUG - Processing node 69f7f3e4559eef1735ba855c: baseline-nfs-arm64 2026-05-04 01:18:43,141 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:18:43,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:18:43,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:18:43,291 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e4559eef1735ba855c/lava-logs.yaml 2026-05-04 01:18:43,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:18:43,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:18:43,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e4559eef1735ba855c/lava_callback.json.gz 2026-05-04 01:18:43,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:43,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e4559eef1735ba855c HTTP/1.1" 200 None 2026-05-04 01:18:43,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:43,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:18:43,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:43,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3e4559eef1735ba855c HTTP/1.1" 200 None 2026-05-04 01:18:43,443 - lava_callback - INFO - Completed processing callback for node 69f7f3e4559eef1735ba855c 2026-05-04 01:18:43,791 - lava_callback - INFO - Received callback for node 69f7f3ca559eef1735ba84f5 INFO: 172.20.0.1:52010 - "POST /node/69f7f3ca559eef1735ba84f5 HTTP/1.0" 202 Accepted 2026-05-04 01:18:43,797 - lava_callback - INFO - Starting async job submit for node 69f7f3ca559eef1735ba84f5 2026-05-04 01:18:43,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:43,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3ca559eef1735ba84f5 HTTP/1.1" 200 None 2026-05-04 01:18:43,833 - lava_callback - DEBUG - Processing node 69f7f3ca559eef1735ba84f5: baseline-arm64 2026-05-04 01:18:44,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:18:44,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:18:44,140 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3ca559eef1735ba84f5/log.txt.gz 2026-05-04 01:18:44,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:18:44,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:18:44,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3ca559eef1735ba84f5/lava-logs.yaml 2026-05-04 01:18:44,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:18:44,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:18:44,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3ca559eef1735ba84f5/lava_callback.json.gz 2026-05-04 01:18:44,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:44,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3ca559eef1735ba84f5 HTTP/1.1" 200 None 2026-05-04 01:18:44,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:44,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:18:44,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:18:44,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3ca559eef1735ba84f5 HTTP/1.1" 200 None 2026-05-04 01:18:44,622 - lava_callback - INFO - Completed processing callback for node 69f7f3ca559eef1735ba84f5 INFO: 172.20.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54462 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:19:05,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:05,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47882 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:19:06,467 - lava_callback - INFO - Received callback for node 69f550fded4ed40b02240bac INFO: 172.20.0.1:47898 - "POST /node/69f550fded4ed40b02240bac HTTP/1.0" 202 Accepted 2026-05-04 01:19:06,475 - lava_callback - INFO - Starting async job submit for node 69f550fded4ed40b02240bac 2026-05-04 01:19:06,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:47904 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:19:06,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f550fded4ed40b02240bac HTTP/1.1" 200 None 2026-05-04 01:19:06,531 - lava_callback - DEBUG - Processing node 69f550fded4ed40b02240bac: baseline-arm64-clabbe 2026-05-04 01:19:06,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f550fded4ed40b02240bac 2026-05-04 01:19:06,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:06,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f550fded4ed40b02240bac HTTP/1.1" 200 None 2026-05-04 01:19:06,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:06,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 01:19:06,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:06,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f550fded4ed40b02240bac HTTP/1.1" 200 None 2026-05-04 01:19:06,580 - lava_callback - ERROR - Error processing callback for node 69f550fded4ed40b02240bac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 01:19:07,822 - lava_callback - INFO - Received callback for node 69f7f3ce559eef1735ba8502 INFO: 172.20.0.1:47918 - "POST /node/69f7f3ce559eef1735ba8502 HTTP/1.0" 202 Accepted 2026-05-04 01:19:07,833 - lava_callback - INFO - Starting async job submit for node 69f7f3ce559eef1735ba8502 2026-05-04 01:19:07,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:07,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3ce559eef1735ba8502 HTTP/1.1" 200 None 2026-05-04 01:19:07,897 - lava_callback - DEBUG - Processing node 69f7f3ce559eef1735ba8502: baseline-arm64 2026-05-04 01:19:08,043 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:19:08,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:08,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:08,219 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3ce559eef1735ba8502/lava-logs.yaml 2026-05-04 01:19:08,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:08,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:08,307 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3ce559eef1735ba8502/lava_callback.json.gz 2026-05-04 01:19:08,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:08,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3ce559eef1735ba8502 HTTP/1.1" 200 None 2026-05-04 01:19:08,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:08,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:08,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:08,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3ce559eef1735ba8502 HTTP/1.1" 200 None 2026-05-04 01:19:08,453 - lava_callback - INFO - Completed processing callback for node 69f7f3ce559eef1735ba8502 2026-05-04 01:19:12,751 - lava_callback - INFO - Received callback for node 69f7f3d2559eef1735ba8528 INFO: 172.20.0.1:51404 - "POST /node/69f7f3d2559eef1735ba8528 HTTP/1.0" 202 Accepted 2026-05-04 01:19:12,760 - lava_callback - INFO - Starting async job submit for node 69f7f3d2559eef1735ba8528 2026-05-04 01:19:12,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:12,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d2559eef1735ba8528 HTTP/1.1" 200 None 2026-05-04 01:19:12,795 - lava_callback - DEBUG - Processing node 69f7f3d2559eef1735ba8528: baseline-arm64 2026-05-04 01:19:13,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:13,264 - lava_callback - INFO - Received callback for node 69f7f3d7559eef1735ba8534 INFO: 172.20.0.1:51418 - "POST /node/69f7f3d7559eef1735ba8534 HTTP/1.0" 202 Accepted 2026-05-04 01:19:13,274 - lava_callback - INFO - Starting async job submit for node 69f7f3d7559eef1735ba8534 2026-05-04 01:19:13,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:13,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:13,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d2559eef1735ba8528/log.txt.gz 2026-05-04 01:19:13,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d7559eef1735ba8534 HTTP/1.1" 200 None 2026-05-04 01:19:13,375 - lava_callback - DEBUG - Processing node 69f7f3d7559eef1735ba8534: baseline-arm64 2026-05-04 01:19:13,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:13,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:13,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:13,889 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d7559eef1735ba8534/log.txt.gz 2026-05-04 01:19:13,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:14,022 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d2559eef1735ba8528/lava-logs.yaml 2026-05-04 01:19:14,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:14,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:14,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:14,139 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d2559eef1735ba8528/lava_callback.json.gz 2026-05-04 01:19:14,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:14,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:14,165 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d7559eef1735ba8534/lava-logs.yaml 2026-05-04 01:19:14,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:14,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d2559eef1735ba8528 HTTP/1.1" 200 None 2026-05-04 01:19:14,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:14,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:14,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:14,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3d2559eef1735ba8528 HTTP/1.1" 200 None 2026-05-04 01:19:14,246 - lava_callback - INFO - Completed processing callback for node 69f7f3d2559eef1735ba8528 2026-05-04 01:19:14,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:14,299 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d7559eef1735ba8534/lava_callback.json.gz 2026-05-04 01:19:14,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:14,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d7559eef1735ba8534 HTTP/1.1" 200 None 2026-05-04 01:19:14,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:14,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:14,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:14,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3d7559eef1735ba8534 HTTP/1.1" 200 None 2026-05-04 01:19:14,417 - lava_callback - INFO - Completed processing callback for node 69f7f3d7559eef1735ba8534 2026-05-04 01:19:14,708 - lava_callback - INFO - Received callback for node 69f7f3cf559eef1735ba8505 INFO: 172.20.0.1:51422 - "POST /node/69f7f3cf559eef1735ba8505 HTTP/1.0" 202 Accepted 2026-05-04 01:19:14,715 - lava_callback - INFO - Starting async job submit for node 69f7f3cf559eef1735ba8505 2026-05-04 01:19:14,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:14,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3cf559eef1735ba8505 HTTP/1.1" 200 None 2026-05-04 01:19:14,767 - lava_callback - DEBUG - Processing node 69f7f3cf559eef1735ba8505: baseline-arm64 2026-05-04 01:19:14,907 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:19:14,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:15,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:15,092 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3cf559eef1735ba8505/lava-logs.yaml 2026-05-04 01:19:15,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:51426 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 01:19:15,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:15,171 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3cf559eef1735ba8505/lava_callback.json.gz 2026-05-04 01:19:15,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:15,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3cf559eef1735ba8505 HTTP/1.1" 200 None 2026-05-04 01:19:15,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:15,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:15,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:15,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3cf559eef1735ba8505 HTTP/1.1" 200 None 2026-05-04 01:19:15,324 - lava_callback - INFO - Completed processing callback for node 69f7f3cf559eef1735ba8505 INFO: 172.20.0.1:51438 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:19:20,300 - lava_callback - INFO - Received callback for node 69f7f3cc559eef1735ba84fb INFO: 172.20.0.1:56796 - "POST /node/69f7f3cc559eef1735ba84fb HTTP/1.0" 202 Accepted 2026-05-04 01:19:20,306 - lava_callback - INFO - Starting async job submit for node 69f7f3cc559eef1735ba84fb 2026-05-04 01:19:20,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:20,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3cc559eef1735ba84fb HTTP/1.1" 200 None 2026-05-04 01:19:20,349 - lava_callback - DEBUG - Processing node 69f7f3cc559eef1735ba84fb: baseline-arm64 2026-05-04 01:19:20,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:20,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:20,752 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3cc559eef1735ba84fb/log.txt.gz 2026-05-04 01:19:20,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:21,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:21,100 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3cc559eef1735ba84fb/lava-logs.yaml 2026-05-04 01:19:21,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:21,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:21,228 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3cc559eef1735ba84fb/lava_callback.json.gz 2026-05-04 01:19:21,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:21,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3cc559eef1735ba84fb HTTP/1.1" 200 None 2026-05-04 01:19:21,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:21,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:21,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:21,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3cc559eef1735ba84fb HTTP/1.1" 200 None 2026-05-04 01:19:21,298 - lava_callback - INFO - Completed processing callback for node 69f7f3cc559eef1735ba84fb 2026-05-04 01:19:22,739 - lava_callback - INFO - Received callback for node 69f7f3da559eef1735ba853d INFO: 172.20.0.1:56808 - "POST /node/69f7f3da559eef1735ba853d HTTP/1.0" 202 Accepted 2026-05-04 01:19:22,744 - lava_callback - INFO - Starting async job submit for node 69f7f3da559eef1735ba853d 2026-05-04 01:19:22,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:22,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3da559eef1735ba853d HTTP/1.1" 200 None 2026-05-04 01:19:22,792 - lava_callback - DEBUG - Processing node 69f7f3da559eef1735ba853d: baseline-arm64 2026-05-04 01:19:23,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:23,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:23,127 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3da559eef1735ba853d/log.txt.gz 2026-05-04 01:19:23,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:23,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:23,449 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3da559eef1735ba853d/lava-logs.yaml 2026-05-04 01:19:23,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:23,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:23,551 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3da559eef1735ba853d/lava_callback.json.gz 2026-05-04 01:19:23,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:23,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3da559eef1735ba853d HTTP/1.1" 200 None 2026-05-04 01:19:23,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:23,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:23,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:23,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3da559eef1735ba853d HTTP/1.1" 200 None 2026-05-04 01:19:23,627 - lava_callback - INFO - Completed processing callback for node 69f7f3da559eef1735ba853d INFO: 172.20.0.1:56818 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:19:27,400 - lava_callback - INFO - Received callback for node 69f7f3d9559eef1735ba853a INFO: 172.20.0.1:56828 - "POST /node/69f7f3d9559eef1735ba853a HTTP/1.0" 202 Accepted 2026-05-04 01:19:27,406 - lava_callback - INFO - Starting async job submit for node 69f7f3d9559eef1735ba853a 2026-05-04 01:19:27,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:27,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d9559eef1735ba853a HTTP/1.1" 200 None 2026-05-04 01:19:27,443 - lava_callback - DEBUG - Processing node 69f7f3d9559eef1735ba853a: baseline-arm64 2026-05-04 01:19:27,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:27,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:27,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d9559eef1735ba853a/log.txt.gz 2026-05-04 01:19:27,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:28,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:28,089 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d9559eef1735ba853a/lava-logs.yaml 2026-05-04 01:19:28,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:28,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:28,209 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d9559eef1735ba853a/lava_callback.json.gz 2026-05-04 01:19:28,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:28,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d9559eef1735ba853a HTTP/1.1" 200 None 2026-05-04 01:19:28,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:28,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:28,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:28,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3d9559eef1735ba853a HTTP/1.1" 200 None 2026-05-04 01:19:28,293 - lava_callback - INFO - Completed processing callback for node 69f7f3d9559eef1735ba853a 2026-05-04 01:19:30,232 - lava_callback - INFO - Received callback for node 69f7f3cb559eef1735ba84f8 INFO: 172.20.0.1:40132 - "POST /node/69f7f3cb559eef1735ba84f8 HTTP/1.0" 202 Accepted 2026-05-04 01:19:30,243 - lava_callback - INFO - Starting async job submit for node 69f7f3cb559eef1735ba84f8 2026-05-04 01:19:30,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:30,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3cb559eef1735ba84f8 HTTP/1.1" 200 None 2026-05-04 01:19:30,298 - lava_callback - DEBUG - Processing node 69f7f3cb559eef1735ba84f8: baseline-arm64 2026-05-04 01:19:30,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:30,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:30,598 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3cb559eef1735ba84f8/log.txt.gz 2026-05-04 01:19:30,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:30,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:30,871 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3cb559eef1735ba84f8/lava-logs.yaml 2026-05-04 01:19:30,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:30,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:31,000 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3cb559eef1735ba84f8/lava_callback.json.gz 2026-05-04 01:19:31,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:31,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3cb559eef1735ba84f8 HTTP/1.1" 200 None 2026-05-04 01:19:31,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:31,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:31,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:31,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3cb559eef1735ba84f8 HTTP/1.1" 200 None 2026-05-04 01:19:31,093 - lava_callback - INFO - Completed processing callback for node 69f7f3cb559eef1735ba84f8 2026-05-04 01:19:34,664 - lava_callback - INFO - Received callback for node 69f7f3d3559eef1735ba852b INFO: 172.20.0.1:40144 - "POST /node/69f7f3d3559eef1735ba852b HTTP/1.0" 202 Accepted 2026-05-04 01:19:34,671 - lava_callback - INFO - Starting async job submit for node 69f7f3d3559eef1735ba852b 2026-05-04 01:19:34,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:34,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d3559eef1735ba852b HTTP/1.1" 200 None 2026-05-04 01:19:34,724 - lava_callback - DEBUG - Processing node 69f7f3d3559eef1735ba852b: baseline-arm64 2026-05-04 01:19:34,821 - lava_callback - INFO - Received callback for node 69f7f3d1559eef1735ba850b INFO: 172.20.0.1:40158 - "POST /node/69f7f3d1559eef1735ba850b HTTP/1.0" 202 Accepted 2026-05-04 01:19:34,838 - lava_callback - INFO - Starting async job submit for node 69f7f3d1559eef1735ba850b 2026-05-04 01:19:34,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:34,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d1559eef1735ba850b HTTP/1.1" 200 None 2026-05-04 01:19:34,989 - lava_callback - DEBUG - Processing node 69f7f3d1559eef1735ba850b: baseline-arm64 2026-05-04 01:19:35,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:35,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:35,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:35,596 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d1559eef1735ba850b/log.txt.gz 2026-05-04 01:19:35,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:35,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d3559eef1735ba852b/log.txt.gz 2026-05-04 01:19:35,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:35,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:36,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:36,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-04 01:19:36,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:36,070 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d1559eef1735ba850b/lava-logs.yaml 2026-05-04 01:19:36,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:36,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:36,174 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d3559eef1735ba852b/lava-logs.yaml 2026-05-04 01:19:36,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:36,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:36,215 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d1559eef1735ba850b/lava_callback.json.gz 2026-05-04 01:19:36,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:36,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d1559eef1735ba850b HTTP/1.1" 200 None 2026-05-04 01:19:36,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:36,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:36,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:36,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3d1559eef1735ba850b HTTP/1.1" 200 None 2026-05-04 01:19:36,296 - lava_callback - INFO - Completed processing callback for node 69f7f3d1559eef1735ba850b 2026-05-04 01:19:36,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:36,345 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d3559eef1735ba852b/lava_callback.json.gz 2026-05-04 01:19:36,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:36,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d3559eef1735ba852b HTTP/1.1" 200 None 2026-05-04 01:19:36,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:36,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:36,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:36,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3d3559eef1735ba852b HTTP/1.1" 200 None 2026-05-04 01:19:36,456 - lava_callback - INFO - Completed processing callback for node 69f7f3d3559eef1735ba852b INFO: 172.20.0.1:40170 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:19:40,967 - lava_callback - INFO - Received callback for node 69f7f3d5559eef1735ba852e INFO: 172.20.0.1:40738 - "POST /node/69f7f3d5559eef1735ba852e HTTP/1.0" 202 Accepted 2026-05-04 01:19:40,973 - lava_callback - INFO - Starting async job submit for node 69f7f3d5559eef1735ba852e 2026-05-04 01:19:40,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:41,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d5559eef1735ba852e HTTP/1.1" 200 None 2026-05-04 01:19:41,010 - lava_callback - DEBUG - Processing node 69f7f3d5559eef1735ba852e: baseline-arm64 2026-05-04 01:19:41,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:41,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:41,564 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d5559eef1735ba852e/log.txt.gz 2026-05-04 01:19:41,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:41,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:41,966 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d5559eef1735ba852e/lava-logs.yaml 2026-05-04 01:19:41,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:42,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:42,095 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d5559eef1735ba852e/lava_callback.json.gz 2026-05-04 01:19:42,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:42,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d5559eef1735ba852e HTTP/1.1" 200 None 2026-05-04 01:19:42,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:42,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:42,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:42,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3d5559eef1735ba852e HTTP/1.1" 200 None 2026-05-04 01:19:42,172 - lava_callback - INFO - Completed processing callback for node 69f7f3d5559eef1735ba852e 2026-05-04 01:19:43,008 - lava_callback - INFO - Received callback for node 69f7f3e3559eef1735ba8559 INFO: 172.20.0.1:40752 - "POST /node/69f7f3e3559eef1735ba8559 HTTP/1.0" 202 Accepted 2026-05-04 01:19:43,015 - lava_callback - INFO - Starting async job submit for node 69f7f3e3559eef1735ba8559 2026-05-04 01:19:43,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:43,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e3559eef1735ba8559 HTTP/1.1" 200 None 2026-05-04 01:19:43,056 - lava_callback - DEBUG - Processing node 69f7f3e3559eef1735ba8559: baseline-nfs-arm64 2026-05-04 01:19:43,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:43,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:43,695 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e3559eef1735ba8559/log.txt.gz 2026-05-04 01:19:44,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:44,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:44,260 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e3559eef1735ba8559/lava-logs.yaml 2026-05-04 01:19:44,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:44,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:44,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e3559eef1735ba8559/lava_callback.json.gz 2026-05-04 01:19:44,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:44,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e3559eef1735ba8559 HTTP/1.1" 200 None 2026-05-04 01:19:44,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:44,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:44,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:44,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3e3559eef1735ba8559 HTTP/1.1" 200 None 2026-05-04 01:19:44,447 - lava_callback - INFO - Completed processing callback for node 69f7f3e3559eef1735ba8559 2026-05-04 01:19:45,439 - lava_callback - INFO - Received callback for node 69f7f3cd559eef1735ba84fe INFO: 172.20.0.1:40764 - "POST /node/69f7f3cd559eef1735ba84fe HTTP/1.0" 202 Accepted 2026-05-04 01:19:45,446 - lava_callback - INFO - Starting async job submit for node 69f7f3cd559eef1735ba84fe 2026-05-04 01:19:45,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:45,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3cd559eef1735ba84fe HTTP/1.1" 200 None 2026-05-04 01:19:45,482 - lava_callback - DEBUG - Processing node 69f7f3cd559eef1735ba84fe: baseline-arm64 2026-05-04 01:19:45,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:45,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:45,892 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3cd559eef1735ba84fe/log.txt.gz 2026-05-04 01:19:46,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:46,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:46,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3cd559eef1735ba84fe/lava-logs.yaml 2026-05-04 01:19:46,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:46,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:46,301 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3cd559eef1735ba84fe/lava_callback.json.gz 2026-05-04 01:19:46,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:46,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3cd559eef1735ba84fe HTTP/1.1" 200 None 2026-05-04 01:19:46,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:46,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:46,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:46,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3cd559eef1735ba84fe HTTP/1.1" 200 None 2026-05-04 01:19:46,374 - lava_callback - INFO - Completed processing callback for node 69f7f3cd559eef1735ba84fe INFO: 172.20.0.1:40770 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:19:48,162 - lava_callback - INFO - Received callback for node 69f7f3e9559eef1735ba8568 INFO: 172.20.0.1:40772 - "POST /node/69f7f3e9559eef1735ba8568 HTTP/1.0" 202 Accepted 2026-05-04 01:19:48,169 - lava_callback - INFO - Starting async job submit for node 69f7f3e9559eef1735ba8568 2026-05-04 01:19:48,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:48,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e9559eef1735ba8568 HTTP/1.1" 200 None 2026-05-04 01:19:48,205 - lava_callback - DEBUG - Processing node 69f7f3e9559eef1735ba8568: baseline-nfs-arm64 2026-05-04 01:19:48,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:48,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:48,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e9559eef1735ba8568/log.txt.gz 2026-05-04 01:19:48,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:49,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:49,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e9559eef1735ba8568/lava-logs.yaml 2026-05-04 01:19:49,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:49,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:49,236 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e9559eef1735ba8568/lava_callback.json.gz 2026-05-04 01:19:49,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:49,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e9559eef1735ba8568 HTTP/1.1" 200 None 2026-05-04 01:19:49,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:49,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:49,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:49,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3e9559eef1735ba8568 HTTP/1.1" 200 None 2026-05-04 01:19:49,318 - lava_callback - INFO - Completed processing callback for node 69f7f3e9559eef1735ba8568 2026-05-04 01:19:52,925 - lava_callback - INFO - Received callback for node 69f7f3db559eef1735ba8540 INFO: 172.20.0.1:38396 - "POST /node/69f7f3db559eef1735ba8540 HTTP/1.0" 202 Accepted 2026-05-04 01:19:52,931 - lava_callback - INFO - Starting async job submit for node 69f7f3db559eef1735ba8540 2026-05-04 01:19:52,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:52,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3db559eef1735ba8540 HTTP/1.1" 200 None 2026-05-04 01:19:52,967 - lava_callback - DEBUG - Processing node 69f7f3db559eef1735ba8540: baseline-arm64 2026-05-04 01:19:53,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:53,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:53,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3db559eef1735ba8540/log.txt.gz 2026-05-04 01:19:53,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:53,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:53,744 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3db559eef1735ba8540/lava-logs.yaml 2026-05-04 01:19:53,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:53,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:53,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3db559eef1735ba8540/lava_callback.json.gz 2026-05-04 01:19:53,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:53,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3db559eef1735ba8540 HTTP/1.1" 200 None 2026-05-04 01:19:53,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:53,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:53,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:53,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3db559eef1735ba8540 HTTP/1.1" 200 None 2026-05-04 01:19:54,027 - lava_callback - INFO - Completed processing callback for node 69f7f3db559eef1735ba8540 INFO: 172.20.0.1:38404 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:19:58,482 - lava_callback - INFO - Received callback for node 69f7f3e5559eef1735ba855f INFO: 172.20.0.1:38420 - "POST /node/69f7f3e5559eef1735ba855f HTTP/1.0" 202 Accepted 2026-05-04 01:19:58,488 - lava_callback - INFO - Starting async job submit for node 69f7f3e5559eef1735ba855f 2026-05-04 01:19:58,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:58,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e5559eef1735ba855f HTTP/1.1" 200 None 2026-05-04 01:19:58,531 - lava_callback - DEBUG - Processing node 69f7f3e5559eef1735ba855f: baseline-nfs-arm64 2026-05-04 01:19:58,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:58,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:58,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e5559eef1735ba855f/log.txt.gz 2026-05-04 01:19:59,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:59,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:59,314 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e5559eef1735ba855f/lava-logs.yaml 2026-05-04 01:19:59,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:19:59,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:19:59,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e5559eef1735ba855f/lava_callback.json.gz 2026-05-04 01:19:59,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:59,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e5559eef1735ba855f HTTP/1.1" 200 None 2026-05-04 01:19:59,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:59,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:19:59,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:19:59,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3e5559eef1735ba855f HTTP/1.1" 200 None 2026-05-04 01:19:59,525 - lava_callback - INFO - Completed processing callback for node 69f7f3e5559eef1735ba855f 2026-05-04 01:20:01,396 - lava_callback - INFO - Received callback for node 69f7f3e2559eef1735ba8556 INFO: 172.20.0.1:53650 - "POST /node/69f7f3e2559eef1735ba8556 HTTP/1.0" 202 Accepted 2026-05-04 01:20:01,403 - lava_callback - INFO - Starting async job submit for node 69f7f3e2559eef1735ba8556 2026-05-04 01:20:01,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:01,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e2559eef1735ba8556 HTTP/1.1" 200 None 2026-05-04 01:20:01,490 - lava_callback - DEBUG - Processing node 69f7f3e2559eef1735ba8556: baseline-nfs-arm64 2026-05-04 01:20:02,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:02,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:02,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e2559eef1735ba8556/log.txt.gz 2026-05-04 01:20:02,301 - lava_callback - INFO - Received callback for node 69f7f3ea559eef1735ba856b INFO: 172.20.0.1:53654 - "POST /node/69f7f3ea559eef1735ba856b HTTP/1.0" 202 Accepted 2026-05-04 01:20:02,317 - lava_callback - INFO - Starting async job submit for node 69f7f3ea559eef1735ba856b 2026-05-04 01:20:02,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:02,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3ea559eef1735ba856b HTTP/1.1" 200 None 2026-05-04 01:20:02,465 - lava_callback - DEBUG - Processing node 69f7f3ea559eef1735ba856b: baseline-nfs-arm64 2026-05-04 01:20:02,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:02,565 - lava_callback - INFO - Received callback for node 69f7f3e7559eef1735ba8565 2026-05-04 01:20:02,587 - lava_callback - INFO - Starting async job submit for node 69f7f3e7559eef1735ba8565 INFO: 172.20.0.1:53656 - "POST /node/69f7f3e7559eef1735ba8565 HTTP/1.0" 202 Accepted 2026-05-04 01:20:02,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:02,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e7559eef1735ba8565 HTTP/1.1" 200 None 2026-05-04 01:20:02,731 - lava_callback - DEBUG - Processing node 69f7f3e7559eef1735ba8565: baseline-nfs-arm64 2026-05-04 01:20:02,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:03,119 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e2559eef1735ba8556/lava-logs.yaml 2026-05-04 01:20:03,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:03,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:03,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:03,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:03,380 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3ea559eef1735ba856b/log.txt.gz 2026-05-04 01:20:03,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:03,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e7559eef1735ba8565/log.txt.gz 2026-05-04 01:20:03,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:03,521 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e2559eef1735ba8556/lava_callback.json.gz 2026-05-04 01:20:03,532 - lava_callback - INFO - Received callback for node 69f7f40c559eef1735ba85f6 2026-05-04 01:20:03,548 - lava_callback - INFO - Starting async job submit for node 69f7f40c559eef1735ba85f6 INFO: 172.20.0.1:53666 - "POST /node/69f7f40c559eef1735ba85f6 HTTP/1.0" 202 Accepted 2026-05-04 01:20:03,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:03,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:03,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:03,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f40c559eef1735ba85f6 HTTP/1.1" 200 None 2026-05-04 01:20:03,864 - lava_callback - DEBUG - Processing node 69f7f40c559eef1735ba85f6: baseline-arm64-pengutronix 2026-05-04 01:20:03,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e2559eef1735ba8556 HTTP/1.1" 200 None 2026-05-04 01:20:03,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:03,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:04,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:20:04,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:04,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:04,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3e2559eef1735ba8556 HTTP/1.1" 200 None 2026-05-04 01:20:04,128 - lava_callback - INFO - Completed processing callback for node 69f7f3e2559eef1735ba8556 2026-05-04 01:20:04,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:04,186 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3ea559eef1735ba856b/lava-logs.yaml 2026-05-04 01:20:04,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:04,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:04,241 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f7f40c559eef1735ba85f6/log.txt.gz 2026-05-04 01:20:04,270 - lava_callback - INFO - Received callback for node 69f7f410559eef1735ba8626 INFO: 172.20.0.1:53680 - "POST /node/69f7f410559eef1735ba8626 HTTP/1.0" 202 Accepted 2026-05-04 01:20:04,282 - lava_callback - INFO - Starting async job submit for node 69f7f410559eef1735ba8626 2026-05-04 01:20:04,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:04,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:04,372 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e7559eef1735ba8565/lava-logs.yaml 2026-05-04 01:20:04,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:04,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f410559eef1735ba8626 HTTP/1.1" 200 None 2026-05-04 01:20:04,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3ea559eef1735ba856b/lava_callback.json.gz 2026-05-04 01:20:04,428 - lava_callback - DEBUG - Processing node 69f7f410559eef1735ba8626: baseline-arm64-foundriesio 2026-05-04 01:20:04,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:04,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:04,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:04,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3ea559eef1735ba856b HTTP/1.1" 200 None 2026-05-04 01:20:04,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:04,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:04,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:20:04,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:04,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3ea559eef1735ba856b HTTP/1.1" 200 None 2026-05-04 01:20:04,743 - lava_callback - INFO - Completed processing callback for node 69f7f3ea559eef1735ba856b 2026-05-04 01:20:04,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:04,824 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f7f40c559eef1735ba85f6/lava-logs.yaml 2026-05-04 01:20:04,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:04,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:04,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e7559eef1735ba8565/lava_callback.json.gz 2026-05-04 01:20:04,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:04,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:04,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f7f410559eef1735ba8626/log.txt.gz 2026-05-04 01:20:04,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e7559eef1735ba8565 HTTP/1.1" 200 None 2026-05-04 01:20:04,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:04,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:05,025 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f7f40c559eef1735ba85f6/lava_callback.json.gz 2026-05-04 01:20:05,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:05,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:05,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:20:05,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:05,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f40c559eef1735ba85f6 HTTP/1.1" 200 None 2026-05-04 01:20:05,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:05,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3e7559eef1735ba8565 HTTP/1.1" 200 None 2026-05-04 01:20:05,103 - lava_callback - INFO - Completed processing callback for node 69f7f3e7559eef1735ba8565 2026-05-04 01:20:05,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:20:05,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:05,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f40c559eef1735ba85f6 HTTP/1.1" 200 None 2026-05-04 01:20:05,180 - lava_callback - INFO - Completed processing callback for node 69f7f40c559eef1735ba85f6 2026-05-04 01:20:05,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:05,263 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f7f410559eef1735ba8626/lava-logs.yaml 2026-05-04 01:20:05,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:05,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:05,392 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f7f410559eef1735ba8626/lava_callback.json.gz 2026-05-04 01:20:05,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:05,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f410559eef1735ba8626 HTTP/1.1" 200 None 2026-05-04 01:20:05,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:05,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:20:05,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:05,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f410559eef1735ba8626 HTTP/1.1" 200 None 2026-05-04 01:20:05,483 - lava_callback - INFO - Completed processing callback for node 69f7f410559eef1735ba8626 2026-05-04 01:20:06,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:06,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:53688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53698 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:20:07,273 - lava_callback - INFO - Received callback for node 69f7f3e0559eef1735ba8550 INFO: 172.20.0.1:53710 - "POST /node/69f7f3e0559eef1735ba8550 HTTP/1.0" 202 Accepted 2026-05-04 01:20:07,279 - lava_callback - INFO - Starting async job submit for node 69f7f3e0559eef1735ba8550 2026-05-04 01:20:07,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:07,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e0559eef1735ba8550 HTTP/1.1" 200 None 2026-05-04 01:20:07,323 - lava_callback - DEBUG - Processing node 69f7f3e0559eef1735ba8550: baseline-nfs-arm64 2026-05-04 01:20:07,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:07,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:07,758 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e0559eef1735ba8550/log.txt.gz 2026-05-04 01:20:07,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:08,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:08,087 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e0559eef1735ba8550/lava-logs.yaml 2026-05-04 01:20:08,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:08,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:08,184 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e0559eef1735ba8550/lava_callback.json.gz 2026-05-04 01:20:08,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:08,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e0559eef1735ba8550 HTTP/1.1" 200 None 2026-05-04 01:20:08,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:08,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:20:08,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:08,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3e0559eef1735ba8550 HTTP/1.1" 200 None 2026-05-04 01:20:08,263 - lava_callback - INFO - Completed processing callback for node 69f7f3e0559eef1735ba8550 2026-05-04 01:20:10,325 - lava_callback - INFO - Received callback for node 69f7f40e559eef1735ba8620 INFO: 172.20.0.1:48986 - "POST /node/69f7f40e559eef1735ba8620 HTTP/1.0" 202 Accepted 2026-05-04 01:20:10,334 - lava_callback - INFO - Starting async job submit for node 69f7f40e559eef1735ba8620 2026-05-04 01:20:10,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:10,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f40e559eef1735ba8620 HTTP/1.1" 200 None 2026-05-04 01:20:10,378 - lava_callback - DEBUG - Processing node 69f7f40e559eef1735ba8620: baseline-arm64-pengutronix 2026-05-04 01:20:10,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:10,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:10,665 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f7f40e559eef1735ba8620/log.txt.gz 2026-05-04 01:20:10,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:10,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:10,937 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f7f40e559eef1735ba8620/lava-logs.yaml 2026-05-04 01:20:10,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:11,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:11,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f7f40e559eef1735ba8620/lava_callback.json.gz 2026-05-04 01:20:11,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:11,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f40e559eef1735ba8620 HTTP/1.1" 200 None 2026-05-04 01:20:11,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:11,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:20:11,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:11,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f40e559eef1735ba8620 HTTP/1.1" 200 None 2026-05-04 01:20:11,137 - lava_callback - INFO - Completed processing callback for node 69f7f40e559eef1735ba8620 INFO: 172.20.0.1:49002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49016 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:20:21,686 - lava_callback - INFO - Received callback for node 69f7f3dd559eef1735ba854a INFO: 172.20.0.1:39312 - "POST /node/69f7f3dd559eef1735ba854a HTTP/1.0" 202 Accepted 2026-05-04 01:20:21,693 - lava_callback - INFO - Starting async job submit for node 69f7f3dd559eef1735ba854a 2026-05-04 01:20:21,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:21,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3dd559eef1735ba854a HTTP/1.1" 200 None 2026-05-04 01:20:21,734 - lava_callback - DEBUG - Processing node 69f7f3dd559eef1735ba854a: baseline-nfs-arm64 2026-05-04 01:20:22,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:22,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:22,158 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3dd559eef1735ba854a/log.txt.gz 2026-05-04 01:20:22,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:22,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:22,498 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3dd559eef1735ba854a/lava-logs.yaml 2026-05-04 01:20:22,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:22,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:22,632 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3dd559eef1735ba854a/lava_callback.json.gz 2026-05-04 01:20:22,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:22,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3dd559eef1735ba854a HTTP/1.1" 200 None 2026-05-04 01:20:22,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:22,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:20:22,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:22,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3dd559eef1735ba854a HTTP/1.1" 200 None 2026-05-04 01:20:22,708 - lava_callback - INFO - Completed processing callback for node 69f7f3dd559eef1735ba854a 2026-05-04 01:20:23,019 - lava_callback - INFO - Received callback for node 69f7f40f559eef1735ba8623 INFO: 172.20.0.1:39324 - "POST /node/69f7f40f559eef1735ba8623 HTTP/1.0" 202 Accepted 2026-05-04 01:20:23,025 - lava_callback - INFO - Starting async job submit for node 69f7f40f559eef1735ba8623 2026-05-04 01:20:23,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:23,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f40f559eef1735ba8623 HTTP/1.1" 200 None 2026-05-04 01:20:23,065 - lava_callback - DEBUG - Processing node 69f7f40f559eef1735ba8623: baseline-arm64-pengutronix 2026-05-04 01:20:23,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:23,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:23,345 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f7f40f559eef1735ba8623/log.txt.gz 2026-05-04 01:20:23,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:23,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:23,592 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f7f40f559eef1735ba8623/lava-logs.yaml 2026-05-04 01:20:23,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:23,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:23,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f7f40f559eef1735ba8623/lava_callback.json.gz 2026-05-04 01:20:23,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:23,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f40f559eef1735ba8623 HTTP/1.1" 200 None 2026-05-04 01:20:23,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:23,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:20:23,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:23,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f40f559eef1735ba8623 HTTP/1.1" 200 None 2026-05-04 01:20:23,775 - lava_callback - INFO - Completed processing callback for node 69f7f40f559eef1735ba8623 INFO: 172.20.0.1:39332 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:20:27,366 - lava_callback - INFO - Received callback for node 69f7f40b559eef1735ba85f1 INFO: 172.20.0.1:39340 - "POST /node/69f7f40b559eef1735ba85f1 HTTP/1.0" 202 Accepted 2026-05-04 01:20:27,372 - lava_callback - INFO - Starting async job submit for node 69f7f40b559eef1735ba85f1 2026-05-04 01:20:27,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:27,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f40b559eef1735ba85f1 HTTP/1.1" 200 None 2026-05-04 01:20:27,409 - lava_callback - DEBUG - Processing node 69f7f40b559eef1735ba85f1: baseline-arm64-kontron 2026-05-04 01:20:27,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:27,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:27,820 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69f7f40b559eef1735ba85f1/log.txt.gz 2026-05-04 01:20:27,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:28,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:28,122 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69f7f40b559eef1735ba85f1/lava-logs.yaml 2026-05-04 01:20:28,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:28,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:28,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69f7f40b559eef1735ba85f1/lava_callback.json.gz 2026-05-04 01:20:28,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:28,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f40b559eef1735ba85f1 HTTP/1.1" 200 None 2026-05-04 01:20:28,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:28,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:20:28,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:28,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f40b559eef1735ba85f1 HTTP/1.1" 200 None 2026-05-04 01:20:28,305 - lava_callback - INFO - Completed processing callback for node 69f7f40b559eef1735ba85f1 2026-05-04 01:20:32,741 - lava_callback - INFO - Received callback for node 69f7f410559eef1735ba8629 INFO: 172.20.0.1:40066 - "POST /node/69f7f410559eef1735ba8629 HTTP/1.0" 202 Accepted 2026-05-04 01:20:32,749 - lava_callback - INFO - Starting async job submit for node 69f7f410559eef1735ba8629 2026-05-04 01:20:32,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:32,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f410559eef1735ba8629 HTTP/1.1" 200 None 2026-05-04 01:20:32,802 - lava_callback - DEBUG - Processing node 69f7f410559eef1735ba8629: baseline-arm64-foundriesio 2026-05-04 01:20:33,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:33,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:33,284 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f7f410559eef1735ba8629/log.txt.gz 2026-05-04 01:20:33,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:33,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:33,695 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f7f410559eef1735ba8629/lava-logs.yaml 2026-05-04 01:20:33,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:33,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:33,829 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f7f410559eef1735ba8629/lava_callback.json.gz 2026-05-04 01:20:33,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:33,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f410559eef1735ba8629 HTTP/1.1" 200 None 2026-05-04 01:20:33,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:33,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:20:33,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:33,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f410559eef1735ba8629 HTTP/1.1" 200 None 2026-05-04 01:20:33,922 - lava_callback - INFO - Completed processing callback for node 69f7f410559eef1735ba8629 2026-05-04 01:20:36,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:36,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35474 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:20:59,455 - lava_callback - INFO - Received callback for node 69f7f3ff559eef1735ba85ca INFO: 172.20.0.1:35488 - "POST /node/69f7f3ff559eef1735ba85ca HTTP/1.0" 202 Accepted 2026-05-04 01:20:59,461 - lava_callback - INFO - Starting async job submit for node 69f7f3ff559eef1735ba85ca 2026-05-04 01:20:59,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:20:59,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3ff559eef1735ba85ca HTTP/1.1" 200 None 2026-05-04 01:20:59,497 - lava_callback - DEBUG - Processing node 69f7f3ff559eef1735ba85ca: baseline-arm64-broonie 2026-05-04 01:20:59,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:20:59,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:20:59,861 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3ff559eef1735ba85ca/log.txt.gz 2026-05-04 01:21:00,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:21:00,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:21:00,182 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3ff559eef1735ba85ca/lava-logs.yaml 2026-05-04 01:21:00,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:21:00,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:21:00,303 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3ff559eef1735ba85ca/lava_callback.json.gz 2026-05-04 01:21:00,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:21:00,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3ff559eef1735ba85ca HTTP/1.1" 200 None 2026-05-04 01:21:00,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:21:00,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:21:00,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:21:00,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3ff559eef1735ba85ca HTTP/1.1" 200 None 2026-05-04 01:21:00,390 - lava_callback - INFO - Completed processing callback for node 69f7f3ff559eef1735ba85ca 2026-05-04 01:21:00,912 - lava_callback - INFO - Received callback for node 69f7f403559eef1735ba85d0 INFO: 172.20.0.1:42036 - "POST /node/69f7f403559eef1735ba85d0 HTTP/1.0" 202 Accepted 2026-05-04 01:21:00,918 - lava_callback - INFO - Starting async job submit for node 69f7f403559eef1735ba85d0 2026-05-04 01:21:00,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:21:00,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f403559eef1735ba85d0 HTTP/1.1" 200 None 2026-05-04 01:21:00,956 - lava_callback - DEBUG - Processing node 69f7f403559eef1735ba85d0: baseline-arm64-broonie 2026-05-04 01:21:01,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:21:01,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:21:01,292 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f403559eef1735ba85d0/log.txt.gz 2026-05-04 01:21:01,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:21:01,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:21:01,578 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f403559eef1735ba85d0/lava-logs.yaml 2026-05-04 01:21:01,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:21:01,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:21:01,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f403559eef1735ba85d0/lava_callback.json.gz 2026-05-04 01:21:01,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:21:01,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f403559eef1735ba85d0 HTTP/1.1" 200 None 2026-05-04 01:21:01,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:21:01,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:21:01,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:21:01,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f403559eef1735ba85d0 HTTP/1.1" 200 None 2026-05-04 01:21:01,763 - lava_callback - INFO - Completed processing callback for node 69f7f403559eef1735ba85d0 2026-05-04 01:21:06,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:21:06,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57766 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:21:59,104 - lava_callback - INFO - Received callback for node 69f7f3fb559eef1735ba85c1 INFO: 172.20.0.1:57770 - "POST /node/69f7f3fb559eef1735ba85c1 HTTP/1.0" 202 Accepted 2026-05-04 01:21:59,110 - lava_callback - INFO - Starting async job submit for node 69f7f3fb559eef1735ba85c1 2026-05-04 01:21:59,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:21:59,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3fb559eef1735ba85c1 HTTP/1.1" 200 None 2026-05-04 01:21:59,165 - lava_callback - DEBUG - Processing node 69f7f3fb559eef1735ba85c1: baseline-arm64-broonie 2026-05-04 01:21:59,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:21:59,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:21:59,534 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3fb559eef1735ba85c1/log.txt.gz 2026-05-04 01:21:59,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:21:59,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:21:59,881 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3fb559eef1735ba85c1/lava-logs.yaml 2026-05-04 01:21:59,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:22:00,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:22:00,005 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3fb559eef1735ba85c1/lava_callback.json.gz 2026-05-04 01:22:00,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:00,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3fb559eef1735ba85c1 HTTP/1.1" 200 None 2026-05-04 01:22:00,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:00,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:22:00,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:00,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3fb559eef1735ba85c1 HTTP/1.1" 200 None 2026-05-04 01:22:00,082 - lava_callback - INFO - Completed processing callback for node 69f7f3fb559eef1735ba85c1 2026-05-04 01:22:05,745 - lava_callback - INFO - Received callback for node 69f7f3d0559eef1735ba8508 INFO: 172.20.0.1:53762 - "POST /node/69f7f3d0559eef1735ba8508 HTTP/1.0" 202 Accepted 2026-05-04 01:22:05,750 - lava_callback - INFO - Starting async job submit for node 69f7f3d0559eef1735ba8508 2026-05-04 01:22:05,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:05,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d0559eef1735ba8508 HTTP/1.1" 200 None 2026-05-04 01:22:05,787 - lava_callback - DEBUG - Processing node 69f7f3d0559eef1735ba8508: baseline-arm64 2026-05-04 01:22:06,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:06,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:22:06,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 01:22:06,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:22:06,212 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d0559eef1735ba8508/log.txt.gz 2026-05-04 01:22:06,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:53770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53778 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:22:06,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:22:06,556 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d0559eef1735ba8508/lava-logs.yaml 2026-05-04 01:22:06,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:22:06,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:22:06,665 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d0559eef1735ba8508/lava_callback.json.gz 2026-05-04 01:22:06,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:06,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d0559eef1735ba8508 HTTP/1.1" 200 None 2026-05-04 01:22:06,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:06,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:22:06,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:06,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3d0559eef1735ba8508 HTTP/1.1" 200 None 2026-05-04 01:22:06,788 - lava_callback - INFO - Completed processing callback for node 69f7f3d0559eef1735ba8508 INFO: 172.20.0.1:51220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51228 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:22:25,615 - lava_callback - INFO - Received callback for node 69f7f3df559eef1735ba854d INFO: 172.20.0.1:49326 - "POST /node/69f7f3df559eef1735ba854d HTTP/1.0" 202 Accepted 2026-05-04 01:22:25,621 - lava_callback - INFO - Starting async job submit for node 69f7f3df559eef1735ba854d 2026-05-04 01:22:25,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:25,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3df559eef1735ba854d HTTP/1.1" 200 None 2026-05-04 01:22:25,704 - lava_callback - DEBUG - Processing node 69f7f3df559eef1735ba854d: baseline-nfs-arm64 2026-05-04 01:22:26,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:22:26,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:22:26,204 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3df559eef1735ba854d/log.txt.gz 2026-05-04 01:22:26,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:49334 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:22:26,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:22:26,593 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3df559eef1735ba854d/lava-logs.yaml 2026-05-04 01:22:26,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:22:26,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:22:26,726 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3df559eef1735ba854d/lava_callback.json.gz 2026-05-04 01:22:26,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:26,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3df559eef1735ba854d HTTP/1.1" 200 None 2026-05-04 01:22:26,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:26,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:22:26,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:26,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3df559eef1735ba854d HTTP/1.1" 200 None 2026-05-04 01:22:26,794 - lava_callback - INFO - Completed processing callback for node 69f7f3df559eef1735ba854d 2026-05-04 01:22:34,060 - lava_callback - INFO - Received callback for node 69f7f3fd559eef1735ba85c4 INFO: 172.20.0.1:36010 - "POST /node/69f7f3fd559eef1735ba85c4 HTTP/1.0" 202 Accepted 2026-05-04 01:22:34,066 - lava_callback - INFO - Starting async job submit for node 69f7f3fd559eef1735ba85c4 2026-05-04 01:22:34,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:34,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3fd559eef1735ba85c4 HTTP/1.1" 200 None 2026-05-04 01:22:34,106 - lava_callback - DEBUG - Processing node 69f7f3fd559eef1735ba85c4: baseline-arm64-broonie 2026-05-04 01:22:34,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:22:34,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:22:34,452 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3fd559eef1735ba85c4/log.txt.gz 2026-05-04 01:22:34,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:22:34,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:22:34,752 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3fd559eef1735ba85c4/lava-logs.yaml 2026-05-04 01:22:34,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:22:34,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:22:34,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3fd559eef1735ba85c4/lava_callback.json.gz 2026-05-04 01:22:34,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:34,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3fd559eef1735ba85c4 HTTP/1.1" 200 None 2026-05-04 01:22:34,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:34,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:22:34,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:34,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3fd559eef1735ba85c4 HTTP/1.1" 200 None 2026-05-04 01:22:34,949 - lava_callback - INFO - Completed processing callback for node 69f7f3fd559eef1735ba85c4 2026-05-04 01:22:36,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:22:36,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51018 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:24:14,011 - lava_callback - INFO - Received callback for node 69f7efc6559eef1735ba82fc INFO: 172.20.0.1:39198 - "POST /node/69f7efc6559eef1735ba82fc HTTP/1.0" 202 Accepted 2026-05-04 01:24:14,017 - lava_callback - INFO - Starting async job submit for node 69f7efc6559eef1735ba82fc 2026-05-04 01:24:14,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:14,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7efc6559eef1735ba82fc HTTP/1.1" 200 None 2026-05-04 01:24:14,094 - lava_callback - DEBUG - Processing node 69f7efc6559eef1735ba82fc: ltp-smoke 2026-05-04 01:24:14,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:24:14,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:24:14,676 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7efc6559eef1735ba82fc/log.txt.gz 2026-05-04 01:24:14,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:24:15,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:24:15,130 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7efc6559eef1735ba82fc/lava-logs.yaml 2026-05-04 01:24:15,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:39204 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 01:24:15,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:24:15,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7efc6559eef1735ba82fc/lava_callback.json.gz 2026-05-04 01:24:15,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:15,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7efc6559eef1735ba82fc HTTP/1.1" 200 None 2026-05-04 01:24:15,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:15,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5be559eef1735ba573d HTTP/1.1" 200 None 2026-05-04 01:24:15,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:15,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7efc6559eef1735ba82fc HTTP/1.1" 200 None 2026-05-04 01:24:15,771 - lava_callback - INFO - Completed processing callback for node 69f7efc6559eef1735ba82fc INFO: 172.20.0.1:39216 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:24:19,181 - lava_callback - INFO - Received callback for node 69f7f401559eef1735ba85cd INFO: 172.20.0.1:39232 - "POST /node/69f7f401559eef1735ba85cd HTTP/1.0" 202 Accepted 2026-05-04 01:24:19,187 - lava_callback - INFO - Starting async job submit for node 69f7f401559eef1735ba85cd 2026-05-04 01:24:19,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:19,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f401559eef1735ba85cd HTTP/1.1" 200 None 2026-05-04 01:24:19,223 - lava_callback - DEBUG - Processing node 69f7f401559eef1735ba85cd: baseline-arm64-broonie 2026-05-04 01:24:19,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:24:19,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:24:19,591 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f401559eef1735ba85cd/log.txt.gz 2026-05-04 01:24:19,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:24:19,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:24:19,887 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f401559eef1735ba85cd/lava-logs.yaml 2026-05-04 01:24:19,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:24:19,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:24:19,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f401559eef1735ba85cd/lava_callback.json.gz 2026-05-04 01:24:20,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:20,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f401559eef1735ba85cd HTTP/1.1" 200 None 2026-05-04 01:24:20,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:20,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:24:20,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:20,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f401559eef1735ba85cd HTTP/1.1" 200 None 2026-05-04 01:24:20,082 - lava_callback - INFO - Completed processing callback for node 69f7f401559eef1735ba85cd INFO: 172.20.0.1:58274 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:24:28,398 - lava_callback - INFO - Received callback for node 69f7f534559eef1735ba8770 INFO: 172.20.0.1:58280 - "POST /node/69f7f534559eef1735ba8770 HTTP/1.0" 202 Accepted 2026-05-04 01:24:28,404 - lava_callback - INFO - Starting async job submit for node 69f7f534559eef1735ba8770 2026-05-04 01:24:28,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:28,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f534559eef1735ba8770 HTTP/1.1" 200 None 2026-05-04 01:24:28,459 - lava_callback - DEBUG - Processing node 69f7f534559eef1735ba8770: baseline-nfs-arm64 2026-05-04 01:24:28,460 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:24:28,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:24:28,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:24:28,713 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f534559eef1735ba8770/lava-logs.yaml 2026-05-04 01:24:28,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:24:28,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:24:28,814 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f534559eef1735ba8770/lava_callback.json.gz 2026-05-04 01:24:28,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:28,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f534559eef1735ba8770 HTTP/1.1" 200 None 2026-05-04 01:24:28,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:28,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:24:28,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:28,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f534559eef1735ba8770 HTTP/1.1" 200 None 2026-05-04 01:24:28,867 - lava_callback - INFO - Completed processing callback for node 69f7f534559eef1735ba8770 2026-05-04 01:24:36,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:24:36,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37204 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:26:01,394 - lava_callback - INFO - Received callback for node 69f7f57b559eef1735ba87a3 INFO: 172.20.0.1:41412 - "POST /node/69f7f57b559eef1735ba87a3 HTTP/1.0" 202 Accepted 2026-05-04 01:26:01,400 - lava_callback - INFO - Starting async job submit for node 69f7f57b559eef1735ba87a3 2026-05-04 01:26:01,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:26:01,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f57b559eef1735ba87a3 HTTP/1.1" 200 None 2026-05-04 01:26:01,443 - lava_callback - DEBUG - Processing node 69f7f57b559eef1735ba87a3: baseline-arm64 2026-05-04 01:26:01,573 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:26:01,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:26:01,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:26:01,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f57b559eef1735ba87a3/lava-logs.yaml 2026-05-04 01:26:01,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:26:02,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:26:02,214 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f57b559eef1735ba87a3/lava_callback.json.gz 2026-05-04 01:26:02,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:26:02,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f57b559eef1735ba87a3 HTTP/1.1" 200 None 2026-05-04 01:26:02,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:26:02,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:26:02,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:26:02,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f57b559eef1735ba87a3 HTTP/1.1" 200 None 2026-05-04 01:26:02,358 - lava_callback - INFO - Completed processing callback for node 69f7f57b559eef1735ba87a3 2026-05-04 01:26:06,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:26:06,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41434 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:26:07,998 - lava_callback - INFO - Received callback for node 69f7f3dc559eef1735ba8547 INFO: 172.20.0.1:41450 - "POST /node/69f7f3dc559eef1735ba8547 HTTP/1.0" 202 Accepted 2026-05-04 01:26:08,005 - lava_callback - INFO - Starting async job submit for node 69f7f3dc559eef1735ba8547 2026-05-04 01:26:08,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:26:08,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3dc559eef1735ba8547 HTTP/1.1" 200 None 2026-05-04 01:26:08,056 - lava_callback - DEBUG - Processing node 69f7f3dc559eef1735ba8547: baseline-arm64 2026-05-04 01:26:08,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:26:08,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:26:08,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3dc559eef1735ba8547/log.txt.gz 2026-05-04 01:26:08,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:26:08,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:26:08,921 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3dc559eef1735ba8547/lava-logs.yaml 2026-05-04 01:26:08,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:26:09,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:26:09,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3dc559eef1735ba8547/lava_callback.json.gz DEBUG: Setup failed for 69f7f3dc559eef1735ba8547. Transitting job node result: incomplete -> fail 2026-05-04 01:26:09,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:26:09,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3dc559eef1735ba8547 HTTP/1.1" 200 None 2026-05-04 01:26:09,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:26:09,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:26:09,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:26:09,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3dc559eef1735ba8547 HTTP/1.1" 200 None 2026-05-04 01:26:09,266 - lava_callback - INFO - Completed processing callback for node 69f7f3dc559eef1735ba8547 INFO: 172.20.0.1:42582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45644 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:26:36,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:26:36,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46800 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:27:20,330 - lava_callback - INFO - Received callback for node 69f7f5c8559eef1735ba87c8 INFO: 172.20.0.1:40008 - "POST /node/69f7f5c8559eef1735ba87c8 HTTP/1.0" 202 Accepted 2026-05-04 01:27:20,336 - lava_callback - INFO - Starting async job submit for node 69f7f5c8559eef1735ba87c8 2026-05-04 01:27:20,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:27:20,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f5c8559eef1735ba87c8 HTTP/1.1" 200 None 2026-05-04 01:27:20,379 - lava_callback - DEBUG - Processing node 69f7f5c8559eef1735ba87c8: baseline-arm64 2026-05-04 01:27:20,523 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:27:20,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:27:20,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:27:20,905 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f5c8559eef1735ba87c8/lava-logs.yaml 2026-05-04 01:27:20,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:27:21,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:27:21,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f5c8559eef1735ba87c8/lava_callback.json.gz 2026-05-04 01:27:21,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:27:21,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f5c8559eef1735ba87c8 HTTP/1.1" 200 None 2026-05-04 01:27:21,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:27:21,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:27:21,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:27:21,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f5c8559eef1735ba87c8 HTTP/1.1" 200 None 2026-05-04 01:27:21,193 - lava_callback - INFO - Completed processing callback for node 69f7f5c8559eef1735ba87c8 INFO: 172.20.0.1:40016 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:27:29,329 - lava_callback - INFO - Received callback for node 69f552eeed4ed40b02240c99 INFO: 172.20.0.1:40028 - "POST /node/69f552eeed4ed40b02240c99 HTTP/1.0" 202 Accepted 2026-05-04 01:27:29,334 - lava_callback - INFO - Starting async job submit for node 69f552eeed4ed40b02240c99 2026-05-04 01:27:29,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:27:29,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f552eeed4ed40b02240c99 HTTP/1.1" 200 None 2026-05-04 01:27:29,363 - lava_callback - DEBUG - Processing node 69f552eeed4ed40b02240c99: baseline-arm64-baylibre 2026-05-04 01:27:29,364 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f552eeed4ed40b02240c99 2026-05-04 01:27:29,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:27:29,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f552eeed4ed40b02240c99 HTTP/1.1" 200 None 2026-05-04 01:27:29,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:27:29,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 01:27:29,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:27:29,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f552eeed4ed40b02240c99 HTTP/1.1" 200 None 2026-05-04 01:27:29,411 - lava_callback - ERROR - Error processing callback for node 69f552eeed4ed40b02240c99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 01:27:36,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:27:36,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37734 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:28:27,022 - lava_callback - INFO - Received callback for node 69f7f3d8559eef1735ba8537 INFO: 172.20.0.1:37740 - "POST /node/69f7f3d8559eef1735ba8537 HTTP/1.0" 202 Accepted 2026-05-04 01:28:27,028 - lava_callback - INFO - Starting async job submit for node 69f7f3d8559eef1735ba8537 2026-05-04 01:28:27,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:28:27,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d8559eef1735ba8537 HTTP/1.1" 200 None 2026-05-04 01:28:27,066 - lava_callback - DEBUG - Processing node 69f7f3d8559eef1735ba8537: baseline-arm64 2026-05-04 01:28:27,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:28:27,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:28:27,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d8559eef1735ba8537/log.txt.gz 2026-05-04 01:28:27,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:28:28,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:28:28,282 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d8559eef1735ba8537/lava-logs.yaml 2026-05-04 01:28:28,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:28:28,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:28:28,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f3d8559eef1735ba8537/lava_callback.json.gz 2026-05-04 01:28:28,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:28:28,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3d8559eef1735ba8537 HTTP/1.1" 200 None 2026-05-04 01:28:28,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:28:28,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:28:28,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:28:28,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3d8559eef1735ba8537 HTTP/1.1" 200 None 2026-05-04 01:28:28,561 - lava_callback - INFO - Completed processing callback for node 69f7f3d8559eef1735ba8537 2026-05-04 01:28:36,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:28:36,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43612 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:28:46,825 - lava_callback - INFO - Received callback for node 69f55349ed4ed40b02240cbd INFO: 172.20.0.1:43616 - "POST /node/69f55349ed4ed40b02240cbd HTTP/1.0" 202 Accepted 2026-05-04 01:28:46,831 - lava_callback - INFO - Starting async job submit for node 69f55349ed4ed40b02240cbd 2026-05-04 01:28:46,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:28:46,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55349ed4ed40b02240cbd HTTP/1.1" 200 None 2026-05-04 01:28:46,848 - lava_callback - DEBUG - Processing node 69f55349ed4ed40b02240cbd: baseline-arm64-clabbe 2026-05-04 01:28:46,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55349ed4ed40b02240cbd 2026-05-04 01:28:46,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:28:46,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55349ed4ed40b02240cbd HTTP/1.1" 200 None 2026-05-04 01:28:46,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:28:46,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 01:28:46,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:28:46,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55349ed4ed40b02240cbd HTTP/1.1" 200 None 2026-05-04 01:28:46,896 - lava_callback - ERROR - Error processing callback for node 69f55349ed4ed40b02240cbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50790 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:29:13,220 - lava_callback - INFO - Received callback for node 69f7f617559eef1735ba87f3 INFO: 172.20.0.1:53230 - "POST /node/69f7f617559eef1735ba87f3 HTTP/1.0" 202 Accepted 2026-05-04 01:29:13,226 - lava_callback - INFO - Starting async job submit for node 69f7f617559eef1735ba87f3 2026-05-04 01:29:13,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:29:13,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f617559eef1735ba87f3 HTTP/1.1" 200 None 2026-05-04 01:29:13,262 - lava_callback - DEBUG - Processing node 69f7f617559eef1735ba87f3: baseline-arm64 2026-05-04 01:29:13,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:29:13,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:29:13,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f617559eef1735ba87f3/log.txt.gz 2026-05-04 01:29:13,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:29:14,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:29:14,060 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f617559eef1735ba87f3/lava-logs.yaml 2026-05-04 01:29:14,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:29:14,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:29:14,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f617559eef1735ba87f3/lava_callback.json.gz 2026-05-04 01:29:14,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:29:14,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f617559eef1735ba87f3 HTTP/1.1" 200 None 2026-05-04 01:29:14,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:29:14,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:29:14,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:29:14,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f617559eef1735ba87f3 HTTP/1.1" 200 None 2026-05-04 01:29:14,317 - lava_callback - INFO - Completed processing callback for node 69f7f617559eef1735ba87f3 INFO: 172.20.0.1:53236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53240 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:29:25,098 - lava_callback - INFO - Received callback for node 69f7f3e6559eef1735ba8562 INFO: 172.20.0.1:45902 - "POST /node/69f7f3e6559eef1735ba8562 HTTP/1.0" 202 Accepted 2026-05-04 01:29:25,105 - lava_callback - INFO - Starting async job submit for node 69f7f3e6559eef1735ba8562 2026-05-04 01:29:25,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:29:25,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e6559eef1735ba8562 HTTP/1.1" 200 None 2026-05-04 01:29:25,145 - lava_callback - DEBUG - Processing node 69f7f3e6559eef1735ba8562: baseline-nfs-arm64 2026-05-04 01:29:25,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:29:25,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:29:25,933 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e6559eef1735ba8562/log.txt.gz 2026-05-04 01:29:26,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:29:26,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:29:26,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e6559eef1735ba8562/lava-logs.yaml 2026-05-04 01:29:26,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:29:26,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:29:26,455 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e6559eef1735ba8562/lava_callback.json.gz 2026-05-04 01:29:26,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:29:26,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e6559eef1735ba8562 HTTP/1.1" 200 None 2026-05-04 01:29:26,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:29:26,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:29:26,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:45906 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:29:26,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3e6559eef1735ba8562 HTTP/1.1" 200 None 2026-05-04 01:29:26,595 - lava_callback - INFO - Completed processing callback for node 69f7f3e6559eef1735ba8562 2026-05-04 01:29:36,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:29:36,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45820 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:30:07,356 - lava_callback - INFO - Received callback for node 69f5539ced4ed40b02240ce6 INFO: 172.20.0.1:45836 - "POST /node/69f5539ced4ed40b02240ce6 HTTP/1.0" 202 Accepted 2026-05-04 01:30:07,361 - lava_callback - INFO - Starting async job submit for node 69f5539ced4ed40b02240ce6 2026-05-04 01:30:07,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:30:07,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5539ced4ed40b02240ce6 HTTP/1.1" 200 None 2026-05-04 01:30:07,376 - lava_callback - DEBUG - Processing node 69f5539ced4ed40b02240ce6: baseline-arm64-clabbe 2026-05-04 01:30:07,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5539ced4ed40b02240ce6 2026-05-04 01:30:07,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:30:07,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5539ced4ed40b02240ce6 HTTP/1.1" 200 None 2026-05-04 01:30:07,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:30:07,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 01:30:07,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:30:07,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5539ced4ed40b02240ce6 HTTP/1.1" 200 None 2026-05-04 01:30:07,430 - lava_callback - ERROR - Error processing callback for node 69f5539ced4ed40b02240ce6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43454 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:31:39,514 - lava_callback - INFO - Received callback for node 69f7f3fa559eef1735ba85be INFO: 172.20.0.1:43466 - "POST /node/69f7f3fa559eef1735ba85be HTTP/1.0" 202 Accepted 2026-05-04 01:31:39,520 - lava_callback - INFO - Starting async job submit for node 69f7f3fa559eef1735ba85be 2026-05-04 01:31:39,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:31:39,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3fa559eef1735ba85be HTTP/1.1" 200 None 2026-05-04 01:31:39,557 - lava_callback - DEBUG - Processing node 69f7f3fa559eef1735ba85be: baseline-arm64-broonie 2026-05-04 01:31:39,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:31:39,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:31:39,952 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3fa559eef1735ba85be/log.txt.gz 2026-05-04 01:31:40,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:31:40,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:31:40,271 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3fa559eef1735ba85be/lava-logs.yaml 2026-05-04 01:31:40,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:31:40,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:31:40,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3fa559eef1735ba85be/lava_callback.json.gz 2026-05-04 01:31:40,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:31:40,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3fa559eef1735ba85be HTTP/1.1" 200 None 2026-05-04 01:31:40,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:31:40,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:31:40,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:31:40,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3fa559eef1735ba85be HTTP/1.1" 200 None 2026-05-04 01:31:40,615 - lava_callback - INFO - Completed processing callback for node 69f7f3fa559eef1735ba85be INFO: 172.20.0.1:57090 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:31:47,033 - lava_callback - INFO - Received callback for node 69f553efed4ed40b02240d11 INFO: 172.20.0.1:57096 - "POST /node/69f553efed4ed40b02240d11 HTTP/1.0" 202 Accepted 2026-05-04 01:31:47,039 - lava_callback - INFO - Starting async job submit for node 69f553efed4ed40b02240d11 2026-05-04 01:31:47,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:31:47,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f553efed4ed40b02240d11 HTTP/1.1" 200 None 2026-05-04 01:31:47,054 - lava_callback - DEBUG - Processing node 69f553efed4ed40b02240d11: baseline-arm64-clabbe 2026-05-04 01:31:47,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f553efed4ed40b02240d11 2026-05-04 01:31:47,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:31:47,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f553efed4ed40b02240d11 HTTP/1.1" 200 None 2026-05-04 01:31:47,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:31:47,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 01:31:47,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:31:47,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f553efed4ed40b02240d11 HTTP/1.1" 200 None 2026-05-04 01:31:47,107 - lava_callback - ERROR - Error processing callback for node 69f553efed4ed40b02240d11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41842 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:32:06,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:32:06,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52484 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:32:08,375 - lava_callback - INFO - Received callback for node 69f7f6fd559eef1735ba8875 INFO: 172.20.0.1:52498 - "POST /node/69f7f6fd559eef1735ba8875 HTTP/1.0" 202 Accepted 2026-05-04 01:32:08,381 - lava_callback - INFO - Starting async job submit for node 69f7f6fd559eef1735ba8875 2026-05-04 01:32:08,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:32:08,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f6fd559eef1735ba8875 HTTP/1.1" 200 None 2026-05-04 01:32:08,398 - lava_callback - DEBUG - Processing node 69f7f6fd559eef1735ba8875: baseline-nfs-arm64 2026-05-04 01:32:08,400 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:32:08,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:32:08,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:32:08,529 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f6fd559eef1735ba8875/lava-logs.yaml 2026-05-04 01:32:08,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:32:08,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:32:08,618 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f6fd559eef1735ba8875/lava_callback.json.gz 2026-05-04 01:32:08,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:32:08,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f6fd559eef1735ba8875 HTTP/1.1" 200 None 2026-05-04 01:32:08,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:32:08,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:32:08,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:32:08,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f6fd559eef1735ba8875 HTTP/1.1" 200 None 2026-05-04 01:32:08,683 - lava_callback - INFO - Completed processing callback for node 69f7f6fd559eef1735ba8875 INFO: 172.20.0.1:55334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54706 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:32:36,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:32:36,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42798 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:32:40,163 - lava_callback - INFO - Received callback for node 69f7f65f559eef1735ba8816 INFO: 172.20.0.1:46100 - "POST /node/69f7f65f559eef1735ba8816 HTTP/1.0" 202 Accepted 2026-05-04 01:32:40,169 - lava_callback - INFO - Starting async job submit for node 69f7f65f559eef1735ba8816 2026-05-04 01:32:40,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:32:40,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f65f559eef1735ba8816 HTTP/1.1" 200 None 2026-05-04 01:32:40,206 - lava_callback - DEBUG - Processing node 69f7f65f559eef1735ba8816: baseline-arm64 2026-05-04 01:32:40,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:32:40,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:32:40,666 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f65f559eef1735ba8816/log.txt.gz 2026-05-04 01:32:40,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:32:41,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:32:41,052 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f65f559eef1735ba8816/lava-logs.yaml 2026-05-04 01:32:41,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:32:41,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:32:41,339 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f65f559eef1735ba8816/lava_callback.json.gz 2026-05-04 01:32:41,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:32:41,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f65f559eef1735ba8816 HTTP/1.1" 200 None 2026-05-04 01:32:41,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:32:41,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:32:41,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:32:41,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f65f559eef1735ba8816 HTTP/1.1" 200 None 2026-05-04 01:32:41,451 - lava_callback - INFO - Completed processing callback for node 69f7f65f559eef1735ba8816 INFO: 172.20.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48122 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:33:06,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:33:06,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42584 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:33:07,202 - lava_callback - INFO - Received callback for node 69f55444ed4ed40b02240d38 INFO: 172.20.0.1:42586 - "POST /node/69f55444ed4ed40b02240d38 HTTP/1.0" 202 Accepted 2026-05-04 01:33:07,207 - lava_callback - INFO - Starting async job submit for node 69f55444ed4ed40b02240d38 2026-05-04 01:33:07,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:33:07,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55444ed4ed40b02240d38 HTTP/1.1" 200 None 2026-05-04 01:33:07,223 - lava_callback - DEBUG - Processing node 69f55444ed4ed40b02240d38: baseline-arm64-clabbe 2026-05-04 01:33:07,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55444ed4ed40b02240d38 2026-05-04 01:33:07,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:33:07,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55444ed4ed40b02240d38 HTTP/1.1" 200 None 2026-05-04 01:33:07,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:33:07,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 01:33:07,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:33:07,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55444ed4ed40b02240d38 HTTP/1.1" 200 None 2026-05-04 01:33:07,276 - lava_callback - ERROR - Error processing callback for node 69f55444ed4ed40b02240d38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41806 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:33:42,215 - lava_callback - INFO - Received callback for node 69f7f742559eef1735ba88a0 INFO: 172.20.0.1:45080 - "POST /node/69f7f742559eef1735ba88a0 HTTP/1.0" 202 Accepted 2026-05-04 01:33:42,221 - lava_callback - INFO - Starting async job submit for node 69f7f742559eef1735ba88a0 2026-05-04 01:33:42,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:33:42,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f742559eef1735ba88a0 HTTP/1.1" 200 None 2026-05-04 01:33:42,268 - lava_callback - DEBUG - Processing node 69f7f742559eef1735ba88a0: baseline-arm64 2026-05-04 01:33:42,398 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:33:42,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:33:42,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:33:42,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f742559eef1735ba88a0/lava-logs.yaml 2026-05-04 01:33:42,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:33:42,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:33:42,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f742559eef1735ba88a0/lava_callback.json.gz 2026-05-04 01:33:42,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:33:42,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f742559eef1735ba88a0 HTTP/1.1" 200 None 2026-05-04 01:33:42,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:33:42,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:33:42,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:33:42,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f742559eef1735ba88a0 HTTP/1.1" 200 None 2026-05-04 01:33:43,021 - lava_callback - INFO - Completed processing callback for node 69f7f742559eef1735ba88a0 INFO: 172.20.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59560 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:34:06,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:34:06,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42456 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:35:47,325 - lava_callback - INFO - Received callback for node 69f554e8ed4ed40b02240d83 INFO: 172.20.0.1:42460 - "POST /node/69f554e8ed4ed40b02240d83 HTTP/1.0" 202 Accepted 2026-05-04 01:35:47,331 - lava_callback - INFO - Starting async job submit for node 69f554e8ed4ed40b02240d83 2026-05-04 01:35:47,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:35:47,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f554e8ed4ed40b02240d83 HTTP/1.1" 200 None 2026-05-04 01:35:47,348 - lava_callback - DEBUG - Processing node 69f554e8ed4ed40b02240d83: baseline-arm64-clabbe 2026-05-04 01:35:47,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f554e8ed4ed40b02240d83 2026-05-04 01:35:47,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:35:47,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f554e8ed4ed40b02240d83 HTTP/1.1" 200 None 2026-05-04 01:35:47,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:35:47,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 01:35:47,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:35:47,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f554e8ed4ed40b02240d83 HTTP/1.1" 200 None 2026-05-04 01:35:47,395 - lava_callback - ERROR - Error processing callback for node 69f554e8ed4ed40b02240d83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46958 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:36:13,243 - lava_callback - INFO - Received callback for node 69f7f3f6559eef1735ba85b7 INFO: 172.20.0.1:59696 - "POST /node/69f7f3f6559eef1735ba85b7 HTTP/1.0" 202 Accepted 2026-05-04 01:36:13,249 - lava_callback - INFO - Starting async job submit for node 69f7f3f6559eef1735ba85b7 2026-05-04 01:36:13,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:13,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3f6559eef1735ba85b7 HTTP/1.1" 200 None 2026-05-04 01:36:13,290 - lava_callback - DEBUG - Processing node 69f7f3f6559eef1735ba85b7: baseline-arm64-broonie 2026-05-04 01:36:13,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:36:13,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:36:13,664 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3f6559eef1735ba85b7/log.txt.gz 2026-05-04 01:36:13,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:36:13,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:36:13,969 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3f6559eef1735ba85b7/lava-logs.yaml 2026-05-04 01:36:13,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:36:14,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:36:14,277 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3f6559eef1735ba85b7/lava_callback.json.gz 2026-05-04 01:36:14,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:14,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3f6559eef1735ba85b7 HTTP/1.1" 200 None 2026-05-04 01:36:14,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:14,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:36:14,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:14,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3f6559eef1735ba85b7 HTTP/1.1" 200 None 2026-05-04 01:36:14,355 - lava_callback - INFO - Completed processing callback for node 69f7f3f6559eef1735ba85b7 INFO: 172.20.0.1:59708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59710 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:36:20,650 - lava_callback - INFO - Received callback for node 69f7f3f6559eef1735ba85b5 INFO: 172.20.0.1:34568 - "POST /node/69f7f3f6559eef1735ba85b5 HTTP/1.0" 202 Accepted 2026-05-04 01:36:20,656 - lava_callback - INFO - Starting async job submit for node 69f7f3f6559eef1735ba85b5 2026-05-04 01:36:20,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:20,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3f6559eef1735ba85b5 HTTP/1.1" 200 None 2026-05-04 01:36:20,725 - lava_callback - DEBUG - Processing node 69f7f3f6559eef1735ba85b5: baseline-arm 2026-05-04 01:36:21,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:36:21,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:36:21,399 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f7f3f6559eef1735ba85b5/log.txt.gz 2026-05-04 01:36:21,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:36:21,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:36:21,941 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f7f3f6559eef1735ba85b5/lava-logs.yaml 2026-05-04 01:36:21,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:36:22,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:36:22,088 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f7f3f6559eef1735ba85b5/lava_callback.json.gz DEBUG: Setup failed for 69f7f3f6559eef1735ba85b5. Transitting job node result: incomplete -> fail 2026-05-04 01:36:22,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:22,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3f6559eef1735ba85b5 HTTP/1.1" 200 None 2026-05-04 01:36:22,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:22,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 01:36:22,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:22,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3f6559eef1735ba85b5 HTTP/1.1" 200 None 2026-05-04 01:36:22,383 - lava_callback - INFO - Completed processing callback for node 69f7f3f6559eef1735ba85b5 2026-05-04 01:36:22,555 - lava_callback - INFO - Received callback for node 69f7f7da559eef1735ba88e7 INFO: 172.20.0.1:34584 - "POST /node/69f7f7da559eef1735ba88e7 HTTP/1.0" 202 Accepted 2026-05-04 01:36:22,562 - lava_callback - INFO - Starting async job submit for node 69f7f7da559eef1735ba88e7 2026-05-04 01:36:22,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:22,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f7da559eef1735ba88e7 HTTP/1.1" 200 None 2026-05-04 01:36:22,605 - lava_callback - DEBUG - Processing node 69f7f7da559eef1735ba88e7: baseline-arm64 2026-05-04 01:36:22,739 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:36:22,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:36:22,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:36:22,945 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f7da559eef1735ba88e7/lava-logs.yaml 2026-05-04 01:36:22,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:36:23,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:36:23,034 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f7da559eef1735ba88e7/lava_callback.json.gz 2026-05-04 01:36:23,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:23,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f7da559eef1735ba88e7 HTTP/1.1" 200 None 2026-05-04 01:36:23,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:23,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:36:23,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:23,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f7da559eef1735ba88e7 HTTP/1.1" 200 None 2026-05-04 01:36:23,182 - lava_callback - INFO - Completed processing callback for node 69f7f7da559eef1735ba88e7 INFO: 172.20.0.1:34600 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:36:36,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:36:36,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57186 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:37:07,296 - lava_callback - INFO - Received callback for node 69f5553bed4ed40b02240db2 INFO: 172.20.0.1:57200 - "POST /node/69f5553bed4ed40b02240db2 HTTP/1.0" 202 Accepted 2026-05-04 01:37:07,301 - lava_callback - INFO - Starting async job submit for node 69f5553bed4ed40b02240db2 2026-05-04 01:37:07,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:37:07,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5553bed4ed40b02240db2 HTTP/1.1" 200 None 2026-05-04 01:37:07,316 - lava_callback - DEBUG - Processing node 69f5553bed4ed40b02240db2: baseline-arm64-clabbe 2026-05-04 01:37:07,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5553bed4ed40b02240db2 2026-05-04 01:37:07,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:37:07,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5553bed4ed40b02240db2 HTTP/1.1" 200 None 2026-05-04 01:37:07,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:37:07,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 01:37:07,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:37:07,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5553bed4ed40b02240db2 HTTP/1.1" 200 None 2026-05-04 01:37:07,369 - lava_callback - ERROR - Error processing callback for node 69f5553bed4ed40b02240db2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57280 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:38:39,571 - lava_callback - INFO - Received callback for node 69f7f3e1559eef1735ba8553 INFO: 172.20.0.1:57282 - "POST /node/69f7f3e1559eef1735ba8553 HTTP/1.0" 202 Accepted 2026-05-04 01:38:39,580 - lava_callback - INFO - Starting async job submit for node 69f7f3e1559eef1735ba8553 2026-05-04 01:38:39,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:38:39,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e1559eef1735ba8553 HTTP/1.1" 200 None 2026-05-04 01:38:39,639 - lava_callback - DEBUG - Processing node 69f7f3e1559eef1735ba8553: baseline-nfs-arm64 2026-05-04 01:38:40,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:38:40,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:38:40,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e1559eef1735ba8553/log.txt.gz 2026-05-04 01:38:41,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:38:41,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:38:41,734 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e1559eef1735ba8553/lava-logs.yaml 2026-05-04 01:38:41,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:38:41,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:38:41,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f3e1559eef1735ba8553/lava_callback.json.gz DEBUG: Setup failed for 69f7f3e1559eef1735ba8553. Transitting job node result: incomplete -> fail 2026-05-04 01:38:42,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:38:42,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3e1559eef1735ba8553 HTTP/1.1" 200 None 2026-05-04 01:38:42,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:38:42,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:38:42,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:38:42,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3e1559eef1735ba8553 HTTP/1.1" 200 None 2026-05-04 01:38:42,144 - lava_callback - INFO - Completed processing callback for node 69f7f3e1559eef1735ba8553 INFO: 172.20.0.1:57206 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:38:53,773 - lava_callback - INFO - Received callback for node 69f7f3f8559eef1735ba85bb INFO: 172.20.0.1:57992 - "POST /node/69f7f3f8559eef1735ba85bb HTTP/1.0" 202 Accepted 2026-05-04 01:38:53,779 - lava_callback - INFO - Starting async job submit for node 69f7f3f8559eef1735ba85bb 2026-05-04 01:38:53,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:38:53,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3f8559eef1735ba85bb HTTP/1.1" 200 None 2026-05-04 01:38:53,816 - lava_callback - DEBUG - Processing node 69f7f3f8559eef1735ba85bb: baseline-arm64-broonie 2026-05-04 01:38:54,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:38:54,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:38:54,114 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3f8559eef1735ba85bb/log.txt.gz 2026-05-04 01:38:54,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:38:54,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:38:54,438 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3f8559eef1735ba85bb/lava-logs.yaml 2026-05-04 01:38:54,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:38:54,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:38:54,549 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3f8559eef1735ba85bb/lava_callback.json.gz 2026-05-04 01:38:54,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:38:54,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3f8559eef1735ba85bb HTTP/1.1" 200 None 2026-05-04 01:38:54,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:38:54,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:38:54,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:38:54,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3f8559eef1735ba85bb HTTP/1.1" 200 None 2026-05-04 01:38:54,624 - lava_callback - INFO - Completed processing callback for node 69f7f3f8559eef1735ba85bb INFO: 172.20.0.1:57996 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:39:06,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:06,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47406 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:39:35,256 - lava_callback - INFO - Received callback for node 69f7f793559eef1735ba88ca INFO: 172.20.0.1:52094 - "POST /node/69f7f793559eef1735ba88ca HTTP/1.0" 202 Accepted 2026-05-04 01:39:35,263 - lava_callback - INFO - Starting async job submit for node 69f7f793559eef1735ba88ca 2026-05-04 01:39:35,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:35,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f793559eef1735ba88ca HTTP/1.1" 200 None 2026-05-04 01:39:35,312 - lava_callback - DEBUG - Processing node 69f7f793559eef1735ba88ca: baseline-arm64 2026-05-04 01:39:35,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:39:35,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:39:35,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f793559eef1735ba88ca/log.txt.gz 2026-05-04 01:39:35,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:39:36,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:39:36,117 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f793559eef1735ba88ca/lava-logs.yaml 2026-05-04 01:39:36,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:39:36,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:39:36,235 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f793559eef1735ba88ca/lava_callback.json.gz DEBUG: Setup failed for 69f7f793559eef1735ba88ca. Transitting job node result: incomplete -> fail 2026-05-04 01:39:36,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:36,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f793559eef1735ba88ca HTTP/1.1" 200 None 2026-05-04 01:39:36,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:36,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:39:36,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:36,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f793559eef1735ba88ca HTTP/1.1" 200 None 2026-05-04 01:39:36,437 - lava_callback - INFO - Completed processing callback for node 69f7f793559eef1735ba88ca INFO: 172.20.0.1:52110 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:39:38,021 - lava_callback - INFO - Received callback for node 69f7f408559eef1735ba85df INFO: 172.20.0.1:52118 - "POST /node/69f7f408559eef1735ba85df HTTP/1.0" 202 Accepted 2026-05-04 01:39:38,069 - lava_callback - INFO - Starting async job submit for node 69f7f408559eef1735ba85df 2026-05-04 01:39:38,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:38,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f408559eef1735ba85df HTTP/1.1" 200 None 2026-05-04 01:39:38,113 - lava_callback - DEBUG - Processing node 69f7f408559eef1735ba85df: baseline-arm64-clabbe 2026-05-04 01:39:38,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:39:38,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:39:38,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69f7f408559eef1735ba85df/log.txt.gz 2026-05-04 01:39:38,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:39:38,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:39:38,494 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69f7f408559eef1735ba85df/lava-logs.yaml 2026-05-04 01:39:38,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:39:38,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:39:38,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69f7f408559eef1735ba85df/lava_callback.json.gz 2026-05-04 01:39:38,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:38,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f408559eef1735ba85df HTTP/1.1" 200 None 2026-05-04 01:39:38,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:38,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:39:38,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:38,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f408559eef1735ba85df HTTP/1.1" 200 None 2026-05-04 01:39:38,730 - lava_callback - INFO - Completed processing callback for node 69f7f408559eef1735ba85df 2026-05-04 01:39:42,609 - lava_callback - INFO - Received callback for node 69f7f454559eef1735ba86d4 INFO: 172.20.0.1:47474 - "POST /node/69f7f454559eef1735ba86d4 HTTP/1.0" 202 Accepted 2026-05-04 01:39:42,620 - lava_callback - INFO - Starting async job submit for node 69f7f454559eef1735ba86d4 2026-05-04 01:39:42,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:42,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f454559eef1735ba86d4 HTTP/1.1" 200 None 2026-05-04 01:39:42,680 - lava_callback - DEBUG - Processing node 69f7f454559eef1735ba86d4: baseline-x86 2026-05-04 01:39:43,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:39:43,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:39:43,698 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f7f454559eef1735ba86d4/log.txt.gz 2026-05-04 01:39:44,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:39:44,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:39:44,307 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f7f454559eef1735ba86d4/lava-logs.yaml 2026-05-04 01:39:44,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:39:44,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:39:44,452 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f7f454559eef1735ba86d4/lava_callback.json.gz DEBUG: Setup failed for 69f7f454559eef1735ba86d4. Transitting job node result: incomplete -> fail 2026-05-04 01:39:44,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:44,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f454559eef1735ba86d4 HTTP/1.1" 200 None 2026-05-04 01:39:44,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:44,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5de559eef1735ba5778 HTTP/1.1" 200 None 2026-05-04 01:39:44,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:39:44,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f454559eef1735ba86d4 HTTP/1.1" 200 None 2026-05-04 01:39:44,708 - lava_callback - INFO - Completed processing callback for node 69f7f454559eef1735ba86d4 INFO: 172.20.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45080 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:40:06,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:40:06,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57238 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:40:08,451 - lava_callback - INFO - Received callback for node 69f555e9ed4ed40b02240e00 INFO: 172.20.0.1:57248 - "POST /node/69f555e9ed4ed40b02240e00 HTTP/1.0" 202 Accepted 2026-05-04 01:40:08,456 - lava_callback - INFO - Starting async job submit for node 69f555e9ed4ed40b02240e00 2026-05-04 01:40:08,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:40:08,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f555e9ed4ed40b02240e00 HTTP/1.1" 200 None 2026-05-04 01:40:08,472 - lava_callback - DEBUG - Processing node 69f555e9ed4ed40b02240e00: baseline-arm64-clabbe 2026-05-04 01:40:08,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f555e9ed4ed40b02240e00 2026-05-04 01:40:08,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:40:08,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f555e9ed4ed40b02240e00 HTTP/1.1" 200 None 2026-05-04 01:40:08,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:40:08,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 01:40:08,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:40:08,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f555e9ed4ed40b02240e00 HTTP/1.1" 200 None 2026-05-04 01:40:08,516 - lava_callback - ERROR - Error processing callback for node 69f555e9ed4ed40b02240e00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37226 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:41:13,133 - lava_callback - INFO - Received callback for node 69f7f3fe559eef1735ba85c7 INFO: 172.20.0.1:54454 - "POST /node/69f7f3fe559eef1735ba85c7 HTTP/1.0" 202 Accepted 2026-05-04 01:41:13,139 - lava_callback - INFO - Starting async job submit for node 69f7f3fe559eef1735ba85c7 2026-05-04 01:41:13,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:41:13,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3fe559eef1735ba85c7 HTTP/1.1" 200 None 2026-05-04 01:41:13,175 - lava_callback - DEBUG - Processing node 69f7f3fe559eef1735ba85c7: baseline-arm64-broonie 2026-05-04 01:41:13,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:41:13,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:41:13,687 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3fe559eef1735ba85c7/log.txt.gz 2026-05-04 01:41:13,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:41:14,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:41:14,008 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3fe559eef1735ba85c7/lava-logs.yaml 2026-05-04 01:41:14,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:41:14,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:41:14,126 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f7f3fe559eef1735ba85c7/lava_callback.json.gz 2026-05-04 01:41:14,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:41:14,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f3fe559eef1735ba85c7 HTTP/1.1" 200 None 2026-05-04 01:41:14,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:41:14,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:41:14,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:41:14,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f3fe559eef1735ba85c7 HTTP/1.1" 200 None 2026-05-04 01:41:14,197 - lava_callback - INFO - Completed processing callback for node 69f7f3fe559eef1735ba85c7 INFO: 172.20.0.1:54456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48756 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:41:36,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:41:36,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50716 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:41:57,009 - lava_callback - INFO - Received callback for node 69f7f90a559eef1735ba89a1 INFO: 172.20.0.1:50728 - "POST /node/69f7f90a559eef1735ba89a1 HTTP/1.0" 202 Accepted 2026-05-04 01:41:57,015 - lava_callback - INFO - Starting async job submit for node 69f7f90a559eef1735ba89a1 2026-05-04 01:41:57,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:41:57,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f90a559eef1735ba89a1 HTTP/1.1" 200 None 2026-05-04 01:41:57,050 - lava_callback - DEBUG - Processing node 69f7f90a559eef1735ba89a1: baseline-arm64 2026-05-04 01:41:57,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:41:57,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:41:57,488 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f90a559eef1735ba89a1/log.txt.gz 2026-05-04 01:41:57,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:41:57,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:41:57,850 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f90a559eef1735ba89a1/lava-logs.yaml 2026-05-04 01:41:57,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:41:57,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:41:57,990 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f90a559eef1735ba89a1/lava_callback.json.gz 2026-05-04 01:41:58,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:41:58,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f90a559eef1735ba89a1 HTTP/1.1" 200 None 2026-05-04 01:41:58,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:41:58,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:41:58,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:41:58,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f90a559eef1735ba89a1 HTTP/1.1" 200 None 2026-05-04 01:41:58,070 - lava_callback - INFO - Completed processing callback for node 69f7f90a559eef1735ba89a1 2026-05-04 01:42:06,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:42:06,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58164 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:42:47,587 - lava_callback - INFO - Received callback for node 69f55682ed4ed40b02240e4c INFO: 172.20.0.1:58178 - "POST /node/69f55682ed4ed40b02240e4c HTTP/1.0" 202 Accepted 2026-05-04 01:42:47,593 - lava_callback - INFO - Starting async job submit for node 69f55682ed4ed40b02240e4c 2026-05-04 01:42:47,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:42:47,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55682ed4ed40b02240e4c HTTP/1.1" 200 None 2026-05-04 01:42:47,608 - lava_callback - DEBUG - Processing node 69f55682ed4ed40b02240e4c: baseline-arm-clabbe 2026-05-04 01:42:47,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55682ed4ed40b02240e4c 2026-05-04 01:42:47,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:42:47,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55682ed4ed40b02240e4c HTTP/1.1" 200 None 2026-05-04 01:42:47,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:42:47,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-04 01:42:47,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:42:47,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55682ed4ed40b02240e4c HTTP/1.1" 200 None 2026-05-04 01:42:47,654 - lava_callback - ERROR - Error processing callback for node 69f55682ed4ed40b02240e4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35390 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:47:08,909 - lava_callback - INFO - Received callback for node 69f7fa87559eef1735ba8a50 INFO: 172.20.0.1:35396 - "POST /node/69f7fa87559eef1735ba8a50 HTTP/1.0" 202 Accepted 2026-05-04 01:47:08,915 - lava_callback - INFO - Starting async job submit for node 69f7fa87559eef1735ba8a50 2026-05-04 01:47:08,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:47:08,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fa87559eef1735ba8a50 HTTP/1.1" 200 None 2026-05-04 01:47:08,932 - lava_callback - DEBUG - Processing node 69f7fa87559eef1735ba8a50: baseline-nfs-arm64 2026-05-04 01:47:08,933 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:47:08,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:47:09,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:47:09,212 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7fa87559eef1735ba8a50/lava-logs.yaml 2026-05-04 01:47:09,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:47:09,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:47:09,327 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7fa87559eef1735ba8a50/lava_callback.json.gz 2026-05-04 01:47:09,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:47:09,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fa87559eef1735ba8a50 HTTP/1.1" 200 None 2026-05-04 01:47:09,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:47:09,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:47:09,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:47:09,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7fa87559eef1735ba8a50 HTTP/1.1" 200 None 2026-05-04 01:47:09,379 - lava_callback - INFO - Completed processing callback for node 69f7fa87559eef1735ba8a50 INFO: 172.20.0.1:55604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54058 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:47:36,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:47:36,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49362 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:47:58,743 - lava_callback - INFO - Received callback for node 69f7f871559eef1735ba8943 INFO: 172.20.0.1:49374 - "POST /node/69f7f871559eef1735ba8943 HTTP/1.0" 202 Accepted 2026-05-04 01:47:58,749 - lava_callback - INFO - Starting async job submit for node 69f7f871559eef1735ba8943 2026-05-04 01:47:58,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:47:58,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f871559eef1735ba8943 HTTP/1.1" 200 None 2026-05-04 01:47:58,787 - lava_callback - DEBUG - Processing node 69f7f871559eef1735ba8943: baseline-arm64 2026-05-04 01:47:59,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:47:59,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:47:59,420 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f871559eef1735ba8943/log.txt.gz 2026-05-04 01:47:59,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:47:59,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:47:59,849 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f871559eef1735ba8943/lava-logs.yaml 2026-05-04 01:47:59,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:47:59,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:47:59,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7f871559eef1735ba8943/lava_callback.json.gz 2026-05-04 01:48:00,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:48:00,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f871559eef1735ba8943 HTTP/1.1" 200 None 2026-05-04 01:48:00,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:48:00,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:48:00,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:48:00,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f871559eef1735ba8943 HTTP/1.1" 200 None 2026-05-04 01:48:00,130 - lava_callback - INFO - Completed processing callback for node 69f7f871559eef1735ba8943 2026-05-04 01:48:06,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:48:06,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36438 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:49:33,380 - lava_callback - INFO - Received callback for node 69f7f6f4559eef1735ba8869 INFO: 172.20.0.1:43950 - "POST /node/69f7f6f4559eef1735ba8869 HTTP/1.0" 202 Accepted 2026-05-04 01:49:33,386 - lava_callback - INFO - Starting async job submit for node 69f7f6f4559eef1735ba8869 2026-05-04 01:49:33,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:49:33,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f6f4559eef1735ba8869 HTTP/1.1" 200 None 2026-05-04 01:49:33,459 - lava_callback - DEBUG - Processing node 69f7f6f4559eef1735ba8869: ltp-smoke 2026-05-04 01:49:33,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:49:34,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:49:34,034 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7f6f4559eef1735ba8869/log.txt.gz 2026-05-04 01:49:34,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:49:34,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:49:34,666 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7f6f4559eef1735ba8869/lava-logs.yaml 2026-05-04 01:49:34,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:49:34,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:49:34,995 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7f6f4559eef1735ba8869/lava_callback.json.gz 2026-05-04 01:49:35,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:49:35,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f6f4559eef1735ba8869 HTTP/1.1" 200 None 2026-05-04 01:49:35,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:49:35,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5be559eef1735ba573d HTTP/1.1" 200 None 2026-05-04 01:49:35,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:49:35,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f6f4559eef1735ba8869 HTTP/1.1" 200 None 2026-05-04 01:49:35,285 - lava_callback - INFO - Completed processing callback for node 69f7f6f4559eef1735ba8869 2026-05-04 01:49:36,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:49:36,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36702 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:51:17,733 - lava_callback - INFO - Received callback for node 69f7facb559eef1735ba8a71 INFO: 172.20.0.1:36706 - "POST /node/69f7facb559eef1735ba8a71 HTTP/1.0" 202 Accepted 2026-05-04 01:51:17,739 - lava_callback - INFO - Starting async job submit for node 69f7facb559eef1735ba8a71 2026-05-04 01:51:17,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:17,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7facb559eef1735ba8a71 HTTP/1.1" 200 None 2026-05-04 01:51:17,771 - lava_callback - DEBUG - Processing node 69f7facb559eef1735ba8a71: baseline-arm64 2026-05-04 01:51:18,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:51:18,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:51:18,222 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7facb559eef1735ba8a71/log.txt.gz 2026-05-04 01:51:18,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:51:18,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:51:18,730 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7facb559eef1735ba8a71/lava-logs.yaml 2026-05-04 01:51:18,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:51:18,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:51:18,862 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7facb559eef1735ba8a71/lava_callback.json.gz 2026-05-04 01:51:18,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:18,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7facb559eef1735ba8a71 HTTP/1.1" 200 None 2026-05-04 01:51:18,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:18,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:51:18,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:18,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7facb559eef1735ba8a71 HTTP/1.1" 200 None 2026-05-04 01:51:19,013 - lava_callback - INFO - Completed processing callback for node 69f7facb559eef1735ba8a71 2026-05-04 01:51:22,593 - lava_callback - INFO - Received callback for node 69f7fb63559eef1735ba8abc INFO: 172.20.0.1:47920 - "POST /node/69f7fb63559eef1735ba8abc HTTP/1.0" 202 Accepted 2026-05-04 01:51:22,600 - lava_callback - INFO - Starting async job submit for node 69f7fb63559eef1735ba8abc 2026-05-04 01:51:22,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:22,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fb63559eef1735ba8abc HTTP/1.1" 200 None 2026-05-04 01:51:22,649 - lava_callback - DEBUG - Processing node 69f7fb63559eef1735ba8abc: baseline-arm64 2026-05-04 01:51:22,798 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:51:22,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:51:23,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:51:23,006 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fb63559eef1735ba8abc/lava-logs.yaml 2026-05-04 01:51:23,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:51:23,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:51:23,114 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fb63559eef1735ba8abc/lava_callback.json.gz 2026-05-04 01:51:23,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:23,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fb63559eef1735ba8abc HTTP/1.1" 200 None 2026-05-04 01:51:23,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:23,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:51:23,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:23,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7fb63559eef1735ba8abc HTTP/1.1" 200 None 2026-05-04 01:51:23,255 - lava_callback - INFO - Completed processing callback for node 69f7fb63559eef1735ba8abc INFO: 172.20.0.1:47930 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:51:36,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:36,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37024 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:51:48,068 - lava_callback - INFO - Received callback for node 69f558a2ed4ed40b02240f3e INFO: 172.20.0.1:37030 - "POST /node/69f558a2ed4ed40b02240f3e HTTP/1.0" 202 Accepted 2026-05-04 01:51:48,074 - lava_callback - INFO - Starting async job submit for node 69f558a2ed4ed40b02240f3e 2026-05-04 01:51:48,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:48,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f558a2ed4ed40b02240f3e HTTP/1.1" 200 None 2026-05-04 01:51:48,092 - lava_callback - DEBUG - Processing node 69f558a2ed4ed40b02240f3e: baseline-arm64-clabbe 2026-05-04 01:51:48,092 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f558a2ed4ed40b02240f3e 2026-05-04 01:51:48,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:48,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f558a2ed4ed40b02240f3e HTTP/1.1" 200 None 2026-05-04 01:51:48,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:48,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 01:51:48,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:51:48,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f558a2ed4ed40b02240f3e HTTP/1.1" 200 None 2026-05-04 01:51:48,144 - lava_callback - ERROR - Error processing callback for node 69f558a2ed4ed40b02240f3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48828 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:52:37,381 - lava_callback - INFO - Received callback for node 69f7f95a559eef1735ba89cb INFO: 172.20.0.1:48842 - "POST /node/69f7f95a559eef1735ba89cb HTTP/1.0" 202 Accepted 2026-05-04 01:52:37,387 - lava_callback - INFO - Starting async job submit for node 69f7f95a559eef1735ba89cb 2026-05-04 01:52:37,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:52:37,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f95a559eef1735ba89cb HTTP/1.1" 200 None 2026-05-04 01:52:37,430 - lava_callback - DEBUG - Processing node 69f7f95a559eef1735ba89cb: baseline-nfs-arm64 2026-05-04 01:52:37,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:52:38,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:52:38,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f95a559eef1735ba89cb/log.txt.gz 2026-05-04 01:52:38,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:52:38,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:52:38,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f95a559eef1735ba89cb/lava-logs.yaml 2026-05-04 01:52:38,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:52:38,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:52:38,964 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7f95a559eef1735ba89cb/lava_callback.json.gz 2026-05-04 01:52:38,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:52:39,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7f95a559eef1735ba89cb HTTP/1.1" 200 None 2026-05-04 01:52:39,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:52:39,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:52:39,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:52:39,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7f95a559eef1735ba89cb HTTP/1.1" 200 None 2026-05-04 01:52:39,138 - lava_callback - INFO - Completed processing callback for node 69f7f95a559eef1735ba89cb INFO: 172.20.0.1:41116 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:52:48,130 - lava_callback - INFO - Received callback for node 69f558e5ed4ed40b02240f69 INFO: 172.20.0.1:41118 - "POST /node/69f558e5ed4ed40b02240f69 HTTP/1.0" 202 Accepted 2026-05-04 01:52:48,138 - lava_callback - INFO - Starting async job submit for node 69f558e5ed4ed40b02240f69 2026-05-04 01:52:48,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:52:48,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f558e5ed4ed40b02240f69 HTTP/1.1" 200 None 2026-05-04 01:52:48,157 - lava_callback - DEBUG - Processing node 69f558e5ed4ed40b02240f69: baseline-arm-clabbe 2026-05-04 01:52:48,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f558e5ed4ed40b02240f69 2026-05-04 01:52:48,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:52:48,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f558e5ed4ed40b02240f69 HTTP/1.1" 200 None 2026-05-04 01:52:48,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:52:48,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-04 01:52:48,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:52:48,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f558e5ed4ed40b02240f69 HTTP/1.1" 200 None 2026-05-04 01:52:48,205 - lava_callback - ERROR - Error processing callback for node 69f558e5ed4ed40b02240f69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43126 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:53:06,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:53:06,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59032 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:54:23,185 - lava_callback - INFO - Received callback for node 69f7fc1e559eef1735ba8b1a INFO: 172.20.0.1:36518 - "POST /node/69f7fc1e559eef1735ba8b1a HTTP/1.0" 202 Accepted 2026-05-04 01:54:23,192 - lava_callback - INFO - Starting async job submit for node 69f7fc1e559eef1735ba8b1a 2026-05-04 01:54:23,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:54:23,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fc1e559eef1735ba8b1a HTTP/1.1" 200 None 2026-05-04 01:54:23,235 - lava_callback - DEBUG - Processing node 69f7fc1e559eef1735ba8b1a: baseline-arm64 2026-05-04 01:54:23,373 - lava_callback - WARNING - Failed to upload log 2026-05-04 01:54:23,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:54:23,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:54:23,557 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fc1e559eef1735ba8b1a/lava-logs.yaml 2026-05-04 01:54:23,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 01:54:23,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 01:54:23,655 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fc1e559eef1735ba8b1a/lava_callback.json.gz 2026-05-04 01:54:23,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:54:23,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fc1e559eef1735ba8b1a HTTP/1.1" 200 None 2026-05-04 01:54:23,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:54:23,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 01:54:23,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:54:23,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7fc1e559eef1735ba8b1a HTTP/1.1" 200 None 2026-05-04 01:54:23,822 - lava_callback - INFO - Completed processing callback for node 69f7fc1e559eef1735ba8b1a INFO: 172.20.0.1:36522 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:54:36,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:54:36,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40444 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:55:08,273 - lava_callback - INFO - Received callback for node 69f5596aed4ed40b02240fc9 INFO: 172.20.0.1:40446 - "POST /node/69f5596aed4ed40b02240fc9 HTTP/1.0" 202 Accepted 2026-05-04 01:55:08,279 - lava_callback - INFO - Starting async job submit for node 69f5596aed4ed40b02240fc9 2026-05-04 01:55:08,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:55:08,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5596aed4ed40b02240fc9 HTTP/1.1" 200 None 2026-05-04 01:55:08,295 - lava_callback - DEBUG - Processing node 69f5596aed4ed40b02240fc9: baseline-arm64-clabbe 2026-05-04 01:55:08,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5596aed4ed40b02240fc9 2026-05-04 01:55:08,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:55:08,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5596aed4ed40b02240fc9 HTTP/1.1" 200 None 2026-05-04 01:55:08,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:55:08,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-04 01:55:08,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:55:08,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5596aed4ed40b02240fc9 HTTP/1.1" 200 None 2026-05-04 01:55:08,340 - lava_callback - ERROR - Error processing callback for node 69f5596aed4ed40b02240fc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45230 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:56:08,232 - lava_callback - INFO - Received callback for node 69f559aded4ed40b02240fea INFO: 172.20.0.1:45240 - "POST /node/69f559aded4ed40b02240fea HTTP/1.0" 202 Accepted 2026-05-04 01:56:08,237 - lava_callback - INFO - Starting async job submit for node 69f559aded4ed40b02240fea 2026-05-04 01:56:08,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:56:08,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f559aded4ed40b02240fea HTTP/1.1" 200 None 2026-05-04 01:56:08,252 - lava_callback - DEBUG - Processing node 69f559aded4ed40b02240fea: baseline-arm-clabbe 2026-05-04 01:56:08,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f559aded4ed40b02240fea 2026-05-04 01:56:08,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:56:08,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f559aded4ed40b02240fea HTTP/1.1" 200 None 2026-05-04 01:56:08,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:56:08,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-04 01:56:08,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:56:08,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f559aded4ed40b02240fea HTTP/1.1" 200 None 2026-05-04 01:56:08,297 - lava_callback - ERROR - Error processing callback for node 69f559aded4ed40b02240fea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42450 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:56:48,236 - lava_callback - INFO - Received callback for node 69f559d4ed4ed40b02240ffb INFO: 172.20.0.1:42456 - "POST /node/69f559d4ed4ed40b02240ffb HTTP/1.0" 202 Accepted 2026-05-04 01:56:48,243 - lava_callback - INFO - Starting async job submit for node 69f559d4ed4ed40b02240ffb 2026-05-04 01:56:48,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:56:48,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f559d4ed4ed40b02240ffb HTTP/1.1" 200 None 2026-05-04 01:56:48,262 - lava_callback - DEBUG - Processing node 69f559d4ed4ed40b02240ffb: baseline-arm-clabbe 2026-05-04 01:56:48,262 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f559d4ed4ed40b02240ffb 2026-05-04 01:56:48,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:56:48,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f559d4ed4ed40b02240ffb HTTP/1.1" 200 None 2026-05-04 01:56:48,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:56:48,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-04 01:56:48,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:56:48,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f559d4ed4ed40b02240ffb HTTP/1.1" 200 None 2026-05-04 01:56:48,368 - lava_callback - ERROR - Error processing callback for node 69f559d4ed4ed40b02240ffb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59812 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:57:28,291 - lava_callback - INFO - Received callback for node 69f55a00ed4ed40b02241016 INFO: 172.20.0.1:59814 - "POST /node/69f55a00ed4ed40b02241016 HTTP/1.0" 202 Accepted 2026-05-04 01:57:28,296 - lava_callback - INFO - Starting async job submit for node 69f55a00ed4ed40b02241016 2026-05-04 01:57:28,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:57:28,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55a00ed4ed40b02241016 HTTP/1.1" 200 None 2026-05-04 01:57:28,336 - lava_callback - DEBUG - Processing node 69f55a00ed4ed40b02241016: baseline-arm-clabbe 2026-05-04 01:57:28,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55a00ed4ed40b02241016 2026-05-04 01:57:28,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:57:28,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55a00ed4ed40b02241016 HTTP/1.1" 200 None 2026-05-04 01:57:28,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:57:28,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-04 01:57:28,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:57:28,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55a00ed4ed40b02241016 HTTP/1.1" 200 None 2026-05-04 01:57:28,453 - lava_callback - ERROR - Error processing callback for node 69f55a00ed4ed40b02241016: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33752 - "GET / HTTP/1.0" 200 OK 2026-05-04 01:58:08,259 - lava_callback - INFO - Received callback for node 69f55a26ed4ed40b02241031 INFO: 172.20.0.1:33754 - "POST /node/69f55a26ed4ed40b02241031 HTTP/1.0" 202 Accepted 2026-05-04 01:58:08,265 - lava_callback - INFO - Starting async job submit for node 69f55a26ed4ed40b02241031 2026-05-04 01:58:08,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:58:08,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55a26ed4ed40b02241031 HTTP/1.1" 200 None 2026-05-04 01:58:08,279 - lava_callback - DEBUG - Processing node 69f55a26ed4ed40b02241031: baseline-arm-clabbe 2026-05-04 01:58:08,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55a26ed4ed40b02241031 2026-05-04 01:58:08,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:58:08,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55a26ed4ed40b02241031 HTTP/1.1" 200 None 2026-05-04 01:58:08,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:58:08,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-04 01:58:08,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 01:58:08,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55a26ed4ed40b02241031 HTTP/1.1" 200 None 2026-05-04 01:58:08,332 - lava_callback - ERROR - Error processing callback for node 69f55a26ed4ed40b02241031: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39686 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:00:08,632 - lava_callback - INFO - Received callback for node 69f55a94ed4ed40b0224104a INFO: 172.20.0.1:39692 - "POST /node/69f55a94ed4ed40b0224104a HTTP/1.0" 202 Accepted 2026-05-04 02:00:08,637 - lava_callback - INFO - Starting async job submit for node 69f55a94ed4ed40b0224104a 2026-05-04 02:00:08,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:00:08,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55a94ed4ed40b0224104a HTTP/1.1" 200 None 2026-05-04 02:00:08,653 - lava_callback - DEBUG - Processing node 69f55a94ed4ed40b0224104a: baseline-arm-clabbe 2026-05-04 02:00:08,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55a94ed4ed40b0224104a 2026-05-04 02:00:08,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:00:08,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55a94ed4ed40b0224104a HTTP/1.1" 200 None 2026-05-04 02:00:08,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:00:08,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-04 02:00:08,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:00:08,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55a94ed4ed40b0224104a HTTP/1.1" 200 None 2026-05-04 02:00:08,707 - lava_callback - ERROR - Error processing callback for node 69f55a94ed4ed40b0224104a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37122 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:00:48,319 - lava_callback - INFO - Received callback for node 69f55abded4ed40b02241059 INFO: 172.20.0.1:37124 - "POST /node/69f55abded4ed40b02241059 HTTP/1.0" 202 Accepted 2026-05-04 02:00:48,324 - lava_callback - INFO - Starting async job submit for node 69f55abded4ed40b02241059 2026-05-04 02:00:48,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:00:48,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55abded4ed40b02241059 HTTP/1.1" 200 None 2026-05-04 02:00:48,340 - lava_callback - DEBUG - Processing node 69f55abded4ed40b02241059: baseline-arm-clabbe 2026-05-04 02:00:48,340 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55abded4ed40b02241059 2026-05-04 02:00:48,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:00:48,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55abded4ed40b02241059 HTTP/1.1" 200 None 2026-05-04 02:00:48,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:00:48,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-04 02:00:48,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:00:48,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55abded4ed40b02241059 HTTP/1.1" 200 None 2026-05-04 02:00:48,416 - lava_callback - ERROR - Error processing callback for node 69f55abded4ed40b02241059: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60352 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:03:28,587 - lava_callback - INFO - Received callback for node 69f55b6aed4ed40b022410a0 INFO: 172.20.0.1:60360 - "POST /node/69f55b6aed4ed40b022410a0 HTTP/1.0" 202 Accepted 2026-05-04 02:03:28,592 - lava_callback - INFO - Starting async job submit for node 69f55b6aed4ed40b022410a0 2026-05-04 02:03:28,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:03:28,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55b6aed4ed40b022410a0 HTTP/1.1" 200 None 2026-05-04 02:03:28,619 - lava_callback - DEBUG - Processing node 69f55b6aed4ed40b022410a0: baseline-arm64-clabbe 2026-05-04 02:03:28,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55b6aed4ed40b022410a0 2026-05-04 02:03:28,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:03:28,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55b6aed4ed40b022410a0 HTTP/1.1" 200 None 2026-05-04 02:03:28,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:03:28,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-04 02:03:28,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:03:28,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55b6aed4ed40b022410a0 HTTP/1.1" 200 None 2026-05-04 02:03:28,667 - lava_callback - ERROR - Error processing callback for node 69f55b6aed4ed40b022410a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47868 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:04:48,646 - lava_callback - INFO - Received callback for node 69f55bbced4ed40b022410d1 INFO: 172.20.0.1:47882 - "POST /node/69f55bbced4ed40b022410d1 HTTP/1.0" 202 Accepted 2026-05-04 02:04:48,651 - lava_callback - INFO - Starting async job submit for node 69f55bbced4ed40b022410d1 2026-05-04 02:04:48,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:04:48,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55bbced4ed40b022410d1 HTTP/1.1" 200 None 2026-05-04 02:04:48,667 - lava_callback - DEBUG - Processing node 69f55bbced4ed40b022410d1: baseline-arm64-clabbe 2026-05-04 02:04:48,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55bbced4ed40b022410d1 2026-05-04 02:04:48,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:04:48,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55bbced4ed40b022410d1 HTTP/1.1" 200 None 2026-05-04 02:04:48,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:04:48,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-04 02:04:48,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:04:48,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55bbced4ed40b022410d1 HTTP/1.1" 200 None 2026-05-04 02:04:48,747 - lava_callback - ERROR - Error processing callback for node 69f55bbced4ed40b022410d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 02:04:50,870 - lava_callback - INFO - Received callback for node 69f7fd01559eef1735ba8b7f INFO: 172.20.0.1:54596 - "POST /node/69f7fd01559eef1735ba8b7f HTTP/1.0" 202 Accepted 2026-05-04 02:04:50,877 - lava_callback - INFO - Starting async job submit for node 69f7fd01559eef1735ba8b7f 2026-05-04 02:04:50,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:04:50,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fd01559eef1735ba8b7f HTTP/1.1" 200 None 2026-05-04 02:04:50,926 - lava_callback - DEBUG - Processing node 69f7fd01559eef1735ba8b7f: baseline-arm64 2026-05-04 02:04:51,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:04:51,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:04:51,438 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fd01559eef1735ba8b7f/log.txt.gz 2026-05-04 02:04:51,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:04:51,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:04:51,852 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fd01559eef1735ba8b7f/lava-logs.yaml 2026-05-04 02:04:51,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:04:52,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:04:52,168 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fd01559eef1735ba8b7f/lava_callback.json.gz DEBUG: Setup failed for 69f7fd01559eef1735ba8b7f. Transitting job node result: incomplete -> fail 2026-05-04 02:04:52,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:04:52,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fd01559eef1735ba8b7f HTTP/1.1" 200 None 2026-05-04 02:04:52,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:04:52,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 02:04:52,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:04:52,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7fd01559eef1735ba8b7f HTTP/1.1" 200 None 2026-05-04 02:04:52,403 - lava_callback - INFO - Completed processing callback for node 69f7fd01559eef1735ba8b7f INFO: 172.20.0.1:54612 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:05:06,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:42754 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:05:06,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37730 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:05:51,238 - lava_callback - INFO - Received callback for node 69f55bfbed4ed40b022410ed INFO: 172.20.0.1:56068 - "POST /node/69f55bfbed4ed40b022410ed HTTP/1.0" 202 Accepted 2026-05-04 02:05:51,243 - lava_callback - INFO - Starting async job submit for node 69f55bfbed4ed40b022410ed 2026-05-04 02:05:51,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:05:51,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55bfbed4ed40b022410ed HTTP/1.1" 200 None 2026-05-04 02:05:51,259 - lava_callback - DEBUG - Processing node 69f55bfbed4ed40b022410ed: baseline-arm-baylibre 2026-05-04 02:05:51,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55bfbed4ed40b022410ed 2026-05-04 02:05:51,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:05:51,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55bfbed4ed40b022410ed HTTP/1.1" 200 None 2026-05-04 02:05:51,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:05:51,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 02:05:51,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:05:51,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55bfbed4ed40b022410ed HTTP/1.1" 200 None 2026-05-04 02:05:51,311 - lava_callback - ERROR - Error processing callback for node 69f55bfbed4ed40b022410ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56072 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:06:04,237 - lava_callback - INFO - Received callback for node 69f7fe22559eef1735ba8bea INFO: 172.20.0.1:54242 - "POST /node/69f7fe22559eef1735ba8bea HTTP/1.0" 202 Accepted 2026-05-04 02:06:04,243 - lava_callback - INFO - Starting async job submit for node 69f7fe22559eef1735ba8bea 2026-05-04 02:06:04,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:06:04,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fe22559eef1735ba8bea HTTP/1.1" 200 None 2026-05-04 02:06:04,277 - lava_callback - DEBUG - Processing node 69f7fe22559eef1735ba8bea: baseline-arm64 2026-05-04 02:06:04,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:06:04,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:06:04,887 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fe22559eef1735ba8bea/log.txt.gz 2026-05-04 02:06:05,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:06:05,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:06:05,247 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fe22559eef1735ba8bea/lava-logs.yaml 2026-05-04 02:06:05,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:06:05,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:06:05,367 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fe22559eef1735ba8bea/lava_callback.json.gz 2026-05-04 02:06:05,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:06:05,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fe22559eef1735ba8bea HTTP/1.1" 200 None 2026-05-04 02:06:05,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:06:05,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 02:06:05,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:06:05,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7fe22559eef1735ba8bea HTTP/1.1" 200 None 2026-05-04 02:06:05,495 - lava_callback - INFO - Completed processing callback for node 69f7fe22559eef1735ba8bea 2026-05-04 02:06:06,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:54244 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:06:06,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58390 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:06:31,167 - lava_callback - INFO - Received callback for node 69f55c21ed4ed40b022410f8 INFO: 172.20.0.1:49630 - "POST /node/69f55c21ed4ed40b022410f8 HTTP/1.0" 202 Accepted 2026-05-04 02:06:31,173 - lava_callback - INFO - Starting async job submit for node 69f55c21ed4ed40b022410f8 2026-05-04 02:06:31,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:06:31,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55c21ed4ed40b022410f8 HTTP/1.1" 200 None 2026-05-04 02:06:31,188 - lava_callback - DEBUG - Processing node 69f55c21ed4ed40b022410f8: baseline-arm-baylibre 2026-05-04 02:06:31,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55c21ed4ed40b022410f8 2026-05-04 02:06:31,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:06:31,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55c21ed4ed40b022410f8 HTTP/1.1" 200 None 2026-05-04 02:06:31,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:06:31,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 02:06:31,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:06:31,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55c21ed4ed40b022410f8 HTTP/1.1" 200 None 2026-05-04 02:06:31,283 - lava_callback - ERROR - Error processing callback for node 69f55c21ed4ed40b022410f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54870 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:07:11,262 - lava_callback - INFO - Received callback for node 69f55c47ed4ed40b02241107 INFO: 172.20.0.1:53288 - "POST /node/69f55c47ed4ed40b02241107 HTTP/1.0" 202 Accepted 2026-05-04 02:07:11,267 - lava_callback - INFO - Starting async job submit for node 69f55c47ed4ed40b02241107 2026-05-04 02:07:11,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:07:11,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55c47ed4ed40b02241107 HTTP/1.1" 200 None 2026-05-04 02:07:11,282 - lava_callback - DEBUG - Processing node 69f55c47ed4ed40b02241107: baseline-arm-baylibre 2026-05-04 02:07:11,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55c47ed4ed40b02241107 2026-05-04 02:07:11,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:07:11,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55c47ed4ed40b02241107 HTTP/1.1" 200 None 2026-05-04 02:07:11,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:07:11,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 02:07:11,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:07:11,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55c47ed4ed40b02241107 HTTP/1.1" 200 None 2026-05-04 02:07:11,327 - lava_callback - ERROR - Error processing callback for node 69f55c47ed4ed40b02241107: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56680 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:07:51,230 - lava_callback - INFO - Received callback for node 69f55c6eed4ed40b02241113 INFO: 172.20.0.1:49594 - "POST /node/69f55c6eed4ed40b02241113 HTTP/1.0" 202 Accepted 2026-05-04 02:07:51,236 - lava_callback - INFO - Starting async job submit for node 69f55c6eed4ed40b02241113 2026-05-04 02:07:51,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:07:51,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55c6eed4ed40b02241113 HTTP/1.1" 200 None 2026-05-04 02:07:51,250 - lava_callback - DEBUG - Processing node 69f55c6eed4ed40b02241113: baseline-arm-baylibre 2026-05-04 02:07:51,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55c6eed4ed40b02241113 2026-05-04 02:07:51,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:07:51,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55c6eed4ed40b02241113 HTTP/1.1" 200 None 2026-05-04 02:07:51,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:07:51,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 02:07:51,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:07:51,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55c6eed4ed40b02241113 HTTP/1.1" 200 None 2026-05-04 02:07:51,295 - lava_callback - ERROR - Error processing callback for node 69f55c6eed4ed40b02241113: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52960 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:08:31,342 - lava_callback - INFO - Received callback for node 69f55c96ed4ed40b02241121 INFO: 172.20.0.1:57036 - "POST /node/69f55c96ed4ed40b02241121 HTTP/1.0" 202 Accepted 2026-05-04 02:08:31,348 - lava_callback - INFO - Starting async job submit for node 69f55c96ed4ed40b02241121 2026-05-04 02:08:31,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:08:31,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55c96ed4ed40b02241121 HTTP/1.1" 200 None 2026-05-04 02:08:31,365 - lava_callback - DEBUG - Processing node 69f55c96ed4ed40b02241121: baseline-arm-baylibre 2026-05-04 02:08:31,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55c96ed4ed40b02241121 2026-05-04 02:08:31,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:08:31,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55c96ed4ed40b02241121 HTTP/1.1" 200 None 2026-05-04 02:08:31,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:08:31,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 02:08:31,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:08:31,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55c96ed4ed40b02241121 HTTP/1.1" 200 None 2026-05-04 02:08:31,415 - lava_callback - ERROR - Error processing callback for node 69f55c96ed4ed40b02241121: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54868 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:09:11,318 - lava_callback - INFO - Received callback for node 69f55cbded4ed40b0224113a INFO: 172.20.0.1:55970 - "POST /node/69f55cbded4ed40b0224113a HTTP/1.0" 202 Accepted 2026-05-04 02:09:11,324 - lava_callback - INFO - Starting async job submit for node 69f55cbded4ed40b0224113a 2026-05-04 02:09:11,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:09:11,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55cbded4ed40b0224113a HTTP/1.1" 200 None 2026-05-04 02:09:11,340 - lava_callback - DEBUG - Processing node 69f55cbded4ed40b0224113a: baseline-arm-baylibre 2026-05-04 02:09:11,340 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55cbded4ed40b0224113a 2026-05-04 02:09:11,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:09:11,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55cbded4ed40b0224113a HTTP/1.1" 200 None 2026-05-04 02:09:11,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:09:11,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 02:09:11,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:09:11,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55cbded4ed40b0224113a HTTP/1.1" 200 None 2026-05-04 02:09:11,390 - lava_callback - ERROR - Error processing callback for node 69f55cbded4ed40b0224113a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36806 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:09:48,867 - lava_callback - INFO - Received callback for node 69f55ce5ed4ed40b0224114d INFO: 172.20.0.1:36814 - "POST /node/69f55ce5ed4ed40b0224114d HTTP/1.0" 202 Accepted 2026-05-04 02:09:48,873 - lava_callback - INFO - Starting async job submit for node 69f55ce5ed4ed40b0224114d 2026-05-04 02:09:48,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:09:48,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55ce5ed4ed40b0224114d HTTP/1.1" 200 None 2026-05-04 02:09:48,894 - lava_callback - DEBUG - Processing node 69f55ce5ed4ed40b0224114d: baseline-arm-clabbe 2026-05-04 02:09:48,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55ce5ed4ed40b0224114d 2026-05-04 02:09:48,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:09:48,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55ce5ed4ed40b0224114d HTTP/1.1" 200 None 2026-05-04 02:09:48,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:09:48,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 02:09:48,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:09:48,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55ce5ed4ed40b0224114d HTTP/1.1" 200 None 2026-05-04 02:09:48,966 - lava_callback - ERROR - Error processing callback for node 69f55ce5ed4ed40b0224114d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59184 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:10:03,557 - lava_callback - INFO - Received callback for node 69f7feca559eef1735ba8c34 INFO: 172.20.0.1:43402 - "POST /node/69f7feca559eef1735ba8c34 HTTP/1.0" 202 Accepted 2026-05-04 02:10:03,565 - lava_callback - INFO - Starting async job submit for node 69f7feca559eef1735ba8c34 2026-05-04 02:10:03,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:10:03,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7feca559eef1735ba8c34 HTTP/1.1" 200 None 2026-05-04 02:10:03,620 - lava_callback - DEBUG - Processing node 69f7feca559eef1735ba8c34: baseline-arm64 2026-05-04 02:10:04,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:10:04,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:10:04,190 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7feca559eef1735ba8c34/log.txt.gz 2026-05-04 02:10:04,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:10:04,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:10:04,593 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7feca559eef1735ba8c34/lava-logs.yaml 2026-05-04 02:10:04,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:10:04,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:10:04,748 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7feca559eef1735ba8c34/lava_callback.json.gz DEBUG: Setup failed for 69f7feca559eef1735ba8c34. Transitting job node result: incomplete -> fail 2026-05-04 02:10:04,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:10:04,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7feca559eef1735ba8c34 HTTP/1.1" 200 None 2026-05-04 02:10:04,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:10:04,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 02:10:04,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:10:04,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7feca559eef1735ba8c34 HTTP/1.1" 200 None 2026-05-04 02:10:04,967 - lava_callback - INFO - Completed processing callback for node 69f7feca559eef1735ba8c34 INFO: 172.20.0.1:43414 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:10:06,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:10:06,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60824 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:10:48,155 - lava_callback - INFO - Received callback for node 69f7fbf9559eef1735ba8b0a INFO: 172.20.0.1:60828 - "POST /node/69f7fbf9559eef1735ba8b0a HTTP/1.0" 202 Accepted 2026-05-04 02:10:48,162 - lava_callback - INFO - Starting async job submit for node 69f7fbf9559eef1735ba8b0a 2026-05-04 02:10:48,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:10:48,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fbf9559eef1735ba8b0a HTTP/1.1" 200 None 2026-05-04 02:10:48,236 - lava_callback - DEBUG - Processing node 69f7fbf9559eef1735ba8b0a: baseline-arm 2026-05-04 02:10:48,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:10:48,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:10:48,921 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f7fbf9559eef1735ba8b0a/log.txt.gz 2026-05-04 02:10:49,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:10:49,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:10:49,471 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f7fbf9559eef1735ba8b0a/lava-logs.yaml 2026-05-04 02:10:49,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:10:49,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:10:49,598 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f7fbf9559eef1735ba8b0a/lava_callback.json.gz DEBUG: Setup failed for 69f7fbf9559eef1735ba8b0a. Transitting job node result: incomplete -> fail 2026-05-04 02:10:49,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:10:49,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fbf9559eef1735ba8b0a HTTP/1.1" 200 None 2026-05-04 02:10:49,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:10:49,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 02:10:49,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:10:49,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7fbf9559eef1735ba8b0a HTTP/1.1" 200 None 2026-05-04 02:10:49,849 - lava_callback - INFO - Completed processing callback for node 69f7fbf9559eef1735ba8b0a INFO: 172.20.0.1:43010 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:10:59,436 - lava_callback - INFO - Received callback for node 69f7fdd6559eef1735ba8bc5 INFO: 172.20.0.1:43026 - "POST /node/69f7fdd6559eef1735ba8bc5 HTTP/1.0" 202 Accepted 2026-05-04 02:10:59,442 - lava_callback - INFO - Starting async job submit for node 69f7fdd6559eef1735ba8bc5 2026-05-04 02:10:59,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:10:59,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fdd6559eef1735ba8bc5 HTTP/1.1" 200 None 2026-05-04 02:10:59,484 - lava_callback - DEBUG - Processing node 69f7fdd6559eef1735ba8bc5: baseline-arm64 2026-05-04 02:11:00,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:11:00,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:11:00,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fdd6559eef1735ba8bc5/log.txt.gz 2026-05-04 02:11:00,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:11:00,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:11:00,528 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fdd6559eef1735ba8bc5/lava-logs.yaml 2026-05-04 02:11:00,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:11:00,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:11:00,665 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f7fdd6559eef1735ba8bc5/lava_callback.json.gz 2026-05-04 02:11:00,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:11:00,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fdd6559eef1735ba8bc5 HTTP/1.1" 200 None 2026-05-04 02:11:00,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:11:00,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 02:11:00,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:11:00,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7fdd6559eef1735ba8bc5 HTTP/1.1" 200 None 2026-05-04 02:11:00,795 - lava_callback - INFO - Completed processing callback for node 69f7fdd6559eef1735ba8bc5 INFO: 172.20.0.1:50806 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:11:06,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:11:06,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39062 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:11:49,003 - lava_callback - INFO - Received callback for node 69f55d5ced4ed40b0224117a INFO: 172.20.0.1:39076 - "POST /node/69f55d5ced4ed40b0224117a HTTP/1.0" 202 Accepted 2026-05-04 02:11:49,009 - lava_callback - INFO - Starting async job submit for node 69f55d5ced4ed40b0224117a 2026-05-04 02:11:49,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:11:49,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55d5ced4ed40b0224117a HTTP/1.1" 200 None 2026-05-04 02:11:49,023 - lava_callback - DEBUG - Processing node 69f55d5ced4ed40b0224117a: baseline-arm-clabbe 2026-05-04 02:11:49,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55d5ced4ed40b0224117a 2026-05-04 02:11:49,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:11:49,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55d5ced4ed40b0224117a HTTP/1.1" 200 None 2026-05-04 02:11:49,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:11:49,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 02:11:49,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:11:49,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55d5ced4ed40b0224117a HTTP/1.1" 200 None 2026-05-04 02:11:49,101 - lava_callback - ERROR - Error processing callback for node 69f55d5ced4ed40b0224117a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50608 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:12:28,966 - lava_callback - INFO - Received callback for node 69f55d84ed4ed40b0224118d INFO: 172.20.0.1:50624 - "POST /node/69f55d84ed4ed40b0224118d HTTP/1.0" 202 Accepted 2026-05-04 02:12:28,972 - lava_callback - INFO - Starting async job submit for node 69f55d84ed4ed40b0224118d 2026-05-04 02:12:28,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:12:28,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55d84ed4ed40b0224118d HTTP/1.1" 200 None 2026-05-04 02:12:28,987 - lava_callback - DEBUG - Processing node 69f55d84ed4ed40b0224118d: baseline-arm-clabbe 2026-05-04 02:12:28,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55d84ed4ed40b0224118d 2026-05-04 02:12:28,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:12:29,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55d84ed4ed40b0224118d HTTP/1.1" 200 None 2026-05-04 02:12:29,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:12:29,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 02:12:29,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:12:29,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55d84ed4ed40b0224118d HTTP/1.1" 200 None 2026-05-04 02:12:29,034 - lava_callback - ERROR - Error processing callback for node 69f55d84ed4ed40b0224118d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48856 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:13:09,024 - lava_callback - INFO - Received callback for node 69f55daced4ed40b02241198 INFO: 172.20.0.1:48858 - "POST /node/69f55daced4ed40b02241198 HTTP/1.0" 202 Accepted 2026-05-04 02:13:09,029 - lava_callback - INFO - Starting async job submit for node 69f55daced4ed40b02241198 2026-05-04 02:13:09,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:13:09,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55daced4ed40b02241198 HTTP/1.1" 200 None 2026-05-04 02:13:09,044 - lava_callback - DEBUG - Processing node 69f55daced4ed40b02241198: baseline-arm-clabbe 2026-05-04 02:13:09,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55daced4ed40b02241198 2026-05-04 02:13:09,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:13:09,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55daced4ed40b02241198 HTTP/1.1" 200 None 2026-05-04 02:13:09,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:13:09,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 02:13:09,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:13:09,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55daced4ed40b02241198 HTTP/1.1" 200 None 2026-05-04 02:13:09,099 - lava_callback - ERROR - Error processing callback for node 69f55daced4ed40b02241198: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45124 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:15:09,300 - lava_callback - INFO - Received callback for node 69f55e21ed4ed40b022411c0 INFO: 172.20.0.1:45138 - "POST /node/69f55e21ed4ed40b022411c0 HTTP/1.0" 202 Accepted 2026-05-04 02:15:09,306 - lava_callback - INFO - Starting async job submit for node 69f55e21ed4ed40b022411c0 2026-05-04 02:15:09,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:15:09,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55e21ed4ed40b022411c0 HTTP/1.1" 200 None 2026-05-04 02:15:09,321 - lava_callback - DEBUG - Processing node 69f55e21ed4ed40b022411c0: baseline-arm-clabbe 2026-05-04 02:15:09,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55e21ed4ed40b022411c0 2026-05-04 02:15:09,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:15:09,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55e21ed4ed40b022411c0 HTTP/1.1" 200 None 2026-05-04 02:15:09,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:15:09,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 02:15:09,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:15:09,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55e21ed4ed40b022411c0 HTTP/1.1" 200 None 2026-05-04 02:15:09,371 - lava_callback - ERROR - Error processing callback for node 69f55e21ed4ed40b022411c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56992 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:15:57,580 - lava_callback - INFO - Received callback for node 69f7fcb9559eef1735ba8b5c INFO: 172.20.0.1:57002 - "POST /node/69f7fcb9559eef1735ba8b5c HTTP/1.0" 202 Accepted 2026-05-04 02:15:57,589 - lava_callback - INFO - Starting async job submit for node 69f7fcb9559eef1735ba8b5c 2026-05-04 02:15:57,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:15:57,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fcb9559eef1735ba8b5c HTTP/1.1" 200 None 2026-05-04 02:15:57,646 - lava_callback - DEBUG - Processing node 69f7fcb9559eef1735ba8b5c: baseline-nfs-arm64 2026-05-04 02:15:58,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:15:58,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:15:58,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7fcb9559eef1735ba8b5c/log.txt.gz 2026-05-04 02:15:59,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:15:59,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:15:59,726 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7fcb9559eef1735ba8b5c/lava-logs.yaml 2026-05-04 02:15:59,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:16:00,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:16:00,076 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7fcb9559eef1735ba8b5c/lava_callback.json.gz DEBUG: Setup failed for 69f7fcb9559eef1735ba8b5c. Transitting job node result: incomplete -> fail 2026-05-04 02:16:00,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:16:00,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fcb9559eef1735ba8b5c HTTP/1.1" 200 None 2026-05-04 02:16:00,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:16:00,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 02:16:00,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:16:00,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7fcb9559eef1735ba8b5c HTTP/1.1" 200 None 2026-05-04 02:16:00,315 - lava_callback - INFO - Completed processing callback for node 69f7fcb9559eef1735ba8b5c INFO: 172.20.0.1:35174 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:16:06,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:16:06,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35186 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:16:09,122 - lava_callback - INFO - Received callback for node 69f55e56ed4ed40b022411d8 INFO: 172.20.0.1:35192 - "POST /node/69f55e56ed4ed40b022411d8 HTTP/1.0" 202 Accepted 2026-05-04 02:16:09,128 - lava_callback - INFO - Starting async job submit for node 69f55e56ed4ed40b022411d8 2026-05-04 02:16:09,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:16:09,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55e56ed4ed40b022411d8 HTTP/1.1" 200 None 2026-05-04 02:16:09,143 - lava_callback - DEBUG - Processing node 69f55e56ed4ed40b022411d8: baseline-arm64-clabbe 2026-05-04 02:16:09,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55e56ed4ed40b022411d8 2026-05-04 02:16:09,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:16:09,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55e56ed4ed40b022411d8 HTTP/1.1" 200 None 2026-05-04 02:16:09,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:16:09,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-04 02:16:09,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:16:09,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55e56ed4ed40b022411d8 HTTP/1.1" 200 None 2026-05-04 02:16:09,253 - lava_callback - ERROR - Error processing callback for node 69f55e56ed4ed40b022411d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34998 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:16:38,525 - lava_callback - INFO - Received callback for node 69f7fdce559eef1735ba8bc1 INFO: 172.20.0.1:35008 - "POST /node/69f7fdce559eef1735ba8bc1 HTTP/1.0" 202 Accepted 2026-05-04 02:16:38,532 - lava_callback - INFO - Starting async job submit for node 69f7fdce559eef1735ba8bc1 2026-05-04 02:16:38,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:16:38,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fdce559eef1735ba8bc1 HTTP/1.1" 200 None 2026-05-04 02:16:38,589 - lava_callback - DEBUG - Processing node 69f7fdce559eef1735ba8bc1: baseline-x86 2026-05-04 02:16:39,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:16:39,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:16:39,421 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f7fdce559eef1735ba8bc1/log.txt.gz 2026-05-04 02:16:39,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:16:40,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:16:40,013 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f7fdce559eef1735ba8bc1/lava-logs.yaml 2026-05-04 02:16:40,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:16:40,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:16:40,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f7fdce559eef1735ba8bc1/lava_callback.json.gz DEBUG: Setup failed for 69f7fdce559eef1735ba8bc1. Transitting job node result: incomplete -> fail 2026-05-04 02:16:40,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:16:40,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fdce559eef1735ba8bc1 HTTP/1.1" 200 None 2026-05-04 02:16:40,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:16:40,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5de559eef1735ba5778 HTTP/1.1" 200 None 2026-05-04 02:16:40,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:16:40,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7fdce559eef1735ba8bc1 HTTP/1.1" 200 None 2026-05-04 02:16:40,424 - lava_callback - INFO - Completed processing callback for node 69f7fdce559eef1735ba8bc1 INFO: 172.20.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60670 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:17:06,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:17:06,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57818 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:17:48,967 - lava_callback - INFO - Received callback for node 69f7fe75559eef1735ba8c0d INFO: 172.20.0.1:57828 - "POST /node/69f7fe75559eef1735ba8c0d HTTP/1.0" 202 Accepted 2026-05-04 02:17:48,974 - lava_callback - INFO - Starting async job submit for node 69f7fe75559eef1735ba8c0d 2026-05-04 02:17:49,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:17:49,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fe75559eef1735ba8c0d HTTP/1.1" 200 None 2026-05-04 02:17:49,014 - lava_callback - DEBUG - Processing node 69f7fe75559eef1735ba8c0d: baseline-nfs-arm64 2026-05-04 02:17:49,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:17:49,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:17:49,521 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7fe75559eef1735ba8c0d/log.txt.gz 2026-05-04 02:17:49,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:17:49,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:17:49,954 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7fe75559eef1735ba8c0d/lava-logs.yaml 2026-05-04 02:17:49,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:17:50,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:17:50,091 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f7fe75559eef1735ba8c0d/lava_callback.json.gz 2026-05-04 02:17:50,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:17:50,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fe75559eef1735ba8c0d HTTP/1.1" 200 None 2026-05-04 02:17:50,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:17:50,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 02:17:50,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:17:50,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7fe75559eef1735ba8c0d HTTP/1.1" 200 None 2026-05-04 02:17:50,207 - lava_callback - INFO - Completed processing callback for node 69f7fe75559eef1735ba8c0d INFO: 172.20.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46190 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:18:06,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:18:06,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54432 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:19:28,978 - lava_callback - INFO - Received callback for node 69f801e3559eef1735ba8d6a INFO: 172.20.0.1:54438 - "POST /node/69f801e3559eef1735ba8d6a HTTP/1.0" 202 Accepted 2026-05-04 02:19:28,984 - lava_callback - INFO - Starting async job submit for node 69f801e3559eef1735ba8d6a 2026-05-04 02:19:29,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:19:29,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f801e3559eef1735ba8d6a HTTP/1.1" 200 None 2026-05-04 02:19:29,016 - lava_callback - DEBUG - Processing node 69f801e3559eef1735ba8d6a: baseline-x86 2026-05-04 02:19:29,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:19:29,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:19:29,579 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f801e3559eef1735ba8d6a/log.txt.gz 2026-05-04 02:19:29,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:19:30,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:19:30,108 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f801e3559eef1735ba8d6a/lava-logs.yaml 2026-05-04 02:19:30,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:19:30,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:19:30,240 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f801e3559eef1735ba8d6a/lava_callback.json.gz 2026-05-04 02:19:30,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:19:30,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f801e3559eef1735ba8d6a HTTP/1.1" 200 None 2026-05-04 02:19:30,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:19:30,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5de559eef1735ba5778 HTTP/1.1" 200 None 2026-05-04 02:19:30,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:19:30,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f801e3559eef1735ba8d6a HTTP/1.1" 200 None 2026-05-04 02:19:30,317 - lava_callback - INFO - Completed processing callback for node 69f801e3559eef1735ba8d6a INFO: 172.20.0.1:56466 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:19:36,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:19:36,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50086 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:19:54,616 - lava_callback - INFO - Received callback for node 69f7fe1f559eef1735ba8be7 INFO: 172.20.0.1:56502 - "POST /node/69f7fe1f559eef1735ba8be7 HTTP/1.0" 202 Accepted 2026-05-04 02:19:54,623 - lava_callback - INFO - Starting async job submit for node 69f7fe1f559eef1735ba8be7 2026-05-04 02:19:54,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:19:54,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fe1f559eef1735ba8be7 HTTP/1.1" 200 None 2026-05-04 02:19:54,716 - lava_callback - DEBUG - Processing node 69f7fe1f559eef1735ba8be7: ltp-smoke 2026-05-04 02:19:55,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:19:55,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:19:55,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7fe1f559eef1735ba8be7/log.txt.gz 2026-05-04 02:19:55,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:19:55,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:19:55,732 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7fe1f559eef1735ba8be7/lava-logs.yaml 2026-05-04 02:19:55,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:19:55,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:19:55,857 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f7fe1f559eef1735ba8be7/lava_callback.json.gz 2026-05-04 02:19:55,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:19:55,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fe1f559eef1735ba8be7 HTTP/1.1" 200 None 2026-05-04 02:19:55,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:19:56,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5be559eef1735ba573d HTTP/1.1" 200 None 2026-05-04 02:19:56,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:19:56,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7fe1f559eef1735ba8be7 HTTP/1.1" 200 None 2026-05-04 02:19:56,143 - lava_callback - INFO - Completed processing callback for node 69f7fe1f559eef1735ba8be7 INFO: 172.20.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45044 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:20:06,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:20:06,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45052 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:20:09,404 - lava_callback - INFO - Received callback for node 69f55f43ed4ed40b02241259 INFO: 172.20.0.1:45060 - "POST /node/69f55f43ed4ed40b02241259 HTTP/1.0" 202 Accepted 2026-05-04 02:20:09,410 - lava_callback - INFO - Starting async job submit for node 69f55f43ed4ed40b02241259 2026-05-04 02:20:09,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:20:09,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55f43ed4ed40b02241259 HTTP/1.1" 200 None 2026-05-04 02:20:09,425 - lava_callback - DEBUG - Processing node 69f55f43ed4ed40b02241259: baseline-arm64-clabbe 2026-05-04 02:20:09,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55f43ed4ed40b02241259 2026-05-04 02:20:09,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:20:09,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55f43ed4ed40b02241259 HTTP/1.1" 200 None 2026-05-04 02:20:09,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:20:09,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-04 02:20:09,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:20:09,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55f43ed4ed40b02241259 HTTP/1.1" 200 None 2026-05-04 02:20:09,471 - lava_callback - ERROR - Error processing callback for node 69f55f43ed4ed40b02241259: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50552 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:21:29,408 - lava_callback - INFO - Received callback for node 69f55f97ed4ed40b02241275 INFO: 172.20.0.1:50564 - "POST /node/69f55f97ed4ed40b02241275 HTTP/1.0" 202 Accepted 2026-05-04 02:21:29,414 - lava_callback - INFO - Starting async job submit for node 69f55f97ed4ed40b02241275 2026-05-04 02:21:29,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:21:29,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55f97ed4ed40b02241275 HTTP/1.1" 200 None 2026-05-04 02:21:29,430 - lava_callback - DEBUG - Processing node 69f55f97ed4ed40b02241275: baseline-arm64-clabbe 2026-05-04 02:21:29,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f55f97ed4ed40b02241275 2026-05-04 02:21:29,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:21:29,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f55f97ed4ed40b02241275 HTTP/1.1" 200 None 2026-05-04 02:21:29,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:21:29,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 02:21:29,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:21:29,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f55f97ed4ed40b02241275 HTTP/1.1" 200 None 2026-05-04 02:21:29,474 - lava_callback - ERROR - Error processing callback for node 69f55f97ed4ed40b02241275: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36502 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:23:20,046 - lava_callback - INFO - Received callback for node 69f80050559eef1735ba8cda INFO: 172.20.0.1:38672 - "POST /node/69f80050559eef1735ba8cda HTTP/1.0" 202 Accepted 2026-05-04 02:23:20,053 - lava_callback - INFO - Starting async job submit for node 69f80050559eef1735ba8cda 2026-05-04 02:23:20,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:23:20,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f80050559eef1735ba8cda HTTP/1.1" 200 None 2026-05-04 02:23:20,095 - lava_callback - DEBUG - Processing node 69f80050559eef1735ba8cda: baseline-arm64 2026-05-04 02:23:20,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:23:20,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:23:20,730 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f80050559eef1735ba8cda/log.txt.gz 2026-05-04 02:23:21,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:23:21,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:23:21,175 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f80050559eef1735ba8cda/lava-logs.yaml 2026-05-04 02:23:21,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:23:21,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:23:21,308 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f80050559eef1735ba8cda/lava_callback.json.gz 2026-05-04 02:23:21,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:23:21,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f80050559eef1735ba8cda HTTP/1.1" 200 None 2026-05-04 02:23:21,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:23:21,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 02:23:21,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:23:21,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f80050559eef1735ba8cda HTTP/1.1" 200 None 2026-05-04 02:23:21,431 - lava_callback - INFO - Completed processing callback for node 69f80050559eef1735ba8cda INFO: 172.20.0.1:38682 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:23:29,480 - lava_callback - INFO - Received callback for node 69f5600ced4ed40b022412ac INFO: 172.20.0.1:38696 - "POST /node/69f5600ced4ed40b022412ac HTTP/1.0" 202 Accepted 2026-05-04 02:23:29,485 - lava_callback - INFO - Starting async job submit for node 69f5600ced4ed40b022412ac 2026-05-04 02:23:29,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:23:29,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5600ced4ed40b022412ac HTTP/1.1" 200 None 2026-05-04 02:23:29,501 - lava_callback - DEBUG - Processing node 69f5600ced4ed40b022412ac: baseline-arm64-clabbe 2026-05-04 02:23:29,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5600ced4ed40b022412ac 2026-05-04 02:23:29,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:23:29,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5600ced4ed40b022412ac HTTP/1.1" 200 None 2026-05-04 02:23:29,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:23:29,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-04 02:23:29,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:23:29,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5600ced4ed40b022412ac HTTP/1.1" 200 None 2026-05-04 02:23:29,549 - lava_callback - ERROR - Error processing callback for node 69f5600ced4ed40b022412ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58700 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:23:36,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:23:36,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51376 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:24:49,555 - lava_callback - INFO - Received callback for node 69f5605ced4ed40b022412d7 INFO: 172.20.0.1:51380 - "POST /node/69f5605ced4ed40b022412d7 HTTP/1.0" 202 Accepted 2026-05-04 02:24:49,561 - lava_callback - INFO - Starting async job submit for node 69f5605ced4ed40b022412d7 2026-05-04 02:24:49,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:24:49,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5605ced4ed40b022412d7 HTTP/1.1" 200 None 2026-05-04 02:24:49,576 - lava_callback - DEBUG - Processing node 69f5605ced4ed40b022412d7: baseline-arm64-clabbe 2026-05-04 02:24:49,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5605ced4ed40b022412d7 2026-05-04 02:24:49,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:24:49,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5605ced4ed40b022412d7 HTTP/1.1" 200 None 2026-05-04 02:24:49,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:24:49,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-04 02:24:49,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:24:49,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5605ced4ed40b022412d7 HTTP/1.1" 200 None 2026-05-04 02:24:49,622 - lava_callback - ERROR - Error processing callback for node 69f5605ced4ed40b022412d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57754 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:26:09,578 - lava_callback - INFO - Received callback for node 69f560abed4ed40b02241306 INFO: 172.20.0.1:57764 - "POST /node/69f560abed4ed40b02241306 HTTP/1.0" 202 Accepted 2026-05-04 02:26:09,584 - lava_callback - INFO - Starting async job submit for node 69f560abed4ed40b02241306 2026-05-04 02:26:09,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:26:09,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f560abed4ed40b02241306 HTTP/1.1" 200 None 2026-05-04 02:26:09,599 - lava_callback - DEBUG - Processing node 69f560abed4ed40b02241306: baseline-arm64-clabbe 2026-05-04 02:26:09,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f560abed4ed40b02241306 2026-05-04 02:26:09,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:26:09,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f560abed4ed40b02241306 HTTP/1.1" 200 None 2026-05-04 02:26:09,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:26:09,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-04 02:26:09,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:26:09,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f560abed4ed40b02241306 HTTP/1.1" 200 None 2026-05-04 02:26:09,651 - lava_callback - ERROR - Error processing callback for node 69f560abed4ed40b02241306: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38820 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:27:09,635 - lava_callback - INFO - Received callback for node 69f560faed4ed40b0224132b INFO: 172.20.0.1:38826 - "POST /node/69f560faed4ed40b0224132b HTTP/1.0" 202 Accepted 2026-05-04 02:27:09,641 - lava_callback - INFO - Starting async job submit for node 69f560faed4ed40b0224132b 2026-05-04 02:27:09,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:27:09,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f560faed4ed40b0224132b HTTP/1.1" 200 None 2026-05-04 02:27:09,661 - lava_callback - DEBUG - Processing node 69f560faed4ed40b0224132b: baseline-arm64-clabbe 2026-05-04 02:27:09,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f560faed4ed40b0224132b 2026-05-04 02:27:09,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:27:09,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f560faed4ed40b0224132b HTTP/1.1" 200 None 2026-05-04 02:27:09,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:27:09,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-04 02:27:09,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:27:09,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f560faed4ed40b0224132b HTTP/1.1" 200 None 2026-05-04 02:27:09,713 - lava_callback - ERROR - Error processing callback for node 69f560faed4ed40b0224132b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39972 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:27:34,226 - lava_callback - INFO - Received callback for node 69f8002a559eef1735ba8cc8 INFO: 172.20.0.1:54396 - "POST /node/69f8002a559eef1735ba8cc8 HTTP/1.0" 202 Accepted 2026-05-04 02:27:34,233 - lava_callback - INFO - Starting async job submit for node 69f8002a559eef1735ba8cc8 2026-05-04 02:27:34,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:27:34,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8002a559eef1735ba8cc8 HTTP/1.1" 200 None 2026-05-04 02:27:34,305 - lava_callback - DEBUG - Processing node 69f8002a559eef1735ba8cc8: baseline-arm 2026-05-04 02:27:34,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:27:34,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:27:34,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f8002a559eef1735ba8cc8/log.txt.gz 2026-05-04 02:27:35,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:27:35,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:27:35,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8002a559eef1735ba8cc8/lava-logs.yaml 2026-05-04 02:27:35,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:27:35,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:27:35,651 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8002a559eef1735ba8cc8/lava_callback.json.gz DEBUG: Setup failed for 69f8002a559eef1735ba8cc8. Transitting job node result: incomplete -> fail 2026-05-04 02:27:35,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:27:35,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8002a559eef1735ba8cc8 HTTP/1.1" 200 None 2026-05-04 02:27:35,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:27:35,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-04 02:27:35,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:27:35,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8002a559eef1735ba8cc8 HTTP/1.1" 200 None 2026-05-04 02:27:35,930 - lava_callback - INFO - Completed processing callback for node 69f8002a559eef1735ba8cc8 INFO: 172.20.0.1:54408 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:27:36,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:27:36,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59118 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:29:09,723 - lava_callback - INFO - Received callback for node 69f5616eed4ed40b0224135f INFO: 172.20.0.1:45586 - "POST /node/69f5616eed4ed40b0224135f HTTP/1.0" 202 Accepted 2026-05-04 02:29:09,729 - lava_callback - INFO - Starting async job submit for node 69f5616eed4ed40b0224135f 2026-05-04 02:29:09,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:29:09,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5616eed4ed40b0224135f HTTP/1.1" 200 None 2026-05-04 02:29:09,744 - lava_callback - DEBUG - Processing node 69f5616eed4ed40b0224135f: baseline-arm64-clabbe 2026-05-04 02:29:09,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5616eed4ed40b0224135f 2026-05-04 02:29:09,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:29:09,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5616eed4ed40b0224135f HTTP/1.1" 200 None 2026-05-04 02:29:09,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:29:09,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 02:29:09,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:29:09,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5616eed4ed40b0224135f HTTP/1.1" 200 None 2026-05-04 02:29:09,793 - lava_callback - ERROR - Error processing callback for node 69f5616eed4ed40b0224135f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37366 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:30:37,978 - lava_callback - INFO - Received callback for node 69f801ef559eef1735ba8d6f INFO: 172.20.0.1:37378 - "POST /node/69f801ef559eef1735ba8d6f HTTP/1.0" 202 Accepted 2026-05-04 02:30:37,985 - lava_callback - INFO - Starting async job submit for node 69f801ef559eef1735ba8d6f 2026-05-04 02:30:38,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:30:38,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f801ef559eef1735ba8d6f HTTP/1.1" 200 None 2026-05-04 02:30:38,026 - lava_callback - DEBUG - Processing node 69f801ef559eef1735ba8d6f: baseline-nfs-arm64 2026-05-04 02:30:38,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:30:38,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:30:38,823 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f801ef559eef1735ba8d6f/log.txt.gz 2026-05-04 02:30:39,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:30:39,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:30:39,264 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f801ef559eef1735ba8d6f/lava-logs.yaml 2026-05-04 02:30:39,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:30:39,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:30:39,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f801ef559eef1735ba8d6f/lava_callback.json.gz 2026-05-04 02:30:39,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:30:39,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f801ef559eef1735ba8d6f HTTP/1.1" 200 None 2026-05-04 02:30:39,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:30:39,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 02:30:39,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:30:39,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f801ef559eef1735ba8d6f HTTP/1.1" 200 None 2026-05-04 02:30:39,531 - lava_callback - INFO - Completed processing callback for node 69f801ef559eef1735ba8d6f INFO: 172.20.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50044 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:31:06,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:31:06,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50054 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:31:09,790 - lava_callback - INFO - Received callback for node 69f561dced4ed40b022413a8 INFO: 172.20.0.1:51178 - "POST /node/69f561dced4ed40b022413a8 HTTP/1.0" 202 Accepted 2026-05-04 02:31:09,796 - lava_callback - INFO - Starting async job submit for node 69f561dced4ed40b022413a8 2026-05-04 02:31:09,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:31:09,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f561dced4ed40b022413a8 HTTP/1.1" 200 None 2026-05-04 02:31:09,817 - lava_callback - DEBUG - Processing node 69f561dced4ed40b022413a8: baseline-arm64-clabbe 2026-05-04 02:31:09,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f561dced4ed40b022413a8 2026-05-04 02:31:09,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:31:09,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f561dced4ed40b022413a8 HTTP/1.1" 200 None 2026-05-04 02:31:09,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:31:09,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-04 02:31:09,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:31:09,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f561dced4ed40b022413a8 HTTP/1.1" 200 None 2026-05-04 02:31:09,864 - lava_callback - ERROR - Error processing callback for node 69f561dced4ed40b022413a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34922 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:32:29,870 - lava_callback - INFO - Received callback for node 69f56229ed4ed40b022413d6 INFO: 172.20.0.1:57164 - "POST /node/69f56229ed4ed40b022413d6 HTTP/1.0" 202 Accepted 2026-05-04 02:32:29,876 - lava_callback - INFO - Starting async job submit for node 69f56229ed4ed40b022413d6 2026-05-04 02:32:29,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:32:29,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56229ed4ed40b022413d6 HTTP/1.1" 200 None 2026-05-04 02:32:29,891 - lava_callback - DEBUG - Processing node 69f56229ed4ed40b022413d6: baseline-arm64-clabbe 2026-05-04 02:32:29,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56229ed4ed40b022413d6 2026-05-04 02:32:29,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:32:29,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56229ed4ed40b022413d6 HTTP/1.1" 200 None 2026-05-04 02:32:29,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:32:29,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-04 02:32:29,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:32:29,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56229ed4ed40b022413d6 HTTP/1.1" 200 None 2026-05-04 02:32:29,937 - lava_callback - ERROR - Error processing callback for node 69f56229ed4ed40b022413d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54498 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:34:09,940 - lava_callback - INFO - Received callback for node 69f5629aed4ed40b02241412 INFO: 172.20.0.1:48458 - "POST /node/69f5629aed4ed40b02241412 HTTP/1.0" 202 Accepted 2026-05-04 02:34:09,945 - lava_callback - INFO - Starting async job submit for node 69f5629aed4ed40b02241412 2026-05-04 02:34:09,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:34:09,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5629aed4ed40b02241412 HTTP/1.1" 200 None 2026-05-04 02:34:09,961 - lava_callback - DEBUG - Processing node 69f5629aed4ed40b02241412: baseline-arm64-clabbe 2026-05-04 02:34:09,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5629aed4ed40b02241412 2026-05-04 02:34:09,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:34:09,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5629aed4ed40b02241412 HTTP/1.1" 200 None 2026-05-04 02:34:09,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:34:09,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-04 02:34:09,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:34:10,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5629aed4ed40b02241412 HTTP/1.1" 200 None 2026-05-04 02:34:10,008 - lava_callback - ERROR - Error processing callback for node 69f5629aed4ed40b02241412: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52640 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:36:11,761 - lava_callback - INFO - Received callback for node 69f80168559eef1735ba8d3c INFO: 172.20.0.1:57206 - "POST /node/69f80168559eef1735ba8d3c HTTP/1.0" 202 Accepted 2026-05-04 02:36:11,773 - lava_callback - INFO - Starting async job submit for node 69f80168559eef1735ba8d3c 2026-05-04 02:36:11,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:36:11,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f80168559eef1735ba8d3c HTTP/1.1" 200 None 2026-05-04 02:36:11,854 - lava_callback - DEBUG - Processing node 69f80168559eef1735ba8d3c: baseline-nfs-arm64 2026-05-04 02:36:12,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:36:13,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:36:13,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f80168559eef1735ba8d3c/log.txt.gz 2026-05-04 02:36:13,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:36:14,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:36:14,115 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f80168559eef1735ba8d3c/lava-logs.yaml 2026-05-04 02:36:14,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:36:14,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:36:14,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f80168559eef1735ba8d3c/lava_callback.json.gz DEBUG: Setup failed for 69f80168559eef1735ba8d3c. Transitting job node result: incomplete -> fail 2026-05-04 02:36:14,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:36:14,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f80168559eef1735ba8d3c HTTP/1.1" 200 None 2026-05-04 02:36:14,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:36:14,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 02:36:14,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:36:14,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f80168559eef1735ba8d3c HTTP/1.1" 200 None 2026-05-04 02:36:14,511 - lava_callback - INFO - Completed processing callback for node 69f80168559eef1735ba8d3c INFO: 172.20.0.1:57214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46246 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:36:36,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:36:36,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42610 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:36:50,036 - lava_callback - INFO - Received callback for node 69f5633aed4ed40b02241459 INFO: 172.20.0.1:35918 - "POST /node/69f5633aed4ed40b02241459 HTTP/1.0" 202 Accepted 2026-05-04 02:36:50,041 - lava_callback - INFO - Starting async job submit for node 69f5633aed4ed40b02241459 2026-05-04 02:36:50,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:36:50,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5633aed4ed40b02241459 HTTP/1.1" 200 None 2026-05-04 02:36:50,057 - lava_callback - DEBUG - Processing node 69f5633aed4ed40b02241459: baseline-arm64-clabbe 2026-05-04 02:36:50,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5633aed4ed40b02241459 2026-05-04 02:36:50,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:36:50,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5633aed4ed40b02241459 HTTP/1.1" 200 None 2026-05-04 02:36:50,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:36:50,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 02:36:50,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:36:50,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5633aed4ed40b02241459 HTTP/1.1" 200 None 2026-05-04 02:36:50,112 - lava_callback - ERROR - Error processing callback for node 69f5633aed4ed40b02241459: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38008 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:38:10,105 - lava_callback - INFO - Received callback for node 69f5638ced4ed40b0224147f INFO: 172.20.0.1:55692 - "POST /node/69f5638ced4ed40b0224147f HTTP/1.0" 202 Accepted 2026-05-04 02:38:10,110 - lava_callback - INFO - Starting async job submit for node 69f5638ced4ed40b0224147f 2026-05-04 02:38:10,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:38:10,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5638ced4ed40b0224147f HTTP/1.1" 200 None 2026-05-04 02:38:10,126 - lava_callback - DEBUG - Processing node 69f5638ced4ed40b0224147f: baseline-arm64-clabbe 2026-05-04 02:38:10,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5638ced4ed40b0224147f 2026-05-04 02:38:10,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:38:10,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5638ced4ed40b0224147f HTTP/1.1" 200 None 2026-05-04 02:38:10,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:38:10,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-04 02:38:10,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:38:10,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5638ced4ed40b0224147f HTTP/1.1" 200 None 2026-05-04 02:38:10,172 - lava_callback - ERROR - Error processing callback for node 69f5638ced4ed40b0224147f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49830 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:39:30,148 - lava_callback - INFO - Received callback for node 69f563d5ed4ed40b022414ba INFO: 172.20.0.1:51588 - "POST /node/69f563d5ed4ed40b022414ba HTTP/1.0" 202 Accepted 2026-05-04 02:39:30,153 - lava_callback - INFO - Starting async job submit for node 69f563d5ed4ed40b022414ba 2026-05-04 02:39:30,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:39:30,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f563d5ed4ed40b022414ba HTTP/1.1" 200 None 2026-05-04 02:39:30,170 - lava_callback - DEBUG - Processing node 69f563d5ed4ed40b022414ba: baseline-arm64-clabbe 2026-05-04 02:39:30,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f563d5ed4ed40b022414ba 2026-05-04 02:39:30,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:39:30,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f563d5ed4ed40b022414ba HTTP/1.1" 200 None 2026-05-04 02:39:30,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:39:30,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 02:39:30,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:39:30,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f563d5ed4ed40b022414ba HTTP/1.1" 200 None 2026-05-04 02:39:30,246 - lava_callback - ERROR - Error processing callback for node 69f563d5ed4ed40b022414ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44896 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:40:50,180 - lava_callback - INFO - Received callback for node 69f5641eed4ed40b022414e9 INFO: 172.20.0.1:58696 - "POST /node/69f5641eed4ed40b022414e9 HTTP/1.0" 202 Accepted 2026-05-04 02:40:50,186 - lava_callback - INFO - Starting async job submit for node 69f5641eed4ed40b022414e9 2026-05-04 02:40:50,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:40:50,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5641eed4ed40b022414e9 HTTP/1.1" 200 None 2026-05-04 02:40:50,202 - lava_callback - DEBUG - Processing node 69f5641eed4ed40b022414e9: baseline-arm64-clabbe 2026-05-04 02:40:50,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5641eed4ed40b022414e9 2026-05-04 02:40:50,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:40:50,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5641eed4ed40b022414e9 HTTP/1.1" 200 None 2026-05-04 02:40:50,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:40:50,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-04 02:40:50,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:40:50,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5641eed4ed40b022414e9 HTTP/1.1" 200 None 2026-05-04 02:40:50,259 - lava_callback - ERROR - Error processing callback for node 69f5641eed4ed40b022414e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40118 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:41:50,218 - lava_callback - INFO - Received callback for node 69f5646aed4ed40b02241514 INFO: 172.20.0.1:33576 - "POST /node/69f5646aed4ed40b02241514 HTTP/1.0" 202 Accepted 2026-05-04 02:41:50,223 - lava_callback - INFO - Starting async job submit for node 69f5646aed4ed40b02241514 2026-05-04 02:41:50,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:41:50,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5646aed4ed40b02241514 HTTP/1.1" 200 None 2026-05-04 02:41:50,239 - lava_callback - DEBUG - Processing node 69f5646aed4ed40b02241514: baseline-arm64-clabbe 2026-05-04 02:41:50,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5646aed4ed40b02241514 2026-05-04 02:41:50,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:41:50,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5646aed4ed40b02241514 HTTP/1.1" 200 None 2026-05-04 02:41:50,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:41:50,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-04 02:41:50,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:41:50,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5646aed4ed40b02241514 HTTP/1.1" 200 None 2026-05-04 02:41:50,285 - lava_callback - ERROR - Error processing callback for node 69f5646aed4ed40b02241514: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50566 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:43:10,256 - lava_callback - INFO - Received callback for node 69f564b7ed4ed40b0224152f INFO: 172.20.0.1:51736 - "POST /node/69f564b7ed4ed40b0224152f HTTP/1.0" 202 Accepted 2026-05-04 02:43:10,263 - lava_callback - INFO - Starting async job submit for node 69f564b7ed4ed40b0224152f 2026-05-04 02:43:10,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:43:10,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f564b7ed4ed40b0224152f HTTP/1.1" 200 None 2026-05-04 02:43:10,292 - lava_callback - DEBUG - Processing node 69f564b7ed4ed40b0224152f: baseline-arm64-clabbe 2026-05-04 02:43:10,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f564b7ed4ed40b0224152f 2026-05-04 02:43:10,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:43:10,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f564b7ed4ed40b0224152f HTTP/1.1" 200 None 2026-05-04 02:43:10,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:43:10,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-04 02:43:10,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:43:10,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f564b7ed4ed40b0224152f HTTP/1.1" 200 None 2026-05-04 02:43:10,341 - lava_callback - ERROR - Error processing callback for node 69f564b7ed4ed40b0224152f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44776 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:44:30,314 - lava_callback - INFO - Received callback for node 69f56506ed4ed40b02241553 INFO: 172.20.0.1:47848 - "POST /node/69f56506ed4ed40b02241553 HTTP/1.0" 202 Accepted 2026-05-04 02:44:30,320 - lava_callback - INFO - Starting async job submit for node 69f56506ed4ed40b02241553 2026-05-04 02:44:30,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:44:30,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56506ed4ed40b02241553 HTTP/1.1" 200 None 2026-05-04 02:44:30,335 - lava_callback - DEBUG - Processing node 69f56506ed4ed40b02241553: baseline-arm64-clabbe 2026-05-04 02:44:30,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56506ed4ed40b02241553 2026-05-04 02:44:30,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:44:30,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56506ed4ed40b02241553 HTTP/1.1" 200 None 2026-05-04 02:44:30,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:44:30,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-04 02:44:30,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:44:30,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56506ed4ed40b02241553 HTTP/1.1" 200 None 2026-05-04 02:44:30,383 - lava_callback - ERROR - Error processing callback for node 69f56506ed4ed40b02241553: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60632 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:45:50,317 - lava_callback - INFO - Received callback for node 69f56552ed4ed40b02241571 INFO: 172.20.0.1:44792 - "POST /node/69f56552ed4ed40b02241571 HTTP/1.0" 202 Accepted 2026-05-04 02:45:50,322 - lava_callback - INFO - Starting async job submit for node 69f56552ed4ed40b02241571 2026-05-04 02:45:50,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:45:50,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56552ed4ed40b02241571 HTTP/1.1" 200 None 2026-05-04 02:45:50,337 - lava_callback - DEBUG - Processing node 69f56552ed4ed40b02241571: baseline-arm64-clabbe 2026-05-04 02:45:50,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56552ed4ed40b02241571 2026-05-04 02:45:50,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:45:50,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56552ed4ed40b02241571 HTTP/1.1" 200 None 2026-05-04 02:45:50,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:45:50,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-04 02:45:50,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:45:50,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56552ed4ed40b02241571 HTTP/1.1" 200 None 2026-05-04 02:45:50,389 - lava_callback - ERROR - Error processing callback for node 69f56552ed4ed40b02241571: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52606 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:47:10,401 - lava_callback - INFO - Received callback for node 69f565a0ed4ed40b02241598 INFO: 172.20.0.1:55706 - "POST /node/69f565a0ed4ed40b02241598 HTTP/1.0" 202 Accepted 2026-05-04 02:47:10,407 - lava_callback - INFO - Starting async job submit for node 69f565a0ed4ed40b02241598 2026-05-04 02:47:10,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:47:10,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f565a0ed4ed40b02241598 HTTP/1.1" 200 None 2026-05-04 02:47:10,424 - lava_callback - DEBUG - Processing node 69f565a0ed4ed40b02241598: baseline-arm64-clabbe 2026-05-04 02:47:10,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f565a0ed4ed40b02241598 2026-05-04 02:47:10,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:47:10,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f565a0ed4ed40b02241598 HTTP/1.1" 200 None 2026-05-04 02:47:10,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:47:10,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 02:47:10,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:47:10,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f565a0ed4ed40b02241598 HTTP/1.1" 200 None 2026-05-04 02:47:10,482 - lava_callback - ERROR - Error processing callback for node 69f565a0ed4ed40b02241598: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60024 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:52:30,649 - lava_callback - INFO - Received callback for node 69f566e4ed4ed40b0224163a INFO: 172.20.0.1:32908 - "POST /node/69f566e4ed4ed40b0224163a HTTP/1.0" 202 Accepted 2026-05-04 02:52:30,654 - lava_callback - INFO - Starting async job submit for node 69f566e4ed4ed40b0224163a 2026-05-04 02:52:30,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:52:30,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f566e4ed4ed40b0224163a HTTP/1.1" 200 None 2026-05-04 02:52:30,670 - lava_callback - DEBUG - Processing node 69f566e4ed4ed40b0224163a: baseline-arm64-clabbe 2026-05-04 02:52:30,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f566e4ed4ed40b0224163a 2026-05-04 02:52:30,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:52:30,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f566e4ed4ed40b0224163a HTTP/1.1" 200 None 2026-05-04 02:52:30,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:52:30,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-04 02:52:30,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:52:30,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f566e4ed4ed40b0224163a HTTP/1.1" 200 None 2026-05-04 02:52:30,734 - lava_callback - ERROR - Error processing callback for node 69f566e4ed4ed40b0224163a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42930 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:55:10,831 - lava_callback - INFO - Received callback for node 69f5677eed4ed40b02241684 INFO: 172.20.0.1:56746 - "POST /node/69f5677eed4ed40b02241684 HTTP/1.0" 202 Accepted 2026-05-04 02:55:10,837 - lava_callback - INFO - Starting async job submit for node 69f5677eed4ed40b02241684 2026-05-04 02:55:10,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:55:10,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5677eed4ed40b02241684 HTTP/1.1" 200 None 2026-05-04 02:55:10,854 - lava_callback - DEBUG - Processing node 69f5677eed4ed40b02241684: baseline-arm64-clabbe 2026-05-04 02:55:10,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5677eed4ed40b02241684 2026-05-04 02:55:10,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:55:10,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5677eed4ed40b02241684 HTTP/1.1" 200 None 2026-05-04 02:55:10,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:55:10,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 02:55:10,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:55:10,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5677eed4ed40b02241684 HTTP/1.1" 200 None 2026-05-04 02:55:10,906 - lava_callback - ERROR - Error processing callback for node 69f5677eed4ed40b02241684: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39064 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:56:30,791 - lava_callback - INFO - Received callback for node 69f567cced4ed40b022416a5 INFO: 172.20.0.1:35002 - "POST /node/69f567cced4ed40b022416a5 HTTP/1.0" 202 Accepted 2026-05-04 02:56:30,797 - lava_callback - INFO - Starting async job submit for node 69f567cced4ed40b022416a5 2026-05-04 02:56:30,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:56:30,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f567cced4ed40b022416a5 HTTP/1.1" 200 None 2026-05-04 02:56:30,812 - lava_callback - DEBUG - Processing node 69f567cced4ed40b022416a5: baseline-arm64-clabbe 2026-05-04 02:56:30,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f567cced4ed40b022416a5 2026-05-04 02:56:30,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:56:30,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f567cced4ed40b022416a5 HTTP/1.1" 200 None 2026-05-04 02:56:30,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:56:30,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-04 02:56:30,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:56:30,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f567cced4ed40b022416a5 HTTP/1.1" 200 None 2026-05-04 02:56:30,863 - lava_callback - ERROR - Error processing callback for node 69f567cced4ed40b022416a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 02:56:33,819 - lava_callback - INFO - Received callback for node 69f80627559eef1735ba8dcc INFO: 172.20.0.1:35006 - "POST /node/69f80627559eef1735ba8dcc HTTP/1.0" 202 Accepted 2026-05-04 02:56:33,831 - lava_callback - INFO - Starting async job submit for node 69f80627559eef1735ba8dcc 2026-05-04 02:56:33,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:56:33,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f80627559eef1735ba8dcc HTTP/1.1" 200 None 2026-05-04 02:56:33,891 - lava_callback - DEBUG - Processing node 69f80627559eef1735ba8dcc: baseline-nfs-arm64 2026-05-04 02:56:34,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:56:35,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:56:35,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f80627559eef1735ba8dcc/log.txt.gz 2026-05-04 02:56:35,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:56:35,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:56:35,969 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f80627559eef1735ba8dcc/lava-logs.yaml 2026-05-04 02:56:35,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 02:56:36,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 02:56:36,123 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f80627559eef1735ba8dcc/lava_callback.json.gz DEBUG: Setup failed for 69f80627559eef1735ba8dcc. Transitting job node result: incomplete -> fail 2026-05-04 02:56:36,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:56:36,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f80627559eef1735ba8dcc HTTP/1.1" 200 None 2026-05-04 02:56:36,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:56:36,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 02:56:36,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:56:36,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f80627559eef1735ba8dcc HTTP/1.1" 200 None 2026-05-04 02:56:36,341 - lava_callback - INFO - Completed processing callback for node 69f80627559eef1735ba8dcc INFO: 172.20.0.1:35016 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:56:36,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:56:36,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55168 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:57:30,841 - lava_callback - INFO - Received callback for node 69f56818ed4ed40b022416cb INFO: 172.20.0.1:54790 - "POST /node/69f56818ed4ed40b022416cb HTTP/1.0" 202 Accepted 2026-05-04 02:57:30,847 - lava_callback - INFO - Starting async job submit for node 69f56818ed4ed40b022416cb 2026-05-04 02:57:30,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:57:30,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56818ed4ed40b022416cb HTTP/1.1" 200 None 2026-05-04 02:57:30,871 - lava_callback - DEBUG - Processing node 69f56818ed4ed40b022416cb: baseline-arm64-clabbe 2026-05-04 02:57:30,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56818ed4ed40b022416cb 2026-05-04 02:57:30,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:57:30,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56818ed4ed40b022416cb HTTP/1.1" 200 None 2026-05-04 02:57:30,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:57:30,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-04 02:57:30,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:57:30,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56818ed4ed40b022416cb HTTP/1.1" 200 None 2026-05-04 02:57:30,936 - lava_callback - ERROR - Error processing callback for node 69f56818ed4ed40b022416cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43454 - "GET / HTTP/1.0" 200 OK 2026-05-04 02:58:50,943 - lava_callback - INFO - Received callback for node 69f56866ed4ed40b022416f9 INFO: 172.20.0.1:36546 - "POST /node/69f56866ed4ed40b022416f9 HTTP/1.0" 202 Accepted 2026-05-04 02:58:50,949 - lava_callback - INFO - Starting async job submit for node 69f56866ed4ed40b022416f9 2026-05-04 02:58:50,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:58:50,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56866ed4ed40b022416f9 HTTP/1.1" 200 None 2026-05-04 02:58:50,965 - lava_callback - DEBUG - Processing node 69f56866ed4ed40b022416f9: baseline-arm64-clabbe 2026-05-04 02:58:50,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56866ed4ed40b022416f9 2026-05-04 02:58:50,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:58:50,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56866ed4ed40b022416f9 HTTP/1.1" 200 None 2026-05-04 02:58:50,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:58:50,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-04 02:58:50,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 02:58:51,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56866ed4ed40b022416f9 HTTP/1.1" 200 None 2026-05-04 02:58:51,019 - lava_callback - ERROR - Error processing callback for node 69f56866ed4ed40b022416f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53136 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:00:11,375 - lava_callback - INFO - Received callback for node 69f568b4ed4ed40b02241719 INFO: 172.20.0.1:37316 - "POST /node/69f568b4ed4ed40b02241719 HTTP/1.0" 202 Accepted 2026-05-04 03:00:11,384 - lava_callback - INFO - Starting async job submit for node 69f568b4ed4ed40b02241719 2026-05-04 03:00:11,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:00:11,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f568b4ed4ed40b02241719 HTTP/1.1" 200 None 2026-05-04 03:00:11,407 - lava_callback - DEBUG - Processing node 69f568b4ed4ed40b02241719: baseline-arm64-clabbe 2026-05-04 03:00:11,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f568b4ed4ed40b02241719 2026-05-04 03:00:11,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:00:11,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f568b4ed4ed40b02241719 HTTP/1.1" 200 None 2026-05-04 03:00:11,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:00:11,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-04 03:00:11,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:00:11,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f568b4ed4ed40b02241719 HTTP/1.1" 200 None 2026-05-04 03:00:11,462 - lava_callback - ERROR - Error processing callback for node 69f568b4ed4ed40b02241719: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33812 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:02:51,077 - lava_callback - INFO - Received callback for node 69f5694eed4ed40b02241766 INFO: 172.20.0.1:43558 - "POST /node/69f5694eed4ed40b02241766 HTTP/1.0" 202 Accepted 2026-05-04 03:02:51,082 - lava_callback - INFO - Starting async job submit for node 69f5694eed4ed40b02241766 2026-05-04 03:02:51,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:02:51,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5694eed4ed40b02241766 HTTP/1.1" 200 None 2026-05-04 03:02:51,098 - lava_callback - DEBUG - Processing node 69f5694eed4ed40b02241766: baseline-arm64-clabbe 2026-05-04 03:02:51,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5694eed4ed40b02241766 2026-05-04 03:02:51,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:02:51,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5694eed4ed40b02241766 HTTP/1.1" 200 None 2026-05-04 03:02:51,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:02:51,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 03:02:51,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:02:51,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5694eed4ed40b02241766 HTTP/1.1" 200 None 2026-05-04 03:02:51,153 - lava_callback - ERROR - Error processing callback for node 69f5694eed4ed40b02241766: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38182 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:04:11,297 - lava_callback - INFO - Received callback for node 69f56998ed4ed40b02241792 INFO: 172.20.0.1:53444 - "POST /node/69f56998ed4ed40b02241792 HTTP/1.0" 202 Accepted 2026-05-04 03:04:11,302 - lava_callback - INFO - Starting async job submit for node 69f56998ed4ed40b02241792 2026-05-04 03:04:11,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:04:11,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56998ed4ed40b02241792 HTTP/1.1" 200 None 2026-05-04 03:04:11,317 - lava_callback - DEBUG - Processing node 69f56998ed4ed40b02241792: baseline-arm64-clabbe 2026-05-04 03:04:11,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56998ed4ed40b02241792 2026-05-04 03:04:11,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:04:11,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56998ed4ed40b02241792 HTTP/1.1" 200 None 2026-05-04 03:04:11,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:04:11,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-04 03:04:11,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:04:11,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56998ed4ed40b02241792 HTTP/1.1" 200 None 2026-05-04 03:04:11,368 - lava_callback - ERROR - Error processing callback for node 69f56998ed4ed40b02241792: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40522 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:05:11,278 - lava_callback - INFO - Received callback for node 69f569e3ed4ed40b022417b8 INFO: 172.20.0.1:39450 - "POST /node/69f569e3ed4ed40b022417b8 HTTP/1.0" 202 Accepted 2026-05-04 03:05:11,284 - lava_callback - INFO - Starting async job submit for node 69f569e3ed4ed40b022417b8 2026-05-04 03:05:11,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:05:11,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f569e3ed4ed40b022417b8 HTTP/1.1" 200 None 2026-05-04 03:05:11,299 - lava_callback - DEBUG - Processing node 69f569e3ed4ed40b022417b8: baseline-arm64-clabbe 2026-05-04 03:05:11,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f569e3ed4ed40b022417b8 2026-05-04 03:05:11,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:05:11,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f569e3ed4ed40b022417b8 HTTP/1.1" 200 None 2026-05-04 03:05:11,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:05:11,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-04 03:05:11,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:05:11,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f569e3ed4ed40b022417b8 HTTP/1.1" 200 None 2026-05-04 03:05:11,348 - lava_callback - ERROR - Error processing callback for node 69f569e3ed4ed40b022417b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45662 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:06:31,311 - lava_callback - INFO - Received callback for node 69f56a2fed4ed40b022417de INFO: 172.20.0.1:44894 - "POST /node/69f56a2fed4ed40b022417de HTTP/1.0" 202 Accepted 2026-05-04 03:06:31,317 - lava_callback - INFO - Starting async job submit for node 69f56a2fed4ed40b022417de 2026-05-04 03:06:31,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:06:31,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56a2fed4ed40b022417de HTTP/1.1" 200 None 2026-05-04 03:06:31,332 - lava_callback - DEBUG - Processing node 69f56a2fed4ed40b022417de: baseline-arm64-clabbe 2026-05-04 03:06:31,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56a2fed4ed40b022417de 2026-05-04 03:06:31,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:06:31,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56a2fed4ed40b022417de HTTP/1.1" 200 None 2026-05-04 03:06:31,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:06:31,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 03:06:31,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:06:31,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56a2fed4ed40b022417de HTTP/1.1" 200 None 2026-05-04 03:06:31,383 - lava_callback - ERROR - Error processing callback for node 69f56a2fed4ed40b022417de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52282 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:09:11,582 - lava_callback - INFO - Received callback for node 69f56ac4ed4ed40b0224182b INFO: 172.20.0.1:42268 - "POST /node/69f56ac4ed4ed40b0224182b HTTP/1.0" 202 Accepted 2026-05-04 03:09:11,587 - lava_callback - INFO - Starting async job submit for node 69f56ac4ed4ed40b0224182b 2026-05-04 03:09:11,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:09:11,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56ac4ed4ed40b0224182b HTTP/1.1" 200 None 2026-05-04 03:09:11,603 - lava_callback - DEBUG - Processing node 69f56ac4ed4ed40b0224182b: baseline-arm64-clabbe 2026-05-04 03:09:11,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56ac4ed4ed40b0224182b 2026-05-04 03:09:11,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:09:11,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56ac4ed4ed40b0224182b HTTP/1.1" 200 None 2026-05-04 03:09:11,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:09:11,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-04 03:09:11,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:09:11,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56ac4ed4ed40b0224182b HTTP/1.1" 200 None 2026-05-04 03:09:11,653 - lava_callback - ERROR - Error processing callback for node 69f56ac4ed4ed40b0224182b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37242 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:10:51,418 - lava_callback - INFO - Received callback for node 69f56b38ed4ed40b0224185c INFO: 172.20.0.1:60494 - "POST /node/69f56b38ed4ed40b0224185c HTTP/1.0" 202 Accepted 2026-05-04 03:10:51,424 - lava_callback - INFO - Starting async job submit for node 69f56b38ed4ed40b0224185c 2026-05-04 03:10:51,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:10:51,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56b38ed4ed40b0224185c HTTP/1.1" 200 None 2026-05-04 03:10:51,439 - lava_callback - DEBUG - Processing node 69f56b38ed4ed40b0224185c: baseline-arm64-clabbe 2026-05-04 03:10:51,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56b38ed4ed40b0224185c 2026-05-04 03:10:51,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:10:51,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56b38ed4ed40b0224185c HTTP/1.1" 200 None 2026-05-04 03:10:51,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:10:51,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-04 03:10:51,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:10:51,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56b38ed4ed40b0224185c HTTP/1.1" 200 None 2026-05-04 03:10:51,532 - lava_callback - ERROR - Error processing callback for node 69f56b38ed4ed40b0224185c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47196 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:13:31,598 - lava_callback - INFO - Received callback for node 69f56bd1ed4ed40b0224189d INFO: 172.20.0.1:50120 - "POST /node/69f56bd1ed4ed40b0224189d HTTP/1.0" 202 Accepted 2026-05-04 03:13:31,604 - lava_callback - INFO - Starting async job submit for node 69f56bd1ed4ed40b0224189d 2026-05-04 03:13:31,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:13:31,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56bd1ed4ed40b0224189d HTTP/1.1" 200 None 2026-05-04 03:13:31,623 - lava_callback - DEBUG - Processing node 69f56bd1ed4ed40b0224189d: baseline-arm64-clabbe 2026-05-04 03:13:31,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56bd1ed4ed40b0224189d 2026-05-04 03:13:31,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:13:31,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56bd1ed4ed40b0224189d HTTP/1.1" 200 None 2026-05-04 03:13:31,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:13:31,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-04 03:13:31,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:13:31,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56bd1ed4ed40b0224189d HTTP/1.1" 200 None 2026-05-04 03:13:31,682 - lava_callback - ERROR - Error processing callback for node 69f56bd1ed4ed40b0224189d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55312 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:14:51,591 - lava_callback - INFO - Received callback for node 69f56c1ded4ed40b022418b7 INFO: 172.20.0.1:53416 - "POST /node/69f56c1ded4ed40b022418b7 HTTP/1.0" 202 Accepted 2026-05-04 03:14:51,597 - lava_callback - INFO - Starting async job submit for node 69f56c1ded4ed40b022418b7 2026-05-04 03:14:51,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:14:51,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56c1ded4ed40b022418b7 HTTP/1.1" 200 None 2026-05-04 03:14:51,623 - lava_callback - DEBUG - Processing node 69f56c1ded4ed40b022418b7: baseline-arm64-clabbe 2026-05-04 03:14:51,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56c1ded4ed40b022418b7 2026-05-04 03:14:51,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:14:51,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56c1ded4ed40b022418b7 HTTP/1.1" 200 None 2026-05-04 03:14:51,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:14:51,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-04 03:14:51,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:14:51,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56c1ded4ed40b022418b7 HTTP/1.1" 200 None 2026-05-04 03:14:51,669 - lava_callback - ERROR - Error processing callback for node 69f56c1ded4ed40b022418b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37776 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:16:31,693 - lava_callback - INFO - Received callback for node 69f56c8ded4ed40b022418e8 INFO: 172.20.0.1:52200 - "POST /node/69f56c8ded4ed40b022418e8 HTTP/1.0" 202 Accepted 2026-05-04 03:16:31,698 - lava_callback - INFO - Starting async job submit for node 69f56c8ded4ed40b022418e8 2026-05-04 03:16:31,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:16:31,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56c8ded4ed40b022418e8 HTTP/1.1" 200 None 2026-05-04 03:16:31,714 - lava_callback - DEBUG - Processing node 69f56c8ded4ed40b022418e8: baseline-arm64-clabbe 2026-05-04 03:16:31,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56c8ded4ed40b022418e8 2026-05-04 03:16:31,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:16:31,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56c8ded4ed40b022418e8 HTTP/1.1" 200 None 2026-05-04 03:16:31,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:16:31,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-04 03:16:31,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:16:31,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56c8ded4ed40b022418e8 HTTP/1.1" 200 None 2026-05-04 03:16:31,758 - lava_callback - ERROR - Error processing callback for node 69f56c8ded4ed40b022418e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47188 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:17:51,774 - lava_callback - INFO - Received callback for node 69f56cd7ed4ed40b02241908 INFO: 172.20.0.1:58650 - "POST /node/69f56cd7ed4ed40b02241908 HTTP/1.0" 202 Accepted 2026-05-04 03:17:51,779 - lava_callback - INFO - Starting async job submit for node 69f56cd7ed4ed40b02241908 2026-05-04 03:17:51,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:17:51,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56cd7ed4ed40b02241908 HTTP/1.1" 200 None 2026-05-04 03:17:51,794 - lava_callback - DEBUG - Processing node 69f56cd7ed4ed40b02241908: baseline-arm64-clabbe 2026-05-04 03:17:51,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56cd7ed4ed40b02241908 2026-05-04 03:17:51,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:17:51,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56cd7ed4ed40b02241908 HTTP/1.1" 200 None 2026-05-04 03:17:51,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:17:51,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-04 03:17:51,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:17:51,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56cd7ed4ed40b02241908 HTTP/1.1" 200 None 2026-05-04 03:17:51,852 - lava_callback - ERROR - Error processing callback for node 69f56cd7ed4ed40b02241908: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49552 - "GET /node/6992690e98a8bdb31c392304%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57446 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:20:31,851 - lava_callback - INFO - Received callback for node 69f56d6fed4ed40b0224194d INFO: 172.20.0.1:54594 - "POST /node/69f56d6fed4ed40b0224194d HTTP/1.0" 202 Accepted 2026-05-04 03:20:31,857 - lava_callback - INFO - Starting async job submit for node 69f56d6fed4ed40b0224194d 2026-05-04 03:20:31,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:20:31,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56d6fed4ed40b0224194d HTTP/1.1" 200 None 2026-05-04 03:20:31,876 - lava_callback - DEBUG - Processing node 69f56d6fed4ed40b0224194d: baseline-arm64-clabbe 2026-05-04 03:20:31,876 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56d6fed4ed40b0224194d 2026-05-04 03:20:31,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:20:31,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56d6fed4ed40b0224194d HTTP/1.1" 200 None 2026-05-04 03:20:31,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:20:31,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 03:20:31,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:20:31,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56d6fed4ed40b0224194d HTTP/1.1" 200 None 2026-05-04 03:20:31,942 - lava_callback - ERROR - Error processing callback for node 69f56d6fed4ed40b0224194d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58420 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:21:51,914 - lava_callback - INFO - Received callback for node 69f56dbced4ed40b02241972 INFO: 172.20.0.1:60346 - "POST /node/69f56dbced4ed40b02241972 HTTP/1.0" 202 Accepted 2026-05-04 03:21:51,920 - lava_callback - INFO - Starting async job submit for node 69f56dbced4ed40b02241972 2026-05-04 03:21:51,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:21:51,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56dbced4ed40b02241972 HTTP/1.1" 200 None 2026-05-04 03:21:51,938 - lava_callback - DEBUG - Processing node 69f56dbced4ed40b02241972: baseline-arm64-clabbe 2026-05-04 03:21:51,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f56dbced4ed40b02241972 2026-05-04 03:21:51,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:21:51,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f56dbced4ed40b02241972 HTTP/1.1" 200 None 2026-05-04 03:21:51,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:21:51,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 03:21:51,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:21:52,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f56dbced4ed40b02241972 HTTP/1.1" 200 None 2026-05-04 03:21:52,021 - lava_callback - ERROR - Error processing callback for node 69f56dbced4ed40b02241972: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39470 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:35:32,632 - lava_callback - INFO - Received callback for node 69f570eeed4ed40b02241aa0 INFO: 172.20.0.1:41490 - "POST /node/69f570eeed4ed40b02241aa0 HTTP/1.0" 202 Accepted 2026-05-04 03:35:32,638 - lava_callback - INFO - Starting async job submit for node 69f570eeed4ed40b02241aa0 2026-05-04 03:35:32,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:35:32,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f570eeed4ed40b02241aa0 HTTP/1.1" 200 None 2026-05-04 03:35:32,661 - lava_callback - DEBUG - Processing node 69f570eeed4ed40b02241aa0: baseline-arm-clabbe 2026-05-04 03:35:32,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f570eeed4ed40b02241aa0 2026-05-04 03:35:32,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:35:32,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f570eeed4ed40b02241aa0 HTTP/1.1" 200 None 2026-05-04 03:35:32,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:35:32,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-04 03:35:32,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:35:32,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f570eeed4ed40b02241aa0 HTTP/1.1" 200 None 2026-05-04 03:35:32,709 - lava_callback - ERROR - Error processing callback for node 69f570eeed4ed40b02241aa0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40766 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:35:52,491 - lava_callback - INFO - Received callback for node 69f57115ed4ed40b02241ab4 INFO: 172.20.0.1:49126 - "POST /node/69f57115ed4ed40b02241ab4 HTTP/1.0" 202 Accepted 2026-05-04 03:35:52,497 - lava_callback - INFO - Starting async job submit for node 69f57115ed4ed40b02241ab4 2026-05-04 03:35:52,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:35:52,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57115ed4ed40b02241ab4 HTTP/1.1" 200 None 2026-05-04 03:35:52,512 - lava_callback - DEBUG - Processing node 69f57115ed4ed40b02241ab4: baseline-arm-clabbe 2026-05-04 03:35:52,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57115ed4ed40b02241ab4 2026-05-04 03:35:52,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:35:52,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57115ed4ed40b02241ab4 HTTP/1.1" 200 None 2026-05-04 03:35:52,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:35:52,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-04 03:35:52,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:35:52,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57115ed4ed40b02241ab4 HTTP/1.1" 200 None 2026-05-04 03:35:52,558 - lava_callback - ERROR - Error processing callback for node 69f57115ed4ed40b02241ab4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53666 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:36:32,589 - lava_callback - INFO - Received callback for node 69f5713aed4ed40b02241abe INFO: 172.20.0.1:33890 - "POST /node/69f5713aed4ed40b02241abe HTTP/1.0" 202 Accepted 2026-05-04 03:36:32,595 - lava_callback - INFO - Starting async job submit for node 69f5713aed4ed40b02241abe 2026-05-04 03:36:32,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:36:32,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5713aed4ed40b02241abe HTTP/1.1" 200 None 2026-05-04 03:36:32,610 - lava_callback - DEBUG - Processing node 69f5713aed4ed40b02241abe: baseline-arm-clabbe 2026-05-04 03:36:32,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5713aed4ed40b02241abe 2026-05-04 03:36:32,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:36:32,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5713aed4ed40b02241abe HTTP/1.1" 200 None 2026-05-04 03:36:32,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:36:32,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-04 03:36:32,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:36:32,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5713aed4ed40b02241abe HTTP/1.1" 200 None 2026-05-04 03:36:32,654 - lava_callback - ERROR - Error processing callback for node 69f5713aed4ed40b02241abe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47296 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:37:12,566 - lava_callback - INFO - Received callback for node 69f57160ed4ed40b02241aca INFO: 172.20.0.1:44586 - "POST /node/69f57160ed4ed40b02241aca HTTP/1.0" 202 Accepted 2026-05-04 03:37:12,572 - lava_callback - INFO - Starting async job submit for node 69f57160ed4ed40b02241aca 2026-05-04 03:37:12,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:37:12,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57160ed4ed40b02241aca HTTP/1.1" 200 None 2026-05-04 03:37:12,587 - lava_callback - DEBUG - Processing node 69f57160ed4ed40b02241aca: baseline-arm-clabbe 2026-05-04 03:37:12,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57160ed4ed40b02241aca 2026-05-04 03:37:12,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:37:12,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57160ed4ed40b02241aca HTTP/1.1" 200 None 2026-05-04 03:37:12,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:37:12,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-04 03:37:12,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:37:12,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57160ed4ed40b02241aca HTTP/1.1" 200 None 2026-05-04 03:37:12,649 - lava_callback - ERROR - Error processing callback for node 69f57160ed4ed40b02241aca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56464 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:37:52,598 - lava_callback - INFO - Received callback for node 69f57185ed4ed40b02241ad7 INFO: 172.20.0.1:51648 - "POST /node/69f57185ed4ed40b02241ad7 HTTP/1.0" 202 Accepted 2026-05-04 03:37:52,603 - lava_callback - INFO - Starting async job submit for node 69f57185ed4ed40b02241ad7 2026-05-04 03:37:52,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:37:52,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57185ed4ed40b02241ad7 HTTP/1.1" 200 None 2026-05-04 03:37:52,618 - lava_callback - DEBUG - Processing node 69f57185ed4ed40b02241ad7: baseline-arm-clabbe 2026-05-04 03:37:52,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57185ed4ed40b02241ad7 2026-05-04 03:37:52,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:37:52,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57185ed4ed40b02241ad7 HTTP/1.1" 200 None 2026-05-04 03:37:52,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:37:52,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-04 03:37:52,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:37:52,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57185ed4ed40b02241ad7 HTTP/1.1" 200 None 2026-05-04 03:37:52,681 - lava_callback - ERROR - Error processing callback for node 69f57185ed4ed40b02241ad7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35374 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:38:32,601 - lava_callback - INFO - Received callback for node 69f571abed4ed40b02241ae6 INFO: 172.20.0.1:51674 - "POST /node/69f571abed4ed40b02241ae6 HTTP/1.0" 202 Accepted 2026-05-04 03:38:32,607 - lava_callback - INFO - Starting async job submit for node 69f571abed4ed40b02241ae6 2026-05-04 03:38:32,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:38:32,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f571abed4ed40b02241ae6 HTTP/1.1" 200 None 2026-05-04 03:38:32,622 - lava_callback - DEBUG - Processing node 69f571abed4ed40b02241ae6: baseline-arm-clabbe 2026-05-04 03:38:32,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f571abed4ed40b02241ae6 2026-05-04 03:38:32,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:38:32,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f571abed4ed40b02241ae6 HTTP/1.1" 200 None 2026-05-04 03:38:32,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:38:32,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-04 03:38:32,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:38:32,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f571abed4ed40b02241ae6 HTTP/1.1" 200 None 2026-05-04 03:38:32,683 - lava_callback - ERROR - Error processing callback for node 69f571abed4ed40b02241ae6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36862 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:39:12,672 - lava_callback - INFO - Received callback for node 69f571d0ed4ed40b02241af0 INFO: 172.20.0.1:46598 - "POST /node/69f571d0ed4ed40b02241af0 HTTP/1.0" 202 Accepted 2026-05-04 03:39:12,678 - lava_callback - INFO - Starting async job submit for node 69f571d0ed4ed40b02241af0 2026-05-04 03:39:12,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:39:12,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f571d0ed4ed40b02241af0 HTTP/1.1" 200 None 2026-05-04 03:39:12,714 - lava_callback - DEBUG - Processing node 69f571d0ed4ed40b02241af0: baseline-arm-clabbe 2026-05-04 03:39:12,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f571d0ed4ed40b02241af0 2026-05-04 03:39:12,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:39:12,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f571d0ed4ed40b02241af0 HTTP/1.1" 200 None 2026-05-04 03:39:12,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:39:12,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-04 03:39:12,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:39:12,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f571d0ed4ed40b02241af0 HTTP/1.1" 200 None 2026-05-04 03:39:12,814 - lava_callback - ERROR - Error processing callback for node 69f571d0ed4ed40b02241af0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38640 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:39:52,683 - lava_callback - INFO - Received callback for node 69f571f6ed4ed40b02241afe INFO: 172.20.0.1:55332 - "POST /node/69f571f6ed4ed40b02241afe HTTP/1.0" 202 Accepted 2026-05-04 03:39:52,688 - lava_callback - INFO - Starting async job submit for node 69f571f6ed4ed40b02241afe 2026-05-04 03:39:52,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:39:52,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f571f6ed4ed40b02241afe HTTP/1.1" 200 None 2026-05-04 03:39:52,704 - lava_callback - DEBUG - Processing node 69f571f6ed4ed40b02241afe: baseline-arm-clabbe 2026-05-04 03:39:52,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f571f6ed4ed40b02241afe 2026-05-04 03:39:52,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:39:52,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f571f6ed4ed40b02241afe HTTP/1.1" 200 None 2026-05-04 03:39:52,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:39:52,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-04 03:39:52,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:39:52,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f571f6ed4ed40b02241afe HTTP/1.1" 200 None 2026-05-04 03:39:52,767 - lava_callback - ERROR - Error processing callback for node 69f571f6ed4ed40b02241afe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38972 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:40:32,670 - lava_callback - INFO - Received callback for node 69f57229ed4ed40b02241b0f INFO: 172.20.0.1:45152 - "POST /node/69f57229ed4ed40b02241b0f HTTP/1.0" 202 Accepted 2026-05-04 03:40:32,675 - lava_callback - INFO - Starting async job submit for node 69f57229ed4ed40b02241b0f 2026-05-04 03:40:32,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:40:32,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57229ed4ed40b02241b0f HTTP/1.1" 200 None 2026-05-04 03:40:32,691 - lava_callback - DEBUG - Processing node 69f57229ed4ed40b02241b0f: baseline-arm64-clabbe 2026-05-04 03:40:32,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57229ed4ed40b02241b0f 2026-05-04 03:40:32,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:40:32,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57229ed4ed40b02241b0f HTTP/1.1" 200 None 2026-05-04 03:40:32,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:40:32,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-04 03:40:32,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:40:32,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57229ed4ed40b02241b0f HTTP/1.1" 200 None 2026-05-04 03:40:32,766 - lava_callback - ERROR - Error processing callback for node 69f57229ed4ed40b02241b0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58922 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:41:32,752 - lava_callback - INFO - Received callback for node 69f57266ed4ed40b02241b2e INFO: 172.20.0.1:37504 - "POST /node/69f57266ed4ed40b02241b2e HTTP/1.0" 202 Accepted 2026-05-04 03:41:32,757 - lava_callback - INFO - Starting async job submit for node 69f57266ed4ed40b02241b2e 2026-05-04 03:41:32,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:41:32,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57266ed4ed40b02241b2e HTTP/1.1" 200 None 2026-05-04 03:41:32,773 - lava_callback - DEBUG - Processing node 69f57266ed4ed40b02241b2e: baseline-arm-clabbe 2026-05-04 03:41:32,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57266ed4ed40b02241b2e 2026-05-04 03:41:32,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:41:32,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57266ed4ed40b02241b2e HTTP/1.1" 200 None 2026-05-04 03:41:32,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:41:32,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-04 03:41:32,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:41:32,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57266ed4ed40b02241b2e HTTP/1.1" 200 None 2026-05-04 03:41:32,855 - lava_callback - ERROR - Error processing callback for node 69f57266ed4ed40b02241b2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36024 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:42:12,779 - lava_callback - INFO - Received callback for node 69f5728aed4ed40b02241b3c INFO: 172.20.0.1:42746 - "POST /node/69f5728aed4ed40b02241b3c HTTP/1.0" 202 Accepted 2026-05-04 03:42:12,784 - lava_callback - INFO - Starting async job submit for node 69f5728aed4ed40b02241b3c 2026-05-04 03:42:12,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:42:12,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5728aed4ed40b02241b3c HTTP/1.1" 200 None 2026-05-04 03:42:12,800 - lava_callback - DEBUG - Processing node 69f5728aed4ed40b02241b3c: baseline-arm-clabbe 2026-05-04 03:42:12,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5728aed4ed40b02241b3c 2026-05-04 03:42:12,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:42:12,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5728aed4ed40b02241b3c HTTP/1.1" 200 None 2026-05-04 03:42:12,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:42:12,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-04 03:42:12,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:42:12,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5728aed4ed40b02241b3c HTTP/1.1" 200 None 2026-05-04 03:42:12,851 - lava_callback - ERROR - Error processing callback for node 69f5728aed4ed40b02241b3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33990 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:44:12,901 - lava_callback - INFO - Received callback for node 69f572fded4ed40b02241b6d INFO: 172.20.0.1:44904 - "POST /node/69f572fded4ed40b02241b6d HTTP/1.0" 202 Accepted 2026-05-04 03:44:12,907 - lava_callback - INFO - Starting async job submit for node 69f572fded4ed40b02241b6d 2026-05-04 03:44:12,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:44:12,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f572fded4ed40b02241b6d HTTP/1.1" 200 None 2026-05-04 03:44:12,942 - lava_callback - DEBUG - Processing node 69f572fded4ed40b02241b6d: baseline-arm-clabbe 2026-05-04 03:44:12,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f572fded4ed40b02241b6d 2026-05-04 03:44:12,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:44:12,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f572fded4ed40b02241b6d HTTP/1.1" 200 None 2026-05-04 03:44:12,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:44:12,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-04 03:44:12,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:44:13,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f572fded4ed40b02241b6d HTTP/1.1" 200 None 2026-05-04 03:44:13,038 - lava_callback - ERROR - Error processing callback for node 69f572fded4ed40b02241b6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56138 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:44:52,901 - lava_callback - INFO - Received callback for node 69f57322ed4ed40b02241b7e INFO: 172.20.0.1:45904 - "POST /node/69f57322ed4ed40b02241b7e HTTP/1.0" 202 Accepted 2026-05-04 03:44:52,906 - lava_callback - INFO - Starting async job submit for node 69f57322ed4ed40b02241b7e 2026-05-04 03:44:52,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:44:52,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57322ed4ed40b02241b7e HTTP/1.1" 200 None 2026-05-04 03:44:52,922 - lava_callback - DEBUG - Processing node 69f57322ed4ed40b02241b7e: baseline-arm-clabbe 2026-05-04 03:44:52,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57322ed4ed40b02241b7e 2026-05-04 03:44:52,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:44:52,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57322ed4ed40b02241b7e HTTP/1.1" 200 None 2026-05-04 03:44:52,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:44:52,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-04 03:44:52,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:44:52,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57322ed4ed40b02241b7e HTTP/1.1" 200 None 2026-05-04 03:44:52,997 - lava_callback - ERROR - Error processing callback for node 69f57322ed4ed40b02241b7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47006 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:45:32,973 - lava_callback - INFO - Received callback for node 69f57354ed4ed40b02241b93 INFO: 172.20.0.1:35730 - "POST /node/69f57354ed4ed40b02241b93 HTTP/1.0" 202 Accepted 2026-05-04 03:45:32,979 - lava_callback - INFO - Starting async job submit for node 69f57354ed4ed40b02241b93 2026-05-04 03:45:32,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:45:33,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57354ed4ed40b02241b93 HTTP/1.1" 200 None 2026-05-04 03:45:33,005 - lava_callback - DEBUG - Processing node 69f57354ed4ed40b02241b93: baseline-arm64-clabbe 2026-05-04 03:45:33,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57354ed4ed40b02241b93 2026-05-04 03:45:33,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:45:33,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57354ed4ed40b02241b93 HTTP/1.1" 200 None 2026-05-04 03:45:33,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:45:33,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-04 03:45:33,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:45:33,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57354ed4ed40b02241b93 HTTP/1.1" 200 None 2026-05-04 03:45:33,054 - lava_callback - ERROR - Error processing callback for node 69f57354ed4ed40b02241b93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43374 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:49:13,122 - lava_callback - INFO - Received callback for node 69f57430ed4ed40b02241bea INFO: 172.20.0.1:60750 - "POST /node/69f57430ed4ed40b02241bea HTTP/1.0" 202 Accepted 2026-05-04 03:49:13,128 - lava_callback - INFO - Starting async job submit for node 69f57430ed4ed40b02241bea 2026-05-04 03:49:13,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:49:13,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57430ed4ed40b02241bea HTTP/1.1" 200 None 2026-05-04 03:49:13,143 - lava_callback - DEBUG - Processing node 69f57430ed4ed40b02241bea: baseline-arm64-clabbe 2026-05-04 03:49:13,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57430ed4ed40b02241bea 2026-05-04 03:49:13,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:49:13,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57430ed4ed40b02241bea HTTP/1.1" 200 None 2026-05-04 03:49:13,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:49:13,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-04 03:49:13,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:49:13,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57430ed4ed40b02241bea HTTP/1.1" 200 None 2026-05-04 03:49:13,188 - lava_callback - ERROR - Error processing callback for node 69f57430ed4ed40b02241bea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60068 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:51:13,209 - lava_callback - INFO - Received callback for node 69f5749fed4ed40b02241c21 INFO: 172.20.0.1:36904 - "POST /node/69f5749fed4ed40b02241c21 HTTP/1.0" 202 Accepted 2026-05-04 03:51:13,214 - lava_callback - INFO - Starting async job submit for node 69f5749fed4ed40b02241c21 2026-05-04 03:51:13,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:51:13,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5749fed4ed40b02241c21 HTTP/1.1" 200 None 2026-05-04 03:51:13,230 - lava_callback - DEBUG - Processing node 69f5749fed4ed40b02241c21: baseline-arm64-clabbe 2026-05-04 03:51:13,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5749fed4ed40b02241c21 2026-05-04 03:51:13,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:51:13,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5749fed4ed40b02241c21 HTTP/1.1" 200 None 2026-05-04 03:51:13,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:51:13,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 03:51:13,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:51:13,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5749fed4ed40b02241c21 HTTP/1.1" 200 None 2026-05-04 03:51:13,276 - lava_callback - ERROR - Error processing callback for node 69f5749fed4ed40b02241c21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55394 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:54:33,336 - lava_callback - INFO - Received callback for node 69f5756eed4ed40b02241c77 INFO: 172.20.0.1:46950 - "POST /node/69f5756eed4ed40b02241c77 HTTP/1.0" 202 Accepted 2026-05-04 03:54:33,341 - lava_callback - INFO - Starting async job submit for node 69f5756eed4ed40b02241c77 2026-05-04 03:54:33,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:54:33,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5756eed4ed40b02241c77 HTTP/1.1" 200 None 2026-05-04 03:54:33,363 - lava_callback - DEBUG - Processing node 69f5756eed4ed40b02241c77: baseline-arm-clabbe 2026-05-04 03:54:33,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5756eed4ed40b02241c77 2026-05-04 03:54:33,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:54:33,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5756eed4ed40b02241c77 HTTP/1.1" 200 None 2026-05-04 03:54:33,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:54:33,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-04 03:54:33,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:54:33,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5756eed4ed40b02241c77 HTTP/1.1" 200 None 2026-05-04 03:54:33,411 - lava_callback - ERROR - Error processing callback for node 69f5756eed4ed40b02241c77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51060 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:55:33,358 - lava_callback - INFO - Received callback for node 69f575a0ed4ed40b02241c82 INFO: 172.20.0.1:57530 - "POST /node/69f575a0ed4ed40b02241c82 HTTP/1.0" 202 Accepted 2026-05-04 03:55:33,364 - lava_callback - INFO - Starting async job submit for node 69f575a0ed4ed40b02241c82 2026-05-04 03:55:33,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:55:33,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f575a0ed4ed40b02241c82 HTTP/1.1" 200 None 2026-05-04 03:55:33,397 - lava_callback - DEBUG - Processing node 69f575a0ed4ed40b02241c82: baseline-arm64-clabbe 2026-05-04 03:55:33,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f575a0ed4ed40b02241c82 2026-05-04 03:55:33,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:55:33,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f575a0ed4ed40b02241c82 HTTP/1.1" 200 None 2026-05-04 03:55:33,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:55:33,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-04 03:55:33,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:55:33,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f575a0ed4ed40b02241c82 HTTP/1.1" 200 None 2026-05-04 03:55:33,470 - lava_callback - ERROR - Error processing callback for node 69f575a0ed4ed40b02241c82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60228 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:56:37,519 - lava_callback - INFO - Received callback for node 69f575e7ed4ed40b02241ca7 INFO: 172.20.0.1:60230 - "POST /node/69f575e7ed4ed40b02241ca7 HTTP/1.0" 202 Accepted 2026-05-04 03:56:37,527 - lava_callback - INFO - Starting async job submit for node 69f575e7ed4ed40b02241ca7 2026-05-04 03:56:37,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:56:37,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f575e7ed4ed40b02241ca7 HTTP/1.1" 200 None 2026-05-04 03:56:37,545 - lava_callback - DEBUG - Processing node 69f575e7ed4ed40b02241ca7: baseline-arm64-baylibre 2026-05-04 03:56:37,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f575e7ed4ed40b02241ca7 2026-05-04 03:56:37,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:56:37,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f575e7ed4ed40b02241ca7 HTTP/1.1" 200 None 2026-05-04 03:56:37,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:56:37,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 03:56:37,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:56:37,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f575e7ed4ed40b02241ca7 HTTP/1.1" 200 None 2026-05-04 03:56:37,590 - lava_callback - ERROR - Error processing callback for node 69f575e7ed4ed40b02241ca7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52740 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:57:33,444 - lava_callback - INFO - Received callback for node 69f57629ed4ed40b02241cc9 INFO: 172.20.0.1:38398 - "POST /node/69f57629ed4ed40b02241cc9 HTTP/1.0" 202 Accepted 2026-05-04 03:57:33,449 - lava_callback - INFO - Starting async job submit for node 69f57629ed4ed40b02241cc9 2026-05-04 03:57:33,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:57:33,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57629ed4ed40b02241cc9 HTTP/1.1" 200 None 2026-05-04 03:57:33,465 - lava_callback - DEBUG - Processing node 69f57629ed4ed40b02241cc9: baseline-arm-clabbe 2026-05-04 03:57:33,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57629ed4ed40b02241cc9 2026-05-04 03:57:33,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:57:33,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57629ed4ed40b02241cc9 HTTP/1.1" 200 None 2026-05-04 03:57:33,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:57:33,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-04 03:57:33,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:57:33,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57629ed4ed40b02241cc9 HTTP/1.1" 200 None 2026-05-04 03:57:33,519 - lava_callback - ERROR - Error processing callback for node 69f57629ed4ed40b02241cc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50896 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:58:33,506 - lava_callback - INFO - Received callback for node 69f5765bed4ed40b02241ce5 INFO: 172.20.0.1:41684 - "POST /node/69f5765bed4ed40b02241ce5 HTTP/1.0" 202 Accepted 2026-05-04 03:58:33,511 - lava_callback - INFO - Starting async job submit for node 69f5765bed4ed40b02241ce5 2026-05-04 03:58:33,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:58:33,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5765bed4ed40b02241ce5 HTTP/1.1" 200 None 2026-05-04 03:58:33,527 - lava_callback - DEBUG - Processing node 69f5765bed4ed40b02241ce5: baseline-arm64-clabbe 2026-05-04 03:58:33,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5765bed4ed40b02241ce5 2026-05-04 03:58:33,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:58:33,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5765bed4ed40b02241ce5 HTTP/1.1" 200 None 2026-05-04 03:58:33,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:58:33,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-04 03:58:33,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:58:33,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5765bed4ed40b02241ce5 HTTP/1.1" 200 None 2026-05-04 03:58:33,595 - lava_callback - ERROR - Error processing callback for node 69f5765bed4ed40b02241ce5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38710 - "GET / HTTP/1.0" 200 OK 2026-05-04 03:59:33,503 - lava_callback - INFO - Received callback for node 69f57699ed4ed40b02241d03 INFO: 172.20.0.1:46974 - "POST /node/69f57699ed4ed40b02241d03 HTTP/1.0" 202 Accepted 2026-05-04 03:59:33,508 - lava_callback - INFO - Starting async job submit for node 69f57699ed4ed40b02241d03 2026-05-04 03:59:33,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:59:33,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57699ed4ed40b02241d03 HTTP/1.1" 200 None 2026-05-04 03:59:33,533 - lava_callback - DEBUG - Processing node 69f57699ed4ed40b02241d03: baseline-arm-clabbe 2026-05-04 03:59:33,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57699ed4ed40b02241d03 2026-05-04 03:59:33,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:59:33,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57699ed4ed40b02241d03 HTTP/1.1" 200 None 2026-05-04 03:59:33,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:59:33,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-04 03:59:33,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 03:59:33,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57699ed4ed40b02241d03 HTTP/1.1" 200 None 2026-05-04 03:59:33,615 - lava_callback - ERROR - Error processing callback for node 69f57699ed4ed40b02241d03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37564 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:00:13,691 - lava_callback - INFO - Received callback for node 69f576caed4ed40b02241d0c INFO: 172.20.0.1:54144 - "POST /node/69f576caed4ed40b02241d0c HTTP/1.0" 202 Accepted 2026-05-04 04:00:13,697 - lava_callback - INFO - Starting async job submit for node 69f576caed4ed40b02241d0c 2026-05-04 04:00:13,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:00:13,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f576caed4ed40b02241d0c HTTP/1.1" 200 None 2026-05-04 04:00:13,711 - lava_callback - DEBUG - Processing node 69f576caed4ed40b02241d0c: baseline-arm64-clabbe 2026-05-04 04:00:13,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f576caed4ed40b02241d0c 2026-05-04 04:00:13,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:00:13,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f576caed4ed40b02241d0c HTTP/1.1" 200 None 2026-05-04 04:00:13,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:00:13,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-04 04:00:13,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:00:13,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f576caed4ed40b02241d0c HTTP/1.1" 200 None 2026-05-04 04:00:13,789 - lava_callback - ERROR - Error processing callback for node 69f576caed4ed40b02241d0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43260 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:01:33,650 - lava_callback - INFO - Received callback for node 69f57715ed4ed40b02241d31 INFO: 172.20.0.1:36876 - "POST /node/69f57715ed4ed40b02241d31 HTTP/1.0" 202 Accepted 2026-05-04 04:01:33,656 - lava_callback - INFO - Starting async job submit for node 69f57715ed4ed40b02241d31 2026-05-04 04:01:33,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:01:33,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57715ed4ed40b02241d31 HTTP/1.1" 200 None 2026-05-04 04:01:33,700 - lava_callback - DEBUG - Processing node 69f57715ed4ed40b02241d31: baseline-arm64-clabbe 2026-05-04 04:01:33,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57715ed4ed40b02241d31 2026-05-04 04:01:33,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:01:33,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57715ed4ed40b02241d31 HTTP/1.1" 200 None 2026-05-04 04:01:33,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:01:33,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-04 04:01:33,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:01:33,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57715ed4ed40b02241d31 HTTP/1.1" 200 None 2026-05-04 04:01:33,746 - lava_callback - ERROR - Error processing callback for node 69f57715ed4ed40b02241d31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58112 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:02:33,644 - lava_callback - INFO - Received callback for node 69f57753ed4ed40b02241d56 INFO: 172.20.0.1:52954 - "POST /node/69f57753ed4ed40b02241d56 HTTP/1.0" 202 Accepted 2026-05-04 04:02:33,650 - lava_callback - INFO - Starting async job submit for node 69f57753ed4ed40b02241d56 2026-05-04 04:02:33,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:02:33,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57753ed4ed40b02241d56 HTTP/1.1" 200 None 2026-05-04 04:02:33,688 - lava_callback - DEBUG - Processing node 69f57753ed4ed40b02241d56: baseline-arm-clabbe 2026-05-04 04:02:33,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57753ed4ed40b02241d56 2026-05-04 04:02:33,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:02:33,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57753ed4ed40b02241d56 HTTP/1.1" 200 None 2026-05-04 04:02:33,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:02:33,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-04 04:02:33,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:02:33,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57753ed4ed40b02241d56 HTTP/1.1" 200 None 2026-05-04 04:02:33,765 - lava_callback - ERROR - Error processing callback for node 69f57753ed4ed40b02241d56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43714 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:03:17,547 - lava_callback - INFO - Received callback for node 69f5777fed4ed40b02241d64 INFO: 172.20.0.1:43728 - "POST /node/69f5777fed4ed40b02241d64 HTTP/1.0" 202 Accepted 2026-05-04 04:03:17,553 - lava_callback - INFO - Starting async job submit for node 69f5777fed4ed40b02241d64 2026-05-04 04:03:17,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:03:17,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5777fed4ed40b02241d64 HTTP/1.1" 200 None 2026-05-04 04:03:17,568 - lava_callback - DEBUG - Processing node 69f5777fed4ed40b02241d64: baseline-arm64-baylibre 2026-05-04 04:03:17,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5777fed4ed40b02241d64 2026-05-04 04:03:17,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:03:17,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5777fed4ed40b02241d64 HTTP/1.1" 200 None 2026-05-04 04:03:17,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:03:17,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 04:03:17,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:03:17,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5777fed4ed40b02241d64 HTTP/1.1" 200 None 2026-05-04 04:03:17,622 - lava_callback - ERROR - Error processing callback for node 69f5777fed4ed40b02241d64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35282 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:10:34,048 - lava_callback - INFO - Received callback for node 69f57933ed4ed40b02241e1c INFO: 172.20.0.1:58736 - "POST /node/69f57933ed4ed40b02241e1c HTTP/1.0" 202 Accepted 2026-05-04 04:10:34,054 - lava_callback - INFO - Starting async job submit for node 69f57933ed4ed40b02241e1c 2026-05-04 04:10:34,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:10:34,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57933ed4ed40b02241e1c HTTP/1.1" 200 None 2026-05-04 04:10:34,079 - lava_callback - DEBUG - Processing node 69f57933ed4ed40b02241e1c: baseline-arm-clabbe 2026-05-04 04:10:34,079 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57933ed4ed40b02241e1c 2026-05-04 04:10:34,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:10:34,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57933ed4ed40b02241e1c HTTP/1.1" 200 None 2026-05-04 04:10:34,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:10:34,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-04 04:10:34,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:10:34,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57933ed4ed40b02241e1c HTTP/1.1" 200 None 2026-05-04 04:10:34,157 - lava_callback - ERROR - Error processing callback for node 69f57933ed4ed40b02241e1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47274 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:11:14,075 - lava_callback - INFO - Received callback for node 69f57958ed4ed40b02241e29 INFO: 172.20.0.1:46706 - "POST /node/69f57958ed4ed40b02241e29 HTTP/1.0" 202 Accepted 2026-05-04 04:11:14,080 - lava_callback - INFO - Starting async job submit for node 69f57958ed4ed40b02241e29 2026-05-04 04:11:14,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:11:14,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57958ed4ed40b02241e29 HTTP/1.1" 200 None 2026-05-04 04:11:14,110 - lava_callback - DEBUG - Processing node 69f57958ed4ed40b02241e29: baseline-arm-clabbe 2026-05-04 04:11:14,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57958ed4ed40b02241e29 2026-05-04 04:11:14,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:11:14,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57958ed4ed40b02241e29 HTTP/1.1" 200 None 2026-05-04 04:11:14,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:11:14,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-04 04:11:14,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:11:14,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57958ed4ed40b02241e29 HTTP/1.1" 200 None 2026-05-04 04:11:14,190 - lava_callback - ERROR - Error processing callback for node 69f57958ed4ed40b02241e29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49842 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:11:54,088 - lava_callback - INFO - Received callback for node 69f5797ced4ed40b02241e35 INFO: 172.20.0.1:49842 - "POST /node/69f5797ced4ed40b02241e35 HTTP/1.0" 202 Accepted 2026-05-04 04:11:54,094 - lava_callback - INFO - Starting async job submit for node 69f5797ced4ed40b02241e35 2026-05-04 04:11:54,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:11:54,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5797ced4ed40b02241e35 HTTP/1.1" 200 None 2026-05-04 04:11:54,110 - lava_callback - DEBUG - Processing node 69f5797ced4ed40b02241e35: baseline-arm-clabbe 2026-05-04 04:11:54,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5797ced4ed40b02241e35 2026-05-04 04:11:54,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:11:54,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5797ced4ed40b02241e35 HTTP/1.1" 200 None 2026-05-04 04:11:54,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:11:54,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-04 04:11:54,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:11:54,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5797ced4ed40b02241e35 HTTP/1.1" 200 None 2026-05-04 04:11:54,162 - lava_callback - ERROR - Error processing callback for node 69f5797ced4ed40b02241e35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45260 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:12:34,065 - lava_callback - INFO - Received callback for node 69f579a2ed4ed40b02241e40 INFO: 172.20.0.1:59490 - "POST /node/69f579a2ed4ed40b02241e40 HTTP/1.0" 202 Accepted 2026-05-04 04:12:34,070 - lava_callback - INFO - Starting async job submit for node 69f579a2ed4ed40b02241e40 2026-05-04 04:12:34,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:12:34,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f579a2ed4ed40b02241e40 HTTP/1.1" 200 None 2026-05-04 04:12:34,086 - lava_callback - DEBUG - Processing node 69f579a2ed4ed40b02241e40: baseline-arm-clabbe 2026-05-04 04:12:34,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f579a2ed4ed40b02241e40 2026-05-04 04:12:34,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:12:34,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f579a2ed4ed40b02241e40 HTTP/1.1" 200 None 2026-05-04 04:12:34,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:12:34,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-04 04:12:34,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:12:34,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f579a2ed4ed40b02241e40 HTTP/1.1" 200 None 2026-05-04 04:12:34,143 - lava_callback - ERROR - Error processing callback for node 69f579a2ed4ed40b02241e40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41368 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:13:14,125 - lava_callback - INFO - Received callback for node 69f579c7ed4ed40b02241e4e INFO: 172.20.0.1:56738 - "POST /node/69f579c7ed4ed40b02241e4e HTTP/1.0" 202 Accepted 2026-05-04 04:13:14,130 - lava_callback - INFO - Starting async job submit for node 69f579c7ed4ed40b02241e4e 2026-05-04 04:13:14,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:13:14,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f579c7ed4ed40b02241e4e HTTP/1.1" 200 None 2026-05-04 04:13:14,145 - lava_callback - DEBUG - Processing node 69f579c7ed4ed40b02241e4e: baseline-arm-clabbe 2026-05-04 04:13:14,145 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f579c7ed4ed40b02241e4e 2026-05-04 04:13:14,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:13:14,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f579c7ed4ed40b02241e4e HTTP/1.1" 200 None 2026-05-04 04:13:14,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:13:14,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-04 04:13:14,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:13:14,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f579c7ed4ed40b02241e4e HTTP/1.1" 200 None 2026-05-04 04:13:14,190 - lava_callback - ERROR - Error processing callback for node 69f579c7ed4ed40b02241e4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50116 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:13:54,073 - lava_callback - INFO - Received callback for node 69f579eced4ed40b02241e5a INFO: 172.20.0.1:54922 - "POST /node/69f579eced4ed40b02241e5a HTTP/1.0" 202 Accepted 2026-05-04 04:13:54,078 - lava_callback - INFO - Starting async job submit for node 69f579eced4ed40b02241e5a 2026-05-04 04:13:54,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:13:54,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f579eced4ed40b02241e5a HTTP/1.1" 200 None 2026-05-04 04:13:54,093 - lava_callback - DEBUG - Processing node 69f579eced4ed40b02241e5a: baseline-arm-clabbe 2026-05-04 04:13:54,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f579eced4ed40b02241e5a 2026-05-04 04:13:54,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:13:54,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f579eced4ed40b02241e5a HTTP/1.1" 200 None 2026-05-04 04:13:54,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:13:54,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-04 04:13:54,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:13:54,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f579eced4ed40b02241e5a HTTP/1.1" 200 None 2026-05-04 04:13:54,155 - lava_callback - ERROR - Error processing callback for node 69f579eced4ed40b02241e5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49726 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:14:14,239 - lava_callback - INFO - Received callback for node 69f57a10ed4ed40b02241e66 INFO: 172.20.0.1:59058 - "POST /node/69f57a10ed4ed40b02241e66 HTTP/1.0" 202 Accepted 2026-05-04 04:14:14,244 - lava_callback - INFO - Starting async job submit for node 69f57a10ed4ed40b02241e66 2026-05-04 04:14:14,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:14:14,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57a10ed4ed40b02241e66 HTTP/1.1" 200 None 2026-05-04 04:14:14,284 - lava_callback - DEBUG - Processing node 69f57a10ed4ed40b02241e66: baseline-arm-clabbe 2026-05-04 04:14:14,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57a10ed4ed40b02241e66 2026-05-04 04:14:14,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:14:14,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57a10ed4ed40b02241e66 HTTP/1.1" 200 None 2026-05-04 04:14:14,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:14:14,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-04 04:14:14,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:14:14,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57a10ed4ed40b02241e66 HTTP/1.1" 200 None 2026-05-04 04:14:14,349 - lava_callback - ERROR - Error processing callback for node 69f57a10ed4ed40b02241e66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47014 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:14:54,153 - lava_callback - INFO - Received callback for node 69f57a35ed4ed40b02241e73 INFO: 172.20.0.1:43246 - "POST /node/69f57a35ed4ed40b02241e73 HTTP/1.0" 202 Accepted 2026-05-04 04:14:54,158 - lava_callback - INFO - Starting async job submit for node 69f57a35ed4ed40b02241e73 2026-05-04 04:14:54,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:14:54,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57a35ed4ed40b02241e73 HTTP/1.1" 200 None 2026-05-04 04:14:54,181 - lava_callback - DEBUG - Processing node 69f57a35ed4ed40b02241e73: baseline-arm-clabbe 2026-05-04 04:14:54,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57a35ed4ed40b02241e73 2026-05-04 04:14:54,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:14:54,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57a35ed4ed40b02241e73 HTTP/1.1" 200 None 2026-05-04 04:14:54,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:14:54,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-04 04:14:54,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:14:54,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57a35ed4ed40b02241e73 HTTP/1.1" 200 None 2026-05-04 04:14:54,227 - lava_callback - ERROR - Error processing callback for node 69f57a35ed4ed40b02241e73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37098 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:15:34,182 - lava_callback - INFO - Received callback for node 69f57a59ed4ed40b02241e82 INFO: 172.20.0.1:33890 - "POST /node/69f57a59ed4ed40b02241e82 HTTP/1.0" 202 Accepted 2026-05-04 04:15:34,187 - lava_callback - INFO - Starting async job submit for node 69f57a59ed4ed40b02241e82 2026-05-04 04:15:34,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:15:34,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57a59ed4ed40b02241e82 HTTP/1.1" 200 None 2026-05-04 04:15:34,212 - lava_callback - DEBUG - Processing node 69f57a59ed4ed40b02241e82: baseline-arm-clabbe 2026-05-04 04:15:34,212 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57a59ed4ed40b02241e82 2026-05-04 04:15:34,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:15:34,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57a59ed4ed40b02241e82 HTTP/1.1" 200 None 2026-05-04 04:15:34,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:15:34,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-04 04:15:34,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:15:34,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57a59ed4ed40b02241e82 HTTP/1.1" 200 None 2026-05-04 04:15:34,266 - lava_callback - ERROR - Error processing callback for node 69f57a59ed4ed40b02241e82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49488 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:16:14,214 - lava_callback - INFO - Received callback for node 69f57a7eed4ed40b02241e8b INFO: 172.20.0.1:44130 - "POST /node/69f57a7eed4ed40b02241e8b HTTP/1.0" 202 Accepted 2026-05-04 04:16:14,220 - lava_callback - INFO - Starting async job submit for node 69f57a7eed4ed40b02241e8b 2026-05-04 04:16:14,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:16:14,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57a7eed4ed40b02241e8b HTTP/1.1" 200 None 2026-05-04 04:16:14,236 - lava_callback - DEBUG - Processing node 69f57a7eed4ed40b02241e8b: baseline-arm-clabbe 2026-05-04 04:16:14,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57a7eed4ed40b02241e8b 2026-05-04 04:16:14,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:16:14,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57a7eed4ed40b02241e8b HTTP/1.1" 200 None 2026-05-04 04:16:14,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:16:14,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-04 04:16:14,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:16:14,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57a7eed4ed40b02241e8b HTTP/1.1" 200 None 2026-05-04 04:16:14,308 - lava_callback - ERROR - Error processing callback for node 69f57a7eed4ed40b02241e8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57194 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:16:54,309 - lava_callback - INFO - Received callback for node 69f57aa4ed4ed40b02241e97 INFO: 172.20.0.1:53336 - "POST /node/69f57aa4ed4ed40b02241e97 HTTP/1.0" 202 Accepted 2026-05-04 04:16:54,315 - lava_callback - INFO - Starting async job submit for node 69f57aa4ed4ed40b02241e97 2026-05-04 04:16:54,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:16:54,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57aa4ed4ed40b02241e97 HTTP/1.1" 200 None 2026-05-04 04:16:54,332 - lava_callback - DEBUG - Processing node 69f57aa4ed4ed40b02241e97: baseline-arm-clabbe 2026-05-04 04:16:54,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57aa4ed4ed40b02241e97 2026-05-04 04:16:54,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:16:54,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57aa4ed4ed40b02241e97 HTTP/1.1" 200 None 2026-05-04 04:16:54,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:16:54,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-04 04:16:54,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:16:54,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57aa4ed4ed40b02241e97 HTTP/1.1" 200 None 2026-05-04 04:16:54,391 - lava_callback - ERROR - Error processing callback for node 69f57aa4ed4ed40b02241e97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56018 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:17:34,284 - lava_callback - INFO - Received callback for node 69f57ac8ed4ed40b02241ea5 INFO: 172.20.0.1:48296 - "POST /node/69f57ac8ed4ed40b02241ea5 HTTP/1.0" 202 Accepted 2026-05-04 04:17:34,290 - lava_callback - INFO - Starting async job submit for node 69f57ac8ed4ed40b02241ea5 2026-05-04 04:17:34,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:17:34,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57ac8ed4ed40b02241ea5 HTTP/1.1" 200 None 2026-05-04 04:17:34,305 - lava_callback - DEBUG - Processing node 69f57ac8ed4ed40b02241ea5: baseline-arm-clabbe 2026-05-04 04:17:34,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57ac8ed4ed40b02241ea5 2026-05-04 04:17:34,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:17:34,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57ac8ed4ed40b02241ea5 HTTP/1.1" 200 None 2026-05-04 04:17:34,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:17:34,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-04 04:17:34,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:17:34,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57ac8ed4ed40b02241ea5 HTTP/1.1" 200 None 2026-05-04 04:17:34,359 - lava_callback - ERROR - Error processing callback for node 69f57ac8ed4ed40b02241ea5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57122 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:20:19,116 - lava_callback - INFO - Received callback for node 69f57b7ced4ed40b02241eee INFO: 172.20.0.1:57130 - "POST /node/69f57b7ced4ed40b02241eee HTTP/1.0" 202 Accepted 2026-05-04 04:20:19,121 - lava_callback - INFO - Starting async job submit for node 69f57b7ced4ed40b02241eee 2026-05-04 04:20:19,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:20:19,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57b7ced4ed40b02241eee HTTP/1.1" 200 None 2026-05-04 04:20:19,137 - lava_callback - DEBUG - Processing node 69f57b7ced4ed40b02241eee: baseline-arm-baylibre 2026-05-04 04:20:19,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57b7ced4ed40b02241eee 2026-05-04 04:20:19,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:20:19,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57b7ced4ed40b02241eee HTTP/1.1" 200 None 2026-05-04 04:20:19,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:20:19,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-04 04:20:19,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:20:19,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57b7ced4ed40b02241eee HTTP/1.1" 200 None 2026-05-04 04:20:19,188 - lava_callback - ERROR - Error processing callback for node 69f57b7ced4ed40b02241eee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37372 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48390 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:23:18,778 - lava_callback - INFO - Received callback for node 69f57c31ed4ed40b02241f2f INFO: 172.20.0.1:48398 - "POST /node/69f57c31ed4ed40b02241f2f HTTP/1.0" 202 Accepted 2026-05-04 04:23:18,784 - lava_callback - INFO - Starting async job submit for node 69f57c31ed4ed40b02241f2f 2026-05-04 04:23:18,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:23:18,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57c31ed4ed40b02241f2f HTTP/1.1" 200 None 2026-05-04 04:23:18,799 - lava_callback - DEBUG - Processing node 69f57c31ed4ed40b02241f2f: baseline-arm-baylibre 2026-05-04 04:23:18,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57c31ed4ed40b02241f2f 2026-05-04 04:23:18,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:23:18,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57c31ed4ed40b02241f2f HTTP/1.1" 200 None 2026-05-04 04:23:18,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:23:18,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-04 04:23:18,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:23:18,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57c31ed4ed40b02241f2f HTTP/1.1" 200 None 2026-05-04 04:23:18,872 - lava_callback - ERROR - Error processing callback for node 69f57c31ed4ed40b02241f2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45578 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:25:18,811 - lava_callback - INFO - Received callback for node 69f57c9eed4ed40b02241f55 INFO: 172.20.0.1:45586 - "POST /node/69f57c9eed4ed40b02241f55 HTTP/1.0" 202 Accepted 2026-05-04 04:25:18,817 - lava_callback - INFO - Starting async job submit for node 69f57c9eed4ed40b02241f55 2026-05-04 04:25:18,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:25:18,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57c9eed4ed40b02241f55 HTTP/1.1" 200 None 2026-05-04 04:25:18,832 - lava_callback - DEBUG - Processing node 69f57c9eed4ed40b02241f55: baseline-arm-baylibre 2026-05-04 04:25:18,832 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57c9eed4ed40b02241f55 2026-05-04 04:25:18,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:25:18,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57c9eed4ed40b02241f55 HTTP/1.1" 200 None 2026-05-04 04:25:18,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:25:18,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-04 04:25:18,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:25:18,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57c9eed4ed40b02241f55 HTTP/1.1" 200 None 2026-05-04 04:25:18,877 - lava_callback - ERROR - Error processing callback for node 69f57c9eed4ed40b02241f55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45480 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:27:38,956 - lava_callback - INFO - Received callback for node 69f57d30ed4ed40b02241f92 INFO: 172.20.0.1:45494 - "POST /node/69f57d30ed4ed40b02241f92 HTTP/1.0" 202 Accepted 2026-05-04 04:27:38,965 - lava_callback - INFO - Starting async job submit for node 69f57d30ed4ed40b02241f92 2026-05-04 04:27:38,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:27:38,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57d30ed4ed40b02241f92 HTTP/1.1" 200 None 2026-05-04 04:27:38,983 - lava_callback - DEBUG - Processing node 69f57d30ed4ed40b02241f92: baseline-arm-baylibre 2026-05-04 04:27:38,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57d30ed4ed40b02241f92 2026-05-04 04:27:38,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:27:38,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57d30ed4ed40b02241f92 HTTP/1.1" 200 None 2026-05-04 04:27:38,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:27:39,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-04 04:27:39,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:27:39,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57d30ed4ed40b02241f92 HTTP/1.1" 200 None 2026-05-04 04:27:39,030 - lava_callback - ERROR - Error processing callback for node 69f57d30ed4ed40b02241f92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33212 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:28:18,965 - lava_callback - INFO - Received callback for node 69f57d53ed4ed40b02241f9f INFO: 172.20.0.1:33214 - "POST /node/69f57d53ed4ed40b02241f9f HTTP/1.0" 202 Accepted 2026-05-04 04:28:18,971 - lava_callback - INFO - Starting async job submit for node 69f57d53ed4ed40b02241f9f 2026-05-04 04:28:18,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:28:18,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57d53ed4ed40b02241f9f HTTP/1.1" 200 None 2026-05-04 04:28:18,986 - lava_callback - DEBUG - Processing node 69f57d53ed4ed40b02241f9f: baseline-arm-baylibre 2026-05-04 04:28:18,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57d53ed4ed40b02241f9f 2026-05-04 04:28:18,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:28:18,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57d53ed4ed40b02241f9f HTTP/1.1" 200 None 2026-05-04 04:28:19,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:28:19,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-04 04:28:19,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:28:19,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57d53ed4ed40b02241f9f HTTP/1.1" 200 None 2026-05-04 04:28:19,031 - lava_callback - ERROR - Error processing callback for node 69f57d53ed4ed40b02241f9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38728 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:29:34,777 - lava_callback - INFO - Received callback for node 69f57da0ed4ed40b02241fba INFO: 172.20.0.1:49088 - "POST /node/69f57da0ed4ed40b02241fba HTTP/1.0" 202 Accepted 2026-05-04 04:29:34,782 - lava_callback - INFO - Starting async job submit for node 69f57da0ed4ed40b02241fba 2026-05-04 04:29:34,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:29:34,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57da0ed4ed40b02241fba HTTP/1.1" 200 None 2026-05-04 04:29:34,797 - lava_callback - DEBUG - Processing node 69f57da0ed4ed40b02241fba: baseline-arm-clabbe 2026-05-04 04:29:34,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57da0ed4ed40b02241fba 2026-05-04 04:29:34,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:29:34,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57da0ed4ed40b02241fba HTTP/1.1" 200 None 2026-05-04 04:29:34,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:29:34,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-04 04:29:34,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:29:34,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57da0ed4ed40b02241fba HTTP/1.1" 200 None 2026-05-04 04:29:34,854 - lava_callback - ERROR - Error processing callback for node 69f57da0ed4ed40b02241fba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56374 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:29:59,121 - lava_callback - INFO - Received callback for node 69f57dc2ed4ed40b02241fc4 INFO: 172.20.0.1:56376 - "POST /node/69f57dc2ed4ed40b02241fc4 HTTP/1.0" 202 Accepted 2026-05-04 04:29:59,127 - lava_callback - INFO - Starting async job submit for node 69f57dc2ed4ed40b02241fc4 2026-05-04 04:29:59,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:29:59,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57dc2ed4ed40b02241fc4 HTTP/1.1" 200 None 2026-05-04 04:29:59,142 - lava_callback - DEBUG - Processing node 69f57dc2ed4ed40b02241fc4: baseline-arm-baylibre 2026-05-04 04:29:59,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57dc2ed4ed40b02241fc4 2026-05-04 04:29:59,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:29:59,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57dc2ed4ed40b02241fc4 HTTP/1.1" 200 None 2026-05-04 04:29:59,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:29:59,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-04 04:29:59,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:29:59,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57dc2ed4ed40b02241fc4 HTTP/1.1" 200 None 2026-05-04 04:29:59,243 - lava_callback - ERROR - Error processing callback for node 69f57dc2ed4ed40b02241fc4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60596 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:30:39,051 - lava_callback - INFO - Received callback for node 69f57de5ed4ed40b02241fd2 INFO: 172.20.0.1:60602 - "POST /node/69f57de5ed4ed40b02241fd2 HTTP/1.0" 202 Accepted 2026-05-04 04:30:39,057 - lava_callback - INFO - Starting async job submit for node 69f57de5ed4ed40b02241fd2 2026-05-04 04:30:39,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:30:39,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57de5ed4ed40b02241fd2 HTTP/1.1" 200 None 2026-05-04 04:30:39,072 - lava_callback - DEBUG - Processing node 69f57de5ed4ed40b02241fd2: baseline-arm-baylibre 2026-05-04 04:30:39,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57de5ed4ed40b02241fd2 2026-05-04 04:30:39,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:30:39,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57de5ed4ed40b02241fd2 HTTP/1.1" 200 None 2026-05-04 04:30:39,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:30:39,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-04 04:30:39,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:30:39,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57de5ed4ed40b02241fd2 HTTP/1.1" 200 None 2026-05-04 04:30:39,122 - lava_callback - ERROR - Error processing callback for node 69f57de5ed4ed40b02241fd2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46664 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:31:14,837 - lava_callback - INFO - Received callback for node 69f57e0bed4ed40b02241fdf INFO: 172.20.0.1:45938 - "POST /node/69f57e0bed4ed40b02241fdf HTTP/1.0" 202 Accepted 2026-05-04 04:31:14,842 - lava_callback - INFO - Starting async job submit for node 69f57e0bed4ed40b02241fdf 2026-05-04 04:31:14,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:31:14,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57e0bed4ed40b02241fdf HTTP/1.1" 200 None 2026-05-04 04:31:14,862 - lava_callback - DEBUG - Processing node 69f57e0bed4ed40b02241fdf: baseline-arm-clabbe 2026-05-04 04:31:14,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57e0bed4ed40b02241fdf 2026-05-04 04:31:14,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:31:14,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57e0bed4ed40b02241fdf HTTP/1.1" 200 None 2026-05-04 04:31:14,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:31:14,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-04 04:31:14,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:31:14,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57e0bed4ed40b02241fdf HTTP/1.1" 200 None 2026-05-04 04:31:14,932 - lava_callback - ERROR - Error processing callback for node 69f57e0bed4ed40b02241fdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37616 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:32:34,915 - lava_callback - INFO - Received callback for node 69f57e54ed4ed40b02241ffc INFO: 172.20.0.1:45100 - "POST /node/69f57e54ed4ed40b02241ffc HTTP/1.0" 202 Accepted 2026-05-04 04:32:34,920 - lava_callback - INFO - Starting async job submit for node 69f57e54ed4ed40b02241ffc 2026-05-04 04:32:34,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:32:34,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57e54ed4ed40b02241ffc HTTP/1.1" 200 None 2026-05-04 04:32:34,936 - lava_callback - DEBUG - Processing node 69f57e54ed4ed40b02241ffc: baseline-arm-clabbe 2026-05-04 04:32:34,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57e54ed4ed40b02241ffc 2026-05-04 04:32:34,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:32:34,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57e54ed4ed40b02241ffc HTTP/1.1" 200 None 2026-05-04 04:32:34,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:32:34,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-04 04:32:34,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:32:34,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57e54ed4ed40b02241ffc HTTP/1.1" 200 None 2026-05-04 04:32:34,983 - lava_callback - ERROR - Error processing callback for node 69f57e54ed4ed40b02241ffc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39286 - "GET /node/69be6278448e074b3ffe20df%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45978 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:33:34,894 - lava_callback - INFO - Received callback for node 69f57e9ced4ed40b02242015 INFO: 172.20.0.1:54470 - "POST /node/69f57e9ced4ed40b02242015 HTTP/1.0" 202 Accepted 2026-05-04 04:33:34,903 - lava_callback - INFO - Starting async job submit for node 69f57e9ced4ed40b02242015 2026-05-04 04:33:34,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:33:34,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57e9ced4ed40b02242015 HTTP/1.1" 200 None 2026-05-04 04:33:34,919 - lava_callback - DEBUG - Processing node 69f57e9ced4ed40b02242015: baseline-arm-clabbe 2026-05-04 04:33:34,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57e9ced4ed40b02242015 2026-05-04 04:33:34,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:33:34,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57e9ced4ed40b02242015 HTTP/1.1" 200 None 2026-05-04 04:33:34,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:33:34,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-04 04:33:34,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:33:34,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57e9ced4ed40b02242015 HTTP/1.1" 200 None 2026-05-04 04:33:34,972 - lava_callback - ERROR - Error processing callback for node 69f57e9ced4ed40b02242015: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59012 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:34:14,865 - lava_callback - INFO - Received callback for node 69f57ec0ed4ed40b02242021 INFO: 172.20.0.1:38910 - "POST /node/69f57ec0ed4ed40b02242021 HTTP/1.0" 202 Accepted 2026-05-04 04:34:14,870 - lava_callback - INFO - Starting async job submit for node 69f57ec0ed4ed40b02242021 2026-05-04 04:34:14,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:34:14,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57ec0ed4ed40b02242021 HTTP/1.1" 200 None 2026-05-04 04:34:14,885 - lava_callback - DEBUG - Processing node 69f57ec0ed4ed40b02242021: baseline-arm-clabbe 2026-05-04 04:34:14,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57ec0ed4ed40b02242021 2026-05-04 04:34:14,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:34:14,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57ec0ed4ed40b02242021 HTTP/1.1" 200 None 2026-05-04 04:34:14,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:34:14,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-04 04:34:14,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:34:14,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57ec0ed4ed40b02242021 HTTP/1.1" 200 None 2026-05-04 04:34:14,930 - lava_callback - ERROR - Error processing callback for node 69f57ec0ed4ed40b02242021: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40672 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:37:15,096 - lava_callback - INFO - Received callback for node 69f57f77ed4ed40b0224206a INFO: 172.20.0.1:54486 - "POST /node/69f57f77ed4ed40b0224206a HTTP/1.0" 202 Accepted 2026-05-04 04:37:15,101 - lava_callback - INFO - Starting async job submit for node 69f57f77ed4ed40b0224206a 2026-05-04 04:37:15,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:37:15,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57f77ed4ed40b0224206a HTTP/1.1" 200 None 2026-05-04 04:37:15,117 - lava_callback - DEBUG - Processing node 69f57f77ed4ed40b0224206a: baseline-arm-clabbe 2026-05-04 04:37:15,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57f77ed4ed40b0224206a 2026-05-04 04:37:15,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:37:15,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57f77ed4ed40b0224206a HTTP/1.1" 200 None 2026-05-04 04:37:15,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:37:15,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-04 04:37:15,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:37:15,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57f77ed4ed40b0224206a HTTP/1.1" 200 None INFO: 172.20.0.1:54488 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 04:37:15,168 - lava_callback - ERROR - Error processing callback for node 69f57f77ed4ed40b0224206a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35482 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:37:55,032 - lava_callback - INFO - Received callback for node 69f57f9ced4ed40b02242079 INFO: 172.20.0.1:54128 - "POST /node/69f57f9ced4ed40b02242079 HTTP/1.0" 202 Accepted 2026-05-04 04:37:55,038 - lava_callback - INFO - Starting async job submit for node 69f57f9ced4ed40b02242079 2026-05-04 04:37:55,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:37:55,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57f9ced4ed40b02242079 HTTP/1.1" 200 None 2026-05-04 04:37:55,056 - lava_callback - DEBUG - Processing node 69f57f9ced4ed40b02242079: baseline-arm-clabbe 2026-05-04 04:37:55,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57f9ced4ed40b02242079 2026-05-04 04:37:55,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:37:55,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57f9ced4ed40b02242079 HTTP/1.1" 200 None 2026-05-04 04:37:55,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:37:55,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-04 04:37:55,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:37:55,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57f9ced4ed40b02242079 HTTP/1.1" 200 None 2026-05-04 04:37:55,123 - lava_callback - ERROR - Error processing callback for node 69f57f9ced4ed40b02242079: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58916 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:38:35,104 - lava_callback - INFO - Received callback for node 69f57fc0ed4ed40b0224208a INFO: 172.20.0.1:59290 - "POST /node/69f57fc0ed4ed40b0224208a HTTP/1.0" 202 Accepted 2026-05-04 04:38:35,113 - lava_callback - INFO - Starting async job submit for node 69f57fc0ed4ed40b0224208a 2026-05-04 04:38:35,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:38:35,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57fc0ed4ed40b0224208a HTTP/1.1" 200 None 2026-05-04 04:38:35,135 - lava_callback - DEBUG - Processing node 69f57fc0ed4ed40b0224208a: baseline-arm-clabbe 2026-05-04 04:38:35,135 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f57fc0ed4ed40b0224208a 2026-05-04 04:38:35,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:38:35,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f57fc0ed4ed40b0224208a HTTP/1.1" 200 None 2026-05-04 04:38:35,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:38:35,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-04 04:38:35,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:38:35,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f57fc0ed4ed40b0224208a HTTP/1.1" 200 None 2026-05-04 04:38:35,190 - lava_callback - ERROR - Error processing callback for node 69f57fc0ed4ed40b0224208a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33736 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:40:35,134 - lava_callback - INFO - Received callback for node 69f5802eed4ed40b022420b0 INFO: 172.20.0.1:47532 - "POST /node/69f5802eed4ed40b022420b0 HTTP/1.0" 202 Accepted 2026-05-04 04:40:35,139 - lava_callback - INFO - Starting async job submit for node 69f5802eed4ed40b022420b0 2026-05-04 04:40:35,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:40:35,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5802eed4ed40b022420b0 HTTP/1.1" 200 None 2026-05-04 04:40:35,155 - lava_callback - DEBUG - Processing node 69f5802eed4ed40b022420b0: baseline-arm-clabbe 2026-05-04 04:40:35,155 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5802eed4ed40b022420b0 2026-05-04 04:40:35,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:40:35,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5802eed4ed40b022420b0 HTTP/1.1" 200 None 2026-05-04 04:40:35,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:40:35,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-04 04:40:35,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:40:35,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5802eed4ed40b022420b0 HTTP/1.1" 200 None 2026-05-04 04:40:35,207 - lava_callback - ERROR - Error processing callback for node 69f5802eed4ed40b022420b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34632 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:44:59,905 - lava_callback - INFO - Received callback for node 69f58137ed4ed40b02242126 INFO: 172.20.0.1:44638 - "POST /node/69f58137ed4ed40b02242126 HTTP/1.0" 202 Accepted 2026-05-04 04:44:59,912 - lava_callback - INFO - Starting async job submit for node 69f58137ed4ed40b02242126 2026-05-04 04:44:59,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:44:59,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58137ed4ed40b02242126 HTTP/1.1" 200 None 2026-05-04 04:44:59,926 - lava_callback - DEBUG - Processing node 69f58137ed4ed40b02242126: baseline-arm64-baylibre 2026-05-04 04:44:59,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f58137ed4ed40b02242126 2026-05-04 04:44:59,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:44:59,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58137ed4ed40b02242126 HTTP/1.1" 200 None 2026-05-04 04:44:59,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:44:59,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 04:45:00,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:45:00,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f58137ed4ed40b02242126 HTTP/1.1" 200 None 2026-05-04 04:45:00,026 - lava_callback - ERROR - Error processing callback for node 69f58137ed4ed40b02242126: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53556 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:45:59,843 - lava_callback - INFO - Received callback for node 69f58181ed4ed40b02242148 INFO: 172.20.0.1:40554 - "POST /node/69f58181ed4ed40b02242148 HTTP/1.0" 202 Accepted 2026-05-04 04:45:59,848 - lava_callback - INFO - Starting async job submit for node 69f58181ed4ed40b02242148 2026-05-04 04:45:59,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:45:59,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58181ed4ed40b02242148 HTTP/1.1" 200 None 2026-05-04 04:45:59,864 - lava_callback - DEBUG - Processing node 69f58181ed4ed40b02242148: baseline-arm64-baylibre 2026-05-04 04:45:59,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f58181ed4ed40b02242148 2026-05-04 04:45:59,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:45:59,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58181ed4ed40b02242148 HTTP/1.1" 200 None 2026-05-04 04:45:59,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:45:59,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 04:45:59,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:45:59,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f58181ed4ed40b02242148 HTTP/1.1" 200 None 2026-05-04 04:45:59,935 - lava_callback - ERROR - Error processing callback for node 69f58181ed4ed40b02242148: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55356 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:46:59,970 - lava_callback - INFO - Received callback for node 69f581c0ed4ed40b02242166 INFO: 172.20.0.1:40692 - "POST /node/69f581c0ed4ed40b02242166 HTTP/1.0" 202 Accepted 2026-05-04 04:46:59,977 - lava_callback - INFO - Starting async job submit for node 69f581c0ed4ed40b02242166 2026-05-04 04:46:59,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:46:59,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f581c0ed4ed40b02242166 HTTP/1.1" 200 None 2026-05-04 04:47:00,000 - lava_callback - DEBUG - Processing node 69f581c0ed4ed40b02242166: baseline-arm-baylibre 2026-05-04 04:47:00,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f581c0ed4ed40b02242166 2026-05-04 04:47:00,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:47:00,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f581c0ed4ed40b02242166 HTTP/1.1" 200 None 2026-05-04 04:47:00,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:47:00,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-04 04:47:00,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:47:00,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f581c0ed4ed40b02242166 HTTP/1.1" 200 None 2026-05-04 04:47:00,086 - lava_callback - ERROR - Error processing callback for node 69f581c0ed4ed40b02242166: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60584 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:47:59,949 - lava_callback - INFO - Received callback for node 69f581eeed4ed40b02242173 INFO: 172.20.0.1:48084 - "POST /node/69f581eeed4ed40b02242173 HTTP/1.0" 202 Accepted 2026-05-04 04:47:59,957 - lava_callback - INFO - Starting async job submit for node 69f581eeed4ed40b02242173 2026-05-04 04:47:59,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:47:59,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f581eeed4ed40b02242173 HTTP/1.1" 200 None 2026-05-04 04:47:59,977 - lava_callback - DEBUG - Processing node 69f581eeed4ed40b02242173: baseline-arm64-baylibre 2026-05-04 04:47:59,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f581eeed4ed40b02242173 2026-05-04 04:47:59,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:47:59,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f581eeed4ed40b02242173 HTTP/1.1" 200 None 2026-05-04 04:47:59,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:48:00,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 04:48:00,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:48:00,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f581eeed4ed40b02242173 HTTP/1.1" 200 None 2026-05-04 04:48:00,030 - lava_callback - ERROR - Error processing callback for node 69f581eeed4ed40b02242173: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50992 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:49:00,140 - lava_callback - INFO - Received callback for node 69f5822fed4ed40b02242191 INFO: 172.20.0.1:35282 - "POST /node/69f5822fed4ed40b02242191 HTTP/1.0" 202 Accepted 2026-05-04 04:49:00,146 - lava_callback - INFO - Starting async job submit for node 69f5822fed4ed40b02242191 2026-05-04 04:49:00,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:49:00,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5822fed4ed40b02242191 HTTP/1.1" 200 None 2026-05-04 04:49:00,173 - lava_callback - DEBUG - Processing node 69f5822fed4ed40b02242191: baseline-arm-baylibre 2026-05-04 04:49:00,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5822fed4ed40b02242191 2026-05-04 04:49:00,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:49:00,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5822fed4ed40b02242191 HTTP/1.1" 200 None 2026-05-04 04:49:00,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:49:00,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-04 04:49:00,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:49:00,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5822fed4ed40b02242191 HTTP/1.1" 200 None 2026-05-04 04:49:00,276 - lava_callback - ERROR - Error processing callback for node 69f5822fed4ed40b02242191: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34080 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:49:40,054 - lava_callback - INFO - Received callback for node 69f5825fed4ed40b0224219f INFO: 172.20.0.1:51260 - "POST /node/69f5825fed4ed40b0224219f HTTP/1.0" 202 Accepted 2026-05-04 04:49:40,059 - lava_callback - INFO - Starting async job submit for node 69f5825fed4ed40b0224219f 2026-05-04 04:49:40,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:49:40,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5825fed4ed40b0224219f HTTP/1.1" 200 None 2026-05-04 04:49:40,075 - lava_callback - DEBUG - Processing node 69f5825fed4ed40b0224219f: baseline-arm64-baylibre 2026-05-04 04:49:40,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5825fed4ed40b0224219f 2026-05-04 04:49:40,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:49:40,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5825fed4ed40b0224219f HTTP/1.1" 200 None 2026-05-04 04:49:40,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:49:40,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 04:49:40,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:49:40,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5825fed4ed40b0224219f HTTP/1.1" 200 None 2026-05-04 04:49:40,119 - lava_callback - ERROR - Error processing callback for node 69f5825fed4ed40b0224219f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43918 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:50:40,160 - lava_callback - INFO - Received callback for node 69f5829eed4ed40b022421bf INFO: 172.20.0.1:57040 - "POST /node/69f5829eed4ed40b022421bf HTTP/1.0" 202 Accepted 2026-05-04 04:50:40,166 - lava_callback - INFO - Starting async job submit for node 69f5829eed4ed40b022421bf 2026-05-04 04:50:40,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:50:40,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5829eed4ed40b022421bf HTTP/1.1" 200 None 2026-05-04 04:50:40,184 - lava_callback - DEBUG - Processing node 69f5829eed4ed40b022421bf: baseline-arm-baylibre 2026-05-04 04:50:40,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5829eed4ed40b022421bf 2026-05-04 04:50:40,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:50:40,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5829eed4ed40b022421bf HTTP/1.1" 200 None 2026-05-04 04:50:40,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:50:40,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-04 04:50:40,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:50:40,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5829eed4ed40b022421bf HTTP/1.1" 200 None 2026-05-04 04:50:40,243 - lava_callback - ERROR - Error processing callback for node 69f5829eed4ed40b022421bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47748 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:51:40,206 - lava_callback - INFO - Received callback for node 69f582ceed4ed40b022421d8 INFO: 172.20.0.1:59218 - "POST /node/69f582ceed4ed40b022421d8 HTTP/1.0" 202 Accepted 2026-05-04 04:51:40,211 - lava_callback - INFO - Starting async job submit for node 69f582ceed4ed40b022421d8 2026-05-04 04:51:40,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:51:40,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f582ceed4ed40b022421d8 HTTP/1.1" 200 None 2026-05-04 04:51:40,226 - lava_callback - DEBUG - Processing node 69f582ceed4ed40b022421d8: baseline-arm64-baylibre 2026-05-04 04:51:40,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f582ceed4ed40b022421d8 2026-05-04 04:51:40,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:51:40,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f582ceed4ed40b022421d8 HTTP/1.1" 200 None 2026-05-04 04:51:40,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:51:40,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 04:51:40,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:51:40,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f582ceed4ed40b022421d8 HTTP/1.1" 200 None 2026-05-04 04:51:40,279 - lava_callback - ERROR - Error processing callback for node 69f582ceed4ed40b022421d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43062 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:53:00,275 - lava_callback - INFO - Received callback for node 69f5831aed4ed40b022421f7 INFO: 172.20.0.1:39014 - "POST /node/69f5831aed4ed40b022421f7 HTTP/1.0" 202 Accepted 2026-05-04 04:53:00,281 - lava_callback - INFO - Starting async job submit for node 69f5831aed4ed40b022421f7 2026-05-04 04:53:00,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:53:00,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5831aed4ed40b022421f7 HTTP/1.1" 200 None 2026-05-04 04:53:00,323 - lava_callback - DEBUG - Processing node 69f5831aed4ed40b022421f7: baseline-arm64-baylibre 2026-05-04 04:53:00,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5831aed4ed40b022421f7 2026-05-04 04:53:00,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:53:00,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5831aed4ed40b022421f7 HTTP/1.1" 200 None 2026-05-04 04:53:00,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:53:00,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 04:53:00,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:53:00,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5831aed4ed40b022421f7 HTTP/1.1" 200 None 2026-05-04 04:53:00,416 - lava_callback - ERROR - Error processing callback for node 69f5831aed4ed40b022421f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44016 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:54:00,347 - lava_callback - INFO - Received callback for node 69f58358ed4ed40b02242218 INFO: 172.20.0.1:36130 - "POST /node/69f58358ed4ed40b02242218 HTTP/1.0" 202 Accepted 2026-05-04 04:54:00,353 - lava_callback - INFO - Starting async job submit for node 69f58358ed4ed40b02242218 2026-05-04 04:54:00,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:54:00,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58358ed4ed40b02242218 HTTP/1.1" 200 None 2026-05-04 04:54:00,368 - lava_callback - DEBUG - Processing node 69f58358ed4ed40b02242218: baseline-arm-baylibre 2026-05-04 04:54:00,368 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f58358ed4ed40b02242218 2026-05-04 04:54:00,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:54:00,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58358ed4ed40b02242218 HTTP/1.1" 200 None 2026-05-04 04:54:00,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:54:00,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-04 04:54:00,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:54:00,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f58358ed4ed40b02242218 HTTP/1.1" 200 None 2026-05-04 04:54:00,415 - lava_callback - ERROR - Error processing callback for node 69f58358ed4ed40b02242218: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40810 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:54:40,379 - lava_callback - INFO - Received callback for node 69f5837ded4ed40b0224222b INFO: 172.20.0.1:45580 - "POST /node/69f5837ded4ed40b0224222b HTTP/1.0" 202 Accepted 2026-05-04 04:54:40,384 - lava_callback - INFO - Starting async job submit for node 69f5837ded4ed40b0224222b 2026-05-04 04:54:40,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:54:40,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5837ded4ed40b0224222b HTTP/1.1" 200 None 2026-05-04 04:54:40,400 - lava_callback - DEBUG - Processing node 69f5837ded4ed40b0224222b: baseline-arm-baylibre 2026-05-04 04:54:40,400 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5837ded4ed40b0224222b 2026-05-04 04:54:40,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:54:40,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5837ded4ed40b0224222b HTTP/1.1" 200 None 2026-05-04 04:54:40,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:54:40,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-04 04:54:40,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:54:40,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5837ded4ed40b0224222b HTTP/1.1" 200 None 2026-05-04 04:54:40,445 - lava_callback - ERROR - Error processing callback for node 69f5837ded4ed40b0224222b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49082 - "GET / HTTP/1.0" 200 OK 2026-05-04 04:55:00,368 - lava_callback - INFO - Received callback for node 69f583a0ed4ed40b02242235 INFO: 172.20.0.1:53340 - "POST /node/69f583a0ed4ed40b02242235 HTTP/1.0" 202 Accepted 2026-05-04 04:55:00,377 - lava_callback - INFO - Starting async job submit for node 69f583a0ed4ed40b02242235 2026-05-04 04:55:00,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:55:00,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f583a0ed4ed40b02242235 HTTP/1.1" 200 None 2026-05-04 04:55:00,402 - lava_callback - DEBUG - Processing node 69f583a0ed4ed40b02242235: baseline-arm-baylibre 2026-05-04 04:55:00,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f583a0ed4ed40b02242235 2026-05-04 04:55:00,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:55:00,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f583a0ed4ed40b02242235 HTTP/1.1" 200 None 2026-05-04 04:55:00,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:55:00,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-04 04:55:00,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 04:55:00,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f583a0ed4ed40b02242235 HTTP/1.1" 200 None 2026-05-04 04:55:00,459 - lava_callback - ERROR - Error processing callback for node 69f583a0ed4ed40b02242235: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48144 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:04:00,960 - lava_callback - INFO - Received callback for node 69f585b1ed4ed40b02242322 INFO: 172.20.0.1:46816 - "POST /node/69f585b1ed4ed40b02242322 HTTP/1.0" 202 Accepted 2026-05-04 05:04:00,965 - lava_callback - INFO - Starting async job submit for node 69f585b1ed4ed40b02242322 2026-05-04 05:04:00,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:04:00,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f585b1ed4ed40b02242322 HTTP/1.1" 200 None 2026-05-04 05:04:00,986 - lava_callback - DEBUG - Processing node 69f585b1ed4ed40b02242322: baseline-arm64-baylibre 2026-05-04 05:04:00,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f585b1ed4ed40b02242322 2026-05-04 05:04:00,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:04:00,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f585b1ed4ed40b02242322 HTTP/1.1" 200 None 2026-05-04 05:04:01,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:04:01,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-04 05:04:01,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:04:01,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f585b1ed4ed40b02242322 HTTP/1.1" 200 None 2026-05-04 05:04:01,033 - lava_callback - ERROR - Error processing callback for node 69f585b1ed4ed40b02242322: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34076 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 05:05:16,145 - lava_callback - INFO - Received callback for node 69f58602ed4ed40b02242347 INFO: 172.20.0.1:34078 - "POST /node/69f58602ed4ed40b02242347 HTTP/1.0" 202 Accepted 2026-05-04 05:05:16,151 - lava_callback - INFO - Starting async job submit for node 69f58602ed4ed40b02242347 2026-05-04 05:05:16,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:05:16,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58602ed4ed40b02242347 HTTP/1.1" 200 None 2026-05-04 05:05:16,168 - lava_callback - DEBUG - Processing node 69f58602ed4ed40b02242347: baseline-arm64-clabbe 2026-05-04 05:05:16,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f58602ed4ed40b02242347 2026-05-04 05:05:16,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:05:16,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58602ed4ed40b02242347 HTTP/1.1" 200 None 2026-05-04 05:05:16,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:05:16,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-04 05:05:16,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:05:16,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f58602ed4ed40b02242347 HTTP/1.1" 200 None 2026-05-04 05:05:16,219 - lava_callback - ERROR - Error processing callback for node 69f58602ed4ed40b02242347: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41144 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:06:36,260 - lava_callback - INFO - Received callback for node 69f5864fed4ed40b02242374 INFO: 172.20.0.1:54242 - "POST /node/69f5864fed4ed40b02242374 HTTP/1.0" 202 Accepted 2026-05-04 05:06:36,265 - lava_callback - INFO - Starting async job submit for node 69f5864fed4ed40b02242374 2026-05-04 05:06:36,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:06:36,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5864fed4ed40b02242374 HTTP/1.1" 200 None 2026-05-04 05:06:36,280 - lava_callback - DEBUG - Processing node 69f5864fed4ed40b02242374: baseline-arm64-clabbe 2026-05-04 05:06:36,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5864fed4ed40b02242374 2026-05-04 05:06:36,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:06:36,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5864fed4ed40b02242374 HTTP/1.1" 200 None 2026-05-04 05:06:36,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:06:36,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-04 05:06:36,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:06:36,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5864fed4ed40b02242374 HTTP/1.1" 200 None 2026-05-04 05:06:36,327 - lava_callback - ERROR - Error processing callback for node 69f5864fed4ed40b02242374: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42714 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:07:56,360 - lava_callback - INFO - Received callback for node 69f5869aed4ed40b02242399 INFO: 172.20.0.1:38920 - "POST /node/69f5869aed4ed40b02242399 HTTP/1.0" 202 Accepted 2026-05-04 05:07:56,366 - lava_callback - INFO - Starting async job submit for node 69f5869aed4ed40b02242399 2026-05-04 05:07:56,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:07:56,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5869aed4ed40b02242399 HTTP/1.1" 200 None 2026-05-04 05:07:56,381 - lava_callback - DEBUG - Processing node 69f5869aed4ed40b02242399: baseline-arm64-clabbe 2026-05-04 05:07:56,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5869aed4ed40b02242399 2026-05-04 05:07:56,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:07:56,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5869aed4ed40b02242399 HTTP/1.1" 200 None 2026-05-04 05:07:56,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:07:56,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-04 05:07:56,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:07:56,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5869aed4ed40b02242399 HTTP/1.1" 200 None 2026-05-04 05:07:56,438 - lava_callback - ERROR - Error processing callback for node 69f5869aed4ed40b02242399: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57386 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:08:56,342 - lava_callback - INFO - Received callback for node 69f586e3ed4ed40b022423ca INFO: 172.20.0.1:37534 - "POST /node/69f586e3ed4ed40b022423ca HTTP/1.0" 202 Accepted 2026-05-04 05:08:56,347 - lava_callback - INFO - Starting async job submit for node 69f586e3ed4ed40b022423ca 2026-05-04 05:08:56,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:08:56,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f586e3ed4ed40b022423ca HTTP/1.1" 200 None 2026-05-04 05:08:56,362 - lava_callback - DEBUG - Processing node 69f586e3ed4ed40b022423ca: baseline-arm64-clabbe 2026-05-04 05:08:56,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f586e3ed4ed40b022423ca 2026-05-04 05:08:56,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:08:56,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f586e3ed4ed40b022423ca HTTP/1.1" 200 None 2026-05-04 05:08:56,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:08:56,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-04 05:08:56,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:08:56,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f586e3ed4ed40b022423ca HTTP/1.1" 200 None 2026-05-04 05:08:56,411 - lava_callback - ERROR - Error processing callback for node 69f586e3ed4ed40b022423ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38626 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:11:36,470 - lava_callback - INFO - Received callback for node 69f5877ced4ed40b02242411 INFO: 172.20.0.1:43580 - "POST /node/69f5877ced4ed40b02242411 HTTP/1.0" 202 Accepted 2026-05-04 05:11:36,476 - lava_callback - INFO - Starting async job submit for node 69f5877ced4ed40b02242411 2026-05-04 05:11:36,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:11:36,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5877ced4ed40b02242411 HTTP/1.1" 200 None 2026-05-04 05:11:36,500 - lava_callback - DEBUG - Processing node 69f5877ced4ed40b02242411: baseline-arm64-clabbe 2026-05-04 05:11:36,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5877ced4ed40b02242411 2026-05-04 05:11:36,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:11:36,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5877ced4ed40b02242411 HTTP/1.1" 200 None 2026-05-04 05:11:36,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:43596 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:11:36,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-04 05:11:36,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:11:36,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5877ced4ed40b02242411 HTTP/1.1" 200 None 2026-05-04 05:11:36,546 - lava_callback - ERROR - Error processing callback for node 69f5877ced4ed40b02242411: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52364 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:12:56,538 - lava_callback - INFO - Received callback for node 69f587c9ed4ed40b0224242e INFO: 172.20.0.1:52380 - "POST /node/69f587c9ed4ed40b0224242e HTTP/1.0" 202 Accepted 2026-05-04 05:12:56,544 - lava_callback - INFO - Starting async job submit for node 69f587c9ed4ed40b0224242e 2026-05-04 05:12:56,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:12:56,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f587c9ed4ed40b0224242e HTTP/1.1" 200 None 2026-05-04 05:12:56,563 - lava_callback - DEBUG - Processing node 69f587c9ed4ed40b0224242e: baseline-arm64-clabbe 2026-05-04 05:12:56,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f587c9ed4ed40b0224242e 2026-05-04 05:12:56,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:12:56,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f587c9ed4ed40b0224242e HTTP/1.1" 200 None 2026-05-04 05:12:56,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:12:56,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-04 05:12:56,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:12:56,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f587c9ed4ed40b0224242e HTTP/1.1" 200 None 2026-05-04 05:12:56,619 - lava_callback - ERROR - Error processing callback for node 69f587c9ed4ed40b0224242e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38546 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:15:21,495 - lava_callback - INFO - Received callback for node 69f58857ed4ed40b02242476 INFO: 172.20.0.1:35276 - "POST /node/69f58857ed4ed40b02242476 HTTP/1.0" 202 Accepted 2026-05-04 05:15:21,501 - lava_callback - INFO - Starting async job submit for node 69f58857ed4ed40b02242476 2026-05-04 05:15:21,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:15:21,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58857ed4ed40b02242476 HTTP/1.1" 200 None 2026-05-04 05:15:21,517 - lava_callback - DEBUG - Processing node 69f58857ed4ed40b02242476: baseline-arm64-baylibre 2026-05-04 05:15:21,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f58857ed4ed40b02242476 2026-05-04 05:15:21,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:15:21,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58857ed4ed40b02242476 HTTP/1.1" 200 None 2026-05-04 05:15:21,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:15:21,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 05:15:21,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:15:21,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f58857ed4ed40b02242476 HTTP/1.1" 200 None 2026-05-04 05:15:21,564 - lava_callback - ERROR - Error processing callback for node 69f58857ed4ed40b02242476: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40338 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:16:21,496 - lava_callback - INFO - Received callback for node 69f588a2ed4ed40b02242496 INFO: 172.20.0.1:54900 - "POST /node/69f588a2ed4ed40b02242496 HTTP/1.0" 202 Accepted 2026-05-04 05:16:21,501 - lava_callback - INFO - Starting async job submit for node 69f588a2ed4ed40b02242496 2026-05-04 05:16:21,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:16:21,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f588a2ed4ed40b02242496 HTTP/1.1" 200 None 2026-05-04 05:16:21,516 - lava_callback - DEBUG - Processing node 69f588a2ed4ed40b02242496: baseline-arm64-baylibre 2026-05-04 05:16:21,516 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f588a2ed4ed40b02242496 2026-05-04 05:16:21,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:16:21,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f588a2ed4ed40b02242496 HTTP/1.1" 200 None 2026-05-04 05:16:21,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:16:21,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 05:16:21,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:16:21,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f588a2ed4ed40b02242496 HTTP/1.1" 200 None 2026-05-04 05:16:21,573 - lava_callback - ERROR - Error processing callback for node 69f588a2ed4ed40b02242496: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56686 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:17:41,596 - lava_callback - INFO - Received callback for node 69f588eded4ed40b022424b8 INFO: 172.20.0.1:42130 - "POST /node/69f588eded4ed40b022424b8 HTTP/1.0" 202 Accepted 2026-05-04 05:17:41,602 - lava_callback - INFO - Starting async job submit for node 69f588eded4ed40b022424b8 2026-05-04 05:17:41,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:17:41,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f588eded4ed40b022424b8 HTTP/1.1" 200 None 2026-05-04 05:17:41,619 - lava_callback - DEBUG - Processing node 69f588eded4ed40b022424b8: baseline-arm64-baylibre 2026-05-04 05:17:41,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f588eded4ed40b022424b8 2026-05-04 05:17:41,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:17:41,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f588eded4ed40b022424b8 HTTP/1.1" 200 None 2026-05-04 05:17:41,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:17:41,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 05:17:41,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:17:41,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f588eded4ed40b022424b8 HTTP/1.1" 200 None 2026-05-04 05:17:41,681 - lava_callback - ERROR - Error processing callback for node 69f588eded4ed40b022424b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38380 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:19:01,755 - lava_callback - INFO - Received callback for node 69f58937ed4ed40b022424de INFO: 172.20.0.1:55104 - "POST /node/69f58937ed4ed40b022424de HTTP/1.0" 202 Accepted 2026-05-04 05:19:01,760 - lava_callback - INFO - Starting async job submit for node 69f58937ed4ed40b022424de 2026-05-04 05:19:01,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:19:01,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58937ed4ed40b022424de HTTP/1.1" 200 None 2026-05-04 05:19:01,775 - lava_callback - DEBUG - Processing node 69f58937ed4ed40b022424de: baseline-arm64-baylibre 2026-05-04 05:19:01,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f58937ed4ed40b022424de 2026-05-04 05:19:01,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:19:01,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58937ed4ed40b022424de HTTP/1.1" 200 None 2026-05-04 05:19:01,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:19:01,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 05:19:01,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:19:01,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f58937ed4ed40b022424de HTTP/1.1" 200 None 2026-05-04 05:19:01,828 - lava_callback - ERROR - Error processing callback for node 69f58937ed4ed40b022424de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51672 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:20:21,776 - lava_callback - INFO - Received callback for node 69f58982ed4ed40b02242501 INFO: 172.20.0.1:43492 - "POST /node/69f58982ed4ed40b02242501 HTTP/1.0" 202 Accepted 2026-05-04 05:20:21,785 - lava_callback - INFO - Starting async job submit for node 69f58982ed4ed40b02242501 2026-05-04 05:20:21,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:20:21,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58982ed4ed40b02242501 HTTP/1.1" 200 None 2026-05-04 05:20:21,801 - lava_callback - DEBUG - Processing node 69f58982ed4ed40b02242501: baseline-arm64-baylibre 2026-05-04 05:20:21,801 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f58982ed4ed40b02242501 2026-05-04 05:20:21,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:20:21,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f58982ed4ed40b02242501 HTTP/1.1" 200 None 2026-05-04 05:20:21,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:20:21,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 05:20:21,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:20:21,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f58982ed4ed40b02242501 HTTP/1.1" 200 None 2026-05-04 05:20:21,856 - lava_callback - ERROR - Error processing callback for node 69f58982ed4ed40b02242501: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53842 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:21:21,732 - lava_callback - INFO - Received callback for node 69f589cced4ed40b0224251f INFO: 172.20.0.1:42848 - "POST /node/69f589cced4ed40b0224251f HTTP/1.0" 202 Accepted 2026-05-04 05:21:21,737 - lava_callback - INFO - Starting async job submit for node 69f589cced4ed40b0224251f 2026-05-04 05:21:21,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:21:21,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f589cced4ed40b0224251f HTTP/1.1" 200 None 2026-05-04 05:21:21,755 - lava_callback - DEBUG - Processing node 69f589cced4ed40b0224251f: baseline-arm64-baylibre 2026-05-04 05:21:21,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f589cced4ed40b0224251f 2026-05-04 05:21:21,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:21:21,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f589cced4ed40b0224251f HTTP/1.1" 200 None 2026-05-04 05:21:21,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:21:21,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-04 05:21:21,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:21:21,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f589cced4ed40b0224251f HTTP/1.1" 200 None 2026-05-04 05:21:21,800 - lava_callback - ERROR - Error processing callback for node 69f589cced4ed40b0224251f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41924 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:52:38,156 - lava_callback - INFO - Received callback for node 69f59110ed4ed40b0224265a INFO: 172.20.0.1:41928 - "POST /node/69f59110ed4ed40b0224265a HTTP/1.0" 202 Accepted 2026-05-04 05:52:38,161 - lava_callback - INFO - Starting async job submit for node 69f59110ed4ed40b0224265a 2026-05-04 05:52:38,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:52:38,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59110ed4ed40b0224265a HTTP/1.1" 200 None 2026-05-04 05:52:38,178 - lava_callback - DEBUG - Processing node 69f59110ed4ed40b0224265a: baseline-arm-clabbe 2026-05-04 05:52:38,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59110ed4ed40b0224265a 2026-05-04 05:52:38,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:52:38,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59110ed4ed40b0224265a HTTP/1.1" 200 None 2026-05-04 05:52:38,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:52:38,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-04 05:52:38,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:52:38,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59110ed4ed40b0224265a HTTP/1.1" 200 None 2026-05-04 05:52:38,225 - lava_callback - ERROR - Error processing callback for node 69f59110ed4ed40b0224265a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45442 - "GET /node/69e97cc58137cb226ce1ff57%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41956 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:54:18,239 - lava_callback - INFO - Received callback for node 69f5917ded4ed40b02242682 INFO: 172.20.0.1:41964 - "POST /node/69f5917ded4ed40b02242682 HTTP/1.0" 202 Accepted 2026-05-04 05:54:18,244 - lava_callback - INFO - Starting async job submit for node 69f5917ded4ed40b02242682 2026-05-04 05:54:18,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:54:18,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5917ded4ed40b02242682 HTTP/1.1" 200 None 2026-05-04 05:54:18,260 - lava_callback - DEBUG - Processing node 69f5917ded4ed40b02242682: baseline-arm-clabbe 2026-05-04 05:54:18,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5917ded4ed40b02242682 2026-05-04 05:54:18,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:54:18,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5917ded4ed40b02242682 HTTP/1.1" 200 None 2026-05-04 05:54:18,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:54:18,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-04 05:54:18,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:54:18,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5917ded4ed40b02242682 HTTP/1.1" 200 None 2026-05-04 05:54:18,305 - lava_callback - ERROR - Error processing callback for node 69f5917ded4ed40b02242682: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44356 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:54:58,219 - lava_callback - INFO - Received callback for node 69f591a1ed4ed40b02242691 INFO: 172.20.0.1:44368 - "POST /node/69f591a1ed4ed40b02242691 HTTP/1.0" 202 Accepted 2026-05-04 05:54:58,224 - lava_callback - INFO - Starting async job submit for node 69f591a1ed4ed40b02242691 2026-05-04 05:54:58,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:54:58,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f591a1ed4ed40b02242691 HTTP/1.1" 200 None 2026-05-04 05:54:58,240 - lava_callback - DEBUG - Processing node 69f591a1ed4ed40b02242691: baseline-arm-clabbe 2026-05-04 05:54:58,240 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f591a1ed4ed40b02242691 2026-05-04 05:54:58,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:54:58,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f591a1ed4ed40b02242691 HTTP/1.1" 200 None 2026-05-04 05:54:58,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:54:58,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-04 05:54:58,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:54:58,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f591a1ed4ed40b02242691 HTTP/1.1" 200 None 2026-05-04 05:54:58,288 - lava_callback - ERROR - Error processing callback for node 69f591a1ed4ed40b02242691: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55204 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:55:38,430 - lava_callback - INFO - Received callback for node 69f591c4ed4ed40b022426a2 INFO: 172.20.0.1:55212 - "POST /node/69f591c4ed4ed40b022426a2 HTTP/1.0" 202 Accepted 2026-05-04 05:55:38,436 - lava_callback - INFO - Starting async job submit for node 69f591c4ed4ed40b022426a2 2026-05-04 05:55:38,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:55:38,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f591c4ed4ed40b022426a2 HTTP/1.1" 200 None 2026-05-04 05:55:38,451 - lava_callback - DEBUG - Processing node 69f591c4ed4ed40b022426a2: baseline-arm-clabbe 2026-05-04 05:55:38,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f591c4ed4ed40b022426a2 2026-05-04 05:55:38,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:55:38,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f591c4ed4ed40b022426a2 HTTP/1.1" 200 None 2026-05-04 05:55:38,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:55:38,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-04 05:55:38,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:55:38,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f591c4ed4ed40b022426a2 HTTP/1.1" 200 None 2026-05-04 05:55:38,498 - lava_callback - ERROR - Error processing callback for node 69f591c4ed4ed40b022426a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60010 - "GET / HTTP/1.0" 200 OK 2026-05-04 05:57:18,343 - lava_callback - INFO - Received callback for node 69f59231ed4ed40b022426cc INFO: 172.20.0.1:60024 - "POST /node/69f59231ed4ed40b022426cc HTTP/1.0" 202 Accepted 2026-05-04 05:57:18,348 - lava_callback - INFO - Starting async job submit for node 69f59231ed4ed40b022426cc 2026-05-04 05:57:18,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:57:18,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59231ed4ed40b022426cc HTTP/1.1" 200 None 2026-05-04 05:57:18,364 - lava_callback - DEBUG - Processing node 69f59231ed4ed40b022426cc: baseline-arm-clabbe 2026-05-04 05:57:18,364 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59231ed4ed40b022426cc 2026-05-04 05:57:18,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:57:18,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59231ed4ed40b022426cc HTTP/1.1" 200 None 2026-05-04 05:57:18,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:57:18,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-04 05:57:18,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 05:57:18,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59231ed4ed40b022426cc HTTP/1.1" 200 None 2026-05-04 05:57:18,410 - lava_callback - ERROR - Error processing callback for node 69f59231ed4ed40b022426cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36402 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:05:44,364 - lava_callback - INFO - Received callback for node 69f59423ed4ed40b02242701 INFO: 172.20.0.1:46098 - "POST /node/69f59423ed4ed40b02242701 HTTP/1.0" 202 Accepted 2026-05-04 06:05:44,369 - lava_callback - INFO - Starting async job submit for node 69f59423ed4ed40b02242701 2026-05-04 06:05:44,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:05:44,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59423ed4ed40b02242701 HTTP/1.1" 200 None 2026-05-04 06:05:44,387 - lava_callback - DEBUG - Processing node 69f59423ed4ed40b02242701: baseline-arm64-baylibre 2026-05-04 06:05:44,387 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59423ed4ed40b02242701 2026-05-04 06:05:44,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:05:44,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59423ed4ed40b02242701 HTTP/1.1" 200 None 2026-05-04 06:05:44,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:05:44,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 06:05:44,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:05:44,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59423ed4ed40b02242701 HTTP/1.1" 200 None 2026-05-04 06:05:44,433 - lava_callback - ERROR - Error processing callback for node 69f59423ed4ed40b02242701: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50612 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:07:44,476 - lava_callback - INFO - Received callback for node 69f5949bed4ed40b02242725 INFO: 172.20.0.1:54156 - "POST /node/69f5949bed4ed40b02242725 HTTP/1.0" 202 Accepted 2026-05-04 06:07:44,482 - lava_callback - INFO - Starting async job submit for node 69f5949bed4ed40b02242725 2026-05-04 06:07:44,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:07:44,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5949bed4ed40b02242725 HTTP/1.1" 200 None 2026-05-04 06:07:44,496 - lava_callback - DEBUG - Processing node 69f5949bed4ed40b02242725: baseline-arm64-baylibre 2026-05-04 06:07:44,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5949bed4ed40b02242725 2026-05-04 06:07:44,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:07:44,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5949bed4ed40b02242725 HTTP/1.1" 200 None 2026-05-04 06:07:44,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:07:44,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 06:07:44,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:07:44,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5949bed4ed40b02242725 HTTP/1.1" 200 None 2026-05-04 06:07:44,540 - lava_callback - ERROR - Error processing callback for node 69f5949bed4ed40b02242725: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55034 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:09:44,395 - lava_callback - INFO - Received callback for node 69f59513ed4ed40b0224274a INFO: 172.20.0.1:37430 - "POST /node/69f59513ed4ed40b0224274a HTTP/1.0" 202 Accepted 2026-05-04 06:09:44,401 - lava_callback - INFO - Starting async job submit for node 69f59513ed4ed40b0224274a 2026-05-04 06:09:44,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:09:44,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59513ed4ed40b0224274a HTTP/1.1" 200 None 2026-05-04 06:09:44,416 - lava_callback - DEBUG - Processing node 69f59513ed4ed40b0224274a: baseline-arm64-baylibre 2026-05-04 06:09:44,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59513ed4ed40b0224274a 2026-05-04 06:09:44,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:09:44,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59513ed4ed40b0224274a HTTP/1.1" 200 None 2026-05-04 06:09:44,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:09:44,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 06:09:44,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:09:44,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59513ed4ed40b0224274a HTTP/1.1" 200 None 2026-05-04 06:09:44,461 - lava_callback - ERROR - Error processing callback for node 69f59513ed4ed40b0224274a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55708 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:13:44,627 - lava_callback - INFO - Received callback for node 69f59605ed4ed40b02242773 INFO: 172.20.0.1:35966 - "POST /node/69f59605ed4ed40b02242773 HTTP/1.0" 202 Accepted 2026-05-04 06:13:44,633 - lava_callback - INFO - Starting async job submit for node 69f59605ed4ed40b02242773 2026-05-04 06:13:44,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:13:44,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59605ed4ed40b02242773 HTTP/1.1" 200 None 2026-05-04 06:13:44,655 - lava_callback - DEBUG - Processing node 69f59605ed4ed40b02242773: baseline-arm64-baylibre 2026-05-04 06:13:44,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59605ed4ed40b02242773 2026-05-04 06:13:44,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:13:44,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59605ed4ed40b02242773 HTTP/1.1" 200 None 2026-05-04 06:13:44,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:13:44,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 06:13:44,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:13:44,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59605ed4ed40b02242773 HTTP/1.1" 200 None 2026-05-04 06:13:44,717 - lava_callback - ERROR - Error processing callback for node 69f59605ed4ed40b02242773: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54790 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:14:44,596 - lava_callback - INFO - Received callback for node 69f59650ed4ed40b02242792 INFO: 172.20.0.1:44008 - "POST /node/69f59650ed4ed40b02242792 HTTP/1.0" 202 Accepted 2026-05-04 06:14:44,602 - lava_callback - INFO - Starting async job submit for node 69f59650ed4ed40b02242792 2026-05-04 06:14:44,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:14:44,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59650ed4ed40b02242792 HTTP/1.1" 200 None 2026-05-04 06:14:44,617 - lava_callback - DEBUG - Processing node 69f59650ed4ed40b02242792: baseline-arm64-baylibre 2026-05-04 06:14:44,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59650ed4ed40b02242792 2026-05-04 06:14:44,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:14:44,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59650ed4ed40b02242792 HTTP/1.1" 200 None 2026-05-04 06:14:44,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:14:44,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 06:14:44,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:14:44,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59650ed4ed40b02242792 HTTP/1.1" 200 None 2026-05-04 06:14:44,662 - lava_callback - ERROR - Error processing callback for node 69f59650ed4ed40b02242792: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43910 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:18:44,927 - lava_callback - INFO - Received callback for node 69f59732ed4ed40b022427bd INFO: 172.20.0.1:38028 - "POST /node/69f59732ed4ed40b022427bd HTTP/1.0" 202 Accepted 2026-05-04 06:18:44,932 - lava_callback - INFO - Starting async job submit for node 69f59732ed4ed40b022427bd 2026-05-04 06:18:44,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:18:44,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59732ed4ed40b022427bd HTTP/1.1" 200 None 2026-05-04 06:18:44,947 - lava_callback - DEBUG - Processing node 69f59732ed4ed40b022427bd: baseline-arm64-baylibre 2026-05-04 06:18:44,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59732ed4ed40b022427bd 2026-05-04 06:18:44,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:18:44,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59732ed4ed40b022427bd HTTP/1.1" 200 None 2026-05-04 06:18:44,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:18:44,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 06:18:44,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:18:44,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59732ed4ed40b022427bd HTTP/1.1" 200 None 2026-05-04 06:18:44,992 - lava_callback - ERROR - Error processing callback for node 69f59732ed4ed40b022427bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41848 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:50:46,714 - lava_callback - INFO - Received callback for node 69f59eb5ed4ed40b0224287d INFO: 172.20.0.1:41860 - "POST /node/69f59eb5ed4ed40b0224287d HTTP/1.0" 202 Accepted 2026-05-04 06:50:46,720 - lava_callback - INFO - Starting async job submit for node 69f59eb5ed4ed40b0224287d 2026-05-04 06:50:46,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:50:46,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59eb5ed4ed40b0224287d HTTP/1.1" 200 None 2026-05-04 06:50:46,754 - lava_callback - DEBUG - Processing node 69f59eb5ed4ed40b0224287d: baseline-arm-baylibre 2026-05-04 06:50:46,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59eb5ed4ed40b0224287d 2026-05-04 06:50:46,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:50:46,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59eb5ed4ed40b0224287d HTTP/1.1" 200 None 2026-05-04 06:50:46,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:50:46,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 06:50:46,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:50:46,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59eb5ed4ed40b0224287d HTTP/1.1" 200 None 2026-05-04 06:50:46,824 - lava_callback - ERROR - Error processing callback for node 69f59eb5ed4ed40b0224287d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54168 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:51:26,595 - lava_callback - INFO - Received callback for node 69f59ed9ed4ed40b0224288a INFO: 172.20.0.1:54176 - "POST /node/69f59ed9ed4ed40b0224288a HTTP/1.0" 202 Accepted 2026-05-04 06:51:26,600 - lava_callback - INFO - Starting async job submit for node 69f59ed9ed4ed40b0224288a 2026-05-04 06:51:26,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:51:26,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59ed9ed4ed40b0224288a HTTP/1.1" 200 None 2026-05-04 06:51:26,615 - lava_callback - DEBUG - Processing node 69f59ed9ed4ed40b0224288a: baseline-arm-baylibre 2026-05-04 06:51:26,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59ed9ed4ed40b0224288a 2026-05-04 06:51:26,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:51:26,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59ed9ed4ed40b0224288a HTTP/1.1" 200 None 2026-05-04 06:51:26,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:51:26,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 06:51:26,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:51:26,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59ed9ed4ed40b0224288a HTTP/1.1" 200 None 2026-05-04 06:51:26,660 - lava_callback - ERROR - Error processing callback for node 69f59ed9ed4ed40b0224288a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51024 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:51:46,645 - lava_callback - INFO - Received callback for node 69f59efded4ed40b02242896 INFO: 172.20.0.1:51036 - "POST /node/69f59efded4ed40b02242896 HTTP/1.0" 202 Accepted 2026-05-04 06:51:46,651 - lava_callback - INFO - Starting async job submit for node 69f59efded4ed40b02242896 2026-05-04 06:51:46,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:51:46,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59efded4ed40b02242896 HTTP/1.1" 200 None 2026-05-04 06:51:46,702 - lava_callback - DEBUG - Processing node 69f59efded4ed40b02242896: baseline-arm-baylibre 2026-05-04 06:51:46,702 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59efded4ed40b02242896 2026-05-04 06:51:46,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:51:46,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59efded4ed40b02242896 HTTP/1.1" 200 None 2026-05-04 06:51:46,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:51:46,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 06:51:46,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:51:46,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59efded4ed40b02242896 HTTP/1.1" 200 None 2026-05-04 06:51:46,750 - lava_callback - ERROR - Error processing callback for node 69f59efded4ed40b02242896: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49700 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:52:26,738 - lava_callback - INFO - Received callback for node 69f59f20ed4ed40b022428a2 INFO: 172.20.0.1:49714 - "POST /node/69f59f20ed4ed40b022428a2 HTTP/1.0" 202 Accepted 2026-05-04 06:52:26,744 - lava_callback - INFO - Starting async job submit for node 69f59f20ed4ed40b022428a2 2026-05-04 06:52:26,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:52:26,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59f20ed4ed40b022428a2 HTTP/1.1" 200 None 2026-05-04 06:52:26,759 - lava_callback - DEBUG - Processing node 69f59f20ed4ed40b022428a2: baseline-arm-baylibre 2026-05-04 06:52:26,760 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59f20ed4ed40b022428a2 2026-05-04 06:52:26,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:52:26,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59f20ed4ed40b022428a2 HTTP/1.1" 200 None 2026-05-04 06:52:26,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:52:26,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 06:52:26,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:52:26,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59f20ed4ed40b022428a2 HTTP/1.1" 200 None 2026-05-04 06:52:26,805 - lava_callback - ERROR - Error processing callback for node 69f59f20ed4ed40b022428a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43664 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:54:20,708 - lava_callback - INFO - Received callback for node 69f59f8aed4ed40b022428c6 INFO: 172.20.0.1:43820 - "POST /node/69f59f8aed4ed40b022428c6 HTTP/1.0" 202 Accepted 2026-05-04 06:54:20,714 - lava_callback - INFO - Starting async job submit for node 69f59f8aed4ed40b022428c6 2026-05-04 06:54:20,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:54:20,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59f8aed4ed40b022428c6 HTTP/1.1" 200 None 2026-05-04 06:54:20,734 - lava_callback - DEBUG - Processing node 69f59f8aed4ed40b022428c6: baseline-arm-clabbe 2026-05-04 06:54:20,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59f8aed4ed40b022428c6 2026-05-04 06:54:20,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:54:20,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59f8aed4ed40b022428c6 HTTP/1.1" 200 None 2026-05-04 06:54:20,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:54:20,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 06:54:20,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:54:20,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59f8aed4ed40b022428c6 HTTP/1.1" 200 None 2026-05-04 06:54:20,783 - lava_callback - ERROR - Error processing callback for node 69f59f8aed4ed40b022428c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55442 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:56:00,767 - lava_callback - INFO - Received callback for node 69f59ff6ed4ed40b022428ec INFO: 172.20.0.1:56672 - "POST /node/69f59ff6ed4ed40b022428ec HTTP/1.0" 202 Accepted 2026-05-04 06:56:00,773 - lava_callback - INFO - Starting async job submit for node 69f59ff6ed4ed40b022428ec 2026-05-04 06:56:00,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:56:00,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59ff6ed4ed40b022428ec HTTP/1.1" 200 None 2026-05-04 06:56:00,788 - lava_callback - DEBUG - Processing node 69f59ff6ed4ed40b022428ec: baseline-arm-clabbe 2026-05-04 06:56:00,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f59ff6ed4ed40b022428ec 2026-05-04 06:56:00,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:56:00,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f59ff6ed4ed40b022428ec HTTP/1.1" 200 None 2026-05-04 06:56:00,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:56:00,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 06:56:00,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:56:00,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f59ff6ed4ed40b022428ec HTTP/1.1" 200 None 2026-05-04 06:56:00,833 - lava_callback - ERROR - Error processing callback for node 69f59ff6ed4ed40b022428ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49382 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:56:40,721 - lava_callback - INFO - Received callback for node 69f5a01ced4ed40b022428f9 INFO: 172.20.0.1:53198 - "POST /node/69f5a01ced4ed40b022428f9 HTTP/1.0" 202 Accepted 2026-05-04 06:56:40,726 - lava_callback - INFO - Starting async job submit for node 69f5a01ced4ed40b022428f9 2026-05-04 06:56:40,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:56:40,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a01ced4ed40b022428f9 HTTP/1.1" 200 None 2026-05-04 06:56:40,744 - lava_callback - DEBUG - Processing node 69f5a01ced4ed40b022428f9: baseline-arm-clabbe 2026-05-04 06:56:40,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a01ced4ed40b022428f9 2026-05-04 06:56:40,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:56:40,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a01ced4ed40b022428f9 HTTP/1.1" 200 None 2026-05-04 06:56:40,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:56:40,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 06:56:40,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:56:40,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a01ced4ed40b022428f9 HTTP/1.1" 200 None 2026-05-04 06:56:40,799 - lava_callback - ERROR - Error processing callback for node 69f5a01ced4ed40b022428f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59690 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:57:20,841 - lava_callback - INFO - Received callback for node 69f5a040ed4ed40b02242903 INFO: 172.20.0.1:56094 - "POST /node/69f5a040ed4ed40b02242903 HTTP/1.0" 202 Accepted 2026-05-04 06:57:20,847 - lava_callback - INFO - Starting async job submit for node 69f5a040ed4ed40b02242903 2026-05-04 06:57:20,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:57:20,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a040ed4ed40b02242903 HTTP/1.1" 200 None 2026-05-04 06:57:20,885 - lava_callback - DEBUG - Processing node 69f5a040ed4ed40b02242903: baseline-arm-clabbe 2026-05-04 06:57:20,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a040ed4ed40b02242903 2026-05-04 06:57:20,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:57:20,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a040ed4ed40b02242903 HTTP/1.1" 200 None 2026-05-04 06:57:20,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:57:20,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 06:57:20,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:57:20,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a040ed4ed40b02242903 HTTP/1.1" 200 None 2026-05-04 06:57:20,965 - lava_callback - ERROR - Error processing callback for node 69f5a040ed4ed40b02242903: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44710 - "GET / HTTP/1.0" 200 OK 2026-05-04 06:59:00,848 - lava_callback - INFO - Received callback for node 69f5a0aded4ed40b0224295d INFO: 172.20.0.1:45220 - "POST /node/69f5a0aded4ed40b0224295d HTTP/1.0" 202 Accepted 2026-05-04 06:59:00,853 - lava_callback - INFO - Starting async job submit for node 69f5a0aded4ed40b0224295d 2026-05-04 06:59:00,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:59:00,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a0aded4ed40b0224295d HTTP/1.1" 200 None 2026-05-04 06:59:00,879 - lava_callback - DEBUG - Processing node 69f5a0aded4ed40b0224295d: baseline-arm-clabbe 2026-05-04 06:59:00,879 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a0aded4ed40b0224295d 2026-05-04 06:59:00,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:59:00,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a0aded4ed40b0224295d HTTP/1.1" 200 None 2026-05-04 06:59:00,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:59:00,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 06:59:00,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 06:59:00,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a0aded4ed40b0224295d HTTP/1.1" 200 None 2026-05-04 06:59:00,924 - lava_callback - ERROR - Error processing callback for node 69f5a0aded4ed40b0224295d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53830 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:05:47,625 - lava_callback - INFO - Received callback for node 69f5a240ed4ed40b022429f5 INFO: 172.20.0.1:53834 - "POST /node/69f5a240ed4ed40b022429f5 HTTP/1.0" 202 Accepted 2026-05-04 07:05:47,630 - lava_callback - INFO - Starting async job submit for node 69f5a240ed4ed40b022429f5 2026-05-04 07:05:47,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:05:47,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a240ed4ed40b022429f5 HTTP/1.1" 200 None 2026-05-04 07:05:47,698 - lava_callback - DEBUG - Processing node 69f5a240ed4ed40b022429f5: baseline-arm64-baylibre 2026-05-04 07:05:47,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a240ed4ed40b022429f5 2026-05-04 07:05:47,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:05:47,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a240ed4ed40b022429f5 HTTP/1.1" 200 None 2026-05-04 07:05:47,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:05:47,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 07:05:47,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:05:47,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a240ed4ed40b022429f5 HTTP/1.1" 200 None 2026-05-04 07:05:47,796 - lava_callback - ERROR - Error processing callback for node 69f5a240ed4ed40b022429f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52390 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:07:07,458 - lava_callback - INFO - Received callback for node 69f5a289ed4ed40b02242a11 INFO: 172.20.0.1:52406 - "POST /node/69f5a289ed4ed40b02242a11 HTTP/1.0" 202 Accepted 2026-05-04 07:07:07,468 - lava_callback - INFO - Starting async job submit for node 69f5a289ed4ed40b02242a11 2026-05-04 07:07:07,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:07:07,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a289ed4ed40b02242a11 HTTP/1.1" 200 None 2026-05-04 07:07:07,484 - lava_callback - DEBUG - Processing node 69f5a289ed4ed40b02242a11: baseline-arm64-baylibre 2026-05-04 07:07:07,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a289ed4ed40b02242a11 2026-05-04 07:07:07,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:07:07,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a289ed4ed40b02242a11 HTTP/1.1" 200 None 2026-05-04 07:07:07,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:07:07,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 07:07:07,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:07:07,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a289ed4ed40b02242a11 HTTP/1.1" 200 None 2026-05-04 07:07:07,543 - lava_callback - ERROR - Error processing callback for node 69f5a289ed4ed40b02242a11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56410 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:08:07,501 - lava_callback - INFO - Received callback for node 69f5a2d2ed4ed40b02242a35 INFO: 172.20.0.1:56424 - "POST /node/69f5a2d2ed4ed40b02242a35 HTTP/1.0" 202 Accepted 2026-05-04 07:08:07,506 - lava_callback - INFO - Starting async job submit for node 69f5a2d2ed4ed40b02242a35 2026-05-04 07:08:07,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:08:07,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a2d2ed4ed40b02242a35 HTTP/1.1" 200 None 2026-05-04 07:08:07,522 - lava_callback - DEBUG - Processing node 69f5a2d2ed4ed40b02242a35: baseline-arm64-baylibre 2026-05-04 07:08:07,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a2d2ed4ed40b02242a35 2026-05-04 07:08:07,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:08:07,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a2d2ed4ed40b02242a35 HTTP/1.1" 200 None 2026-05-04 07:08:07,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:08:07,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 07:08:07,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:08:07,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a2d2ed4ed40b02242a35 HTTP/1.1" 200 None 2026-05-04 07:08:07,568 - lava_callback - ERROR - Error processing callback for node 69f5a2d2ed4ed40b02242a35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59446 - "GET /node/69f38df22fa6ff8e8ca90a66%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54600 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:09:27,650 - lava_callback - INFO - Received callback for node 69f5a31eed4ed40b02242a53 INFO: 172.20.0.1:54608 - "POST /node/69f5a31eed4ed40b02242a53 HTTP/1.0" 202 Accepted 2026-05-04 07:09:27,656 - lava_callback - INFO - Starting async job submit for node 69f5a31eed4ed40b02242a53 2026-05-04 07:09:27,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:09:27,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a31eed4ed40b02242a53 HTTP/1.1" 200 None 2026-05-04 07:09:27,672 - lava_callback - DEBUG - Processing node 69f5a31eed4ed40b02242a53: baseline-arm64-baylibre 2026-05-04 07:09:27,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a31eed4ed40b02242a53 2026-05-04 07:09:27,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:09:27,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a31eed4ed40b02242a53 HTTP/1.1" 200 None 2026-05-04 07:09:27,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:09:27,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 07:09:27,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:09:27,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a31eed4ed40b02242a53 HTTP/1.1" 200 None 2026-05-04 07:09:27,722 - lava_callback - ERROR - Error processing callback for node 69f5a31eed4ed40b02242a53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57566 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:10:47,700 - lava_callback - INFO - Received callback for node 69f5a369ed4ed40b02242a75 INFO: 172.20.0.1:57576 - "POST /node/69f5a369ed4ed40b02242a75 HTTP/1.0" 202 Accepted 2026-05-04 07:10:47,705 - lava_callback - INFO - Starting async job submit for node 69f5a369ed4ed40b02242a75 2026-05-04 07:10:47,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:10:47,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a369ed4ed40b02242a75 HTTP/1.1" 200 None 2026-05-04 07:10:47,722 - lava_callback - DEBUG - Processing node 69f5a369ed4ed40b02242a75: baseline-arm64-baylibre 2026-05-04 07:10:47,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a369ed4ed40b02242a75 2026-05-04 07:10:47,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:10:47,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a369ed4ed40b02242a75 HTTP/1.1" 200 None 2026-05-04 07:10:47,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:10:47,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 07:10:47,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:10:47,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a369ed4ed40b02242a75 HTTP/1.1" 200 None 2026-05-04 07:10:47,773 - lava_callback - ERROR - Error processing callback for node 69f5a369ed4ed40b02242a75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39162 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:12:07,722 - lava_callback - INFO - Received callback for node 69f5a3b2ed4ed40b02242a94 INFO: 172.20.0.1:39164 - "POST /node/69f5a3b2ed4ed40b02242a94 HTTP/1.0" 202 Accepted 2026-05-04 07:12:07,729 - lava_callback - INFO - Starting async job submit for node 69f5a3b2ed4ed40b02242a94 2026-05-04 07:12:07,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:12:07,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a3b2ed4ed40b02242a94 HTTP/1.1" 200 None 2026-05-04 07:12:07,747 - lava_callback - DEBUG - Processing node 69f5a3b2ed4ed40b02242a94: baseline-arm64-baylibre 2026-05-04 07:12:07,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a3b2ed4ed40b02242a94 2026-05-04 07:12:07,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:12:07,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a3b2ed4ed40b02242a94 HTTP/1.1" 200 None 2026-05-04 07:12:07,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:12:07,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 07:12:07,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:12:07,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a3b2ed4ed40b02242a94 HTTP/1.1" 200 None 2026-05-04 07:12:07,793 - lava_callback - ERROR - Error processing callback for node 69f5a3b2ed4ed40b02242a94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34434 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:13:21,506 - lava_callback - INFO - Received callback for node 69f5a403ed4ed40b02242ab5 INFO: 172.20.0.1:40252 - "POST /node/69f5a403ed4ed40b02242ab5 HTTP/1.0" 202 Accepted 2026-05-04 07:13:21,512 - lava_callback - INFO - Starting async job submit for node 69f5a403ed4ed40b02242ab5 2026-05-04 07:13:21,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:13:21,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a403ed4ed40b02242ab5 HTTP/1.1" 200 None 2026-05-04 07:13:21,528 - lava_callback - DEBUG - Processing node 69f5a403ed4ed40b02242ab5: baseline-arm64-clabbe 2026-05-04 07:13:21,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a403ed4ed40b02242ab5 2026-05-04 07:13:21,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:13:21,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a403ed4ed40b02242ab5 HTTP/1.1" 200 None 2026-05-04 07:13:21,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:13:21,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 07:13:21,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:13:21,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a403ed4ed40b02242ab5 HTTP/1.1" 200 None 2026-05-04 07:13:21,591 - lava_callback - ERROR - Error processing callback for node 69f5a403ed4ed40b02242ab5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48026 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:14:41,561 - lava_callback - INFO - Received callback for node 69f5a44eed4ed40b02242ad5 INFO: 172.20.0.1:50168 - "POST /node/69f5a44eed4ed40b02242ad5 HTTP/1.0" 202 Accepted 2026-05-04 07:14:41,567 - lava_callback - INFO - Starting async job submit for node 69f5a44eed4ed40b02242ad5 2026-05-04 07:14:41,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:14:41,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a44eed4ed40b02242ad5 HTTP/1.1" 200 None 2026-05-04 07:14:41,595 - lava_callback - DEBUG - Processing node 69f5a44eed4ed40b02242ad5: baseline-arm64-clabbe 2026-05-04 07:14:41,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a44eed4ed40b02242ad5 2026-05-04 07:14:41,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:14:41,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a44eed4ed40b02242ad5 HTTP/1.1" 200 None 2026-05-04 07:14:41,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:14:41,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 07:14:41,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:14:41,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a44eed4ed40b02242ad5 HTTP/1.1" 200 None 2026-05-04 07:14:41,643 - lava_callback - ERROR - Error processing callback for node 69f5a44eed4ed40b02242ad5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34586 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:15:41,701 - lava_callback - INFO - Received callback for node 69f5a498ed4ed40b02242af7 INFO: 172.20.0.1:52176 - "POST /node/69f5a498ed4ed40b02242af7 HTTP/1.0" 202 Accepted 2026-05-04 07:15:41,707 - lava_callback - INFO - Starting async job submit for node 69f5a498ed4ed40b02242af7 2026-05-04 07:15:41,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:15:41,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a498ed4ed40b02242af7 HTTP/1.1" 200 None 2026-05-04 07:15:41,741 - lava_callback - DEBUG - Processing node 69f5a498ed4ed40b02242af7: baseline-arm64-clabbe 2026-05-04 07:15:41,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a498ed4ed40b02242af7 2026-05-04 07:15:41,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:15:41,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a498ed4ed40b02242af7 HTTP/1.1" 200 None 2026-05-04 07:15:41,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:15:41,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 07:15:41,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:15:41,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a498ed4ed40b02242af7 HTTP/1.1" 200 None 2026-05-04 07:15:41,800 - lava_callback - ERROR - Error processing callback for node 69f5a498ed4ed40b02242af7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43508 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:17:01,719 - lava_callback - INFO - Received callback for node 69f5a4e2ed4ed40b02242b13 INFO: 172.20.0.1:57270 - "POST /node/69f5a4e2ed4ed40b02242b13 HTTP/1.0" 202 Accepted 2026-05-04 07:17:01,725 - lava_callback - INFO - Starting async job submit for node 69f5a4e2ed4ed40b02242b13 2026-05-04 07:17:01,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:17:01,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a4e2ed4ed40b02242b13 HTTP/1.1" 200 None 2026-05-04 07:17:01,741 - lava_callback - DEBUG - Processing node 69f5a4e2ed4ed40b02242b13: baseline-arm64-clabbe 2026-05-04 07:17:01,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a4e2ed4ed40b02242b13 2026-05-04 07:17:01,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:17:01,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a4e2ed4ed40b02242b13 HTTP/1.1" 200 None 2026-05-04 07:17:01,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:17:01,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 07:17:01,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:17:01,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a4e2ed4ed40b02242b13 HTTP/1.1" 200 None 2026-05-04 07:17:01,791 - lava_callback - ERROR - Error processing callback for node 69f5a4e2ed4ed40b02242b13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58640 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:19:41,785 - lava_callback - INFO - Received callback for node 69f5a578ed4ed40b02242b54 INFO: 172.20.0.1:37050 - "POST /node/69f5a578ed4ed40b02242b54 HTTP/1.0" 202 Accepted 2026-05-04 07:19:41,790 - lava_callback - INFO - Starting async job submit for node 69f5a578ed4ed40b02242b54 2026-05-04 07:19:41,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:19:41,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a578ed4ed40b02242b54 HTTP/1.1" 200 None 2026-05-04 07:19:41,805 - lava_callback - DEBUG - Processing node 69f5a578ed4ed40b02242b54: baseline-arm64-clabbe 2026-05-04 07:19:41,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a578ed4ed40b02242b54 2026-05-04 07:19:41,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:19:41,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a578ed4ed40b02242b54 HTTP/1.1" 200 None 2026-05-04 07:19:41,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:19:41,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 07:19:41,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:19:41,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a578ed4ed40b02242b54 HTTP/1.1" 200 None 2026-05-04 07:19:41,850 - lava_callback - ERROR - Error processing callback for node 69f5a578ed4ed40b02242b54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44236 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:20:41,825 - lava_callback - INFO - Received callback for node 69f5a5c6ed4ed40b02242b78 INFO: 172.20.0.1:42446 - "POST /node/69f5a5c6ed4ed40b02242b78 HTTP/1.0" 202 Accepted 2026-05-04 07:20:41,833 - lava_callback - INFO - Starting async job submit for node 69f5a5c6ed4ed40b02242b78 2026-05-04 07:20:41,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:20:41,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a5c6ed4ed40b02242b78 HTTP/1.1" 200 None 2026-05-04 07:20:41,856 - lava_callback - DEBUG - Processing node 69f5a5c6ed4ed40b02242b78: baseline-arm64-clabbe 2026-05-04 07:20:41,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a5c6ed4ed40b02242b78 2026-05-04 07:20:41,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:20:41,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a5c6ed4ed40b02242b78 HTTP/1.1" 200 None 2026-05-04 07:20:41,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:20:41,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 07:20:41,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:20:41,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a5c6ed4ed40b02242b78 HTTP/1.1" 200 None 2026-05-04 07:20:41,909 - lava_callback - ERROR - Error processing callback for node 69f5a5c6ed4ed40b02242b78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40954 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:27:48,732 - lava_callback - INFO - Received callback for node 69f5a766ed4ed40b02242ba2 INFO: 172.20.0.1:40956 - "POST /node/69f5a766ed4ed40b02242ba2 HTTP/1.0" 202 Accepted 2026-05-04 07:27:48,737 - lava_callback - INFO - Starting async job submit for node 69f5a766ed4ed40b02242ba2 2026-05-04 07:27:48,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:27:48,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a766ed4ed40b02242ba2 HTTP/1.1" 200 None 2026-05-04 07:27:48,759 - lava_callback - DEBUG - Processing node 69f5a766ed4ed40b02242ba2: baseline-arm64-baylibre 2026-05-04 07:27:48,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a766ed4ed40b02242ba2 2026-05-04 07:27:48,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:27:48,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a766ed4ed40b02242ba2 HTTP/1.1" 200 None 2026-05-04 07:27:48,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:27:48,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 07:27:48,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:27:48,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a766ed4ed40b02242ba2 HTTP/1.1" 200 None 2026-05-04 07:27:48,807 - lava_callback - ERROR - Error processing callback for node 69f5a766ed4ed40b02242ba2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60452 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:28:58,028 - lava_callback - INFO - Received callback for node 69f7fd5c559eef1735ba8ba3 INFO: 172.20.0.1:60462 - "POST /node/69f7fd5c559eef1735ba8ba3 HTTP/1.0" 202 Accepted 2026-05-04 07:28:58,038 - lava_callback - INFO - Starting async job submit for node 69f7fd5c559eef1735ba8ba3 2026-05-04 07:28:58,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:28:58,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fd5c559eef1735ba8ba3 HTTP/1.1" 200 None 2026-05-04 07:28:58,075 - lava_callback - DEBUG - Processing node 69f7fd5c559eef1735ba8ba3: baseline-arm64-clabbe 2026-05-04 07:28:58,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 07:28:58,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 07:28:58,421 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69f7fd5c559eef1735ba8ba3/log.txt.gz 2026-05-04 07:28:58,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 07:28:58,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 07:28:58,706 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69f7fd5c559eef1735ba8ba3/lava-logs.yaml 2026-05-04 07:28:58,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 07:28:58,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 07:28:58,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69f7fd5c559eef1735ba8ba3/lava_callback.json.gz 2026-05-04 07:28:58,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:28:58,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7fd5c559eef1735ba8ba3 HTTP/1.1" 200 None 2026-05-04 07:28:58,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:28:58,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-04 07:28:58,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:28:58,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7fd5c559eef1735ba8ba3 HTTP/1.1" 200 None 2026-05-04 07:28:58,889 - lava_callback - INFO - Completed processing callback for node 69f7fd5c559eef1735ba8ba3 INFO: 172.20.0.1:54350 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:29:06,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:29:06,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34048 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:30:02,323 - lava_callback - INFO - Received callback for node 69f5a7e3ed4ed40b02242bc4 INFO: 172.20.0.1:46018 - "POST /node/69f5a7e3ed4ed40b02242bc4 HTTP/1.0" 202 Accepted 2026-05-04 07:30:02,329 - lava_callback - INFO - Starting async job submit for node 69f5a7e3ed4ed40b02242bc4 2026-05-04 07:30:02,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:30:02,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a7e3ed4ed40b02242bc4 HTTP/1.1" 200 None 2026-05-04 07:30:02,347 - lava_callback - DEBUG - Processing node 69f5a7e3ed4ed40b02242bc4: baseline-arm64-clabbe 2026-05-04 07:30:02,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a7e3ed4ed40b02242bc4 2026-05-04 07:30:02,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:30:02,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a7e3ed4ed40b02242bc4 HTTP/1.1" 200 None 2026-05-04 07:30:02,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:30:02,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 07:30:02,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:30:02,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a7e3ed4ed40b02242bc4 HTTP/1.1" 200 None 2026-05-04 07:30:02,417 - lava_callback - ERROR - Error processing callback for node 69f5a7e3ed4ed40b02242bc4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57510 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:31:02,380 - lava_callback - INFO - Received callback for node 69f5a82fed4ed40b02242bec INFO: 172.20.0.1:44812 - "POST /node/69f5a82fed4ed40b02242bec HTTP/1.0" 202 Accepted 2026-05-04 07:31:02,389 - lava_callback - INFO - Starting async job submit for node 69f5a82fed4ed40b02242bec 2026-05-04 07:31:02,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:31:02,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a82fed4ed40b02242bec HTTP/1.1" 200 None 2026-05-04 07:31:02,409 - lava_callback - DEBUG - Processing node 69f5a82fed4ed40b02242bec: baseline-arm64-clabbe 2026-05-04 07:31:02,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a82fed4ed40b02242bec 2026-05-04 07:31:02,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:31:02,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a82fed4ed40b02242bec HTTP/1.1" 200 None 2026-05-04 07:31:02,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:31:02,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 07:31:02,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:31:02,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a82fed4ed40b02242bec HTTP/1.1" 200 None 2026-05-04 07:31:02,470 - lava_callback - ERROR - Error processing callback for node 69f5a82fed4ed40b02242bec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46810 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:33:02,382 - lava_callback - INFO - Received callback for node 69f5a898ed4ed40b02242c07 INFO: 172.20.0.1:45248 - "POST /node/69f5a898ed4ed40b02242c07 HTTP/1.0" 202 Accepted 2026-05-04 07:33:02,387 - lava_callback - INFO - Starting async job submit for node 69f5a898ed4ed40b02242c07 2026-05-04 07:33:02,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:33:02,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a898ed4ed40b02242c07 HTTP/1.1" 200 None 2026-05-04 07:33:02,403 - lava_callback - DEBUG - Processing node 69f5a898ed4ed40b02242c07: baseline-arm64-clabbe 2026-05-04 07:33:02,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a898ed4ed40b02242c07 2026-05-04 07:33:02,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:33:02,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a898ed4ed40b02242c07 HTTP/1.1" 200 None 2026-05-04 07:33:02,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:33:02,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 07:33:02,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:33:02,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a898ed4ed40b02242c07 HTTP/1.1" 200 None 2026-05-04 07:33:02,450 - lava_callback - ERROR - Error processing callback for node 69f5a898ed4ed40b02242c07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52632 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:34:02,482 - lava_callback - INFO - Received callback for node 69f5a8e4ed4ed40b02242c2e INFO: 172.20.0.1:43208 - "POST /node/69f5a8e4ed4ed40b02242c2e HTTP/1.0" 202 Accepted 2026-05-04 07:34:02,487 - lava_callback - INFO - Starting async job submit for node 69f5a8e4ed4ed40b02242c2e 2026-05-04 07:34:02,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:34:02,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a8e4ed4ed40b02242c2e HTTP/1.1" 200 None 2026-05-04 07:34:02,502 - lava_callback - DEBUG - Processing node 69f5a8e4ed4ed40b02242c2e: baseline-arm64-clabbe 2026-05-04 07:34:02,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a8e4ed4ed40b02242c2e 2026-05-04 07:34:02,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:34:02,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a8e4ed4ed40b02242c2e HTTP/1.1" 200 None 2026-05-04 07:34:02,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:34:02,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 07:34:02,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:34:02,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a8e4ed4ed40b02242c2e HTTP/1.1" 200 None 2026-05-04 07:34:02,562 - lava_callback - ERROR - Error processing callback for node 69f5a8e4ed4ed40b02242c2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58096 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:37:02,571 - lava_callback - INFO - Received callback for node 69f5a988ed4ed40b02242c6a INFO: 172.20.0.1:45646 - "POST /node/69f5a988ed4ed40b02242c6a HTTP/1.0" 202 Accepted 2026-05-04 07:37:02,577 - lava_callback - INFO - Starting async job submit for node 69f5a988ed4ed40b02242c6a 2026-05-04 07:37:02,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:37:02,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a988ed4ed40b02242c6a HTTP/1.1" 200 None 2026-05-04 07:37:02,592 - lava_callback - DEBUG - Processing node 69f5a988ed4ed40b02242c6a: baseline-arm64-clabbe 2026-05-04 07:37:02,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a988ed4ed40b02242c6a 2026-05-04 07:37:02,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:37:02,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a988ed4ed40b02242c6a HTTP/1.1" 200 None 2026-05-04 07:37:02,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:37:02,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 07:37:02,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:37:02,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a988ed4ed40b02242c6a HTTP/1.1" 200 None 2026-05-04 07:37:02,650 - lava_callback - ERROR - Error processing callback for node 69f5a988ed4ed40b02242c6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57142 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:38:02,658 - lava_callback - INFO - Received callback for node 69f5a9d2ed4ed40b02242c95 INFO: 172.20.0.1:43306 - "POST /node/69f5a9d2ed4ed40b02242c95 HTTP/1.0" 202 Accepted 2026-05-04 07:38:02,664 - lava_callback - INFO - Starting async job submit for node 69f5a9d2ed4ed40b02242c95 2026-05-04 07:38:02,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:38:02,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a9d2ed4ed40b02242c95 HTTP/1.1" 200 None 2026-05-04 07:38:02,679 - lava_callback - DEBUG - Processing node 69f5a9d2ed4ed40b02242c95: baseline-arm64-clabbe 2026-05-04 07:38:02,679 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5a9d2ed4ed40b02242c95 2026-05-04 07:38:02,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:38:02,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5a9d2ed4ed40b02242c95 HTTP/1.1" 200 None 2026-05-04 07:38:02,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:38:02,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-04 07:38:02,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:38:02,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5a9d2ed4ed40b02242c95 HTTP/1.1" 200 None 2026-05-04 07:38:02,726 - lava_callback - ERROR - Error processing callback for node 69f5a9d2ed4ed40b02242c95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39342 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:39:09,293 - lava_callback - INFO - Received callback for node 69f5aa14ed4ed40b02242cad INFO: 172.20.0.1:39344 - "POST /node/69f5aa14ed4ed40b02242cad HTTP/1.0" 202 Accepted 2026-05-04 07:39:09,298 - lava_callback - INFO - Starting async job submit for node 69f5aa14ed4ed40b02242cad 2026-05-04 07:39:09,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:39:09,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5aa14ed4ed40b02242cad HTTP/1.1" 200 None 2026-05-04 07:39:09,320 - lava_callback - DEBUG - Processing node 69f5aa14ed4ed40b02242cad: baseline-arm64-baylibre 2026-05-04 07:39:09,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5aa14ed4ed40b02242cad 2026-05-04 07:39:09,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:39:09,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5aa14ed4ed40b02242cad HTTP/1.1" 200 None 2026-05-04 07:39:09,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:39:09,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 07:39:09,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:39:09,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5aa14ed4ed40b02242cad HTTP/1.1" 200 None 2026-05-04 07:39:09,377 - lava_callback - ERROR - Error processing callback for node 69f5aa14ed4ed40b02242cad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53814 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:40:29,310 - lava_callback - INFO - Received callback for node 69f5aa5fed4ed40b02242ccb INFO: 172.20.0.1:53828 - "POST /node/69f5aa5fed4ed40b02242ccb HTTP/1.0" 202 Accepted 2026-05-04 07:40:29,316 - lava_callback - INFO - Starting async job submit for node 69f5aa5fed4ed40b02242ccb 2026-05-04 07:40:29,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:40:29,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5aa5fed4ed40b02242ccb HTTP/1.1" 200 None 2026-05-04 07:40:29,339 - lava_callback - DEBUG - Processing node 69f5aa5fed4ed40b02242ccb: baseline-arm64-baylibre 2026-05-04 07:40:29,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5aa5fed4ed40b02242ccb 2026-05-04 07:40:29,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:40:29,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5aa5fed4ed40b02242ccb HTTP/1.1" 200 None 2026-05-04 07:40:29,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:40:29,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 07:40:29,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:40:29,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5aa5fed4ed40b02242ccb HTTP/1.1" 200 None 2026-05-04 07:40:29,385 - lava_callback - ERROR - Error processing callback for node 69f5aa5fed4ed40b02242ccb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33612 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:41:49,379 - lava_callback - INFO - Received callback for node 69f5aaaaed4ed40b02242cef INFO: 172.20.0.1:33626 - "POST /node/69f5aaaaed4ed40b02242cef HTTP/1.0" 202 Accepted 2026-05-04 07:41:49,384 - lava_callback - INFO - Starting async job submit for node 69f5aaaaed4ed40b02242cef 2026-05-04 07:41:49,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:41:49,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5aaaaed4ed40b02242cef HTTP/1.1" 200 None 2026-05-04 07:41:49,399 - lava_callback - DEBUG - Processing node 69f5aaaaed4ed40b02242cef: baseline-arm64-baylibre 2026-05-04 07:41:49,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5aaaaed4ed40b02242cef 2026-05-04 07:41:49,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:41:49,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5aaaaed4ed40b02242cef HTTP/1.1" 200 None 2026-05-04 07:41:49,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:41:49,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 07:41:49,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:41:49,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5aaaaed4ed40b02242cef HTTP/1.1" 200 None 2026-05-04 07:41:49,451 - lava_callback - ERROR - Error processing callback for node 69f5aaaaed4ed40b02242cef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50986 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:42:49,419 - lava_callback - INFO - Received callback for node 69f5aaf5ed4ed40b02242d0e INFO: 172.20.0.1:51002 - "POST /node/69f5aaf5ed4ed40b02242d0e HTTP/1.0" 202 Accepted 2026-05-04 07:42:49,426 - lava_callback - INFO - Starting async job submit for node 69f5aaf5ed4ed40b02242d0e 2026-05-04 07:42:49,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:42:49,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5aaf5ed4ed40b02242d0e HTTP/1.1" 200 None 2026-05-04 07:42:49,441 - lava_callback - DEBUG - Processing node 69f5aaf5ed4ed40b02242d0e: baseline-arm64-baylibre 2026-05-04 07:42:49,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5aaf5ed4ed40b02242d0e 2026-05-04 07:42:49,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:42:49,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5aaf5ed4ed40b02242d0e HTTP/1.1" 200 None 2026-05-04 07:42:49,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:42:49,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 07:42:49,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:42:49,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5aaf5ed4ed40b02242d0e HTTP/1.1" 200 None 2026-05-04 07:42:49,488 - lava_callback - ERROR - Error processing callback for node 69f5aaf5ed4ed40b02242d0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35496 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:44:09,500 - lava_callback - INFO - Received callback for node 69f5ab3fed4ed40b02242d33 INFO: 172.20.0.1:35506 - "POST /node/69f5ab3fed4ed40b02242d33 HTTP/1.0" 202 Accepted 2026-05-04 07:44:09,505 - lava_callback - INFO - Starting async job submit for node 69f5ab3fed4ed40b02242d33 2026-05-04 07:44:09,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:44:09,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ab3fed4ed40b02242d33 HTTP/1.1" 200 None 2026-05-04 07:44:09,526 - lava_callback - DEBUG - Processing node 69f5ab3fed4ed40b02242d33: baseline-arm64-baylibre 2026-05-04 07:44:09,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5ab3fed4ed40b02242d33 2026-05-04 07:44:09,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:44:09,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ab3fed4ed40b02242d33 HTTP/1.1" 200 None 2026-05-04 07:44:09,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:44:09,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 07:44:09,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:44:09,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5ab3fed4ed40b02242d33 HTTP/1.1" 200 None 2026-05-04 07:44:09,574 - lava_callback - ERROR - Error processing callback for node 69f5ab3fed4ed40b02242d33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43142 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:45:29,656 - lava_callback - INFO - Received callback for node 69f5ab8bed4ed40b02242d50 INFO: 172.20.0.1:43152 - "POST /node/69f5ab8bed4ed40b02242d50 HTTP/1.0" 202 Accepted 2026-05-04 07:45:29,662 - lava_callback - INFO - Starting async job submit for node 69f5ab8bed4ed40b02242d50 2026-05-04 07:45:29,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:45:29,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ab8bed4ed40b02242d50 HTTP/1.1" 200 None 2026-05-04 07:45:29,677 - lava_callback - DEBUG - Processing node 69f5ab8bed4ed40b02242d50: baseline-arm64-baylibre 2026-05-04 07:45:29,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5ab8bed4ed40b02242d50 2026-05-04 07:45:29,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:45:29,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ab8bed4ed40b02242d50 HTTP/1.1" 200 None 2026-05-04 07:45:29,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:45:29,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-04 07:45:29,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:45:29,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5ab8bed4ed40b02242d50 HTTP/1.1" 200 None 2026-05-04 07:45:29,736 - lava_callback - ERROR - Error processing callback for node 69f5ab8bed4ed40b02242d50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48378 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:47:29,897 - lava_callback - INFO - Received callback for node 69f5ac04ed4ed40b02242d72 INFO: 172.20.0.1:52138 - "POST /node/69f5ac04ed4ed40b02242d72 HTTP/1.0" 202 Accepted 2026-05-04 07:47:29,902 - lava_callback - INFO - Starting async job submit for node 69f5ac04ed4ed40b02242d72 2026-05-04 07:47:29,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:47:29,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ac04ed4ed40b02242d72 HTTP/1.1" 200 None 2026-05-04 07:47:29,928 - lava_callback - DEBUG - Processing node 69f5ac04ed4ed40b02242d72: baseline-arm-baylibre 2026-05-04 07:47:29,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5ac04ed4ed40b02242d72 2026-05-04 07:47:29,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:47:29,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ac04ed4ed40b02242d72 HTTP/1.1" 200 None 2026-05-04 07:47:29,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:47:29,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-04 07:47:29,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:47:29,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5ac04ed4ed40b02242d72 HTTP/1.1" 200 None 2026-05-04 07:47:29,992 - lava_callback - ERROR - Error processing callback for node 69f5ac04ed4ed40b02242d72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45782 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:48:09,734 - lava_callback - INFO - Received callback for node 69f5ac2ced4ed40b02242d80 INFO: 172.20.0.1:44090 - "POST /node/69f5ac2ced4ed40b02242d80 HTTP/1.0" 202 Accepted 2026-05-04 07:48:09,740 - lava_callback - INFO - Starting async job submit for node 69f5ac2ced4ed40b02242d80 2026-05-04 07:48:09,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:48:09,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ac2ced4ed40b02242d80 HTTP/1.1" 200 None 2026-05-04 07:48:09,755 - lava_callback - DEBUG - Processing node 69f5ac2ced4ed40b02242d80: baseline-arm-baylibre 2026-05-04 07:48:09,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5ac2ced4ed40b02242d80 2026-05-04 07:48:09,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:48:09,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ac2ced4ed40b02242d80 HTTP/1.1" 200 None 2026-05-04 07:48:09,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:48:09,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-04 07:48:09,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:48:09,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5ac2ced4ed40b02242d80 HTTP/1.1" 200 None 2026-05-04 07:48:09,802 - lava_callback - ERROR - Error processing callback for node 69f5ac2ced4ed40b02242d80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55554 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:48:49,774 - lava_callback - INFO - Received callback for node 69f5ac51ed4ed40b02242d8c INFO: 172.20.0.1:55218 - "POST /node/69f5ac51ed4ed40b02242d8c HTTP/1.0" 202 Accepted 2026-05-04 07:48:49,780 - lava_callback - INFO - Starting async job submit for node 69f5ac51ed4ed40b02242d8c 2026-05-04 07:48:49,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:48:49,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ac51ed4ed40b02242d8c HTTP/1.1" 200 None 2026-05-04 07:48:49,795 - lava_callback - DEBUG - Processing node 69f5ac51ed4ed40b02242d8c: baseline-arm-baylibre 2026-05-04 07:48:49,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5ac51ed4ed40b02242d8c 2026-05-04 07:48:49,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:48:49,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ac51ed4ed40b02242d8c HTTP/1.1" 200 None 2026-05-04 07:48:49,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:48:49,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-04 07:48:49,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:48:49,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5ac51ed4ed40b02242d8c HTTP/1.1" 200 None 2026-05-04 07:48:49,851 - lava_callback - ERROR - Error processing callback for node 69f5ac51ed4ed40b02242d8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34064 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:49:29,766 - lava_callback - INFO - Received callback for node 69f5ac76ed4ed40b02242d99 INFO: 172.20.0.1:41328 - "POST /node/69f5ac76ed4ed40b02242d99 HTTP/1.0" 202 Accepted 2026-05-04 07:49:29,771 - lava_callback - INFO - Starting async job submit for node 69f5ac76ed4ed40b02242d99 2026-05-04 07:49:29,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:49:29,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ac76ed4ed40b02242d99 HTTP/1.1" 200 None 2026-05-04 07:49:29,787 - lava_callback - DEBUG - Processing node 69f5ac76ed4ed40b02242d99: baseline-arm-baylibre 2026-05-04 07:49:29,787 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5ac76ed4ed40b02242d99 2026-05-04 07:49:29,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:49:29,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ac76ed4ed40b02242d99 HTTP/1.1" 200 None 2026-05-04 07:49:29,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:49:29,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-04 07:49:29,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:49:29,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5ac76ed4ed40b02242d99 HTTP/1.1" 200 None 2026-05-04 07:49:29,837 - lava_callback - ERROR - Error processing callback for node 69f5ac76ed4ed40b02242d99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46864 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:49:49,825 - lava_callback - INFO - Received callback for node 69f5ac9aed4ed40b02242da7 INFO: 172.20.0.1:49846 - "POST /node/69f5ac9aed4ed40b02242da7 HTTP/1.0" 202 Accepted 2026-05-04 07:49:49,831 - lava_callback - INFO - Starting async job submit for node 69f5ac9aed4ed40b02242da7 2026-05-04 07:49:49,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:49:49,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ac9aed4ed40b02242da7 HTTP/1.1" 200 None 2026-05-04 07:49:49,852 - lava_callback - DEBUG - Processing node 69f5ac9aed4ed40b02242da7: baseline-arm-baylibre 2026-05-04 07:49:49,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5ac9aed4ed40b02242da7 2026-05-04 07:49:49,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:49:49,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5ac9aed4ed40b02242da7 HTTP/1.1" 200 None 2026-05-04 07:49:49,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:49:49,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-04 07:49:49,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:49:49,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5ac9aed4ed40b02242da7 HTTP/1.1" 200 None 2026-05-04 07:49:49,898 - lava_callback - ERROR - Error processing callback for node 69f5ac9aed4ed40b02242da7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35610 - "GET / HTTP/1.0" 200 OK 2026-05-04 07:50:30,175 - lava_callback - INFO - Received callback for node 69f5acbeed4ed40b02242db4 INFO: 172.20.0.1:59772 - "POST /node/69f5acbeed4ed40b02242db4 HTTP/1.0" 202 Accepted 2026-05-04 07:50:30,181 - lava_callback - INFO - Starting async job submit for node 69f5acbeed4ed40b02242db4 2026-05-04 07:50:30,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:50:30,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5acbeed4ed40b02242db4 HTTP/1.1" 200 None 2026-05-04 07:50:30,196 - lava_callback - DEBUG - Processing node 69f5acbeed4ed40b02242db4: baseline-arm-baylibre 2026-05-04 07:50:30,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5acbeed4ed40b02242db4 2026-05-04 07:50:30,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:50:30,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5acbeed4ed40b02242db4 HTTP/1.1" 200 None 2026-05-04 07:50:30,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:50:30,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-04 07:50:30,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 07:50:30,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5acbeed4ed40b02242db4 HTTP/1.1" 200 None 2026-05-04 07:50:30,250 - lava_callback - ERROR - Error processing callback for node 69f5acbeed4ed40b02242db4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45878 - "GET / HTTP/1.0" 200 OK 2026-05-04 08:06:31,154 - lava_callback - INFO - Received callback for node 69f5b07fed4ed40b02242dde INFO: 172.20.0.1:46556 - "POST /node/69f5b07fed4ed40b02242dde HTTP/1.0" 202 Accepted 2026-05-04 08:06:31,160 - lava_callback - INFO - Starting async job submit for node 69f5b07fed4ed40b02242dde 2026-05-04 08:06:31,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:06:31,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b07fed4ed40b02242dde HTTP/1.1" 200 None 2026-05-04 08:06:31,178 - lava_callback - DEBUG - Processing node 69f5b07fed4ed40b02242dde: baseline-arm-baylibre 2026-05-04 08:06:31,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5b07fed4ed40b02242dde 2026-05-04 08:06:31,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:06:31,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b07fed4ed40b02242dde HTTP/1.1" 200 None 2026-05-04 08:06:31,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:06:31,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 08:06:31,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:06:31,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5b07fed4ed40b02242dde HTTP/1.1" 200 None 2026-05-04 08:06:31,242 - lava_callback - ERROR - Error processing callback for node 69f5b07fed4ed40b02242dde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41954 - "GET / HTTP/1.0" 200 OK 2026-05-04 08:07:30,752 - lava_callback - INFO - Received callback for node 69f5b0bbed4ed40b02242def INFO: 172.20.0.1:48102 - "POST /node/69f5b0bbed4ed40b02242def HTTP/1.0" 202 Accepted 2026-05-04 08:07:30,759 - lava_callback - INFO - Starting async job submit for node 69f5b0bbed4ed40b02242def 2026-05-04 08:07:30,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:07:30,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b0bbed4ed40b02242def HTTP/1.1" 200 None 2026-05-04 08:07:30,783 - lava_callback - DEBUG - Processing node 69f5b0bbed4ed40b02242def: baseline-arm-baylibre 2026-05-04 08:07:30,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5b0bbed4ed40b02242def 2026-05-04 08:07:30,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:07:30,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b0bbed4ed40b02242def HTTP/1.1" 200 None 2026-05-04 08:07:30,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:07:30,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 08:07:30,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:07:30,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5b0bbed4ed40b02242def HTTP/1.1" 200 None 2026-05-04 08:07:30,840 - lava_callback - ERROR - Error processing callback for node 69f5b0bbed4ed40b02242def: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35578 - "GET / HTTP/1.0" 200 OK 2026-05-04 08:08:10,804 - lava_callback - INFO - Received callback for node 69f5b0deed4ed40b02242dfc INFO: 172.20.0.1:43540 - "POST /node/69f5b0deed4ed40b02242dfc HTTP/1.0" 202 Accepted 2026-05-04 08:08:10,810 - lava_callback - INFO - Starting async job submit for node 69f5b0deed4ed40b02242dfc 2026-05-04 08:08:10,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:08:10,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b0deed4ed40b02242dfc HTTP/1.1" 200 None 2026-05-04 08:08:10,826 - lava_callback - DEBUG - Processing node 69f5b0deed4ed40b02242dfc: baseline-arm-baylibre 2026-05-04 08:08:10,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5b0deed4ed40b02242dfc 2026-05-04 08:08:10,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:08:10,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b0deed4ed40b02242dfc HTTP/1.1" 200 None 2026-05-04 08:08:10,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:08:10,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 08:08:10,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:08:10,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5b0deed4ed40b02242dfc HTTP/1.1" 200 None 2026-05-04 08:08:10,871 - lava_callback - ERROR - Error processing callback for node 69f5b0deed4ed40b02242dfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK 2026-05-04 08:08:50,825 - lava_callback - INFO - Received callback for node 69f5b102ed4ed40b02242e0a INFO: 172.20.0.1:56290 - "POST /node/69f5b102ed4ed40b02242e0a HTTP/1.0" 202 Accepted 2026-05-04 08:08:50,831 - lava_callback - INFO - Starting async job submit for node 69f5b102ed4ed40b02242e0a 2026-05-04 08:08:50,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:08:50,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b102ed4ed40b02242e0a HTTP/1.1" 200 None 2026-05-04 08:08:50,846 - lava_callback - DEBUG - Processing node 69f5b102ed4ed40b02242e0a: baseline-arm-baylibre 2026-05-04 08:08:50,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5b102ed4ed40b02242e0a 2026-05-04 08:08:50,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:08:50,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b102ed4ed40b02242e0a HTTP/1.1" 200 None 2026-05-04 08:08:50,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:08:50,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 08:08:50,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:08:50,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5b102ed4ed40b02242e0a HTTP/1.1" 200 None 2026-05-04 08:08:50,899 - lava_callback - ERROR - Error processing callback for node 69f5b102ed4ed40b02242e0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47218 - "GET / HTTP/1.0" 200 OK 2026-05-04 08:09:30,885 - lava_callback - INFO - Received callback for node 69f5b136ed4ed40b02242e1c INFO: 172.20.0.1:53990 - "POST /node/69f5b136ed4ed40b02242e1c HTTP/1.0" 202 Accepted 2026-05-04 08:09:30,890 - lava_callback - INFO - Starting async job submit for node 69f5b136ed4ed40b02242e1c 2026-05-04 08:09:30,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:09:30,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b136ed4ed40b02242e1c HTTP/1.1" 200 None 2026-05-04 08:09:30,905 - lava_callback - DEBUG - Processing node 69f5b136ed4ed40b02242e1c: baseline-arm-baylibre 2026-05-04 08:09:30,905 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5b136ed4ed40b02242e1c 2026-05-04 08:09:30,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:09:30,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b136ed4ed40b02242e1c HTTP/1.1" 200 None 2026-05-04 08:09:30,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:09:30,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 08:09:30,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:09:30,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5b136ed4ed40b02242e1c HTTP/1.1" 200 None 2026-05-04 08:09:30,952 - lava_callback - ERROR - Error processing callback for node 69f5b136ed4ed40b02242e1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58734 - "GET / HTTP/1.0" 200 OK 2026-05-04 08:10:10,888 - lava_callback - INFO - Received callback for node 69f5b15aed4ed40b02242e28 INFO: 172.20.0.1:56000 - "POST /node/69f5b15aed4ed40b02242e28 HTTP/1.0" 202 Accepted 2026-05-04 08:10:10,893 - lava_callback - INFO - Starting async job submit for node 69f5b15aed4ed40b02242e28 2026-05-04 08:10:10,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:10:10,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b15aed4ed40b02242e28 HTTP/1.1" 200 None 2026-05-04 08:10:10,924 - lava_callback - DEBUG - Processing node 69f5b15aed4ed40b02242e28: baseline-arm-baylibre 2026-05-04 08:10:10,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5b15aed4ed40b02242e28 2026-05-04 08:10:10,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:10:10,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b15aed4ed40b02242e28 HTTP/1.1" 200 None 2026-05-04 08:10:10,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:10:10,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 08:10:10,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:10:10,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5b15aed4ed40b02242e28 HTTP/1.1" 200 None 2026-05-04 08:10:10,992 - lava_callback - ERROR - Error processing callback for node 69f5b15aed4ed40b02242e28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45988 - "GET / HTTP/1.0" 200 OK 2026-05-04 08:10:43,824 - lava_callback - INFO - Received callback for node 69f5b17fed4ed40b02242e35 INFO: 172.20.0.1:49848 - "POST /node/69f5b17fed4ed40b02242e35 HTTP/1.0" 202 Accepted 2026-05-04 08:10:43,829 - lava_callback - INFO - Starting async job submit for node 69f5b17fed4ed40b02242e35 2026-05-04 08:10:43,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:10:43,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b17fed4ed40b02242e35 HTTP/1.1" 200 None 2026-05-04 08:10:43,846 - lava_callback - DEBUG - Processing node 69f5b17fed4ed40b02242e35: baseline-arm-clabbe 2026-05-04 08:10:43,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f5b17fed4ed40b02242e35 2026-05-04 08:10:43,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:10:43,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b17fed4ed40b02242e35 HTTP/1.1" 200 None 2026-05-04 08:10:43,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:10:43,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-04 08:10:43,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 08:10:43,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f5b17fed4ed40b02242e35 HTTP/1.1" 200 None 2026-05-04 08:10:43,892 - lava_callback - ERROR - Error processing callback for node 69f5b17fed4ed40b02242e35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]